Sensitivity and Validity of Psychometric Tests for Assessing Driving Impairment: Effects of Sleep Deprivation

PubMed Central

Jongen, Stefan; Perrier, Joy; Vuurman, Eric F.; Ramaekers, Johannes G.; Vermeeren, Annemiek

2015-01-01

Objective To assess drug induced driving impairment, initial screening is needed. However, no consensus has been reached about which initial screening tools have to be used. The present study aims to determine the ability of a battery of psychometric tests to detect performance impairing effects of clinically relevant levels of drowsiness as induced by one night of sleep deprivation. Methods Twenty four healthy volunteers participated in a 2-period crossover study in which the highway driving test was conducted twice: once after normal sleep and once after one night of sleep deprivation. The psychometric tests were conducted on 4 occasions: once after normal sleep (at 11 am) and three times during a single night of sleep deprivation (at 1 am, 5 am, and 11 am). Results On-the-road driving performance was significantly impaired after sleep deprivation, as measured by an increase in Standard Deviation of Lateral Position (SDLP) of 3.1 cm compared to performance after a normal night of sleep. At 5 am, performance in most psychometric tests showed significant impairment. As expected, largest effect sizes were found on performance in the Psychomotor Vigilance Test (PVT). Large effects sizes were also found in the Divided Attention Test (DAT), the Attention Network Test (ANT), and the test for Useful Field of View (UFOV) at 5 and 11 am during sleep deprivation. Effects of sleep deprivation on SDLP correlated significantly with performance changes in the PVT and the DAT, but not with performance changes in the UFOV. Conclusion From the psychometric tests used in this study, the PVT and DAT seem most promising for initial evaluation of drug impairment based on sensitivity and correlations with driving impairment. Further studies are needed to assess the sensitivity and validity of these psychometric tests after benchmark sedative drug use. PMID:25668292

Online Friendship, Romance, and Sex: Properties and Associations of the Online Relationship Initiation Scale.

PubMed

Harris, Keith M; Aboujaoude, Elias

2016-08-01

Online relationships are increasingly central to many people's lives. As a result, there is a growing need to scientifically examine their psychosocial implications. This study developed and tested the Online Relationship Initiation Scale (ORIS) through classical and item response theory analyses to address this need. An anonymous online survey included 713 adults, aged 18-71 years. The ORIS was tested on psychometric properties and examined for associations with gender and several standardized psychosocial measures. Results demonstrated unidimensionality of nine items, strong factor loadings, and high internal consistency (α = 0.90, ωt = 0.94). All items captured significant information on the latent trait and none showed differential item functioning by sex, age group, or ethnicity. General linear modeling confirmed hypotheses that men were more likely than women to initiate online relationships. Online relationship initiation was not strongly associated with perceived social support, but was positively related to financial distress, and willingness to engage in infidelity or unprotected sex. The ORIS was negatively associated with age and satisfaction with life and showed modest interactions with ethnicity and hours online. This study provided empirical evidence for an interpersonal relationship initiation construct. The ORIS was shown to be a psychometrically sound instrument for evaluating online interpersonal behaviors and their associations with psychosocial and demographic factors. Such psychometrically sound instruments can be useful in exploring online interpersonal behaviors and their significance.

Current Status of the Matson Evaluation of Drug Side Effects (MEDS)

ERIC Educational Resources Information Center

Matson, Johnny L.; Cervantes, Paige E.

2013-01-01

The Matson Evaluation of Drug Side Effects (MEDS) is currently the best established and most researched measure of drug side effects in the intellectual disability (ID) literature. Initial research was conducted on its psychometric properties such as reliability and validity. More recent research studies have used the measure to determine the…

The Law Enforcement Officer Stress Survey (LEOSS): Evaluation of Psychometric Properties

ERIC Educational Resources Information Center

Van Hasselt, Vincent B.; Sheehan, Donald C.; Malcolm, Abigail S.; Sellers, Alfred H.; Baker, Monty T.; Couwels, Judy

2008-01-01

This study establishes the reliability and validity of the Law Enforcement Officer Stress Survey (LEOSS), a short early-warning stress-screening measure for law enforcement officers. The initial phase of LEOSS development employed the behavioral-analytic model to construct a 25-item instrument specifically geared toward evaluation of stress in…

Development of the Contact Lens User Experience: CLUE Scales

PubMed Central

Wirth, R. J.; Edwards, Michael C.; Henderson, Michael; Henderson, Terri; Olivares, Giovanna; Houts, Carrie R.

2016-01-01

ABSTRACT Purpose The field of optometry has become increasingly interested in patient-reported outcomes, reflecting a common trend occurring across the spectrum of healthcare. This article reviews the development of the Contact Lens User Experience: CLUE system designed to assess patient evaluations of contact lenses. CLUE was built using modern psychometric methods such as factor analysis and item response theory. Methods The qualitative process through which relevant domains were identified is outlined as well as the process of creating initial item banks. Psychometric analyses were conducted on the initial item banks and refinements were made to the domains and items. Following this data-driven refinement phase, a second round of data was collected to further refine the items and obtain final item response theory item parameters estimates. Results Extensive qualitative work identified three key areas patients consider important when describing their experience with contact lenses. Based on item content and psychometric dimensionality assessments, the developing CLUE instruments were ultimately focused around four domains: comfort, vision, handling, and packaging. Item response theory parameters were estimated for the CLUE item banks (377 items), and the resulting scales were found to provide precise and reliable assignment of scores detailing users’ subjective experiences with contact lenses. Conclusions The CLUE family of instruments, as it currently exists, exhibits excellent psychometric properties. PMID:27383257

Pediatric Sleep Questionnaires as Diagnostic or Epidemiological Tools: A Review of Currently Available Instruments

PubMed Central

Spruyt, Karen; Gozal, David

2010-01-01

An extensive list of published and unpublished instruments used to investigate or evaluate sleep issues in children was collected and assessed based on the fundamental operational principles of instrument development (11 steps). Of all the available tools identified, only a few were validated and standardized using appropriate psychometric criteria. In fact, only 2 fulfill all desirable criteria and approximately 11 instruments seem to adhere to most of the psychometric tool development requirements, and were therefore assessed in greater detail. Notwithstanding, in the rapidly developing scientific world of pediatric sleep, there are too many tools being used that have not undergone careful and methodical psychometric evaluation, and as such may be fraught with biased or invalid findings. It is hoped that this initial effort in categorizing and assessing available tools for pediatric sleep will serve as recognition of the relatively early developmental stage of our field, and provide the necessary impetus for future tool development using multicentered approaches and adequate methodologies. PMID:20934896

Design and testing of classroom and clinical teaching evaluation tools for nursing education.

PubMed

Emerson, Roberta J; Records, Kathie

2007-01-01

Student evaluations of teaching provide administrators an overall picture of the effectiveness of personnel and contribute data for promotion and merit decisions. These evaluations must be assessed for their relevance, validity, and reliability. This paper describes the development process and psychometric testing for clinical (n = 149) and didactic (n = 148) student evaluation of teaching forms for undergraduate and graduate courses in one college of nursing. Validity and reliability results were quite strong for the instruments, both of which evidenced a one-factor solution with factor loadings ranging from .68-.88 and Cronbach's alphas of .96 (Classroom) and .95 (Clinical). The clinical and classroom evaluation tools are relatively short, decreasing the burden on students who need to complete the instruments for multiple instructors in any one semester. Initial testing of the psychometric properties of the tools supports their continued use in colleges of nursing.

Development and Validation of a New Questionnaire Assessing Quality of Life in Adults with Hypopituitarism: Adult Hypopituitarism Questionnaire (AHQ)

PubMed Central

Ishii, Hitoshi; Shimatsu, Akira; Okimura, Yasuhiko; Tanaka, Toshiaki; Hizuka, Naomi; Kaji, Hidesuke; Hanew, Kunihiko; Oki, Yutaka; Yamashiro, Sayuri; Takano, Koji; Chihara, Kazuo

2012-01-01

Objective To develop and validate the Adult Hypopituitarism Questionnaire (AHQ) as a disease-specific, self-administered questionnaire for evaluation of quality of life (QOL) in adult patients with hypopituitarism. Methods We developed and validated this new questionnaire, using a standardized procedure which included item development, pilot-testing and psychometric validation. Of the patients who participated in psychometric validation, those whose clinical conditions were judged to be stable were asked to answer the survey questionnaire twice, in order to assess test-retest reliability. Results Content validity of the initial questionnaire was evaluated via two pilot tests. After these tests, we made minor revisions and finalized the initial version of the questionnaire. The questionnaire was constructed with two domains, one psycho-social and the other physical. For psychometric assessment, analyses were performed on the responses of 192 adult patients with various types of hypopituitarism. The intraclass correlations of the respective domains were 0.91 and 0.95, and the Cronbach’s alpha coefficients were 0.96 and 0.95, indicating adequate test-retest reliability and internal consistency for each domain. For known-group validity, patients with hypopituitarism due to hypothalamic disorder showed significantly lower scores in 11 out of 13 sub-domains compared to those who had hypopituitarism due to pituitary disorder. Regarding construct validity, the domain structure was found to be almost the same as that initially hypothesized. Exploratory factor analysis (n = 228) demonstrated that each domain consisted of six and seven sub-domains. Conclusion The AHQ showed good reliability and validity for evaluating QOL in adult patients with hypopituitarism. PMID:22984490

Initial evaluation of the Older Adult Social-Evaluative Situations Questionnaire: a measure of social anxiety in older adults.

PubMed

Gould, Christine E; Gerolimatos, Lindsay A; Ciliberti, Caroline M; Edelstein, Barry A; Smith, Merideth D

2012-12-01

The assessment of social anxiety in late life has been examined in few studies (e.g. Gretarsdottir et al., 2004; Ciliberti et al., 2011). The present study describes the creation and initial psychometric evaluation of a new, content valid measure of social anxiety for older adults, the Older Adult Social-Evaluative Situations Questionnaire (OASES). Psychometric properties of the OASES were evaluated in a community dwelling sample of older adults (N = 137; 70.8% female). Convergent validity was established by examining the relation between the OASES and the Liebowitz Social Anxiety Scale (LSAS), Social Phobia and Anxiety Inventory (SPAI), and Beck Anxiety Inventory (BAI). Discriminant validity was established by examining the relation between the OASES and measures of depression (Geriatric Depression Scale, GDS), perceived health status (Short Form Health Survey, SF-12), and demographic variables. The validity analyses of the OASES were based on a smaller sample with n values ranging from 98 to 137 depending on missing data on each questionnaire. Internal consistency, measured by Cronbach's α, for the OASES total score was 0.96. All items on the OASES were endorsed by participants. Convergent validity was demonstrated by medium to large correlations with the SPAI, LSAS, and BAI. Support for discriminant validity was evidenced by small to medium correlations between the OASES and GDS, SF-12, and demographic variables. Evidence in support of convergent and discriminant validity of the OASES is discussed. Although the results from the present study suggest that this measure may assess anxiety in and avoidance of social situations salient to older adults, future studies are needed to further examine the psychometric properties of the OASES and replicate these results in both clinical and more diverse samples of older adults.

Design process and preliminary psychometric study of a video game to detect cognitive impairment in senior adults.

PubMed

Valladares-Rodriguez, Sonia; Perez-Rodriguez, Roberto; Facal, David; Fernandez-Iglesias, Manuel J; Anido-Rifon, Luis; Mouriño-Garcia, Marcos

2017-01-01

Assessment of episodic memory has been traditionally used to evaluate potential cognitive impairments in senior adults. Typically, episodic memory evaluation is based on personal interviews and pen-and-paper tests. This article presents the design, development and a preliminary validation of a novel digital game to assess episodic memory intended to overcome the limitations of traditional methods, such as the cost of its administration, its intrusive character, the lack of early detection capabilities, the lack of ecological validity, the learning effect and the existence of confounding factors. Our proposal is based on the gamification of the California Verbal Learning Test (CVLT) and it has been designed to comply with the psychometric characteristics of reliability and validity. Two qualitative focus groups and a first pilot experiment were carried out to validate the proposal. A more ecological, non-intrusive and better administrable tool to perform cognitive assessment was developed. Initial evidence from the focus groups and pilot experiment confirmed the developed game's usability and offered promising results insofar its psychometric validity is concerned. Moreover, the potential of this game for the cognitive classification of senior adults was confirmed, and administration time is dramatically reduced with respect to pen-and-paper tests. Additional research is needed to improve the resolution of the game for the identification of specific cognitive impairments, as well as to achieve a complete validation of the psychometric properties of the digital game. Initial evidence show that serious games can be used as an instrument to assess the cognitive status of senior adults, and even to predict the onset of mild cognitive impairments or Alzheimer's disease.

Design process and preliminary psychometric study of a video game to detect cognitive impairment in senior adults

PubMed Central

Perez-Rodriguez, Roberto; Facal, David; Fernandez-Iglesias, Manuel J.; Anido-Rifon, Luis; Mouriño-Garcia, Marcos

2017-01-01

Introduction Assessment of episodic memory has been traditionally used to evaluate potential cognitive impairments in senior adults. Typically, episodic memory evaluation is based on personal interviews and pen-and-paper tests. This article presents the design, development and a preliminary validation of a novel digital game to assess episodic memory intended to overcome the limitations of traditional methods, such as the cost of its administration, its intrusive character, the lack of early detection capabilities, the lack of ecological validity, the learning effect and the existence of confounding factors. Materials and Methods Our proposal is based on the gamification of the California Verbal Learning Test (CVLT) and it has been designed to comply with the psychometric characteristics of reliability and validity. Two qualitative focus groups and a first pilot experiment were carried out to validate the proposal. Results A more ecological, non-intrusive and better administrable tool to perform cognitive assessment was developed. Initial evidence from the focus groups and pilot experiment confirmed the developed game’s usability and offered promising results insofar its psychometric validity is concerned. Moreover, the potential of this game for the cognitive classification of senior adults was confirmed, and administration time is dramatically reduced with respect to pen-and-paper tests. Limitations Additional research is needed to improve the resolution of the game for the identification of specific cognitive impairments, as well as to achieve a complete validation of the psychometric properties of the digital game. Conclusion Initial evidence show that serious games can be used as an instrument to assess the cognitive status of senior adults, and even to predict the onset of mild cognitive impairments or Alzheimer’s disease. PMID:28674661

Systematic review of the psychometric properties of the questionnaire to evaluate the adherence to HIV therapy (CEAT-VIH).

PubMed

Remor, Eduardo

2013-01-01

Since the use of the questionnaire to evaluate adherence to HIV therapy (acronym CEAT-VIH) has increased in the last decade and translation into new language versions has been requested, summarizing information regarding the psychometric properties of the instrument may be useful for researchers and practitioners. The purpose of this work was to review the psychometric properties of the questionnaire CEAT-VIH, available from published studies and research reports. Medline, PsycINFO, Google Scholar and Google; the searched period was from 2001 to 2012. Forty-eight research materials referring to the questionnaire CEAT-VIH were initially gathered from academic databases and direct contact with researchers, before being analyzed. From the initial pool of material compiled (i.e., abstracts, technical reports or database files, dissertations or complete articles), only 20 comprised original data. The selected research material described a variety of information in terms of the psychometric properties of the questionnaire. The results from the primary studies were then summarized in tables for evaluation, description and comparison. Thirteen out of 16 studies reported a Cronbach's alpha value of above 0.70, supporting the internal consistency reliability of the CEAT-VIH questionnaire. No floor or ceiling effects were observed. Hypothesized relationships between the CEAT-VIH score and adherence-related variables (e.g., viral load, CD4+, compliance evaluated by physician or pharmacist, complexity of treatment and pill numbers) were observed, indicating validity evidence. Thus, variables expected to act as psychological risk factors for low adherence (e.g., stress, depression and anxiety) or protector factor (e.g., social support) to good adherence were observed. The scores of the questionnaire were also related to quality of life outcomes. Moreover, patients that received adherence intervention showed increased CEAT-VIH adherence scores. Sensitivity and specificity to correctly identify adherent patients with undetectable viral load were also observed for three studies. Although the data provided in the reports were heterogeneous, these were valuable and reported enough evidence of validity for the instrument. The selected studies represented 41.7 % of those initially identified, and only eight out of 20 documents were peer reviewed. The CEAT-VIH has been used for a variety of individuals of different ages, sex, socioeconomic and educational backgrounds. It has been a reliable and valid tool in measuring adherence to HIV treatment among different samples, and has been used with a wide range of study populations and countries (i.e., Brazil, Chile, Colombia, Mexico, Panama, Peru, Portugal, Puerto Rico, Romania and Spain). Encouraging data reported here may allow the recommendation of the CEAT-VIH as a valuable measure to use in HIV adherence research, especially in countries where the questionnaire already has available psychometric evidence.

A psychometric evaluation of an advanced pharmacy practice experience clinical competency framework.

PubMed

Douglas Ried, L; Doty, Randell E; Nemire, Ruth E

2015-03-25

To assess the psychometric properties of the clinical competency framework known as the System of Universal Clinical Competency Evaluation in the Sunshine State (SUCCESS), including its internal consistency and content, construct, and criterion validity. Sub-competency items within each hypothesized competency pair were subjected to principal components factor analysis to demonstrate convergent and discriminant validity. Varimax rotation was conducted for each competency pair (eg, competency 1 vs competency 2, competency 1 vs competency 3, competency 2 vs competency 3). Internal consistency was evaluated using Cronbach alpha. Of the initial 78 pairings, 44 (56%) demonstrated convergent and discriminant validity. Five pairs of competencies were unidimensional. Of the 34 pairs where at least 1 competency was multidimensional, most (91%) were from competencies 7, 11, and 12, indicating modifications were warranted in those competencies. After reconfiguring the competencies, 76 (94%) of the 81 pairs resulted in 2 factors as required. A unidimensional factor emerged when all 13 of the competencies were entered into a factor analysis. The internal consistency of all of the competencies was satisfactory. Psychometric evaluation shows the SUCCESS framework demonstrates adequate reliability and validity for most competencies. However, it also provides guidance where improvements are needed as part of a continuous quality improvement program.

A preliminary psychometric evaluation of Music in Dementia Assessment Scales (MiDAS).

PubMed

McDermott, Orii; Orgeta, Vasiliki; Ridder, Hanne Mette; Orrell, Martin

2014-06-01

Music in Dementia Assessment Scales (MiDAS), an observational outcome measure for music therapy with people with moderate to severe dementia, was developed from qualitative data of focus groups and interviews. Expert and peer consultations were conducted at each stage of the scale development to maximize its content validity. This study aimed to evaluate the psychometric properties of MiDAS. Care home residents with dementia attended weekly group music therapy for up to ten sessions. Music therapists and care home staff were requested to complete weekly MiDAS ratings. The Quality of Life Scale (QoL-AD) was completed at three time-points. A total of 629 (staff = 306, therapist = 323) MiDAS forms were completed. The statistical analysis revealed that MiDAS has high therapist inter-rater reliability, low staff inter-rater reliability, adequate staff test-retest reliability, adequate concurrent validity, and good construct validity. High factor loadings between the five MiDAS Visual Analogue Scale (VAS) items, levels of Interest, Response, Initiation, Involvement, and Enjoyment, were found. This study indicates that MiDAS has good psychometric properties despite the small sample size. Future research with a larger sample size could provide a more in-depth psychometric evaluation, including further exploration of the underlying factors. MiDAS provides a measure of engagement with musical experience and offers insight into who is likely to benefit on other outcomes such as quality of life or reduction in psychiatric symptoms.

Initial Development and Psychometric Data for the Privilege and Oppression Inventory

ERIC Educational Resources Information Center

Hays, Danica G.; Chang, Catherine Y.; Decker, Scott L.

2007-01-01

The authors describe the development of the Privilege and Oppression Inventory, a measure that assesses counselors' awareness of privilege and oppression along dimensions of race, sexual orientation, religion, and gender. Initial item development as well as psychometric information derived from factor analyses, reliability estimation, and…

The Depression Inventory Development Workgroup: A Collaborative, Empirically Driven Initiative to Develop a New Assessment Tool for Major Depressive Disorder.

PubMed

Vaccarino, Anthony L; Evans, Kenneth R; Kalali, Amir H; Kennedy, Sidney H; Engelhardt, Nina; Frey, Benicio N; Greist, John H; Kobak, Kenneth A; Lam, Raymond W; MacQueen, Glenda; Milev, Roumen; Placenza, Franca M; Ravindran, Arun V; Sheehan, David V; Sills, Terrence; Williams, Janet B W

2016-01-01

The Depression Inventory Development project is an initiative of the International Society for CNS Drug Development whose goal is to develop a comprehensive and psychometrically sound measurement tool to be utilized as a primary endpoint in clinical trials for major depressive disorder. Using an iterative process between field testing and psychometric analysis and drawing upon expertise of international researchers in depression, the Depression Inventory Development team has established an empirically driven and collaborative protocol for the creation of items to assess symptoms in major depressive disorder. Depression-relevant symptom clusters were identified based on expert clinical and patient input. In addition, as an aid for symptom identification and item construction, the psychometric properties of existing clinical scales (assessing depression and related indications) were evaluated using blinded datasets from pharmaceutical antidepressant drug trials. A series of field tests in patients with major depressive disorder provided the team with data to inform the iterative process of scale development. We report here an overview of the Depression Inventory Development initiative, including results of the third iteration of items assessing symptoms related to anhedonia, cognition, fatigue, general malaise, motivation, anxiety, negative thinking, pain and appetite. The strategies adopted from the Depression Inventory Development program, as an empirically driven and collaborative process for scale development, have provided the foundation to develop and validate measurement tools in other therapeutic areas as well.

Development and Initial Psychometric Evaluation of the Sport Interference Checklist

ERIC Educational Resources Information Center

Donohue, Brad; Silver, N. Clayton; Dickens, Yani; Covassin, Tracey; Lancer, Kevin

2007-01-01

The Sport Interference Checklist (SIC) was developed in 141 athletes to assist in the concurrent assessment of cognitive and behavioral problems experienced by athletes in both training (Problems in Sports Training Scale, PSTS) and competition (Problems in Sports Competition Scale, PSCS). An additional scale (Desire for Sport Psychology Scale,…

Evaluation of the Self-Stigma of Stuttering Scale (4S)

ERIC Educational Resources Information Center

Boyle, Michael P.

2013-01-01

Purpose: To create a psychometrically sound scale that measures different levels of internalized stigma (i.e., self-stigma) among adults who stutter and to analyze factor structure, reliability, and initial construct validity of the scale. Method: Two-hundred ninety-one adults who stutter were recruited from Board Recognized Specialists in Fluency…

Considerations for Test Selection: How Do Validity and Reliability Impact Diagnostic Decisions?

ERIC Educational Resources Information Center

Friberg, Jennifer C.

2010-01-01

Nine preschool and school-age language assessment tools found to have acceptable levels of identification accuracy were evaluated to determine their overall levels of psychometric validity for use in diagnosing the presence/absence of language impairment. Eleven specific criteria based on those initially devised by McCauley and Swisher (1984) were…

Development and Initial Validation of the Self-Directed Learning Inventory with Korean College Students

ERIC Educational Resources Information Center

Suh, Han Na; Wang, Kenneth T.; Arterberry, Brooke J.

2015-01-01

This article describes the development and psychometric evaluation of the Self-Directed Learning Inventory (SDLI) tailored to Korean college students, based on study evidences of differences in learning behavior across culture and educational level. With a sample of 605 female college students in Korea, exploratory factor analysis (EFA) results…

Development and Assessment of the Social Issues Advocacy Scale

ERIC Educational Resources Information Center

Nilsson, Johanna E.; Marszalek, Jacob M.; Linnemeyer, Rachel M.; Bahner, Angela D.; Misialek, Leah Hanson

2011-01-01

This article describes the development and the initial psychometric evaluation of the Social Issues Advocacy Scale in two studies. In the first study, an exploratory factor analysis (n = 278) revealed a four-factor scale, accounting for 71.4% of the variance, measuring different aspects of social issue advocacy: Political and Social Advocacy,…

Validation of the Social Appearance Anxiety Scale: Factor, Convergent, and Divergent Validity

ERIC Educational Resources Information Center

Levinson, Cheri A.; Rodebaugh, Thomas L.

2011-01-01

The Social Appearance Anxiety Scale (SAAS) was created to assess fear of overall appearance evaluation. Initial psychometric work indicated that the measure had a single-factor structure and exhibited excellent internal consistency, test-retest reliability, and convergent validity. In the current study, the authors further examined the factor,…

The Construction and Initial Validation of the "Student Teachers' Efficacy Scale for Teaching Students with Disabilities"

ERIC Educational Resources Information Center

Zhang, Dake; Wang, Qiu; Stegall, Joanna; Losinki, Mickey; Katsiyannis, Antonis

2018-01-01

Although there have been numerous instruments for assessing teacher efficacy in teaching general education students, there is a need to develop and validate an instrument that specifically assesses teachers' efficacy in teaching students with disabilities. This study constructed and evaluated the psychometric properties of the "Student…

Development of a Drug Use Resistance Self-Efficacy (DURSE) Scale

ERIC Educational Resources Information Center

Carpenter, Carrie M.; Howard, Donna

2009-01-01

Objectives: To develop and evaluate psychometric properties of a new instrument, the drug use resistance self-efficacy (DURSE) scale, designed for young adolescents. Methods: Scale construction occurred in 3 phases: (1) initial development, (2) pilot testing of preliminary items, and (3) final scale administration among a sample of seventh graders…

Initial Validation of the Teacher/Coach Role Conflict Scale

ERIC Educational Resources Information Center

Richards, K. Andrew R.; Levesque-Bristol, Chantal; Templin, Thomas J.

2014-01-01

The study of teacher/coach role conflict has a long history in the physical education literature. However, only a few studies have measured the construct using psychometric instrumentation. Ryan (2008) created one such instrument, but the survey was not validated prior to use. As such, the purpose of this investigation was to evaluate the…

Initial Validation of the Activity Choice Index among Overweight Women

ERIC Educational Resources Information Center

Mullen, Sean P.; Silva, Marlene N.; Sardinha, Luís B.; Teixeira, Pedro J.

2016-01-01

Purpose: This prospective study was designed to evaluate psychometric properties of the Activity Choice Index (ACI), a measure for assessing one's choice to engage in more effortful, physically active behaviors in the course of daily routines over less-demanding, sedentary behaviors, in a sample of overweight women. Method: The sample included 192…

A New Clinical Pain Knowledge Test for Nurses: Development and Psychometric Evaluation.

PubMed

Bernhofer, Esther I; St Marie, Barbara; Bena, James F

2017-08-01

All nurses care for patients with pain, and pain management knowledge and attitude surveys for nurses have been around since 1987. However, no validated knowledge test exists to measure postlicensure clinicians' knowledge of the core competencies of pain management in current complex patient populations. To develop and test the psychometric properties of an instrument designed to measure pain management knowledge of postlicensure nurses. Psychometric instrument validation. Four large Midwestern U.S. hospitals. Registered nurses employed full time and part time August 2015 to April 2016, aged M = 43.25 years; time as RN, M = 16.13 years. Prospective survey design using e-mail to invite nurses to take an electronic multiple choice pain knowledge test. Content validity of initial 36-item test "very good" (95.1% agreement). Completed tests that met analysis criteria, N = 747. Mean initial test score, 69.4% correct (range 27.8-97.2). After revision/removal of 13 unacceptable questions, mean test score was 50.4% correct (range 8.7-82.6). Initial test item percent difficulty range was 15.2%-98.1%; discrimination values range, 0.03-0.50; final test item percent difficulty range, 17.6%-91.1%, discrimination values range, -0.04 to 1.04. Split-half reliability final test was 0.66. A high decision consistency reliability was identified, with test cut-score of 75%. The final 23-item Clinical Pain Knowledge Test has acceptable discrimination, difficulty, decision consistency, reliability, and validity in the general clinical inpatient nurse population. This instrument will be useful in assessing pain management knowledge of clinical nurses to determine gaps in education, evaluate knowledge after pain management education, and measure research outcomes. Copyright © 2017 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Development and psychometric pilot-testing of a questionnaire for the evaluation of satisfaction with continuing education in infection control nurses.

PubMed

Meng, Michael; Peter, Daniel; Mattner, Frauke; Igel, Christoph; Kugler, Christiane

2018-05-16

Satisfaction with continuing education can be defined as positive attitudes towards educational programs, which has potential to strengthen learning outcomes. A multi-dimensional construct may enhance continuing education program evaluation processes. The objective is to describe the development and psychometric testing of the 'affective - behavioral - cognitive - satisfaction questionnaire' (ABC-SAT) for assessing participants' satisfaction with a continuing education program for nurses in infection control. The multi-staged development of a satisfaction questionnaire comprised of three subscales. The pilot tool was administered to a nationwide sample of 126 infection control nurses to assess satisfaction after participating in a continuing education program. Satisfaction scores were calculated and psychometric testing was performed to determine reliability, using Cronbach's alpha, face validity, objectivity, and economy. A principle component analysis using varimax rotation and Kaiser normalization was performed. The analysis led to a three-factor solution of the questionnaire with 11 items, explaining 61.4% of the variance. Internal consistency of three scales using Cronbach's alpha was 0.83, 0.60, and 0.66, respectively. Selectivity coefficients varied between 0.39 and 0.70. Participants needed approximately three minutes to complete the questionnaire. Initial findings refer to a satisfying scale structure and internal consistency of the 3-dimensional ABC-SAT questionnaire. Further research is required to confirm the questionnaires' psychometric properties. Copyright © 2018 Elsevier Ltd. All rights reserved.

Development and evaluation of the INSPIRE measure of staff support for personal recovery.

PubMed

Williams, Julie; Leamy, Mary; Bird, Victoria; Le Boutillier, Clair; Norton, Sam; Pesola, Francesca; Slade, Mike

2015-05-01

No individualised standardised measure of staff support for mental health recovery exists. To develop and evaluate a measure of staff support for recovery. initial draft of measure based on systematic review of recovery processes; consultation (n = 61); and piloting (n = 20). Psychometric evaluation: three rounds of data collection from mental health service users (n = 92). INSPIRE has two sub-scales. The 20-item Support sub-scale has convergent validity (0.60) and adequate sensitivity to change. Exploratory factor analysis (variance 71.4-85.1 %, Kaiser-Meyer-Olkin 0.65-0.78) and internal consistency (range 0.82-0.85) indicate each recovery domain is adequately assessed. The 7-item Relationship sub-scale has convergent validity 0.69, test-retest reliability 0.75, internal consistency 0.89, a one-factor solution (variance 70.5 %, KMO 0.84) and adequate sensitivity to change. A 5-item Brief INSPIRE was also evaluated. INSPIRE and Brief INSPIRE demonstrate adequate psychometric properties, and can be recommended for research and clinical use.

Development of the multiple sclerosis (MS) early mobility impairment questionnaire (EMIQ).

PubMed

Ziemssen, Tjalf; Phillips, Glenn; Shah, Ruchit; Mathias, Adam; Foley, Catherine; Coon, Cheryl; Sen, Rohini; Lee, Andrew; Agarwal, Sonalee

2016-10-01

The Early Mobility Impairment Questionnaire (EMIQ) was developed to facilitate early identification of mobility impairments in multiple sclerosis (MS) patients. We describe the initial development of the EMIQ with a focus on the psychometric evaluation of the questionnaire using classical and item response theory methods. The initial 20-item EMIQ was constructed by clinical specialists and qualitatively tested among people with MS and physicians via cognitive interviews. Data from an observational study was used to make additional updates to the instrument based on exploratory factor analysis (EFA) and item response theory (IRT) analysis, and psychometric analyses were performed to evaluate the reliability and validity of the final instrument's scores and screening properties (i.e., sensitivity and specificity). Based on qualitative interview analyses, a revised 15-item EMIQ was included in the observational study. EFA, IRT and item-to-item correlation analyses revealed redundant items which were removed leading to the final nine-item EMIQ. The nine-item EMIQ performed well with respect to: test-retest reliability (ICC = 0.858); internal consistency (α = 0.893); convergent validity; and known-groups methods for construct validity. A cut-point of 41 on the 0-to-100 scale resulted in sufficient sensitivity and specificity statistics for viably identifying patients with mobility impairment. The EMIQ is a content valid and psychometrically sound instrument for capturing MS patients' experience with mobility impairments in a clinical practice setting. Additional research is suggested to further confirm the EMIQ's screening properties over time.

Systematic Review and Critical Analysis of Measures of Social Support Used in Studies of Persons With Type 2 Diabetes.

PubMed

Al-Dwaikat, Tariq N; Hall, Lynne A

2017-08-01

Social support is linked to improved glycemic control and psychosocial well-being of patients diagnosed with Type 2 diabetes mellitus. The purpose was to critically evaluate the psychometric properties of social support measures used in this population. A systematic review of measures of social support was performed using 5 databases. Two hundred and fifty-six studies were initially retrieved, and 48 studies met the inclusion criteria for review. The majority used general measures of perceived social support. Only 17% measured positive and negative social support; 92% used a single measure of social support. The Medical Outcomes Study Social Support Survey (MOS-SSS) was used in 25% of the studies. Using a combination of social support measures and further evaluation of their psychometric properties in this population is recommended.

A review of the Child and Adolescent Social Support Scale for Healthy Behaviors.

PubMed

Cullum, Kristiana G H; Mayo, Ann M

2015-01-01

Assessing an instrument's psychometric properties to determine appropriateness for use can be a challenging process. Dissecting the statistical terminology may be even more perplexing. There are several instruments that evaluate adolescents' perceived social support, but a fairly new instrument related to this construct assesses not only the availability of social support but also support for healthy behaviors in this population. The Child and Adolescent Social Support Scale for Healthy Behaviors, first published in 2013, demonstrates adequate initial reliability and validity. The purpose of this article is to review the psychometric properties of the Child and Adolescent Social Support Scale for Healthy Behaviors and potential uses of the instrument.

The Social Cognition Psychometric Evaluation Study: Results of the Expert Survey and RAND Panel

PubMed Central

Pinkham, Amy E.; Penn, David L.; Green, Michael F.; Buck, Benjamin; Healey, Kristin; Harvey, Philip D.

2014-01-01

Background: In schizophrenia, social cognition is strongly linked to functional outcome and is increasingly seen as a viable treatment target. The goal of the Social Cognition Psychometric Evaluation (SCOPE) study is to identify and improve the best existing measures of social cognition so they can be suitably applied in large-scale treatment studies. Initial phases of this project sought to (1) develop consensus on critical domains of social cognition and (2) identify the best existing measures of social cognition for use in treatment studies. Methods: Experts in social cognition were invited to nominate key domains of social cognition and the best measures of those domains. Nominations for measures were reduced according to set criteria, and all available psychometric information about these measures was summarized and provided to RAND panelists. Panelists rated the quality of each measure on multiple criteria, and diverging ratings were discussed at the in-person meeting to obtain consensus. Results: Expert surveys identified 4 core domains of social cognition—emotion processing, social perception, theory of mind/mental state attribution, and attributional style/bias. Using RAND panel consensus ratings, the following measures were selected for further evaluation: Ambiguous Intentions Hostility Questionnaire, Bell Lysaker Emotion Recognition Task, Penn Emotion Recognition Test, Relationships Across Domains, Reading the Mind in the Eyes Test, The Awareness of Social Inferences Test, Hinting Task, and Trustworthiness Task. Discussion: While it was possible to establish consensus, only a limited amount of psychometric information is currently available for the candidate measures, which underscores the need for well-validated and standardized measures in this area. PMID:23728248

Development and Initial Psychometric Properties of the Computer Assisted Maltreatment Inventory (CAMI): A Comprehensive Self-Report Measure of Child Maltreatment History

ERIC Educational Resources Information Center

DiLillo, David; Hayes-Skelton, Sarah A.; Fortier, Michelle A.; Perry, Andrea R.; Evans, Sarah E.; Messman Moore, Terri L.; Walsh, Kate; Nash, Cindy; Fauchier, Angele

2010-01-01

Objectives: The present study reports on the development and initial psychometric properties of the Computer Assisted Maltreatment Inventory (CAMI), a web-based self-report measure of child maltreatment history, including sexual and physical abuse, exposure to interparental violence, psychological abuse, and neglect. Methods: The CAMI was…

Forging Harmony in the Social Organism: Industry and the Power of Psychometric Techniques

ERIC Educational Resources Information Center

Herman, Frederik

2014-01-01

This article analyses the initiating role of the steel industry in educational selection by means of psychometric techniques used in the psycho-physiological laboratory associated with a vocational school in Luxembourg founded in 1914. It first considers the origins of, and initial meanings bestowed upon, this first (and perhaps also last)…

The Milwaukee Inventory for Styles of Trichotillomania-Child Version (MIST-C): Initial Development and Psychometric Properties

ERIC Educational Resources Information Center

Flessner, Christopher A.; Woods, Douglas W.; Franklin, Martin E.; Keuthen, Nancy J.; Piacentini, John; Cashin, Susan E.; Moore, Phoebe S.

2007-01-01

This article describes the development and initial psychometric properties of the Milwaukee Inventory for Styles of Trichotillomania-Child Version (MIST-C), a self-report scale designed to assess styles of hair pulling in children and adolescents diagnosed with trichotillomania (TTM). Using Internet sampling procedures, the authors recruited 164…

Evaluation of Instrumental Activities of Daily Living in Greek Patients with Advanced Cancer

ERIC Educational Resources Information Center

Mystakidou, Kyriaki; Parpa, Efi; Tsilika, Eleni; Panagiotoua, Irene; Roumeliotou, Anna; Symeonidi, Matina; Galanos, Antonis; Kouvaris, Ioannis

2013-01-01

Translation of the instrumental activities of daily living (IADL) was carried out and its psychometric properties were assessed in a Greek sample of patients with advanced cancer. The scale was translated with the forward-backward procedure into the Greek language. It was initially administered to 136 advanced cancer patients. To assess…

Self-Reported Acceptance of Social Anxiety Symptoms: Development and Validation of the Social Anxiety-Acceptance and Action Questionnaire

ERIC Educational Resources Information Center

MacKenzie, Meagan B.; Kocovski, Nancy L.

2010-01-01

Mindfulness and acceptance-based interventions have been used in social anxiety treatments with initial success. Further research requires the psychometrically sound measurement of mechanisms of change associated with these treatments. This research was conducted to develop and evaluate such a measure, the Social Anxiety-Acceptance and Action…

An Initial Psychometric Evaluation of the CBCL 6-18 in a Sample of Youth with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Pandolfi, Vincent; Magyar, Caroline I.; Dill, Charles A.

2012-01-01

Individuals with an autism spectrum disorder (ASD) often present with co-occurring emotional and behavioral disorders (EBD). The Child Behavior Checklist 6-18 (CBCL; Achenbach & Rescorla, 2001) is an EBD measure that contains several norm-referenced scales derived through factor analysis of data from the general pediatric population. The…

Exercising with Passion: Initial Validation of the Passion Scale in Exercise

ERIC Educational Resources Information Center

Parastatidou, Irini S.; Doganis, Georgios; Theodorakis, Yannis; Vlachopoulos, Symeon P.

2012-01-01

The purpose of the researchers in the study was to psychometrically evaluate Passion Scale scores (Vallerand et al., 2003) in exercise. Self-report data were collected from two samples of Greek exercise participants. Sample 1 (n = 217) provided data on the Passion Scale and the self-determination theory variables of perceived autonomy support by…

The Development and Initial Psychometric Evaluation of the Korean Career Stress Inventory for College Students

ERIC Educational Resources Information Center

Choi, Bo Young; Park, Heerak; Nam, Suk Kyung; Lee, Jayoung; Cho, Daeyeon; Lee, Sang Min

2011-01-01

The purpose of this study was to develop a Korean College Stress Inventory (KCSI), which is designed to measure Korean college students' experiences and symptoms of career stress. Even though there have been numerous scales related to career issues, few scales measure the career stress construct and its dimensions. Factor structure, internal…

The SASSI-3 Face Valid other Drugs Scale: A Psychometric Investigation (Substance Abuse Subtle Screening Inventory-3)

ERIC Educational Resources Information Center

Laux, John M.; Perera-Diltz, Dilani; Smirnoff, Jennifer B.; Salyers, Kathleen M.

2005-01-01

The authors investigated the psychometric capabilities of the Face Valid Other Drugs (FVOD) scale of the Substance Abuse Subtle Screening Inventory-3 (SASSI-3; G. A. Miller, 1999). Internal consistency reliability estimates and construct validity factor analysis for 230 college students provided initial support for the psychometric properties of…

Development and psychometric properties of the Inner Strength Scale.

PubMed

Lundman, Berit; Viglund, Kerstin; Aléx, Lena; Jonsén, Elisabeth; Norberg, Astrid; Fischer, Regina Santamäki; Strandberg, Gunilla; Nygren, Björn

2011-10-01

Four dimensions of inner strength were previously identified in a meta-theoretical analysis: firmness, creativity, connectedness, and flexibility. The aim of this study was to develop an Inner Strength Scale (ISS) based on those four dimensions and to evaluate its psychometric properties. An initial version of ISS was distributed for validation purpose with the Rosenberg Self-Esteem Scale, the resilience scale, and the sense of Coherence Scale. A convenience sample of 391 adults, aged 19-90 years participated. Principal component analysis (PCA) and confirmatory factor analysis (CFA) were used in the process of exploring, evaluating, and reducing the 63-item ISS to the 20-item ISS. Cronbach's alpha and test-retest were used to measure reliability. CFA showed satisfactory goodness-of-fit for the 20-item ISS. The analysis supported a fourfactor solution explaining 51% of the variance. Cronbach's alpha on the 20-item ISS was 0.86, and the test-retest showed stability over time (r=0.79). The ISS was found to be a valid and reliable instrument for capturing a multifaceted understanding of inner strength. Further tests of psychometric properties of the ISS will be performed in forthcoming studies. Copyright © 2011 Elsevier Ltd. All rights reserved.

Child-Report Measures of Occupational Performance: A Systematic Review

PubMed Central

Totino, Rebekah; Doma, Kenji; Leicht, Anthony; Brown, Nicole; Cuomo, Belinda

2016-01-01

Introduction Improving occupational performance is a key service of occupational therapists and client-centred approach to care is central to clinical practice. As such it is important to comprehensively evaluate the quality of psychometric properties reported across measures of occupational performance; in order to guide assessment and treatment planning. Objective To systematically review the literature on the psychometric properties of child-report measures of occupational performance for children ages 2–18 years. Methods A systematic search of the following six electronic databases was conducted: CINAHL; PsycINFO; EMBASE; PubMed; the Health and Psychosocial Instruments (HAPI) database; and Google Scholar. The quality of the studies was evaluated against the COSMIN taxonomy of measurement properties and the overall quality of psychometric properties was evaluated using pre-set psychometric criteria. Results Fifteen articles and one manual were reviewed to assess the psychometric properties of the six measures–the PEGS, MMD, CAPE, PAC, COSA, and OSA- which met the inclusion criteria. Most of the measures had conducted good quality studies to evaluate the psychometric properties of measures (PEGS, CAPE, PAC, OSA); however, the quality of the studies for two of these measures was relatively weak (MMD, COSA). When integrating the quality of the psychometric properties of the measures with the quality of the studies, the PAC stood out as having superior psychometric qualities. Conclusions The overall quality of the psychometric properties of most measures was limited. There is a need for continuing research into the psychometric properties of child-report measures of occupational performance, and to revise and improve the psychometric properties of existing measures. PMID:26808674

Development and psychometric evaluation of the Personal Growth Initiative Scale-II.

PubMed

Robitschek, Christine; Ashton, Matthew W; Spering, Cynthia C; Geiger, Nathaniel; Byers, Danielle; Schotts, G Christian; Thoen, Megan A

2012-04-01

The original Personal Growth Initiative Scale (PGIS; Robitschek, 1998) was unidimensional, despite theory identifying multiple components (e.g., cognition and behavior) of personal growth initiative (PGI). The present research developed a multidimensional measure of the complex process of PGI, while retaining the brief and psychometrically sound properties of the original scale. Study 1 focused on scale development, including theoretical derivation of items, assessing factor structure, reducing number of items, and refining the scale length using samples of college students. Study 2 consisted of confirmatory factor analysis with 3 independent samples of college students and community members. Lastly, Study 3 assessed test-retest reliability over 1-, 2-, 4-, and 6-week periods and tests of concurrent and discriminant validity using samples of college students. The final measure, the Personal Growth Initiative Scale-II (PGIS-II), includes 4 subscales: Readiness for Change, Planfulness, Using Resources, and Intentional Behavior. These studies provide exploratory and confirmatory evidence for the 4-factor structure, strong internal consistency for the subscales and overall score across samples, acceptable temporal stability at all assessed intervals, and concurrent and discriminant validity of the PGIS-II. Future directions for research and clinical practice are discussed.

Development of Patient-reported Outcomes Measure of Pharmaceutical Therapy for Quality of Life (PROMPT-QoL): A novel instrument for medication management.

PubMed

Sakthong, Phantipa; Suksanga, Phattrapa; Sakulbumrungsil, Rungpetch; Winit-Watjana, Win

2015-01-01

Medicines can affect a patient's health-related quality of life (HRQoL), but there exists no standardized HRQoL measure for medication management. To develop the new HRQoL instrument "Patient-reported Outcomes Measure of Pharmaceutical Therapy for Quality of Life" (PROMPT-QoL), and to evaluate its content validity and preliminary psychometrics using a Rasch model. The PROMPT-QoL questionnaire was developed through the concept review, item generation, cognitive interviews, and initial psychometric evaluation. Its first draft was initially tested by Round-1 interviews of 120 adult outpatients taking their medicines at least three months continuously. The final draft with 43 items was then constructed and checked by 10 physicians and 5 pharmacists for the questionnaire importance and content validity. Round-2 interviews in six patient groups with 10 patients of each were conducted to elicit patients' understanding of the questionnaire and assess preliminary psychometrics using the Rasch analysis, including fit statistics, person and item reliabilities. The 43-item PROMPT-QoL comprised 10 domains: General Attitude toward Medication Use, Medicine Information, Disease Information, Medicine Effectiveness, Impacts of Medicines and Side-effects, Psychological Impacts of Medication Use, Convenience, Availability and Accessibility, Therapeutic Relationship with Healthcare Providers, and Overall QoL. Based on the patient interviews and expert review, the questionnaire was considered important, useful, and comprehensive. All items and domains yielded content validity indexes above the acceptable values of 0.80 and 0.90, respectively. In Round 2, thirty-nine problems identified in Group 1 were reduced to two issues in Group 6 after amendments. The Rasch analysis revealed eight items were misfit and two domains were reliable for both personal and item aspects (Medicine Information and Psychological Impacts of Medication Use). The newly developed PROMPT-QoL has favorable content validity and appropriate preliminary results. Further studies in large patient groups are required to test its complete psychometric properties. Copyright © 2015 Elsevier Inc. All rights reserved.

An initial evaluation of the Social Communication Questionnaire for the assessment of autism spectrum disorders in children with Down syndrome.

PubMed

Magyar, Caroline I; Pandolfi, Vincent; Dill, Charles A

2012-02-01

This study investigated the psychometric properties of the Social Communication Questionnaire (SCQ) in a sample of children with Down syndrome (DS), many of whom had a co-occurring autism spectrum disorder (ASD). The SCQ is a widely used ASD screening measure; however, its measurement properties have not been comprehensively evaluated specifically in children with DS, a group that seems to be at higher risk for an ASD. Exploratory and confirmatory factor analyses, scale reliability, convergent and discriminant correlations, significance tests between groups of children with DS and DS + ASD, and diagnostic accuracy analyses were conducted. Factor analyses identified 2 reliable factors that we labeled Social-Communication and Stereotyped Behavior and Unusual Interests. Pearson correlations with Autism Diagnostic Interview-Revised subscales indicated support for the SCQ's convergent validity and some support for the discriminant validity of the factor-based scales. Significance tests and receiver operating characteristic analyses indicated that children with DS + ASD obtained significantly higher SCQ factor-based and total scores than children with DS alone, and that the SCQ Total Score evidenced good sensitivity and adequate specificity. Results indicated initial psychometric support for the SCQ as an ASD screening measure in children with DS. The SCQ should be considered as part of a multimethod evaluation when screening children with DS.

Psychometric properties of the brief version of the Fear of Negative Evaluation Scale in a Turkish sample.

PubMed

Koydemir, Selda; Demir, Ayhan

2007-06-01

The purpose of the study was to report initial data on the psychometric properties of the Brief Fear of Negative Evaluation Scale. The scale was applied to a nonclinical sample of 250 (137 women, 113 men) Turkish undergraduate students selected randomly from Middle East Technical University. Their mean age was 20.4 yr. (SD= 1.9). The factor structure of the Turkish version, its criterion validity, and internal reliability coefficients were assessed. Although maximum likelihood factor analysis initially indicated that the scale had only one factor, a forced two-factor solution accounted for more variance (61%) in scale scores than a single factor. The straightforward items loaded on the first factor, and the reverse-coded items loaded on the second factor. The total score was significantly positively correlated with scores on the Revised Cheek and Buss Shyness Scale and significantly negatively correlated with scores on the Rosenberg Self-Esteem Scale. Factor 1 (straightforward items) correlated more highly with both Shyness and Self-esteem than Factor 2 (reverse-coded items). Internal consistency estimate was .94 for the Total scores, .91 for the Factor 1 (straightforward items), and .87 for the Factor 2 (reverse-coded items). No sex differences were evident for Fear of Negative Evaluation.

Young Learners: An Examination of the Psychometric Properties of the Early Literacy Knowledge and Skills Instrument

ERIC Educational Resources Information Center

Chan, Man Ching Esther

2015-01-01

The Early Literacy Knowledge and Skills (ELKS) instrument was informed by the work of Ferreiro and Teberosky based on the notion that young children could be differentiated according to levels of sophistication in their understanding of the rules of written language. As an initial step to evaluate the instrument for teaching purposes, the present…

Psychometric Evaluation of the Tagalog and German Subjective Happiness Scales and a Cross-Cultural Comparison

ERIC Educational Resources Information Center

Swami, Viren; Stieger, Stefan; Voracek, Martin; Dressler, Stefan G.; Eisma, Laura; Furnham, Adrian

2009-01-01

The Subjective Happiness Scale (SHS) has recently been developed as a more complete measure for the assessment of molar subjective happiness. In the present study, we report on the translation and validation of German and Tagalog versions of the SHS and conduct an initial cross-cultural examination of subjective happiness. In Study 1, 960…

Interpersonal and Affective Dimensions of Psychopathic Traits in Adolescents: Development and Validation of a Self-Report Instrument

ERIC Educational Resources Information Center

Houghton, Stephen; Hunter, Simon C.; Khan, Umneea; Tan, Carol

2013-01-01

We report the development and psychometric evaluations of a self-report instrument designed to screen for psychopathic traits among mainstream community adolescents. Tests of item functioning were initially conducted with 26 adolescents. In a second study the new instrument was administered to 150 high school adolescents, 73 of who had school…

Initial Psychometric Properties of a Brief Parent-Report Instrument for Assessing Tic Severity in Children with Chronic Tic Disorders

ERIC Educational Resources Information Center

Chang, Susanna; Himle, Michael B.; Tucker, Benjamin T. P.; Woods, Douglas W.; Piacentini, John

2009-01-01

This article describes the development and initial psychometric properties of the Parent Tic Questionnaire (PTQ)--a new measure assessing the number, frequency, and intensity of motor and vocal tics in children and adolescents with Chronic Tic Disorder (CTD). Parents of 40 children with a CTD completed the PTQ as part of a larger assessment…

Development of a scale to measure individuals’ ratings of peace

PubMed Central

2014-01-01

Background The evolving concept of peace-building and the interplay between peace and health is examined in many venues, including at the World Health Assembly. However, without a metric to determine effectiveness of intervention programs all efforts are prone to subjective assessment. This paper develops a psychometric index that lays the foundation for measuring community peace stemming from intervention programs. Methods After developing a working definition of ‘peace’ and delineating a Peace Evaluation Across Cultures and Environments (PEACE) scale with seven constructs comprised of 71 items, a beta version of the index was pilot-tested. Two hundred and fifty subjects in three sites in the U.S. were studied using a five-point Likert scale to evaluate the psychometric functioning of the PEACE scale. Known groups validation was performed using the SOS-10. In addition, test-retest reliability was performed on 20 subjects. Results The preliminary data demonstrated that the scale has acceptable psychometric properties for measuring an individual’s level of peacefulness. The study also provides reliability and validity data for the scale. The data demonstrated internal consistency, correlation between data and psychological well-being, and test-retest reliability. Conclusions The PEACE scale may serve as a novel assessment tool in the health sector and be valuable in monitoring and evaluating the peace-building impact of health initiatives in conflict-affected regions. PMID:25298781

[The methodological assessment and qualitative evaluation of psychometric performance tests based on the example of modern tests that assess reading and spelling skills].

PubMed

Galuschka, Katharina; Rothe, Josefine; Schulte-Körne, Gerd

2015-09-01

This article looks at a means of objectively evaluating the quality of psychometric tests. This approach enables users to evaluate psychometric tests based on their methodological characteristics, in order to decide which instrument should be used. Reading and spelling assessment tools serve as examples. The paper also provides a review of German psychometric tests for the assessment of reading and spelling skills. This method facilitates the identification of psychometric tests.of high methodological quality which can be used for the assessment of reading and spelling skills. Reading performance should ideally be assessed with the following instruments: ELFE 1-6, LGVT 6-12, LESEN 6-7, LESEN 8-9, or WLLP-R. The tests to be used for the evaluation of spelling skills are DERET 1-2+, DERET 3-4+, WRT 1+, WRT 2+, WRT 3+, WRT 4+ or HSP 1-10.

A Spanish-Language Version of the Herth Hope Scale: Development and Psychometric Evaluation in a Peruvian Sample

ERIC Educational Resources Information Center

Arnau, Randolph C.; Martinez, Patricia; de Guzman, Isabel Nino; Herth, Kaye; Konishi, Carlos Yoshiyuki

2010-01-01

Hope is a motivational/cognitive attribute that is theoretically necessary to initiate and sustain action toward goal attainment. The Herth Hope Scale (HHS) not only appears to tap into some of the same Agency and Pathways content of the commonly used Adult Hope Scale developed by Snyder et al. but also contains some more spiritual and social…

A preliminary quality of life questionnaire-bronchiectasis: a patient-reported outcome measure for bronchiectasis.

PubMed

Quittner, Alexandra L; Marciel, Kristen K; Salathe, Matthias A; O'Donnell, Anne E; Gotfried, Mark H; Ilowite, Jonathan S; Metersky, Mark L; Flume, Patrick A; Lewis, Sandra A; McKevitt, Matthew; Montgomery, A Bruce; O'Riordan, Thomas G; Barker, Alan F

2014-08-01

The Quality of Life Questionnaire-Bronchiectasis (QOL-B) is the first disease-specific, patient-reported outcome measure for patients with bronchiectasis. Content validity, cognitive testing, responsivity to open-label treatment, and psychometric analyses are presented. Reviews of literature, existing measures, and physician input were used to generate the initial QOL-B. Modifications following preliminary cognitive testing (N = 35 patients with bronchiectasis) generated version (V) 1.0. An open-ended patient interview study (N = 28) provided additional information and was content analyzed to derive saturation matrices, which summarized all disease-related topics mentioned by each participant. This resulted in QOL-B V2.0. Psychometric analyses were carried out using results from an open-label phase 2 trial, in which 89 patients were enrolled and treated with aztreonam for inhalation solution. Responsivity to open-label treatment was observed. Additional analyses generated QOL-B V3.0, with 37 items on eight scales: respiratory symptoms; physical, role, emotional, and social functioning; vitality; health perceptions; and treatment burden. For each scale, scores are standardized on a 0-to-100-point scale; higher scores indicate better health-related quality of life. No total score is calculated. A final cognitive testing study (N = 40) resulted in a minor change to one social functioning scale item (QOL-B V3.1). Content validity, cognitive testing, responsivity to open-label treatment, and initial psychometric analyses supported QOL-B items and structure. This interim QOL-B is a promising tool for evaluating the efficacy of new therapies for patients with bronchiectasis and for measuring symptoms, functioning, and quality of life in these patients on a routine basis. A final psychometric validation study is needed and is forthcoming. ClinicalTrials.gov; No.: NCT00805025; URL: www.clinicaltrials.gov.

Development and validation of an instrument to assess future orientation and resilience in adolescence.

PubMed

Di Maggio, Ilaria; Ginevra, Maria Cristina; Nota, Laura; Soresi, Salvatore

2016-08-01

The study is aimed at providing the development and initial validation of the Design My Future (DMF), which may be administered in career counseling and research activities to assess adolescents' future orientation and resilience. Two studies with two independent samples of Italian adolescents were conducted to examine psychometric requisites of DMF. Specifically, in the first study, after developing items and examined the content validity, the factorial structure, reliability and discriminant validity of the DMF were tested. In the second study, the measurement invariance across gender, conducing a sequence of nested CFA models, was evaluated. Results showed good psychometric support for the instrument with Italian adolescents. Copyright © 2016 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

Assessing Patients' Cognitive Therapy Skills: Initial Evaluation of the Competencies of Cognitive Therapy Scale.

PubMed

Strunk, Daniel R; Hollars, Shannon N; Adler, Abby D; Goldstein, Lizabeth A; Braun, Justin D

2014-10-01

In Cognitive Therapy (CT), therapists work to help patients develop skills to cope with negative affect. Most current methods of assessing patients' skills are cumbersome and impractical for clinical use. To address this issue, we developed and conducted an initial psychometric evaluation of self and therapist reported versions of a new measure of CT skills: the Competencies of Cognitive Therapy Scale (CCTS). We evaluated the CCTS at intake and post-treatment in a sample of 67 patients participating in CT. The CCTS correlated with a preexisting measure of CT skills (the Ways of Responding Questionnaire) and was also related to concurrent depressive symptoms. Across CT, self-reported improvements in CT competencies were associated with greater changes in depressive symptoms. These findings offer initial evidence for the validity of the CCTS. We discuss the CCTS in comparison with other measures of CT skills and suggest future research directions.

Assessing Patients’ Cognitive Therapy Skills: Initial Evaluation of the Competencies of Cognitive Therapy Scale

PubMed Central

Strunk, Daniel R.; Hollars, Shannon N.; Adler, Abby D.; Goldstein, Lizabeth A.; Braun, Justin D.

2014-01-01

In Cognitive Therapy (CT), therapists work to help patients develop skills to cope with negative affect. Most current methods of assessing patients’ skills are cumbersome and impractical for clinical use. To address this issue, we developed and conducted an initial psychometric evaluation of self and therapist reported versions of a new measure of CT skills: the Competencies of Cognitive Therapy Scale (CCTS). We evaluated the CCTS at intake and post-treatment in a sample of 67 patients participating in CT. The CCTS correlated with a preexisting measure of CT skills (the Ways of Responding Questionnaire) and was also related to concurrent depressive symptoms. Across CT, self-reported improvements in CT competencies were associated with greater changes in depressive symptoms. These findings offer initial evidence for the validity of the CCTS. We discuss the CCTS in comparison with other measures of CT skills and suggest future research directions. PMID:25408560

Scale Refinement and Initial Evaluation of a Behavioral Health Function Measurement Tool for Work Disability Evaluation

PubMed Central

Marfeo, Elizabeth E.; Ni, Pengsheng; Bogusz, Kara; Meterko, Mark; McDonough, Christine M.; Chan, Leighton; Rasch, Elizabeth K.; Brandt, Diane E.; Jette, Alan M.

2014-01-01

Objectives To use item response theory (IRT) data simulations to construct and perform initial psychometric testing of a newly developed instrument, the Social Security Administration Behavioral Health Function (SSA-BH) instrument, that aims to assess behavioral health functioning relevant to the context of work. Design Cross-sectional survey followed by item response theory (IRT) calibration data simulations Setting Community Participants A sample of individuals applying for SSA disability benefits, claimants (N=1015), and a normative comparative sample of US adults (N=1000) Interventions None. Main Outcome Measure Social Security Administration Behavioral Health Function (SSA-BH) measurement instrument Results Item response theory analyses supported the unidimensionality of four SSA-BH scales: Mood and Emotions (35 items), Self-Efficacy (23 items), Social Interactions (6 items), and Behavioral Control (15 items). All SSA-BH scales demonstrated strong psychometric properties including reliability, accuracy, and breadth of coverage. High correlations of the simulated 5- or 10- item CATs with the full item bank indicated robust ability of the CAT approach to comprehensively characterize behavioral health function along four distinct dimensions. Conclusions Initial testing and evaluation of the SSA-BH instrument demonstrated good accuracy, reliability, and content coverage along all four scales. Behavioral function profiles of SSA claimants were generated and compared to age and sex matched norms along four scales: Mood and Emotions, Behavioral Control, Social Interactions, and Self-Efficacy. Utilizing the CAT based approach offers the ability to collect standardized, comprehensive functional information about claimants in an efficient way, which may prove useful in the context of the SSA’s work disability programs. PMID:23542404

The Clinician-Administered PTSD Scale for DSM-5 (CAPS-5): Development and initial psychometric evaluation in military veterans.

PubMed

Weathers, Frank W; Bovin, Michelle J; Lee, Daniel J; Sloan, Denise M; Schnurr, Paula P; Kaloupek, Danny G; Keane, Terence M; Marx, Brian P

2018-03-01

The Clinician-Administered PTSD Scale (CAPS) is an extensively validated and widely used structured diagnostic interview for posttraumatic stress disorder (PTSD). The CAPS was recently revised to correspond with PTSD criteria in the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5; American Psychiatric Association, 2013). This article describes the development of the CAPS for DSM-5 (CAPS-5) and presents the results of an initial psychometric evaluation of CAPS-5 scores in 2 samples of military veterans (Ns = 165 and 207). CAPS-5 diagnosis demonstrated strong interrater reliability (к = .78 to 1.00, depending on the scoring rule) and test-retest reliability (к = .83), as well as strong correspondence with a diagnosis based on the CAPS for DSM-IV (CAPS-IV; к = .84 when optimally calibrated). CAPS-5 total severity score demonstrated high internal consistency (α = .88) and interrater reliability (ICC = .91) and good test-retest reliability (ICC = .78). It also demonstrated good convergent validity with total severity score on the CAPS-IV (r = .83) and PTSD Checklist for DSM-5 (r = .66) and good discriminant validity with measures of anxiety, depression, somatization, functional impairment, psychopathy, and alcohol abuse (rs = .02 to .54). Overall, these results indicate that the CAPS-5 is a psychometrically sound measure of DSM-5 PTSD diagnosis and symptom severity. Importantly, the CAPS-5 strongly corresponds with the CAPS-IV, which suggests that backward compatibility with the CAPS-IV was maintained and that the CAPS-5 provides continuity in evidence-based assessment of PTSD in the transition from DSM-IV to DSM-5 criteria. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Psychometric Properties of a Decisional Capacity Screening Tool for Individuals Contemplating Participation in Alzheimer's disease Research

PubMed Central

Seaman, Jennifer Burgher; Terhorst, Lauren; Gentry, Amanda; Hunsaker, Amanda; Parker, Lisa S.; Lingler, Jennifer Hagerty

2016-01-01

Background With the growing population of individuals affected by Alzheimer's disease (AD) and related disorders, there is a pressing demand for research on late life cognitive disorders. However, the high risk for decisional incapacity in this population necessitates the evaluation of capacity to consent to research participation, adding to the cost and complexity of the research process. The University of California, San Diego Brief Assessment of Capacity to Consent (UBACC) was initially validated in a sample of persons with schizophrenia and healthy controls. Objective To assess the psychometric properties of the UBACC when used in a sample of individuals contemplating participation in research on AD. Methods The UBACC was administered to a convenience sample (n=132) consisting of individuals with mild to moderate cognitive impairment (n=52), their study partners (n= 52) and healthy older adults control subjects (n=30), as part of a broader study to evaluate perceived burden of research participation. Reliability tests, correlational analyses, and exploratory factor analytic methods were used to examine the psychometric properties of the instrument. Results UBACC scores were significantly associated with both global cognition (rs = .564, p < .001) and verbal fluency (rs = .511, P <.001), indicating concurrent validity with related constructs. The resulting factor structure differed from that reported by the developers in their initial testing. Items clustered almost entirely on one factor, and items reflecting the construct of understanding accounted for 32.12% of the total variance, with no evidence for distinct reasoning or appreciation scales. Conclusion The UBACC shows promise when used to screen for decisional capacity among those considering participation in AD research. PMID:25765917

Adaptation and initial psychometric study of the self-report version of Liebowitz Social Anxiety Scale (LSAS-SR).

PubMed

Dos Santos, Larissa Forni; Loureiro, Sonia Regina; Crippa, José Alexandre S; de Lima Osório, Flávia

2013-06-01

The objectives of the present study were to adapt the Liebowitz Social Anxiety Scale from the clinician administered to the self-report version (LSAS-SR) and to perform the initial psychometric studies concerning internal consistency and item analysis. The phase of adaptation was performed by two specialists in the Mental Health area and the face validity was tested by a group of 30 university students. As part of the psychometric study of the LSAS-SR, the internal consistency was assessed and the items were analyzed by applying the scale to 682 university students. The LSAS-SR proved to be easy to understand by the group studied, with no need to make any changes in the instructions for application. The scale showed adequate internal consistency (α = 0.96) as well as an acceptable correlation between items and total score (0.38-0.72). The initial psychometric studies of the LSAS-SR presented adequate indicators, stimulating the continuation of studies involving the validation and reliability of the scale not only when applied to a sample of the general population, but also when applied to clinical groups.

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review.

PubMed

Cordier, Reinie; Speyer, Renée; Chen, Yu-Wei; Wilkes-Gillan, Sarah; Brown, Ted; Bourke-Taylor, Helen; Doma, Kenji; Leicht, Anthony

2015-01-01

Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning. To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults. A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity. The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments.

Instruments evaluating the quality of the clinical learning environment in nursing education: A systematic review of psychometric properties.

PubMed

Mansutti, Irene; Saiani, Luisa; Grassetti, Luca; Palese, Alvisa

2017-03-01

The clinical learning environment is fundamental to nursing education paths, capable of affecting learning processes and outcomes. Several instruments have been developed in nursing education, aimed at evaluating the quality of the clinical learning environments; however, no systematic review of the psychometric properties and methodological quality of these studies has been performed to date. The aims of the study were: 1) to identify validated instruments evaluating the clinical learning environments in nursing education; 2) to evaluate critically the methodological quality of the psychometric property estimation used; and 3) to compare psychometric properties across the instruments available. A systematic review of the literature (using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines) and an evaluation of the methodological quality of psychometric properties (using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines). The Medline and CINAHL databases were searched. Eligible studies were those that satisfied the following criteria: a) validation studies of instruments evaluating the quality of clinical learning environments; b) in nursing education; c) published in English or Italian; d) before April 2016. The included studies were evaluated for the methodological quality of the psychometric properties measured and then compared in terms of both the psychometric properties and the methodological quality of the processes used. The search strategy yielded a total of 26 studies and eight clinical learning environment evaluation instruments. A variety of psychometric properties have been estimated for each instrument, with differing qualities in the methodology used. Concept and construct validity were poorly assessed in terms of their significance and rarely judged by the target population (nursing students). Some properties were rarely considered (e.g., reliability, measurement error, criterion validity), whereas others were frequently estimated, but using different coefficients and statistical analyses (e.g., internal consistency, structural validity), thus rendering comparison across instruments difficult. Moreover, the methodological quality adopted in the property assessments was poor or fair in most studies, compromising the goodness of the psychometric values estimated. Clinical learning placements represent the key strategies in educating the future nursing workforce: instruments evaluating the quality of the settings, as well as their capacity to promote significant learning, are strongly recommended. Studies estimating psychometric properties, using an increased quality of research methodologies are needed in order to support nursing educators in the process of clinical placements accreditation and quality improvement. Copyright © 2017 Elsevier Ltd. All rights reserved.

Psychometric properties of the Social Problem Solving Inventory-Revised Short-Form in a South African population.

PubMed

Sorsdahl, Katherine; Stein, Dan J; Myers, Bronwyn

2017-04-01

The Social Problem Solving Inventory-Revised Short-Form (SPSI-R:SF) has been used in several countries to identify problem-solving deficits among clinical and general populations in order to guide cognitive-behavioural interventions. Yet, very few studies have evaluated its psychometric properties. Three language versions of the questionnaire were administered to a general population sample comprising 1000 participants (771 English-, 178 Afrikaans- and 101 Xhosa-speakers). Of these participants, 210 were randomly selected to establish test-retest reliability (70 in each language). Principal component analysis was performed to examine the applicability of the factor structure of the original questionnaire to the South African data. Supplementary psychometric analyses were performed, including internal consistency and test-retest reliability. Collectively, results provide initial evidence of the reliability and validity of the SPSI-R:SF for the assessment of problem solving deficits in South Africa. Further studies that explore how the Afrikaans language version of the SPSI-R:SF can be improved and that establish the predictive validity of scores on the SPSI-R:SF are needed. © 2015 International Union of Psychological Science.

A systematic review evaluating the psychometric properties of measures of social inclusion.

PubMed

Cordier, Reinie; Milbourn, Ben; Martin, Robyn; Buchanan, Angus; Chung, Donna; Speyer, Renée

2017-01-01

Improving social inclusion opportunities for population health has been identified as a priority area for international policy. There is a need to comprehensively examine and evaluate the quality of psychometric properties of measures of social inclusion that are used to guide social policy and outcomes. To conduct a systematic review of the literature on all current measures of social inclusion for any population group, to evaluate the quality of the psychometric properties of identified measures, and to evaluate if they capture the construct of social inclusion. A systematic search was performed using five electronic databases: CINAHL, PsycINFO, Embase, ERIC and Pubmed and grey literature were sourced to identify measures of social inclusion. The psychometric properties of the social inclusion measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Of the 109 measures identified, twenty-five measures, involving twenty-five studies and one manual met the inclusion criteria. The overall quality of the reviewed measures was variable, with the Social and Community Opportunities Profile-Short, Social Connectedness Scale and the Social Inclusion Scale demonstrating the strongest evidence for sound psychometric quality. The most common domain included in the measures was connectedness (21), followed by participation (19); the domain of citizenship was covered by the least number of measures (10). No single instrument measured all aspects within the three domains of social inclusion. Of the measures with sound psychometric evidence, the Social and Community Opportunities Profile-Short captured the construct of social inclusion best. The overall quality of the psychometric properties demonstrate that the current suite of available instruments for the measurement of social inclusion are promising but need further refinement. There is a need for a universal working definition of social inclusion as an overarching construct for ongoing research in the area of the psychometric properties of social inclusion instruments.

A systematic review evaluating the psychometric properties of measures of social inclusion

PubMed Central

Milbourn, Ben; Martin, Robyn; Buchanan, Angus; Chung, Donna; Speyer, Renée

2017-01-01

Introduction Improving social inclusion opportunities for population health has been identified as a priority area for international policy. There is a need to comprehensively examine and evaluate the quality of psychometric properties of measures of social inclusion that are used to guide social policy and outcomes. Objective To conduct a systematic review of the literature on all current measures of social inclusion for any population group, to evaluate the quality of the psychometric properties of identified measures, and to evaluate if they capture the construct of social inclusion. Methods A systematic search was performed using five electronic databases: CINAHL, PsycINFO, Embase, ERIC and Pubmed and grey literature were sourced to identify measures of social inclusion. The psychometric properties of the social inclusion measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Results Of the 109 measures identified, twenty-five measures, involving twenty-five studies and one manual met the inclusion criteria. The overall quality of the reviewed measures was variable, with the Social and Community Opportunities Profile-Short, Social Connectedness Scale and the Social Inclusion Scale demonstrating the strongest evidence for sound psychometric quality. The most common domain included in the measures was connectedness (21), followed by participation (19); the domain of citizenship was covered by the least number of measures (10). No single instrument measured all aspects within the three domains of social inclusion. Of the measures with sound psychometric evidence, the Social and Community Opportunities Profile-Short captured the construct of social inclusion best. Conclusions The overall quality of the psychometric properties demonstrate that the current suite of available instruments for the measurement of social inclusion are promising but need further refinement. There is a need for a universal working definition of social inclusion as an overarching construct for ongoing research in the area of the psychometric properties of social inclusion instruments. PMID:28598984

Development and Initial Psychometrics of Counseling Supervisor's Behavior Questionnaire

ERIC Educational Resources Information Center

Lee, Ahram; Park, Eun Hye; Byeon, Eunji; Lee, Sang Min

2016-01-01

This study describes the development and psychometric properties of the Counseling Supervisor's Behavior Questionnaire, designed to assess the specific behaviors of supervisors, which can be observed by supervisees during supervision sessions. Factor structure, construct and concurrent validity, and internal consistency reliability of the…

Development and psychometric evaluation of the Impact of Health Information Technology (I-HIT) scale.

PubMed

Dykes, Patricia C; Hurley, Ann; Cashen, Margaret; Bakken, Suzanne; Duffy, Mary E

2007-01-01

The use of health information technology (HIT) for the support of communication processes and data and information access in acute care settings is a relatively new phenomenon. A means of evaluating the impact of HIT in hospital settings is needed. The purpose of this research was to design and psychometrically evaluate the Impact of Health Information Technology scale (I-HIT). I-HIT was designed to measure the perception of nurses regarding the ways in which HIT influences interdisciplinary communication and workflow patterns and nurses' satisfaction with HIT applications and tools. Content for a 43-item tool was derived from the literature, and supported theoretically by the Coiera model and by nurse informaticists. Internal consistency reliability analysis using Cronbach's alpha was conducted on the 43-item scale to initiate the item reduction process. Items with an item total correlation of less than 0.35 were removed, leaving a total of 29 items. Item analysis, exploratory principal component analysis and internal consistency reliability using Cronbach's alpha were used to confirm the 29-item scale. Principal components analysis with Varimax rotation produced a four-factor solution that explained 58.5% of total variance (general advantages, information tools to support information needs, information tools to support communication needs, and workflow implications). Internal consistency of the total scale was 0.95 and ranged from 0.80-0.89 for four subscales. I-HIT demonstrated psychometric adequacy and is recommended to measure the impact of HIT on nursing practice in acute care settings.

Psychometric Evaluation of the Fear of Positive Evaluation Scale in Patients With Social Anxiety Disorder

PubMed Central

Weeks, Justin W.; Heimberg, Richard G.; Rodebaugh, Thomas L.; Goldin, Philippe R.; Gross, James J.

2014-01-01

The Fear of Positive Evaluation Scale (FPES; Weeks, Heimberg, & Rodebaugh, 2008) was designed to assess fear of positive evaluation, a proposed cognitive component of social anxiety. Although previous findings on the psychometric properties of the FPES have been highly encouraging, only one previous study has examined the psychometric profile of the FPES in a sample of patients with social anxiety disorder (Fergus et al., 2009). The primary purpose of the present study was to conduct a large multi-site examination of the psychometric profile of the FPES among patients with a principal diagnosis of social anxiety disorder (n = 226; generalized subtype: 97.8%). Responses of non-anxious control participants (n = 42) were also examined. The factorial validity, internal consistency, test-retest reliability, construct validity, and treatment sensitivity of the FPES were strongly supported by our findings. Furthermore, an FPES cutoff score was identified for distinguishing levels of fear of positive evaluation characteristic of patients with social anxiety disorder from those characteristic of the control group. Results provide additional support for the psychometric properties of the FPES in clinical samples. PMID:21966932

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review

PubMed Central

Brown, Ted; Bourke-Taylor, Helen; Doma, Kenji; Leicht, Anthony

2015-01-01

Introduction Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning. Objective To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults. Methods A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Results Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity. Conclusions The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments. PMID:26151362

Psychometric properties of the Kids' Child Feeding Questionnaire-Restriction.

PubMed

Stromberg, Sarah E; Minski, Samantha; Wheeler, Paris B; Chardon, Marie L; Janicke, David M

Research exploring parental restrictive feeding is mixed and shows that it both negatively and positively affects children's dietary intake. One hypothesis for these inconsistent findings is the use of parent-report vs. youth-report measures of parental restrictive feeding, but there are limited psychometrically-sound youth-report measures of this construct. Therefore, the current study aims to evaluate the psychometric properties of a measure of parent restrictive feeding practices, the Kids' Child Feeding Questionnaire-Restriction (KCFQ-R), from the youth perspective. The 7-item, youth-report KCFQ-R is composed of the restriction subscale from the Kids' Child Feeding Questionnaire. This measure was completed by 225 youth attending a primary care appointment. Initial exploratory factor analysis and communalities yielded a single factor solution explaining 39.93% of the variability in the data. Internal consistency using the seven items was .73. The KCFQ-R demonstrated external validity through its significant relationship with parent concern about child overweight. Results provide preliminary support that the KCFQ-R is a psychometrically sound and reliable measure of youth-reported parental restrictive feeding practices. Given the mixed research on the effects of parent-reported parental feeding restriction on various child outcomes, this youth-report measure may help clarify these relationships. Future research should examine youth-report measures of other parent feeding domains. Copyright © 2017 Asia Oceania Association for the Study of Obesity. All rights reserved.

Development and Initial Psychometrics of the Counselor Burnout Inventory

ERIC Educational Resources Information Center

Lee, Sang Min; Baker, Crystal R.; Cho, Seong Ho; Heckathorn, Danette E.; Holland, Michael W.; Newgent, Rebecca A.; Ogle, Nick T.; Powell, Michael L.; Quinn, James J.; Wallace, Sam L.; Yu, Kumlan

2007-01-01

This article describes the development and psychometric properties of the Counselor Burnout Inventory (CBI), which is designed to meet the needs of the counseling profession by assessing burnout in counselors. Factor structure, concurrent validity, internal consistency, and test-retest reliability of the CBI scores are reported. Implications for…

Psychometric Analysis of the Servicemember Evaluation Tool

DTIC Science & Technology

to assess psychological resilience. The Naval Center for Combat and Operational Stress Control developed the Servicemember Evaluation Tool (SET) to...vessels on deployment. The goals of this thesis are to evaluate the psychometric properties of the SET on this sample population. Furthermore, this

Spanish cross-cultural adaptation and psychometric properties of the Schizophrenia Quality of Life short-version questionnaire (SQoL18) in 3 middle-income countries: Bolivia, Chile and Peru.

PubMed

Caqueo-Urízar, Alejandra; Boyer, Laurent; Boucekine, Mohamed; Auquier, Pascal

2014-10-01

The aim of this study was to adapt the Schizophrenia - Quality of Life short-version questionnaire (SQoL18) for use in three middle-income countries in Latin America and to evaluate the factor structure, reliability, and external validity of this questionnaire. The SQoL18 was translated into Spanish using a well-validated forward-backward process. We evaluated the psychometric properties of the SQoL18 in a sample of 253 patients with schizophrenia attending outpatient mental health services in three Latin American countries. For participants in each country (Bolivia, N=83; Chile, N=85; Peru, N=85), psychometric properties were compared to those reported from the reference population (507 patients with schizophrenia) assessed in the validation study. In addition, differential item functioning (DIF) analyses were performed to see whether all items behave in the same way in each country. Factor analysis performed in the 3 countries showed that the questionnaire's structure adequately matched the initial structure of the SQoL18. The unidimensionality of the dimensions was preserved, and the internal/external validity indices were close to those of the reference population. However, one dimension of the SQoL18 (resilience) presented some unsatisfactory properties including low Cronbach's alpha coefficients, one INFIT value higher than 1.2, and one item showing DIF between the 3 countries. These results demonstrate the satisfactory acceptability and psychometric properties of the SQoL18, suggesting the relevance of this questionnaire among patients with schizophrenia in these 3 Latin American countries. Copyright © 2014 Elsevier B.V. All rights reserved.

A Rasch Analysis of Assessments of Morning and Evening Fatigue in Oncology Patients Using the Lee Fatigue Scale.

PubMed

Lerdal, Anners; Kottorp, Anders; Gay, Caryl; Aouizerat, Bradley E; Lee, Kathryn A; Miaskowski, Christine

2016-06-01

To accurately investigate diurnal variations in fatigue, a measure needs to be psychometrically sound and demonstrate stable item function in relationship to time of day. Rasch analysis is a modern psychometric approach that can be used to evaluate these characteristics. To evaluate, using Rasch analysis, the psychometric properties of the Lee Fatigue Scale (LFS) in a sample of oncology patients. The sample comprised 587 patients (mean age 57.3 ± 11.9 years, 80% women) undergoing chemotherapy for breast, gastrointestinal, gynecological, or lung cancer. Patients completed the 13-item LFS within 30 minutes of awakening (i.e., morning fatigue) and before going to bed (i.e., evening fatigue). Rasch analysis was used to assess validity and reliability. In initial analyses of differential item function, eight of the 13 items functioned differently depending on whether the LFS was completed in the morning or in the evening. Subsequent analyses were conducted separately for the morning and evening fatigue assessments. Nine of the morning fatigue items and 10 of the evening fatigue items demonstrated acceptable goodness-of-fit to the Rasch model. Principal components analyses indicated that both morning and evening assessments demonstrated unidimensionality. Person-separation indices indicated that both morning and evening fatigue scales were able to distinguish four distinct strata of fatigue severity. Excluding four items from the morning fatigue scale and three items from the evening fatigue scale improved the psychometric properties of the LFS for assessing diurnal variations in fatigue severity in oncology patients. Copyright © 2016 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Initial Development and Psychometric Properties of a New Measure of Substance Use Disorder "Recovery Progression": The Recovery Progression Measure (RPM).

PubMed

Elison, Sarah; Davies, Glyn; Ward, Jonathan

2016-07-28

There is a growing literature around substance use disorder treatment outcomes measures. Various constructs have been suggested as being appropriate for measuring recovery outcomes, including "recovery capital" and "treatment progression." However, these previously proposed constructs do not measure changes in psychosocial functioning during the recovery process. Therefore, a new psychometric assessment, the "Recovery Progression Measure" (RPM), has been developed to measure this recovery oriented psychosocial change. The aims of this study were to evaluate the reliability and factor structure of the RPM via data collected from 2218 service users being treated for their substance dependence. Data were collected from service users accessing the Breaking Free Online (BFO) substance use disorder treatment and recovery program, which has within its baseline assessment a 36-item psychometric measure previously developed by the authors to assess the six areas of functioning described in the RPM. Reliability analyses and exploratory factor analyses (EFA) were conducted to examine the underlying factor structure of the RPM measure. Internal reliability of the RPM measure was found to be excellent (α > .70) with the overall assessment to have reliability α = .89, with item-total correlations revealing moderate-excellent reliability of individual items. EFA revealed the RPM to contain an underlying factor structure of eight components. This study provides initial data to support the reliability of the RPM as a recovery measure. Further work is now underway to extend these findings, including convergent and predictive validity analyses.

Scale refinement and initial evaluation of a behavioral health function measurement tool for work disability evaluation.

PubMed

Marfeo, Elizabeth E; Ni, Pengsheng; Haley, Stephen M; Bogusz, Kara; Meterko, Mark; McDonough, Christine M; Chan, Leighton; Rasch, Elizabeth K; Brandt, Diane E; Jette, Alan M

2013-09-01

To use item response theory (IRT) data simulations to construct and perform initial psychometric testing of a newly developed instrument, the Social Security Administration Behavioral Health Function (SSA-BH) instrument, that aims to assess behavioral health functioning relevant to the context of work. Cross-sectional survey followed by IRT calibration data simulations. Community. Sample of individuals applying for Social Security Administration disability benefits: claimants (n=1015) and a normative comparative sample of U.S. adults (n=1000). None. SSA-BH measurement instrument. IRT analyses supported the unidimensionality of 4 SSA-BH scales: mood and emotions (35 items), self-efficacy (23 items), social interactions (6 items), and behavioral control (15 items). All SSA-BH scales demonstrated strong psychometric properties including reliability, accuracy, and breadth of coverage. High correlations of the simulated 5- or 10-item computer adaptive tests with the full item bank indicated robust ability of the computer adaptive testing approach to comprehensively characterize behavioral health function along 4 distinct dimensions. Initial testing and evaluation of the SSA-BH instrument demonstrated good accuracy, reliability, and content coverage along all 4 scales. Behavioral function profiles of Social Security Administration claimants were generated and compared with age- and sex-matched norms along 4 scales: mood and emotions, behavioral control, social interactions, and self-efficacy. Using the computer adaptive test-based approach offers the ability to collect standardized, comprehensive functional information about claimants in an efficient way, which may prove useful in the context of the Social Security Administration's work disability programs. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

African American Dementia Caregiver Problem Inventory: Descriptive analysis and initial psychometric evaluation.

PubMed

Wells, Brittny A; Glueckauf, Robert L; Bernabe, Daniel; Kazmer, Michelle M; Schettini, Gabriel; Springer, Jane; Sharma, Dinesh; Meng, Hongdao; Willis, Floyd B; Graff-Radford, Neill

2017-02-01

The primary objectives of the present study were: (a) to develop the African American Dementia Caregiver Problem Inventory (DCPI-A) that assesses the types and frequency of problems reported by African American dementia caregivers seeking cognitive-behavioral intervention, (b) to evaluate the intercoder reliability of the DCPI-A, and (c) to measure the perceived severity of common problems reported by this caregiver population. The development of the DCPI-A was divided into 3 major steps: (a) creating an initial sample pool of caregiver problems derived from 2 parent randomized clinical trials, (b) formulating a preliminary version of the DCPI-A, and (c) finalizing the development of the DCPI-A that includes 20 problem categories with explicit coding rules, definitions, and illustrative examples. The most commonly reported caregiver problems fell into 5 major categories: (a) communication problems with care recipients, family members, and/or significant others, (b) problems with socialization, recreation, and personal enhancement time; (c) problems with physical health and health maintenance, (d) problems in managing care recipients' activities of daily living; and (e) problems with care recipients' difficult behaviors. Intercoder reliability was moderately high for both percent agreement and Cronbach's kappa. A similar positive pattern of results was obtained for the analysis of coder drift. The descriptive analysis of the types and frequency of problems of African American dementia caregivers coupled with the outcomes of the psychometric evaluation bode well for the adoption of the DCPI-A in clinical settings. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Development and initial psychometric evaluation of patient-reported outcome questionnaires to evaluate the symptoms and impact of hidradenitis suppurativa.

PubMed

Kimball, Alexa B; Sundaram, Murali; Banderas, Benjamin; Foley, Catherine; Shields, Alan L

2018-03-01

Two patient-reported outcome (PRO) questionnaires, the Hidradenitis Suppurativa Symptom Assessment (HSSA) and Hidradenitis Suppurativa Impact Assessment (HSIA), were developed to measure signs, symptoms and impacts of HS in treatment efficacy studies. In accordance with FDA guidelines and published best practices, four stages of research were conducted to create the questionnaires: concept elicitation, questionnaire construction, content evaluation and psychometric evaluation. Subjects (N = 20) who participated in the concept elicitation stage reported 15 unique HS-related signs and symptoms and 51 impacts. Following this, eight sign and symptom concepts and 21 impacts were selected for construction of the HSSA and HSIA, respectively. During content evaluation, cognitive debriefing interviews with HS subjects (N = 20) confirmed subjects could read, comprehend and meaningfully respond to both questionnaires. Modifications made after this stage of work resulted in a nine-item HSSA and a 17-item HSIA. The HSSA and HSIA were subsequently entered into a US-based observational study (N = 40), and the scores produced by each were found to be reliable, construct valid, and able to distinguish among clinically distinct groups. The HSSA and HSIA are content-valid, HS-specific, PRO questionnaires with demonstrated ability to generate reliable, valid scores when administered to patients with HS in a research setting.

Development and Psychometric Evaluation of the Interpersonal Sexual Objectification Scale

ERIC Educational Resources Information Center

Kozee, Holly B.; Tylka, Tracy L.; Augustus-Horvath, Casey L.; Denchik, Angela

2007-01-01

This study reports on the development and psychometric evaluation of the Interpersonal Sexual Objectification Scale (ISOS). Data from 576 college women were collected in three studies. Exploratory factor analysis uncovered two factors: Body Evaluation and Unwanted Explicit Sexual Advances; confirmatory factor analysis supported this factor…

CRISP-Psychometric Assessment of Postdivorce Stress/Adjustment in Children.

ERIC Educational Resources Information Center

Aronson, David M.; Baum, Steven K.

A new psychometric instrument for measuring the impact of divorce on elementary school age children was developed: the Child's Report of the Impact of Separation by Parents (CRISP). This structured projective test was specifically designed to assess children's postdivorce stress/adjustment. An initial version of the CRISP was administered to 99…

The Development and Psychometric Properties of the Selective Mutism Questionnaire

ERIC Educational Resources Information Center

Bergman, R. Lindsey; Keller, Melody L.; Piacentini, John; Bergman, Andrea J.

2008-01-01

Research on selective mutism (SM) has been limited by the absence of standardized, psychometrically sound assessment measures. The purpose of our investigation was to present two studies that examined the factor structure and initial reliability and validity of the Selective Mutism Questionnaire (SMQ), a 17-item parent report measure of failure to…

The Juvenile Addiction Risk Rating: Development and Initial Psychometrics

ERIC Educational Resources Information Center

Powell, Michael; Newgent, Rebecca A.

2016-01-01

This article describes the development and psychometrics of the Juvenile Addiction Risk Rating. The Juvenile Addiction Risk Rating is a brief screening of addiction potential based on 10 risk factors predictive of youth alcohol and drug-related problems that assists examiners in more accurate treatment planning when self-report information is…

Development and Psychometric Evaluation of the Instrument: Attitudes Towards Organ Donor Advocacy Scale (ATODAS)

PubMed Central

Flodén, Anne; Lennerling, Annette; Fridh, Isabell; Rizell, Magnus; Forsberg, Anna

2011-01-01

The consequences of advocacy in nursing are critical when caring for a potential organ donor. No specific instrument has been available to measure attitudes toward organ donor advocacy. The aim of this study was to develop and psychometrically evaluate an instrument for measuring intensive and critical care (ICU) nurses’ attitudes toward organ donor advocacy. The study was conducted in two stages: instrument development and instrument evaluation and refinement. A questionnaire was developed (Attitude Toward Organ Donor Advocacy Scale (ATODAS)), which was sent to half of all nurses working in ICUs (general-, neuro-, thoracic- or paediatric-) in Sweden (n=1180). The final response rate was 42.5% (n=502). In order to explore validity and reliability, the expected scale dimensionality of the questionnaire was examined both by explorative principal component analysis (with oblique, varimax rotation) and by confirmatory multi-trait analysis. The confirmatory factor analysis indicated that the ATODAS could best be explained by five factors; Attitudes toward championing organ donation at a structural hospital level; Attitudes toward championing organ donation at a political and research level; Attitudes toward actively and personally safeguarding the will and wishes of the potential organ donor, Attitudes toward safeguarding the potential donor’s will and wishes by a professional approach and Attitudes toward safeguarding the will and wishes of the relatives. This initial testing indicated that the ATODAS has good psychometric properties and can be used in future research to explore if interventions may influence attitudes and behaviors related to organ donor advocacy. PMID:22046210

The Dissociative Subtype of PTSD Scale (DSPS): Initial Evaluation in a National Sample of Trauma-Exposed Veterans

PubMed Central

Wolf, Erika J.; Mitchell, Karen S.; Sadeh, Naomi; Hein, Christina; Fuhrman, Isaac; Pietrzak, Robert H.; Miller, Mark W.

2015-01-01

The fifth edition of the Diagnostic and Statistical Manual (DSM-5) includes a dissociative subtype of posttraumatic stress disorder (PTSD), but no existing measures specifically assess it. This paper describes the initial evaluation of a 15-item self-report measure of the subtype called the Dissociative Subtype of PTSD Scale (DSPS) in an on-line survey of 697 trauma-exposed military veterans representative of the US veteran population. Exploratory factor analyses of the lifetime DSPS items supported the intended structure of the measure consisting of three factors reflecting derealization/depersonalization, loss of awareness, and psychogenic amnesia. Consistent with prior research, latent profile analyses assigned 8.3% of the sample to a highly dissociative class distinguished by pronounced symptoms of derealization and depersonalization. Overall, results provide initial psychometric support for the lifetime DSPS scales; additional research in clinical and community samples is needed to further validate the measure. PMID:26603115

The Dissociative Subtype of PTSD Scale: Initial Evaluation in a National Sample of Trauma-Exposed Veterans.

PubMed

Wolf, Erika J; Mitchell, Karen S; Sadeh, Naomi; Hein, Christina; Fuhrman, Isaac; Pietrzak, Robert H; Miller, Mark W

2017-06-01

The fifth edition of the Diagnostic and Statistical Manual includes a dissociative subtype of posttraumatic stress disorder, but no existing measures specifically assess it. This article describes the initial evaluation of a 15-item self-report measure of the subtype called the Dissociative Subtype of Posttraumatic Stress Disorder Scale (DSPS) in an online survey of 697 trauma-exposed military veterans representative of the U.S. veteran population. Exploratory factor analyses of the lifetime DSPS items supported the intended structure of the measure consisting of three factors reflecting derealization/depersonalization, loss of awareness, and psychogenic amnesia. Consistent with prior research, latent profile analyses assigned 8.3% of the sample to a highly dissociative class distinguished by pronounced symptoms of derealization and depersonalization. Overall, results provide initial psychometric support for the lifetime DSPS scales; additional research in clinical and community samples is needed to further validate the measure.

Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods.

PubMed

Hobart, J; Cano, S

2009-02-01

In this monograph we examine the added value of new psychometric methods (Rasch measurement and Item Response Theory) over traditional psychometric approaches by comparing and contrasting their psychometric evaluations of existing sets of rating scale data. We have concentrated on Rasch measurement rather than Item Response Theory because we believe that it is the more advantageous method for health measurement from a conceptual, theoretical and practical perspective. Our intention is to provide an authoritative document that describes the principles of Rasch measurement and the practice of Rasch analysis in a clear, detailed, non-technical form that is accurate and accessible to clinicians and researchers in health measurement. A comparison was undertaken of traditional and new psychometric methods in five large sets of rating scale data: (1) evaluation of the Rivermead Mobility Index (RMI) in data from 666 participants in the Cannabis in Multiple Sclerosis (CAMS) study; (2) evaluation of the Multiple Sclerosis Impact Scale (MSIS-29) in data from 1725 people with multiple sclerosis; (3) evaluation of test-retest reliability of MSIS-29 in data from 150 people with multiple sclerosis; (4) examination of the use of Rasch analysis to equate scales purporting to measure the same health construct in 585 people with multiple sclerosis; and (5) comparison of relative responsiveness of the Barthel Index and Functional Independence Measure in data from 1400 people undergoing neurorehabilitation. Both Rasch measurement and Item Response Theory are conceptually and theoretically superior to traditional psychometric methods. Findings from each of the five studies show that Rasch analysis is empirically superior to traditional psychometric methods for evaluating rating scales, developing rating scales, analysing rating scale data, understanding and measuring stability and change, and understanding the health constructs we seek to quantify. There is considerable added value in using Rasch analysis rather than traditional psychometric methods in health measurement. Future research directions include the need to reproduce our findings in a range of clinical populations, detailed head-to-head comparisons of Rasch analysis and Item Response Theory, and the application of Rasch analysis to clinical practice.

Development of measures of organizational leadership for health promotion.

PubMed

Barrett, Linda; Plotnikoff, Ronald C; Raine, Kim; Anderson, Donna

2005-04-01

This study describes the development and psychometric evaluation of four scales measuring leadership for health promotion at an organizational level in the baseline survey (n=144) of the Alberta Heart Health Project. Content validity was established through a series of focus groups and expert opinion appraisals, pilot testing of a draft based on capacity assessment instruments developed by other provinces involved in the Canadian Heart Health Initiative, and the literature. Psychometric analyses provided empirical evidence of the construct validity and reliability of the organizational leadership scales. Principal component analysis verified the unidimensionality of the leadership scales of (a) Practices for Organizational Learning, (b) Wellness Planning, (c) Workplace Climate, and (d) Organization Member Development. Scale alpha coefficients ranged between .79 and .91 thus establishing good to high scale internal consistencies. These measures can be used by both researchers and practitioners for the assessment of organizational leadership for health promotion and heart health promotion.

Development and psychometric validation of a questionnaire to evaluate nurses' adherence to recommendations for preventing pressure ulcers (QARPPU).

PubMed

Moya-Suárez, Ana Belén; Morales-Asencio, José Miguel; Aranda-Gallardo, Marta; Enríquez de Luna-Rodríguez, Margarita; Canca-Sánchez, José Carlos

2017-11-01

The main objective of this work is the development and psychometric validation of an instrument to evaluate nurses' adherence to the main recommendations issued for preventing pressure ulcers. An instrument was designed based on the main recommendations for the prevention of pressure ulcers published in various clinical practice guides. Subsequently, it was proceeded to evaluate the face and content validity of the instrument by an expert group. It has been applied to 249 Spanish nurses took part in a cross-sectional study to obtain a psychometric evaluation (reliability and construct validity) of the instrument. The study data were compiled from June 2015 to July 2016. From the results of the psychometric analysis, a final 18-item, 4-factor questionnaire was derived, which explained 60.5% of the variance and presented the following optimal indices of fit (CMIN/DF: 1.40 p < 0.001; GFI: 0.93; NFI: 0.92; CFI: 0.98; TLI: 0.97; RMSEA: 0.04 (90% CI 0.025-0.054). The results obtained show that the instrument presents suitable psychometric properties for evaluating nurses' adherence to recommendations for the prevention of pressure ulcers. Copyright © 2017 Tissue Viability Society. Published by Elsevier Ltd. All rights reserved.

Investigating Psychometric Isomorphism for Traditional and Performance-Based Assessment

ERIC Educational Resources Information Center

Fay, Derek M.; Levy, Roy; Mehta, Vandhana

2018-01-01

A common practice in educational assessment is to construct multiple forms of an assessment that consists of tasks with similar psychometric properties. This study utilizes a Bayesian multilevel item response model and descriptive graphical representations to evaluate the psychometric similarity of variations of the same task. These approaches for…

Psychometric Evaluation and Discussions of English Language Learners' Listening Comprehension

ERIC Educational Resources Information Center

Seo, Daeryong; Taherbhai, Husein; Frantz, Roger

2016-01-01

The importance of listening in the context of English language acquisition is gaining acceptance, but its unique attributes in language performance, while substantively and qualitatively justifiable, are generally not psychometrically defined. This article psychometrically supports listening as a distinct domain among the three other domains of…

The Psychometric Properties of the Difficult Behavior Self-Efficacy Scale

ERIC Educational Resources Information Center

Oh, Hyun-Kyoung; Kozub, Francis M.

2010-01-01

The study was designed to estimate the psychometric properties of Hastings and Brown's (2002a) Difficult Behavior Self-efficacy Scale. Participants were two samples of physical educators teaching in Korea (n = 229) and the United States (U.S.; n = 139). An initial translation of the questionnaire to Korean and pilot study were conducted along with…

The Autism Impact Measure (AIM): Initial Development of a New Tool for Treatment Outcome Measurement

ERIC Educational Resources Information Center

Kanne, Stephen M.; Mazurek, Micah O.; Sikora, Darryn; Bellando, Jayne; Branum-Martin, Lee; Handen, Benjamin; Katz, Terry; Freedman, Brian; Powell, Mary Paige; Warren, Zachary

2014-01-01

The current study describes the development and psychometric properties of a new measure targeting sensitivity to change of core autism spectrum disorder (ASD) symptoms, the Autism Impact Measure (AIM). The AIM uses a 2-week recall period with items rated on two corresponding 5-point scales (frequency and impact). Psychometric properties were…

Amateur boxing and risk of chronic traumatic brain injury: systematic review of observational studies

PubMed Central

Knowles, Charles H; Whyte, Greg P

2007-01-01

Objective To evaluate the risk of chronic traumatic brain injury from amateur boxing. Setting Secondary research performed by combination of sport physicians and clinical academics. Design, data sources, and methods Systematic review of observational studies in which chronic traumatic brain injury was defined as any abnormality on clinical neurological examination, psychometric testing, neuroimaging studies, and electroencephalography. Studies were identified through database (1950 to date) and bibliographic searches without language restrictions. Two reviewers extracted study characteristics, quality, and data, with adherence to a protocol developed from a widely recommended method for systematic review of observational studies (MOOSE). Results 36 papers had relevant extractable data (from a detailed evaluation of 93 studies of 943 identified from the initial search). Quality of evidence was generally poor. The best quality studies were those with a cohort design and those that used psychometric tests. These yielded the most negative results: only four of 17 (24%) better quality studies found any indication of chronic traumatic brain injury in a minority of boxers studied. Conclusion There is no strong evidence to associate chronic traumatic brain injury with amateur boxing. PMID:17916811

Amateur boxing and risk of chronic traumatic brain injury: systematic review of observational studies.

PubMed

Loosemore, Mike; Knowles, Charles H; Whyte, Greg P

2007-10-20

To evaluate the risk of chronic traumatic brain injury from amateur boxing. Secondary research performed by combination of sport physicians and clinical academics. DESIGN, DATA SOURCES, AND METHODS: Systematic review of observational studies in which chronic traumatic brain injury was defined as any abnormality on clinical neurological examination, psychometric testing, neuroimaging studies, and electroencephalography. Studies were identified through database (1950 to date) and bibliographic searches without language restrictions. Two reviewers extracted study characteristics, quality, and data, with adherence to a protocol developed from a widely recommended method for systematic review of observational studies (MOOSE). 36 papers had relevant extractable data (from a detailed evaluation of 93 studies of 943 identified from the initial search). Quality of evidence was generally poor. The best quality studies were those with a cohort design and those that used psychometric tests. These yielded the most negative results: only four of 17 (24%) better quality studies found any indication of chronic traumatic brain injury in a minority of boxers studied. There is no strong evidence to associate chronic traumatic brain injury with amateur boxing.

Perceived Experiences of Anti-Bisexual Prejudice: Instrument Development and Evaluation

ERIC Educational Resources Information Center

Brewster, Melanie E.; Moradi, Bonnie

2010-01-01

This research describes the development and psychometric evaluation of the Anti-Bisexual Experiences Scale (ABES). Items were developed on the basis of prior literature, revised on the basis of expert feedback, and submitted to psychometric evaluation. Exploratory factor analysis of data from 350 bisexual participants yielded 3 factors of reported…

Refinement, Application, and Evaluation of Cognitive and Affective Chemistry Measures for College Students

ERIC Educational Resources Information Center

Heredia, Keily

2013-01-01

This work describes three case studies conducted to address two major problems in the area of chemistry education research, the lack of reported psychometrics regarding instrument scores, and the need for well-characterized assessments to evaluate college chemistry curricula. The first case study describes a psychometric evaluation of the Colorado…

A note on contemporary psychometrics.

PubMed

Vitoratou, Silia; Pickles, Andrew

2017-12-01

Psychometrics provide the mathematical underpinnings for psychological assessment. From the late 19th century, a plethora of methodological research achievements equipped researchers and clinicians with efficient tools whose practical value becomes more evident in the era of the internet and big data. Nowadays, powerful probabilistic models exist for most types of data and research questions. As the usability of the psychometric scales is better comprehended, there is an increased interest in applied research outcomes. Paradoxically, while the interest in applications for psychometric scales increases, publishing research on the development and/or evaluation of those scales per se, is not welcomed by many relevant journals. This special issue in psychometrics is therefore a great opportunity to briefly review the main ideas and methods used in psychometrics, and to discuss the challenges in contemporary applied psychometrics.

Psychometrics of a Child Report Measure of Maternal Support Following Disclosure of Sexual Abuse

PubMed Central

Smith, Daniel W.; Sawyer, Genelle K.; Heck, Nicholas C.; Zajac, Kristyn; Solomon, David; Self-Brown, Shannon; Danielson, Carla K.; Ralston, M. Elizabeth

2018-01-01

Objective The purpose of this study was to develop a psychometrically sound child-report measure of maternal support following disclosure of child sexual abuse. Maternal support following disclosure of child sexual abuse is an important predictor of child adjustment; however, this construct is not well defined, and a psychometrically sound method to assess maternal support from a child’s perspective does not exist. Methods Demographic and abuse-specific information was collected via structured interview from 146 mother-child dyads presenting for an initial forensic evaluation at a child advocacy center. Mothers completed the Maternal Self-report Support Questionnaire, and children completed the Trauma Symptom Checklist for Children and 32 items considered for inclusion in a new measure known as the Maternal Support Questionnaire – Child Report (MSQ-CR). Results Exploratory factor analysis of the MSQ-CR resulted in a three factor solution: Emotional Support (9 items), Skeptical Preoccupation (5 items), and Protection/Retaliation (6 items). Each factor demonstrated adequate internal consistency reliability. Analyses with the Maternal Self-report Support Questionnaire and the Trauma Symptom Checklist supported the construct and concurrent validity of the new measure. Conclusions The MSQ-CR demonstrated sound psychometric properties. Future research is needed to determine whether the MSQ-CR provides a more sensitive approximation of maternal support following disclosure of sexual abuse, relative to measures of global parent-child relations. Additional research is needed to contextualize discrepancies between mother and child ratings of maternal support. Important limitations of the investigation are reviewed. PMID:28471341

Measuring patient engagement: development and psychometric properties of the Patient Health Engagement (PHE) Scale

PubMed Central

Graffigna, Guendalina; Barello, Serena; Bonanomi, Andrea; Lozza, Edoardo

2015-01-01

Beyond the rhetorical call for increasing patients' engagement, policy makers recognize the urgency to have an evidence-based measure of patients' engagement and capture its effect when planning and implementing initiatives aimed at sustaining the engagement of consumers in their health. In this paper, authors describe the Patient Health Engagement Scale (PHE-scale), a measure of patient engagement that is grounded in rigorous conceptualization and appropriate psychometric methods. The scale was developed based on our previous conceptualization of patient engagement (the PHE-model). In particular, the items of the PHE-scale were developed based on the findings from the literature review and from interviews with chronic patients. Initial psychometric analysis was performed to pilot test a preliminary version of the items. The items were then refined and administered to a national sample of chronic patients (N = 382) to assess the measure's psychometric performance. A final phase of test-retest reliability was performed. The analysis showed that the PHE Scale has good psychometric properties with good correlation with concurrent measures and solid reliability. Having a valid and reliable measure to assess patient engagement is the first step in understanding patient engagement and its role in health care quality, outcomes, and cost containment. The PHE Scale shows a promising clinical relevance, indicating that it can be used to tailor intervention and assess changes after patient engagement interventions. PMID:25870566

Measuring patient engagement: development and psychometric properties of the Patient Health Engagement (PHE) Scale.

PubMed

Graffigna, Guendalina; Barello, Serena; Bonanomi, Andrea; Lozza, Edoardo

2015-01-01

Beyond the rhetorical call for increasing patients' engagement, policy makers recognize the urgency to have an evidence-based measure of patients' engagement and capture its effect when planning and implementing initiatives aimed at sustaining the engagement of consumers in their health. In this paper, authors describe the Patient Health Engagement Scale (PHE-scale), a measure of patient engagement that is grounded in rigorous conceptualization and appropriate psychometric methods. The scale was developed based on our previous conceptualization of patient engagement (the PHE-model). In particular, the items of the PHE-scale were developed based on the findings from the literature review and from interviews with chronic patients. Initial psychometric analysis was performed to pilot test a preliminary version of the items. The items were then refined and administered to a national sample of chronic patients (N = 382) to assess the measure's psychometric performance. A final phase of test-retest reliability was performed. The analysis showed that the PHE Scale has good psychometric properties with good correlation with concurrent measures and solid reliability. Having a valid and reliable measure to assess patient engagement is the first step in understanding patient engagement and its role in health care quality, outcomes, and cost containment. The PHE Scale shows a promising clinical relevance, indicating that it can be used to tailor intervention and assess changes after patient engagement interventions.

Psychometric Evaluation of the Fear of Positive Evaluation Scale in Patients with Social Anxiety Disorder

ERIC Educational Resources Information Center

Weeks, Justin W.; Heimberg, Richard G.; Rodebaugh, Thomas L.; Goldin, Philippe R.; Gross, James J.

2012-01-01

The Fear of Positive Evaluation Scale (FPES; J. W. Weeks, R. G. Heimberg, & T. L. Rodebaugh, 2008) was designed to assess fear of positive evaluation, a proposed cognitive component of social anxiety. Although previous findings on the psychometric properties of the FPES have been highly encouraging, only 1 previous study has examined the…

Social Cognition Psychometric Evaluation: Results of the Final Validation Study.

PubMed

Pinkham, Amy E; Harvey, Philip D; Penn, David L

2018-06-06

Social cognition is increasingly recognized as an important treatment target in schizophrenia; however, the dearth of well-validated measures that are suitable for use in clinical trials remains a significant limitation. The Social Cognition Psychometric Evaluation (SCOPE) study addresses this need by systematically evaluating the psychometric properties of promising measures. In this final phase of SCOPE, eight new or modified tasks were evaluated. Stable outpatients with schizophrenia (n = 218) and healthy controls (n = 154) completed the battery at baseline and 2-4 weeks later across three sites. Tasks included the Bell Lysaker Emotion Recognition Task (BLERT), Penn Emotion Recognition Task (ER-40), Reading the Mind in the Eyes Task (Eyes), The Awareness of Social Inferences Test (TASIT), Hinting Task, Mini Profile of Nonverbal Sensitivity (MiniPONS), Social Attribution Task-Multiple Choice (SAT-MC), and Intentionality Bias Task (IBT). BLERT and ER-40 modifications included response time and confidence ratings. The Eyes task was modified to include definitions of terms and TASIT to include response time. Hinting was scored with more stringent criteria. MiniPONS, SAT-MC, and IBT were new to this phase. Tasks were evaluated on (1) test-retest reliability, (2) utility as a repeated measure, (3) relationship to functional outcome, (4) practicality and tolerability, (5) sensitivity to group differences, and (6) internal consistency. Hinting, BLERT, and ER-40 showed the strongest psychometric properties and are recommended for use in clinical trials. Eyes, TASIT, and IBT showed somewhat weaker psychometric properties and require further study. MiniPONS and SAT-MC showed poorer psychometric properties that suggest caution for their use in clinical trials.

The development and psychometrical evaluation of a set of instruments to evaluate the effectiveness of diabetes patient education.

PubMed

Duprez, Veerle; De Pover, Marleen; De Spiegelaere, Marc; Beeckman, Dimitri

2014-02-01

To develop a set of psychometrically sound instruments to assess knowledge, self-management and self-efficacy of diabetic patients. Furthermore, a survey to evaluate the satisfaction about diabetes education for patients was developed and tested. Treatment and secondary prevention of diabetes require a complex combination of care components. Patients' education has been accepted to improve diabetes knowledge, self-management and self-efficacy. Psychometrically sound instruments are needed to measure these patient-centred outcomes. Psychometric instrument validation. The first phase included a systematic literature review to develop the instruments. Content validity was evaluated using a two-round Delphi procedure involving diabetes experts. The content validity of the instruments was excellent. In a second phase, a convenience sample of 188 diabetic patients in two hospitals in one specific care region in Belgium participated in the psychometric evaluation. The criterion-related validity and internal consistency reliability were evaluated. The study produced a 21-item knowledge instrument, reflecting knowledge about 'glycemic control' and 'medico-social management aspects'. The self-management instrument included 32 statements, reflecting 'treatment and compliance' and 'general lifestyle'. The self-efficacy instrument included 30 items, reflecting 'nutrition', 'treatment' and 'regimen'. The patient satisfaction survey included 36 items, reflecting satisfaction about the relationship among the diabetes specialist, the diabetes educator, podiatrist and dietician. An instrument set with sound psychometric characteristics was developed to assess knowledge, self-management and self-efficacy of diabetic patients. Future studies should focus on the association between the instrument outcomes and clinical patient outcomes. The current instrument can support the design of educational interventions and training programmes and reduce inconsistencies in the information that patients receive. Furthermore, the instruments can be used for benchmarking the quality of diabetic patient education. © 2013 Blackwell Publishing Ltd.

Danish translation, cultural adaption and initial psychometric evaluation of the patient feedback form.

PubMed

Tolstrup, Lærke K; Pappot, Helle; Zangger, Graziella; Bastholt, Lars; Zwisler, Ann-Dorthe; Dieperink, Karin B

2018-04-27

No suitable Danish questionnaire exists to evaluate patient satisfaction with various patient reported outcome measures. Thus, the aim of this research project was to conduct a study on the translation and cultural adaption of an American patient reported experience measures questionnaire, "Patient Feedback Form", among Danish patients, and to examine selected psychometric properties within reliability. In the first phase of the study, the Patient Feedback Form was forward and backward translated following the methodology of existing guidelines. Subsequently, cognitive interviewing was performed with seven cancer patients and seven healthy persons (19-86 years old/6 men and 8 women) to ensure that questions were easy to understand and made sense to Danish interviewees. In the second phase, phone interviews were carried out with 95 prostate cancer patients after they had responded to the same Patient Feedback Form. Missing data was imputed using the Expectation-Maximization technique. To examine the structure of the questionnaire, an exploratory factor analysis was conducted. Cronbach's alpha was calculated to investigate internal consistency. There were only minor disagreements in the translation process, and the reconciliation went smoothly (phase 1). With regard to one item, however, it was difficult to reach a consensus. Through the qualitative validation process, the right solution was found. The results from the psychometric testing (phase 2) showed that four factors had an Eigen value > 1, but only one factor was extracted as the Scree plot had a clear "elbow", showing a one factor structure that explained 46.1% of the variance. The internal consistency was high as Cronbach's alpha was 0.89. The translated, culturally adapted, and validated version of the Patient Feedback Form seems to be suitable for measuring satisfaction with patient reported outcome measures in a Danish setting. While the results should be treated with caution due to the small sample size, psychometric testing indicates that the questionnaire is a valid instrument. However, additional psychometric testing such as hypotheses testing, responsiveness, and test-retest on a larger and more diverse sample size is required to further verify the validity of the instrument.

Increasing meaning in measurement: a Rasch analysis of the Child-Adolescent Teasing Scale.

PubMed

Vessey, Judith A; DiFazio, Rachel L; Strout, Tania D

2012-01-01

In today's increasingly violent society, many childhood incidents that begin as simple teasing deteriorate into persistent bullying. The Child-Adolescent Teasing Scale (CATS) was developed to measure self-perceived teasing in youths aged 11-15 years. It was validated initially using the principles of classical test theory and deemed to be a reliable and valid measure of teasing; it has been responsive to change in intervention studies. The aim of this study was to evaluate further the psychometric properties of the CATS by evaluating the degree to which the CATS items are congruent with the primary assumptions of the Rasch measurement model. A methodological study design using a Rasch Rating Scale Model was utilized to examine the psychometric properties of the 32-item CATS. The sample of the CATS consisted of 666 youths aged 11-15 years from diverse racial and socioeconomic backgrounds and geographic regions. Unidimensionality, hierarchical ordering, and stretching of the variable's responses along a continuum were examined. The current CATS subscales do not fit the criteria for the Rasch model. The subscales are not unidimensional or hierarchical and do not exist on upon a continuum upon which items can be ordered and children can be placed. The divergent results between the classical test theory and Rasch analyses, although not completely surprising, underscore the need for continued refinement of an instrument's psychometric properties to ensure it is measuring the concept of interest in the way it was intended.

Observational Coding Systems of Parent-Child Interactions During Painful Procedures: A Systematic Review.

PubMed

Bai, Jinbing; Swanson, Kristen M; Santacroce, Sheila J

2018-01-01

Parent interactions with their child can influence the child's pain and distress during painful procedures. Reliable and valid interaction analysis systems (IASs) are valuable tools for capturing these interactions. The extent to which IASs are used in observational research of parent-child interactions is unknown in pediatric populations. To identify and evaluate studies that focus on assessing psychometric properties of initial iterations/publications of observational coding systems of parent-child interactions during painful procedures. To identify and evaluate studies that focus on assessing psychometric properties of initial iterations/publications of observational coding systems of parent-child interactions during painful procedures. Computerized databases searched included PubMed, CINAHL, PsycINFO, Health and Psychosocial Instruments, and Scopus. Timeframes covered from inception of the database to January 2017. Studies were included if they reported use or psychometrics of parent-child IASs. First assessment was whether the parent-child IASs were theory-based; next, using the Society of Pediatric Psychology Assessment Task Force criteria IASs were assigned to one of three categories: well-established, approaching well-established, or promising. A total of 795 studies were identified through computerized searches. Eighteen studies were ultimately determined to be eligible for inclusion in the review and 17 parent-child IASs were identified from these 18 studies. Among the 17 coding systems, 14 were suitable for use in children age 3 years or more; two were theory-based; and 11 included verbal and nonverbal parent behaviors that promoted either child coping or child distress. Four IASs were assessed as well-established; seven approached well-established; and six were promising. Findings indicate a need for the development of theory-based parent-child IASs that consider both verbal and nonverbal parent behaviors during painful procedures. Findings also suggest a need for further testing of those parent-child IASs deemed "approaching well-established" or "promising". © 2017 World Institute of Pain.

Initial psychometric evaluation of the Moral Injury Questionnaire--Military version.

PubMed

Currier, Joseph M; Holland, Jason M; Drescher, Kent; Foy, David

2015-01-01

Moral injury is an emerging construct related to negative consequences associated with war-zone stressors that transgress military veterans' deeply held values/beliefs. Given the newness of the construct, there is a need for instrumentation that might assess morally injurious experiences (MIEs) in this population. Drawing on a community sample of 131 Iraq and/or Afghanistan Veterans and clinical sample of 82 returning Veterans, we conducted an initial psychometric evaluation of the newly developed Moral Injury Questionnaire-Military version (MIQ-M)-a 20-item self-report measure for assessing MIEs. Possibly due to low rates of reporting, an item assessing sexual trauma did not yield favourable psychometric properties and was excluded from analyses. Veterans in the clinical sample endorsed significantly higher scores across MIQ-M items. Factor analytic results for the final 19 items supported a unidimensional structure, and convergent validity analyses revealed that higher scores (indicative of more MIEs) were correlated with greater general combat exposure, impairments in work/social functioning, posttraumatic stress and depression in the community sample. In addition, when controlling for demographics, deployment-related factors and exposure to life threat stressors associated with combat, tests of incremental validity indicated that MIQ-M scores were also uniquely linked with suicide risk and other mental health outcomes. These findings provide preliminary evidence for the validity of the MIQ-M and support the applicability of this measure for further research and clinical work with Veterans. Military service can confront service members with experiences that undermine their core sense of humanity and violate global values and beliefs. These types of experiences increase the risk for posttraumatic maladjustment in this population, even when accounting for rates of exposure to life threat traumas. Moral injury is an emerging construct to more fully capture the many possible psychological, ethical, and spiritual/existential challenges among persons who served in modern wars and other trauma-exposed professional groups. There is currently a need for psychometrically sound instrumentation for assessing morally injurious experiences (MIEs). The Moral Injury Questionnaire - Military Version (MIQ-M) was developed to provide a tool for assessing possible MIEs among military populations. This study provides preliminary evidence of the validity - including factorial, concurrent, and incremental - and clinical utility of the MIQ-M for further applications in clinical and research contexts. Copyright © 2013 John Wiley & Sons, Ltd.

A Psychometric Review of Norm-Referenced Tests Used to Assess Phonological Error Patterns

ERIC Educational Resources Information Center

Kirk, Celia; Vigeland, Laura

2014-01-01

Purpose: The authors provide a review of the psychometric properties of 6 norm-referenced tests designed to measure children's phonological error patterns. Three aspects of the tests' psychometric adequacy were evaluated: the normative sample, reliability, and validity. Method: The specific criteria used for determining the psychometric…

Psychometric properties evaluation of a new ergonomics-related job factors questionnaire developed for nursing workers.

PubMed

Coluci, Marina Zambon Orpinelli; Alexandre, Neusa Maria Costa

2014-11-01

The objectives of this study were to develop a questionnaire that evaluates the perception of nursing workers to job factors that may contribute to musculoskeletal symptoms, and to evaluate its psychometric properties. Internationally recommended methodology was followed: construction of domains, items and the instrument as a whole, content validity, and pre-test. Psychometric properties were evaluated among 370 nursing workers. Construct validity was analyzed by the factorial analysis, known-groups technique, and convergent validity. Reliability was assessed through internal consistency and stability. Results indicated satisfactory fit indices during confirmatory factor analysis, significant difference (p < 0.01) between the responses of nursing and office workers, and moderate correlations between the new questionnaire and Numeric Pain Scale, SF-36 and WRFQ. Cronbach's alpha was close to 0.90 and ICC values ranged from 0.64 to 0.76. Therefore, results indicated that the new questionnaire had good psychometric properties for use in studies involving nursing workers. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Quality of Life Assessment for Physical Activity and Health Promotion: Further Psychometrics and Comparison of Measures

ERIC Educational Resources Information Center

Gill, Diane L.; Reifsteck, Erin J.; Adams, Melanie M.; Shang, Ya-Ting

2015-01-01

Despite the clear relationship between physical activity and quality of life, few sound, relevant quality of life measures exist. Gill and colleagues developed a 32-item quality of life survey, and provided initial psychometric evidence. This study further examined that quality of life survey in comparison with the widely used short form (SF-36)…

Psychometric Properties of the Student Risk Screening Scale: An Effective Tool for Use in Diverse Urban Elementary Schools

ERIC Educational Resources Information Center

Oakes, Wendy Peia; Wilder, Kaitlin S.; Lane, Kathleen Lynne; Powers, Lisa; Yokoyama, Lynn T. K.; O'Hare, Mary Ellen; Jenkins, Abbie B.

2010-01-01

The authors examined the psychometric properties of the "Student Risk Screening Scale", as used in three ethnically, culturally, and economically diverse urban midwestern elementary schools. The results suggest strong internal consistency ([alpha] = 0.81-0.82) and test-retest stability (r = 0.86). Initial ratings of risk as measured by…

Scale Development and Initial Tests of the Multidimensional Complex Adaptive Leadership Scale for School Principals: An Exploratory Mixed Method Study

ERIC Educational Resources Information Center

Özen, Hamit; Turan, Selahattin

2017-01-01

This study was designed to develop the scale of the Complex Adaptive Leadership for School Principals (CAL-SP) and examine its psychometric properties. This was an exploratory mixed method research design (ES-MMD). Both qualitative and quantitative methods were used to develop and assess psychometric properties of the questionnaire. This study…

A Psychometric Evaluation of the STAI-Y, BDI-II, and PAI Using Single and Multifactorial Models in Young Adults Seeking Psychoeducational Evaluation

ERIC Educational Resources Information Center

Hill, Benjamin D.; Musso, Mandi; Jones, Glenn N.; Pella, Russell D.; Gouvier, Wm. Drew

2013-01-01

A psychometric evaluation on the measurement of self-report anxiety and depression using the Beck Depression Inventory (BDI-II), State Trait Anxiety Inventory, Form-Y (STAI-Y), and the Personality Assessment Inventory (PAI) was performed using a sample of 534 generally young adults seeking psychoeducational evaluation at a university-based clinic.…

Counselor Competence, Performance Assessment, and Program Evaluation: Using Psychometric Instruments

ERIC Educational Resources Information Center

Tate, Kevin A.; Bloom, Margaret L.; Tassara, Marcel H.; Caperton, William

2014-01-01

Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

Development and preliminary validation of the Parenting around SNAcking Questionnaire (P-SNAQ).

PubMed

Davison, K K; Blake, C E; Kachurak, A; Lumeng, J C; Coffman, D L; Miller, A L; Hughes, S O; Power, T G; Vaughn, A F; Blaine, R E; Younginer, N; Fisher, J O

2018-06-01

Snacking makes significant contributions to children's dietary intake but is poorly understood from a parenting perspective. This research was designed to develop and evaluate the psychometrics of a theoretically grounded, empirically-informed measure of snack parenting. The Parenting around SNAcking Questionnaire (P-SNAQ) was developed using a conceptual model derived from current theory and mixed-methods research to include 20 hypothesized snack parenting practices along 4 parenting dimensions (autonomy support, structure, coercive control and permissiveness). Expert panel evaluation and cognitive interviews were used to refine items and construct definitions. The initial instrument of 105 items was administered to an ethnically diverse, low-income sample of 305 parents (92% mothers) of children aged 1-6 y participating in three existing cohort studies. The sample was randomly split into two equal samples. Exploratory factor analysis was conducted with the first sample to identify snack parenting practices within each parenting dimension, followed by confirmatory factor analysis with the second sample to test the hypothesized factor structure. Internal consistency of sub-scales and associations with existing measures of food parenting practices and styles and child weight status were evaluated. The final P-SNAQ scale included 51 items reflecting 14 snack parenting practices across four parenting dimensions. The factor structure of the P-SNAQ was consistent with prior theoretical frameworks. Internal consistency coefficients were good to very good for 12 out of 14 scales and subscale scores were moderately correlated with previously validated measures. In conclusion, initial evidence suggests that P-SNAQ is a psychometrically sound measure for evaluating a wide range of snack parenting practices in young children. Copyright © 2018 Elsevier Ltd. All rights reserved.

The development and initial psychometric evaluation of a measure assessing adherence to prescribed exercise: the Exercise Adherence Rating Scale (EARS).

PubMed

Newman-Beinart, Naomi A; Norton, Sam; Dowling, Dominic; Gavriloff, Dimitri; Vari, Chiara; Weinman, John A; Godfrey, Emma L

2017-06-01

There is no gold standard for measuring adherence to prescribed home exercise. Self-report diaries are commonly used however lack of standardisation, inaccurate recall and self-presentation bias limit their validity. A valid and reliable tool to assess exercise adherence behaviour is required. Consequently, this article reports the development and psychometric evaluation of the Exercise Adherence Rating Scale (EARS). Development of a questionnaire. Secondary care in physiotherapy departments of three hospitals. A focus group consisting of 8 patients with chronic low back pain (CLBP) and 2 physiotherapists was conducted to generate qualitative data. Following on from this, a convenience sample of 224 people with CLBP completed the initial 16-item EARS for purposes of subsequent validity and reliability analyses. Construct validity was explored using exploratory factor analysis and item response theory. Test-retest reliability was assessed 3 weeks later in a sub-sample of patients. An item pool consisting of 6 items was found suitable for factor analysis. Examination of the scale structure of these 6 items revealed a one factor solution explaining a total of 71% of the variance in adherence to exercise. The six items formed a unidimensional scale that showed good measurement properties, including acceptable internal consistency and high test-retest reliability. The EARS enables the measurement of adherence to prescribed home exercise. This may facilitate the evaluation of interventions promoting self-management for both the prevention and treatment of chronic conditions. Copyright © 2017 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Development and psychometric validation of the general practice nurse satisfaction scale.

PubMed

Halcomb, Elizabeth J; Caldwell, Belinda; Salamonson, Yenna; Davidson, Patricia M

2011-09-01

To develop an instrument to assess consumer satisfaction with nursing in general practice to provide feedback to nurses about consumers' perceptions of their performance. Prospective psychometric instrument validation study. A literature review was conducted to generate items for an instrument to measure consumer satisfaction with nursing in general practice. Face and content validity were evaluated by an expert panel, which had extensive experience in general practice nursing and research. Included in the questionnaire battery was the 27-item General Practice Nurse Satisfaction (GPNS) scale, as well as demographic and health status items. This survey was distributed to 739 consumers following intervention administered by a practice nurse in 16 general practices across metropolitan, rural, and regional Australia. Participants had the option of completing the survey online or receiving a hard copy of the survey form at the time of their visit. These data were collected between June and August 2009. Satisfaction data from 739 consumers were collected following their consultation with a general practice nurse. From the initial 27-item GPNS scale, a 21-item instrument was developed. Two factors, "confidence and credibility" and "interpersonal and communication" were extracted using principal axis factoring and varimax rotation. These two factors explained 71.9% of the variance. Cronbach's α was 0.97. The GPNS scale has demonstrated acceptable psychometric properties and can be used both in research and clinical practice for evaluating consumer satisfaction with general practice nurses. Assessing consumer satisfaction is important for developing and evaluating nursing roles. The GPNS scale is a valid and reliable tool that can be utilized to assess consumer satisfaction with general practice nurses and can assist in performance management and improving the quality of nursing services. © 2011 Sigma Theta Tau International.

The Dutch Memory Compensation Questionnaire: Psychometric Properties and Regression-Based Norms

ERIC Educational Resources Information Center

Van der Elst, Wim; Hoogenhout, Esther M.; Dixon, Roger A.; De Groot, Renate H. M.; Jolles, Jelle

2011-01-01

The Memory Compensation Questionnaire (MCQ) is a psychometrically sound instrument that assesses the variety and extent to which an individual compensates for actual or perceived memory losses. Until now, only an English version of the MCQ has been psychometrically evaluated. The aim of the present study was to establish a Dutch version of the MCQ…

Psychometric Characteristics of the Persian Version of the Multidimensional School Anger Inventory-Revised

ERIC Educational Resources Information Center

Aryadoust, Vahid; Akbarzadeh, Sanaz; Akbarzedeh, Sara

2011-01-01

The Multidimensional School Anger Inventory-Revised (MSAI-R) is a measurement tool to evaluate high school students' anger. Its psychometric features have been tested in the USA, Australia, Japan, Guatemala, and Italy. This study investigates the factor structure and psychometric quality of the Persian version of the MSAI-R using data from an…

A Psychometric Evaluation of the Self-Presentational Efficacy Scale

ERIC Educational Resources Information Center

Lamarche, Larkin; Gammage, Kimberley L.; Sullivan, Philip J.; Gabriel, David A.

2013-01-01

This study examined the psychometric properties of the Self-Presentational Efficacy Scale (SPES) developed by Gammage, Hall, and Martin Ginis (2004). University students (196 men and 269 women) completed the SPES and measures of social physique anxiety, fear of negative evaluation, and physical activity. Participants also completed the SPES a…

Psychometric Evaluation of the Simplified Chinese Version of Flourishing Scale

ERIC Educational Resources Information Center

Tang, Xiaoqing; Duan, Wenjie; Wang, Zhizhang; Liu, Tianyuan

2016-01-01

Objectives: The Flourishing Scale (FS) was developed to measure psychological well-being from the eudaimonic perspective, highlighting the flourishing of human functioning. This article evaluated the psychometric characteristics of the simplified Chinese version of FS among a Chinese community population. Method: A total of 433 participants from…

Investigating Key Psychometric Properties of the French Version of the Early Years Evaluation-Teacher Assessment

ERIC Educational Resources Information Center

Laurie, Robert; Sloat, Elizabeth

2016-01-01

This research investigates key psychometric properties of the French Early Years Evaluation-Teacher Assessment measure designed to systematically assess kindergarten children across five social and academic developmental domains: awareness of self and environment, social skills and behaviour, cognitive abilities, language and communication, and…

The Swedish version of the Acceptance of Chronic Health Conditions Scale for people with multiple sclerosis: Translation, cultural adaptation and psychometric properties.

PubMed

Forslin, Mia; Kottorp, Anders; Kierkegaard, Marie; Johansson, Sverker

2016-11-11

To translate and culturally adapt the Acceptance of Chronic Health Conditions (ACHC) Scale for people with multiple sclerosis into Swedish, and to analyse the psychometric properties of the Swedish version. Ten people with multiple sclerosis participated in translation and cultural adaptation of the ACHC Scale; 148 people with multiple sclerosis were included in evaluation of the psychometric properties of the scale. Translation and cultural adaptation were carried out through translation and back-translation, by expert committee evaluation and pre-test with cognitive interviews in people with multiple sclerosis. The psychometric properties of the Swedish version were evaluated using Rasch analysis. The Swedish version of the ACHC Scale was an acceptable equivalent to the original version. Seven of the original 10 items fitted the Rasch model and demonstrated ability to separate between groups. A 5-item version, including 2 items and 3 super-items, demonstrated better psychometric properties, but lower ability to separate between groups. The Swedish version of the ACHC Scale with the original 10 items did not fit the Rasch model. Two solutions, either with 7 items (ACHC-7) or with 2 items and 3 super-items (ACHC-5), demonstrated acceptable psychometric properties. Use of the ACHC-5 Scale with super-items is recommended, since this solution adjusts for local dependency among items.

Psychometrics in action, science as practice.

PubMed

Pearce, Jacob

2017-07-27

Practitioners in health sciences education and assessment regularly use a range of psychometric techniques to analyse data, evaluate models, and make crucial progression decisions regarding student learning. However, a recent editorial entitled "Is Psychometrics Science?" highlighted some core epistemological and practical problems in psychometrics, and brought its legitimacy into question. This paper attempts to address these issues by applying some key ideas from history and philosophy of science (HPS) discourse. I present some of the conceptual developments in HPS that have bearing on the psychometrics debate. Next, by shifting the focus onto what constitutes the practice of science, I discuss psychometrics in action. Some incorrectly conceptualize science as an assemblage of truths, rather than an assemblage of tools and goals. Psychometrics, however, seems to be an assemblage of methods and techniques. Psychometrics in action represents a range of practices using specific tools in specific contexts. This does not render the practice of psychometrics meaningless or futile. Engaging in debates about whether or not we should regard psychometrics as 'scientific' is, however, a fruitless enterprise. The key question and focus should be whether, on what grounds, and in what contexts, the existing methods and techniques used by psychometricians can be justified or criticized.

Assessing Management Support for Worksite Health Promotion: Psychometric Analysis of the Leading by Example (LBE) Instrument

PubMed Central

Della, Lindsay J.; DeJoy, David M.; Goetzel, Ron Z.; Ozminkowski, Ronald J.; Wilson, Mark G.

2009-01-01

Objective This paper describes the development of the Leading by Example (LBE) instrument. Methods Exploratory factor analysis was used to obtain an initial factor structure. Factor validity was evaluated using confirmatory factor analysis methods. Cronbach’s alpha and item-total correlations provided information on the reliability of the factor subscales. Results Four subscales were identified: business alignment with health promotion objectives; awareness of the health-productivity link; worksite support for health promotion; leadership support for health promotion. Factor by group comparisons revealed that the initial factor structure is effective in detecting differences in organizational support for health promotion across different employee groups Conclusions Management support for health promotion can be assessed using the LBE, a brief, self-report questionnaire. Researchers can use the LBE to diagnose, track, and evaluate worksite health promotion programs. PMID:18517097

A psychometric evaluation of the University of Auckland General Practice Report of Educational Environment: UAGREE.

PubMed

Eggleton, Kyle; Goodyear-Smith, Felicity; Henning, Marcus; Jones, Rhys; Shulruf, Boaz

2017-03-01

The aim of this study was to develop an instrument (University of Auckland General Practice Report of Educational Environment: UAGREE) with robust psychometric properties that measured the educational environment of undergraduate primary care. The questions were designed to incorporate measurements of the teaching of cultural competence. Following a structured consensus process and an initial pilot, a list of 55 questions was developed. All Year 5 and 6 students completing a primary care attachment at Auckland University were invited to complete the questionnaire. The results were analysed using exploratory factor analysis and confirmatory factor analysis resulting in a 16-item instrument. Three factors were identified explaining 53% of the variance. The items' reliability within the factors were high (Learning: 0.894; Teaching: 0.871; Cultural competence: 0.857). Multiple groups analysis by gender; and separately across ethnic groups did not find significant differences between groups. UAGREE is a specific instrument measuring the undergraduate primary care educational environment. Its questions fit within established theoretical educational environment frameworks and the incorporation of cultural competence questions reflects the importance of teaching cultural competence within medicine. The psychometric properties of UAGREE suggest that it is a reliable and valid measure of the primary care education environment.

The measurement of fatigue in chronic illness: a systematic review of unidimensional and multidimensional fatigue measures.

PubMed

Whitehead, Lisa

2009-01-01

Fatigue is a common symptom associated with a wide range of chronic diseases. A large number of instruments have been developed to measure fatigue. An assessment regarding the reliability, validity, and utility of fatigue measures is time-consuming for the clinician and researcher, and few reviews exist on which to draw such information. The aim of this article is to present a critical review of fatigue measures, the populations in which the scales have been used, and the extent to which the psychometric properties of each instrument have been evaluated to provide clinicians and researchers with information on which to base decisions. Seven databases were searched for all articles that measured fatigue and offered an insight into the psychometric properties of the scales used over the period 1980-2007. Criteria for judging the "ideal" measure were developed to encompass scale usability, clinical/research utility, and the robustness of psychometric properties. Twenty-two fatigue measures met the inclusion criteria and were evaluated. A further 17 measures met some of the criteria, but have not been tested beyond initial development, and are reviewed briefly at the end of the article. The review did not identify any instrument that met all the criteria of an ideal instrument. However, a small number of short instruments demonstrated good psychometric properties (Fatigue Severity Scale [FSS], Fatigue Impact Scale [FIS], and Brief Fatigue Inventory [BFI]), and three comprehensive instruments demonstrated the same (Fatigue Symptom Inventory [FSI], Multidimensional Assessment of Fatigue [MAF], and Multidimensional Fatigue Symptom Inventory [MFSI]). Only four measures (BFI, FSS, FSI, and MAF) demonstrated the ability to detect change over time. The clinician and researcher also should consider the populations in which the scale has been used previously to assess its validity with their own patient group, and assess the content of a scale to ensure that the key qualitative aspects of fatigue of the population of interest are covered.

Psychometric Properties of the MMPI-2-RF Somatic Complaints (RC1) Scale

ERIC Educational Resources Information Center

Thomas, Michael L.; Locke, Dona E. C.

2010-01-01

The MMPI-2 Restructured Form (MMPI-2-RF; Tellegen & Ben-Porath, 2008) was designed to be psychometrically superior to its MMPI-2 counterpart. However, the test has yet to be extensively evaluated in diverse clinical settings. The purpose of this study was to examine the psychometric properties of the MMPI-2-RF Somatic Complaints (RC1) scale in…

Hurlbert Index of Sexual Assertiveness: a study of psychometric properties in a Spanish sample.

PubMed

Santos-Iglesias, Pablo; Sierra, Juan Carlos

2010-08-01

The study analyzed psychometric properties of a Spanish version of the Hurlbert Index of Sexual Assertiveness in a Spanish sample of 400 men and 453 women who had had a partner for the last 6 mo. or longer at the time of the study. Exploratory and confirmatory factor analyses suggested a two-factor solution with the factors Initiation and No shyness/Refusal. Internal consistency values for total scores were .87 and .83 for the factors, respectively. Convergent validity tests were also satisfactory. It is therefore reasonable to conclude that the Spanish version of the scale has appropriate psychometric properties.

A dimensional approach to measuring anxiety for DSM-5.

PubMed

Lebeau, Richard T; Glenn, Daniel E; Hanover, Lauren N; Beesdo-Baum, Katja; Wittchen, Hans-Ulrich; Craske, Michelle G

2012-12-01

In preparation for DSM-5's planned inclusion of dimensional assessments of psychopathology as a complement to traditional categorical diagnoses, we developed brief self-rated scales for anxiety disorders that are consistent in content and structure. In the present paper, we discuss the creation of the scales and examine their psychometric properties and clinical sensitivity. Phase One assessed psychometric properties of the initial versions of the scales in a large non-clinical sample (n = 702). Phase Two assessed the psychometric properties of revised versions of the scales, including test-retest reliability, in a non-clinical sample (n = 57). Phase Three examined the scales' psychometric properties and relationship with clinician ratings of disorder severity in a clinical sample (n = 48). The scales demonstrated internal consistency (α = 0.85-0.92), convergent validity (r(s)  = 0.39-0.69), and test-retest reliability in the non-clinical samples (ICC = 0.51-0.81). In the clinical sample, the scales demonstrated significantly higher total scores than in the non-clinical sample (Cohen's d = 0.72-1.50) and moderate to high correlations with clinician ratings of disorder severity (r = 0.43-0.82) Although further evaluation and refinement of the scales (particularly the specific phobia and agoraphobia scales) is needed, the results provide preliminary support for the use of these scales in DSM-5 and thus take an important step toward the integration of standardized dimensional measurement into the diagnosis of anxiety disorders. Copyright © 2012 American Psychiatric Association. All rights reserved.

Psychometric assessment of the IBS-D Daily Symptom Diary and Symptom Event Log.

PubMed

Rosa, Kathleen; Delgado-Herrera, Leticia; Zeiher, Bernie; Banderas, Benjamin; Arbuckle, Rob; Spears, Glen; Hudgens, Stacie

2016-12-01

Diarrhea-predominant irritable bowel syndrome (IBS-D) can considerably impact patients' lives. Patient-reported symptoms are crucial in understanding the diagnosis and progression of IBS-D. This study psychometrically evaluates the newly developed IBS-D Daily Symptom Diary and Symptom Event Log (hereafter, "Event Log") according to US regulatory recommendations. A US-based observational field study was conducted to understand cross-sectional psychometric properties of the IBS-D Daily Symptom Diary and Event Log. Analyses included item descriptive statistics, item-to-item correlations, reliability, and construct validity. The IBS-D Daily Symptom Diary and Event Log had no items with excessive missing data. With the exception of two items ("frequency of gas" and "accidents"), moderate to high inter-item correlations were observed among all items of the IBS-D Daily Symptom Diary and Event Log (day 1 range 0.67-0.90). Item scores demonstrated reliability, with the exception of the "frequency of gas" and "accidents" items of the Diary and "incomplete evacuation" item of the Event Log. The pattern of correlations of the IBS-D Daily Symptom Diary and Event Log item scores with generic and disease-specific measures was as expected, moderate for similar constructs and low for dissimilar constructs, supporting construct validity. Known-groups methods showed statistically significant differences and monotonic trends in each of the IBS-D Daily Symptom Diary item scores among groups defined by patients' IBS-D severity ratings ("none"/"mild," "moderate," or "severe"/"very severe"), supporting construct validity. Initial psychometric results support the reliability and validity of the items of the IBS-D Daily Symptom Diary and Event Log.

A psychometric evaluation of the digital logic concept inventory

NASA Astrophysics Data System (ADS)

Herman, Geoffrey L.; Zilles, Craig; Loui, Michael C.

2014-10-01

Concept inventories hold tremendous promise for promoting the rigorous evaluation of teaching methods that might remedy common student misconceptions and promote deep learning. The measurements from concept inventories can be trusted only if the concept inventories are evaluated both by expert feedback and statistical scrutiny (psychometric evaluation). Classical Test Theory and Item Response Theory provide two psychometric frameworks for evaluating the quality of assessment tools. We discuss how these theories can be applied to assessment tools generally and then apply them to the Digital Logic Concept Inventory (DLCI). We demonstrate that the DLCI is sufficiently reliable for research purposes when used in its entirety and as a post-course assessment of students' conceptual understanding of digital logic. The DLCI can also discriminate between students across a wide range of ability levels, providing the most information about weaker students' ability levels.

Psychometric Evaluation of the Social Problem-Solving Inventory-Revised among Overweight or Obese Adults

ERIC Educational Resources Information Center

Wang, Jing; Matthews, Judith T.; Sereika, Susan M.; Chasens, Eileen R.; Ewing, Linda J.; Burke, Lora E.

2013-01-01

Problem solving is a key component of weight loss programs. The Social Problem Solving Inventory-Revised (SPSI-R) has not been evaluated in weight loss studies. The purpose of this study was to evaluate the psychometrics of the SPSI-R. Cronbach's a (0.95 for total score; 0.67-0.92 for subscales) confirmed internal consistency reliability. The…

A Psychometric Evaluation of the Anatomy Learning Experiences Questionnaire and Correlations with Learning Outcomes

ERIC Educational Resources Information Center

Choi-Lundberg, Derek L.; Williams, Anne-Marie M.; Zimitat, Craig

2017-01-01

The Anatomy Learning Experiences Questionnaire (ALEQ) was designed by Smith and Mathias to explore students' perceptions and experiences of learning anatomy. In this study, the psychometric properties of a slightly altered 34-item ALEQ (ALEQ-34) were evaluated, and correlations with learning outcomes investigated, by surveying first- and…

Automated Essay Scoring: Psychometric Guidelines and Practices

ERIC Educational Resources Information Center

Ramineni, Chaitanya; Williamson, David M.

2013-01-01

In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

Measuring the Youth Bullying Experience: A Systematic Review of the Psychometric Properties of Available Instruments

ERIC Educational Resources Information Center

Vessey, Judith; Strout, Tania D.; DiFazio, Rachel L.; Walker, Allison

2014-01-01

Background: Bullying is a significant problem in schools and measuring this concept remains problematic. The purposes of this study were to (1) identify the published self-report measures developed to assess youth bullying; (2) evaluate their psychometric properties and instrument characteristics; and (3) evaluate the quality of identified…

The Psychometric Evaluation of a Questionnaire to Measure Attitudes towards Inclusive Education

ERIC Educational Resources Information Center

de Boer, Anke; Timmerman, Marieke; Pijl, Sip Jan; Minnaert, Alexander

2012-01-01

In many countries, there has been a development towards the inclusion of students with special educational needs in regular education. Over the past decade, this has resulted in an increased interest in attitudes towards this educational change of those directly involved. This current study aims at the development, psychometric evaluation, and…

Development and Psychometric Evaluation of the Counseling Women Competencies Scale (CWCS)

ERIC Educational Resources Information Center

Ancis, Julie R.; Szymanski, Dawn M.; Ladany, Nicholas

2008-01-01

This article describes the development and psychometric evaluation of the Counseling Women Competencies Scale (CWCS). The CWCS is designed to assess clinicians' self-perceived competencies with regard to therapeutic practice with diverse female clients. Through an extensive review of the literature on counseling women and expert review by 32…

Creation of a computer self-efficacy measure: analysis of internal consistency, psychometric properties, and validity.

PubMed

Howard, Matt C

2014-10-01

Computer self-efficacy is an often studied construct that has been shown to be related to an array of important individual outcomes. Unfortunately, existing measures of computer self-efficacy suffer from several deficiencies, including criterion contamination, outdated wording, and/or inadequate psychometric properties. For this reason, the current article presents the creation of a new computer self-efficacy measure. In Study 1, an over-representative item list is created and subsequently reduced through exploratory factor analysis to create an initial measure, and the discriminant validity of this initial measure is tested. In Study 2, the unidimensional factor structure of the initial measure is supported through confirmatory factor analysis and further reduced into a final, 12-item measure. In Study 3, the convergent and criterion validity of the 12-item measure is tested. Overall, this three study process demonstrates that the new computer self-efficacy measure has superb psychometric properties and internal reliability, and demonstrates excellent evidence for several aspects of validity. It is hoped that the 12-item computer self-efficacy measure will be utilized in future research on computer self-efficacy, which is discussed in the current article.

The quality of dying and death measurement instruments: A systematic psychometric review.

PubMed

Gutiérrez Sánchez, Daniel; Pérez Cruzado, David; Cuesta-Vargas, Antonio I

2018-04-19

To identify instruments that could assess the quality of dying and death and their psychometric properties. To assess the methodological quality of studies on measurement properties. A high quality of death is regarded as a goal at the end of life and, therefore, an assessment of the end of life experience is essential. Many instruments have been developed to evaluate the quality of dying and death. The selection of the most appropriate measure to be used in clinical and research settings is crucial. Psychometric systematic review. We systematically searched ProQuest Medline, SciELO and ProQuest PsycINFO from 1970 - May 2016. Identification and evaluation of instruments that assessed quality of dying and death. Papers were evaluated by two independent reviewers according to the COSMIN checklist with a 4-point scale. A total of 19 studies were included in this review. Seven instruments were found that were specifically designed for assessing quality of dying and death. A retrospective carer proxy report to evaluate this construct was used in most of the papers. The methodological quality of the studies was fair for most of the psychometric characteristics analyzed. Many instruments have been developed to assess the quality of dying and death. The Quality of Dying and Death Questionnaire is the best available measure of the quality of dying and death. It is the only questionnaire identified in this review where all psychometric properties according to the COSMIN checklist have been evaluated. © 2018 John Wiley & Sons Ltd.

Psychometric Development of the Research and Knowledge Scale.

PubMed

Powell, Lauren R; Ojukwu, Elizabeth; Person, Sharina D; Allison, Jeroan; Rosal, Milagros C; Lemon, Stephenie C

2017-02-01

Many research participants are misinformed about research terms, procedures, and goals; however, no validated instruments exist to assess individual's comprehension of health-related research information. We propose research literacy as a concept that incorporates understanding about the purpose and nature of research. We developed the Research and Knowledge Scale (RaKS) to measure research literacy in a culturally, literacy-sensitive manner. We describe its development and psychometric properties. Qualitative methods were used to assess perspectives of research participants and researchers. Literature and informed consent reviews were conducted to develop initial items. These data were used to develop initial domains and items of the RaKS, and expert panel reviews and cognitive pretesting were done to refine the scale. We conducted psychometric analyses to evaluate the scale. The cross-sectional survey was administered to a purposive community-based sample (n=430) using a Web-based data collection system and paper. We did classic theory testing on individual items and assessed test-retest reliability and Kuder-Richardson-20 for internal consistency. We conducted exploratory factor analysis and analysis of variance to assess differences in mean research literacy scores in sociodemographic subgroups. The RaKS is comprised of 16 items, with a Kuder-Richardson-20 estimate of 0.81 and test-retest reliability 0.84. There were differences in mean scale scores by race/ethnicity, age, education, income, and health literacy (all P<0.01). This study provides preliminary evidence for the reliability and validity of the RaKS. This scale can be used to measure research participants' understanding about health-related research processes and identify areas to improve informed decision-making about research participation.

Measuring the Process and Quality of Informed Consent for Clinical Research: Development and Testing

PubMed Central

Cohn, Elizabeth Gross; Jia, Haomiao; Smith, Winifred Chapman; Erwin, Katherine; Larson, Elaine L.

2013-01-01

Purpose/Objectives To develop and assess the reliability and validity of an observational instrument, the Process and Quality of Informed Consent (P-QIC). Design A pilot study of the psychometrics of a tool designed to measure the quality and process of the informed consent encounter in clinical research. The study used professionally filmed, simulated consent encounters designed to vary in process and quality. Setting A major urban teaching hospital in the northeastern region of the United States. Sample 63 students enrolled in health-related programs participated in psychometric testing, 16 students participated in test-retest reliability, and 5 investigator-participant dyads were observed for the actual consent encounters. Methods For reliability and validity testing, students watched and rated videotaped simulations of four consent encounters intentionally varied in process and content and rated them with the proposed instrument. Test-retest reliability was established by raters watching the videotaped simulations twice. Inter-rater reliability was demonstrated by two simultaneous but independent raters observing an actual consent encounter. Main Research Variables The essential elements of information and communication for informed consent. Findings The initial testing of the P-QIC demonstrated reliable and valid psychometric properties in both the simulated standardized consent encounters and actual consent encounters in the hospital setting. Conclusions The P-QIC is an easy-to-use observational tool that provides a quick assessment of the areas of strength and areas that need improvement in a consent encounter. It can be used in the initial trainings of new investigators or consent administrators and in ongoing programs of improvement for informed consent. Implications for Nursing The development of a validated observational instrument will allow investigators to assess the consent process more accurately and evaluate strategies designed to improve it. PMID:21708532

The Role of Psychometrics in Individual Differences Research in Cognition: A Case Study of the AX-CPT

PubMed Central

Cooper, Shelly R.; Gonthier, Corentin; Barch, Deanna M.; Braver, Todd S.

2017-01-01

Investigating individual differences in cognition requires addressing questions not often thought about in standard experimental designs, especially regarding the psychometric properties of the task. Using the AX-CPT cognitive control task as a case study example, we address four concerns that one may encounter when researching the topic of individual differences in cognition. First, we demonstrate the importance of variability in task scores, which in turn directly impacts reliability, particularly when comparing correlations in different populations. Second, we demonstrate the importance of variability and reliability for evaluating potential failures to replicate predicted correlations, even within the same population. Third, we demonstrate how researchers can turn to evaluating psychometric properties as a way of evaluating the feasibility of utilizing the task in new settings (e.g., online administration). Lastly, we show how the examination of psychometric properties can help researchers make informed decisions when designing a study, such as determining the appropriate number of trials for a task. PMID:28928690

Psychometric Evaluation of Two Appetite Questionnaires in Patients With Heart Failure.

PubMed

Andreae, Christina; Strömberg, Anna; Sawatzky, Richard; Årestedt, Kristofer

2015-12-01

Decreased appetite in heart failure (HF) may lead to undernutrition which could negatively influence prognosis. Appetite is a complex clinical issue that is often best measured with the use of self-report instruments. However, there is a lack of self-rated appetite instruments. The Council on Nutrition Appetite Questionnaire (CNAQ) and the Simplified Nutritional Appetite Questionnaire (SNAQ) are validated instruments developed primarily for elderly people. Yet, the psychometric properties have not been evaluated in HF populations. The aim of the present study was to evaluate the psychometric properties of CNAQ and SNAQ in patients with HF. A total of 186 outpatients with reduced ejection fraction and New York Heart Association (NYHA) functional classifications II-IV were included (median age 72 y; 70% men). Data were collected with the use of a questionnaire that included the CNAQ and SNAQ. The psychometric evaluation included data quality, factor structure, construct validity, known-group validity, and internal consistency. Unidimensionality was supported by means of parallel analysis and confirmatory factor analyses (CFAs). The CFA results indicated sufficient model fit. Both construct validity and known-group validity were supported. Internal consistency reliability was acceptable, with ordinal coefficient alpha estimates of 0.82 for CNAQ and 0.77 for SNAQ. CNAQ and SNAQ demonstrated sound psychometric properties and can be used to measure appetite in patients with HF. Copyright © 2015 Elsevier Inc. All rights reserved.

Psychometric properties of the Spanish Burnout Inventory among staff nurses.

PubMed

Gil-Monte, P R; Manzano-García, G

2015-12-01

The burnout syndrome contributes to the deterioration in the quality of personal life as well as lower quality practice in healthcare personnel. Researchers have been concerned about the psychometric limitations of some previous questionnaires designed to evaluate burnout. The Spanish Burnout Inventory was developed to address the problems associated with other instruments, but it has not yet been validated in staff nurses. This study provides evidence that the Spanish Burnout Inventory has adequate psychometric properties to estimate burnout in staff nurses. The Spanish Burnout Inventory offers a theoretical proposal to explain the different components of burnout. The Spanish Burnout Inventory provides researchers and practitioners with an expanded conceptualization of the burnout syndrome, which can facilitate the diagnosis and treatment of nursing professionals. Researchers have been concerned about the psychometric limitations of the some previous questionnaires designed to evaluate burnout. To address these problems associated with previous instruments, the Spanish Burnout Inventory (SBI) was developed. The instrument has not yet been validated in staff nurses. The purpose of this paper was to evaluate the psychometric properties of the SBI. The sample consisted of 720 staff nurses from two Spanish general hospitals. The instrument is composed of 20 items distributed in four dimensions: Enthusiasm towards the job (five items), Psychological exhaustion (four items), Indolence (six items) and Guilt (five items). Data were subjected to confirmatory factor analysis. To assess the factorial validity of the SBI, four alternative models were tested. Results show that the four-factor model of the SBI has adequate psychometric properties for the study of burnout in staff nurses. This model fitted the data better than the alternative models. The study provides evidence of the adequate psychometric properties of a measure to evaluate burnout in nursing professionals. The SBI proposes a theoretical explanation for the different types of burnout, facilitating the diagnosis and treatment of staff nurses. © 2015 John Wiley & Sons Ltd.

Psychometric Properties of Language Assessments for Children Aged 4–12 Years: A Systematic Review

PubMed Central

Denman, Deborah; Speyer, Renée; Munro, Natalie; Pearce, Wendy M.; Chen, Yu-Wei; Cordier, Reinie

2017-01-01

Introduction: Standardized assessments are widely used by speech pathologists in clinical and research settings to evaluate the language abilities of school-aged children and inform decisions about diagnosis, eligibility for services and intervention. Given the significance of these decisions, it is important that assessments have sound psychometric properties. Objective: The aim of this systematic review was to examine the psychometric quality of currently available comprehensive language assessments for school-aged children and identify assessments with the best evidence for use. Methods: Using the PRISMA framework as a guideline, a search of five databases and a review of websites and textbooks was undertaken to identify language assessments and published material on the reliability and validity of these assessments. The methodological quality of selected studies was evaluated using the COSMIN taxonomy and checklist. Results: Fifteen assessments were evaluated. For most assessments evidence of hypothesis testing (convergent and discriminant validity) was identified; with a smaller number of assessments having some evidence of reliability and content validity. No assessments presented with evidence of structural validity, internal consistency or error measurement. Overall, all assessments were identified as having limitations with regards to evidence of psychometric quality. Conclusions: Further research is required to provide good evidence of psychometric quality for currently available language assessments. Of the assessments evaluated, the Assessment of Literacy and Language, the Clinical Evaluation of Language Fundamentals-5th Edition, the Clinical Evaluation of Language Fundamentals-Preschool: 2nd Edition and the Preschool Language Scales-5th Edition presented with most evidence and are thus recommended for use. PMID:28936189

Psychometric Evaluation of an Adolescent and Young Adult Module of the Impact of Cancer Instrument.

PubMed

Husson, Olga; Zebrack, Bradley J

2017-03-01

To develop and evaluate a new instrument that measures unique aspects of long-term survivorship for people diagnosed with cancer as Adolescent and Young Adult (AYA), not measured by existing tools. A new candidate instrument-the Impact of Cancer for Adolescent and Young Adult (IOC-AYA) cancer survivors-was developed and administered to AYA cancer survivors aged 18-35 years who were 15-29 years old when diagnosed with cancer. Psychometric properties of newly derived scales were assessed. Factor analyses of items derived seven new and specific subscales: Social Life; Uncertainties, Worries and Wonders; Cognitive Function; Sense of Purpose/Life Goals; Identity; Health Behaviors; and Health Literacy. Two separate and conditional subscales were formed: Relationship Concerns (partnered/unpartnered) and Having Children (at least one child/no children). Internal consistency measurements for these subscales ranged from 0.70 to 0.90. Expected associations within and among IOC-AYA subscales and standardized measures of quality of life were observed. Psychometric analyses indicated that this initial version of the IOC-AYA measures distinct and relevant constructs for survivors diagnosed with cancer in adolescence and young adulthood. Future work is needed to confirm the responsiveness to change and further validate the instrument in multiple and representative samples. Use of the IOC-AYA instrument in research and clinical practice will inform the development of psychosocial and supportive care interventions that not only minimize or prevent long-term deleterious effects of cancer but also promote positive adaptation, resilience, and the achievement of age-specific developmental tasks.

First evidence on the validity and reliability of the Safety Organizing Scale-Nursing Home version (SOS-NH).

PubMed

Ausserhofer, Dietmar; Anderson, Ruth A; Colón-Emeric, Cathleen; Schwendimann, René

2013-08-01

The Safety Organizing Scale is a valid and reliable measure on safety behaviors and practices in hospitals. This study aimed to explore the psychometric properties of the Safety Organizing Scale-Nursing Home version (SOS-NH). In a cross-sectional analysis of staff survey data, we examined validity and reliability of the 9-item Safety SOS-NH using American Educational Research Association guidelines. This substudy of a larger trial used baseline survey data collected from staff members (n = 627) in a variety of work roles in 13 nursing homes (NHs) in North Carolina and Virginia. Psychometric evaluation of the SOS-NH revealed good response patterns with low average of missing values across all items (3.05%). Analyses of the SOS-NH's internal structure (eg, comparative fit indices = 0.929, standardized root mean square error of approximation = 0.045) and consistency (composite reliability = 0.94) suggested its 1-dimensionality. Significant between-facility variability, intraclass correlations, within-group agreement, and design effect confirmed appropriateness of the SOS-NH for measurement at the NH level, justifying data aggregation. The SOS-NH showed discriminate validity from one related concept: communication openness. Initial evidence regarding validity and reliability of the SOS-NH supports its utility in measuring safety behaviors and practices among a wide range of NH staff members, including those with low literacy. Further psychometric evaluation should focus on testing concurrent and criterion validity, using resident outcome measures (eg, patient fall rates). Copyright © 2013 American Medical Directors Association, Inc. All rights reserved.

Psychometric properties of carer-reported outcome measures in palliative care: A systematic review

PubMed Central

Michels, Charlotte TJ; Boulton, Mary; Adams, Astrid; Wee, Bee; Peters, Michele

2016-01-01

Background: Informal carers face many challenges in caring for patients with palliative care needs. Selecting suitable valid and reliable outcome measures to determine the impact of caring and carers’ outcomes is a common problem. Aim: To identify outcome measures used for informal carers looking after patients with palliative care needs, and to evaluate the measures’ psychometric properties. Design: A systematic review was conducted. The studies identified were evaluated by independent reviewers (C.T.J.M., M.B., M.P.). Data regarding study characteristics and psychometric properties of the measures were extracted and evaluated. Good psychometric properties indicate a high-quality measure. Data sources: The search was conducted, unrestricted to publication year, in the following electronic databases: Applied Social Sciences Index and Abstracts, Cumulative Index to Nursing and Allied Health Literature, The Cochrane Library, EMBASE, PubMed, PsycINFO, Social Sciences Citation Index and Sociological Abstracts. Results: Our systematic search revealed 4505 potential relevant studies, of which 112 studies met the inclusion criteria using 38 carer measures for informal carers of patients with palliative care needs. Psychometric properties were reported in only 46% (n = 52) of the studies, in relation to 24 measures. Where psychometric data were reported, the focus was mainly on internal consistency (n = 45, 87%), construct validity (n = 27, 52%) and/or reliability (n = 14, 27%). Of these, 24 measures, only four (17%) had been formally validated in informal carers in palliative care. Conclusion: A broad range of outcome measures have been used for informal carers of patients with palliative care needs. Little formal psychometric testing has been undertaken. Furthermore, development and refinement of measures in this field is required. PMID:26407683

Development and psychometric evaluation of the Core Nurse Resource Scale.

PubMed

Simpson, Michelle R

2010-11-01

To examine the factor structure, internal consistency reliability and concurrent-related validity of the Core Nurse Resource Scale. A cross-sectional survey study design was used to obtain a sample of 149 nurses and nursing staff [Registered Nurse (RNs), Licensed Practical Nurse (LPNs) and Certified Nursing Assistant (CNAs)] working in long-term care facilities. Exploratory factor analysis, Cronbach's alpha and bivariate correlations were used to evaluate validity and reliability. Exploratory factor analysis yielded a scale with 18 items on three factors, accounting for 52% of the variance in scores. Internal consistency reliability for the composite and Core Nurse Resource Scale factors ranged from 0.79 to 0.91. The Core Nurse Resource Scale composite scale and subscales correlated positively with a measure of work engagement (r=0.247-0.572). The initial psychometric evaluation of the Core Nurse Resource Scale demonstrates it is a sound measure. Further validity and reliability assessment will need to be explored and assessed among nurses and other nursing staff working in other practice settings. The intent of the Core Nurse Resource Scale is to evaluate the presence of physical, psychological and social resources of the nursing work environment, to identify workplaces at risk for disengaged (low work engagement) nursing staff and to provide useful diagnostic information to healthcare administrators interested in interventions to improve the nursing work environment. © 2010 The Author. Journal compilation © 2010 Blackwell Publishing Ltd.

The Structured Trauma-Related Experiences and Symptoms Screener (STRESS): Development and Preliminary Psychometrics.

PubMed

Grasso, Damion J; Felton, Julia W; Reid-Quiñones, Kathryn

2015-08-01

The Structured Trauma-Related Experiences and Symptoms Screener (STRESS) is a self-report instrument for youth of age 7-18 that inventories 25 adverse childhood experiences and potentially traumatic events and assesses symptoms of post-traumatic stress disorder using the revised criteria published in the Diagnostic and Statistical Manual for Mental Disorders, fifth edition (DSM-5). The STRESS can be administered by computer such that questions are read aloud and automatic scoring and feedback are provided. Data were collected on a sample of 229 children and adolescents of age 7-17 undergoing a forensic child abuse and neglect evaluation. The purpose of the current study was to examine preliminary psychometric characteristics of the computer-administered STRESS as well as its underlying factor structure in relation to the four-factor DSM-5 model. Results provide initial support for the use of the STRESS in assessing adverse and potentially traumatic experiences and traumatic stress in children and adolescents. © The Author(s) 2015.

An Evaluation of the Psychometric Properties of an Advising Survey for Medical and Professional Program Students

ERIC Educational Resources Information Center

Royal, Kenneth D.; Gonzalez, Liara M.

2016-01-01

The purpose of this study was to evaluate the psychometric properties of a newly developed instrument intended to measure faculty competence as it pertains to their role as advisors, particularly in medical and professional programs. A total of 166 students completed the Faculty Advisor's Skills and Behaviors Inventory (FASBI). The psychometric…

A Critical Examination of the Technical Adequacy of a Curriculum-Based Assessment Using Rasch Analyses

ERIC Educational Resources Information Center

Winchell, Brooke

2011-01-01

The purpose of the study was to (a) examine the psychometric properties of The Assessment, Evaluation, and Programming System for Infants and Children (AEPS Test); (b) provide a process for establishing psychometric properties for other Curriculum Based Assessments (CBAs); and (c) identify and guide evaluation and subsequent revisions of the AEPS…

Psychometric Analysis of the Diagnostic Evaluation of Language Variation-Screening Test: Extension to Low-Income African American Pre-Kindergarteners

ERIC Educational Resources Information Center

Terry, Nicole P.; Petscher, Yaacov; Rhodes, Katherine T.

2017-01-01

The purpose of this study was to extend a previous investigation of the psychometrics of the "Diagnostic Evaluation of Language Variation-Screening Test" (DELV-S) to include pre-kindergarten children (primarily African American and from low-income households). The previous study (Petscher, Connor, & Al Otaiba, 2012) included a…

A Psychometric Evaluation of the Colorado Learning Attitudes about Science Survey for Use in Chemistry

ERIC Educational Resources Information Center

Heredia, Keily; Lewis, Jennifer E.

2012-01-01

The purpose of this paper is to evaluate the psychometric properties of The Colorado Learning Attitudes about Science Survey (CLASS). The 50-item instrument was administered to 311 college students from a public institution in the United States enrolled in General Chemistry I Laboratory. Confirmatory factor analysis and Cronbach's [alpha]…

An evaluation of psychometric properties of caregiver burden outcome measures used in caregivers of children with cerebral palsy: a systematic review protocol.

PubMed

Dambi, Jermaine M; Jelsma, Jennifer; Mlambo, Tecla; Chiwaridzo, Matthew; Dangarembizi-Munambah, Nyaradzai; Corten, Lieselotte

2016-03-09

Cerebral palsy (CP) is the most common, life-long paediatric disability. Taking care of a child with CP often results in caregiver burden/strain in the long run. As caregivers play an essential role in the rehabilitation of these children, it is therefore important to routinely screen for health outcomes in informal caregivers. Consequently, a plethora of caregiver burden outcome measures have been developed; however, there is a dearth of evidence of the most psychometrically sound tools. Therefore, the broad objective of this systematic review is to evaluate the psychometrical properties and clinical utility of tools used to measure caregiver burden in caregivers of children with CP. This is a systematic review for the evaluation of the psychometric properties of caregiver burden outcome tools. Two independent and blinded reviewers will search articles on PubMed, Scopus, Web of Science, CINAHL, PsychINFO and Africa-Wide Google Scholar. Information will be analysed using predefined criteria. Thereafter, three independent reviewers will then screen the retrieved articles. The methodological quality of studies on the development and validation of the identified tools will be evaluated using the four point COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Finally, the psychometric properties of the tools which were developed and validated from methodological sound studies will then be analysed using predefined criteria. The proposed systematic review will give an extensive review of the psychometrical properties of tools used to measure caregiver burden in caregivers of children with CP. We hope to identify tools that can be used to accurately screen for caregiver burden both in clinical setting and for research purposes. PROSPERO CRD42015028026.

Systematic review of the psychometric properties and theoretical grounding of instruments evaluating self-care in people with type 2 diabetes mellitus.

PubMed

Caro-Bautista, Jorge; Martín-Santos, Francisco Javier; Morales-Asencio, Jose Miguel

2014-06-01

To determine the psychometric properties and theoretical grounding of instruments that evaluate self-care behaviour or barriers in people with type 2 diabetes. There are many instruments designed to evaluate self-care behaviour or barriers in this population, but knowledge about their psychometric validation processes is lacking. Systematic review. We conducted a search for psychometric or validation studies published between January 1990-December 2012. We carried out searches in Pubmed, CINAHL, PsycINFO, ProQuolid, BibliPRO and Google SCHOLAR to identify instruments that evaluated self-care behaviours or barriers to diabetes self-care. We conducted a systematic review with the following inclusion criteria: Psychometric or clinimetric validation studies that included patients with type 2 diabetes (exclusively or partially) and which analysed self-care behaviour or barriers to self-care and proxies like self-efficacy or empowerment, from a multidimensional approach. Language: Spanish or English. Two authors independently assessed the quality of the studies and extracted data using Terwee's proposed criteria: psychometrics properties, dimensionality, theoretical ground and population used for validation through each included instrument. Sixteen instruments achieved the inclusion criteria for the review. We detected important methodological flaws in many of the selected instruments. Only the Self-management Profile for Type 2 Diabetes and Problem Areas in Diabetes Scale met half of Terwee's quality criteria. There are no instruments for identifying self-care behaviours or barriers elaborated with a strong validation process. Further research should be carried out to provide patients, clinicians and researchers with valid and reliable instruments that are methodologically solid and theoretically grounded. © 2013 John Wiley & Sons Ltd.

Initial development of a treatment adherence measure for cognitive-behavioral therapy for child anxiety.

PubMed

Southam-Gerow, Michael A; McLeod, Bryce D; Arnold, Cassidy C; Rodríguez, Adriana; Cox, Julia R; Reise, Steven P; Bonifay, Wesley E; Weisz, John R; Kendall, Philip C

2016-01-01

The measurement of treatment adherence (a component of treatment integrity defined as the extent to which a treatment is delivered as intended) is a critical element in treatment evaluation research. This article presents initial psychometric data for scores on the Cognitive-Behavioral Therapy Adherence Scale for Youth Anxiety (CBAY-A), an observational measure designed to be sensitive to common practice elements found in individual cognitive-behavioral therapy (ICBT) for youth anxiety. Therapy sessions (N = 954) from 1 efficacy and 1 effectiveness study of ICBT for youth anxiety were independently rated by 2 coders. Interrater reliability (as gauged by intraclass correlation coefficients) for the item scores averaged 0.77 (SD = 0.15; range .48 to .80). The CBAY-A item and scale (skills, model, total) scores demonstrated evidence of convergent and discriminant validity with an observational measure of therapeutic interventions and an observational measure of the alliance. The CBAY-A item and scale scores also discriminated between therapists delivering ICBT in research and practice settings and therapists delivering nonmanualized usual clinical care. We discuss the importance of replicating these psychometric findings in different samples and highlight possible application of an adherence measure in testing integrity-outcome relations. (c) 2016 APA, all rights reserved).

Psychometric properties of the multidimensional fatigue inventory in Brazilian Hodgkin's lymphoma survivors.

PubMed

Baptista, Renata Lyrio R; Biasoli, Irene; Scheliga, Adriana; Soares, Andrea; Brabo, Eloa; Morais, José Carlos; Werneck, Guilherme Loureiro; Spector, Nelson

2012-12-01

Fatigue is the most common symptom among Hodgkin's lymphoma survivors. To evaluate the psychometric properties of the Brazilian version of the Multidimensional Fatigue Inventory (MFI). The MFI was translated into Brazilian Portuguese using established forward-backward translation procedures, and the psychometric properties were evaluated in a sample of 200 Hodgkin's lymphoma survivors. The psychometric properties evaluated included internal consistency and construct validity. The MFI was administered along with the informed consent form. The overall Cronbach's alpha coefficient for the 20 items was 0.84, ranging from 0.59 to 0.81 for each of the five scales. Correlations between items and scales ranged from 0.32 to 0.72. The factor analysis yielded a five-factor solution that explained 65% of the variance. The first factor merged the original "general fatigue" and "physical fatigue" scales, as has been previously reported. The second factor identified the original "mental fatigue" scale and the fifth factor identified the original "reduced activity" scale. Questions from the original "reduced motivation" scale were represented in both factors three and four. The Brazilian version of the MFI showed satisfactory psychometric properties and can be considered a valid research tool for assessing cancer-related fatigue. Copyright © 2012 U.S. Cancer Pain Relief Committee. Published by Elsevier Inc. All rights reserved.

Validation of a pregnancy planning measure for Arabic-speaking women.

PubMed

Almaghaslah, Eman; Rochat, Roger; Farhat, Ghada

2017-01-01

The prevalence of unplanned pregnancy in Saudi Arabia has not been thoroughly investigated. To conduct a psychometric evaluation study of the Arabic version of the London Measure of Unplanned Pregnancy (LMUP). To evaluate the psychometric properties of the LMUP, we conducted a self-administered online survey among 796 ever-married Saudi women aged 20-49 years, and a re-test survey among 24 women. The psychometric properties evaluated included content validity measured by content validity index (CVI), structural validity assessed by exploratory factor analysis (EFA), substantive validity assessed by hypothesis testing, contextual stability for the test-retest assessed by weighted Kappa, and internal consistency assessed by Cronbach's alpha. The psychometric analysis of the Arabic version of LMUP exhibited valid and reliable properties. The CVIs for individual items and at the scale level were >0.7. EFA confirmed a unidimensional extraction of the scale item. Hypothesis testing confirmed expected associations. The tool was stable with weighted kappa = 0.78 and Cronbach's alpha = 0.88. In this study, the validity and reliability of the Arabic version of the LMUP were confirmed according to well-known psychometric criteria. This LMUP version can be used in research studies among Arabic-speaking women to measure unplanned pregnancy and investigate correlates and outcomes related to unplanned pregnancy.

A Psychometric Approach to Theory-Based Behavior Change Intervention Development: Example From the Colorado Meaning-Activity Project.

PubMed

Masters, Kevin S; Ross, Kaile M; Hooker, Stephanie A; Wooldridge, Jennalee L

2018-05-18

There has been a notable disconnect between theories of behavior change and behavior change interventions. Because few interventions are both explicitly and adequately theory-based, investigators cannot assess the impact of theory on intervention effectiveness. Theory-based interventions, designed to deliberately engage the theory's proposed mechanisms of change, are needed to adequately test theories. Thus, systematic approaches to theory-based intervention development are needed. This article will introduce and discuss the psychometric method of developing theory-based interventions. The psychometric approach to intervention development utilizes basic psychometric principles at each step of the intervention development process in order to build a theoretically driven intervention to, subsequently, be tested in process (mechanism) and outcome studies. Five stages of intervention development are presented as follows: (i) Choice of theory; (ii) Identification and characterization of key concepts and expected relations; (iii) Intervention construction; (iv) Initial testing and revision; and (v) Empirical testing of the intervention. Examples of this approach from the Colorado Meaning-Activity Project (COMAP) are presented. Based on self-determination theory integrated with meaning or purpose, and utilizing a motivational interviewing approach, the COMAP intervention is individually based with an initial interview followed by smart phone-delivered interventions for increasing daily activity. The psychometric approach to intervention development is one method to ensure careful consideration of theory in all steps of intervention development. This structured approach supports developing a research culture that endorses deliberate and systematic operationalization of theory into behavior change intervention from the outset of intervention development.

Health behavior in persons with spinal cord injury: development and initial validation of an outcome measure.

PubMed

Pruitt, S D; Wahlgren, D R; Epping-Jordan, J E; Rossi, A L

1998-10-01

To describe the development and initial psychometric properties of a new outcome measure for health behaviors that delay or prevent secondary impairments associated with spinal cord injury (SCI). Persons with SCI were surveyed during routine annual physical evaluations. Veterans Affairs Medical Center Spinal Cord Injury Unit, which specializes in primary care for persons with SCI. Forty-nine persons with SCI, aged 19-73 years, 1-50 years post-SCI. The newly developed Spinal Cord Injury Lifestyle Scale (SCILS). Internal consistency is high (alpha = 0.81). Correlations between clinicians' ratings of participants' health behavior and the new SCILS provide preliminary support for construct validity. The SCILS is a brief, self-report measure of health-related behavior in persons with SCI. It is a promising new outcome measure to evaluate the effectiveness of clinical and educational efforts for health maintenance and prevention of secondary impairments associated with SCI.

Psychometric evaluation of the Revised Professional Practice Environment (RPPE) scale.

PubMed

Erickson, Jeanette Ives; Duffy, Mary E; Ditomassi, Marianne; Jones, Dorothy

2009-05-01

The purpose was to examine the psychometric properties of the Revised Professional Practice Environment (RPPE) scale. Despite renewed focus on studying health professionals' practice environments, there are still few reliable and valid instruments available to assist nurse administrators in decision making. A psychometric evaluation using a random-sample cross-validation procedure (calibration sample [CS], n = 775; validation sample [VS], n = 775) was undertaken. Cronbach alpha internal consistency reliability of the total score (r = 0.93 [CS] and 0.92 [VS]), resulting subscale scores (r range: 0.80-0.87 [CS], 0.81-0.88 [VS]), and principal components analyses with Varimax rotation and Kaiser normalization (8 components, 59.2% variance [CS], 59.7% [VS]) produced almost identical results in both samples. The multidimensional RPPE is a psychometrically sound measure of 8 components of the professional practice environment in the acute care setting and sufficiently reliable and valid for use as independent subscales in healthcare research.

An evaluation of the HM prison service "thinking skills programme" using psychometric assessments.

PubMed

Gobbett, Matthew J; Sellen, Joselyn L

2014-04-01

The most widely implemented offending behaviour programme in the United Kingdom was Enhanced Thinking Skills (ETS), a cognitive-behavioural group intervention that aimed to develop participant's general cognitive skills. A new offending behaviour programme has been developed to replace ETS: the Thinking Skills Programme (TSP). This study reports an evaluation of the effectiveness of TSP using psychometric assessments. Phasing of the two programmes created an opportunity to compare the two programmes consecutively. Forty participants, 20 from each programme, completed a range of psychometric measures to examine cognition, attitudes, and thinking styles. Analysis of pre- and post-programme psychometric results indicated that participants of TSP demonstrated improvements on 14 of the 15 scales, 9 of which were statistically significant. Effect sizes between pre-post results were generally greater for TSP than ETS, demonstrating that TSP had a more positive impact on the thinking styles and attitudes of participants than the ETS programme.

A Psychometric Evaluation of the Behavioral Inhibition Questionnaire in a Non-Clinical Sample of Dutch Children and Adolescents

ERIC Educational Resources Information Center

Broeren, Suzanne; Muris, Peter

2010-01-01

The Behavioral Inhibition Questionnaire (BIQ) is a parent-rating scale for measuring temperamental characteristics referring to shyness, fearfulness, and withdrawal in young, preschool children. The present study evaluated the psychometric properties of the BIQ in a Dutch community sample of children with a broad age range. For this purpose, the…

Support for Alzheimer's Caregivers: Psychometric Evaluation of Familial and Friend Support Measures

ERIC Educational Resources Information Center

Wilks, Scott E.

2009-01-01

Objective: Information on the shortened, 20-item version of the Perceived Social Support Scale (S-PSSS) is scarce. The purpose of this study is to evaluate the psychometric properties of the S-PSSS Family (SSfa) and Friends (SSfr) subscales. Method: Because of their common coping method of social support, a cross-sectional sample of Alzheimer's…

Lost in Translation? Psychometric Properties and Construct Validity of the English Essen Climate Evaluation Schema (EssenCES) Social Climate Questionnaire

ERIC Educational Resources Information Center

Tonkin, Matthew; Howells, Kevin; Ferguson, Eamonn; Clark, Amanda; Newberry, Michelle; Schalast, Norbert

2012-01-01

The social climate of correctional (forensic) settings is likely to have a significant impact on the outcome of treatment and the overall functioning of these units. The Essen Climate Evaluation Schema (EssenCES) provides an objective way of measuring social climate that overcomes the content, length, and psychometric limitations of other…

The Career Transition Inventory: A Psychometric Evaluation of a French Version (CTI-F)

ERIC Educational Resources Information Center

Fernandez, Anne; Fouquereau, Evelyne; Heppner, Mary J.

2008-01-01

The Career Transition Inventory (CTI) is a well-known measure for assessing perceptions of psychological resources when adults undergo a career change. The purpose of this study was to conduct a psychometric evaluation of a French version of the CTI (CTI-F). A total of 1,042 French volunteer participants completed the CTI-F. The procedure used…

Psychometric Evaluation of the Serbian Version of the Multidimensional Students' Life Satisfaction Scale

ERIC Educational Resources Information Center

Jovanovic, Veljko; Zuljevic, Dragan

2013-01-01

The main purpose of this study was to evaluate psychometric properties of the Serbian version of the Multidimensional Students' Life Satisfaction Scale (MSLSS). The research was carried out on a sample of 408 high school students (250 females, 158 males), with the mean age 16.6. The Serbian version of the MSLSS has demonstrated good psychometric…

Psychometric Evaluation of the Connor-Davidson Resilience Scale (CD-RISC) Using Iranian Students

ERIC Educational Resources Information Center

Khoshouei, Mahdieh Sadat

2009-01-01

The purpose of this study was to evaluate the psychometric properties of the Persian version of the Connor-Davidson Resilience Scale (CD-RISC). The CD-RISC was completed by a sample of 323 Isfahan university students (168 females, 155 males) aged 19-34 years. A maximum likelihood method with an oblique solution resulted in four factors…

Psychometric Evaluation of a Chinese Version of the eHealth Literacy Scale (eHEALS) in School Age Children

ERIC Educational Resources Information Center

Koo, Malcolm; Norman, Cameron D.; Chang, Hsiao-Mei

2012-01-01

The eight-item eHealth Literacy Scale (eHEALS) is a previously validated scale developed to assess consumers' combined knowledge, comfort, and perceived skills at finding, evaluating, and applying electronic health information to health problems. In the present study, a Chinese version of the eHEALS was developed and its psychometric properties…

An Evaluation of the Psychometric Properties of Three Different Forms of Daly and Miller's Writing Apprehension Test through Rasch Analysis

ERIC Educational Resources Information Center

Güler, Nese; Ilhan, Mustafa; Güneyli, Ahmet; Demir, Süleyman

2017-01-01

This study evaluates the psychometric properties of three different forms of the Writing Apprehension Test (WAT; Daly & Miller, 1975) through Rasch analysis. For this purpose, the fit statistics and correlation coefficients, and the reliability, separation ratio, and chi-square values for the facets of item and person calculated for the…

A preliminary psychometric evaluation of the eight-item cognitive load scale.

PubMed

Pignatiello, Grant A; Tsivitse, Emily; Hickman, Ronald L

2018-04-01

The aim of this article is to report the psychometric properties of the eight-item cognitive load scale. According to cognitive load theory, the formatting and delivery of healthcare education influences the degree to which patients and/or family members can engage their working memory systems for learning. However, despite its relevance, cognitive load has not yet been evaluated among surrogate decision makers exposed to electronic decision support for healthcare decisions. To date, no psychometric analyses of instruments evaluating cognitive load have been reported within healthcare settings. A convenience sample of 62 surrogate decision makers for critically ill patients were exposed to one of two healthcare decision support interventions were recruited from four intensive care units at a tertiary medical center in Northeast Ohio. Participants were administered a battery of psychosocial instruments and the eight-item cognitive load scale (CLS). The CLS demonstrated a bidimensional factor structure with acceptable discriminant validity and internal consistency reliability (Cronbach's α = 0.75 and 0.89). The CLS is a psychometrically sound instrument that may be used in the evaluation of decision support among surrogate decision makers of the critically ill. The authors recommend application of the cognitive load scale in the evaluation and development of healthcare education and interventions. Copyright © 2018 Elsevier Inc. All rights reserved.

Translation, adaptation and validation of the Coronary Revascularization Outcome Questionnaire into Greek.

PubMed

Takousi, Maria G; Schmeer, Stefanie; Manaras, Irene; Olympios, Christoforos D; Fakiolas, Constantine N; Makos, Georgios; Troop, Nick A

2016-04-01

Evaluating the impact of coronary revascularization on patients' health related quality of life with a patient-based and disease-specific tool is important for drawing conclusions about treatment and outcomes. This study reports on the translation, adaptation and psychometric evaluation of a Greek version of the Coronary Revascularization Outcome Questionnaire (CROQ-Gr). A total of 609 (81.7% male) patients who had undergone coronary revascularization (percutaneous coronary intervention or coronary artery bypass grafting) were recruited from four hospitals in Athens. After translating the CROQ into Greek, a preliminary qualitative study and a pilot quantitative study were conducted. A full psychometric evaluation was carried out on the main study's data. The psychometric evaluation demonstrated that the CROQ-Gr is acceptable to patients (high response rate, low missing data) and has a good level of reliability (internal consistency >0.70, test-retest reliability >0.90) and validity (both content and construct validity). The results of this study show the CROQ-Gr to be a psychometrically rigorous patient-based measure of outcomes of coronary revascularization. It would be appropriate for use in evaluative research as well as a routine clinical tool to aid cardiologists in monitoring the outcomes of care. © The European Society of Cardiology 2015.

Critical appraisal of questionnaires to assess functional impairment in individuals with mild cognitive impairment.

PubMed

Kaur, Navaldeep; Belchior, Patricia; Gelinas, Isabelle; Bier, Nathalie

2016-09-01

Mild deficits in instrumental activities of daily living (IADLs) have consistently been reported in the individuals with mild cognitive impairment (MCI). A variety of functional assessment tools, including self-and informant report questionnaires and performance-based measures, have been employed in MCI. Previously, a limited focus has been directed at appraising the quality of questionnaires. The goal of this study was to identify the questionnaires that have been validated in the MCI population. Additionally, the quality of validation studies and psychometric attributes of these questionnaires were appraised. Relevant articles were systematically searched in PsychINFO, Ovid MEDLINE, and CINAHL against specific eligibility criteria. To evaluate the methodology of the psychometric studies, the COSMIN checklist was employed. Also, the psychometric properties of the assessment tools were evaluated based upon Terwee's criteria. A total of five psychometric studies and questionnaires were critically evaluated. Varying psychometric properties were available for the chosen tools. None of the studies received the best possible rating for their methodological quality. It was found that questionnaires with high discriminative ability to distinguish MCI from other diagnostic groups were: Disability Assessment in Dementia-6 (DAD-6), Functional Activity Questionnaire (FAQ), and Alzheimer's Disease Cooperative Study/Activities of Daily Living scale adapted for MCI patients (ADCS-MCI-ADL-24). Psychometric studies with strong methodological rigor are required in the future. Considering the fact that IADL decline has been associated with dementia, early detection of functional difficulties in MCI needs to be encouraged as it will allow suitable and timely interventions to prolong functional independence of affected individuals.

An initial psychometric evaluation of the German PROMIS v1.2 Physical Function item bank in patients with a wide range of health conditions.

PubMed

Liegl, Gregor; Rose, Matthias; Correia, Helena; Fischer, H Felix; Kanlidere, Sibel; Mierke, Annett; Obbarius, Alexander; Nolte, Sandra

2018-01-01

To translate the PROMIS Physical Function (PF) item bank version 1.2 into German and to investigate psychometric properties of resulting full bank and seven derived short forms. Cross-sectional psychometric study. Inpatient and outpatient clinics of the Department of Psychosomatic Medicine at Charité-Universitätsmedizin Berlin, Germany. A total of 10 adult patients with various chronic diseases participated in cognitive debriefing interviews. The final item bank was administered to n = 266 adult patients with a broad range of medical conditions. Patient-reported outcome assessment as part of routine care. PROMIS v1.2 PF bank; MOS SF-36 PF scale (PF-10). Cross-cultural adaptation of the item bank followed established guidelines. For the final German translation, the corrected item-total correlations ranged from 0.44 to 0.84. Cronbach's alpha was high for each PROMIS PF short form ( α = 0.88-0.96). The full PROMIS PF bank and most short forms correlated highly with the SF-36 PF-10 ( r = 0.85-0.90), with the exception of PROMIS Upper Extremity ( r = 0.64). PROMIS Upper Extremity showed ceiling effects and lower agreement with the full bank than other short forms. Unidimensionality was supported for all PROMIS PF measures using traditional factor analysis and nonparametric item response theory. The German PROMIS PF bank was found to be conceptually equivalent to the English version and fulfilled the psychometric requirements for use of short forms in clinical practice. Future studies should pay particular attention to samples with upper extremity functional limitations to further investigate the dimensional structure of PF as conceptualized according to PROMIS.

Psychometric evaluation of the Social Interaction Phobia Scale.

PubMed

Reilly, Alison R; Carleton, R Nicholas; Weeks, Justin W

2012-01-01

The present study evaluated the psychometric properties of a novel measure of social anxiety symptoms, the Social Interaction Phobia Scale (SIPS), as a stand-alone item set, using an undergraduate sample (N=512). The 14-item SIPS has three subscales assessing Social Interaction Anxiety, Fear of Overt Evaluation, and Fear of Attracting Attention. Confirmatory factor analyses replicated the three-factor structure for the SIPS originally reported by Carleton et al. All SIPS scores demonstrated good internal consistency. The convergent validity of the SIPS was supported by strong and positive correlations between all SIPS scores and measures of social anxiety and fear of evaluation; the finding that the relationships between all SIPS scores and a social anxiety measure were stronger than relationships between all SIPS scores and measures of other constructs supported the discriminant validity of the SIPS. Results suggest that the SIPS possesses excellent psychometric properties.

Style preference survey: a report on the psychometric properties and a cross-validation experiment.

PubMed

Smith, Sherri L; Ricketts, Todd; McArdle, Rachel A; Chisolm, Theresa H; Alexander, Genevieve; Bratt, Gene

2013-02-01

Several self-report measures exist that target different aspects of outcomes for hearing aid use. Currently, no comprehensive questionnaire specifically assesses factors that may be important for differentiating outcomes pertaining to hearing aid style. The goal of this work was to develop the Style Preference Survey (SPS), a questionnaire aimed at outcomes associated with hearing aid style differences. Two experiments were conducted. After initial item development, Experiment 1 was conducted to refine the items and to determine its psychometric properties. Experiment 2 was designed to cross-validate the findings from the initial experiment. An observational design was used in both experiments. Participants who wore traditional, custom-fitted (TC) or open-canal (OC) style hearing aids from 3 mo to 3 yr completed the initial experiment. One-hundred and eighty-four binaural hearing aid users (120 of whom wore TC hearing aids and 64 of whom wore OC hearing aids) participated. A new sample of TC and OC users (n = 185) participated in the cross-validation experiment. Currently available self-report measures were reviewed to identify items that might differentiate between hearing aid styles, particularly preference for OC versus TC hearing aid styles. A total of 15 items were selected and modified from available self-report measures. An additional 55 items were developed through consensus of six audiologists for the initial version of the SPS. In the first experiment, the initial SPS version was mailed to 550 veterans who met the inclusion criteria. A total of 184 completed the SPS. Approximately three weeks later, a subset of participants (n = 83) completed the SPS a second time. Basic analyses were conducted to evaluate the psychometric properties of the SPS including subscale structure, internal consistency, test-retest reliability, and responsiveness. Based on the results of Experiment 1, the SPS was revised. A cross-validation experiment was then conducted using the revised version of the SPS to confirm the subscale structure, internal consistency, and responsiveness of the questionnaire in a new sample of participants. The final factor analysis led to the ultimate version of the SPS, which had a total of 35 items encompassing five subscales: (1) Feedback, (2) Occlusion/Own Voice Effects, (3) Localization, (4) Fit, Comfort, and Cosmetics, and (5) Ease of Use. The internal consistency of the total SPS (Cronbach's α = .92) and of the subscales (each Cronbach's α > .75) was high. Intraclass correlations (ICCs) showed that the test-retest reliability of the total SPS (ICC = .93) and of the subscales (each ICC > .80) also was high. TC hearing aid users had significantly poorer outcomes than OC hearing aid users on 4 of the 5 subscales, suggesting that the SPS largely is responsive to factors related to style-specific differences. The results suggest that the SPS has good psychometric properties and is a valid and reliable measure of outcomes related to style-specific, hearing aid preference. American Academy of Audiology.

Development and assessment of a composite score for memory in the Alzheimer's Disease Neuroimaging Initiative (ADNI).

PubMed

Crane, Paul K; Carle, Adam; Gibbons, Laura E; Insel, Philip; Mackin, R Scott; Gross, Alden; Jones, Richard N; Mukherjee, Shubhabrata; Curtis, S McKay; Harvey, Danielle; Weiner, Michael; Mungas, Dan

2012-12-01

We sought to develop and evaluate a composite memory score from the neuropsychological battery used in the Alzheimer's Disease (AD) Neuroimaging Initiative (ADNI). We used modern psychometric approaches to analyze longitudinal Rey Auditory Verbal Learning Test (RAVLT, 2 versions), AD Assessment Schedule - Cognition (ADAS-Cog, 3 versions), Mini-Mental State Examination (MMSE), and Logical Memory data to develop ADNI-Mem, a composite memory score. We compared RAVLT and ADAS-Cog versions, and compared ADNI-Mem to RAVLT recall sum scores, four ADAS-Cog-derived scores, the MMSE, and the Clinical Dementia Rating Sum of Boxes. We evaluated rates of decline in normal cognition, mild cognitive impairment (MCI), and AD, ability to predict conversion from MCI to AD, strength of association with selected imaging parameters, and ability to differentiate rates of decline between participants with and without AD cerebrospinal fluid (CSF) signatures. The second version of the RAVLT was harder than the first. The ADAS-Cog versions were of similar difficulty. ADNI-Mem was slightly better at detecting change than total RAVLT recall scores. It was as good as or better than all of the other scores at predicting conversion from MCI to AD. It was associated with all our selected imaging parameters for people with MCI and AD. Participants with MCI with an AD CSF signature had somewhat more rapid decline than did those without. This paper illustrates appropriate methods for addressing the different versions of word lists, and demonstrates the additional power to be gleaned with a psychometrically sound composite memory score.

Development and Psychometric Evaluation of a Psychosocial Quality-of-Life Questionnaire for Individuals with Autism and Related Developmental Disorders

ERIC Educational Resources Information Center

Markowitz, Leslie A.; Reyes, Charina; Embacher, Rebecca A.; Speer, Leslie L.; Roizen, Nancy; Frazier, Thomas W.

2016-01-01

This study investigated the psychometric properties of the Child and Family Quality of Life scale, a measure of psychosocial quality of life in those with autism and related developmental disorders. Parents of 212 children suspected of autism spectrum disorder completed the Child and Family Quality of Life prior to a diagnostic evaluation. Results…

Psychometric Evaluation of Three Psychosocial Measures Associated with Physical Activity among Adolescent Girls

ERIC Educational Resources Information Center

Ling, Jiying; Robbins, Lorraine B.

2017-01-01

The purpose of this study was to evaluate the psychometric properties of a Perceived Benefits Scale, a Perceived Barriers Scale, and a Physical Activity Enjoyment Scale with data from a group randomized controlled trial (RCT) and a test-retest study with 1-week interval. In the group RCT at baseline and Week 17, 1,012 fifth- to eighth-grade girls…

The Risk-Taking and Self-Harm Inventory for Adolescents: Development and Psychometric Evaluation

ERIC Educational Resources Information Center

Vrouva, Ioanna; Fonagy, Peter; Fearon, Pasco R. M.; Roussow, Trudie

2010-01-01

In this study, we report on the development and psychometric evaluation of the Risk-Taking (RT) and Self-Harm (SH) Inventory for Adolescents (RTSHIA), a self-report measure designed to assess adolescent RT and SH in community and clinical settings. 651 young people from secondary schools in England ranging in age from 11.6 years to 18.7 years and…

Experimenting the hospital survey on patient safety culture in prevention facilities in Italy: psychometric properties.

PubMed

Tereanu, Carmen; Smith, Scott A; Sampietro, Giuseppe; Sarnataro, Francesco; Mazzoleni, Giuliana; Pesenti, Bruno; Sala, Luca C; Cecchetti, Roberto; Arvati, Massimo; Brioschi, Dania; Viscardi, Michela; Prati, Chiara; Barbaglio, Giorgio G

2017-04-01

The Agency for Healthcare Research and Quality Hospital Survey on Patient Safety Culture (HSOPS) was designed to assess staff views on patient safety culture in hospital. This study examines psychometrics of the Italian translation of the HSOPS for use in territorial prevention facilities. After minimal adjustments and pre-test of the Italian version, a qualitative cross-sectional study was carried out. Departments of Prevention (DPs) of four Local Health Authorities in Northern Italy. Census of medical and non-medical staff (n. 479). Web-based self-administered questionnaire. Descriptive statistics, internal reliability, Confirmatory Factor Analysis (CFA) and intercorrelations among survey composites. Initial CFA of the 12 patient safety culture composites and 42 items included in the original version of the questionnaire revealed that two dimensions (Staffing and Overall Perception of Patient Safety) and nine individual items did not perform well among Italian territorial Prevention staff. After dropping those composites and items, psychometric properties were acceptable (comparative fit index = 0.94; root mean square error of approximation = 0.04; standardized root mean square residual = 0.04). Internal consistency for each remaining composite met or exceeded the criterion 0.70. Intercorrelations were all statistically significant. Psychometric analyses provided overall support for 10 of the 12 initial patient safety culture composites and 33 of the 42 initial composite items. Although the original instrument was intended for US Hospitals, the Italian translation of the HSOPS adapted for use in territorial prevention facilities performed adequately in Italian DPs. © The Author 2017. Published by Oxford University Press in association with the International Society for Quality in Health Care. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com

Measuring the Quality of Life of Visually Impaired Children: First Stage Psychometric Evaluation of the Novel VQoL_CYP Instrument.

PubMed

Tadić, Valerija; Cooper, Andrew; Cumberland, Phillippa; Lewando-Hundt, Gillian; Rahi, Jugnoo S

2016-01-01

To report piloting and initial validation of the VQoL_CYP, a novel age-appropriate vision-related quality of life (VQoL) instrument for self-reporting by children with visual impairment (VI). Participants were a random patient sample of children with VI aged 10-15 years. 69 patients, drawn from patient databases at Great Ormond Street Hospital and Moorfields Eye Hospital, United Kingdom, participated in piloting of the draft 47-item VQoL instrument, which enabled preliminary item reduction. Subsequent administration of the instrument, alongside functional vision (FV) and generic health-related quality of life (HRQoL) self-report measures, to 101 children with VI comprising a nationally representative sample enabled further item reduction and evaluation of psychometric properties using Rasch analysis. Construct validity was assessed through Pearson correlation coefficients. Item reduction through piloting (8 items removed for skewness and individual item response pattern) and validation (1 item removed for skewness and 3 for misfit in Rasch) produced a 35-item scale, with fit values within acceptable limits, no notable differential item functioning, good measurement precision, ordered response categories and acceptable targeting in Rasch. The VQoL_CYP showed good construct validity, correlating strongly with HRQoL scores, moderately with FV scores but not with acuity. Robust child-appropriate self-report VQoL measures for children with VI are necessary for understanding the broader impacts of living with a visual disability, distinguishing these from limited functioning per se. Future planned use in larger patient samples will allow further psychometric development of the VQoL_CYP as an adjunct to objective outcomes assessment.

Psychometric evaluation of the Sibling Cancer Needs Instrument (SCNI): an instrument to assess the psychosocial unmet needs of young people who are siblings of cancer patients.

PubMed

Patterson, P; McDonald, F E J; Butow, P; White, K J; Costa, D S J; Millar, B; Bell, M L; Wakefield, C E; Cohn, R J

2014-03-01

The current study sought to establish the psychometric properties of the revised Sibling Cancer Needs Instrument (SCNI) when completed by young people who have a brother or sister with cancer. The participants were 106 young people aged between 12 and 24 who had a living brother or sister diagnosed with any type or stage of cancer in the last 5 years. They were recruited from multiple settings. The initial step in determining the dimensional structure of the questionnaire was exploratory factor analysis and further assessment followed using Rasch analysis. Construct validity and test-retest reliability (n = 17) were also assessed. The final SCNI has 45 items and seven domains: information; practical assistance; "time out" and recreation; feelings; support (friends and other young people); understanding from my family; and sibling relationship. There was a reasonable spread of responses across the scale for every item. Rasch analysis results suggested that overall, respondents used the scale consistently. Support for construct validity was provided by the correlations between psychological distress and the SCNI domains. The internal consistency was good to excellent; Cronbach's alphas ranged from 0.78 to 0.94. The test-retest reliability of the overall measure is 0.88. The SCNI is the first measure of psychosocial unmet needs which has been developed for young people who have a brother or sister with cancer. The sound psychometric properties allow the instrument to be used with confidence. The measure will provide a substantial clinical benefit in highlighting the unmet needs of this population to assist with the prioritisation of targeted supportive care services and evaluating the impact of interventions targeted at siblings.

Psychometric evaluation of the shortened resilience scale among Alzheimer's caregivers.

PubMed

Wilks, Scott E

2008-01-01

The purpose of this study was to evaluate psychometric properties of the shortened Resilience Scale (15-item version RS15) among a sample of Alzheimer's caregivers. Self-reported data were collected from 229 participants at 2 Alzheimer's caregiver conferences. RS15 principal axis factoring indicated a single-dimensional solution with all items loaded. Reliability was strong. Convergent validity for the RS15 was suggested through its correlations with stress, family support, and friend support. Odds ratios showed significant likelihoods of high resilience given low stress and high social support. The results confirmed the RS15 to be a psychometrically sound measure that can be used to appraise the efficacy of adaptability among Alzheimer's caregivers.

Development and psychometric testing of a chinese version of the caregiver burden index for parents of children with allergies.

PubMed

Liu, Pei-Ching; Gau, Bih-Shya; Hung, Chao-Chia

2015-01-01

BACKGROUNG: No specific instrument has thus far been developed for measuring the caregiver burden perceived by parents of children with allergies (CWA). To determine the psychometric properties of the Caregiver Burden Index (CBI). A mixed-methods design was adopted to evaluate the psychometric properties of the scale. The content validity index was 0.89, and the internal consistency was high with a coefficient alpha of 0.98. Three factors were extracted after exploratory factor analysis. The study findings suggest that the CBI has sufficient reliability and validity to evaluate the caregiver burden of parents of CWA. Copyright © 2015 Elsevier Inc. All rights reserved.

Psychometric Evaluation of the Filipino Versions of the Duke University Religion Index and the Spiritual Coping Strategies Scale in Filipino Hemodialysis Patients.

PubMed

Cruz, Jonas Preposi; Reyes, Ralph Warren P; Colet, Paolo C; Estacio, Joel C; Caldeira, Sílvia; Vitorino, Luciano Magalhães; Koenig, Harold G

2017-08-01

This study evaluated the psychometric properties of the Filipino versions of the Duke University Religion Index (DUREL-F) and the Spiritual Coping Strategies scale (SCS-F) for hemodialysis (HD) patients in the Philippines. A convenient sample of 162 HD patients was included in this descriptive, cross-sectional study. The DUREL-F and SCS-F exhibited acceptable internal consistency and stability reliability, as well as excellent content and construct validity. The findings confirmed the soundness of the psychometric properties of the two scales. Thus, they can be used for timely and accurate assessment of religiosity and spiritual coping utilization among Filipino patients receiving HD.

A systematic review of psychometric testing of instruments that measure intention to work with older people.

PubMed

Che, Chong Chin; Hairi, Noran Naqiah; Chong, Mei Chan

2017-09-01

To review systematically the psychometric properties of instruments used to measure intention to work with older people. Nursing students are part of the future healthcare workforce; thus, being aware of their intention to work with older people would give valuable insights to nursing education and practice. Despite a plethora of research on measuring intention to work with older people, a valid and reliable instrument has not been identified. A systematic literature review of evidence and psychometric properties. Eight database searches were conducted between 2006 - 2016. English articles were selected based on inclusion and exclusion criteria. The COSMIN checklist was used to assess instruments reporting a psychometric evaluation of validity and reliability. Of 41 studies identified for full text review, 36 met the inclusion criteria. Seven different types of instruments were identified for psychometric evaluation. Measures of reliability were reported in eight papers and validity in five papers. Evidence for each measurement property was limited, with each instrument demonstrating a lack of information on measurement properties. Based on the COSMIN checklist, the overall quality of the psychometric properties was rated as poor to good. No single instrument was found to be optimal for use. Studies of high methodological quality are needed to properly assess the measurement properties of the instruments that are currently available. Until such studies are available, we recommend using existing instruments with caution. © 2017 John Wiley & Sons Ltd.

Psychometric testing of the Italian and French versions of the Care Dependency Scale.

PubMed

Zürcher, Simeon Joel; Vangelooven, Christa; Borter, Natalie; Schnyder, Daniel; Hahn, Sabine

2016-12-01

The aim of this study was to test psychometrically the Italian and French versions of the Care Dependency Scale. The Care Dependency Scale assesses changes in patients' level of care dependency including important functional and mental dimensions. Evaluation of the psychometric properties of the Italian version is still ongoing. The French version has to date not been validated. Nationwide cross-sectional point prevalence study. Data were extracted from the national, annual prevalence survey of hospital-acquired pressure ulcers and inpatient falls in Swiss acute care hospitals in 2011. A total of 799 Italian and 1068 French-speaking patients were included in the analysis. For the evaluation, the psychometric properties were tested for each language both separately and conjointly. The scales revealed high internal consistency. Factor analysis presented a one-factor solution for both versions separately as well as combined. Comparison of internal structure revealed an excellent degree of equivalence between the versions. Highly significant Spearman correlations between the Care Dependency Scale and the Braden Scale sum scores indicated satisfactory criterion validity. Both the Italian and the French versions of the Care Dependency Scale showed satisfactory psychometric properties and a high level of equivalence. Further psychometric testing, using modern test theory approaches, is required. However, the scale is recommended as a valid instrument for further use in Italian and French. © 2016 John Wiley & Sons Ltd.

Calibration of the Spanish PROMIS Smoking Item Banks.

PubMed

Huang, Wenjing; Stucky, Brian D; Edelen, Maria O; Tucker, Joan S; Shadel, William G; Hansen, Mark; Cai, Li

2016-07-01

The Patient-Reported Outcomes Measurement Information System (PROMIS) Smoking Initiative has developed item banks for assessing six smoking behaviors and biopsychosocial correlates of smoking among adult cigarette smokers. The goal of this study is to evaluate the performance of the Spanish version of the PROMIS smoking item banks as compared to the original banks developed in English. The six PROMIS banks for daily smokers were translated into Spanish and administered to a sample of Spanish-speaking adult daily smokers in the United States (N = 302). We first evaluated the unidimensionality of each bank using confirmatory factor analysis. We then conducted a two-group item response theory calibration, including an item response theory-based Differential Item Functioning (DIF) analysis by language of administration (Spanish vs. English). Finally, we generated full bank and short form scores for the translated banks and evaluated their psychometric performance. Unidimensionality of the Spanish smoking item banks was supported by confirmatory factor analysis results. Out of a total of 109 items that were evaluated for language DIF, seven items in three of the six banks were identified as having levels of DIF that exceeded an established criterion. The psychometric performance of the Spanish daily smoker banks is largely comparable to that of the English versions. The Spanish PROMIS smoking item banks are highly similar, but not entirely equivalent, to the original English versions. The parameters from these two-group calibrations can be used to generate comparable bank scores across the two language versions. In this study, we developed a Spanish version of the PROMIS smoking toolkit, which was originally designed and developed for English speakers. With the growing Spanish-speaking population, it is important to make the toolkit more accessible by translating the items and calibrating the Spanish version to be comparable with English-language scores. This study provided the translated item banks and short forms, comparable unbiased scores for Spanish speakers and evaluations of the psychometric properties of the new Spanish toolkit. © The Author 2016. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Psychometric evaluation of the Northwick Park Dependency Scale.

PubMed

Siegert, Richard J; Turner-Stokes, Lynne

2010-11-01

To examine the psychometric properties of the Northwick Park Dependency Scale (NPDS). Review of existing literature and psychometric analysis in relation to other standardized measures of disability in a large neurorehabilitation cohort. A regional post-acute specialist inpatient neurorehabilitation unit in London, UK. A total of 569 inpatients with complex neurological disabilities (350 males, 219 females; mean age 44.4 years). The NPDS, Barthel Index, Functional Independence and Functional Assessment measures. A database search found 5 studies that examined the psychometrics of the NPDS. These supported its validity and reliability. The present study added to these by evaluating the internal consistency, factor structure, discriminatory power and responsiveness to change during rehabilitation. The NPDS was found to have good internal consistency (α = 0.90), suggesting that it can reasonably be summed to a single total score. It discriminated among people with different levels of dependency and was responsive to change, particularly in the higher dependency groups. The NPDS is a psychometrically robust tool, providing a broader range of information on nursing needs than some other commonly-used disability measures. The Special Nursing Needs subscale provides clinically useful information, but its metric properties require further development, which is now underway.

Neuropsychological Testing Predicts Cerebrospinal Fluid Aβ in Mild Cognitive Impairment (MCI)

PubMed Central

Kandel, Benjamin M.; Avants, Brian B.; Gee, James C.; Arnold, Steven E.; Wolk, David A.

2015-01-01

Background Psychometric tests predict conversion of Mild Cognitive Impairment (MCI) to probable Alzheimer's Disease (AD). Because the definition of clinical AD relies on those same psychometric tests, the ability of these tests to identify underlying AD pathology remains unclear. Objective To determine the degree to which psychometric testing predicts molecular evidence of AD amyloid pathology, as indicated by CSF Aβ1–42, in patients with MCI, as compared to neuroimaging biomarkers. Methods We identified 408 MCI subjects with CSF Aβ levels, psychometric test data, FDG-PET scans, and acceptable volumetric MR scans from the Alzheimer’s Disease Neuroimaging Initiative (ADNI). We used psychometric tests and imaging biomarkers in univariate and multivariate models to predict Aβ status. Results The 30-minute delayed recall score of the Rey Auditory Verbal Learning Test (AVLT) was the best predictor of Aβ status among the psychometric tests, achieving an AUC of 0.67±0.02 and odds ratio of 2.5±0.4. FDG-PET was the best imaging-based biomarker (AUC 0.67±0.03, OR 3.2±1.2), followed by hippocampal volume (AUC 0.64±0.02,,OR 2.4±0.3). A multivariate analysis based on the psychometric tests improved on the univariate predictors, achieving an AUC of 0.68±0.03 (OR 3.38±1.2). Adding imaging biomarkers to the multivariate analysis did not improve the AUC. Conclusion Psychometric tests perform as well as imaging biomarkers to predict presence of molecular markers of AD pathology in MCI patients and should be considered in the determination of the likelihood that MCI is due to AD. PMID:25881908

Mental imagery during daily life: Psychometric evaluation of the Spontaneous Use of Imagery Scale (SUIS)

PubMed Central

Nelis, Sabine; Holmes, Emily A.; Griffith, James W.; Raes, Filip

2015-01-01

The Spontaneous Use of Imagery Scale (SUIS) is used to measure the tendency to use visual mental imagery in daily life. Its psychometric properties were evaluated in three independent samples (total N = 1297). We evaluated the internal consistency and test-retest reliability of the questionnaire. We also examined the structure of the items using exploratory and confirmatory factor analysis. Moreover, correlations with other imagery questionnaires provided evidence about convergent validity. The SUIS had acceptable reliability and convergent validity. Exploratory and confirmatory factor analysis revealed that a unidimensional structure fit the data, suggesting that the SUIS indeed measures a general use of mental imagery in daily life. Future research can further investigate and improve the psychometric properties of the SUIS. Moreover, the SUIS could be useful to determine how imagery relates to e.g. psychopathology. PMID:26290615

Development and Psychometric Evaluation of a Questionnaire Based on the Nursing Outcomes Classification to Determine the Knowledge of Parents on Breast-Feeding: Research Protocol.

PubMed

Paloma-Castro, Olga; Romero-Sánchez, José Manuel; Paramio-Cuevas, Juan Carlos; Pastor-Montero, Sonia María; Del Carmen Sánchez-Dalda, María; Rozadillas-Sanmiguel, Elena; Moreno-Corral, Luis Javier

2017-04-01

To develop and psychometrically evaluate a questionnaire based on the outcome "Knowledge: Breast-feeding" of the Nursing Outcomes Classification (NOC) to determine the knowledge of parents on breast-feeding. The NOC outcome "Knowledge: Breast-feeding" allows for nurses/midwives to assess the efficacy of interventions aimed to improve the knowledge on breast-feeding in parents thought the clinical interview/observation. However, the use of self-administered questionnaires by patients could facilitate its evaluation. Two-phased study: (1) Development of the questionnaire based on experts' opinions; (2) Methodological design to assess its psychometric properties. The availability of tools that enable the determination of the knowledge of patients would facilitate nurses/midwives to set objectives, individualize interventions, and measure their effectiveness. © 2015 NANDA International, Inc.

A two-dimensional model of disrupted body integrity: initial evaluation in head and neck cancer.

PubMed

Mah, Kenneth; Lebel, Sophie; Irish, Jonathan; Bezjak, Andrea; Payne, Ada Y M; Devins, Gerald M

2018-04-13

This cross-sectional study presents an initial psychometric evaluation of a two-dimensional (perceptual and evaluative) conceptualization and measure of disrupted body integrity (DBI)-illness-related disruption of the sense of the body as an integrated, smoothly functioning whole. Male and female head and neck cancer (HNC) outpatients (N = 98) completed a questionnaire package prior to outpatient visits. The Disrupted Body Integrity Scale (DBIS) was developed to measure the perceptual and evaluative facets of DBI. Self-report measures of disfigurement, stigma, depressive symptoms, and negative affect were also completed. Almost all DBIS subscales demonstrated good internal consistency. Results largely supported the DBIS's construct validity. The majority of subscales correlated within the predicted range of r's = .40-.70. Almost all DBIS constructs were positively linked with either depressive symptoms or disfigurement. None correlated with positive affect, and only two subscales, abnormal sensations (perceptual) and physical vulnerability (evaluative), correlated with negative affect. DBIS constructs showed little relation with stigma, once disfigurement effects were controlled for. Findings offer preliminary evidence for the DBIS and the relevance of DBI in HNC. Further evaluation of DBI in disease adaptation and the DBIS's factor structure is warranted.

Content and psychometric evaluations of questionnaires for assessing physical function in people with neck disorders: a systematic review of the literature.

PubMed

Wiitavaara, Birgitta; Heiden, Marina

2017-06-02

The purpose was to investigate how physical function is assessed in people with musculoskeletal disorders (MSD) in the neck. Specifically, we aimed to determine: (1) Which questionnaires are used to assess physical function in people with MSD in the neck? (2) What do those questionnaires measure? (3) What are the measurement properties of the questionnaires? A systematic review was performed to identify questionnaires and psychometric evaluations. The content of the questionnaires was categorized according to the International Classification of Function, Disability and Health, and the psychometric properties were quality-rated using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. Ten questionnaires and 32 articles evaluating measurement properties were analyzed. Most questionnaires covered only the components body functions and activity and participation, more often activity participation than body function. Internal consistency was adequate in most questionnaires, whereas responsiveness was generally low. Neck Disability Index was most evaluated, but the evaluations of all questionnaires tended to cover most properties in the checklist. The questionnaires differed substantially in items and extent to which their psychometric properties had been evaluated. Focus of measurement was on activities in daily life rather than physical function as such. Implications for Rehabilitation To provide early diagnostics and effective treatment for patients with neck disorders, valid and reliable instruments that measure relevant aspects of the disorders are needed. This paper presents an overview of content and quality of questionnaires used to assess physical function in neck disorders, which may facilitate informed decisions about which measurement instruments to use when evaluating the course of neck disorders. Most of the questionnaires need more testing to judge the quality, however the NDI was the most frequently tested questionnaire. The COnsensus-based Standards for the selection of health Measurement INstruments checklist is a useful tool in relation to psychometric testing of questionnaires, but clear definitions of interpretation of the quality criteria in each study would enhance comparability of results.

The Swedish version of the multidimensional scale of perceived social support (MSPSS)--a psychometric evaluation study in women with hirsutism and nursing students.

PubMed

Ekbäck, Maria; Benzein, Eva; Lindberg, Magnus; Arestedt, Kristofer

2013-10-10

The Multidimensional Scale of Perceived Social Support (MSPSS) is a short instrument, developed to assess perceived social support. The original English version has been widely used. The original scale has demonstrated satisfactory psychometric properties in different settings, but no validated Swedish version has been available. The aim was therefore to translate, adapt and psychometrically evaluate the Multidimensional Scale of Perceived Social Support for use in a Swedish context. In total 281 participants accepted to join the study, a main sample of 127 women with hirsutism and a reference sample of 154 nursing students. The MSPSS was translated and culturally adapted according to the rigorous official process approved by WHO. The psychometric evaluation included item analysis, evaluation of factor structure, known-group validity, internal consistency and reproducibility. The original three-factor structure was reproduced in the main sample of women with hirsutism. An equivalent factor structure was demonstrated in a cross-validation, based on the reference sample of nursing students. Known-group validity was supported and internal consistency was good for all scales (α = 0.91-0.95). The test-retest showed acceptable to very good reproducibility for the items (κw = 0.58-0.85) and the scales (ICC = 0.89-0.92; CCC = 0.89-0.92). The Swedish version of the MSPSS is a multidimensional scale with sound psychometric properties in the present study sample. The simple and short format makes it a useful tool for measuring perceived social support.

Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP)

PubMed Central

Bernhard, Gerda; Knibbe, Ronald A.; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

2015-01-01

Background Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs’ cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. Methods The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Results Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs’ cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension’s Cronbach’s α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. Conclusions The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs’ cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs’ cultural competence, and has the ability to distinguish between groups that are expected to differ in cultural competence. This instrument can foster professional development through systematic self-assessment and thus contributes to improve the quality of patient care. PMID:26641876

Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP).

PubMed

Bernhard, Gerda; Knibbe, Ronald A; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

2015-01-01

Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs' cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs' cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension's Cronbach's α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs' cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs' cultural competence, and has the ability to distinguish between groups that are expected to differ in cultural competence. This instrument can foster professional development through systematic self-assessment and thus contributes to improve the quality of patient care.

The Getting-Out-of-Bed (GoB) Scale: A Measure of Motivation and Life Outlook in Older Adults with Cancer

PubMed Central

Clough-Gorr, Kerri M.; Rakowski, William; Clark, Melissa; Silliman, Rebecca A.

2009-01-01

Objective To develop and evaluate the psychometric properties of a measure of motivation and life outlook (Getting-Out-of-Bed [GoB]). Design Secondary analysis of baseline and 6-month data from a longitudinal follow-up study of older breast cancer survivors. Participants Women (N=660) diagnosed with primary breast cancer stage I -IIIA disease, age ≥65-years, and permission to contact from an attending physician in four geographic regions in the USA (city-based Los Angeles, California; state-wide in Minnesota, North Carolina, and Rhode Island). Measurement Data were collected over 6-months of follow-up from consenting patients’ medical records and telephone interviews with patients. Data collected included the 4-item GoB, health related quality of life (HRQoL), breast cancer, socio-demographic and health-related characteristics. Results Factor analysis produced, as hypothesized, one principal component with eigen values of 2.74baseline and 2.916-months which explained 68.6%baseline and 72.7%6-months of total variance. In further psychometric analyses, GoB exhibited good construct validity (divergent: low non-statistically significant correlations with unrelated constructs; convergent: moderate statistically significant correlations with related constructs; discriminant: distinguished high HRQoL groups with a high level of significance), excellent internal reliability (Cronbach’s alpha 0.84baseline,0.876-months), and produced stable measurements over 6-months. Women with GoB scores ≥50 at baseline were more likely at 6-months to have good HRQoL, good self-perceived health, and report regular exercise, indicating good predictive ability. Conclusion GoB demonstrated overall good psychometric properties in this sample of older breast cancer survivors, suggestive of a promising tool for assessing motivation and life outlook in older adults. Nevertheless, because it was developed and initially evaluated in a select sample, using measures with similar but not exact content overlap further evaluation is needed before it can be recommended for widespread use. PMID:19813135

Development and initial validation of the Localized Scleroderma Skin Damage Index and Physician Global Assessment of disease Damage: a proof-of-concept study

PubMed Central

Vilaiyuk, Soamarat; Torok, Kathryn S.; Medsger, Thomas A.

2010-01-01

Objective. To develop and assess the psychometric properties of the Localized Scleroderma (LS) Skin Damage Index (LoSDI) and Physician Global Assessment of disease Damage (PGA-D). Methods. Damage was defined as irreversible/persistent changes (>6 months) due to previous active disease/complications of therapy. Eight rheumatologists assessed the importance of 17 variables in formulating the PGA-D/LoSDI. LS patients were evaluated by two rheumatologists using both tools to assess their psychometric properties. LoSDI was calculated by summing three scores for cutaneous features of damage [dermal atrophy (DAT), subcutaneous atrophy (SAT) and dyspigmentation (DP)] measured at 18 anatomic sites. Patient GA of disease severity (PtGA-S), Children's Dermatology Life Quality Index (CDLQI) and PGA-D were recorded at the time of each examination. Results. Thirty LS patients (112 lesions) and nine patient-visit pairs (18 lesions) were included for inter- and intra-rater reliability study. LoSDI and its domains DAT, SAT, DP and PGA-D demonstrated excellent inter- and intra-rater reliability (reliability coefficients 0.86–0.99 and 0.74–0.96, respectively). LoSDI correlated moderately with PGA-D and poorly with PtGA-S and CDLQI. PGA-D correlated moderately with PtGA-S, but poorly with CDLQI. Conclusions. To complete the LS Cutaneous Assessment Tool (LoSCAT), we developed and evaluated the psychometric properties of the LoSDI and PGA-D in addition to the LS Skin Severity Index (LoSSI). These instruments will facilitate evaluation of LS patients for individual patient management and clinical trials. LoSDI and PGA-D demonstrated excellent reliability and high validity. LoSCAT provides an improved understanding of LS natural history. Further study in a larger group of patients is needed to confirm these preliminary findings. PMID:20008472

Applying modern psychometric techniques to melodic discrimination testing: Item response theory, computerised adaptive testing, and automatic item generation.

PubMed

Harrison, Peter M C; Collins, Tom; Müllensiefen, Daniel

2017-06-15

Modern psychometric theory provides many useful tools for ability testing, such as item response theory, computerised adaptive testing, and automatic item generation. However, these techniques have yet to be integrated into mainstream psychological practice. This is unfortunate, because modern psychometric techniques can bring many benefits, including sophisticated reliability measures, improved construct validity, avoidance of exposure effects, and improved efficiency. In the present research we therefore use these techniques to develop a new test of a well-studied psychological capacity: melodic discrimination, the ability to detect differences between melodies. We calibrate and validate this test in a series of studies. Studies 1 and 2 respectively calibrate and validate an initial test version, while Studies 3 and 4 calibrate and validate an updated test version incorporating additional easy items. The results support the new test's viability, with evidence for strong reliability and construct validity. We discuss how these modern psychometric techniques may also be profitably applied to other areas of music psychology and psychological science in general.

Initial development and psychometric testing of an instrument to measure the quality of children's end-of-life care.

PubMed

Widger, Kimberley; Tourangeau, Ann E; Steele, Rose; Streiner, David L

2015-01-01

The field of pediatric palliative care is hindered by the lack of a well-defined, reliable, and valid method for measuring the quality of end-of-life care. The study purpose was to develop and test an instrument to measure mothers' perspectives on the quality of care received before, at the time of, and following a child's death. In Phase 1, key components of quality end-of-life care for children were synthesized through a comprehensive review of research literature. These key components were validated in Phase 2 and then extended through focus groups with bereaved parents. In Phase 3, items were developed to assess structures, processes, and outcomes of quality end-of-life care then tested for content and face validity with health professionals. Cognitive testing was conducted through interviews with bereaved parents. In Phase 4, bereaved mothers were recruited through 10 children's hospitals/hospices in Canada to complete the instrument, and psychometric testing was conducted. Following review of 67 manuscripts and 3 focus groups with 10 parents, 141 items were initially developed. The overall content validity index for these items was 0.84 as rated by 7 health professionals. Based on feedback from health professionals and cognitive testing with 6 parents, a 144-item instrument was finalized for further testing. In Phase 4, 128 mothers completed the instrument, 31 of whom completed it twice. Test-retest reliability, internal consistency, and construct validity were demonstrated for six subscales: Connect With Families, Involve Parents, Share Information With Parents, Share Information Among Health Professionals, Support Parents, and Provide Care at Death. Additional items with content validity were grouped in four domains: Support the Child, Support Siblings, Provide Bereavement Follow-up, and Structures of Care. Forty-eight items were deleted through psychometric testing, leaving a 95-item instrument. There is good initial evidence for the reliability and validity of this new quality of end-of-life care instrument as a mechanism for evaluative feedback to health professionals, health systems, and policy makers to improve children's end-of-life care.

Development and psychometric evaluation of the Undergraduate Clinical Education Environment Measure (UCEEM).

PubMed

Strand, Pia; Sjöborg, Karolina; Stalmeijer, Renée; Wichmann-Hansen, Gitte; Jakobsson, Ulf; Edgren, Gudrun

2013-12-01

There is a paucity of instruments designed to evaluate the multiple dimensions of the workplace as an educational environment for undergraduate medical students. The aim was to develop and psychometrically evaluate an instrument to measure how undergraduate medical students perceive the clinical workplace environment, based on workplace learning theories and empirical findings. Development of the instrument relied on established standards including theoretical and empirical grounding, systematic item development and expert review at various stages to ensure content validity. Qualitative and quantitative methods were employed using a series of steps from conceptualization through psychometric analysis of scores in a Swedish medical student population. The final result was a 25-item instrument with two overarching dimensions, experiential learning and social participation, and four subscales that coincided well with theory and empirical findings: Opportunities to learn in and through work & quality of supervision; Preparedness for student entry; Workplace interaction patterns & student inclusion; and Equal treatment. Evidence from various sources supported content validity, construct validity and reliability of the instrument. The Undergraduate Clinical Education Environment Measure represents a valid, reliable and feasible multidimensional instrument for evaluation of the clinical workplace as a learning environment for undergraduate medical students. Further validation in different populations using various psychometric methods is needed.

Further psychometric evaluation and revision of the Mayo-Portland Adaptability Inventory in a national sample.

PubMed

Malec, James F; Kragness, Miriam; Evans, Randall W; Finlay, Karen L; Kent, Ann; Lezak, Muriel D

2003-01-01

To evaluate the internal consistency of the Mayo-Portland Adaptability Inventory (MPAI), further refine the instrument, and provide reference data based on a large, geographically diverse sample of persons with acquired brain injury (ABI). 386 persons, most with moderate to severe ABI. Outpatient, community-based, and residential rehabilitation facilities for persons with ABI located in the United States: West, Midwest, and Southeast. Rasch, item cluster, principal components, and traditional psychometric analyses for internal consistency of MPAI data and subscales. With rescoring of rating scales for 4 items, a 29-item version of the MPAI showed satisfactory internal consistency by Rasch (Person Reliability=.88; Item Reliability=.99) and traditional psychometric indicators (Cronbach's alpha=.89). Three rationally derived subscales for Ability, Activity, and Participation demonstrated psychometric properties that were equivalent to subscales derived empirically through item cluster and factor analyses. For the 3 subscales, Person Reliability ranged from.78 to.79; Item Reliability, from.98 to.99; and Cronbach's alpha, from.76 to.83. Subscales correlated moderately (Pearson r =.49-.65) with each other and strongly with the overall scale (Pearson r=.82-.86). Outcome after ABI is represented by the unitary dimension described by the MPAI. MPAI subscales further define regions of this dimension that may be useful for evaluation of clinical cases and program evaluation.

Validation of a general measure of treatment satisfaction, the Treatment Satisfaction Questionnaire for Medication (TSQM), using a national panel study of chronic disease

PubMed Central

Atkinson, Mark J; Sinha, Anusha; Hass, Steven L; Colman, Shoshana S; Kumar, Ritesh N; Brod, Meryl; Rowland, Clayton R

2004-01-01

Background The objective of this study was to develop and psychometrically evaluate a general measure of patients' satisfaction with medication, the Treatment Satisfaction Questionnaire for Medication (TSQM). Methods The content and format of 55 initial questions were based on a formal conceptual framework, an extensive literature review, and the input from three patient focus groups. Patient interviews were used to select the most relevant questions for further evaluation (n = 31). The psychometric performance of items and resulting TSQM scales were examined using eight diverse patient groups (arthritis, asthma, major depression, type I diabetes, high cholesterol, hypertension, migraine, and psoriasis) recruited from a national longitudinal panel study of chronic illness (n = 567). Participants were then randomized to complete the test items using one of two alternate scaling methods (Visual Analogue vs. Likert-type). Results A factor analysis (principal component extraction with varimax rotation) of specific items revealed three factors (Eigenvalues > 1.7) explaining 75.6% of the total variance; namely Side effects (4 items, 28.4%, Cronbach's Alpha = .87), Effectiveness (3 items, 24.1%, Cronbach's Alpha = .85), and Convenience (3 items, 23.1%, Cronbach's Alpha = .87). A second factor analysis of more generally worded items yielded a Global Satisfaction scale (3 items, Eigenvalue = 2.3, 79.1%, Cronbach's Alpha = .85). The final four scales possessed good psychometric properties, with the Likert-type scaling method performing better than the VAS approach. Significant differences were found on the TSQM by the route of medication administration (oral, injectable, topical, inhalable), level of illness severity, and length of time on medication. Regression analyses using the TSQM scales accounted for 40–60% of variation in patients' ratings of their likelihood to persist with their current medication. Conclusion The TSQM is a psychometrically sound and valid measure of the major dimensions of patients' satisfaction with medication. Preliminary evidence suggests that the TSQM may also be a good predictor of patients' medication adherence across different types of medication and patient populations. PMID:14987333

Simulation-based assessment in anesthesiology: requirements for practical implementation.

PubMed

Boulet, John R; Murray, David J

2010-04-01

Simulations have taken a central role in the education and assessment of medical students, residents, and practicing physicians. The introduction of simulation-based assessments in anesthesiology, especially those used to establish various competencies, has demanded fairly rigorous studies concerning the psychometric properties of the scores. Most important, major efforts have been directed at identifying, and addressing, potential threats to the validity of simulation-based assessment scores. As a result, organizations that wish to incorporate simulation-based assessments into their evaluation practices can access information regarding effective test development practices, the selection of appropriate metrics, the minimization of measurement errors, and test score validation processes. The purpose of this article is to provide a broad overview of the use of simulation for measuring physician skills and competencies. For simulations used in anesthesiology, studies that describe advances in scenario development, the development of scoring rubrics, and the validation of assessment results are synthesized. Based on the summary of relevant research, psychometric requirements for practical implementation of simulation-based assessments in anesthesiology are forwarded. As technology expands, and simulation-based education and evaluation takes on a larger role in patient safety initiatives, the groundbreaking work conducted to date can serve as a model for those individuals and organizations that are responsible for developing, scoring, or validating simulation-based education and assessment programs in anesthesiology.

Psychometric Evaluation of the Chinese Virtues Questionnaire

ERIC Educational Resources Information Center

Duan, Wenjie; Ho, Samuel M. Y.; Bai, Yu; Tang, Xiaoqing

2013-01-01

Objectives: The present study examined the psychometric properties of the Chinese Virtues Questionnaire (CVQ). The reliability, factor structure, construct validity, and temporal stability of the inventory were examined. Method: A university student sample ("n" = 878) and a working adult sample ("n" = 153) were recruited.…

Evaluation of the Psychometric Properties of the Mental Vulnerability Questionnaire in Undergraduate Students.

PubMed

Sequeira, Carlos Alberto da Cruz; Barbosa, Elsa Natalina Mendes; Nogueira, Maria José Carvalho; Sampaio, Francisco Miguel Correia

2017-10-01

Translate, adapt the language, and assess the psychometric properties of the Mental Vulnerability Questionnaire (MVQ) in a Portuguese population sample of young adults. A psychometric validation study was performed. The sample comprised 166 undergraduate students. Factor analysis was applied to extract three indicators. The MVQ showed divergent validity with the Positive Mental Health Questionnaire (p < .001) and convergent validity with the Mental Health Inventory including five items (p < .001). Reliability was verified through the assessment of internal consistency, evidencing positive outcomes (Cronbach's α = 0.81). The MVQ shows psychometric properties enabling its adaptation to clinical practice and research, essential to an effective screening of mental vulnerability. © 2016 Wiley Periodicals, Inc.

Can personality traits predict the future development of heart disease in hospitalized psychiatric veterans?

PubMed

Williams, Wright; Kunik, Mark E; Springer, Justin; Graham, David P

2013-11-01

To examine which personality traits are associated with the new onset of chronic coronary heart disease (CHD) in psychiatric inpatients within 16 years after their initial evaluation. We theorized that personality measures of depression, anxiety, hostility, social isolation, and substance abuse would predict CHD development in psychiatric inpatients. We used a longitudinal database of psychological test data from 349 Veterans first admitted to a psychiatric unit between October 1, 1983, and September 30, 1987. Veterans Affairs and national databases were assessed to determine the development of new-onset chronic CHD over the intervening 16-year period. New-onset CHD developed in 154 of the 349 (44.1%) subjects. Thirty-one psychometric variables from five personality tests significantly predicted the development of CHD. We performed a factor analysis of these variables because they overlapped and four factors emerged, with positive adaptive functioning the only significant factor (OR=0.798, p=0.038). These results support previous research linking personality traits to the development of CHD, extending this association to a population of psychiatric inpatients. Compilation of these personality measures showed that 31 overlapping psychometric variables predicted those Veterans who developed a diagnosis of heart disease within 16 years after their initial psychiatric hospitalization. Our results suggest that personality variables measuring positive adaptive functioning are associated with a reduced risk of developing chronic CHD.

Validation of a Behavioral Approach for Measuring Saccades in Parkinson's Disease.

PubMed

Turner, Travis H; Renfroe, Jenna B; Duppstadt-Delambo, Amy; Hinson, Vanessa K

2017-01-01

Speed and control of saccades are related to disease progression and cognitive functioning in Parkinson's disease (PD). Traditional eye-tracking complexities encumber application for individual evaluations and clinical trials. The authors examined psychometric properties of standalone tasks for reflexive prosaccade latency, volitional saccade initiation, and saccade inhibition (antisaccade) in a heterogeneous sample of 65 PD patients. Demographics had minimal impact on task performance. Thirty-day test-retest reliability estimates for behavioral tasks were acceptable and similar to traditional eye tracking. Behavioral tasks demonstrated concurrent validity with traditional eye-tracking measures; discriminant validity was less clear. Saccade initiation and inhibition discriminated PD patients with cognitive impairment. The present findings support further development and use of the behavioral tasks for assessing latency and control of saccades in PD.

A Critical Meta-Analysis of Lens Model Studies in Human Judgment and Decision-Making

PubMed Central

Kaufmann, Esther; Reips, Ulf-Dietrich; Wittmann, Werner W.

2013-01-01

Achieving accurate judgment (‘judgmental achievement’) is of utmost importance in daily life across multiple domains. The lens model and the lens model equation provide useful frameworks for modeling components of judgmental achievement and for creating tools to help decision makers (e.g., physicians, teachers) reach better judgments (e.g., a correct diagnosis, an accurate estimation of intelligence). Previous meta-analyses of judgment and decision-making studies have attempted to evaluate overall judgmental achievement and have provided the basis for evaluating the success of bootstrapping (i.e., replacing judges by linear models that guide decision making). However, previous meta-analyses have failed to appropriately correct for a number of study design artifacts (e.g., measurement error, dichotomization), which may have potentially biased estimations (e.g., of the variability between studies) and led to erroneous interpretations (e.g., with regards to moderator variables). In the current study we therefore conduct the first psychometric meta-analysis of judgmental achievement studies that corrects for a number of study design artifacts. We identified 31 lens model studies (N = 1,151, k = 49) that met our inclusion criteria. We evaluated overall judgmental achievement as well as whether judgmental achievement depended on decision domain (e.g., medicine, education) and/or the level of expertise (expert vs. novice). We also evaluated whether using corrected estimates affected conclusions with regards to the success of bootstrapping with psychometrically-corrected models. Further, we introduce a new psychometric trim-and-fill method to estimate the effect sizes of potentially missing studies correct psychometric meta-analyses for effects of publication bias. Comparison of the results of the psychometric meta-analysis with the results of a traditional meta-analysis (which only corrected for sampling error) indicated that artifact correction leads to a) an increase in values of the lens model components, b) reduced heterogeneity between studies, and c) increases the success of bootstrapping. We argue that psychometric meta-analysis is useful for accurately evaluating human judgment and show the success of bootstrapping. PMID:24391781

A critical meta-analysis of lens model studies in human judgment and decision-making.

PubMed

Kaufmann, Esther; Reips, Ulf-Dietrich; Wittmann, Werner W

2013-01-01

Achieving accurate judgment ('judgmental achievement') is of utmost importance in daily life across multiple domains. The lens model and the lens model equation provide useful frameworks for modeling components of judgmental achievement and for creating tools to help decision makers (e.g., physicians, teachers) reach better judgments (e.g., a correct diagnosis, an accurate estimation of intelligence). Previous meta-analyses of judgment and decision-making studies have attempted to evaluate overall judgmental achievement and have provided the basis for evaluating the success of bootstrapping (i.e., replacing judges by linear models that guide decision making). However, previous meta-analyses have failed to appropriately correct for a number of study design artifacts (e.g., measurement error, dichotomization), which may have potentially biased estimations (e.g., of the variability between studies) and led to erroneous interpretations (e.g., with regards to moderator variables). In the current study we therefore conduct the first psychometric meta-analysis of judgmental achievement studies that corrects for a number of study design artifacts. We identified 31 lens model studies (N = 1,151, k = 49) that met our inclusion criteria. We evaluated overall judgmental achievement as well as whether judgmental achievement depended on decision domain (e.g., medicine, education) and/or the level of expertise (expert vs. novice). We also evaluated whether using corrected estimates affected conclusions with regards to the success of bootstrapping with psychometrically-corrected models. Further, we introduce a new psychometric trim-and-fill method to estimate the effect sizes of potentially missing studies correct psychometric meta-analyses for effects of publication bias. Comparison of the results of the psychometric meta-analysis with the results of a traditional meta-analysis (which only corrected for sampling error) indicated that artifact correction leads to a) an increase in values of the lens model components, b) reduced heterogeneity between studies, and c) increases the success of bootstrapping. We argue that psychometric meta-analysis is useful for accurately evaluating human judgment and show the success of bootstrapping.

Psychometric properties of health related quality of life measures in acute coronary syndrome patients: a systematic review protocol.

PubMed

Brasil, Virginia; Oliveira, Gabriela; Moraes, Katarinne Lima

2018-02-01

The objective of this systematic review is to evaluate the psychometric properties and clinical utility of patient-reported outcome measures that assess health-related quality of life in patients with a clinical diagnosis of acute coronary syndrome.

Assessing nurse-patient interactions from a caring perspective: report of the development and preliminary psychometric testing of the Caring Nurse--Patient Interactions Scale.

PubMed

Cossette, Sylvie; Cara, Chantal; Ricard, Nicole; Pepin, Jacinthe

2005-08-01

While there is a large body of literature regarding caring in nursing and some measurement tools addressing the concept have been developed, limitations of existing instruments constrain theory-driven research on nurse-patient interactions. The purpose of this paper is to describe the development and initial psychometric evaluation of the Caring Nurse-Patient Interactions Scale in a sample of 332 nurses and nursing students. The tool intended to facilitate research on the links between caring and patient outcomes. A content validity approach involving 13 expert nurses resulted in a 70-item tool sub-divided into 10 nursing carative factors. Alpha coefficients between sub-scales varied from .73 to .91 and sub-scales inter-correlations ranged from .53 to .89. Pearson correlation coefficients ranged from --.02 to .32 between the sub-scales and social desirability suggesting low to moderate bias. Results of the contrasted group approach partially supported the hypotheses while all differences were in the expected direction. Results suggest that the scale has strong potential for use in research, clinical and educational settings.

Of psychometric means: Starke R. Hathaway and the popularization of the Minnesota Multiphasic Personality Inventory.

PubMed

Schilling, Rebecca; Casper, Stephen T

2015-03-01

The Minnesota Multiphasic Personality Inventory (MMPI) was developed at the University of Minnesota, Minneapolis, in the 1930s and 1940s. It became a highly successful and highly controversial psychometric tool. In professional terms, psychometric tools such as the MMPI transformed psychology and psychiatry. Psychometric instruments thus readily fit into the developmental history of psychology, psychiatry, and neurology; they were a significant part of the narrative of those fields' advances in understanding, intervening, and treating people with mental illnesses. At the same time, the advent of such tools also fits into a history of those disciplines that records the rise of obsessional observational and evaluative techniques and technologies in order to facilitate patterns of social control that became typical during the Progressive Era in the United States and after. It was those patterns that also nurtured the resistance to psychometrics that emerged during the Vietnam War and after.

Educational Neuroscience: New Horizons for Research in Mathematics Education

ERIC Educational Resources Information Center

Campbell, Stephen R.

2006-01-01

This paper outlines an initiative in mathematics education research that aims to augment qualitative methods of research into mathematical cognition and learning with quantitative methods of psychometrics and psychophysiology. Background and motivation are provided for this initiative, which is coming to be referred to as educational neuroscience.…

The Adolescent-Parent Career Congruence Scale: Development and Initial Validation

ERIC Educational Resources Information Center

Sawitri, Dian R.; Creed, Peter A.; Zimmer-Gembeck, Melanie J.

2013-01-01

Although there is a growing interest in the discrepancy between parents and their adolescent children in relation to career expectations, there is no existing, psychometrically sound scale that directly measures adolescent-parent career congruence or incongruence. This study reports the development and initial validation of the Adolescent-Parent…

Development of the Clinical Teaching Effectiveness Questionnaire in the United States.

PubMed

Wormley, Michelle E; Romney, Wendy; Greer, Anna E

2017-01-01

The purpose of this study was to develop a valid measure for assessing clinical teaching effectiveness within the field of physical therapy. The Clinical Teaching Effectiveness Questionnaire (CTEQ) was developed via a 4-stage process, including (1) initial content development, (2) content analysis with 8 clinical instructors with over 5 years of clinical teaching experience, (3) pilot testing with 205 clinical instructors from 2 universities in the Northeast of the United States, and (4) psychometric evaluation, including principal component analysis. The scale development process resulted in a 30-item questionnaire with 4 sections that relate to clinical teaching: learning experiences, learning environment, communication, and evaluation. The CTEQ provides a preliminary valid measure for assessing clinical teaching effectiveness in physical therapy practice.

Assessing safety climate in acute hospital settings: a systematic review of the adequacy of the psychometric properties of survey measurement tools.

PubMed

Alsalem, Gheed; Bowie, Paul; Morrison, Jillian

2018-05-10

The perceived importance of safety culture in improving patient safety and its impact on patient outcomes has led to a growing interest in the assessment of safety climate in healthcare organizations; however, the rigour with which safety climate tools were developed and psychometrically tested was shown to be variable. This paper aims to identify and review questionnaire studies designed to measure safety climate in acute hospital settings, in order to assess the adequacy of reported psychometric properties of identified tools. A systematic review of published empirical literature was undertaken to examine sample characteristics and instrument details including safety climate dimensions, origin and theoretical basis, and extent of psychometric evaluation (content validity, criterion validity, construct validity and internal reliability). Five questionnaire tools, designed for general evaluation of safety climate in acute hospital settings, were included. Detailed inspection revealed ambiguity around concepts of safety culture and climate, safety climate dimensions and the methodological rigour associated with the design of these measures. Standard reporting of the psychometric properties of developed questionnaires was variable, although evidence of an improving trend in the quality of the reported psychometric properties of studies was noted. Evidence of the theoretical underpinnings of climate tools was limited, while a lack of clarity in the relationship between safety culture and patient outcome measures still exists. Evidence of the adequacy of the psychometric development of safety climate questionnaire tools is still limited. Research is necessary to resolve the controversies in the definitions and dimensions of safety culture and climate in healthcare and identify related inconsistencies. More importance should be given to the appropriate validation of safety climate questionnaires before extending their usage in healthcare contexts different from those in which they were originally developed. Mixed methods research to understand why psychometric assessment and measurement reporting practices can be inadequate and lacking in a theoretical basis is also necessary.

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

PubMed Central

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Background Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students’ communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. Methods We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Results Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Discussion Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students’ academic success. PMID:27031506

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE)--A Systematic Review of Rating Scales.

PubMed

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students' academic success.

Psychometric properties of startle and corrugator response in NPU, Affective Picture Viewing, and Resting State tasks

PubMed Central

Kaye, Jesse T.; Bradford, Daniel E.; Curtin, John J.

2016-01-01

The current study provides a comprehensive evaluation of critical psychometric properties of commonly used psychophysiology laboratory tasks/measures within the NIMH RDoC. Participants (N = 128) completed the No Shock, Predictable Shock, Unpredictable Shock (NPU) task, Affective Picture Viewing task, and Resting State task at two study visits separated by one week. We examined potentiation/modulation scores in NPU (predictable or unpredictable shock vs. no shock) and Affective Picture Viewing tasks (pleasant or unpleasant vs. neutral pictures) for startle and corrugator responses with two commonly used quantification methods. We quantified startle potentiation/modulation scores with raw and standardized responses. We quantified corrugator potentiation/modulation in the time and frequency domains. We quantified general startle reactivity in the Resting State Task as the mean raw startle response during the task. For these three tasks, two measures, and two quantification methods we evaluated effect size robustness and stability, internal consistency (i.e., split-half reliability), and one-week temporal stability. The psychometric properties of startle potentiation in the NPU task were good but concerns were noted for corrugator potentiation in this task. Some concerns also were noted for the psychometric properties of both startle and corrugator modulation in the Affective Picture Viewing task, in particular for pleasant picture modulation. Psychometric properties of general startle reactivity in the Resting State task were good. Some salient differences in the psychometric properties of the NPU and Affective Picture Viewing tasks were observed within and across quantification methods. PMID:27167717

Evaluation Criteria for Micro-CAI: A Psychometric Approach

PubMed Central

Wallace, Douglas; Slichter, Mark; Bolwell, Christine

1985-01-01

The increased use of microcomputer-based instructional programs has resulted in a greater need for third-party evaluation of the software. This in turn has prompted the development of micro-CAI evaluation tools. The present project sought to develop a prototype instrument to assess the impact of CAI program presentation characteristics on students. Data analysis and scale construction was conducted using standard item reliability analyses and factor analytic techniques. Adequate subscale reliabilities and factor structures were found, suggesting that a psychometric approach to CAI evaluation may possess some merit. Efforts to assess the utility of the resultant instrument are currently underway.

Psychometric evaluation of the PainCAS Interference with Daily Activities, Psychological/Emotional Distress, and Pain scales.

PubMed

McCaffrey, Stacey A; Black, Ryan A; Butler, Stephen F

2018-03-01

The PainCAS is a web-based clinical tool for assessing and tracking pain and opioid risk in chronic pain patients. Despite evidence for its utility within the clinical setting, the PainCAS scales have never been subject to psychometric evaluation. The current study is the first to evaluate the psychometric properties of the PainCAS Interference with Daily Activities, Psychological/Emotional Distress, and Pain scales. Patients (N = 4797) from treatment centers and hospitals in 16 different states completed the PainCAS as part of routine clinical assessment. A subsample (n = 73) from two hospital-based treatment centers also completed comparator measures. Rasch Rating Scale Models were employed to evaluate the Interference with Daily Activities and Psychological/Emotional Distress scales, and empirical evaluation included assessment of dimensionality, discrimination, item fit, reliability, information, and person-to-item targeting. Additionally, convergent and discriminant validity were evaluated through classical test theory approaches. Convergent validity of the Pain scales was evaluated through correlations with corresponding comparator items. One Interference with Daily Activities item was removed due to poor functioning and discrimination. The retained items from the Interference with Daily Activities and Psychological/Emotional Distress scales conformed to unidimensional Rasch measurement models, yielding satisfactory item fit, reliability, precision, and coverage. Further, results provided support for the convergent and discriminant validity of these two scales. Convergent validity between the PainCAS Pain and BPI Pain items was also strong. Taken together, results provide strong psychometric support for these PainCAS Pain scales. Strengths and limitations of the current study are discussed.

Development and psychometric evaluation of the "Neurosurgical Evaluation of Attitudes towards simulation Training" (NEAT) tool for use in neurosurgical education and training.

PubMed

Kirkman, Matthew A; Muirhead, William; Nandi, Dipankar; Sevdalis, Nick

2014-01-01

Neurosurgical simulation training is becoming increasingly popular. Attitudes toward simulation among residents can contribute to the effectiveness of simulation training, but such attitudes remain poorly explored in neurosurgery with no psychometrically proven measure in the literature. The aim of the present study was to evaluate prospectively a newly developed tool for this purpose: the Neurosurgical Evaluation of Attitudes towards simulation Training (NEAT). The NEAT tool was prospectively developed in 2 stages and psychometrically evaluated (validity and reliability) in 2 administrations with the same participants. The tool comprises a questionnaire with 9 Likert scale items and 2 free-text sections assessing attitudes toward simulation in neurosurgery. The evaluation was completed with 31 neurosurgery residents in London, United Kingdom, who were generally favorable toward neurosurgical simulation. The internal consistency of the questionnaire was high, as demonstrated by the overall Cronbach α values (α=0.899 and α=0.955). All but 2 questionnaire items had "substantial" or "almost perfect" test-retest reliability following repeated survey administrations (median Pearson r correlation=0.688; range, 0.248-0.841). NEAT items were well correlated with each other on both occasions, showing good validity of content within the NEAT tool. There was no significant relationship between either gender or length of neurosurgical experience and item ratings. NEAT is the first psychometrically evaluated tool for evaluating attitudes toward simulation in neurosurgery. Further implementation of NEAT is required in wider neurosurgical populations to establish whether specific population groups differ. Use of NEAT in studies of neurosurgical simulation could offer an additional outcome measure to performance metrics, permitting evaluation of the impact of neurosurgical simulation on attitudes toward simulation both between participants and within the same participants over time. Copyright © 2014 Elsevier Inc. All rights reserved.

A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS).

PubMed

Dambi, Jermaine M; Corten, Lieselotte; Chiwaridzo, Matthew; Jack, Helen; Mlambo, Tecla; Jelsma, Jennifer

2018-05-02

Social support (SS) has been identified as an essential buffer to stressful life events. Consequently, there has been a surge in the evaluation of SS as a wellbeing indicator. The Multidimensional Perceived Social Support Scale (MSPSS) has evolved as one of the most extensively translated and validated social support outcome measures. Due to linguistic and cultural differences, there is need to test the psychometrics of the adapted versions. However, there is a paucity of systematic evidence of the psychometrics of adapted and translated versions of the MSPSS across settings. To understand the psychometric properties of the MSPSS for non-English speaking populations by conducting a systematic review of studies that examine the psychometric properties of non-English versions of the MSPSS. We searched Africa-Wide Information, CINAHL, Medline and PsycINFO, for articles published in English on the translation and or validation of the MSPSS. Methodological quality and quality of psychometric properties of the retrieved translations were assessed using the COSMIN checklist and a validated quality assessment criterion, respectively. The two assessments were combined to produce the best level of evidence per language/translation. Seventy articles evaluating the MSPSS in 22 languages were retrieved. Most translations [16/22] were not rigorously translated (only solitary backward-forward translations were performed, reconciliation was poorly described, or were not pretested). There was poor evidence for structural validity, as confirmatory factor analysis was performed in only nine studies. Internal consistency was reported in all studies. Most attained a Cronbach's alpha of at least 0.70 against a backdrop of fair methodological quality. There was poor evidence for construct validity. There is limited evidence supporting the psychometric robustness of the translated versions of the MSPSS, and given the variability, the individual psychometrics of a translation must be considered prior to use. Responsiveness, measurement error and cut-off values should also be assessed to increase the clinical utility and psychometric robustness of the translated versions of the MSPSS. PROSPERO - CRD42016052394.

Computerized Testing in a Hospital Setting: Psychometric and Psychological Effects.

ERIC Educational Resources Information Center

Peterson, Leif; And Others

1996-01-01

This Swedish study sought to evaluate a touch-screen computer-based (CB) test administration system in a hospital setting in comparison with paper-and-pencil administrative routine. Patients were given psychometric tests (involving depression, mood, and intelligence measurement) in both formats. Patient pleasantness, activation, and calmness were…

The Alzheimer's Disease Knowledge Scale: Development and Psychometric Properties

ERIC Educational Resources Information Center

Carpenter, Brian D.; Balsis, Steve; Otilingam, Poorni G.; Hanson, Priya K.; Gatz, Margaret

2009-01-01

Purpose: This study provides preliminary evidence for the acceptability, reliability, and validity of the new Alzheimer's Disease Knowledge Scale (ADKS), a content and psychometric update to the Alzheimer's Disease Knowledge Test. Design and Methods: Traditional scale development methods were used to generate items and evaluate their psychometric…

School bonding in early adolescents: Psychometrics of the brief survey of school bonding

USDA-ARS?s Scientific Manuscript database

The comprehensive assessment of middle school student bonding is important for basic research and to evaluate interventions. Of over 30 tools reviewed, this study examined the psychometric properties of three that together assessed the four constructs identified by Hirschi as key elements. With some...

Parent Behavior Importance Questionnaire-Revised: Scale Development and Psychometric Characteristics

ERIC Educational Resources Information Center

Mowder, Barbara A.; Shamah, Renee

2011-01-01

This paper reports the scale development and psychometric characteristics of the Parent Behavior Importance Questionnaire-Revised (PBIQ-R). To develop this measure, 502 subject matter experts (SMEs) evaluated 91 parenting behaviors in terms of parenting behavior specificity (e.g., bonding, discipline), importance level, and appropriateness for…

Psychometric Evaluation of the Student Authorship Questionnaire: A Confirmatory Factor Analysis Approach

ERIC Educational Resources Information Center

Ballantine, Joan; Guo, Xin; Larres, Patricia

2015-01-01

This research provides new insights into the measurement of students' authorial identity and its potential for minimising the incidence of unintentional plagiarism by providing evidence about the psychometric properties of the Student Authorship Questionnaire (SAQ). Exploratory and confirmatory factor analyses (EFA and CFA) are employed to…

Psychometric Properties of Measures of Team Diversity with Likert Data

ERIC Educational Resources Information Center

Deng, Lifang; Marcoulides, George A.; Yuan, Ke-Hai

2015-01-01

Certain diversity among team members is beneficial to the growth of an organization. Multiple measures have been proposed to quantify diversity, although little is known about their psychometric properties. This article proposes several methods to evaluate the unidimensionality and reliability of three measures of diversity. To approximate the…

Homework Emotion Regulation Scale: Psychometric Properties for Middle School Students

ERIC Educational Resources Information Center

Xu, Jianzhong; Fan, Xitao; Du, Jianxia

2016-01-01

The goal of the present investigation is to evaluate the psychometric properties of the Homework Emotion Regulation Scale (HERS) using 796 middle school students in China. Confirmatory factor analyses (CFAs) supported the existence of two distinct yet related subscales for the HERS: Emotion Management and Cognitive Reappraisal. Concerning the…

A Psychometric Evaluation of the Core Bereavement Items

ERIC Educational Resources Information Center

Holland, Jason M.; Nam, Ilsung; Neimeyer, Robert A.

2013-01-01

Despite being a routinely administered assessment of grieving, few studies have empirically examined the psychometric properties of the Core Bereavement Items (CBI). The present study investigated the factor structure, internal reliability, and concurrent validity of the CBI in a large, diverse sample of bereaved young adults (N = 1,366).…

Psychometric evaluation of commonly used game-specific skills tests in rugby: A systematic review

PubMed Central

Oorschot, Sander; Chiwaridzo, Matthew; CM Smits-Engelsman, Bouwien

2017-01-01

Objectives To (1) give an overview of commonly used game-specific skills tests in rugby and (2) evaluate available psychometric information of these tests. Methods The databases PubMed, MEDLINE CINAHL and Africa Wide information were systematically searched for articles published between January 1995 and March 2017. First, commonly used game-specific skills tests were identified. Second, the available psychometrics of these tests were evaluated and the methodological quality of the studies assessed using the Consensus-based Standards for the selection of health Measurement Instruments checklist. Studies included in the first step had to report detailed information on the construct and testing procedure of at least one game-specific skill, and studies included in the second step had additionally to report at least one psychometric property evaluating reliability, validity or responsiveness. Results 287 articles were identified in the first step, of which 30 articles met the inclusion criteria and 64 articles were identified in the second step of which 10 articles were included. Reactive agility, tackling and simulated rugby games were the most commonly used tests. All 10 studies reporting psychometrics reported reliability outcomes, revealing mainly strong evidence. However, all studies scored poor or fair on methodological quality. Four studies reported validity outcomes in which mainly moderate evidence was indicated, but all articles had fair methodological quality. Conclusion Game-specific skills tests indicated mainly high reliability and validity evidence, but the studies lacked methodological quality. Reactive agility seems to be a promising domain, but the specific tests need further development. Future high methodological quality studies are required in order to develop valid and reliable test batteries for rugby talent identification. Trial registration number PROSPERO CRD42015029747. PMID:29259812

The Counseling Center Assessment of Psychological Symptoms (CCAPS-62): Acceptance, feasibility, and initial psychometric properties in a UK student population.

PubMed

Broglia, Emma; Millings, Abigail; Barkham, Michael

2017-09-01

The burden and severity of student mental health continue to increase in parallel with increasing financial pressures on students and services alike. There is a need for a student-specific measure of distress that acknowledges their unique context. This study examined the feasibility, acceptance, and initial psychometric properties of a US measure, the Counseling Center Assessment of Psychological Symptoms (CCAPS), in a UK student sample. A sample of 294 UK help-seeking students from two universities completed the CCAPS-62 and Clinical Outcomes in Routine Evaluation (CORE-10) as a comparator. The factor solution and reliability of the CCAPS-62 were examined. Correlations and clinical boundaries were determined between the CCAPS-62 subscales and CORE-10, and comparisons were made with US published norms. The CCAPS-62 demonstrated a strong factor solution that matched the intended subscales. All subscales had good reliability and correlated significantly with the CORE-10. The agreement on caseness between the two measures was 92.8% with 86.3% reaching clinical threshold on both the CCAPS-62 and CORE-10. Severity was most noticeable for academic distress, depression, anxiety, and social anxiety. Compared to US data, UK students showed higher clinical severity for all psychological symptoms. The CCAPS-62 is a reliable and psychometrically valid assessment measure to use with UK students without revision. The overall distress indicated is similar to that of the CORE-10, but the individual subscales are more informative of specific student concerns including academic distress, social anxiety, and substance abuse. Potential benefits of administering a student-focused assessment measure in student counselling services are discussed. University students attending counselling in the UK demonstrate clinical severity for academic distress, depression, anxiety, and social anxiety. Compared to university students in the US, UK students present with higher clinical severity on all contextual measures of student psychological distress. It is advantageous for university counselling services to administer a student-specific clinical measure over measures intended for the general clinical population. CCAPS-62 is an acceptable, feasible, and psychometrically valid measure of student psychological distress that can be used in the UK without revision. It is important for university counselling services to continue to provide support from therapists that are trained and experienced in the university context over services intended for the general clinical population. Copyright © 2017 John Wiley & Sons, Ltd.

Reliability and validity of the Pragmatics Observational Measure (POM): a new observational measure of pragmatic language for children.

PubMed

Cordier, Reinie; Munro, Natalie; Wilkes-Gillan, Sarah; Speyer, Renée; Pearce, Wendy M

2014-07-01

There is a need for a reliable and valid assessment of childhood pragmatic language skills during peer-peer interactions. This study aimed to evaluate the psychometric properties of a newly developed pragmatic assessment, the Pragmatic Observational Measure (POM). The psychometric properties of the POM were investigated from observational data of two studies - study 1 involved 342 children aged 5-11 years (108 children with ADHD; 108 typically developing playmates; 126 children in the control group), and study 2 involved 9 children with ADHD who attended a 7-week play-based intervention. The psychometric properties of the POM were determined based on the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) taxonomy of psychometric properties and definitions for health-related outcomes; the Pragmatic Protocol was used as the reference tool against which the POM was evaluated. The POM demonstrated sound psychometric properties in all the reliability, validity and interpretability criteria against which it was assessed. The findings showed that the POM is a reliable and valid measure of pragmatic language skills of children with ADHD between the age of 5 and 11 years and has clinical utility in identifying children with pragmatic language difficulty. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Screening disordered eating in a representative sample of the German population: Usefulness and psychometric properties of the German SCOFF questionnaire.

PubMed

Richter, Felicitas; Strauss, Bernhard; Braehler, Elmar; Adametz, Luise; Berger, Uwe

2017-04-01

The prevention of eating disorders and the identification of high-risk individuals are essential for the public health sector. There is need for sensitive and specific screening instruments of disordered eating that can be applied in universal samples as an initial step into disease prevention. The SCOFF is a screening instrument for disordered eating, frequently used in international and cross-cultural contexts to detect individuals at risk. The objective of this research is to evaluate whether the SCOFF can be used as a screening tool for disordered eating in universal samples. This is the first study which examined the psychometric properties of the German version of the SCOFF in a general population sample. A representative sample (N=2527) of the German population, aged 14-95years, was recruited. Psychometric properties were determined including reliability, concurrent and construct validity, and factor structure. The prevalence of disordered eating was assessed. The prevalence of disordered eating in the general population was 10%. Using the established cutoff point of ≥2, values for diagnostic accuracy were 26% (sensitivity), 97% (specificity), 80% (positive predictive value), and 74% (negative predictive value). Factorial analyses revealed an excellent model fit of a unidimensional model. Due to its low sensitivity and a high percentage of false negatives, there are limitations in using the German version of the SCOFF in general population samples with wide age ranges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Instruments evaluating the self-directed learning abilities among nursing students and nurses: a systematic review of psychometric properties.

PubMed

Cadorin, Lucia; Bressan, Valentina; Palese, Alvisa

2017-11-25

Modern healthcare institutions are continuously changing, and Self-Directed Learning (SDL) abilities are considered a prerequisite for both nursing students and nurses in order to be proactive about these demanding challenges. To date, no systematic reviews of existing instruments aimed at detecting and critically evaluating SDL abilities have been published. Therefore, the aims of this review are: 1) identify the instruments for assessment of SDL abilities among nursing students and nurses; 2) critically evaluate the methodological studies quality; and 3) compare the psychometric properties of the available instruments. A psychometric-systematic-review was performed. CDSR, CINAHL, ERIC, MEDLINE, PROSPERO, SCOPUS databases were searched without restrictions in time and setting. All primary studies involving nursing students or nurses, written in English and aimed at validating SDL assessment tools, were included. Studies retrieved were evaluated according to the COnsensus-based-Standards for the selection of health Measurement-INstruments (COSMIN) panel. Study inclusion, data extraction and quality assessment were performed by researchers independently. Eleven studies were included and four tools based on Knowles's theory have emerged: 1) the Self-Directed Learning Readiness Scale; 2) the Self-Directed Learning Readiness Scale for Nursing Education; 3) the Self-Rating Scale of Self-Directed Learning, and 4) the Self-Directed Learning Instrument. A few psychometric properties have been considered in each study, from two to four out of the ten required. The quality of the methodologies used was in general, from fair to poor with the exception of one instrument (the Self-Directed-Learning-Instrument). The psychometric proprieties that emerged across the tools were good in general: the Cronbach α was from 0.73 to 0.91; structural validities have also reported good indexes both in the explorative and in the confirmative factor analyses. On the basis of the findings, the Self-Directed-Learning-Instrument can be recommended for the assessment of SDL abilities among nursing students and nurses, given the excellent methodology quality adopted in estimating the psychometric properties. However, rigorous study designs aimed at estimating psychometric properties of tools in wide samples of nursing students and nurses across different stages of professional life, from undergraduate education to professional maturity, in different cultural, educational, and work settings, are strongly recommended.

Evaluating Patient Reported Outcome Measures (PROMs) for bladder cancer: a systematic review using the COSMIN checklist.

PubMed

Mason, Samantha J; Catto, James Wf; Downing, Amy; Bottomley, Sarah E; Glaser, Adam W; Wright, Penny

2018-05-03

Patient Reported Outcome Measures (PROMs) are important tools used to understand patient focused outcomes from care. Various PROMs have been developed for patients with Bladder Cancer (BC), although the disease's heterogeneity makes selection difficult. Accurate measurement of Health Related Quality of Life (HRQL) can only be achieved if the PROM chosen is 'fit for purpose' (i.e. psychometrically sound). Systematic reviews of psychometric properties are useful for selecting the best PROM for a specific purpose. The COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) developed a checklist to improve the selection of health measurement instruments as part of a review process. Our aims were to undertake a systematic review, using the COSMIN criteria, to assess the quality of studies that report the psychometric properties of PROMs used with people with BC and determine the psychometric quality of these PROMs. An electronic search of seven databases including PubMed, MEDLINE and EMBASE (PROSPERO reference CRD42016051974) was undertaken to identify English language publications, published between January 1990 and September 2017 that evaluated psychometric properties of PROMs used in BC research. Two researchers independently screened abstracts and selected full text papers. Studies were rated on methodological quality using the COSMIN checklist. Overall, 4,663 records were screened and 23 studies, reporting outcomes in 3,568 patients, were evaluated using the COSMIN checklist. Most PROMs had limited information reported about their psychometric properties. Studies reporting on the Bladder Cancer Index (BCI) and Functional Assessment of Cancer Therapy Vanderbilt Cystectomy Index (FACT-VCI) provided the most detail and these PROMs could be evaluated on the most COSMIN properties. Based on the available evidence, no existing PROM stands out as the most appropriate to measure HRQL in BC populations. This is due to two factors; (i) the heterogeneity of BC and its treatments (ii) no PROM was evaluated on all COSMIN measurement properties due to a lack of validation studies. We suggest future evaluation of generic, cancer generic and BC specific PROMs to better understand their application with BC populations and propose strategies to help clinicians and researchers. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

[Evaluation of the factorial and metric equivalence of the Sexual Assertiveness Scale (SAS) by sex].

PubMed

Sierra, Juan Carlos; Santos-Iglesias, Pablo; Vallejo-Medina, Pablo

2012-05-01

Sexual assertiveness refers to the ability to initiate sexual activity, refuse unwanted sexual activity, and use contraceptive methods to avoid sexually transmitted diseases, developing healthy sexual behaviors. The Sexual Assertiveness Scale (SAS) assesses these three dimensions. The purpose of this study is to evaluate, using structural equation modeling and differential item functioning, the equivalence of the scale between men and women. Standard scores are also provided. A total of 4,034 participants from 21 Spanish provinces took part in the study. Quota sampling method was used. Results indicate a strict equivalent dimensionality of the Sexual Assertiveness Scale across sexes. One item was flagged by differential item functioning, although it does not affect the scale. Therefore, there is no significant bias in the scale when comparing across sexes. Standard scores show similar Initiation assertiveness scores for men and women, and higher scores on Refusal and Sexually Transmitted Disease Prevention for women. This scale can be used on men and women with sufficient psychometric guarantees.

Caregiving demands in parents of children with cancer: psychometric validation of the Care of My Child with Cancer questionnaire.

PubMed

Klassen, Anne; Klaassen, Robert J; Dix, David; Pritchard, Sheila; Yanofsky, Rochelle; Sung, Lillian

2010-08-01

A comprehensive evaluation of the psychometric properties of Care of My Child With Cancer (CMCC) was performed in a sample of 411 parents of children undergoing treatment of cancer at five Canadian pediatric oncology centers. Psychometric tests used to assess data quality, targeting, reliability, and construct validity demonstrated that the CMCC is a scientific sound measure. The CMCC will be helpful for assessing increasing parental responsibility for caregiving tasks associated with cancer care. Copyright 2010 Elsevier Inc. All rights reserved.

Extension of the Contingency Naming Test to adult assessment: psychometric analysis in a college student sample.

PubMed

Riddle, Tara; Suhr, Julie

2012-01-01

The Contingency Naming Test (CNT; Taylor, Albo, Phebus, Sachs, & Bierl, 1987) was initially designed to assess aspects of executive functioning, such as processing speed and response inhibition, in children. The measure has shown initial utility in identifying differences in executive function among child clinical groups; however, there is an absence of adequate psychometric data for use with adults. The current study expanded psychometric data upward for use with a college student sample and explored the measure's test-retest reliability and factor structure. Performance in the adult sample showed continued improvement above child norms, consistent with theories of executive function development. Exploratory factor analysis showed that the CNT is most closely related to measures of processing speed, as well as elements of response inhibition within the latter trials. Overall, results from the current study provide added support for the utility of the CNT as a measure of executive functioning in young adults. However, more research is needed to determine patterns of performance among adult clinical groups, as well as to better understand how performance patterns may change in a broader age range, including middle and older adulthood.

Confirmatory Factor Analysis of the System for Evaluation of Teaching Qualities (SETQ) in Graduate Medical Training.

PubMed

Boerebach, Benjamin C M; Lombarts, Kiki M J M H; Arah, Onyebuchi A

2016-03-01

The System for Evaluation of Teaching Qualities (SETQ) was developed as a formative system for the continuous evaluation and development of physicians' teaching performance in graduate medical training. It has been seven years since the introduction and initial exploratory psychometric analysis of the SETQ questionnaires. This study investigates the validity and reliability of the SETQ questionnaires across hospitals and medical specialties using confirmatory factor analyses (CFAs), reliability analysis, and generalizability analysis. The SETQ questionnaires were tested in a sample of 3,025 physicians and 2,848 trainees in 46 hospitals. The CFA revealed acceptable fit of the data to the previously identified five-factor model. The high internal consistency estimates suggest satisfactory reliability of the subscales. These results provide robust evidence for the validity and reliability of the SETQ questionnaires for evaluating physicians' teaching performance. © The Author(s) 2014.

Evaluation of the psychometric properties of the Pediatric Parenting Stress Inventory (PPSI).

PubMed

Devine, Katie A; Heckler, Charles E; Katz, Ernest R; Fairclough, Diane L; Phipps, Sean; Sherman-Bien, Sandra; Dolgin, Michael J; Noll, Robert B; Askins, Martha A; Butler, Robert W; Sahler, Olle Jane Z

2014-02-01

This work evaluated the psychometric properties of the Pediatric Parenting Stress Inventory (PPSI), a new measure of problems and distress experienced by parents of children with chronic illnesses. This secondary data analysis used baseline data from 1 sample of English-, Spanish-, and Hebrew-speaking mothers of children recently diagnosed with cancer (n = 449) and 1 sample of English- and Spanish-speaking mothers of children recently diagnosed with cancer (n = 399) who participated in 2 problem-solving skills training interventions. The PPSI was administered at baseline with other measures of maternal distress. Factor structure was evaluated using exploratory factor analysis (EFA) on the first sample and confirmatory factor analysis (CFA) on both samples. Internal consistency was evaluated using Cronbach's alpha. Construct validity was assessed via Spearman correlations with measures of maternal distress. EFA resulted in a stable four-factor solution with 35 items. CFA indicated that the four-factor solution demonstrated reasonable fit in both samples. Internal consistency of the subscales and full scale was adequate to excellent. Construct validity was supported by moderate to strong correlations with measures of maternal distress, depression, and posttraumatic stress symptoms. The PPSI demonstrated good psychometric properties in assessing current problems and distress experienced by mothers of children newly diagnosed with cancer. This tool may be used to identify individualized targets for intervention in families of children with cancer. Future studies could evaluate the utility and psychometrics of the PPSI with other pediatric populations. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Bringing the real world to Psychometric Evaluation of Cervical Cancer Literacy Assessments with Black, Latina, and Arab Women in Real World Settings

PubMed Central

Williams, Karen Patricia; Templin, Thomas N.

2013-01-01

Objective This research describes the development and evaluation of a new scale for assessing functional cervical cancer health literacy, the Cervical Cancer Literacy Assessment Tool (C-CLAT). Methods In Phase 1, 35 items in English, Spanish and Arabic, for C-CLAT were generated, taking into account three content domains-Awareness, Knowledge, and Prevention/Control. After content validation, 24 items were retained for psychometric evaluation. In Phase 2, the 24-item C-CLAT was evaluated in three racial/ethnic populations of urban women (N =543). Psychometric methods included item analysis, multifactor Item Response Theory modeling, and concurrent correlations. Results The final C-CLAT consisted of 16 items, with an internal consistency reliability of .72. C-CLAT reliabilities in Black, Latina, and Arab women were .73, .76, and .60, respectively. The rank order correlations of item difficulties across racial/ethnic groups was high (r’s = .97 to .98). The C-CLAT was positively related to educational level, and Arab women scored significantly higher than the Black and Latina participants. Conclusions This study presents a psychometrically sound instrument that measures health literacy related to cervical cancer. Practice Implications The C-CLAT is a tool that can be orally administered by a lay person and used in a community-based health promotion intervention. PMID:24072456

Content Validity and Psychometric Characteristics of the "Knowledge about Older Patients Quiz" for Nurses Using Item Response Theory.

PubMed

Dikken, Jeroen; Hoogerduijn, Jita G; Kruitwagen, Cas; Schuurmans, Marieke J

2016-11-01

To assess the content validity and psychometric characteristics of the Knowledge about Older Patients Quiz (KOP-Q), which measures nurses' knowledge regarding older hospitalized adults and their certainty regarding this knowledge. Cross-sectional. Content validity: general hospitals. Psychometric characteristics: nursing school and general hospitals in the Netherlands. Content validity: 12 nurse specialists in geriatrics. Psychometric characteristics: 107 first-year and 78 final-year bachelor of nursing students, 148 registered nurses, and 20 nurse specialists in geriatrics. Content validity: The nurse specialists rated each item of the initial KOP-Q (52 items) on relevance. Ratings were used to calculate Item-Content Validity Index and average Scale-Content Validity Index (S-CVI/ave) scores. Items with insufficient content validity were removed. Psychometric characteristics: Ratings of students, nurses, and nurse specialists were used to test for different item functioning (DIF) and unidimensionality before item characteristics (discrimination and difficulty) were examined using Item Response Theory. Finally, norm references were calculated and nomological validity was assessed. Content validity: Forty-three items remained after assessing content validity (S-CVI/ave = 0.90). Psychometric characteristics: Of the 43 items, two demonstrating ceiling effects and 11 distorting ability estimates (DIF) were subsequently excluded. Item characteristics were assessed for the remaining 30 items, all of which demonstrated good discrimination and difficulty parameters. Knowledge was positively correlated with certainty about this knowledge. The final 30-item KOP-Q is a valid, psychometrically sound, comprehensive instrument that can be used to assess the knowledge of nursing students, hospital nurses, and nurse specialists in geriatrics regarding older hospitalized adults. It can identify knowledge and certainty deficits for research purposes or serve as a tool in educational or quality improvement programs. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

Cross- cultural validation of the Brazilian Portuguese version of the Social Phobia Inventory (SPIN): study of the items and internal consistency.

PubMed

Osório, Flávia de Lima; Crippa, José Alexandre S; Loureiro, Sonia Regina

2009-03-01

The objective of the present study was to carry out the cross- cultural validation for Brazilian Portuguese of the Social Phobia Inventory, an instrument for the evaluation of fear, avoidance and physiological symptoms associated with social anxiety disorder. The process of translation and adaptation involved four bilingual professionals, appreciation and approval of the back- translation by the authors of the original scale, a pilot study with 30 Brazilian university students, and appreciation by raters who confirmed the face validity of the Portuguese version, which was named ' Inventário de Fobia Social' . As part of the psychometric study of the Social Phobia Inventory, analysis of the items and evaluation of the internal consistency of the instrument were performed in a study conducted on 2314 university students. The results demonstrated that item 11, related to the fear of public speaking, was the most frequently scored item. The correlation of the items with the total score was quite adequate, ranging from 0.44 to 0.71, as was the internal consistency, which ranged from 0.71 to 0.90. The authors conclude that the Brazilian Portuguese version of the Social Phobia Inventory proved to be adequate regarding the psychometric properties initially studied, with qualities quite close to those of the original study. Studies that will evaluate the remaining indicators of validity of the Social Phobia Inventory in clinical and non-clinical samples are considered to be opportune and necessary.

Development and psychometric evaluation of the Dialysis patient-perceived Exercise Benefits and Barriers Scale.

PubMed

Zheng, Jing; You, Li-Ming; Lou, Tan-Qi; Chen, Nian-Chang; Lai, De-Yuan; Liang, Yan-Yi; Li, Ying-Na; Gu, Ying-Ming; Lv, Shao-Fen; Zhai, Cui-Qiu

2010-02-01

Perceptions of exercise benefits and barriers affect exercise behavior. Because of the clinical course and treatment, dialysis patients differ from the general population in their perceptions of exercise benefits and barriers, especially the latter. At present, no valid instruments for assessing perceived exercise benefits and barriers in dialysis patients are available. Our goal was to develop and test the psychometric properties of the Dialysis patient-perceived Exercise Benefits and Barriers Scale (DPEBBS). A literature review and two focus groups were conducted to generate the initial item pool. An expert panel examined the content validity. Then, 269 Chinese hemodialysis patients were recruited by convenience sampling. Exploratory and confirmatory factor analyses were used to test construct validity. Finally, internal consistency and test-retest reliability were assessed. The expert panel determined that the content validity index was satisfactory. The final 24-item scale consisted of six factors explaining 57% of the total variance in the data. Confirmative factor analysis supported the six-factor structure and a higher-order model. Cronbach's alpha was 0.87 for the total scale, and 0.84 for test-retest reliability. The DPEBBS was a valid and reliable instrument for evaluating dialysis patients' perceived benefits and barriers to exercise. The application value of this scale remains to be investigated by increasing the sample size and evaluating patients undergoing different dialysis modalities and coming from different regions and cultural backgrounds. Copyright 2009 Elsevier Ltd. All rights reserved.

The Culturally Responsive Classroom Management Self-Efficacy Scale: Development and Initial Validation

ERIC Educational Resources Information Center

Siwatu, Kamau Oginga; Putman, S. Michael; Starker-Glass, Tehia V.; Lewis, Chance W.

2017-01-01

This article reports on the development and initial validation of the Culturally Responsive Classroom Management Self-Efficacy Scale. Data from 380 preservice and inservice teachers were used to examine the psychometric properties of the instrument. Exploratory factor analysis results suggested a one-factor structure consisting of 35 items and the…

Social, Attitudinal, and Demographic Correlates of Adolescent vs College-Age Tobacco Use Initiation

ERIC Educational Resources Information Center

Stockdale, Margaret S.; Dawson-Owens, Hayley L.; Sagrestano, Lynda M.

2005-01-01

Objective: To examine associations between social influences and smoking-related attitudes and age of cigarette use initiation among college students. Methods: Responses from 3 campus surveys (2 random, 1 convenience) were analyzed. The surveys were modeled from existing state or national tobacco surveys and other psychometrically valid surveys.…

Development and Initial Validation of the Intimate Violence Responsibility Scale (IVRS)

ERIC Educational Resources Information Center

Yun, Sung Hyun; Vonk, M. Elizabeth

2011-01-01

The present study demonstrates the development and initial examination of psychometric properties of the Intimate Violence Responsibility Scale (IVRS) in a community-based sample (N = 527). The underlying factor structure of the IVRS was tested by the exploratory factor analysis (Principal Axis Factoring), which identifies the four factors:…

Development of an item bank for computerized adaptive test (CAT) measurement of pain.

PubMed

Petersen, Morten Aa; Aaronson, Neil K; Chie, Wei-Chu; Conroy, Thierry; Costantini, Anna; Hammerlid, Eva; Hjermstad, Marianne J; Kaasa, Stein; Loge, Jon H; Velikova, Galina; Young, Teresa; Groenvold, Mogens

2016-01-01

Patient-reported outcomes should ideally be adapted to the individual patient while maintaining comparability of scores across patients. This is achievable using computerized adaptive testing (CAT). The aim here was to develop an item bank for CAT measurement of the pain domain as measured by the EORTC QLQ-C30 questionnaire. The development process consisted of four steps: (1) literature search, (2) formulation of new items and expert evaluations, (3) pretesting and (4) field-testing and psychometric analyses for the final selection of items. In step 1, we identified 337 pain items from the literature. Twenty-nine new items fitting the QLQ-C30 item style were formulated in step 2 that were reduced to 26 items by expert evaluations. Based on interviews with 31 patients from Denmark, France and the UK, the list was further reduced to 21 items in step 3. In phase 4, responses were obtained from 1103 cancer patients from five countries. Psychometric evaluations showed that 16 items could be retained in a unidimensional item bank. Evaluations indicated that use of the CAT measure may reduce sample size requirements with 15-25% compared to using the QLQ-C30 pain scale. We have established an item bank of 16 items suitable for CAT measurement of pain. While being backward compatible with the QLQ-C30, the new item bank will significantly improve measurement precision of pain. We recommend initiating CAT measurement by screening for pain using the two original QLQ-C30 pain items. The EORTC pain CAT is currently available for "experimental" purposes.

Adaptation and Psychometric Evaluation of a Resilience Measure in Greek Elementary School Students

ERIC Educational Resources Information Center

Nearchou, Finiki A.; Stogiannidou, Ariadni; Kiosseoglou, Grigoris

2014-01-01

This study aimed to adapt the Resilience Youth Development Module (RYDM) and assess its psychometric properties in terms of internal consistency and convergent validity in Greek elementary students. Participants (N = 346) completed a battery of self-report questionnaires, including the RYDM, School Connectedness Scale, and Strengths and…

Psychometric Properties of the Schedule for Nonadaptive and Adaptive Personality in a PTSD Sample

ERIC Educational Resources Information Center

Wolf, Erika J.; Harrington, Kelly M.; Miller, Mark W.

2011-01-01

This study evaluated the psychometric characteristics of the Schedule for Nonadaptive and Adaptive Personality (SNAP; Clark, 1996) in 280 individuals who screened positive for posttraumatic stress disorder (PTSD). The SNAP validity, trait, temperament, and personality disorder (PD) scales were compared with scales on the Brief Form of the…

Psychometric Evaluation of the Exercise Identity Scale among Greek Adults and Cross-Cultural Validity

ERIC Educational Resources Information Center

Vlachopoulos, Symeon P.; Kaperoni, Maria; Moustaka, Frederiki C.; Anderson, Dean F.

2008-01-01

The present study reported on translating the Exercise Identity Scale (EIS: Anderson & Cychosz, 1994) into Greek and examining its psychometric properties and cross-cultural validity based on U.S. individuals' EIS responses. Using four samples comprising 33, 103, and 647 Greek individuals, including exercisers and nonexercisers, and a similar…

A Psychometric Analysis of the Ottawa Self-Injury Inventory-F

ERIC Educational Resources Information Center

Brown, Joshua Travis; Volk, Fred; Gearhart, Gabrielle L.

2018-01-01

Objective: This study seeks to evaluate the psychometric properties of the Ottawa Self-Injury Inventory-Functions (OSI-F) for assessing nonsuicidal self-injury (NSSI), a condition for further study in the DSM-5. Participants: Participants included 345 students who indicated a history of self-injury in a university counseling center over six…

Psychometric Assessment of the Mindful Attention Awareness Scale (MAAS) among Chinese Adolescents

ERIC Educational Resources Information Center

Black, David S.; Sussman, Steve; Johnson, C. Anderson; Milam, Joel

2012-01-01

The Mindful Attention Awareness Scale (MAAS) has the longest empirical track record as a valid measure of trait mindfulness. Most of what is understood about trait mindfulness comes from administering the MAAS to relatively homogenous samples of Caucasian adults. This study rigorously evaluates the psychometric properties of the MAAS among Chinese…

Development and Psychometric Evaluation of the Independent School Teacher Development Inventory

ERIC Educational Resources Information Center

Murray, John M.

2012-01-01

In this study the author examined the psychometrics of an instrument, the Independent School Teacher Development Inventory, designed to assess the professional learning opportunities in U.S. independent schools. The inventory was sent to 3,422 independent school administrators and of these, 2,474 returned completed surveys. Exploratory factor…

Psychometric Qualities of the German Version of the Posttraumatic Diagnostic Scale (PTDS)

ERIC Educational Resources Information Center

Griesel, Dorothee; Wessa, Michele; Flor, Herta

2006-01-01

In the present study, the psychometric properties of the German version of the Posttraumatic Diagnostic Scale (PTDS; A. Ehlers, R. Steil, H. Winter, & E. B. Foa, 1996) were evaluated in a sample of 143 trauma survivors. To investigate convergent and discriminant validity of this questionnaire, the authors assessed posttraumatic stress disorder…

Psychometric Properties of the Teacher-Reported Motor Skills Rating Scale

ERIC Educational Resources Information Center

Kim, Helyn; Murrah, William M.; Cameron, Claire E.; Brock, Laura L.; Cottone, Elizabeth A.; Grissmer, David

2015-01-01

Children's early motor competence is associated with social development and academic achievement. However, few studies have examined teacher reports of children's motor skills. This study evaluated the psychometric properties of the Motor Skills Rating Scale (MSRS), a 19-item measure of children's teacher-reported motor skills in the classroom.…

Psychometric Properties of an Arabic Version of the Depression Anxiety Stress Scales (DASS)

ERIC Educational Resources Information Center

Moussa, Miriam Taouk; Lovibond, Peter; Laube, Roy; Megahead, Hamido A.

2017-01-01

Objective: To translate and evaluate the psychometric properties of an Arabic-language version of the Depression Anxiety Stress Scales (DASS). Method: The items were translated, back translated, refined, and tested in an Australian immigrant sample (N = 220). Results: Confirmatory factor analysis showed that the Arabic DASS discriminates between…

Psychometric Properties of Scores from the Web-based LibQUAL+ Study of Perceptions of Library Service Quality.

ERIC Educational Resources Information Center

Cook, Colleen; Thompson, Bruce

2001-01-01

Investigated the psychometric integrity of scores from the LibQUAL+ evaluation of perceived library service quality conducted by ARL (Association of Research Libraries). Examines score structure, score reliability, score correlation and concurrent validity coefficients, scale means, and scale standardized norms, and considers the potential of the…

New Reliability and Validity Evidence of the Emotional Intelligence Scale

ERIC Educational Resources Information Center

Zhoc, Karen C. H.; Li, Johnson C. H.; Webster, Beverley J.

2017-01-01

Emotional Intelligence Scale (EIS) is a popular EI measure. Yet, it has been criticized for an unclear factor structure, and its psychometric properties were mainly examined in the Western context. This study was to evaluate its psychometric properties based on 1,724 Hong Kong undergraduate students, including its (a) factor structure, (b)…

Psychometric Evaluation of the Italian Adaptation of the Test of Inferential and Creative Thinking

ERIC Educational Resources Information Center

Faraci, Palmira; Hell, Benedikt; Schuler, Heinz

2016-01-01

This article describes the psychometric properties of the Italian adaptation of the "Analyse des Schlussfolgernden und Kreativen Denkens" (ASK; Test of Inferential and Creative Thinking) for measuring inferential and creative thinking. The study aimed to (a) supply evidence for the factorial structure of the instrument, (b) describe its…

A Psychometric Evaluation of the CDRS and MADRS in Assessing Depressive Symptoms in Children

ERIC Educational Resources Information Center

Jain, Shailesh; Carmody, Thomas J.; Trivedi, Madhukar H.; Hughes, Carroll; Bernstein, Ira H.; Morris, David W.; Emslie, Graham J.; Rush, A. John

2007-01-01

Objective: This study compared the psychometric properties of the Children's Depression Rating Scale-Revised (CDRS-R) and the Montgomery-Asberg Depression Rating Scale (MADRS) in children with major depressive disorder. Method: Children (N = 96; ages 8 to 11 years inclusive) with nonpsychotic major depressive disorder were enrolled. Participants…

The Yale Craving Scale: Development and psychometric properties.

PubMed

Rojewski, Alana M; Morean, Meghan E; Toll, Benjamin A; McKee, Sherry A; Krishnan-Sarin, Suchitra; Green, Barry G; Bartoshuk, Linda M; O'Malley, Stephanie S

2015-09-01

The current study presents a psychometric evaluation of the Yale Craving Scale (YCS), a novel measure of craving for cigarettes and alcohol, respectively. The YCS is the first craving measure to use a generalized Labeled Magnitude Scale (gLMS) as the scoring format, which facilitates between-group comparisons of subjective craving and eliminates ceiling effects by assessing the full range of imaginable sensation intensities. Psychometric evaluations of the YCS for use with cigarettes (YCS Smoking) and alcohol (YCS Drinking) included assessments of latent factor structure, internal consistency, ceiling effects, and test-criterion relationships. Study samples included 493 treatment-seeking smokers and 213 heavy drinkers. Factor analyses of the 5-item YCS Smoking and Drinking scores confirmed a 1-factor scale. The YCS Smoking and Drinking scores evidenced: (1) good internal consistency, (2) scalar measurement invariance within several subgroups (e.g., smoking/drinking status; nicotine/alcohol dependence), (3) convergent relationships with extant craving measures, and (4) concurrent relationships with smoking/drinking outcomes. These results suggest that the YCS represents a psychometrically sound scale for assessing smoking and drinking urges in dependent populations. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

A psychometric evaluation of the four-item version of the Control Attitudes Scale for patients with cardiac disease and their partners.

PubMed

Årestedt, Kristofer; Ågren, Susanna; Flemme, Inger; Moser, Debra K; Strömberg, Anna

2015-08-01

The four-item Control Attitudes Scale (CAS) was developed to measure control perceived by patients with cardiac disease and their family members, but extensive psychometric evaluation has not been performed. The aim was to translate, culturally adapt and psychometrically evaluate the CAS in a Swedish sample of implantable cardioverter defibrillator (ICD) recipients, heart failure (HF) patients and their partners. A sample (n=391) of ICD recipients, HF patients and partners were used. Descriptive statistics, item-total and inter-item correlations, exploratory factor analysis, ordinal regression modelling and Cronbach's alpha were used to validate the CAS. The findings from the factor analyses revealed that the CAS is a multidimensional scale including two factors, Control and Helplessness. The internal consistency was satisfactory for all scales (α=0.74-0.85), except the family version total scale (α=0.62). No differential item functioning was detected which implies that the CAS can be used to make invariant comparisons between groups of different age and sex. The psychometric properties, together with the simple and short format of the CAS, make it to a useful tool for measuring perceived control among patients with cardiac diseases and their family members. When using the CAS, subscale scores should be preferred. © The European Society of Cardiology 2014.

Psychometrically Improved, Abbreviated Versions of Three Classic Measures of Impulsivity and Self-Control

PubMed Central

Morean, Meghan E.; DeMartini, Kelly S.; Leeman, Robert F.; Pearlson, Godfrey D.; Anticevic, Alan; Krishnan-Sarin, Suchitra; Krystal, John H.; O’Malley, Stephanie S.

2014-01-01

Self-reported impulsivity confers risk factor for substance abuse. However, the psychometric properties of many self-report impulsivity measures have been questioned, thereby undermining the interpretability of study findings using these measures. To better understand these measurement limitations and to suggest a path to assessing self-reported impulsivity with greater psychometric stability, we conducted a comprehensive psychometric evaluation of the Barratt Impulsiveness Scale-11 (BIS-11), the Behavioral Inhibition and Activation Scales (BIS/BAS), and the Brief Self Control Scale (BSCS) using data from 1,449 individuals who participated in substance use research. For each measure, we evaluated: 1) latent factor structure, 2) measurement invariance, 3) test-criterion relationships between the measures, and 4) test-criterion relations with drinking and smoking outcomes. Notably, we could not replicate the originally published latent structure for the BIS, BIS/BAS, or BSCS or any previously published alternative factor structures (English language). Using exploratory and confirmatory factor analysis, we identified psychometrically improved, abbreviated versions of each measure (i.e., 8-item, 2 factor BIS-11 [RMSEA = .06, CFI = .95]; 13-item, 4 factor BIS/BAS [RMSEA = .04, CFI = .96]; 7-item, 2 factor BSCS [RMSEA = .05, CFI = .96]). These versions evidenced: 1) stable, replicable factor structures, 2) scalar measurement invariance, ensuring our ability to make statistically interpretable comparisons across subgroups of interest (e.g., sex, race, drinking/smoking status), and 3) test-criterion relationships with each other and with drinking/smoking. This study provides strong support for using these psychometrically improved impulsivity measures, which improve data quality directly through better scale properties and indirectly through reducing response burden. PMID:24885848

Development and psychometric evaluation of the nursing instructors' clinical teaching performance inventory.

PubMed

A Farahani, Mansoureh; Emamzadeh Ghasemi, Hormat Sadat; Nikpaima, Nasrin; Fereidooni, Zhila; Rasoli, Maryam

2014-10-29

Evaluation of nursing instructors' clinical teaching performance is a prerequisite to the quality assurance of nursing education. One of the most common procedures for this purpose is using student evaluations. This study was to develop and evaluate the psychometric properties of Nursing Instructors' Clinical Teaching Performance Inventory (NICTPI). The primary items of the inventory were generated by reviewing the published literature and the existing questionnaires as well as consulting with the members of the Faculties Evaluation Committee of the study setting. Psychometric properties were assessed by calculating its content validity ratio and index, and test-retest correlation coefficient as well as conducting an exploratory factor analysis and an internal consistency assessment. The content validity ratios and indices of the items were respectively higher than 0.85 and 0.79. The final version of the inventory consisted of 25 items, and in the exploratory factor analysis, items were loaded on three factors which jointly accounting for 72.85% of the total variance. The test-retest correlation coefficient and the Cronbach's alpha of the inventory were 0.93 and 0.973, respectively. The results revealed that the developed inventory is an appropriate, valid, and reliable instrument for evaluating nursing instructors' clinical teaching performance.

Psychometric properties of the Penn State Worry Questionnaire for children in a large clinical sample.

PubMed

Pestle, Sarah L; Chorpita, Bruce F; Schiffman, Jason

2008-04-01

The Penn State Worry Questionnaire for Children (PSWQ-C; Chorpita, Tracey, Brown, Collica, & Barlow, 1997) is a 14-item self-report measure of worry in children and adolescents. Although the PSWQ-C has demonstrated favorable psychometric properties in small clinical and large community samples, this study represents the first psychometric evaluation of the PSWQ-C in a large clinical sample (N = 491). Factor analysis indicated a two-factor structure, in contrast to all previously published findings on the measure. The PSWQ-C demonstrated favorable psychometric properties in this sample, including high internal consistency, high convergent validity with related constructs, and acceptable discriminative validity between diagnostic categories. The performance of the 3 reverse-scored items was closely examined, and results indicated retaining all 14 items.

Adaptation and psychometric assessment of the Hebrew version of the Recovery Promoting Relationships Scale (RPRS).

PubMed

Moran, Galia S; Zisman-Ilani, Yaara; Garber-Epstein, Paula; Roe, David

2014-03-01

Recovery is supported by relationships that are characterized by human centeredness, empowerment and a hopeful approach. The Recovery Promoting Relationships Scale (RPRS; Russinova, Rogers, & Ellison, 2006) assesses consumer-provider relationships from the consumer perspective. Here we present the adaptation and psychometric assessment of a Hebrew version of the RPRS. The RPRS was translated to Hebrew (RPRS-Heb) using multiple strategies to assure conceptual soundness. Then 216 mental health consumers were administered the RPRS-Heb as part of a larger project initiative implementing illness management and recovery intervention (IMR) in community settings. Psychometric testing included assessment of the factor structure, reliability, and validity using the Hope Scale, the Working Alliance Inventory, and the Recovery Assessment Scale. The RPRS-Heb factor structure replicated the two factor structures found in the original scale with minor exceptions. Reliability estimates were good: Cronbach's alpha for the total scale was 0.94. An estimate of 0.93 for the Recovery-Promoting Strategies factor, and 0.86 for the Core Relationship. Concurrent validity was confirmed using the Working Alliance Scale (rp = .51, p < .001) and the Hope Scale (rp = .43, p < .001). Criterion validity was examined using the Recovery Assessment Scale (rp = .355, p < .05). The study yielded a 23-item RPRS-Heb version with a psychometrically sound factor structure, satisfactory reliability, and concurrent validity tested against the Hope, Alliance, and Recovery Assessment scales. Outcomes are discussed in the context of the original scale properties and a similar Dutch initiative. The RPRS-Heb can serve as a valuable tool for studying recovery promoting relationships with Hebrew speaking population.

Development and Initial Psychometric Assessment of the Plant Attitude Questionnaire

NASA Astrophysics Data System (ADS)

Fančovičová, Jana; Prokop, Pavol

2010-10-01

Plants are integral parts of ecosystems which determine life on Earth. People's attitudes toward them are however, largely overlooked. Here we present initial psychometric assessment of self-constructed Plant Attitude Scale (PAS) that was administered to a sample of 310 Slovakian students living in rural areas aged 10-15 years. The final version of PAS consists from 29 Likert-scale items that were loaded to four distinct dimensions (Interest, Importance, Urban trees and Utilization). Mean scores revealed that Slovakian students lack positive attitudes toward plants and that gender had no effect on their mean attitude scores. Living in a family with a garden was associated with a more positive attitude toward plants. Further correlative research on diverse samples containing urban children and experimental research examining the impact of gardening in schools on student attitudes toward plants is required.

Construction and validation of a measure of integrative well-being in seven languages: the Pemberton Happiness Index.

PubMed

Hervás, Gonzalo; Vázquez, Carmelo

2013-04-22

We introduce the Pemberton Happiness Index (PHI), a new integrative measure of well-being in seven languages, detailing the validation process and presenting psychometric data. The scale includes eleven items related to different domains of remembered well-being (general, hedonic, eudaimonic, and social well-being) and ten items related to experienced well-being (i.e., positive and negative emotional events that possibly happened the day before); the sum of these items produces a combined well-being index. A distinctive characteristic of this study is that to construct the scale, an initial pool of items, covering the remembered and experienced well-being domains, were subjected to a complete selection and validation process. These items were based on widely used scales (e.g., PANAS, Satisfaction With Life Scale, Subjective Happiness Scale, and Psychological Well-Being Scales). Both the initial items and reference scales were translated into seven languages and completed via Internet by participants (N = 4,052) aged 16 to 60 years from nine countries (Germany, India, Japan, Mexico, Russia, Spain, Sweden, Turkey, and USA). Results from this initial validation study provided very good support for the psychometric properties of the PHI (i.e., internal consistency, a single-factor structure, and convergent and incremental validity). Given the PHI's good psychometric properties, this simple and integrative index could be used as an instrument to monitor changes in well-being. We discuss the utility of this integrative index to explore well-being in individuals and communities.

Systematic review of self-concept measures for primary school aged children with cerebral palsy.

PubMed

Cheong, Sau Kuan; Johnston, Leanne M

2013-10-01

This study involved a systematic review aimed to identify self-concept measures that provided published psychometrics for primary school aged children (8-12 years) with cerebral palsy (CP). Six electronic databases (PubMed, MEDLINE, CINAHL, PsycINFO, PsycARTICLES and Web of Science) were searched to identify assessments that (1) measured self-concept; (2) in children aged 8-12 years; (3) with CP; (4) with psychometrics available. The Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) checklist was used to evaluate psychometric properties and the CanChild Outcome Measure Rating Form was used to evaluate clinical utility. Search yielded 271 papers, of which five met inclusion criteria. These papers reported five measures of self-concept with psychometric properties for the target population: the Rosenberg Self-Esteem Index, Self-Description Questionnaire-I, Self-Perception Profile for Children (original) and two separate modifications of the Self-Perception Profile for Children. Currently, no self-concept measures published in English had sufficient psychometric data for children with CP. The Self-Description Questionnaire-I and the Self-Perception Profile for Children were promising options. Further research is required (a) to determine self-concept construct components important for children with CP and (b) to examine the relative strength, validity, reliability and clinical utility of self-concept measures for the target population. Copyright © 2013 Elsevier Ltd. All rights reserved.

The Drug Effects Questionnaire: Psychometric Support across Three Drug Types

PubMed Central

Morean, Meghan E.; de Wit, Harriet; King, Andrea C.; Sofuoglu, Mehmet; Rueger, Sandra Y.; O’Malley, Stephanie S.

2013-01-01

Rationale The Drug Effects Questionnaire (DEQ) is widely used in studies of acute subjective response (SR) to a variety of substances, but the format of the DEQ varies widely across studies, and details of its psychometric properties are lacking. Thus, the field would benefit from demonstrating the reliability and validity of the DEQ for use across multiple substances. Objective The current study evaluated the psychometric properties of several variations of DEQ items, which assessed the extent to which participants (1) feel any substance effect(s), (2) feel high, (3) like the effects, (4) dislike the effects, and (5) want more of the substance using 100mm Visual Analog Scales. Methods DEQ data from three placebo-controlled studies were analyzed to examine SR to amphetamine, nicotine, and alcohol. We evaluated the internal structure of the DEQ for use with each substance as well as relationships between scale items, measures of similar constructs, and substance-related behaviors. Results Results provided preliminary psychometric support for items assessing each DEQ construct (FEEL, HIGH, DISLIKE, LIKE, and MORE). Conclusions Based on the study results, we identify several common limitations of extant variants of the DEQ and recommend an improved version of the measure. The simplicity and brevity of the DEQ combined with its promising psychometric properties support its use in future SR research across a variety of substances. PMID:23271193

Development and psychometric evaluation of the Professional Practice Environment (PPE) scale.

PubMed

Erickson, Jeanette Ives; Duffy, Mary E; Gibbons, M Patricia; Fitzmaurice, Joan; Ditomassi, Marianne; Jones, Dorothy

2004-01-01

To describe the Professional Practice Environment (PPE) scale, its conceptual development and psychometric evaluation, and its uses in measuring eight characteristics of the professional practice environment in an acute care setting. The 38-item PPE Scale was validated on a sample of 849 professional practice staff at the Massachusetts General Hospital in Boston. Psychometric analysis included: item analysis, principal components analysis (PCA) with varimax rotation and Kaiser normalization, and internal consistency reliability using Cronbach's alpha coefficient. Eight components were shown, confirming the original conceptually derived model's structure and accounting for 61% of explained variance. Cronbach's alpha coefficients for the eight PPE subscales ranged from .78 to .88. Findings showed the 38-item PPE Scale was reliable and valid for use in health outcomes research to examine the professional practice environment of staff working in acute care settings.

A mixed methods approach to adapting health-related quality of life measures for use in routine oncology clinical practice.

PubMed

Harley, Clare; Takeuchi, Elena; Taylor, Sally; Keding, Ada; Absolom, Kate; Brown, Julia; Velikova, Galina

2012-04-01

The current study reviewed and adapted existing health-related quality of life (HRQoL) instruments for use in routine clinical practice delivering outpatient chemotherapy for colorectal, breast and gynaecological cancers. 564 (288 gynaecological, 208 breast and 68 colorectal) outpatient consultations of 141 patients were audio-recorded and analysed to identify discussed issues. Issues were ranked from most to least commonly discussed within each disease group. Existing HRQoL instruments were evaluated against these lists and best fitting items entered into cancer-specific item banks. Item banks were evaluated during semi-structured interviews by twenty-one oncologists (13 consultants and 8 specialist registrars), four clinical nurse specialists and thirty patients, from breast, gynaecological and colorectal cancer practices. Pilot questionnaires were completed by 448 (145 breast, 148 gynaecological and 155 colorectal) patients attending outpatient clinics. Item selection and scale reliability was explored using descriptive data and psychometric methods alongside qualitative patient and clinician ratings. Each questionnaire includes five physical and three psychosocial function scales each with good internal consistency reliability (α > 0.70) plus disease-specific individual-symptom items identified as useful in clinical practice. Three cancer-specific health-related quality of life measures were developed for use in routine clinical practice. Initial analyses suggest good clinical utility and acceptable psychometric properties for the new instruments.

Development and evaluation of the Internalized Racism in Asian Americans Scale (IRAAS).

PubMed

Choi, Andrew Young; Israel, Tania; Maeda, Hotaka

2017-01-01

This article presents the development and psychometric evaluation of the Internalized Racism in Asian Americans Scale (IRAAS), which was designed to measure the degree to which Asian Americans internalized hostile attitudes and negative messages targeted toward their racial identity. Items were developed on basis of prior literature, vetted through expert feedback and cognitive interviews, and administered to 655 Asian American participants through Amazon Mechanical Turk. Exploratory factor analysis with a random subsample (n = 324) yielded a psychometrically robust preliminary measurement model consisting of 3 factors: Self-Negativity, Weakness Stereotypes, and Appearance Bias. Confirmatory factor analysis with a separate subsample (n = 331) indicated that the proposed correlated factors model was strongly consistent with the observed data. Factor determinacies were high and demonstrated that the specified items adequately measured their intended factors. Bifactor modeling further indicated that this multidimensionality could be univocally represented for the purpose of measurement, including the use of a mean total score representing a single continuum of internalized racism on which individuals vary. The IRAAS statistically predicted depressive symptoms, and demonstrated statistically significant correlations in theoretically expected directions with four dimensions of collective self-esteem. These results provide initial validity evidence supporting the use of the IRAAS to measure aspects of internalized racism in this population. Limitations and research implications are discussed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Child's Challenging Behaviour Scale, Version 2 (CCBS-2): Psychometric Evaluation With Young Children.

PubMed

Bourke-Taylor, Helen; Pallant, Julie; Cordier, Reinie

In this article, we evaluate psychometric properties of the Child's Challenging Behaviour Scale, Version 2 (CCBS-2) with mothers of young, typically developing children. A cross-sectional mail survey with Australian mothers (N = 337) included the CCBS-2, the Depression Anxiety Stress Scales, and the Parents' Evaluation of Developmental Status scale. Internal consistency was good, and no gender differences in CCBS-2 scores were significant. Significant results included differences between CCBS-2 scores: among children grouped according to age, among children grouped according to pre- and post-school entry, among mothers grouped according to extent of any symptom type, and between this sample and a previously collected age-matched sample of children with disabilities. Of the properties tested, results support sound psychometrics. The CCBS-2 can be used to differentiate children according to age, school entry, and disability as well as to identify families for potential services in behavior management and mental health. Copyright © 2017 by the American Occupational Therapy Association, Inc.

Psychometric Evaluation of the Malay Satisfaction with Life Scale

ERIC Educational Resources Information Center

Swami, Viren; Chamorro-Premuzic, Tomas

2009-01-01

The Satisfaction With Life Scale (SWLS) is one of the most widely used scales for the measurement of subjective well-being across the globe, but no satisfactory version exists for use among Malay-speaking populations. The present study reports on the translation of a new Malay SWLS and examines its psychometric properties in a community sample of…

The Reliability and Validity of a Progress-Monitoring Tool: A Psychometric Examination of the Phonological Awareness Skills of Preschoolers with ASD

ERIC Educational Resources Information Center

Martini, Jay R.

2017-01-01

The purpose of this study was to conduct a psychometric evaluation the "Sound Beginning" phonological awareness progress monitoring tool. This assessment was used to track emergent literacy skills of preschoolers with autism spectrum disorder who were participating in a randomized trial studying early literacy interventions. Research…

Psychometric Properties of the Chinese Version of the Social Responsiveness Scale

ERIC Educational Resources Information Center

Gau, Susan Shur-Fen; Liu, Li-Ting; Wu, Yu-Yu; Chiu, Yen-Nan; Tsai, Wen-Che

2013-01-01

This study evaluated the psychometric properties of the Chinese version of the Social Responsiveness Scale (Chinese SRS). We assessed 1419 grade 1 to grade 8 students from northern Taiwan and 401 clinic-based participants (aged 3-20, male 90.3%). All clinic-based participants were clinically diagnosed with autism spectrum disorders (ASDs),…

Item response modeling: A psychometric assessment of the children's fruit, vegetable, water, and physical activity self-efficacy scales among Chinese children

USDA-ARS?s Scientific Manuscript database

This study aimed to evaluate the psychometric properties of four self-efficacy scales (i.e., self-efficacy for fruit (FSE), vegetable (VSE), and water (WSE) intakes, and physical activity (PASE)) and to investigate their differences in item functioning across sex, age, and body weight status groups ...

Psychometrics of a Brief Measure of Emotional Self-Efficacy among Adolescents from the United States

ERIC Educational Resources Information Center

Valois, Robert F.; Zullig, Keith J.

2013-01-01

Background: Preliminary data were collected to evaluate the psychometric properties of an emotional self-efficacy (ESE) measure in a sample of 3836 public high school adolescents who completed the Centers for Disease Control and Prevention (CDC) Youth Risk Behavior Survey in South Carolina. Methods: Principal axis factor analysis was followed by a…

Psychometric Properties of the Volunteer Functions Inventory with Chinese Students

ERIC Educational Resources Information Center

Wu, Joseph; Lo, T. Wing; Liu, Elaine S. C.

2009-01-01

The authors report an evaluation of the psychometric properties of a Chinese version of the Volunteer Functions Inventory on a sample of university student volunteers. Reliabilities were high for four out of the six scales of the Inventory (Values, Career, Social, and Understanding) in terms of internal consistency. Items in these four scales also…

Psychometric Evaluation of the Chinese Version of the Existential Anxiety Questionnaire in a Sample of Chinese Adolescents Living in Hong Kong

ERIC Educational Resources Information Center

To, Siu-ming; Chan, Wallace Chi-ho

2016-01-01

Background: While Western academia has increasingly recognized the importance of studying existential anxiety among adolescents, psychometrically valid and reliable tools for measuring this construct remain unavailable in Chinese societies. Objective: This research investigated the empirical viability of the construct of existential anxiety in…

A Review of Standardized Tests of Nonverbal Oral and Speech Motor Performance in Children

ERIC Educational Resources Information Center

McCauley, Rebecca J.; Strand, Edythe A.

2008-01-01

Purpose: To review the content and psychometric characteristics of 6 published tests currently available to aid in the study, diagnosis, and treatment of motor speech disorders in children. Method: We compared the content of the 6 tests and critically evaluated the degree to which important psychometric characteristics support the tests' use for…

A Psychometric Evaluation of the Achievement Goal Questionnaire-Revised in Singapore Secondary Students

ERIC Educational Resources Information Center

Ning, Hoi Kwan

2017-01-01

This study examined the psychometric properties of the Achievement Goal Questionnaire-Revised (AGQ-R) in a sample of Singapore secondary students (N = 1,171). Confirmatory factor analyses provided support for the AGQ-R in measuring the four achievements goals delineated in the 2 × 2 framework. Measurement invariance across ethnic groups was…

School Bonding in Early Adolescence: Psychometrics of the Brief Survey of School Bonding

ERIC Educational Resources Information Center

Whiteside-Mansell, Leanne; Weber, Judith L.; Moore, Page C.; Johnson, Danya; Williams, Ed R.; Ward, Wendy L.; Robbins, James M.; Phillips, B. Allyson

2015-01-01

The comprehensive assessment of middle school student bonding is important for basic research and to evaluate interventions. In this study, the psychometric properties of three assessment tools found in the literature were examined individually and then combined to create a shorter survey. With minor modifications, the tools were found to be…

Psychometric Properties of the Disability Assessment Schedule (DAS) for Behavior Problems: An Independent Investigation

ERIC Educational Resources Information Center

Tsakanikos, Elias; Underwood, Lisa; Sturmey, Peter; Bouras, Nick; McCarthy, Jane

2011-01-01

The present study employed the Disability Assessment Schedule (DAS) to assess problem behaviors in a large sample of adults with ID (N = 568) and evaluate the psychometric properties of this instrument. Although the DAS problem behaviors were found to be internally consistent (Cronbach's [alpha] = 0.87), item analysis revealed one weak item…

Development and Psychometric Evaluation of the Yale-Brown Obsessive-Compulsive Scale--Second Edition

ERIC Educational Resources Information Center

Storch, Eric A.; Rasmussen, Steven A.; Price, Lawrence H.; Larson, Michael J.; Murphy, Tanya K.; Goodman, Wayne K.

2010-01-01

The Yale-Brown Obsessive-Compulsive Scale (Y-BOCS; Goodman, Price, Rasmussen, Mazure, Delgado, et al., 1989) is acknowledged as the gold standard measure of obsessive-compulsive disorder (OCD) symptom severity. A number of areas where the Y-BOCS may benefit from revision have emerged in past psychometric studies of the Severity Scale and Symptom…

Psychometric Properties of the Fatigue Severity Scale in Polio Survivors

ERIC Educational Resources Information Center

Burger, Helena; Franchignoni, Franco; Puzic, Natasa; Giordano, Andrea

2010-01-01

The objective of this study was to evaluate by means of classical test theory and Rasch analysis the scaling characteristics and psychometric properties of the Fatigue Severity Scale (FSS) in polio survivors. A questionnaire, consisting of five general questions (sex, age, age at time of acute polio, sequelae of polio, and new symptoms), the FSS,…

A Psychometric Evaluation of the SASSI-3 in a College Sample

ERIC Educational Resources Information Center

Laux, John M.; Salyers, Kathleen M.; Kotova, Ekaterina

2005-01-01

Although the Substance Abuse Subtle Screening Inventory-3 (SASSI-3; F. G. Miller & L. E. Lazowski, 1999) is widely used with college students (L. Myerholtz & H. Rosenberg, 1998), it is unclear whether the SASSI-3 is appropriate for use with this population. The authors investigated the SASSI-3's psychometric capabilities in a college student…

Development and psychometric evaluation of the urgency questionnaire for evaluating severity and health-related quality of life impact of urinary urgency in overactive bladder.

PubMed

Coyne, Karin S; Sexton, Chris C; Thompson, Christine; Bavendam, Tamara; Brubaker, Linda

2015-03-01

Urinary urgency is the cardinal symptom of overactive bladder (OAB). However, there is no single instrument that assesses the context, severity, intensity, and daily life impact of urinary urgency. The purpose of this manuscript is to describe the methods and results of the qualitative and quantitative research conducted to develop a new tool for this purpose, the Urgency Questionnaire (UQ). Qualitative data from interviews with patients with urinary urgency were used to develop and refine the items and response options of the UQ. Three studies were used to evaluate psychometric properties: a clinical trial of tolterodine (Detrol; n = 974); a psychometric validation study (n = 163); and a test-retest validation study (n = 47). Item and exploratory factor analysis (EFA) were performed to assess the subscale structure, and the psychometric performance of the resulting scales was evaluated. Fifteen Likert-scale items and four VAS questions were retained. A four-factor solution was shown to best fit the data, with the subscales: Impact on Daily Activities, Time to Control Urgency, Nocturia, and Fear of Incontinence. All subscales and VAS items demonstrated good reliability (Cronbach's α 0.79-0.94), convergent and discriminant validity, and responsiveness to change. The UQ differentiated between OAB patients and controls. The results provide quantitative evidence that urinary urgency, as assessed by the UQ, is a pathological sensation distinctive from the normal urge to void and suggest that the UQ might be a reliable, valid, and responsive instrument for evaluating the severity and HRQL impact of urinary urgency in OAB.

The School Counseling Program Implementation Survey: Initial Instrument Development and Exploratory Factor Analysis

ERIC Educational Resources Information Center

Clemens, Elysia V.; Carey, John C.; Harrington, Karen M.

2010-01-01

This article details the initial development of the School Counseling Program Implementation Survey and psychometric results including reliability and factor structure. An exploratory factor analysis revealed a three-factor model that accounted for 54% of the variance of the intercorrelation matrix and a two-factor model that accounted for 47% of…

Psychometric evaluation of the Chinese version of short-form Test of Functional Health Literacy in Adolescents.

PubMed

Chang, Li-Chun; Hsieh, Pei-Lin; Liu, Chieh-Hsing

2012-09-01

The purpose of this study is to develop and evaluate the psychometric properties of the Chinese version of short-form Test of Functional Health Literacy in Adolescents. Assessing health literacy is vital to design health education programme; however, there are no measurement tools exist for use specifically in Chinese adolescents. A non-experimental design was used to test the psychometric properties of the Test of Functional Health Literacy in Adolescents. The short-form Test of Functional Health Literacy in Adolescents was translated and back translated into a Chinese language version. Thirty high school students were recruited to validate the scenario of Test of Functional Health Literacy in Adolescents. Based on the multiple-stage stratified random sampling method, 300 high school students from four counties in Taiwan were invited to participate in this study to evaluate the psychometric properties of Test of Functional Health Literacy in Adolescents. The Functional Health Literacy in Adolescents had good internal consistency reliability and excellent test-retest reliability. Confirmatory factor analysis resulted in a one-factor solution. Contrary to the original version of the Test of Functional Health Literacy in Adolescents, the findings revealed that the 36-item, one-factor model for the Test of Functional Health Literacy in Adolescents is the best-fit model. This is a suitable instrument to assess health literacy levels in Chinese adolescents before health education programmes can be appropriately planned, implemented and evaluated. © 2012 Blackwell Publishing Ltd.

Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples.

PubMed

Petrillo, Jennifer; Cano, Stefan J; McLeod, Lori D; Coon, Cheryl D

2015-01-01

To provide comparisons and a worked example of item- and scale-level evaluations based on three psychometric methods used in patient-reported outcome development-classical test theory (CTT), item response theory (IRT), and Rasch measurement theory (RMT)-in an analysis of the National Eye Institute Visual Functioning Questionnaire (VFQ-25). Baseline VFQ-25 data from 240 participants with diabetic macular edema from a randomized, double-masked, multicenter clinical trial were used to evaluate the VFQ at the total score level. CTT, RMT, and IRT evaluations were conducted, and results were assessed in a head-to-head comparison. Results were similar across the three methods, with IRT and RMT providing more detailed diagnostic information on how to improve the scale. CTT led to the identification of two problematic items that threaten the validity of the overall scale score, sets of redundant items, and skewed response categories. IRT and RMT additionally identified poor fit for one item, many locally dependent items, poor targeting, and disordering of over half the response categories. Selection of a psychometric approach depends on many factors. Researchers should justify their evaluation method and consider the intended audience. If the instrument is being developed for descriptive purposes and on a restricted budget, a cursory examination of the CTT-based psychometric properties may be all that is possible. In a high-stakes situation, such as the development of a patient-reported outcome instrument for consideration in pharmaceutical labeling, however, a thorough psychometric evaluation including IRT or RMT should be considered, with final item-level decisions made on the basis of both quantitative and qualitative results. Copyright © 2015. Published by Elsevier Inc.

Estimating productivity costs in health economic evaluations: a review of instruments and psychometric evidence.

PubMed

Tang, Kenneth

2015-01-01

Health economic evaluations (i.e. cost-effectiveness appraisal of an intervention) are useful aids for decision makers responsible for the allocation of scarce healthcare resources. The relevance of including health-related productivity costs (or benefits) in these evaluations is increasingly recognized and, as such, reliable and valid instruments to quantify productivity costs are needed. Over the years, a number of work productivity instruments have emerged in the literature, along with a growing body of psychometric evidence. The overall aim of this paper is to provide a review of available instruments with potential for estimating health-related productivity costs. This included the Health and Labor Questionnaire, Health and Work Performance Questionnaire, Health-Related Productivity Questionnaire Diary, Productivity and Disease Questionnaire, Quantity and Quality method, Stanford Presenteeism Scale 13, Valuation of Lost Productivity, Work and Health Interview, Work Limitations Questionnaire, Work Productivity and Activity Impairment Questionnaire, and Work Productivity Short Inventory. Critical discussions on the instruments' overall strengths and limitations, applicability for health economic evaluations, as well as the methodological quality of existing psychometric evidence were provided. Lastly, a set of reflective questions were proposed for users to consider when selecting an instrument for health economic evaluations.

Methodologically Sound: Evaluating the Psychometric Approach to the Assessment of Human Life History [Reply to Copping, Campbell, and Muncer, 2014

PubMed Central

Cabeza de Baca, Tomás; Black, Candace Jasmine; García, Rafael Antonio; Fernandes, Heitor Barcellos Ferreira; Wolf, Pedro Sofio Abril; Woodley of Menie, Michael Anthony

2016-01-01

Copping, Campbell, and Muncer (2014) have recently published an article critical of the psychometric approach to the assessment of life history (LH) strategy. Their purported goal was testing for the convergent validation and examining the psychometric structure of the High-K Strategy Scale (HKSS). As much of the literature on the psychometrics of human LH during the past decade or so has emanated from our research laboratory and those of close collaborators, we have prepared this detailed response. Our response is organized into four main sections: (1) A review of psychometric methods for the assessment of human LH strategy, expounding upon the essence of our approach; (2) our theoretical/conceptual concerns regarding the critique, addressing the broader issues raised by the critique regarding the latent and hierarchical structure of LH strategy; (3) our statistical/methodological concerns regarding the critique, examining the validity and persuasiveness of the empirical case made specifically against the HKSS; and (4) our recommendations for future research that we think might be helpful in closing the gap between the psychometric and biometric approaches to measurement in this area. Clearly stating our theoretical positions, describing our existing body of work, and acknowledgintheir limitations should assist future researchers in planning and implementing more informed and prudent empirical research that will synthesize the psychometric approach to the assessment of LH strategy with complementary methods. PMID:25844774

Fitting psychometric functions using a fixed-slope parameter: an advanced alternative for estimating odor thresholds with data generated by ASTM E679.

PubMed

Peng, Mei; Jaeger, Sara R; Hautus, Michael J

2014-03-01

Psychometric functions are predominately used for estimating detection thresholds in vision and audition. However, the requirement of large data quantities for fitting psychometric functions (>30 replications) reduces their suitability in olfactory studies because olfactory response data are often limited (<4 replications) due to the susceptibility of human olfactory receptors to fatigue and adaptation. This article introduces a new method for fitting individual-judge psychometric functions to olfactory data obtained using the current standard protocol-American Society for Testing and Materials (ASTM) E679. The slope parameter of the individual-judge psychometric function is fixed to be the same as that of the group function; the same-shaped symmetrical sigmoid function is fitted only using the intercept. This study evaluated the proposed method by comparing it with 2 available methods. Comparison to conventional psychometric functions (fitted slope and intercept) indicated that the assumption of a fixed slope did not compromise precision of the threshold estimates. No systematic difference was obtained between the proposed method and the ASTM method in terms of group threshold estimates or threshold distributions, but there were changes in the rank, by threshold, of judges in the group. Overall, the fixed-slope psychometric function is recommended for obtaining relatively reliable individual threshold estimates when the quantity of data is limited.

Methodologically sound: Evaluating the psychometric approach to the assessment of human life history [reply to Copping, Campbell, and Muncer, 2014].

PubMed

Figueredo, Aurelio José; Cabeza de Baca, Tomás; Black, Candace Jasmine; García, Rafael Antonio; Fernandes, Heitor Barcellos Ferreira; Wolf, Pedro Sofio Abril; Woodley of Menie, Michael Anthony

2015-04-06

Copping, Campbell, and Muncer (2014) have recently published an article critical of the psychometric approach to the assessment of life history (LH) strategy. Their purported goal was testing for the convergent validation and examining the psychometric structure of the High-K Strategy Scale (HKSS). As much of the literature on the psychometrics of human LH during the past decade or so has emanated from our research laboratory and those of close collaborators, we have prepared this detailed response. Our response is organized into four main sections: (1) A review of psychometric methods for the assessment of human LH strategy, expounding upon the essence of our approach; (2) our theoretical/conceptual concerns regarding the critique, addressing the broader issues raised by the critique regarding the latent and hierarchical structure of LH strategy; (3) our statistical/methodological concerns regarding the critique, examining the validity and persuasiveness of the empirical case made specifically against the HKSS; and (4) our recommendations for future research that we think might be helpful in closing the gap between the psychometric and biometric approaches to measurement in this area. Clearly stating our theoretical positions, describing our existing body of work, and acknowledging their limitations should assist future researchers in planning and implementing more informed and prudent empirical research that will synthesize the psychometric approach to the assessment of LH strategy with complementary methods.

Conceptualization and Assessment of Hypersexual Disorder: A Systematic Review of the Literature.

PubMed

Montgomery-Graham, Stephanie

2017-04-01

Despite the rejection of hypersexual disorder (HD) as a new diagnosis in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), clinical and research interest in HD continues. To systematically review the existing scientific literature on the conceptualization and assessment of HD and out-of-control sexual behavior. Studies were identified from PsychInfo, PubMed, JSTOR, Google Scholar, and Scholar's Portal using an exhaustive list of key terms. Of 299 total articles identified and screened, 252 were excluded, and 47 are included in this review. To review two categories of articles: HD conceptualization and HD psychometric assessment. First, results of the review of theoretical conceptualizations of HD reflected a large proportion of the peer-reviewed literature devoted to discussing conceptualizations of HD without reaching consensus. Second, results of the review of HD psychometric assessments were analyzed using Hunsley and Mash's (2008) criteria to evaluate psychometric adequacy of evidence-based assessment measurements. The six most researched measurements of HD were evaluated, including the Hypersexual Disorder Screening Inventory, the Hypersexual Behavior Inventory, the Sexual Compulsivity Scale, the Sexual Addiction Screening Test, the Sexual Addiction Screening Test-Revised, and the Compulsive Sexual Behavior Inventory. Psychometric properties of the scales are reviewed, evaluated, and discussed. The Hypersexual Disorder Screening Inventory, the measurement proposed for the clinical screening of HD by the DSM-5 workgroup, currently has the strongest psychometric support. Future research and clinical directions are discussed in light of findings after the literature review and synthesis. Montgomery-Graham S. Conceptualization and Assessment of Hypersexual Disorder: A Systematic Review of the Literature. Sex Med Rev 2017;5:146-162. Copyright © 2016 International Society for Sexual Medicine. Published by Elsevier Inc. All rights reserved.

Psychometric properties of the Interpersonal Relationship Inventory-Short Form for active duty female service members.

PubMed

Nayback-Beebe, Ann M; Yoder, Linda H

2011-06-01

The Interpersonal Relationship Inventory-Short Form (IPRI-SF) has demonstrated psychometric consistency across several demographic and clinical populations; however, it has not been psychometrically tested in a military population. The purpose of this study was to psychometrically evaluate the reliability and component structure of the IPRI-SF in active duty United States Army female service members (FSMs). The reliability estimates were .93 for the social support subscale and .91 for the conflict subscale. Principal component analysis demonstrated an obliquely rotated three-component solution that accounted for 58.9% of the variance. The results of this study support the reliability and validity of the IPRI-SF for use in FSMs; however, a three-factor structure emerged in this sample of FSMs post-deployment that represents "cultural context." Copyright © 2011 Wiley Periodicals, Inc.

Spinal appearance questionnaire: factor analysis, scoring, reliability, and validity testing.

PubMed

Carreon, Leah Y; Sanders, James O; Polly, David W; Sucato, Daniel J; Parent, Stefan; Roy-Beaudry, Marjolaine; Hopkins, Jeffrey; McClung, Anna; Bratcher, Kelly R; Diamond, Beverly E

2011-08-15

Cross sectional. This study presents the factor analysis of the Spinal Appearance Questionnaire (SAQ) and its psychometric properties. Although the SAQ has been administered to a large sample of patients with adolescent idiopathic scoliosis (AIS) treated surgically, its psychometric properties have not been fully evaluated. This study presents the factor analysis and scoring of the SAQ and evaluates its psychometric properties. The SAQ and the Scoliosis Research Society-22 (SRS-22) were administered to AIS patients who were being observed, braced or scheduled for surgery. Standard demographic data and radiographic measures including Lenke type and curve magnitude were also collected. Of the 1802 patients, 83% were female; with a mean age of 14.8 years and mean initial Cobb angle of 55.8° (range, 0°-123°). From the 32 items of the SAQ, 15 loaded on two factors with consistent and significant correlations across all Lenke types. There is an Appearance (items 1-10) and an Expectations factor (items 12-15). Responses are summed giving a range of 5 to 50 for the Appearance domain and 5 to 20 for the Expectations domain. The Cronbach's α was 0.88 for both domains and Total score with a test-retest reliability of 0.81 for Appearance and 0.91 for Expectations. Correlations with major curve magnitude were higher for the SAQ Appearance and SAQ Total scores compared to correlations between the SRS Appearance and SRS Total scores. The SAQ and SRS-22 Scores were statistically significantly different in patients who were scheduled for surgery compared to those who were observed or braced. The SAQ is a valid measure of self-image in patients with AIS with greater correlation to curve magnitude than SRS Appearance and Total score. It also discriminates between patients who require surgery from those who do not.

Development of Depression Profile: a new psychometric instrument to selectively evaluate depressive symptoms based on the neurocircuitry theory.

PubMed

Faludi, Gábor; Gonda, Xenia; Kliment, Edit; Bekes, Vera; Mészáros, Veronika; Oláh, Attila

2010-06-01

Although we have several self-report instruments available to assess depression, they yield a composite score and thus do not allow for the differential examination of major symptom clusters associated with depression. However, such an instrument would be a useful tool in subtyping depression and selecting the most appropriate pharmacotherapy for each patient. The neurocircuitry theory describes the biochemical and neuroanatomic background associated with the major symptoms of depression. Based on the neurocircuitry theory, our team has developed a new instrument, the Depression Profile, to selectively assess depressive symptom clusters associated with different neurotransmitter systems and neuroanatomic structures. The aim of our study was to investigate the psychometric characteristics of Depression Profile. 339 patients consecutively admitted with DSM-IV major depression in our hospital completed the Depression Profile in the first two weeks of their hospitalisation. 81 patients in an adult outpatient unit also completed the Zung Self-rating Depression Scale. Internal consistency of Depression Profile was tested with item analysis. The external validity of Depression Profile against the Zung Self-rating Depression Scale was tested using Pearson correlations. The internal consistency of Depression Profile proved to be excellent. The Cronbach alpha values of the scales met the expectable minimum level derived from the number of items in the scales. In testing for convergent validity, all Pearson correlation coefficients between Depression profile subscales and the Zung Self-rating Depression Scale were significant and moderate to high which indicates the good external validity of our instrument. The initial psychometric evaluation of Depression Profile indicates that our instrument has good reliability and internal and external validity. The instrument also proved to be useful in clinical work to aid the choice of medications and determine the subtype of depressive episodes. Further studies, possibly with biochemical and neuroimaging methodology are needed to validate the 9 main symptom clusters of the Depression Profile subscales with respect to their neuroanatomical and neurochemical bases.

An initial psychometric evaluation and exploratory cross-sectional study of the body checking questionnaire among Brazilian women.

PubMed

Campana, Angela Nogueira Neves Betanho; Swami, Viren; Onodera, Carolina Mie Kawagosi; da Silva, Dirceu; Tavares, Maria da Consolação Gomes Cunha Fernandes

2013-01-01

Body checking is considered an expression of an excessive preoccupation with appearance. The first aim of this study was to evaluate the psychometric properties of a Brazilian Portuguese version of the Body Checking Questionnaire (BCQ). Additionally, we wanted to examine the questionnaire's associations with body avoidance behaviour, body mass index, dietary habits, and the intensity, frequency, and length of physical exercise. Finally, we also examined the differences between the total BCQ score and the individual BCQ factor scores. Differences between active and sedentary persons and between non-dieters and those on weight-loss diets were also analyzed. For the psychometric study, 546 female public university students from four different courses were surveyed. Two minor samples of university students and eating disorders women were also recruited. In the second part of the study, 403 women were recruited from weight-loss programs, gyms, and a university. All participants were verbally invited to participate in the research and voluntarily took part. Confirmatory factor analysis showed a good fit to the original model of the Brazilian BCQ that retained all 23 items. Satisfactory evidence of construct validity and internal consistency were also generated through analysis of factor loadings, t-values, Cronbach's alpha, and construct reliability tests. The results also showed associations among body checking and body avoidance, body satisfaction, social anxiety, body mass index, and the frequency and intensity of physical exercise. Significant differences were found between non-dieters and weight-loss dieters for all BCQ factors and the total BCQ score. For physically active and sedentary persons, a significant difference was only observed for idiosyncratic checking behaviour. In conclusion, the BCQ appears to be a valid and reliable scale for Brazilian research, and the associations and differences found in this study suggest that women at gyms and especially in weight-loss programs should be targeted for future body checking studies.

Psychometric testing of the breastfeeding self-efficacy scale-short form among adolescents.

PubMed

Dennis, Cindy-Lee; Heaman, Maureen; Mossman, Marion

2011-09-01

This study aimed to (a) psychometrically assess the Breastfeeding Self-Efficacy Scale-Short Form (BSES-SF) antenatally and postnatally among adolescents, and (b) examine the relationship between breast-feeding self-efficacy and adolescent demographic variables. The BSES-SF is used internationally but has not been psychometrically tested with an adolescent population. A methodological study was conducted in which 103 pregnant adolescents were recruited from two prenatal clinics at a tertiary care setting in western Canada. The BSES-SF was administered at 34 weeks' gestation and again at 1 and 4 weeks postpartum. The Cronbach's alpha coefficient was .84 for the antenatal assessment and .93 for the postnatal assessment. Antenatal BSES-SF scores significantly predicted breast-feeding initiation, whereas antenatal and postnatal scores predicted duration and exclusivity to 4 weeks postpartum. Other reliability and validity results are consistent with previous research with adult samples. Study findings indicate prenatal classes and professional support may be particularly important sources of information to increase adolescent breast-feeding self-efficacy. Results provide evidence that the scale may be a valid and reliable measure of breast-feeding self-efficacy among adolescents, predicting breast-feeding initiation, duration, and exclusivity. Copyright © 2011 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

Development and initial psychometric evaluation of an item bank created to measure upper extremity function in persons with stroke.

PubMed

Higgins, Johanne; Finch, Lois E; Kopec, Jacek; Mayo, Nancy E

2010-02-01

To create and illustrate the development of a method to parsimoniously and hierarchically assess upper extremity function in persons after stroke. Data were analyzed using Rasch analysis. Re-analysis of data from 8 studies involving persons after stroke. Over 4000 patients with stroke who participated in various studies in Montreal and elsewhere in Canada. Data comprised 17 tests or indices of upper extremity function and health-related quality of life, for a total of 99 items related to upper extremity function. Tests and indices included, among others, the Box and Block Test, the Nine-Hole Peg Test and the Stroke Impact Scale. Data were collected at various times post-stroke from 3 days to 1 year. Once the data fit the model, a bank of items measuring upper extremity function with persons and items organized hierarchically by difficulty and ability in log units was produced. This bank forms the basis for eventual computer adaptive testing. The calibration of the items should be tested further psychometrically, as should the interpretation of the metric arising from using the item calibration to measure the upper extremity of individuals.

Pressure ulcers: development and psychometric evaluation of the attitude towards pressure ulcer prevention instrument (APuP).

PubMed

Beeckman, D; Defloor, T; Demarré, L; Van Hecke, A; Vanderwee, K

2010-11-01

Pressure ulcers continue to be a significant problem in hospitals, nursing homes and community care settings. Pressure ulcer incidence is widely accepted as an indicator for the quality of care. Negative attitudes towards pressure ulcer prevention may result in suboptimal preventive care. A reliable and valid instrument to assess attitudes towards pressure ulcer prevention is lacking. Development and psychometric evaluation of the Attitude towards Pressure ulcer Prevention instrument (APuP). Prospective psychometric instrument validation study. A literature review was performed to design the instrument. Content validity was evaluated by nine European pressure ulcer experts and five experts in psychometric instrument validation in a double Delphi procedure. A convenience sample of 258 nurses and 291 nursing students from Belgium and The Netherlands participated in order to evaluate construct validity and stability reliability of the instrument. The data were collected between February and May 2008. A factor analysis indicated the construct of a 13 item instrument in a five factor solution: (1) attitude towards personal competency to prevent pressure ulcers (three items); (2) attitude towards the priority of pressure ulcer prevention (three items); (3) attitude towards the impact of pressure ulcers (three items); (4) attitude towards personal responsibility in pressure ulcer prevention (two items); and (5) attitude towards confidence in the effectiveness of prevention (two items). This five factor solution accounted for 61.4% of the variance in responses related to attitudes towards pressure ulcer prevention. All items demonstrated factor loadings over 0.60. The instrument produced similar results during stability testing [ICC=0.88 (95% CI=0.84-0.91, P<0.001)]. For the total instrument, the internal consistency (Cronbachs alpha) was 0.79. The APuP is a psychometrically sound instrument that can be used to effectively assess attitudes towards pressure ulcer prevention in patient care, education, and research. In further research, the association between attitude, knowledge and clinical performance should be explored. Copyright 2010 Elsevier Ltd. All rights reserved.

Psychometric properties of the Dutch version of the London Measure of Unplanned Pregnancy in women with pregnancies ending in birth.

PubMed

Goossens, Joline; Verhaeghe, Sofie; Van Hecke, Ann; Barrett, Geraldine; Delbaere, Ilse; Beeckman, Dimitri

2018-01-01

To evaluate the psychometric properties of the Dutch version of the London Measure of Unplanned Pregnancy in women with pregnancies ending in birth. A two-phase psychometric evaluation design was set-up. Phase I comprised the translation from English into Dutch and pretesting with 6 women using cognitive interviews. In phase II, the reliability and validity of the Dutch version of the LMUP was assessed in 517 women giving birth recently. Reliability (internal consistency) was assessed using Cronbach's alpha, inter-item correlations, and corrected item-total correlations. Construct validity was assessed using principal components analysis and hypothesis testing. Exploratory Mokken scale analysis was carried out. 517 women aged 15-45 completed the Dutch version of the LMUP. Reliability testing showed acceptable internal consistency (alpha = 0.74, positive inter-item correlations between all items, all corrected item-total correlations >0.20). Validity testing confirmed the unidimensional structure of the scale and all hypotheses were confirmed. The overall Loevinger's H coefficient was 0.57, representing a 'strong' scale. The Dutch version of the LMUP is a reliable and valid measure that can be used in the Dutch-speaking population in Belgium to assess pregnancy planning. Future research is necessary to assess the stability of the Dutch version of the LMUP, and to evaluate its psychometric properties in women with abortions.

Psychometric Assessment and Reporting Practices: Incongruence between Theory and Practice

ERIC Educational Resources Information Center

Slaney, Kathleen L.; Tkatchouk, Masha; Gabriel, Stephanie M.; Maraun, Michael D.

2009-01-01

The aim of the current study is twofold: (a) to investigate the rates at which researchers assess and report on the psychometric properties of the measures they use in their research and (b) to examine whether or not researchers appear to be generally employing sound/unsound rationales when it comes to how they conduct test evaluations. Based on a…

The Psychometric Entrance Examination of the Universities in Israel. Information Booklet, English Version.

ERIC Educational Resources Information Center

National Inst. for Testing and Evaluation, Jerusalem (Israel).

The purpose of this booklet is to explain examination registration procedures and to introduce the Psychometric Entrance Examination so that students will know what to expect, what types of questions they will be asked, and how they will be expected to answer. The aim of the examination is to evaluate a variety of cognitive abilities: verbal,…

The measurement of place attachment: validity and generalizability of a psychometric approach

Treesearch

Daniel R. Williams; Jerry J. Vaske

2003-01-01

To enhance land managers’ ability to address deeper landscape meanings and place-specific symbolic values in natural resource decision making, this study evaluated the psychometric properties of a place attachment measure designed to capture the extent of emotions and feelings people have for places. Building on previous measurement efforts, this study examined the...

Examination of the Psychometric Properties of the Knowledge of Aging for Social Work Quiz

ERIC Educational Resources Information Center

Nakao, Kayoko C.; Damron-Rodriguez, JoAnn; Lawrance, Frances P.; Volland, Patricia J.

2013-01-01

Using graduate social work students' data ("n" = 481) in the Hartford Partnership Program for Aging Education (HPPAE) in the United States, the study examined psychometric properties of the Knowledge of Aging for Social Work Quiz (KASW), a revision of the Facts on Aging Quiz, to evaluate biopsychosocial knowledge relevant to social work.…

Psychometric Evaluation of an Arabic Version of the Spiritual Involvement and Beliefs Scale in Jordanian Muslim College Nursing Students

ERIC Educational Resources Information Center

Musa, Ahmad S.

2015-01-01

A review of the nursing and health-related literature on spirituality revealed that no valid and reliable research tool exists in Arabic for measuring spiritual beliefs and practices for Arab Muslim population. This study translated the Spiritual Involvement and Beliefs Scale (SIBS) into Arabic and examined the psychometric properties of the…

Developing a Measure of Therapist Adherence to Contingency Management: An Application of the Many-Facet Rasch Model

ERIC Educational Resources Information Center

Chapman, Jason E.; Sheidow, Ashli J.; Henggeler, Scott W.; Halliday-Boykins, Colleen A.; Cunningham, Phillippe B.

2008-01-01

A unique application of the Many-Facet Rasch Model (MFRM) is introduced as the preferred method for evaluating the psychometric properties of a measure of therapist adherence to Contingency Management (CM) treatment of adolescent substance use. The utility of psychometric methods based in Classical Test Theory was limited by complexities of the…

Psychometrical Assessment and Item Analysis of the General Health Questionnaire in Victims of Terrorism

ERIC Educational Resources Information Center

Delgado-Gomez, David; Lopez-Castroman, Jorge; de Leon-Martinez, Victoria; Baca-Garcia, Enrique; Cabanas-Arrate, Maria Luisa; Sanchez-Gonzalez, Antonio; Aguado, David

2013-01-01

There is a need to assess the psychiatric morbidity that appears as a consequence of terrorist attacks. The General Health Questionnaire (GHQ) has been used to this end, but its psychometric properties have never been evaluated in a population affected by terrorism. A sample of 891 participants included 162 direct victims of terrorist attacks and…

The Shortened Raven Standard Progressive Matrices: Item Response Theory-Based Psychometric Analyses and Normative Data

ERIC Educational Resources Information Center

Van der Elst, Wim; Ouwehand, Carolijn; van Rijn, Peter; Lee, Nikki; Van Boxtel, Martin; Jolles, Jelle

2013-01-01

The purpose of the present study was to evaluate the psychometric properties of a shortened version of the Raven Standard Progressive Matrices (SPM) under an item response theory framework (the one- and two-parameter logistic models). The shortened Raven SPM was administered to N = 453 cognitively healthy adults aged between 24 and 83 years. The…

Examination of the Psychometric Properties of the Adult Manifest Anxiety Scale-Elderly Version Scores

ERIC Educational Resources Information Center

Lowe, Patricia A.; Reynolds, Cecil R.

2006-01-01

The psychometric properties of the Adult Manifest Anxiety Scale-Elderly Version (AMAS-E) scores were evaluated in two studies. In Study 1, the temporal stability and construct validity of the AMAS-E test scores were examined in a group of 226 older adults, aged 60 years and older. Results indicated adequate to excellent temporal stability (2-week…

The Empathy Index: An Evaluation of the Psychometric Properties of a New Empathy Measure for Sex Offenders

ERIC Educational Resources Information Center

Grady, Melissa D.; Rose, Roderick A.

2011-01-01

This article examines the analysis of the psychometric properties, including the validity and reliability, of the Empathy Index (EI), a new instrument designed to measure empathy deficits of sex offenders. The EI was tested with a sample of 158 sex offenders incarcerated in North Carolina prisons. An exploratory factor analysis yielded three…

A Review of Psychometric Assessment and Reporting Practices: An Examination of Measurement-Oriented versus Non-Measurement-Oriented Domains

ERIC Educational Resources Information Center

Slaney, Kathleen L.; Tkatchouk, Masha; Gabriel, Stephanie M.; Ferguson, Leona P.; Knudsen, Jared R. S.; Legere, Julien C.

2010-01-01

The primary aim of the present study is to determine whether the psychometric evaluation practices and test-analytic rationales of researchers publishing in journals with a measurement focus differ from those of researchers publishing in journals with varying substantive research foci. Several components of two different samples of articles were…

The Shedler-Westen Assessment Procedure (SWAP): Evaluating Psychometric Questions about Its Reliability, Validity, and Impact of Its Fixed Score Distribution

ERIC Educational Resources Information Center

Blagov, Pavel S.; Bi, Wu; Shedler, Jonathan; Westen, Drew

2012-01-01

The Shedler-Westen Assessment Procedure (SWAP) is a personality assessment instrument designed for use by expert clinical assessors. Critics have raised questions about its psychometrics, most notably its validity across observers and situations, the impact of its fixed score distribution on research findings, and its test-retest reliability. We…

Validation of the Beck Depression Inventory-II in a Low-Income African American Sample of Medical Outpatients

ERIC Educational Resources Information Center

Grothe, Karen B.; Dutton, Gareth R.; Jones, Glenn N.; Bodenlos, Jamie; Ancona, Martin; Brantley, Phillip J.

2005-01-01

The psychometric properties of the Beck Depression Inventory-II (BDI-II) are well established with primarily Caucasian samples. However, little is known about its reliability and validity with minority groups. This study evaluated the psychometric properties of the BDI-II in a sample of low-income African American medical outpatients (N = 220).…

Psychometric Evaluation of the Multidimensional Assessment of Fatigue Scale for Use with Pregnant and Postpartum Women

ERIC Educational Resources Information Center

Fairbrother, Nichole; Hutton, Eileen K.; Stoll, Kathrin; Hall, Wendy; Kluka, Sandy

2008-01-01

Although fatigue is a common experience for pregnant women and new mothers, few measures of fatigue have been validated for use with this population. To address this gap, the authors assessed psychometric properties of the Multidimensional Assessment of Fatigue (MAF) scale, which was used in 2 independent samples of pregnant women. Results…

Computerized and Paper-and-Pencil Versions of the Rosenberg Self-Esteem Scale: A Comparison of Psychometric Features and Respondent Preferences.

ERIC Educational Resources Information Center

Vispoel, Walter P.; Boo, Jaeyool; Bleiler, Timothy

2001-01-01

Evaluated the characteristics of computerized and paper-and-pencil versions of the Rosenberg Self-Esteem Scale (SES) using scores for 224 college students. Results show that mode of administration has little effect on the psychometric properties of the SES although the computerized version took longer and was preferred by examinees. (SLD)

An Item-Level Psychometric Analysis of the Personality Assessment Inventory: Clinical Scales in a Psychiatric Inpatient Unit

ERIC Educational Resources Information Center

Siefert, Caleb J.; Sinclair, Samuel J.; Kehl-Fie, Kendra A.; Blais, Mark A.

2009-01-01

Multi-item multiscale self-report measures are increasingly used in inpatient assessments. When considering a measure for this setting, it is important to evaluate the psychometric properties of the clinical scales and items to ensure that they are functioning as intended in a highly distressed clinical population. The present study examines scale…

Psychometric Validation and Normative Data of a Second Chinese Version of the Hooper Visual Organization Test in Children

ERIC Educational Resources Information Center

Lin, Yueh-Hsien; Su, Chwen-Yng; Guo, Wei-Yuan; Wuang, Yee-Pay

2012-01-01

The Hooper Visual Organization Test (HVOT) is a measure of visuosynthetic ability. Previously, the psychometric properties of the HVOT have been evaluated for Chinese-speaking children aged 5-11 years. This study reports development and further evidence of reliability and validity for a second version involving an extended age range of healthy…

Evaluation of the Psychometric Properties of the Parents' Proxy MPAQ-C in Chinese Population

ERIC Educational Resources Information Center

Leung, Ka Man; Chung, Pak-Kwong; Ransdell, Lynda B.; Gao, Yong

2016-01-01

We examined psychometric properties of a Modified Physical Activity Questionnaire for Children (MPAQ-C). Thirty-two parents (Study 1), 40 students (6-9 years) and one of each student's parents (Study 2), and 625 parents (Study 3) completed the MPAQ-C. The MPAQ-C (six items) measured children's physical activity (PA) after school, and during…

Self-rating of daily time management in children: psychometric properties of the Time-S.

PubMed

Sköld, Annika; Janeslätt, Gunnel Kristina

2017-05-01

Impaired ability to manage time has been shown in several diagnoses common in childhood. Impaired ability involves activities and participation domain (daily time management, DTM) and body function and structure domain (time-processing ability, TPA). DTM needs to be evaluated from an individual's own perspective. To date, there has been a lack of self-rating instruments for children that focus on DTM. The aim of this study is to describe psychometric properties of Time-S when used in children aged 10-17 years with a diagnosis of ADHD, Autism, CP or mild ID. Further, to test whether TPA correlates with self-rated DTM. Eighty-three children aged 10-17 years participated in the study. Rasch analysis was used to assess psychometric properties. Correlation analysis was performed between Time-S and a measure of TPA. The 21 items of the Time-S questionnaire fit into a unitary construct measuring self-perceived daily management of an individual's time. A non-significant, small correlation was found between TPA and DTM. The results indicate good psychometric properties for the questionnaire. The questionnaire is potentially useful in intervention planning and evaluation.

Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 1—Psychometric Characteristics of 5 Paradigms

PubMed Central

Reddy, L. Felice; Horan, William P.; Barch, Deanna M.; Buchanan, Robert W.; Dunayevich, Eduardo; Gold, James M.; Lyons, Naomi; Marder, Stephen R.; Treadway, Michael T.; Wynn, Jonathan K.; Young, Jared W.; Green, Michael F.

2015-01-01

Impairments in willingness to exert effort contribute to the motivational deficits characteristic of the negative symptoms of schizophrenia. The current study evaluated the psychometric properties of 5 new or adapted paradigms to determine their suitability for use in clinical trials of schizophrenia. This study included 94 clinically stable participants with schizophrenia and 40 healthy controls. The effort-based decision-making battery was administered twice to the schizophrenia group (baseline, 4-week retest) and once to the control group. The 5 paradigms included 1 that assesses cognitive effort, 1 perceptual effort, and 3 that assess physical effort. Each paradigm was evaluated on (1) patient vs healthy control group differences, (2) test-retest reliability, (3) utility as a repeated measure (ie, practice effects), and (4) tolerability. The 5 paradigms showed varying psychometric strengths and weaknesses. The Effort Expenditure for Rewards Task showed the best reliability and utility as a repeated measure, while the Grip Effort Task had significant patient-control group differences, and superior tolerability and administration duration. The other paradigms showed weaker psychometric characteristics in their current forms. These findings highlight challenges in adapting effort and motivation paradigms for use in clinical trials. PMID:26142081

A Psychometric Evaluation of the Santa Clara Strength of Religious Faith Questionnaire among Students from Poland and Chile.

PubMed

Wnuk, Marcin

2017-01-01

This study verifies the psychometric properties of the Santa Clara Strength of Religious Faith Questionnaire (SCSORFQ). This measure consists of 10 items regarding strength of religious faith, regardless of religious denomination or affiliation. Participants were 177 students from Chile and 393 students from Poland. The SCSORFQ method is a reliable measure with good internal consistency evaluated by the α-Cronbach coefficient. Factor analysis statistically confirmed the unidimensional structure of the SCSORFQ. The strength of religious faith in both student groups was moderate to strong correlated with public or private aspects of religiousness and strong correlated with spiritual experiences. It was weakly correlated with the cognitive indicator of well-being as satisfaction with life as well as with existential variables like hope and meaning of life. The results confirm that the SCSORFQ is psychometrically sound and is therefore recommended for use by researchers studying the construct of religiousness.

The Psychometric Evaluation of the Connor-Davidson Resilience Scale Using a Chinese Military Sample

PubMed Central

Xie, Yuanjun; Peng, Li; Zuo, Xin; Li, Min

2016-01-01

This study examined the psychometric properties of the Connor-Davidson Resilience Scale (CD-RISC) with a Chinese military population with the aim of finding a suitable instrument to quantify resilience in Chinese military service members. The confirmatory factor analysis results did not support the factorial structure of the original or the Chinese community version of the CD-RISC, but the exploratory factor analysis results revealed a three-factor model (composed of Competency, Toughness, and Adaptability) that seemed to fit. Moreover, the repeat confirmatory factory analysis replicated the three-factor model. Additionally, the CD-RISC with a Chinese military sample exhibited appropriate psychometric properties, including internal consistency, test-retest reliability, and structural and concurrent validity. The revised CD-RISC with a Chinese military sample provides insight into the resilience measurement framework and could be a reliable and valid measurement for evaluating resilience in a Chinese military population. PMID:26859484

Psychometric evaluation of the Multidimensional Assessment of Fatigue scale for use with pregnant and postpartum women.

PubMed

Fairbrother, Nichole; Hutton, Eileen K; Stoll, Kathrin; Hall, Wendy; Kluka, Sandy

2008-06-01

Although fatigue is a common experience for pregnant women and new mothers, few measures of fatigue have been validated for use with this population. To address this gap, the authors assessed psychometric properties of the Multidimensional Assessment of Fatigue (MAF) scale, which was used in 2 independent samples of pregnant women. Results indicated that the psychometric properties of the scale were very similar across samples and time points. The scale possesses a high level of internal consistency, has good convergent validity with measures of sleep quality and depression, and discriminates well from a measure of social support. Contrary to previous evaluations of the MAF, data strongly suggest that the scale represents a unidimensional construct best represented by a single factor. Results indicate that the MAF is a useful measure of fatigue among pregnant and postpartum women.

A Psychometric Evaluation of the Revised Temperament and Character Inventory (TCI-R) and the TCI-140

PubMed Central

Farmer, Richard F.; Goldberg, Lewis R.

2010-01-01

The psychometric properties of the newest version of the Temperament and Character Inventory, the TCI-R, were evaluated in a large (n = 727) community sample, as was the TCI-140, a short inventory derivative. Facets-to-scale confirmatory and exploratory factor analyses of the TCI-R did not support the organization of temperament and character facet scales within their superordinate domains. Five of the 29 facet scales also displayed relatively low internal consistency (α < .70). Factor analyses of the TCI-140 item set yielded only limited support for hypothesized item-to-scale memberships. Harm Avoidance, Novelty Seeking, and Self-directedness items, in particular, were not well differentiated. Although psychometrically comparable, the TCI-R and the TCI-140 demonstrate many of the limitations of earlier inventory versions. Implications associated with the use of the TCI-R and TCI-140 and Cloninger’s theory of personality are discussed. PMID:18778164

Word recognition materials for native speakers of Taiwan Mandarin.

PubMed

Nissen, Shawn L; Harris, Richard W; Dukes, Alycia

2008-06-01

To select, digitally record, evaluate, and psychometrically equate word recognition materials that can be used to measure the speech perception abilities of native speakers of Taiwan Mandarin in quiet. Frequently used bisyllabic words produced by male and female talkers of Taiwan Mandarin were digitally recorded and subsequently evaluated using 20 native listeners with normal hearing at 10 intensity levels (-5 to 40 dB HL) in increments of 5 dB. Using logistic regression, 200 words with the steepest psychometric slopes were divided into 4 lists and 8 half-lists that were relatively equivalent in psychometric function slope. To increase auditory homogeneity of the lists, the intensity of words in each list was digitally adjusted so that the threshold of each list was equal to the midpoint between the mean thresholds of the male and female half-lists. Digital recordings of the word recognition lists and the associated clinical instructions are available on CD upon request.

Measuring the expectations of kidney donors: initial psychometric properties of the Living Donation Expectancies Questionnaire.

PubMed

Rodrigue, James R; Guenther, Robert; Kaplan, Bruce; Mandelbrot, Didier A; Pavlakis, Martha; Howard, Richard J

2008-05-15

We report on the initial development and validation of the Living Donation Expectancies Questionnaire (LDEQ), designed to measure the expectations of living kidney donor candidates. Potential living donors (n=443) at two transplant centers were administered the LDEQ and other questionnaires, and their medical records were reviewed. Factor analysis provides support for six LDEQ scales: Interpersonal Benefit, Personal Growth, Spiritual Growth, Quid Pro Quo, Health Consequences, and Miscellaneous Consequences. All but one scale showed good internal consistency. Expected benefits of donation were associated with higher optimism and lower mental health; expected consequences of donation were associated with lower optimism and lower physical and mental health. More potential donors with relative or absolute contraindications had high Interpersonal Benefit (P<0.0001), Personal Growth (P<0.01), Quid Pro Quo (P<0.0001), and Health Consequences (P<0.0001) expectations. The LDEQ has promise in evaluating donor candidates' expectations.

Analysis of the psychometric properties of the Multiple Sclerosis Impact Scale-29 (MSIS-29) in relapsing–remitting multiple sclerosis using classical and modern test theory

PubMed Central

Wyrwich, KW; Phillips, GA; Vollmer, T; Guo, S

2016-01-01

Background Investigations using classical test theory support the psychometric properties of the original version of the Multiple Sclerosis Impact Scale (MSIS-29v1), a disease-specific measure of multiple sclerosis (MS) impact (physical and psychological subscales). Later, assessments of the MSIS-29v1 in an MS community-based sample using Rasch analysis led to revisions of the instrument’s response options (MSIS-29v2). Objective The objective of this paper is to evaluate the psychometric properties of the MSIS-29v1 in a clinical trial cohort of relapsing–remitting MS patients (RRMS). Methods Data from 600 patients with RRMS enrolled in the SELECT clinical trial were used. Assessments were performed at baseline and at Weeks 12, 24, and 52. In addition to traditional psychometric analyses, Item Response Theory (IRT) and Rasch analysis were used to evaluate the measurement properties of the MSIS-29v1. Results Both MSIS-29v1 subscales demonstrated strong reliability, construct validity, and responsiveness. The IRT and Rasch analysis showed overall support for response category threshold ordering, person-item fit, and item fit for both subscales. Conclusions Both MSIS-29v1 subscales demonstrated robust measurement properties using classical, IRT, and Rasch techniques. Unlike previous research using a community-based sample, the MSIS-29v1 was found to be psychometrically sound to assess physical and psychological impairments in a clinical trial sample of patients with RRMS. PMID:28607741

Analysis of the psychometric properties of the Multiple Sclerosis Impact Scale-29 (MSIS-29) in relapsing-remitting multiple sclerosis using classical and modern test theory.

PubMed

Bacci, E D; Wyrwich, K W; Phillips, G A; Vollmer, T; Guo, S

2016-01-01

Investigations using classical test theory support the psychometric properties of the original version of the Multiple Sclerosis Impact Scale (MSIS-29v1), a disease-specific measure of multiple sclerosis (MS) impact (physical and psychological subscales). Later, assessments of the MSIS-29v1 in an MS community-based sample using Rasch analysis led to revisions of the instrument's response options (MSIS-29v2). The objective of this paper is to evaluate the psychometric properties of the MSIS-29v1 in a clinical trial cohort of relapsing-remitting MS patients (RRMS). Data from 600 patients with RRMS enrolled in the SELECT clinical trial were used. Assessments were performed at baseline and at Weeks 12, 24, and 52. In addition to traditional psychometric analyses, Item Response Theory (IRT) and Rasch analysis were used to evaluate the measurement properties of the MSIS-29v1. Both MSIS-29v1 subscales demonstrated strong reliability, construct validity, and responsiveness. The IRT and Rasch analysis showed overall support for response category threshold ordering, person-item fit, and item fit for both subscales. Both MSIS-29v1 subscales demonstrated robust measurement properties using classical, IRT, and Rasch techniques. Unlike previous research using a community-based sample, the MSIS-29v1 was found to be psychometrically sound to assess physical and psychological impairments in a clinical trial sample of patients with RRMS.

How good is the neurophysiology of pain questionnaire? A Rasch analysis of psychometric properties.

PubMed

Catley, Mark J; O'Connell, Neil E; Moseley, G Lorimer

2013-08-01

The Neurophysiology of Pain Questionnaire (NPQ) was devised to assess how an individual conceptualizes the biological mechanisms that underpin his or her pain. Despite its widespread use, its psychometric properties have not been comprehensively interrogated. Rasch analysis was undertaken on NPQ data from a convenience sample of 300 spinal pain patients, and test-retest reliability was assessed in a sample of 45 low back pain patients. The NPQ effectively targeted the ability of the sample and had acceptable internal consistency and test-retest reliability. However, some items functioned erratically for persons of differing abilities or were psychometrically redundant. The NPQ was reanalyzed with 7 questionable items excluded, and superior psychometric properties were observed. These findings suggest that the NPQ could be improved, but future prospective studies including qualitative measures are needed. In summary, the NPQ is a useful tool for assessing a patient's conceptualization of the biological mechanisms that underpin his or her pain and for evaluating the effects of cognitive interventions in clinical practice and research. These findings suggest that it has adequate psychometric properties for use with chronic spinal pain patients. Rasch analysis was used to analyze the NPQ. Despite several limitations, these results suggest that it is a useful tool with which to assess a patient's conceptualization of the biological mechanisms that underpin his or her pain and to evaluate the effects of cognitive interventions in clinical practice and research. Copyright © 2013 American Pain Society. Published by Elsevier Inc. All rights reserved.

Measurement properties of the Patient-Rated Wrist and Hand Evaluation: Rasch analysis of responses from a traumatic hand injury population.

PubMed

Packham, Tara; MacDermid, Joy C

2013-01-01

The Patient-Rated Wrist and Hand Evaluation (PRWHE) is a self-reported assessment of pain and disability to evaluate outcome after hand injuries. Rasch analysis is an alternative strategy for examining the psychometric properties of a measurement scale based in item response theory, rather than classical test theory. This study used Rasch analysis to examine the content, scoring and measurement properties of the PRWHE. PRWHE scores (n = 264) from persons with a traumatic injury or reconstructive surgery to one hand were collected from an outpatient hand rehabilitation facility. Rasch analysis was conducted to assess how the PRWHE fit the Rasch model, confirms the scaling structure of the pain and disability subscales, and identifies any areas of bias from differential item functioning. Rasch analysis of the PRWHE supports internal consistency of the scale (α = 0.96) and reliability (as measured by the person separation index) of 0.95. While gender, age, diagnosis, and duration since injury all systematically influenced how people scored the PRWHE, hand dominance and affected side did not. Rasch analysis supported a 3 subscale structure (pain, specific activities and usual activities) rather than the current divisions of pain and disability. Initial examination of the PRWHE indicates the psychometric properties of consistency, reliability and responsiveness previously tested by classical methods are further supported by Rasch analysis. It also suggests the scale structure may be best considered as 3 subscales rather than simply pain and disability. Copyright © 2013 Hanley & Belfus. Published by Elsevier Inc. All rights reserved.

Standardized measures for substance use stigma.

PubMed

Brown, Seth A

2011-07-01

Despite indications that the stigma associated with substance use is high and may play a role in discouraging treatment participation, there is limited research in this area and only a few psychometrically sound measures of substance use stigma exist. The purpose of this study was to formulate and evaluate the psychometric properties of three substance use stigma measures. College students (N=565) completed three measures of substance use stigma that were modified from three established measures of mental illness stigma. Two of the three modified measures (Social Distance Scale for Substance Users and Affect Scale for Substance Users) emerged as having acceptable psychometric properties, whereas one modified measure (Dangerousness Scale for Substance Users) had inadequate psychometric properties. In regard to sex differences, women had significantly higher substance use stigma on the two psychometrically sound measures (p<.01). Perhaps, with standardized measures, there can be greater progress towards better understanding the mechanisms leading to high levels of substance use stigma and ultimately address failures to seek out treatment due to stigma. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

The development and psychometric validation of an instrument to evaluate nurses' attitudes towards communication with the patient (ACO).

PubMed

Giménez-Espert, María Del Carmen; Prado-Gascó, Vicente Javier

2018-05-01

Patient communication is a key skill for nurses involved in clinical care. Its measurement is a complex phenomenon that can be addressed through attitude evaluation. To develop and psychometrically test a measure of nurses' attitudes towards communication with patients (ACO), to study the relationship between these dimensions, and to analyse nursing attitudes. To develop and psychometrically test the ACO questionnaire. All hospitals in the province of Valencia were invited by e-mail to distribute the ACO instrument. Ten hospitals took part in the study. The study population was composed of a convenience sample of 400 hospital nurses on general or special services. The inclusion criteria were nurses at the selected centres who had previously provided an informed consent to participate. A literature review and expert consultation (N = 10) was used to develop the content of the questionnaire. The 62-item version of the instrument was applied to a convenience sample of 400 nurses between May 2015 and March 2016. Factor structure was evaluated with exploratory and confirmatory factor analysis (EFA, CFA), and reliability was evaluated with Cronbach's alpha, composite reliability (CR), and average variance extracted (AVE). The final instrument (ACO), composed of 25 items grouped into three attitude dimensions (cognitive, affective and behavioural), had good psychometric properties. In the study sample, nurses had a favourable attitude towards communication. The cognitive and affective dimensions of the ACO should be able to predict the behaviour dimension. The ACO is useful for evaluating current clinical practices, identifying educational needs and assessing the effectiveness of communication training or other interventions intended to improve communication. Copyright © 2018 Elsevier Ltd. All rights reserved.

Graduate nursing students' evaluation of EBP courses: a cross-sectional study.

PubMed

Zelenikova, Renata; Beach, Michael; Ren, Dianxu; Wolff, Emily; Sherwood, Paula R

2015-01-01

There is a lack of appropriate tools for assessing the effectiveness of teaching evidence-based practice in nursing. The objective of the study was to develop the instrument evaluating the students' perception of the effectiveness of EBP courses and to verify its psychometric properties. A descriptive cross-sectional study design was used to verify psychometric properties of the questionnaire measuring the students' perception of the effectiveness of EBP courses. The psychometric properties were evaluated in a group of 129 graduate nursing students who completed EBP courses. The instrument for measuring the students' perception of the effectiveness of EBP courses was inspired by Kirkpatrick's evaluation model, which advocates evaluating interventions at four levels - reaction (satisfaction), learning, behavior change (transfer) and results (benefits). A web-based survey was used for data collection. Data was collected from the middle of January 2013 through the end of March 2013. A thirteen item instrument was developed for measuring the students' perception of the effectiveness of EBP courses. The internal consistency of the scale, based on standardized Cronbach's alpha, was .93. The results of factor analysis identified three factors of the instrument. The highest rated items on a scale of 1 (strongly disagree) to 7 (strongly agree) were 'implementation of EBP can improve clinical care' (mean 6.16), 'EBP instructors had a thorough knowledge of EBP' (6.13), 'EBP instructors were enthusiastic about teaching EBP' (5.65), and 'I can use my EBP knowledge and skills in my practice' (5.58). The results of testing of the psychometric properties of the questionnaire showed at least satisfactory validity and reliability. The majority of students perceived EBP courses as effective. The instrument may be used to assess the students' perception of the effectiveness of EBP courses. Copyright © 2014 Elsevier Ltd. All rights reserved.

Psychometric qualities of questionnaires for the assessment of otitis media impact.

PubMed

Timmerman, A A; Meesters, C M G; Speyer, R; Anteunis, L J C

2007-12-01

The assessment of impact and evaluation of treatment effects in chronic otitis media (OM) calls for a much broader approach than just examining the presence of middle ear effusion or hearing loss. It is increasingly recognised that this condition may result in a comprised quality of life. Several studies have used proxy completed questionnaires to objectify the illness experience associated with chronic OM. To review questionnaires which have been developed to describe the effects of chronic OM on the daily functioning of children. Psychometric properties have been evaluated, in addition to discriminative and evaluative qualities. A systematic review of publications pertaining to developed questionnaires related with chronic OM. Systematic literature searches of PubMed (1966-January 2007) and EMBASE (1989-January 2007) were conducted, supplemented by using free text words to identify publications after January 2005. The included 15 questionnaires were developed for children with recurrent or persistent OM, describing functional health status (FHS), while two questionnaires also evaluate the effect of tympanostomy tubes insertion. The questionnaires generally cover six impact areas (physical symptoms, child development, educational performance, emotional/practical burden and general health status) with physical symptoms being the most prominant. The OM8-30, OMO-22 and OM-6 adequately reflect the multidimensional aspects of FHS in chronic OM. The OMO-22 and OM8-30 show the best psychometric properties for the discrimination of impact severity between children, while the OM-6 was found to have the best qualities for the evaluation of clinical change. Clinical applicability is crucial for the assessment of FHS in chronic OM, but requires a trade-off with necessary psychometric properties.

Measuring students' perceptions of plagiarism: modification and Rasch validation of a plagiarism attitude scale.

PubMed

Howard, Steven J; Ehrich, John F; Walton, Russell

2014-01-01

Plagiarism is a significant area of concern in higher education, given university students' high self-reported rates of plagiarism. However, research remains inconsistent in prevalence estimates and suggested precursors of plagiarism. This may be a function of the unclear psychometric properties of the measurement tools adopted. To investigate this, we modified an existing plagiarism scale (to broaden its scope), established its psychometric properties using traditional (EFA, Cronbach's alpha) and modern (Rasch analysis) survey evaluation approaches, and examined results of well-functioning items. Results indicated that traditional and modern psychometric approaches differed in their recommendations. Further, responses indicated that although most respondents acknowledged the seriousness of plagiarism, these attitudes were neither unanimous nor consistent across the range of issues assessed. This study thus provides rigorous psychometric testing of a plagiarism attitude scale and baseline data from which to begin a discussion of contextual, personal, and external factors that influence students' plagiarism attitudes.

Construction and validation of a measure of integrative well-being in seven languages: The Pemberton Happiness Index

PubMed Central

2013-01-01

Purpose We introduce the Pemberton Happiness Index (PHI), a new integrative measure of well-being in seven languages, detailing the validation process and presenting psychometric data. The scale includes eleven items related to different domains of remembered well-being (general, hedonic, eudaimonic, and social well-being) and ten items related to experienced well-being (i.e., positive and negative emotional events that possibly happened the day before); the sum of these items produces a combined well-being index. Methods A distinctive characteristic of this study is that to construct the scale, an initial pool of items, covering the remembered and experienced well-being domains, were subjected to a complete selection and validation process. These items were based on widely used scales (e.g., PANAS, Satisfaction With Life Scale, Subjective Happiness Scale, and Psychological Well-Being Scales). Both the initial items and reference scales were translated into seven languages and completed via Internet by participants (N = 4,052) aged 16 to 60 years from nine countries (Germany, India, Japan, Mexico, Russia, Spain, Sweden, Turkey, and USA). Results Results from this initial validation study provided very good support for the psychometric properties of the PHI (i.e., internal consistency, a single-factor structure, and convergent and incremental validity). Conclusions Given the PHI’s good psychometric properties, this simple and integrative index could be used as an instrument to monitor changes in well-being. We discuss the utility of this integrative index to explore well-being in individuals and communities. PMID:23607679

Multicentre study for validation of the French addictovigilance network reports assessment tool

PubMed Central

Hardouin, Jean Benoit; Rousselet, Morgane; Gerardin, Marie; Guerlais, Marylène; Guillou, Morgane; Bronnec, Marie; Sébille, Véronique; Jolliet, Pascale

2016-01-01

Aims The French health authority (ANSM) is responsible for monitoring medicinal and other drug dependencies. To support these activities, the ANSM manages a network of 13 drug dependence evaluation and information centres (Centres d'Evaluation et d'Information sur la Pharmacodépendance ‐ Addictovigilance ‐ CEIP‐A) throughout France. In 2006, the Nantes CEIP‐A created a new tool called the EGAP (Echelle de GrAvité de la Pharmacodépendance‐ drug dependence severity scale) based on DSM IV criteria. This tool allows the creation of a substance use profile that enables the drug dependence severity to be homogeneously quantified by assigning a score to each substance indicated in the reports from health professionals. This article describes the validation and psychometric properties of the drug dependence severity score obtained from the scale ( Clinicaltrials.gov NCT01052675). Method The validity of the EGAP construct, the concurrent validity and the discriminative ability of the EGAP score, the consistency of answers to EGAP items, the internal consistency and inter rater reliability of the EGAP score were assessed using statistical methods that are generally used for psychometric tests. Results The total EGAP score was a reliable and precise measure for evaluating drug dependence (Cronbach alpha = 0.84; ASI correlation = 0.70; global ICC = 0.92). In addition to its good psychometric properties, the EGAP is a simple and efficient tool that can be easily specified on the official ANSM notification form. Conclusion The good psychometric properties of the total EGAP score justify its use for evaluating the severity of drug dependence. PMID:27302554

Adaptation of the Practice Environment Scale for military nurses: a psychometric analysis.

PubMed

Swiger, Pauline A; Raju, Dheeraj; Breckenridge-Sproat, Sara; Patrician, Patricia A

2017-09-01

The aim of this study was to confirm the psychometric properties of Practice Environment Scale of the Nursing Work Index in a military population. This study also demonstrates association rule analysis, a contemporary exploratory technique. One of the instruments most commonly used to evaluate the nursing practice environment is the Practice Environment Scale of the Nursing Work Index. Although the instrument has been widely used, the reliability, validity and individual item function are not commonly evaluated. Gaps exist with regard to confirmatory evaluation of the subscale factors, individual item analysis and evaluation in the outpatient setting and with non-registered nursing staff. This was a secondary data analysis of existing survey data. Multiple psychometric methods were used for this analysis using survey data collected in 2014. First, descriptive analyses were conducted, including exploration using association rules. Next, internal consistency was tested and confirmatory factor analysis was performed to test the factor structure. The specified factor structure did not hold; therefore, exploratory factor analysis was performed. Finally, item analysis was executed using item response theory. The differential item functioning technique allowed the comparison of responses by care setting and nurse type. The results of this study indicate that responses differ between groups and that several individual items could be removed without altering the psychometric properties of the instrument. The instrument functions moderately well in a military population; however, researchers may want to consider nurse type and care setting during analysis to identify any meaningful variation in responses. © 2017 John Wiley & Sons Ltd.

Psychometric evaluation of the Swedish adaptation of the Inventory for Assessing the Process of Cultural Competence Among Healthcare Professionals--Revised (IAPCC-R).

PubMed

Olt, Helen; Jirwe, Maria; Gustavsson, Petter; Emami, Azita

2010-01-01

The purpose of this study was to describe the translation, adaption, and psychometric evaluation process in relation to validity and reliability of the Swedish version of the instrument, Inventory for Assessing The Process of Cultural Competence Among Healthcare Professionals-Revised (IAPCC-R) following the translation, adaptation, and psychometric evaluation process. Validity tests were conducted on the response processes (N = 15), the content (N = 7), and the internal structure of the instrument (N = 334). Reliability (alpha = .65 for the total scale varying between -.01 and .65 for the different subscales) was evaluated in terms of internal consistency. Results indicated weak validity and reliability though it is difficult to conclude whether this is related to adaptation issues or the original construction.The testing of the response process identified problems in relation to respondents' conceptualization of cultural competence. The test of the content identified a weak correspondence between the items and the underlying model. In addition, a confirmatory factor analysis did not confirm the proposed structure of the instrument. This study concludes that this instrument is not valid and reliable for use with a Swedish population of practicing nurses or nursing students.

Validity and Reliability of a Parental Self-Efficacy Instrument in the Healthy School Start Prevention Trial of Childhood Obesity

ERIC Educational Resources Information Center

Bohman, Benjamin; Nyberg, Gisela; Sundblom, Elinor; Schäfer Elinder, Liselotte

2014-01-01

Introduction: Measures of parental self-efficacy (PSE) for healthy dietary or physical activity (PA) behaviors in children have been used in several studies; however, further psychometric validation of PSE for these behaviors is needed. The purpose of the present study was to evaluate the psychometric properties of a new PSE instrument. Methods:…

Psychometric Properties of a Scale to Assess Parental Self-Efficacy for Influencing Children's Dietary, Physical Activity, Sedentary, and Screen Time Behaviors in Disadvantaged Areas

ERIC Educational Resources Information Center

Norman, Åsa; Bohman, Benjamin; Nyberg, Gisela; Schäfer Elinder, Liselotte

2018-01-01

Background: According to social cognitive theory, self-efficacy is central to behavior change. Consequently, parental self-efficacy (PSE) for influencing children's dietary, physical activity (PA), sedentary, and screen time behaviors is important for child obesity prevention. The aim of this study was to evaluate the psychometric properties of an…

Psychometric Adequacy and Comparability of the Short and Full forms of the Personality Assessment Inventory

ERIC Educational Resources Information Center

Frazier, Thomas W.; Naugle, Richard I.; Haggerty, Kathryn A.

2006-01-01

The 160-item short form of the Personality Assessment Inventory (PAI) was developed for situations in which respondents complete only the 1st half of the test. The present study evaluates the adequacy and comparability of the full and short forms of the PAI in terms of a wide range of psychometric characteristics. In all, 421 participants…

Incomplete Psychometric Equivalence of Scores Obtained on the Manual and the Computer Version of the Wisconsin Card Sorting Test?

ERIC Educational Resources Information Center

Steinmetz, Jean-Paul; Brunner, Martin; Loarer, Even; Houssemand, Claude

2010-01-01

The Wisconsin Card Sorting Test (WCST) assesses executive and frontal lobe function and can be administered manually or by computer. Despite the widespread application of the 2 versions, the psychometric equivalence of their scores has rarely been evaluated and only a limited set of criteria has been considered. The present experimental study (N =…

M-Learning: A Psychometric Study of the Mobile Learning Perception Scale and the Relationships between Teachers' Perceptions and School Level

ERIC Educational Resources Information Center

Roche, Allyn J.

2013-01-01

The purpose of this research was to evaluate the psychometric properties of Uzunboylu and Ozdamli (2011) Mobile Learning Perception Scale (MLPS) in order to determine whether it was an acceptable instrument to measure U.S. teachers' perception of mobile learning (m-learning) in the classroom. A second purpose was to determine if relationships…

The Screening Tool of Feeding Problems Applied to Children (STEP-CHILD): Psychometric Characteristics and Associations with Child and Parent Variables

ERIC Educational Resources Information Center

Seiverling, Laura; Hendy, Helen M.; Williams, Keith

2011-01-01

The present study evaluated the 23-item Screening Tool for Feeding Problems (STEP; Matson & Kuhn, 2001) with a sample of children referred to a hospital-based feeding clinic to examine the scale's psychometric characteristics and then demonstrate how a children's revision of the STEP, the STEP-CHILD is associated with child and parent variables.…

Modeling the Test-Taking Motivation Construct through Investigation of Psychometric Properties of an Expectancy-Value-Based Questionnaire

ERIC Educational Resources Information Center

Knekta, Eva; Eklöf, Hanna

2015-01-01

The aim of this study was to evaluate the psychometric properties of an expectancy-value-based questionnaire measuring five aspects of test-taking motivation (effort, expectancies, importance, interest, and test anxiety). The questionnaire was distributed to a sample of Swedish Grade 9 students taking a low-stakes (n = 1,047) or a high-stakes (n =…

Psychometric Evaluation of the Theory of Mind Inventory (ToMI): A Study of Typically Developing Children and Children with Autism Spectrum Disorder

ERIC Educational Resources Information Center

Hutchins, Tiffany L.; Prelock, Patricia A.; Bonazinga, Laura

2012-01-01

Two studies examined the psychometric properties of the Theory of Mind Inventory (ToMI). In Study One, 135 caregivers completed the ToMI for children (ages 3 through 17) with autism spectrum disorder (ASD). Findings revealed excellent test-retest reliability and internal consistency. Principle Components Analysis revealed three subscales related…

Quality improvement of forensic mental health evaluations and reports of youth in the Netherlands.

PubMed

Duits, Nils; van der Hoorn, Steven; Wiznitzer, Martin; Wettstein, Robert M; de Beurs, Edwin

2012-01-01

Quality improvement of forensic mental health evaluations and reports is needed, but little information is available on how this can be attained, and relatively little conceptual analysis has been undertaken. The STAR, a standardized evaluation instrument of the quality of forensic mental health reports of youth, is developed on the basis of concept mapping to clarify the different perspectives on usability of these reports. Psychometric data are provided, demonstrating the reliability and supporting the validity of the STAR. The Dutch forensic context is described to better understand the development and psychometric properties of this standardized instrument. Quality improvement possibilities of forensic mental health evaluations and reports are discussed. Copyright © 2012 Elsevier Ltd. All rights reserved.

Review of the Draw a Person: Screening Procedure for Emotional Disturbance.

ERIC Educational Resources Information Center

Trevisan, Michael S.

1996-01-01

The Draw a Person: Screening Procedures for Emotional Disturbance (DAP:SPED) is a projective technique used in the initial assessment of children suffering from emotional problems, and unlike most projective techniques, features sound psychometric development. (Author)

Scenes for Social Information Processing in Adolescence: Item and factor analytic procedures for psychometric appraisal.

PubMed

Vagos, Paula; Rijo, Daniel; Santos, Isabel M

2016-04-01

Relatively little is known about measures used to investigate the validity and applications of social information processing theory. The Scenes for Social Information Processing in Adolescence includes items built using a participatory approach to evaluate the attribution of intent, emotion intensity, response evaluation, and response decision steps of social information processing. We evaluated a sample of 802 Portuguese adolescents (61.5% female; mean age = 16.44 years old) using this instrument. Item analysis and exploratory and confirmatory factor analytic procedures were used for psychometric examination. Two measures for attribution of intent were produced, including hostile and neutral; along with 3 emotion measures, focused on negative emotional states; 8 response evaluation measures; and 4 response decision measures, including prosocial and impaired social behavior. All of these measures achieved good internal consistency values and fit indicators. Boys seemed to favor and choose overt and relational aggression behaviors more often; girls conveyed higher levels of neutral attribution, sadness, and assertiveness and passiveness. The Scenes for Social Information Processing in Adolescence achieved adequate psychometric results and seems a valuable alternative for evaluating social information processing, even if it is essential to continue investigation into its internal and external validity. (c) 2016 APA, all rights reserved.

Development and psychometric evaluation of the Thirst Distress Scale for patients with heart failure.

PubMed

Waldréus, Nana; Jaarsma, Tiny; van der Wal, Martje Hl; Kato, Naoko P

2018-03-01

Patients with heart failure can experience thirst distress. However, there is no instrument to measure this in patients with heart failure. The aim of the present study was to develop the Thirst Distress Scale for patients with Heart Failure (TDS-HF) and to evaluate psychometric properties of the scale. The TDS-HF was developed to measure thirst distress in patients with heart failure. Face and content validity was confirmed using expert panels including patients and healthcare professionals. Data on the TDS-HF was collected from patients with heart failure at outpatient heart failure clinics and hospitals in Sweden, the Netherlands and Japan. Psychometric properties were evaluated using data from 256 heart failure patients (age 72±11 years). Concurrent validity of the scale was assessed using a thirst intensity visual analogue scale. Patients did not have any difficulties answering the questions, and time taken to answer the questions was about five minutes. Factor analysis of the scale showed one factor. After psychometric testing, one item was deleted. For the eight item TDS-HF, a single factor explained 61% of the variance and Cronbach's alpha was 0.90. The eight item TDS-HF was significantly associated with the thirst intensity score ( r=0.55, p<0.001). Regarding test-retest reliability, the intraclass correlation coefficient was 0.88, and the weighted kappa values ranged from 0.29-0.60. The eight-item TDS-HF is valid and reliable for measuring thirst distress in patients with heart failure.

Psychometric assessment of the Family Satisfaction in the Intensive Care Unit questionnaire in the United Kingdom.

PubMed

Harrison, David A; Ferrando-Vivas, Paloma; Wright, Stephen E; McColl, Elaine; Heyland, Daren K; Rowan, Kathryn M

2017-04-01

To establish the psychometric properties of the Family Satisfaction in the Intensive Care Unit 24-item (FS-ICU-24) questionnaire in the United Kingdom. The Family-Reported Experiences Evaluation study recruited family members of patients staying at least 24 hours in 20 participating intensive care units. Questionnaires were evaluated for nonresponse, floor/ceiling effects, redundancy, and construct validity. Internal consistency was evaluated with item-to-own scale correlations and Cronbach α. Confirmatory and exploratory factor analyses were used to explore the underlying structure. Twelve thousand three hundred forty-six family members of 6380 patients were recruited and 7173 (58%) family members of 4615 patients returned a completed questionnaire. One family member per patient was included in the psychometric assessment. Six items had greater than 10% nonresponse; 1 item had a ceiling effect; and 11 items had potential redundancy. Internal consistency was high (Cronbach α, overall .96; satisfaction with care, .94; satisfaction with decision making, .93). The 2-factor solution was not a good fit. Exploratory factor analysis indicated that satisfaction with decision making encompassed 2 constructs-satisfaction with information and satisfaction with the decision-making process. The Family Satisfaction in the Intensive Care Unit 24-item questionnaire demonstrated good psychometric properties in the United Kingdom setting. Construct validity could be improved by use of 3 domains and some scope for further improvement was identified. Copyright © 2016 Elsevier Inc. All rights reserved.

Quality of care in the intensive care unit from the perspective of patient's relatives: development and psychometric evaluation of the consumer quality index 'R-ICU'.

PubMed

Rensen, Ans; van Mol, Margo M; Menheere, Ilse; Nijkamp, Marjan D; Verhoogt, Ellen; Maris, Bea; Manders, Willeke; Vloet, Lilian; Verharen, Lisbeth

2017-01-24

The quality standards of the Dutch Society of Intensive Care require monitoring of the satisfaction of patient's relatives with respect to care. Currently, no suitable instrument is available in the Netherlands to measure this. This study describes the development and psychometric evaluation of the questionnaire-based Consumer Quality Index 'Relatives in Intensive Care Unit' (CQI 'R-ICU'). The CQI 'R-ICU' measures the perceived quality of care from the perspective of patients' relatives, and identifies aspects of care that need improvement. The CQI 'R-ICU' was developed using a mixed method design. Items were based on quality of care aspects from earlier studies and from focus group interviews with patients' relatives. The time period for the data collection of the psychometric evaluation was from October 2011 until July 2012. Relatives of adult intensive care patients in one university hospital and five general hospitals in the Netherlands were approached to participate. Psychometric evaluation included item analysis, inter-item analysis, and factor analysis. Twelve aspects were noted as being indicators of quality of care, and were subsequently selected for the questionnaire's vocabulary. The response rate of patients' relatives was 81% (n = 455). Quality of care was represented by two clusters, each showing a high reliability: 'Communication' (α = .80) and 'Participation' (α = .84). Relatives ranked the following aspects for quality of care as most important: no conflicting information, information from doctors and nurses is comprehensive, and health professionals take patients' relatives seriously. The least important care aspects were: need for contact with peers, nuisance, and contact with a spiritual counsellor. Aspects that needed the most urgent improvement (highest quality improvement scores) were: information about how relatives can contribute to the care of the patient, information about the use of meal-facilities in the hospital, and involvement in decision-making on the medical treatment of the patient. The CQI 'R-ICU' evaluates quality of care from the perspective of relatives of intensive care patients and provides practical information for quality assurance and improvement programs. The development and psychometric evaluation of the CQI 'R-ICU' led to a draft questionnaire, sufficient to justify further research into the reliability, validity, and the discriminative power of the questionnaire.

Construction and initial validation of the self-worth protection scale.

PubMed

Thompson, Ted; Dinnel, Dale L

2003-03-01

The self-worth theory of achievement motivation holds that in certain circumstances students stand to gain by deliberately withdrawing effort. When failure occurs despite effort, students are likely to conclude that failure resulted from lack of ability. Thus, withdrawing effort offers a defence against conclusions of low ability, thereby protecting self-worth. We undertook to assess the psychometric properties of the Self-Worth Protection Scale (SWPS). Data were obtained from 243 participants (Study 1) and 411 participants (Study 2) enrolled in undergraduate psychology courses at a university in the United States. We administered a number of scales, including the SWPS and scales assessing a fear of negative evaluation, academic self-esteem, uncertain global self-evaluations, self-handicapping, and causal uncertainty. Exploratory factor analysis indicated a three-factor solution (ability doubts, the importance of ability as a criterion of self-worth, and an avoidance orientation) utilising 33 of the original 44 items. A confirmatory factor analysis indicated that this three-factor solution was a poor fit of the data. After modifying the model, a confirmatory factor analysis indicated that a three-factor solution with 26 of the original items and a higher order factor of self-worth protection was an adequate fit of the data. Reliability measures were acceptable for the three subscales and total score. The total score of the SWPS was positively correlated with theoretically related constructs, demonstrating construct validity. The SWPS appears to be a psychometrically sound scale to assist in identifying individuals who manifest self-worth protection in achievement situations.

Development and Evaluation of the PROMIS® Pediatric Positive Affect Item Bank, Child-Report and Parent-Proxy Editions.

PubMed

Forrest, Christopher B; Ravens-Sieberer, Ulrike; Devine, Janine; Becker, Brandon D; Teneralli, Rachel; Moon, JeanHee; Carle, Adam; Tucker, Carole A; Bevans, Katherine B

2018-03-01

The purpose of this study is to describe the psychometric evaluation and item response theory calibration of the PROMIS Pediatric Positive Affect item bank, child-report and parent-proxy editions. The initial item pool comprising 53 items, previously developed using qualitative methods, was administered to 1,874 children 8-17 years old and 909 parents of children 5-17 years old. Analyses included descriptive statistics, reliability, factor analysis, differential item functioning, and construct validity. A total of 14 items were deleted, because of poor psychometric performance, and an 8-item short form constructed from the remaining 39 items was administered to a national sample of 1,004 children 8-17 years old, and 1,306 parents of children 5-17 years old. The combined sample was used in item response theory (IRT) calibration analyses. The final item bank appeared unidimensional, the items appeared locally independent, and the items were free from differential item functioning. The scales showed excellent reliability and convergent and discriminant validity. Positive affect decreased with children's age and was lower for those with a special health care need. After IRT calibration, we found that 4 and 8 item short forms had a high degree of precision (reliability) across a wide range of the latent trait (>4 SD units). The PROMIS Pediatric Positive Affect item bank and its short forms provide an efficient, precise, and valid assessment of positive affect in children and youth.

Evaluating nursing administration instruments.

PubMed

Huber, D L; Maas, M; McCloskey, J; Scherb, C A; Goode, C J; Watson, C

2000-05-01

To identify and evaluate available measures that can be used to examine the effects of management innovations in five important areas: autonomy, conflict, job satisfaction, leadership, and organizational climate. Management interventions target the context in which care is delivered and through which evidence for practice diffuses. These innovations need to be evaluated for their effects on desired outcomes. However, busy nurses may not have the time to locate, evaluate, and select instruments to measure expected nursing administration outcomes without research-based guidance. Multiple and complex important contextual variables need psychometrically sound and easy-to-use measurement instruments identified for use in both practice and research. An expert focus group consensus methodology was used in this evaluation research to review available instruments in the five areas and evaluate which of these instruments are psychometrically sound and easy to use in the practice setting. The result is a portfolio of measures, clustered by concept and displayed on a spreadsheet. Retrieval information is provided. The portfolio includes the expert consensus judgment as well as useful descriptive information. The research reported here identifies psychometrically sound and easy-to-use instruments for measuring five key variables to be included in a portfolio. The results of this study can be used as a beginning for saving time in instrument selection and as an aid for determining the best instrument for measuring outcomes from a clinical or management intervention.

Examination of Psychometric Properties of a Translated Social-Emotional Screening Test: The Taiwanese Version of The Ages and Stages Questionnaires: Social-Emotional

ERIC Educational Resources Information Center

Chen, Chieh-Yu

2017-01-01

Investigating the psychometric properties of a screening instrument for young children is necessary to ascertain its quality and accuracy. In light of the important role culture plays on human beliefs and parenting styles, a newly translated and adapted test needs to be studied. Evaluating outcomes on a translated version of a test may reveal…

Psychometrics of the scale of attitudes toward physician-pharmacist collaboration: a study with medical students.

PubMed

Hojat, Mohammadreza; Spandorfer, John; Isenberg, Gerald A; Vergare, Michael J; Fassihi, Reza; Gonnella, Joseph S

2012-01-01

Despite the emphasis placed on interdisciplinary education and interprofessional collaboration between physicians and pharmacologists, no psychometrically sound instrument is available to measure attitudes toward collaborative relationships. This study was designed to examine psychometrics of an instrument for measuring attitudes toward physician-pharmacist collaborative relationships for administration to students in medical and pharmacy schools and to physicians and pharmacists. The Scale of Attitudes Toward Physician-Pharmacist Collaboration was completed by 210 students at Jefferson Medical College. Factor analysis and correlational methods were used to examine psychometrics of the instrument. Consistent with the conceptual framework of interprofessional collaboration, three underlying constructs, namely "responsibility and accountability;" "shared authority;" and "interdisciplinary education" emerged from the factor analysis of the instrument providing support for its construct validity. The reliability coefficient alpha for the instrument was 0.90. The instrument's criterion-related validity coefficient with scores of a validated instrument (Jefferson Scale of Attitudes Toward Physician-Nurse Collaboration) was 0.70. Findings provide support for the validity and reliability of the instrument for medical students. The instrument has the potential to be used for the evaluation of interdisciplinary education in medical and pharmacy schools, and for the evaluation of patient outcomes resulting from collaborative physician-pharmacist relationships.

Psychometric Properties of the Diabetes Management Self-Efficacy Scale in Korean Patients with Type 2 Diabetes.

PubMed

Lee, Eun-Hyun; van der Bijl, Jaap; Shortridge-Baggett, Lillie M; Han, Seung Jin; Moon, Seung Hei

2015-01-01

Objectives. The aims of this study were to perform a cultural translation of the DMSES and evaluate the psychometric properties of the translated scale in a Korean population with type 2 diabetics. Methods. This study was conducted in patients with diabetes recruited from university hospitals. The first stage of this study involved translating the DMSES into Korean using a forward- and backward-translation technique. The content validity was assessed by an expert group. In the second stage, the psychometric properties of the Korean version of the DMSES (K-DMSES) were evaluated. Results. The content validity of the K-DMSES was satisfactory. Sixteen-items clustered into four-subscales were extracted by exploratory factor analysis, and supported by confirmatory factor analysis. The construct validity of the K-DMSES with the Summary of Diabetes Self-Care Activities scale was satisfactory (r = 0.50, P<0.001). The Cronbach's alpha and intraclass correlation coefficient were 0.92 and 0.85 (P<0.001; 95% CI = 0.75-0.91), respectively, which indicate excellent internal consistency reliability and test-retest reliability. Conclusions. The K-DMSES is a brief instrument that has demonstrated good psychometric properties. It is therefore feasible to use in practice, and is ready for use in clinical research involving Korean patients with type 2 diabetes.

Psychometric properties of the Chinese version of the Pediatric Quality of Life Inventory 4.0 generic core scales.

PubMed

Hao, Yuantao; Tian, Qi; Lu, Yiyun; Chai, Yiming; Rao, Shaoqi

2010-10-01

The aim of this study was to evaluate the psychometric properties of the Chinese version of the Pediatric Quality of Life Inventory 4.0 (PedsQL 4.0) generic core scales. The standard procedure of cross-culture adaptation was used to develop the Chinese version PedsQL4.0. We enrolled 1583 healthy children and 1335 pediatric patients (aged from 5 to 18 years) and 325 proxies. The psychometric properties of the measure were evaluated. The subscales of physical functioning, social functioning and psychosocial showed alpha coefficients above 0.7 for self-report in healthy children and the total pediatric patients, and all coefficients were higher than 0.7 for proxy report for all subscales. There were higher correlations between items and hypothesized subscales than with other subscales. Healthy children reported higher scores than pediatric patients in all subscales. Confirmatory factor analysis showed that some of the indices of goodness of fit did not reach the standard of acceptable construct validity. Moderate to high correlations were found between self-reported and proxy-reported scores. The Chinese version PedsQL4.0 has acceptable psychometric properties except the construct validity tested by confirmatory factor analysis and the internal reliability for self-report in pediatric patients with migraine or Gilles and Tourette's syndrome.

Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 1—Psychometric Characteristics of 5 Paradigms.

PubMed

Reddy, L Felice; Horan, William P; Barch, Deanna M; Buchanan, Robert W; Dunayevich, Eduardo; Gold, James M; Lyons, Naomi; Marder, Stephen R; Treadway, Michael T; Wynn, Jonathan K; Young, Jared W; Green, Michael F

2015-09-01

Impairments in willingness to exert effort contribute to the motivational deficits characteristic of the negative symptoms of schizophrenia. The current study evaluated the psychometric properties of 5 new or adapted paradigms to determine their suitability for use in clinical trials of schizophrenia. This study included 94 clinically stable participants with schizophrenia and 40 healthy controls. The effort-based decision-making battery was administered twice to the schizophrenia group (baseline, 4-week retest) and once to the control group. The 5 paradigms included 1 that assesses cognitive effort, 1 perceptual effort, and 3 that assess physical effort. Each paradigm was evaluated on (1) patient vs healthy control group differences, (2) test-retest reliability, (3) utility as a repeated measure (ie, practice effects), and (4) tolerability. The 5 paradigms showed varying psychometric strengths and weaknesses. The Effort Expenditure for Rewards Task showed the best reliability and utility as a repeated measure, while the Grip Effort Task had significant patient-control group differences, and superior tolerability and administration duration. The other paradigms showed weaker psychometric characteristics in their current forms. These findings highlight challenges in adapting effort and motivation paradigms for use in clinical trials. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center 2015.

Development and psychometric testing of a new instrument to measure the caring behaviour of nurses in Italian acute care settings.

PubMed

Piredda, Michela; Ghezzi, Valerio; Fenizia, Elisa; Marchetti, Anna; Petitti, Tommasangelo; De Marinis, Maria Grazia; Sili, Alessandro

2017-12-01

To develop and psychometrically test the Italian-language Nurse Caring Behaviours Scale, a short measure of nurse caring behaviour as perceived by inpatients. Patient perceptions of nurses' caring behaviours are a predictor of care quality. Caring behaviours are culture-specific, but no measure of patient perceptions has previously been developed in Italy. Moreover, existing tools show unclear psychometric properties, are burdensome for respondents, or are not widely applicable. Instrument development and psychometric testing. Item generation included identifying and adapting items from existing measures of caring behaviours as perceived by patients. A pool of 28 items was evaluated for face validity. Content validity indexes were calculated for the resulting 15-item scale; acceptability and clarity were pilot tested with 50 patients. To assess construct validity, a sample of 2,001 consecutive adult patients admitted to a hospital in 2014 completed the scale and was split into two groups. Reliability was evaluated using nonlinear structural equation modelling coefficients. Measurement invariance was tested across subsamples. Item 15 loaded poorly in the exploratory factor analysis (n = 983) and was excluded from the final solution, positing a single latent variable with 14 indicators. This model fitted the data moderately. The confirmatory factor analysis (n = 1018) returned similar results. Internal consistency was excellent in both subsamples. Full scalar invariance was reached, and no significant latent mean differences were detected across subsamples. The new instrument shows reasonable psychometric properties and is a promising short and widely applicable measure of inpatient perceptions of nurse caring behaviours. © 2017 John Wiley & Sons Ltd.

The Assessment of Recovery Capital: properties and psychometrics of a measure of addiction recovery strengths.

PubMed

Groshkova, Teodora; Best, David; White, William

2013-03-01

Sociological work on social capital and its impact on health behaviours have been translated into the addiction field in the form of 'recovery capital' as the construct for assessing individual progress on a recovery journey. Yet there has been little attempt to quantify recovery capital. The aim of the project was to create a scale that assessed addiction recovery capital. Initial focus group work identified and tested candidate items and domains followed by data collection from multiple sources to enable psychometric assessment of a scale measuring recovery capital. The scale shows moderate test-retest reliability at 1 week and acceptable concurrent validity. Principal component analysis determined single factor structure. The Assessment of Recovery Capital (ARC) is a brief and easy to administer measurement of recovery capital that has acceptable psychometric properties and may be a useful complement to deficit-based assessment and outcome monitoring instruments for substance dependent individuals in and out of treatment. © 2012 Australasian Professional Society on Alcohol and other Drugs.

Holistic Health Status Questionnaire: developing a measure from a Hong Kong Chinese population.

PubMed

Chan, Choi Wan; Wong, Frances Kam Yuet; Yeung, Siu Ming; Sum, Fok

2016-02-25

The increased prevalence of chronic diseases is a global health issue. Once chronic disease is diagnosed, individuals face lifelong healthcare treatments, and the disabilities and disturbances resulting from their illness will affect the whole person. A valid tool that can measure clients' holistic care needs is important to enable us to identify issues of concern and address them early to prevent further complications. This study aimed to develop and evaluate the psychometric properties of a scale measuring holistic health among chronically ill individuals. The research was an instrument development and validation study using three samples of Hong Kong Chinese people. The first sample (n = 15) consisted of stroke survivors who had experienced disruption of their total being, and was used as a basis for the generation of scale items. In the second and third samples (n = 319, n = 303), respondents with various chronic illnesses were assessed in order to estimate the psychometric properties of the scale. A total of 52 items were initially generated, and 7 items with a factor loading less than 0.3 were removed in the process, as substantiated by the literature and expert panel reviews. Exploratory factor analysis identified a 45-item, 8-factor Holistic Health Status Questionnaire (HHSQ) that could account for 56.38 % of the variance. The HHSQ demonstrated content validity, acceptable internal consistency (0.59-0.92) and satisfactory convergent validity from moderate to high correlation with similar constructs (r ≥ 0.46, p < 0.01). The HHSQ tapped into the relational experiences and connectedness among the bio-psycho-social-spiritual dimensions of a Chinese person with chronic disease, with acceptable psychometric properties.

Psychometric testing of the properties of the spiritual health scale short form.

PubMed

Hsiao, Ya-Chu; Chiang, Yi-Chien; Lee, Hsiang-Chun; Han, Chin-Yen

2013-11-01

To further examine the psychometric properties of the spiritual health scale short form, including its reliability and validity. Spirituality is one of the main factors associated with good health outcomes. A reliable and valid instrument to measure spirituality is essential to identify the spiritual needs of an individual and to evaluate the effect of spiritual care. A cross-sectional study design was used. The study was conducted in six nursing schools in northern, central and southern Taiwan. The inclusion criterion for participants was nursing students with clinical practice experience. Initially, 1141 participants were recruited for the study, but 67 were absent and 48 did not complete the questionnaires. A total of 1026 participants were finally recruited, indicating a response rate of 89·9%. The psychometric testing of the spiritual health scale short form included construct validity with confirmatory factor analysis, known-group validity and internal consistency reliability. The results of the confirmatory factor analysis supported the five-factor model as an acceptable model fit. In the known-group validity, the results indicated that people who are in the category of primary religious affiliation have better spiritual health than people in the category of secondary religious affiliation and atheism. The result also indicated that the 24-item spiritual health scale short form achieved an acceptable internal consistency coefficient. The findings suggest that the spiritual health scale short form is a valid and reliable instrument for the appraisal of individual spiritual health. The spiritual health scale short form could provide useful information to guide clinical practice in assessing and managing people's spiritual health in Taiwan. © 2013 John Wiley & Sons Ltd.

Psychometric Validation of the Pulmonary Arterial Hypertension-Symptoms and Impact (PAH-SYMPACT®) Questionnaire: Results of the SYMPHONY Trial.

PubMed

Chin, Kelly M; Gomberg-Maitland, Mardi; Channick, Richard N; Cuttica, Michael J; Fischer, Aryeh; Frantz, Robert P; Hunsche, Elke; Kleinman, Leah; McConnell, John W; McLaughlin, Vallerie V; Miller, Chad E; Zamanian, Roham T; Zastrow, Michael S; Badesch, David B

2018-04-26

Disease-specific patient-reported outcome (PRO) instruments are important in assessing the impact of disease and treatment. PAH-SYMPACT ® is the first questionnaire for quantifying pulmonary arterial hypertension (PAH) symptoms and impacts developed following the 2009 FDA PRO guidance; previous qualitative research with PAH patients supported its initial content validity. Content finalization and psychometric validation were conducted using data from SYMPHONY, a single-arm, 16-week study with macitentan 10mg in US patients with PAH. Item performance, Rasch, and factor analyses were used to select final item content of the PRO and define its domain structure. Internal consistency, test-retest reliability, known-group and construct validity, sensitivity to change, and influence of oxygen on item performance were evaluated. Data from 278 patients (79% female, mean age 60 years) were analyzed. Following removal of redundant/misfitting items, the final questionnaire has 11 symptom items across 2 domains (cardiopulmonary and cardiovascular symptoms) and 11 impact items across 2 domains (physical and cognitive/emotional impacts). Differential item function analysis confirmed PRO scoring is unaffected by oxygen use. For all 4 domains, internal consistency reliability was high (Cronbach's alpha >0.80) and scores were highly reproducible in stable patients (intra-class correlation coefficient 0.84-0.94). Correlations with CAMPHOR and SF-36 were moderate-to-high ([r]=0.34-0.80). The questionnaire differentiated well between patients with different disease severity levels, and was sensitive to improvements in clinician- and patient-reported disease severity. The PAH-SYMPACT ® is a brief, disease-specific PRO instrument possessing good psychometric properties which can be administered in clinical practice and clinical studies. Copyright © 2018. Published by Elsevier Inc.

Psychometric properties of self-reported questionnaires for the evaluation of symptoms and functional limitations in individuals with rotator cuff disorders: a systematic review.

PubMed

St-Pierre, Corinne; Desmeules, François; Dionne, Clermont E; Frémont, Pierre; MacDermid, Joy C; Roy, Jean-Sébastien

2016-01-01

To conduct a systematic review of the psychometric properties (reliability, validity and responsiveness) of self-report questionnaires used to assess symptoms and functional limitations of individuals with rotator cuff (RC) disorders. A systematic search in three databases (Cinahl, Medline and Embase) was conducted. Data extraction and critical methodological appraisal were performed independently by three raters using structured tools, and agreement was achieved by consensus. A descriptive synthesis was performed. One-hundred and twenty articles reporting on 11 questionnaires were included. All questionnaires were highly reliable and responsive to change, and showed construct validity; seven questionnaires also shown known-group validity. The minimal detectable change ranged from 6.4% to 20.8% of total score; only two questionnaires (American Shoulder and Elbow Surgeon questionnaire [ASES] and Upper Limb Functional Index [ULFI]) had a measurement error below 10% of global score. Minimal clinically important differences were established for eight questionnaires, and ranged from 8% to 20% of total score. Overall, included questionnaires showed acceptable psychometric properties for individuals with RC disorders. The ASES and ULFI have the smallest absolute error of measurement, while the Western Ontario RC Index is one of the most responsive questionnaires for individuals suffering from RC disorders. All included questionnaires are reliable, valid and responsive for the evaluation of individuals with RC disorders. As all included questionnaires showed good psychometric properties for the targeted population, the choice should be made according to the purpose of the evaluation and to the construct being evaluated by the questionnaire. The WORC, a RC-specific questionnaire, appeared to be more responsive. It should therefore be used to evaluate change in time. If the evaluation is time-limited, shorter questionnaires or short versions should be considered (such as Quick DASH or SST).

Assessing Adult Exposure to Community Violence: A Review of Definitions and Measures.

PubMed

DeCou, Christopher R; Lynch, Shannon M

2017-01-01

Although experiences of community violence are linked with negative outcomes for adults and children, few standardized measures assessing community violence exist, and available measures lack consistency concerning the definition of community violence. Further, most measures currently utilized to assess adult exposure to community violence were designed for use with children and adolescents. To address these identified concerns and make recommendations for future research, this article reviews contemporary definitions of community violence, identifies the outcomes of exposure to community violence for adults, and evaluates measures of exposure to community violence with published psychometric data employing adult samples. A systematic review of the literature was conducted to identify studies that (1) included a self-report of community violence exposure, (2) included primarily adult respondents, and (3) reported psychometric data. Seventeen studies met the inclusion criteria. Measures employed in these studies were reviewed and basic psychometric properties discussed. Notably, the Survey of Exposure to Community Violence was the most commonly used measure among these studies. Although multiple measures demonstrated limited but acceptable psychometric performance in select studies, few in-depth psychometric analyses exist for measures of adult exposure to community violence. Also, it is difficult to compare studies due to variations in definitions of community violence and multiple versions of each measure. Recommendations for future research include provision of explicit definitions of community violence and reporting psychometric data for measures. © The Author(s) 2015.

Psychometric characteristics of health-related quality-of-life questionnaires in oropharyngeal dysphagia.

PubMed

Timmerman, Angelique A; Speyer, Renée; Heijnen, Bas J; Klijn-Zwijnenberg, Iris R

2014-04-01

Dysphagia can have severe consequences for the patient's health, influencing health-related quality of life (HRQoL). Sound psychometric properties of HRQoL questionnaires are a precondition for assessing the impact of dysphagia, the focus of this study, resulting in recommendations for the appropriate use of these questionnaires in both clinical practice and research contexts. We performed a systematic review starting with a search for and retrieval of all full-text articles on the development of HRQoL questionnaires related to oropharyngeal dysphagia and/or their psychometric validation from the electronic databases PubMed and Embase published up to June 2011. Psychometric properties were judged according to quality criteria proposed for health status questionnaires. Eight questionnaires were included in this study. Four are aimed solely at HRQoL in oropharyngeal dysphagia: the deglutition handicap index (DHI), dysphagia handicap index (DHI'), M.D. Anderson Dysphagia Inventory (MDADI), and SWAL-QOL, while the EDGQ, EORTC QLQ-STO 22, EORTC QLQ-OG 25 and EORTC QLQ-H&N35 focus on other primary diseases resulting in dysphagia. The psychometric properties of the DHI, DHI', MDADI, and SWAL-QOL were evaluated. For appropriate applicability of HRQoL questionnaires, strong scores on the psychometric criteria face validity, criterion validity, and interpretability are prerequisites. The SWAL-QOL has the strongest ratings for these criteria, while the DHI' is the most easy to apply given its 25 items and the use of a uniform scoring format. For optimal use of HRQoL questionnaires in diverse settings, it is necessary to combine psychometric and utility approaches.

The MOVES (Motor tic, Obsessions and compulsions, Vocal tic Evaluation Survey): cross-cultural evaluation of the French version and additional psychometric assessment.

PubMed

Jalenques, Isabelle; Guiguet-Auclair, Candy; Derost, Philippe; Joubert, Pauline; Foures, Louis; Hartmann, Andreas; Muellner, Julia; Rondepierre, Fabien

2018-03-01

The Motor tic, Obsessions and compulsions, Vocal tic Evaluation Survey (MOVES) is a self-report scale suggested as a severity scale for tics and related sensory phenomena observed in Gilles de la Tourette syndrome (GTS) and recommended as a screening instrument by the Committee on Rating Scale Development of the International Parkinson's Disease and Movement Disorder Society. To cross-culturally adapt a French version of the MOVES and to evaluate its psychometric properties. After the cross-cultural adaptation of the MOVES, we assessed its psychometric properties in 53 patients aged 12-16 years and in 54 patients aged 16 years and above: reliability and construct validity (relationships between items and scales), internal consistency and concurrent validity with the Yale Global Tic Severity Scale (YGTSS) and the Children's Yale-Brown Obsessive-Compulsive Scale (CY-BOCS) or the auto-Yale-Brown scale. The results showed very good acceptability with response rates greater than 92%, good internal consistency (Cronbach's alpha ranging from 0.62 and 0.89) and good test-retest reliability (ICCs ranging from 0.59 to 0.91). Concurrent validity with the YGTSS, CY-BOCS and auto-Yale-Brown scales showed strong expected correlations. The cut-off points tested for diagnostic performance gave satisfactory values of sensitivity, specificity, and positive and negative predictive values. Our study provides evidence of the good psychometric properties of the French version of the MOVES. The cross-cultural adaptation of this specific instrument will allow investigators to include French-speaking persons with GTS aged 12 years and over in national and international collaboration research projects.

Psychometric Evaluation of the Hypogonadism Impact of Symptoms Questionnaire Short Form (HIS-Q-SF).

PubMed

Gelhorn, Heather L; Roberts, Laurie J; Khandelwal, Nikhil; Revicki, Dennis A; DeRogatis, Leonard R; Dobs, Adrian; Hepp, Zsolt; Miller, Michael G

2017-08-01

The Hypogonadism Impact of Symptoms Questionnaire Short Form (HIS-Q-SF) is a patient-reported outcome measurement designed to evaluate the symptoms of hypogonadism. The HIS-Q-SF is an abbreviated version including17 items from the original 28-item HIS-Q. To conduct item analyses and reduction, evaluate the psychometric properties of the HIS-Q-SF, and provide guidance on score interpretation. A 12-week observational longitudinal study of hypogonadal men was conducted as part of the original HIS-Q psychometric evaluation. Participants completed the original HIS-Q every 2 weeks. Blood samples were collected to evaluate testosterone levels. Participants completed the Aging Male's Symptoms Scale, the International Index of Erectile Function, the Short Form-12, and the PROMIS Sexual Activity, Satisfaction with Sex Life, Sleep Disturbance, and Applied Cognition Scales (baseline and weeks 6 and 12). Clinicians completed the Clinical Global Impression of Severity and Change scales and a clinical form. Item performance was evaluated using descriptive statistics and Rasch analyses. Reliability (internal consistency and test-retest), validity (concurrent and know groups), and responsiveness were assessed. One hundred seventy-seven men participated (mean age = 54.1 years, range = 23-83). Similar to the full HIS-Q, the final abbreviated HIS-Q-SF instrument includes five domains (sexual, energy, sleep, cognition, and mood) with two sexual subdomains (libido and sexual function). For key domains, test-retest reliability was very good, and construct validity was good for all domains. Known-groups validity was demonstrated for all domain scores, subdomain scores, and total score based on the Clinical Global Impression-Severity. All domains and subdomains were responsive to change based on patient-rated anchor questions. The HIS-Q-SF could be a useful tool in clinical practice, epidemiologic studies, and other academic research settings. Careful consideration was given to the selection of the final HIS-Q-SF items based on quantitative data and clinical expert feedback. Overall, the reduced set of items demonstrated strong psychometric properties. Testosterone levels for the participating men were not as low as anticipated, which could have limited the ability to examine the relations between the HIS-Q-SF and testosterone levels. Further, the analyses used data collected through administration of the full HIS-Q, and future studies should administer the standalone HIS-Q-SF to replicate the psychometric analyses reported in the present study. Similar to the original HIS-Q, the HIS-Q-SF has evidence supporting reliability, validity, and responsiveness. The short form includes a smaller set of items that might be more suitable for use in clinical practice or academic research settings. Gelhorn HL, Roberts LJ, Khandelwal N, et al. Psychometric Evaluation of the Hypogonadism Impact of Symptoms Questionnaire Short Form (HIS-Q-SF). J Sex Med 2017;14:1046-1058. Copyright © 2017 International Society for Sexual Medicine. Published by Elsevier Inc. All rights reserved.

Psychometric evaluation of ADAS-Cog and NTB for measuring drug response.

PubMed

Karin, A; Hannesdottir, K; Jaeger, J; Annas, P; Segerdahl, M; Karlsson, P; Sjögren, N; von Rosen, T; Miller, F

2014-02-01

To conduct a psychometric analysis to determine the adequacy of instruments that measure cognition in Alzheimer's disease trials. Both the Alzheimer's Disease Assessment Scale - Cognition (ADAS-Cog) and the Neuropsychological Test Battery (NTB) are validated outcome measures for clinical trials in Alzheimer's disease and are approved also for regulatory purposes. However, it is not clear how comparable they are in measuring cognitive function. In fact, many recent trials in Alzheimer's disease patients have failed and it has been questioned if ADAS-Cog still is a sensitive measure. The present paper examines the psychometric properties of ADAS-Cog and NTB, based on a post hoc analysis of data from a clinical trial (NCT01024660), which was conducted by AstraZeneca, in mild-to-moderate Alzheimer's disease (AD) patients, with a Mini Mental State Examination (MMSE) Total score 16-24. Acceptability, reliability, different types of validity and ability to detect change were assessed using relevant statistical methods. Total scores of both tests, as well as separate domains of both tests, including the Wechsler Memory Scale (WMS), Rey Auditory Verbal Learning Test (RAVLT) and Delis-Kaplan Executive Function System (D-KEFS) Verbal Fluency Condition, were analyzed. Overall, NTB performed well, with acceptable reliability and ability to detect change, while ADAS-Cog had insufficient psychometric properties, including ceiling effects in 8 out of a total of 11 ADAS-Cog items in mild AD patients, as well as low test-retest reliability in some of the items. Based on a direct comparison on the same patient sample, we see advantages of the NTB compared with the ADAS-Cog for the evaluation of cognitive function in the population of mild-to-moderate AD patients. The results suggest that not all of ADAS-Cog items are relevant for both mild and moderate AD population. This validation study demonstrates satisfactory psychometric properties of the NTB, while ADAS-Cog was found to be psychometrically inadequate. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Psychometric Evaluation of the MMPI-2/MMPI-2-RF Restructured Clinical Scales in an Israeli Sample.

PubMed

Shkalim, Eleanor

2015-10-01

The current study cross-culturally evaluated the psychometric properties of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2)/MMPI-2-Restructured Form Restructured Clinical (RC) Scales in psychiatric settings in Israel with a sample of 100 men and 133 women. Participants were administered the MMPI-2 and were rated by their therapists on a 188-item Patient Description Form. Results indicated that in most instances the RC Scales demonstrated equivalent or better internal consistencies and improved intercorrelation patterns relative to their clinical counterparts. Furthermore, external analyses revealed comparable or improved convergent validity (with the exceptions of Antisocial Behavior [RC4] and Ideas of Persecution [RC6] among men), and mostly greater discriminant validity. Overall, the findings indicate that consistent with previous findings, the RC Scales generally exhibit comparable to improved psychometric properties over the Clinical Scales. Implications of the results, limitations, and recommendations for future research are discussed. © The Author(s) 2014.

Psychometric testing of the Chinese version of the medical outcomes study social support survey (MOS-SSS-C).

PubMed

Yu, Doris S F; Lee, Diana T F; Woo, Jean

2004-04-01

The purpose of this study was to assess the psychometric properties of the Chinese version of the Medical Outcomes Study Social Support Survey (MOS-SSS-C) in a sample of 110 patients. Criterion-related and construct validities of the MOS-SSS-C were evaluated by correlations with the Chinese version of the Multidimensional Perceived Social Support Survey (r =.82) and the Hospital Anxiety and Depression Scale (r = -.58). Confirmatory factor analysis affirmed the four-factor structure of the MOS-SSS-C in measuring the functional aspects of perceived social support. Cronbach's alphas for the subscales ranged from.93 to.96, whereas the alpha for the overall scale was.98. The 2-week test-retest reliability of the MOS-SSS-C as measured by the intraclass correlation coefficient was.84. The MOS-SSS-C is a psychometrically sound multidimensional measure for the evaluation of functional aspects of perceived social support by Chinese patients with chronic disease. Copyright 2004 Wiley Periodicals, Inc.

"Who does this body belong to?" The development and psychometric evaluation of the Body Experience during Pregnancy Scale.

PubMed

Talmon, Anat; Ginzburg, Karni

2018-05-25

Women's experiences of their bodies during pregnancy may reflect their reactions to concrete physical changes as well as self-representations during the transition to motherhood. However, adequate measures of the body experience during pregnancy are lacking. This study aims to evaluate the psychometric properties of a new measure, the Body Experience during Pregnancy Scale (BEPS). In Study 1, the BEPS was administered to 423 pregnant women. In Study 2, 373 pregnant women completed the BEPS, as well as questionnaires assessing body shame, disrupted body boundaries, and well-being. Three BEPS subscales emerged from Study 1: body agency, body estrangement, and body visibility. In Study 2, a confirmatory factor analysis replicated the scale's structure. The factors were significantly correlated with measures of body shame, disrupted body boundaries, and well-being. The results of the present analyses suggest that the BEPS has good psychometric properties, making it useful in future research. Copyright © 2018 Elsevier Ltd. All rights reserved.

Assessing Collectivism in Latino, Asian/Pacific Islander, and African American Men Who Have Sex With Men: A Psychometric Evaluation.

PubMed

Sauceda, John A; Paul, Jay P; Gregorich, Steven E; Choi, Kyung-Hee

2016-02-01

The study of collectivism has implications for HIV prevention research, especially in studies that use a social networking or community mobilization approach. However, research on collectivism in race/ethnicity and sexual minority groups is limited. We psychometrically evaluated a brief version of the Individualism-Collectivism Interpersonal Assessment Inventory (ICIAI) in a chain-referral sample of 400 Latino, 393 Asian/Pacific Islander, and 403 African American men who have sex with men (MSM). Data were collected via a one-time survey on demographics, the ICIAI, acculturation, and ethnicity identity. We conducted a multiple groups confirmatory factor analysis to assess for measurement invariance across the three groups of MSM, as well as tested its reliability and validity. The ICIAI evidenced good psychometric properties and was invariant across all groups. We highlight implications for how this measure of collectivism can be applied toward the study of HIV prevention and in lesbian, gay, bisexual and transgender communities.

Assessing collectivism in Latino, Asian/Pacific Islander and African American men who have sex with men: A psychometric evaluation

PubMed Central

Sauceda, John A.; Paul, Jay P.; Gregorich, Steven E.; Choi, Kyung-Hee

2015-01-01

The study of collectivism has implications for HIV prevention research, especially in studies that use a social networking or community mobilization approach. However, research on collectivism in race/ethnicity and sexual minority groups is limited. We psychometrically evaluated a brief version of the Individualism-Collectivism Interpersonal Assessment Inventory (ICIAI) in a chain-referral sample of 400 Latino, 393 Asian/Pacific Islander, and 403 African American men who have sex with men (MSM). Data were collected via a one-time survey on demographics, the ICIAI, acculturation, and ethnicity identity. We conducted a multiple groups confirmatory factor analysis to assess for measurement invariance across the three groups of MSM, as well as tested its reliability and validity. The ICIAI evidenced good psychometric properties and was invariant across all groups. We highlight implications for how this measure of collectivism can be applied toward the study of HIV prevention and in lesbian, gay, bisexual and transgender communities. PMID:26829254

Safer Conception Methods and Counseling: Psychometric Evaluation of New Measures of Attitudes and Beliefs Among HIV Clients and Providers.

PubMed

Woldetsadik, Mahlet Atakilt; Goggin, Kathy; Staggs, Vincent S; Wanyenze, Rhoda K; Beyeza-Kashesya, Jolly; Mindry, Deborah; Finocchario-Kessler, Sarah; Khanakwa, Sarah; Wagner, Glenn J

2016-06-01

With data from 400 HIV clients with fertility intentions and 57 HIV providers in Uganda, we evaluated the psychometrics of new client and provider scales measuring constructs related to safer conception methods (SCM) and safer conception counselling (SCC). Several forms of validity (i.e., content, face, and construct validity) were examined using standard methods including exploratory and confirmatory factor analysis. Internal consistency was established using Cronbach's alpha correlation coefficient. The final scales consisted of measures of attitudes towards use of SCM and delivery of SCC, including measures of self-efficacy and motivation to use SCM, and perceived community stigma towards childbearing. Most client and all provider measures had moderate to high internal consistency (alphas 0.60-0.94), most had convergent validity (associations with other SCM or SCC-related measures), and client measures had divergent validity (poor associations with depression). These findings establish preliminary psychometric properties of these scales and should facilitate future studies of SCM and SCC.

A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings

PubMed Central

Olderbak, Sally; Wilhelm, Oliver; Olaru, Gabriel; Geiger, Mattis; Brenneman, Meghan W.; Roberts, Richard D.

2015-01-01

The Reading the Mind in the Eyes Test is a popular measure of individual differences in Theory of Mind that is often applied in the assessment of particular clinical populations (primarily, individuals on the autism spectrum). However, little is known about the test's psychometric properties, including factor structure, internal consistency, and convergent validity evidence. We present a psychometric analysis of the test followed by an evaluation of other empirically proposed and statistically identified structures. We identified, and cross-validated in a second sample, an adequate short-form solution that is homogeneous with adequate internal consistency, and is moderately related to Cognitive Empathy, Emotion Perception, and strongly related to Vocabulary. We recommend the use of this short-form solution in normal adults as a more precise measure over the original version. Future revisions of the test should seek to reduce the test's reliance on one's vocabulary and evaluate the short-form structure in clinical populations. PMID:26500578

The Symptoms and Functioning Severity Scale (SFSS): Psychometric Evaluation and Discrepancies among Youth, Caregiver, and Clinician Ratings over Time

PubMed Central

Athay, M. Michele; Riemer, Manuel; Bickman, Leonard

2012-01-01

This paper describes the development and psychometric evaluation of the Symptoms and Functioning Severity Scale (SFSS), which includes three parallel forms to systematically capture clinician, youth, and caregiver perspectives of youth symptoms on a frequent basis. While there is widespread consensus that different raters of youth psychopathology vary significantly in their assessment this is the first paper that specifically investigates the discrepancies among clinician, youth, and caregiver ratings in a community mental health setting throughout the treatment process. Results for all three respondent versions indicate the SFSS is a psychometrically sound instrument for use in this population. Significant discrepancies in scores exist at baseline among the three respondents. Longitudinal analyses reveal the youth-clinician and caregiver-clinician score discrepancies decrease significantly over time. Differences by youth gender exist for caregiver-clinician discrepancies. The average youth-caregiver score discrepancy remains consistent throughout treatment. Implications for future research and clinical practice are discussed. PMID:22407556

An interventionist adherence scale for a specialized brief negotiation interview focused on treatment engagement for opioid use disorders.

PubMed

Pantalon, Michael V; Dziura, James; Li, Fang-Yong; Owens, Patricia H; O'Connor, Patrick G; D'Onofrio, Gail

2017-01-01

No psychometrically validated instrument for evaluating the extent to which interventionists correctly implement brief interventions designed to motivate treatment engagement for opioid use disorders has been reported in the literature. The objective of this study was to develop and examine the psychometric properties of the Brief Negotiation Interview (BNI) Adherence Scale for Opioid Use Disorders (BAS-O). In the context of a randomized controlled trial evaluating the efficacy of 3 models of emergency department care for opioid use disorders, the authors developed and subsequently examined the psychometric properties of the BAS-O, a 38-item scale that required raters to answer whether or not ("Yes" or "No") each of the critical actions of the BNI was correctly implemented by the research interventionist. BAS-O items pertained to the BNI's 4 steps: (1) Raise the Subject, (2) Provide Feedback, (3) Enhance Motivation, and (4) Negotiate and Advise. A total of 215 audio-recorded BNI and 88 control encounters were rated by 3 trained raters who were independent of the study team and blind to study hypotheses, treatment, and assignment. The results indicated the BAS-O has fair to excellent psychometric properties, in terms of good internal consistency, excellent interrater reliability, discriminant validity, and construct validity, and fair predictive validity. A 13-item, 2-factor solution accounted for nearly 80% of the variance, where factor 1 addressed "Autonomy and Planning" (7 items) and factor 2 addressed "Motivation and Problems" (6 items). However, predictive validity was found for only one of the BAS-O factor items (i.e., Telling patients that treatment will address a range of issues related to their opioid use disorder). This study suggests that the BAS-O is a psychometrically valid measure of adherence to the specialized BNI for motivating treatment engagement in patients with opioid use disorders, thus providing a brief (13-item), objective method of evaluating BNI skill performance.

Positive mental health literacy: development and validation of a measure among Norwegian adolescents.

PubMed

Bjørnsen, Hanne Nissen; Eilertsen, Mary Elizabeth Bradley; Ringdal, Regine; Espnes, Geir Arild; Moksnes, Unni Karin

2017-09-18

Mental health literacy (MHL), or the knowledge and abilities necessary to benefit mental health, is a significant determinant of mental health and has the potential to benefit both individual and public mental health. MHL and its measures have traditionally focused on knowledge and beliefs about mental -ill-health rather than on mental health. No measures of MHL addressing knowledge of good or positive mental health have been identified. This study aimed to develop and validate an instrument measuring adolescents' knowledge of how to obtain and maintain good mental health and to evaluate the psychometric properties of the instrument. More specifically, the factor structure, internal and construct validity, and test-retest reliability were assessed. The participants were Norwegian upper secondary school students aged 15-21 years. The development and validation of the instrument entailed three phases: 1) item generation based on the basic psychological needs theory (BPNT), focus group interviews, and a narrative literature review, 2) a pilot study (n = 479), and 3) test-retest (n = 149), known-groups validity (n = 44), and scale construction, item reduction through principal component analysis (PCA), and confirmatory factor analysis (CFA) for factor structure and psychometric properties assessment (n = 1888). Thirty-two items were initially generated, and 15 were selected for the pilot study. PCA identified cross-loadings, and a one-factor solution was examined. After removing five problematic items, CFA yielded a satisfactory fit for a 10-item one-factor model, referred to as the mental health-promoting knowledge (MHPK-10) measure. The test-retest evaluation supported the stability of the measure. McDonald's omega was 0.84, and known-groups validity test indicated good construct validity. A valid and reliable one-dimensional instrument measuring knowledge of factors promoting good mental health among adolescents was developed. The instrument has the potential to complement current measures of MHL and may be useful when planning mental health promotion activities and evaluating public mental health education initiatives in adolescents.

The Development and Initial Validation of the Dating Attitudes Inventory: A Measure of the Gender Context of Dating Violence in Men

ERIC Educational Resources Information Center

Schwartz, Jonathan Peter; Kelley, Frances A.; Kohli, Nidhi

2012-01-01

The development and initial psychometric investigation of the Dating Attitudes Inventory (DAI) is reported. The DAI was created, to fill a gap in the literature and to measure specific masculine ideology and traditional gender attitudes that rationalize the abuse of women. Using a sample (n = 164) of male college students, a 20-item measure was…

Social support for healthy behaviors: Scale psychometrics and prediction of weight loss among women in a behavioral program

PubMed Central

Kiernan, Michaela; Moore, Susan D.; Schoffman, Danielle E.; Lee, Katherine; King, Abby C.; Taylor, C. Barr; Kiernan, Nancy Ellen; Perri, Michael G.

2015-01-01

Social support could be a powerful weight-loss treatment moderator or mediator but is rarely assessed. We assessed the psychometric properties, initial levels, and predictive validity of a measure of perceived social support and sabotage from friends and family for healthy eating and physical activity (eight subscales). Overweight/obese women randomized to one of two 6-month, group-based behavioral weight-loss programs (N=267; mean BMI 32.1±3.5; 66.3% White) completed subscales at baseline, and weight loss was assessed at 6 months. Internal consistency, discriminant validity, and content validity were excellent for support subscales and adequate for sabotage subscales; qualitative responses revealed novel deliberate instances not reflected in current sabotage items. Most women (>75%) “never” or “rarely” experienced support from friends or family. Using non-parametric classification methods, we identified two subscales—support from friends for healthy eating and support from family for physical activity—that predicted three clinically meaningful subgroups who ranged in likelihood of losing ≥5% of initial weight at 6 months. Women who “never” experienced family support were least likely to lose weight (45.7% lost weight) whereas women who experienced both frequent friend and family support were more likely to lose weight (71.6% lost weight). Paradoxically, women who “never” experienced friend support were most likely to lose weight (80.0% lost weight), perhaps because the group-based programs provided support lacking from friendships. Psychometrics for support subscales were excellent; initial support was rare; and the differential roles of friend versus family support could inform future targeted weight-loss interventions to subgroups at risk. PMID:21996661

Development and validation of a new knowledge, attitude, belief and practice questionnaire on leptospirosis in Malaysia.

PubMed

Zahiruddin, Wan Mohd; Arifin, Wan Nor; Mohd-Nazri, Shafei; Sukeri, Surianti; Zawaha, Idris; Bakar, Rahman Abu; Hamat, Rukman Awang; Malina, Osman; Jamaludin, Tengku Zetty Maztura Tengku; Pathman, Arumugam; Mas-Harithulfadhli-Agus, Ab Rahman; Norazlin, Idris; Suhailah, Binti Samsudin; Saudi, Siti Nor Sakinah; Abdullah, Nurul Munirah; Nozmi, Noramira; Zainuddin, Abdul Wahab; Aziah, Daud

2018-03-07

In Malaysia, leptospirosis is considered an endemic disease, with sporadic outbreaks following rainy or flood seasons. The objective of this study was to develop and validate a new knowledge, attitude, belief and practice (KABP) questionnaire on leptospirosis for use in urban and rural populations in Malaysia. The questionnaire comprised development and validation stages. The development phase encompassed a literature review, expert panel review, focus-group testing, and evaluation. The validation phase consisted of exploratory and confirmatory parts to verify the psychometric properties of the questionnaire. A total of 214 and 759 participants were recruited from two Malaysian states, Kelantan and Selangor respectively, for the validation phase. The participants comprised urban and rural communities with a high reported incidence of leptospirosis. The knowledge section of the validation phase utilized item response theory (IRT) analysis. The attitude and belief sections utilized exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). The development phase resulted in a questionnaire that included four main sections: knowledge, attitude, belief, and practice. In the exploratory phase, as shown by the IRT analysis of knowledge about leptospirosis, the difficulty and discrimination values of the items were acceptable, with the exception of two items. Based on the EFA, the psychometric properties of the attitude, belief, and practice sections were poor. Thus, these sections were revised, and no further factor analysis of the practice section was conducted. In the confirmatory stage, the difficulty and discrimination values of the items in the knowledge section remained within the acceptable range. The CFA of the attitude section resulted in a good-fitting two-factor model. The CFA of the belief section retained low number of items, although the analysis resulted in a good fit in the final three-factor model. Based on the IRT analysis and factor analytic evidence, the knowledge and attitude sections of the KABP questionnaire on leptospirosis were psychometrically valid. However, the psychometric properties of the belief section were unsatisfactory, despite being revised after the initial validation study. Further development of this section is warranted in future studies.

[Psychometric analysis of the Spanish and Catalan versions of a questionnaire for hypoglycemia awareness].

PubMed

Jansa, Marga; Quirós, Carmen; Giménez, Marga; Vidal, Merce; Galindo, Mercedes; Conget, Ignacio

2015-05-21

Intensive insulin therapy with multiple insulin doses in subjects with type 1 diabetes mellitus (T1D) is associated with a higher risk of hypoglycaemic episodes. Repeated hypoglycemia results in a reduced ability/failure to recognize hypoglycemia symptoms and predisposes to severe episodes. In this context is crucial to work with specific questionnaires to diagnose and address this burden. Our study aimed to perform the psychometric analysis of Spanish and Catalan versions of Clarke et al. questionnaire for hypoglycemia awareness. Psychometric analysis in patients with T1D of Spanish and Catalan versions of Clarke et al. questionnaire in 3 phases: 1) translation, back-translation and cultural adaptation of the English version; 2) analysis of internal, external and test-retest validity, and 3) assessing sensitivity to change in hypoglycemia perception. One-hundred and forty-four subjects with T1D answered the Clarke et al. questionnaire (mean age [SD] 36 [18] years, 46% men). We observed a Cronbach α coefficient for internal validity of 0.75, a correlation coefficient for test-retest reliability of r=0.81 and a correlation of the questionnaire score with the frequency of severe and no severe hypoglycemia events of r=0.47 and r=0.77, respectively. The analysis of 20 patients with T1D 24 months after the initiation of continuous subcutaneous insulin infusion showed a decrease in the frequency of non-severe hypoglycemia/week (from 5.40 [2.09] to 2.75 [1.74]) and in the number of severe hypoglycemic episodes/year (1.25 [0.44] to 0.05 [0.22]). This was associated with a decrease in scores of the translated versions of Clarke et al. questionnaire (from 5.45 [1.19] to 1.60 [2.03]). Spanish and Catalan versions of Clarke et al. questionnaire display good psychometric properties and both could be considered a useful tool for evaluating hypoglycemia awareness in patients with T1D from our area. Copyright © 2013 Elsevier España, S.L.U. All rights reserved.

Psychometric evaluation of dietary habits questionnaire for type 2 diabetes mellitus

NASA Astrophysics Data System (ADS)

Sami, W.; Ansari, T.; Butt, N. S.; Hamid, M. R. Ab

2017-09-01

This research evaluated the psychometric properties of English version of dietary habits questionnaires developed for type 2 diabetic patients. There is scarcity of literature about availability of standardized questionnaires for assessing dietary habits of type 2 diabetics in Saudi Arabia. As dietary habits vary from country to country, therefore, this was an attempt to develop questionnaires that can serve as a baseline. Through intensive literature review, four questionnaires were developed / modified and subsequently tested for psychometric properties. Prior to pilot study, a pre-test was conducted to evaluate the face validity and content validity. The pilot study was conducted from 23 October - 22 November, 2016 to evaluate the questionnaires’ reliability and validity. Systematic random sampling technique was used to collect the data from 132 patients by direct investigation method. Questionnaires assessing diabetes mellitus knowledge (0.891), dietary knowledge (0.869), dietary attitude (0.841) and dietary practices (0.874) had good internal consistency reliability. Factor analysis conducted on dietary attitude questionnaire showed a valid 5 factor solution. Directions of loadings were positive and free from factorial complexity. Relying on the data obtained from type 2 diabetics, these questionnaires can be considered as reliable and valid for the assessment of dietary habits in Saudi Arabia and neighbouring Gulf countries population.

The Mayo-Portland Participation Index: A brief and psychometrically sound measure of brain injury outcome.

PubMed

Malec, James F

2004-12-01

To evaluate the internal consistency, interrater agreement, concurrent validity, and floor and ceiling effects of the 8-item Participation Index (M2PI) of the Mayo-Portland Adaptability Inventory (MPAI). M2PI data derived from MPAIs completed independently by the people with acquired brain injury undergoing evaluation, their significant others, and rehabilitation staff were submitted to Rasch Facets analysis to determine the internal consistency of each independent rater group and of composite measures that combined rater groups. Correlations with the full-scale MPAI were examined to assess concurrent validity, as was interrater agreement. Outpatient rehabilitation in academic physical medicine and rehabilitation department. People with acquired brain injury (N=134) consecutively seen for evaluation, significant others, and evaluating staff. Not applicable. The MPAI and M2PI. The M2PI showed satisfactory internal consistency, concurrent validity, interrater agreement, and minimal floor and ceiling effects, although evidence of rater bias was also apparent. Composite indices showed more desirable psychometric properties than ratings by individual rater groups. The M2PI, particularly in composite indices and with attention to rater biases, provides an outcome measure with satisfactory psychometric qualities and the potential to represent the varying perspectives of people with acquired brain injury, significant others, and rehabilitation staff.

The Spiritual Well-Being Scale: Psychometric Evaluation of the Shortened Version in Czech Adolescents.

PubMed

Malinakova, Klara; Kopcakova, Jaroslava; Kolarcik, Peter; Geckova, Andrea Madarasova; Solcova, Iva Polackova; Husek, Vit; Kracmarova, Lucie Kluzova; Dubovska, Eva; Kalman, Michal; Puzova, Zuzana; van Dijk, Jitse P; Tavel, Peter

2017-04-01

The aim of this study was to psychometrically evaluate the shortened version of the Spiritual Well-Being Scale (SWBS) in Czech adolescents. A nationally representative sample of 4217 adolescents participated in the 2014 Health Behaviour in School-aged Children survey. The internal consistency of the SWBS was assessed using Cronbach's alpha (α) and Mean Inter-Item Correlation (MIIC) values. The factor structure was evaluated using principal component analyses. After adjustment, our new seven-item version of the scale supports a two-factorial model of the SWBS with satisfactory internal consistency (α = 0.814, MIIC = 0.379). This version of the SWBS is suitable for measuring spiritual well-being in a secularising environment.

Psychometric Comparison of Self- and Informant-Reports of Personality

PubMed Central

Olino, Thomas M.; Klein, Daniel N.

2017-01-01

Self-reports are the most relied on assessment method in psychology. In the area of personality, informant-reports are a reasonable alternative assessment strategy. However, agreement between self- and informant-reports of personality is only moderately good. A portion of the observed discrepancies between self- and informant-reports of personality may come from differences in psychometric measurement across raters. That is, it is unknown whether the constructs assessed via self- and informant-reports are psychometrically identical. We examined four key personality scales—Well-Being, Social Closeness, Stress Reaction, and Harm Avoidance—in male and female dyads who provided self- and informant-reports for their partner. Similarities in self- and informant-reports of personality were evaluated by testing measurement invariance. Overall, models supported configural, metric, and scalar invariance for each of the four personality dimensions. These results suggest that the same psychometric constructs are assessed via self- and informant-reports of these personality dimensions. Informant-reports can be used in studies to avoid biases from relying solely on self-reports. PMID:25612626

Psychometric properties of a scale to measure menopause-related symptoms in two ethnicities.

PubMed

Wang, X; Perry, A C; Elbaum, B E; Burnett, K F; Swaminathan, H

2009-08-01

To evaluate the psychometric properties of a scale we constructed to measure menopause-related symptoms in Hispanic and White non-Hispanic women. Items were generated from the literature and clinical experiences. Hispanic (n = 123, 51.34 +/- 5.14 years) and White (n = 210, 53.36 +/- 4.80 years) women completed the scale and other instruments used to validate respective constructs. A subgroup of 69 women completed our scale a second time. Following exploratory factor analysis using the entire sample, confirmatory factor analysis was conducted for Hispanic and White women, separately. The same four-factor model (vasomotor, psychological symptoms, relationship(s), and other symptoms) fit data for both ethnic groups. The coefficient alpha for internal consistency was 0.852 and 0.849 for the initial and second administration, respectively, and the test-retest reliability was significant (p < 0.001). There were differences in factor scores among groups with different menopausal status. Factor scores were significantly correlated with scores of a global quality-of-life instrument (p < or = 0.001). Our study suggests that the scale is appropriate for use for Hispanic and White non-Hispanic women and is capable of detecting differences among women with different menopause-related symptoms. Menopause-related symptoms measured by the scale were correlated with global quality of life.

The Kids Insight into Dementia Survey (KIDS): development and preliminary psychometric properties.

PubMed

Baker, Jess R; Low, Lee-Fay; Goodenough, Belinda; Jeon, Yun-Hee; Tsang, Ruby S M; Bryden, Christine; Hutchinson, Karen

2017-05-08

Children may have a foundational role in efforts to raise community awareness about dementia. There is some qualitative work with children with a relative with dementia, but little work into the insights of children as general citizens without affected family. One issue is an absence of measurement tools; thus the study aimed to design and pilot a psychometrically sound self-report measure of dementia attitudes for children. Using a multi-staged scale development process, stakeholder and expert input informed a 52-item Kids Insight into Dementia Survey (KIDS). After a pretest of KIDS with 21 Australian schoolchildren aged 10-12 years, exploratory factor analysis and reliability and validity testing were run on a revised KIDS with data from 203 similar-aged schoolchildren. The KIDS was reduced from 52 to 14 items, and a three-factor solution identified: 'Personhood,' 'Stigma,' and 'Dementia Understanding.' A strong positive correlation with an adult measure of dementia attitudes (r = .76) and a moderate positive correlation with a child measure of attitudes towards older adults (r = .47) indicated good concurrent validity. Internal consistency of .83 indicated good reliability. Results support the use of KIDS as a tool to measure children's insight into dementia, and to evaluate dementia education initiatives targeting the youth.

Orthorexia nervosa behavior in a sample of Brazilian dietitians assessed by the Portuguese version of ORTO-15.

PubMed

Alvarenga, M S; Martins, M C T; Sato, K S C J; Vargas, S V A; Philippi, S T; Scagliusi, F B

2012-03-01

Orthorexia nervosa (ON) is described as an obsessive pathological behavior characterized by a strong preoccupation with healthy eating and the avoidance of foods or ingredients considered unhealthy by the subject. Although it is still not officially recognized as an eating disorder, previous studies have discussed its frequency in some groups and a fifteen-question test (ORTO-15) was developed elsewhere to assess ON behavior. The present study aimed to evaluate ON behavior in a sample of Brazilian dietitians after testing the psychometric properties of the Portuguese version of ORTO-15. A total of 392 dietitians answered an online version of the test. The answers were analyzed regarding ON tendency, according with the scoring grid proposed by its authors. Exploratory factor analysis was performed and internal consistency was assessed. It was found that three questions of the test presented loadings lower than 0.5. The 12 remaining question formed 3 factors with internal consistency of -0.51, 0.63 and 0.47. The answers of the participants to these questions revealed a tendency to orthorexic behavior, mainly regarding aspects such as: making food choices conditioned by worry about health status, evaluating food rather from nutritional quality than from its taste, believing that consuming healthy food may improve appearance, discrediting the influence of mood on eating behavior and banning food choices considered by them as eating transgressions. There is no evidence of the validity and reliability of the ORTO-15 with the initial psychometric evaluation performed. Further analyses are needed. Nevertheless, it was possible to observe a high frequency of orthorexic behavior among the studied Brazilian dietitians. However, additional studies are needed to completely understand dietitians behavior toward ON.

Assessment of psychometric properties of the Brazilian version of the oral anticoagulation knowledge test.

PubMed

Praxedes, Marcus Fernando da Silva; de Abreu, Mauro Henrique Nogueira Guimarães; Paiva, Saul Martins; Mambrini, Juliana Vaz de Melo; Marcolino, Milena Soriano; Martins, Maria Auxiliadora Parreiras

2016-06-24

The aim of this study was to evaluate the psychometric properties of the Brazilian version of the Oral Anticoagulation Knowledge (OAK) Test. This study, conducted in an anticoagulation clinic, included 201 Brazilian participants aged over 18 years, who had been using warfarin for more than two months. The reliability of the instrument was evaluated by assessing internal consistency (Kuder-Richardson coefficient) and reproducibility (test-retest reliability). The validity was evaluated by hypothesizing that there would be a positive correlation of moderate to strong intensity between the correctness levels of the OAK Test and time within therapeutic range (TTR) values, which is a measure used to evaluate the quality of oral anticoagulation. The instrument exhibited good psychometric properties. The total a Kuder-Richardson coefficient value was 0.818 and intraclass correlation coefficient was 0.967. The validity revealed a strong positive correlation between the values of the level of knowledge, as measured by the OAK Test and the TTR values (rs = 0.780). The instrument proved to be a reliable and valid tool for evaluating the knowledge of Brazilian patients on oral anticoagulation therapy with warfarin. This instrument may be incorporated into the practice of health care for substantiating the structuring of educational activities to ensure the improvement of knowledge about the use of warfarin, thereby increasing the effectiveness and safety of treatment.

A Systematic Review of the Psychometric Properties of Composite LGBT Prejudice and Discrimination Scales.

PubMed

Morrison, Melanie A; Bishop, C J; Morrison, Todd G

2018-01-08

Prejudice and discrimination against LGBT individuals is widespread and has been shown to have negative consequences for sexual and gender minority persons' physical and psychological wellbeing. A recent and problematic trend in the literature is to compositely measure prejudice toward and discrimination against LGBT persons. As such, a review of the psychometric properties of scales assessing, in a combinatory fashion, negative attitudes and/or behaviors toward LGBT persons is warranted. In the current study, 32 scales were identified, and their psychometric properties were evaluated. Most of the scales reviewed did not provide sufficient information regarding item development and refinement, scale dimensionality, scale score reliability, or validity. Properties of the reviewed scales are summarized, and recommendations for better measurement practice are articulated.

Measuring Characteristics of Teacher Professional Development

ERIC Educational Resources Information Center

Soine, Karen M.; Lumpe, Andrew

2014-01-01

The primary purpose of the study was to create and psychometrically test an instrument which measured teachers' perceptions of characteristics of professional development. The sample consisted of elementary teachers from five school districts in Washington State participating in a district improvement initiative. Results of exploratory factor…

Introducing a brief measure of cultural and religious identification in American Jewish identity.

PubMed

Friedlander, Myrna L; Friedman, Michelle L; Miller, Matthew J; Ellis, Michael V; Friedlander, Lee K; Mikhaylov, Vadim G

2010-07-01

The authors conducted 3 studies to develop and investigate the psychometric properties of the American Jewish Identity Scales (AJIS), a brief self-report measure that assesses cultural identification and religious identification. Study 1 assessed the content validity of the item pool using an expert panel. In Study 2, 1,884 Jewish adults completed the initial AJIS and various measures of ethnic identity, collective self-esteem, and religiosity. Using confirmatory factor analyses, the authors selected and cross-validated 33 items that loaded highly and differentially on the 2 theorized latent factors. Study 3 assessed the AJIS's short-term stability and its relation to social desirability. Tests of reliability and construct validity provided initial psychometric support for the measure and confirmed the theorized primary salience of cultural identification. Participants reported significantly more private than public collective self-esteem, and the most Jewish-identified participants reported greater private self-esteem, acculturative stress, and perceived discrimination than did their more assimilated counterparts. (c) 2010 APA, all rights reserved.

Psychometric evaluation of the Shared Decision-Making Instrument--Revised.

PubMed

Bartlett, Jacqueline A; Peterson, Jane A

2013-02-01

The purpose of this study was to evaluate the psychometric properties of the Shared Decision-Making Inventory-Revised (SDMI-R) to measure four constructs (knowledge, attitudes, self-efficacy, and intent) theoretically defined as vital in discussing the human papillomavirus (HPV) disease and vaccine with clients. The SDMI-R was distributed to a sample (N = 1,525) of school nurses. Correlational matrixes denoted moderate to strong correlations, indicating adequate internal reliability. Reliability for the total instrument was satisfactory (α = .874) along with Attitude, Self-Efficacy and Intent subscales .828, .917, .891, respectively. Exploratory factor analysis revealed five components that explained 75.96% of the variance.

The Self-Stigma of Depression Scale (SSDS): development and psychometric evaluation of a new instrument.

PubMed

Barney, Lisa J; Griffiths, Kathleen M; Christensen, Helen; Jorm, Anthony F

2010-12-01

Self-stigma may feature strongly and be detrimental for people with depression, but the understanding of its nature and prevalence is limited by the lack of psychometrically-validated measures. This study aimed to develop and validate a measure of self-stigma about depression. Items assessing self-stigma were developed from focus group discussions, and were tested and refined over three studies using surveys of 408 university students, 330 members of a depression Internet network, and 1312 members of the general Australian public. Evaluation involved item-level and bivariate analyses, and factor analytic procedures. Items performed consistently across the three surveys. The resulting Self-Stigma of Depression Scale (SSDS) comprised 16 items representing subscales of Shame, Self-Blame, Social Inadequacy, and Help-Seeking Inhibition. Construct validity, internal consistency and test-retest reliability were satisfactory. The SSDS distinguishes self-stigma from perceptions of stigma by others, yields in-depth information about self-stigma of depression, and possesses good psychometric properties. It is a promising tool for the measurement of self-stigma and is likely to be useful in further understanding self-stigma and evaluating stigma interventions. Copyright © 2010 John Wiley & Sons, Ltd.

Psychometric Evaluation of the Eating Disorder Examination-Questionnaire for Bariatric Surgery Candidates

PubMed Central

Hrabosky, Joshua I.; White, Marney A.; Masheb, Robin M.; Rothschild, Bruce S.; Burke-Martindale, Carolyn H.; Grilo, Carlos M.

2013-01-01

Objective Despite increasing use of the Eating Disorder Examination-Questionnaire (EDE-Q) in bariatric surgery patients, little is known about the utility and psychometric performance of this self-report measure in this clinical group. The primary purpose of the current study was to evaluate the factor structure and construct validity of the EDE-Q in a large series of bariatric surgery candidates. Methods and Procedures Participants were 337 obese bariatric surgery candidates. Participants completed the EDE-Q and a battery of behavioral and psychological measures. Results Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) produced a 12-item, 4-factor structure of the EDE-Q. The four factors, interpreted as Dietary Restraint, Eating Disturbance, Appearance Concerns, and Shape/Weight Overvaluation, were found to be internally consistent and converged with other relevant measures of psychopathology. Discussion Factor analysis of the EDE-Q in bariatric surgery candidates did not replicate the original subscales but revealed an alternative factor structure. Future research must further evaluate the psychometric properties, including the factor structure, of the EDE-Q in this and other diverse populations and consider means of improving this measure's ability to best assess eating-related pathology in bariatric surgery patients. PMID:18379561

Psychometric evaluation of the Chinese version of the Patient Perceptions of Empowerment Scale (PPES).

PubMed

Yeh, Mei-Yu; Lin, Sieh-Hwa; Tung, Tao-Hsin

2014-01-01

To evaluate the psychometric properties of the Chinese version of the Patient Perceptions of Empowerment Scale (PPES) and to perform a cross-cultural validity assessment. In this cross-sectional survey, 554 inpatients in three general hospitals in northern Taiwan were recruited. Principal component analysis was used to examine the factor structure of the scale. Confirmatory factor analyses were conducted on the measurement model of the Chinese version of the PPES. Confirmatory factor analyses supported the presence of a second-order four-factor model (information, decision, individual, and self-management) of the Chinese version of the PPES when used with a Taiwanese inpatient population. The results indicate that the 11-item, second-order, four-factor Chinese version of the PPES provided best goodness-of-fit for the data in this study. The 11-item four-factor Chinese version of the PPES is a self-completion scale. This study demonstrated that the Chinese version of the PPES is a reliable and valid self-report instrument for the assessment of patient perceptions of empowerment in clinical practice. Further adaptation and evaluation of the scale will hopefully stimulate further studies on PPES in the fields of psychometrics in Taiwan.

Psychometric Evaluation of the Chinese Version of the Patient Perceptions of Empowerment Scale (PPES)

PubMed Central

Lin, Sieh-Hwa

2014-01-01

Objectives. To evaluate the psychometric properties of the Chinese version of the Patient Perceptions of Empowerment Scale (PPES) and to perform a cross-cultural validity assessment. Methods. In this cross-sectional survey, 554 inpatients in three general hospitals in northern Taiwan were recruited. Principal component analysis was used to examine the factor structure of the scale. Confirmatory factor analyses were conducted on the measurement model of the Chinese version of the PPES. Results. Confirmatory factor analyses supported the presence of a second-order four-factor model (information, decision, individual, and self-management) of the Chinese version of the PPES when used with a Taiwanese inpatient population. The results indicate that the 11-item, second-order, four-factor Chinese version of the PPES provided best goodness-of-fit for the data in this study. Conclusion. The 11-item four-factor Chinese version of the PPES is a self-completion scale. This study demonstrated that the Chinese version of the PPES is a reliable and valid self-report instrument for the assessment of patient perceptions of empowerment in clinical practice. Further adaptation and evaluation of the scale will hopefully stimulate further studies on PPES in the fields of psychometrics in Taiwan. PMID:24971354

Cross-cultural validation and psychometric evaluation of the Spanish Brief Religious Coping Scale (S-BRCS).

PubMed

Martinez, Nelda C; Sousa, Valmi D

2011-07-01

To evaluate the psychometric properties of the Spanish Brief Religious Coping Scale (S-BRCS). A descriptive correlational design was used to conduct the study among a convenience sample of 121 Mexican Americans with diabetes. The positive and negative religious coping subscales had Cronbach’s alphas of .85 and .86, respectively. All interitem and item-to-total correlations for each subscale were above the recommended criteria of .30. Factor loadings of the positive subscale using oblique (oblimin) and orthogonal (varimax) rotation ranged from .71 to .86 and from .72 to .86, respectively.Factor loadings of the negative subscale using oblimin and varimax rotation ranged from .64 to .83 and from .63 to .83,respectively. The S-BRCS was found to be a valid and reliable instrument to measure religious coping among Spanish-speaking Mexican Americans with type 2 diabetes. IMPLICATIONS FOR FURTHER RESEARCH AND PRACTICE: Further psychometric evaluation of the S-BRCS among larger sample of Mexican Americans and other Hispanic ethnic groups is warranted. The S-BRCS has the potential to become a standard instrument that can be used by clinicians who work with Hispanic clients with diabetes mellitus to provide culturally competent diabetes care.

Mobility care in nursing homes: development and psychometric evaluation of the kinaesthetics competence self-evaluation (KCSE) scale.

PubMed

Gattinger, Heidrun; Senn, Beate; Hantikainen, Virpi; Köpke, Sascha; Ott, Stefan; Leino-Kilpi, Helena

2017-01-01

Impaired mobility is a prevalent condition among care-dependent persons living in nursing homes. Therefore, competence development of nursing staff in mobility care is important. This study aimed to develop and initially test the Kinaesthetics Competence Self-Evaluation (KCSE) scale for assessing nursing staff's competence in mobility care. The KCSE scale was developed based on an analysis of the concept of nurses' competence in kinaesthetics. Kinaesthetics is a training concept that provides theory and practice about movement foundations that comprise activities of daily living. The scale contains 28 items and four subscales (attitude, dynamic state, knowledge and skills). Content validity was assessed by determining the content validity index within two expert panels. Internal consistency and construct validity were tested within a cross-sectional study in three nursing homes in the German-speaking region of Switzerland between September and November 2015. The content validity index for the entire scale was good (0.93). Based on a sample of nursing staff ( n  = 180) the internal consistency results were good for the whole scale (Cronbach's alpha = 0.91) and for the subscales knowledge and skills (α = 0.91, 0.86), acceptable for the subscale attitude (α = 0.63) and weak for the subscale dynamic state (α = 0.54). Most items showed acceptable inter-item and item-total correlations. Based on the exploratory factor analysis, four factors explaining 52% of the variance were extracted. The newly developed KCSE scale is a promising instrument for measuring nursing staff's attitude, dynamic state, knowledge, and skills in mobility care based on kinaesthetics. Despite the need for further psychometric evaluation, the KCSE scale can be used in clinical practice to evaluate competence in mobility care based on kinaesthetics and to identify educational needs for nursing staff.

Neurocognitive dysfunction in children with β thalassemia major: psychometric, neurophysiologic and radiologic evaluation.

PubMed

Elalfy, M S; Aly, R H; Azzam, H; Aboelftouh, K; Shatla, R H; Tarif, M; Abdatty, M; Elsayed, R M

2017-12-01

To evaluate the impact of iron chelating drugs and serum ferritin on the neurocognitive functions of patients with β thalassemia major (β-TM), using psychometric, neurophysiologic and radiologic tests. Eighty children with β-TM were enrolled into the study and were compared to 40 healthy controls. All participants were evaluated by measuring serum ferritin, neurocognitive assessment by Benton Visual Retention Test, Wechsler Intelligence Scale for Children, Wisconsin Card Sort Test, P300 and magnetic resonance spectroscopy (MRS). WISC in our study showed that 40% of cases were borderline mental function as regards total IQ. Neurophysiologic tests were significantly impaired in patients compared to control group, with significant impairment in those receiving desferrioxamine (DFO). P300 amplitude was significantly lower in cases compared to controls (2.24 and 4.66 uv, respectively), recording the shortest amplitude in patients receiving DFO. Altered metabolic markers in the brain were detected by MRS in the form of reduced N-acetylaspartate to creatine ratio in 78.3% of our cases. There were significant correlations between psychometric tests and both neurophysiologic (P300) and radiologic (MRS) tests. β-TM is associated with neurocognitive impairment that can be assessed by psychometric, neurophysiologic and radiologic tests. The role of hemosiderosis and iron chelation therapy on cognitive functioning still need more research. β-TM: beta thalassemia major; DFO: Dysferal; DFP: Deferiprone; DFX: Deferasirox; WISC: Wechsler Intelligence Scale for Children; VIQ: verbal IQ; PIQ: performance IQ; TIQ: total IQ; BVRT: Benton Visual Retention Test; WCST: Wisconsin Card Sort Test; MRS: Magnetic resonant spectroscopy; NAA/Cr ratio: N-acetylaspartate to creatine ratio.

Psychometric goodness of the Mini Sleep Questionnaire.

PubMed

Natale, Vincenzo; Fabbri, Marco; Tonetti, Lorenzo; Martoni, Monica

2014-07-01

The current study was conducted to evaluate the psychometric properties and analyze the convergent validity of the Italian version of the Mini Sleep Questionnaire (MSQ). In addition, it was aimed to put forward cut-off values to be used in screening protocols. The MSQ was administered to 1830 participants (age range 18-87 years), of whom 1208 also completed the Sleep Disorder Questionnaire (age range 18-87 years). A subgroup of 187 (age range 18-71 years) participants was randomly chosen to test the test-retest reliability. A complete psychometric evaluation was performed on the MSQ. To study the validity of the tool, the Sleep Disorder Questionnaire was used as an external criterion to validate the MSQ. Using the Youden index, we calculated the cut-off values that performed best. Finally, we created receiver-operator curves to test the accuracy of each cut-off value identified. For the MSQ, Cronbach's alpha score was 0.77 while homogeneity was 0.26. Factorial analyses confirmed the presence of two dimensions: sleep (Cronbach's alpha 0.75; homogeneity 0.37) and wake (Cronbach's alpha 0.75; homogeneity 0.44). For each dimension, a cut-off value was identified (>16 and >14, respectively). Both cut-off values obtained an area under the curve higher than 0.80. Psychometric evaluation of the MSQ was satisfactory. The cut-off values analyzed in the present study showed good performance. On the whole, the results of this study suggest that the MSQ can be a useful screening tool. © 2014 The Authors. Psychiatry and Clinical Neurosciences © 2014 Japanese Society of Psychiatry and Neurology.

The design and evaluation of psychometric properties for a questionnaire on elderly abuse by family caregivers among older adults on hemodialysis.

PubMed

Mahmoudian, Amaneh; Torabi Chafjiri, Razieh; Alipour, Atefeh; Shamsalinia, Abbas; Ghaffari, Fatemeh

2018-01-01

Older adults with chronic disease are more vulnerable to abuse. Early and accurate detection of the elderly abuse phenomenon can help identify health-promoting solutions for the elderly, their family, and society. The purpose of this study was to design and evaluate the psychometric properties of a questionnaire on elderly abuse by family caregivers among older adults on hemodialysis. Qualitative and quantitative research methodologies were used to develop the questionnaire. The item pool was compiled from literature reviews and the Delphi method. The literature reviews comprised 22 studies. The psychometric properties of the questionnaire were verified using face, content, and construct validity, and the reliability was tested using Cronbach's alpha reliability. A 57-item questionnaire was developed after the psychometric evaluation. The Kaiser-Meyer-Olkin index and Bartlett's test of sphericity showed reliable results. Seven components from the exploratory content analysis including psychological misbehavior, authority deprivation, physical misbehavior, financial misbehavior, being abandoned, caring neglect, and emotional misbehavior explained 74.769% of the total variance. Cronbach's alpha was 0.98 and the interclass correlation coefficient was r =0.91 responding to the items twice ( p <0.001), which shows a high level of tool stability. This study developed a questionnaire to assess elderly abuse by family caregivers among older adults on hemodialysis. It is recommended as a mini scale that can be used both in statistical and practical studies, and that is valid and reliable. Nurses or other health care providers can use it in health centers, dialysis centers, or at the house of the patient.

A Systematic Review of Measurement Properties of Patient-Reported Outcome Measures Used in Patients Undergoing Total Knee Arthroplasty.

PubMed

Gagnier, Joel J; Mullins, Megan; Huang, Hsiaomin; Marinac-Dabic, Danica; Ghambaryan, Anna; Eloff, Benjamin; Mirza, Faisal; Bayona, Manuel

2017-05-01

While clinical research on total knee arthroplasty (TKA) outcomes is prevalent in the literature, studies often have poor methodological and reporting quality. A high-quality patient-reported outcome instrument is reliable, valid, and responsive. Many studies evaluate these properties, but none have done so with a systematic and accepted method. The objectives of this study were to identify patient-reported outcome measures (PROMs) for TKA, and to critically appraise, compare, and summarize their psychometric properties using accepted methods. MEDLINE, EMBASE, SCOPUS, Web of Science, PsycINFO, and SPORTDiscus were systematically searched for articles with the following inclusion criteria: publication before December 2014, English language, non-generic PRO, and evaluation in the TKA population. Methodological quality and evidence of psychometric properties were assessed with the COnsensus-based standards for the selection of health Status Measurement INstruments (COSMIN) checklist and criteria for psychometric evidence proposed by the COSMIN group and Terwee et al. One-hundred fifteen studies on 32 PROMs were included in this review. Only the Work, Osteoarthritis or joint-Replacement Questionnaire, the Oxford Knee Score, and the Western Ontario and McMaster Universities Arthritis Index had 4 or more properties with positive evidence. Most TKA PROMs have limited evidence for their psychometric properties. Although not all the properties were studied, the Work, Osteoarthritis or joint-Replacement Questionnaire, with the highest overall ratings, could be a useful PROM for evaluating patients undergoing TKA. The methods and reporting of this literature can improve by following accepted guidelines. Published by Elsevier Inc.

Measuring Future Time Perspective across Adulthood: Development and Evaluation of a Brief Multidimensional Questionnaire

PubMed Central

Brothers, Allyson; Chui, Helena; Diehl, Manfred

2014-01-01

Purpose of the Study: Despite calls for the consideration of future time perspective (FTP) as a multidimensional construct, mostly unidimensional measurement instruments have been used. This study had two objectives: (a) to develop a brief multidimensional questionnaire for assessing FTP in adulthood and evaluate its psychometric properties; and (b) to examine age associations and age-group differences of the dimensions of FTP. Design and Methods: Data were collected from 625 community-residing adults between the ages of 18 and 93, representing young, middle-aged, and older adults. The psychometric evaluation involved exploratory factor analyses (EFA) and confirmatory FA (CFA), reliability and validity analyses, and measurement invariance testing. Zero-order and partial correlations were used to examine the association of the dimensions of FTP with age, and multivariate analysis of variance was used to examine age-group differences. Results: EFA and CFA supported a three-factor solution: Future as Open, Future as Limited, and Future as Ambiguous. Metric measurement invariance for this factor structure was confirmed across the three age groups. Reliability and validity analyses provided evidence of sound psychometric properties of the brief questionnaire. Age was negatively associated with Future as Open and positively associated with Future as Limited. Young adults exhibited significantly greater ambiguity toward the future than middle-aged or older adults. Implications: This study provides evidence in support of the psychometric properties of a new brief multidimensional FTP scale. It also provides evidence for a pattern of age associations and age-group differences consistent with life-span developmental theory. PMID:25063938

Cross-cultural adaptation and validation of the Ankle Osteoarthritis Scale for use in French-speaking populations.

PubMed

Angers, Magalie; Svotelis, Amy; Balg, Frederic; Allard, Jean-Pascal

2016-04-01

The Ankle Osteoarthritis Scale (AOS) is a self-administered score specific for ankle osteoarthritis (OA) with excellent reliability and strong construct and criterion validity. Many recent randomized multicentre trials have used the AOS, and the involvement of the French-speaking population is limited by the absence of a French version. Our goal was to develop a French version and validate the psychometric properties to assure equivalence to the original English version. Translation was performed according to American Association of Orthopaedic Surgeons (AAOS) 2000 guidelines for cross-cultural adaptation. Similar to the validation process of the English AOS, we evaluated the psychometric properties of the French version (AOS-Fr): criterion validity (AOS-Fr v. Western Ontario and McMaster Universities Arthritis Index [WOMAC] and SF-36 scores), construct validity (AOS-Fr correlation to single heel-lift test), and reliability (AOS-Fr test-retest). Sixty healthy individuals tested a prefinal version of the AOS-Fr for comprehension, leading to modifications and a final version that was approved by C. Saltzman, author of the AOS. We then recruited patients with ankle OA for evaluation of the AOS-Fr psychometric properties. Twenty-eight patients with ankle OA participated in the evaluation. The AOS-Fr showed strong criterion validity (AOS:WOMAC r = 0.709 and AOS:SF-36 r = -0.654) and construct validity (r = 0.664) and proved to be reliable (test-retest intraclass correlation coefficient = 0.922). The AOS-Fr is a reliable and valid score equivalent to the English version in terms of psychometric properties, thus is available for use in multicentre trials.

Psychometric properties of the Italian version of the Cognitive Reserve Scale (I-CRS).

PubMed

Altieri, Manuela; Siciliano, Mattia; Pappacena, Simona; Roldán-Tapia, María Dolores; Trojano, Luigi; Santangelo, Gabriella

2018-05-04

The original definition of cognitive reserve (CR) refers to the individual differences in cognitive performance after a brain damage or pathology. Several proxies were proposed to evaluate CR (education, occupational attainment, premorbid IQ, leisure activities). Recently, some scales were developed to measure CR taking into account several cognitively stimulating activities. The aim of this study is to adapt the Cognitive Reserve Scale (I-CRS) for the Italian population and to explore its psychometric properties. I-CRS was administered to 547 healthy participants, ranging from 18 to 89 years old, along with neuropsychological and behavioral scales to evaluate cognitive functioning, depressive symptoms, and apathy. Cronbach's α, corrected item-total correlations, and the inter-item correlation matrix were calculated to evaluate the psychometric properties of the scale. Linear regression analysis was performed to build a correction grid of the I-CRS according to demographic variables. Correlational analyses were performed to explore the relationships between I-CRS and neuropsychological and behavioral scales. We found that age, sex, and education influenced the I-CRS score. Young adults and adults obtained higher I-CRS scores than elderly adults; women and participants with high educational attainment scored higher on I-CRS than men and participants with low education. I-CRS score correlated poorly with cognitive and depression scale scores, but moderately with apathy scale scores. I-CRS showed good psychometric properties and seemed to be a useful tool to assess CR in every adult life stage. Moreover, our findings suggest that apathy rather than depressive symptoms may interfere with the building of CR across the lifespan.

Clinical and Psychometric Evaluations of the Cerebral Vision Screening Questionnaire in 461 Nonaphasic Individuals Poststroke.

PubMed

Neumann, Guenter; Schaadt, Anna-Katharina; Reinhart, Stefan; Kerkhoff, Georg

2016-03-01

Cerebral vision disorders (CVDs) are frequent after brain damage and impair the patient's outcome. Yet clinically and psychometrically validated procedures for the anamnesis of CVD are lacking. To evaluate the clinical validity and psychometric qualities of the Cerebral Vision Screening Questionnaire (CVSQ) for the anamnesis of CVD in individuals poststroke. Analysis of the patients' subjective visual complaints in the 10-item CVSQ in relation to objective visual perimetry, tests of reading, visual scanning, visual acuity, spatial contrast sensitivity, light/dark adaptation, and visual depth judgments. Psychometric analyses of concurrent validity, specificity, sensitivity, positive/negative predictive value, and interrater reliability were also done. Four hundred sixty-one patients with unilateral (39.5% left, 47.5% right) or bilateral stroke (13.0%) were included. Most patients were assessed in the chronic stage, on average 36.7 (range = 1-620) weeks poststroke. The majority of all patients (96.4%) recognized their visual symptoms within 1 week poststroke when asked for specifically. Mean concurrent validity of the CVSQ with objective tests was 0.64 (0.54-0.79, P < .05). The mean positive predictive value was 80.1%, mean negative predictive value 82.9%, mean specificity 81.7%, and mean sensitivity 79.8%. The mean interrater reliability was 0.76 for a 1-week interval between both assessments (all P < .05). The CVSQ is suitable for the anamnesis of CVD poststroke because of its brevity (10 minute), clinical validity, and good psychometric qualities. It, thus, improves neurovisual diagnosis and guides the clinician in the selection of necessary assessments and appropriate neurovisual therapies for the patient. © The Author(s) 2015.

Linguistic and psychometric validation of the MSSS-88 questionnaire for patients with multiple sclerosis and spasticity in Germany.

PubMed

Henze, Thomas; von Mackensen, Sylvia; Lehrieder, Gerald; Zettl, Uwe K; Pfiffner, Carmen; Flachenecker, Peter

2014-08-01

Multiple sclerosis (MS) is an inflammatory disease where many of the patients suffer from spasticity impacting their quality-of-life. The purpose of this paper was to linguistically validate and psychometrically test the Multiple Sclerosis Spasticity Scale (MSSS-88) in German speaking MS patients. The study had two stages: 1) forward/backward translations of the original MSSS-88 scale into German, discussions with MS-experts and cognitive debriefings with MS patients; 2) psychometric evaluation of the German version. Data collection took part in an observational multi-centre study in Germany (MOVE2). The German translation of the MSSS-88 scale was discussed with three MS-experts; followed by two cognitive debriefing sessions with 12 MS patients. For psychometric evaluation the MSSS-88 was filled in by 87 MS patients with a mean age of 50.2 ± 10.4 years; 26.4% of them had severe spasticity. Data quality was acceptable. Missing data for items of the MSSS-88 were low (range 0-5.75%). Psychometric testing of the MSSS-88 revealed excellent values for reliability and validity. Significant differences between groups regarding severity, grading, type and self-ratings of MS-spasticity and sleep disturbances were found. Sensitivity to change could be demonstrated for the MSSS-88 in the group of MS patients treated with cannabinoid oromucosal spray vs. non-treated patients. In the treated group significant changes with a moderate effect size were found for 'muscle spasms', 'emotional health' and 'pain/discomfort'. No significant changes could be detected in the non-treated group. Preliminary evidence from this small study supports reliability, validity, and responsiveness of the German version of the MSSS-88 for measuring the impact of spasticity in MS.

Children and Young People-Mental Health Safety Assessment Tool (CYP-MH SAT) study: Protocol for the development and psychometric evaluation of an assessment tool to identify immediate risk of self-harm and suicide in children and young people (10–19 years) in acute paediatric hospital settings

PubMed Central

Walker, Gemma M; Carter, Tim; Aubeeluck, Aimee; Witchell, Miranda; Coad, Jane

2018-01-01

Introduction Currently, no standardised, evidence-based assessment tool for assessing immediate self-harm and suicide in acute paediatric inpatient settings exists. Aim The aim of this study is to develop and test the psychometric properties of an assessment tool that identifies immediate risk of self-harm and suicide in children and young people (10–19 years) in acute paediatric hospital settings. Methods and analysis Development phase: This phase involved a scoping review of the literature to identify and extract items from previously published suicide and self-harm risk assessment scales. Using a modified electronic Delphi approach, these items will then be rated according to their relevance for assessment of immediate suicide or self-harm risk by expert professionals. Inclusion of items will be determined by 65%–70% consensus between raters. Subsequently, a panel of expert members will convene to determine the face validity, appropriate phrasing, item order and response format for the finalised items. Psychometric testing phase: The finalised items will be tested for validity and reliability through a multicentre, psychometric evaluation. Psychometric testing will be undertaken to determine the following: internal consistency, inter-rater reliability, convergent, divergent validity and concurrent validity. Ethics and dissemination Ethical approval was provided by the National Health Service East Midlands—Derby Research Ethics Committee (17/EM/0347) and full governance clearance received by the Health Research Authority and local participating sites. Findings from this study will be disseminated to professionals and the public via peer-reviewed journal publications, popular social media and conference presentations. PMID:29654046

Iranian Effective Clinical Nurse Instructor evaluation tool: Development and psychometric testing

PubMed Central

Shahsavari, Hooman; Yekta, Zohreh Parsa; Zare, Zahra; Sigaroodi, Abdolhossain Emami

2014-01-01

Background: Clinical education is the heart of the nursing education program. Effective nursing clinical instructors are needed for graduating the future qualified nurses. There is a well-developed body of knowledge about the effectiveness of clinical teaching and the instructors. However, translating this knowledge into a context-based evaluation tool for measuring the effectiveness of Iranian clinical nursing instructors remains a deficiency. The purpose of this study is to describe the development and psychometric testing process of an instrument to evaluate the characteristics of Iranian effective clinical nurse instructor. Materials and Methods: Following a precise review of Iranian literatures and expert consultation, 83 statements about the characteristics that make clinical nurse instructors effective were extracted. In the next phase, the psychometric properties of the instrument were established by looking at the content validity, face validity, and internal consistency. Content validity of the instrument was assessed based on the comments of an expert panel including 10 nursing faculty members. During this phase, 30 items of the instrument were omitted or merged. Face validity of the instrument was assured based on the advices of 10 nursing students and 10 nursing faculty members. Finally, in the pilot test, the data of 168 filled questionnaires were gathered and analyzed by an exploratory factor analysis to reduce the items and identify the factor structure of the instrument. Results: Through subsequent analyses, of the 83 items, 31 items were merged or omitted. At last, 52 retained items were divided into four subscales including student-centric behaviors, clinical performances, planning ability, and personality traits. The Cronbach's alpha level of the inventory was 0.96, with the value for each domain ranging from 0.87 to 0.94. Conclusions: Iranian Effective Clinical Nurse Instructor evaluation tool has acceptable psychometric properties and can be used in evaluating the effectiveness of clinical nursing instructors. PMID:24834081

Assessment of Patient Empowerment - A Systematic Review of Measures

PubMed Central

Barr, Paul J.; Scholl, Isabelle; Bravo, Paulina; Faber, Marjan J.; Elwyn, Glyn; McAllister, Marion

2015-01-01

Background Patient empowerment has gained considerable importance but uncertainty remains about the best way to define and measure it. The validity of empirical findings depends on the quality of measures used. This systematic review aims to provide an overview of studies assessing psychometric properties of questionnaires purporting to capture patient empowerment, evaluate the methodological quality of these studies and assess the psychometric properties of measures identified. Methods Electronic searches in five databases were combined with reference tracking of included articles. Peer-reviewed articles reporting psychometric testing of empowerment measures for adult patients in French, German, English, Portuguese and Spanish were included. Study characteristics, constructs operationalised and psychometric properties were extracted. The quality of study design, methods and reporting was assessed using the COSMIN checklist. The quality of psychometric properties was assessed using Terwee’s 2007 criteria. Findings 30 studies on 19 measures were included. Six measures are generic, while 13 were developed for a specific condition (N=4) or specialty (N=9). Most studies tested measures in English (N=17) or Swedish (N=6). Sample sizes of included studies varied from N=35 to N=8261. A range of patient empowerment constructs was operationalised in included measures. These were classified into four domains: patient states, experiences and capacities; patient actions and behaviours; patient self-determination within the healthcare relationship and patient skills development. Quality assessment revealed several flaws in methodological study quality with COSMIN scores mainly fair or poor. The overall quality of psychometric properties of included measures was intermediate to positive. Certain psychometric properties were not tested for most measures. Discussion Findings provide a basis from which to develop consensus on a core set of patient empowerment constructs and for further work to develop a (set of) appropriately validated measure(s) to capture this. The methodological quality of psychometric studies could be improved by adhering to published quality criteria. PMID:25970618

Design and Psychometric Evaluation of the Quality of Life in Patients With Anal Fistula Questionnaire.

PubMed

Ferrer-Márquez, Manuel; Espínola-Cortés, Natalia; Reina-Duarte, Angel; Granero-Molina, José; Fernández-Sola, Cayetano; Hernández-Padilla, José Manuel

2017-10-01

Quality of life is often considered when deciding and evaluating the treatment strategy for patients diagnosed with anal fistula. The purpose of this study was to develop and psychometrically test the Quality of Life in Patients with Anal Fistula Questionnaire. This was an observational cross-sectional study for the development and validation of a psychometric tool. The study was conducted at a general hospital in the southeast of Spain. A convenience sample included 54 patients diagnosed with anal fistula. The reliability of the tool was assessed through its internal consistency (Cronbach α) and temporal stability (Spearman correlation coefficient (r) between test-retest). The content validity index of the items and the scale was calculated. Correlation analysis and an ordinal regression analysis between the developed tool and the Short Form 12 Health Survey examined its concurrent validity. Principal component analysis and known-group analysis using the Kruskal-Wallis test examined its construct validity. The reliability of the developed questionnaire was very high (α = 0.908; r = 0.861; p < 0.01). Its content validity was excellent (all-item content validity index = 0.79-1.00; scale validity index = 0.92). Evidence of its concurrent validity included strong correlation between the developed tool and Short Form 12 Health Survey (r = 0.734; p < 0.001), and participant scores on the developed tool explained ≈46.2% of the between-subject variation for the participant scores on Short Form 12 Health Survey (Nagelkerke R = 0.462). Confirming its construct validity, principal component analysis revealed that 2 factors explained 81.63% of the total variance found. Known-group analysis evidenced the ability of the questionnaire to detect expected differences in patients presenting with different symptomatology. The major limitations of this study were the use of a small sample of Spanish-speaking patients, not including patients in the initial development of the questionnaire, and developing the scoring system using a summation method. The Quality of Life in Patients with Anal Fistula Questionnaire has proven to be a valid, reliable, and concise tool that could contribute to the evaluation of quality of life among patients with an anal fistula. See Video Abstract at http://links.lww.com/DCR/A368.

Item-level psychometrics and predictors of performance for Spanish/English bilingual speakers on an object and action naming battery.

PubMed

Edmonds, Lisa A; Donovan, Neila J

2012-04-01

There is a pressing need for psychometrically sound naming materials for Spanish/English bilingual adults. To address this need, in this study the authors examined the psychometric properties of An Object and Action Naming Battery (An O&A Battery; Druks & Masterson, 2000) in bilingual speakers. Ninety-one Spanish/English bilinguals named O&A Battery items in English and Spanish. Responses underwent a Rasch analysis. Using correlation and regression analyses, the authors evaluated the effect of psycholinguistic (e.g., imageability) and participant (e.g., proficiency ratings) variables on accuracy. Rasch analysis determined unidimensionality across English and Spanish nouns and verbs and robust item-level psychometric properties, evidence for content validity. Few items did not fit the model, there were no ceiling or floor effects after uninformative and misfit items were removed, and items reflected a range of difficulty. Reliability coefficients were high, and the number of statistically different ability levels provided indices of sensitivity. Regression analyses revealed significant correlations between psycholinguistic variables and accuracy, providing preliminary construct validity. The participant variables that contributed most to accuracy were proficiency ratings and time of language use. Results suggest adequate content and construct validity of O&A items retained in the analysis for Spanish/English bilingual adults and support future efforts to evaluate naming in older bilinguals and persons with bilingual aphasia.

Disruptive behavior scale for adolescents (DISBA): development and psychometric properties.

PubMed

Karimy, Mahmood; Fakhri, Ahmad; Vali, Esmaeel; Vali, Farzaneh; Veiga, Feliciano H; Stein, L A R; Araban, Marzieh

2018-01-01

Growing evidence indicates that if disruptive behavior is left unidentified and untreated, a significant proportion of these problems will persist and may develop into problems linked with delinquency, substance abuse, and violence. Research is needed to develop valid and reliable measures of disruptive behavior to assist recognition and impact of treatments on disruptive behavior. The aim of this study was to develop and evaluate the psychometric properties of a scale for disruptive behavior in adolescents. Six hundred high school students (50% girls), ages ranged 15-18 years old, selected through multi stage random sampling. Psychometrics of the disruptive behavior scale for adolescents (DISBA) (Persian version) was assessed through content validity, explanatory factor analysis (EFA) using Varimax rotation and confirmatory factor analysis (CFA). The reliability of this scale was assessed via internal consistency and test-retest reliability. EFA revealed four factors accounting for 59% of observed variance. The final 29-item scale contained four factors: (1) aggressive school behavior, (2) classroom defiant behavior, (3) unimportance of school, and (4) defiance to school authorities. Furthermore, CFA produced a sufficient Goodness of Fit Index > 0.90. Test-retest and internal consistency reliabilities were acceptable at 0.85 and 0.89, respectively. The findings from this study suggest that the Iranian version of DISBA questionnaire has content validity. Further studies are needed to evaluate stronger psychometric properties for DISBA.

Development and Initial Validation of the Environmental Restriction Questionnaire (ERQ)

ERIC Educational Resources Information Center

Rosenberg, Limor; Ratzon, Nava Z.; Jarus, Tal; Bart, Orit

2010-01-01

The purpose of this manuscript was to develop and test the psychometric properties of the Environmental Restriction Questionnaire (ERQ) a parent-reported questionnaire for measuring perceived environmental restrictions for young children participation. Reliability and homogeneity were tested by Cronbach's alpha and inter-item correlations.…

Concise Associated Symptoms Tracking scale: a brief self-report and clinician rating of symptoms associated with suicidality.

PubMed

Trivedi, Madhukar H; Wisniewski, Stephen R; Morris, David W; Fava, Maurizio; Kurian, Benji T; Gollan, Jackie K; Nierenberg, Andrew A; Warden, Diane; Gaynes, Bradley N; Luther, James F; Rush, A John

2011-06-01

US Food and Drug Administration (FDA) warnings recommend monitoring negative symptoms associated with the initiation of antidepressant medications as these symptoms may interfere with full recovery and pose safety concerns. There is currently no brief, reliable rating instrument for assessing treatment-emergent, negative symptoms. We evaluated the psychometric properties of 2 versions of the newly developed 17-item Concise Associated Symptom Tracking (CAST) scale, the CAST Clinician Rating (CAST-C) and CAST Self-Rated (CAST-SR), which are brief instruments designed to measure the 5 relevant associated symptom domains (irritability, anxiety, mania, insomnia, and panic). The study enrolled 265 outpatients with major depressive disorder (MDD), from July 2007 through February 2008, into an 8-week, open-label trial with a selective serotonin reuptake inhibitor. Diagnosis of MDD was determined by the Psychiatric Diagnostic Screening questionnaire and an MDD checklist based on DSM-IV-TR criteria. Suicidality (suicidal ideation with associated behaviors) is 1 of 9 symptoms of MDD (depressed mood, loss of interest, appetite or weight change, sleep disturbance, reduced concentration or indecisiveness, fatigue or decreased energy, psychomotor agitation or retardation, feelings of worthlessness or excessive guilt). Psychometric evaluations were conducted on both versions of the CAST. Cronbach α was .80 (CAST-C) and .81 (CAST-SR). Factor analysis identified 5 factors for each scale: (1) irritability, (2) anxiety, (3) mania, (4) insomnia, and (5) panic. When the item that cross-loaded on 2 factors was eliminated, the 16-item solution had a better goodness of fit (CAST-C: 0.90 vs 0.87; CAST-SR: 0.88 vs 0.84). Cronbach α for the 16-item versions was .77 (CAST-C) and .78 (CAST-SR). The 5 associated CAST symptom domains correlated well with other standard measures of these domains. The 16-item CAST-C and CAST-SR demonstrated excellent psychometric properties. These are potentially useful measures for monitoring treatment-emergent negative symptoms associated with antidepressants, as recommended by the FDA. Clinicaltrials.gov Identifier: NCT00532103. © Copyright 2011 Physicians Postgraduate Press, Inc.

Informational and decisional empowerment in online health support communities: initial psychometric validation of the Cyber Info-Decisional Empowerment Scale (CIDES) and preliminary data from administration of the scale.

PubMed

Seçkin, Gül

2011-12-01

This article presents initial psychometric validation of an instrument developed to measure cyber informational and decisional empowerment. The article provides preliminary insights into the extent to which cyber patients view the digital environment of peer-based information and support as a resource for informed and empowered participation in self health care management. Data come from cancer patients (N = 350) who participated in the Study of Virtual Health Networks for Cancer Patients of the 21st Century. Data were first analyzed using exploratory factor analysis with principle component extraction and Varimax rotation. Age-based split-sample analysis (≥ 51 and ≤ 50) was performed on a subsample, which consisted of only women (N = 255), in order to cross-validate psychometric data obtained from the full sample. A confirmatory factor analysis was conducted using AMOS 19.0. to further validate the scale. The composite scale is unidimensional with excellent internal consistency reliability. The highest average scores were obtained for informational empowerment items. The lowest average was for the item that measured empowerment to seek second opinion from additional health care professionals. The ability of this composite measure to provide information about the extent to which computer-connected patients view digital peer support as an empowerment tool makes it a valuable addition to the literature in health informatics, supportive cancer care, and health quality of life research.

Cross-cultural psychometric assessment of the VAGUS insight into psychosis scale - Spanish version.

PubMed

de León, Patricia Ponce; Gerretsen, Philip; Shah, Parita; Saracco-Alvarez, Ricardo; Graff-Guerrero, Ariel; Fresán, Ana

2018-01-01

Impaired insight into illness, a core feature of schizophrenia with negative clinical implications, is a multidimensional phenomenon existing on a continuum. However, the degree to which illness perception in distinct cultures influences the appraisal of insight into illness in schizophrenia remains unclear. As such, we aimed to determine if the psychometric properties of the VAGUS insight into psychosis scale (www.vagusonline.com), which was originally assessed in English speaking Canadians, were similar in a sample of Latino Mexican Spanish speaking patients with schizophrenia. To accomplish this, the VAGUS - Self-Report (SR) version was translated from English to Spanish and psychometrically evaluated in 95 participants. The Spanish version of the VAGUS-SR was internally consistent (ᾳ = 0.713), and demonstrated good convergent and discriminant validity with the subscales of the Positive and Negative Syndrome Scale. Factor analysis identified two components of insight, congruent with two of the components of the English version of the VAGUS-SR. In conclusion, the VAGUS-SR is a brief, novel, and valid measure of insight into illness in schizophrenia, which demonstrated similar psychometric properties in two culturally and linguistically distinct samples with schizophrenia. Future studies should assess whether the VAGUS demonstrates similar psychometric properties in non-Western cultures. Copyright © 2017 Elsevier B.V. All rights reserved.

Development and initial evaluation of the Clinical Information Systems Success Model (CISSM).

PubMed

Garcia-Smith, Dianna; Effken, Judith A

2013-06-01

Most clinical information systems (CIS) today are technically sound, but the number of successful implementations of these systems is low. The purpose of this study was to develop and test a theoretically based integrated CIS Success Model (CISSM) from the nurse perspective. Model predictors of CIS success were taken from existing research on information systems acceptance, user satisfaction, use intention, user behavior and perceptions, as well as clinical research. Data collected online from 234 registered nurses in four hospitals were used to test the model. Each nurse had used the Cerner Power Chart Admission Health Profile for at least 3 months. Psychometric testing and factor analysis of the 23-item CISSM instrument established its construct validity and reliability. Initial analysis showed nurses' satisfaction with and dependency on CIS use predicted their perceived CIS use Net Benefit. Further analysis identified Social Influence and Facilitating Conditions as other predictors of CIS user Net Benefit. The level of hospital CIS integration may account for the role of CIS Use Dependency in the success of CIS. Based on our experience, CISSM provides a formative as well as summative tool for evaluating CIS success from the nurse's perspective. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Factorial validity and measurement equivalence of the Client Assessment of Treatment Scale for psychiatric inpatient care - a study in three European countries.

PubMed

Richardson, Michelle; Katsakou, Christina; Torres-González, Francisco; Onchev, George; Kallert, Thomas; Priebe, Stefan

2011-06-30

Patients' views of inpatient care need to be assessed for research and routine evaluation. For this a valid instrument is required. The Client Assessment of Treatment Scale (CAT) has been used in large scale international studies, but its psychometric properties have not been well established. The structural validity of the CAT was tested among involuntary inpatients with psychosis. Data from locations in three separate European countries (England, Spain and Bulgaria) were collected. The factorial validity was initially tested using single sample confirmatory factor analyses in each country. Subsequent multi-sample analyses were used to test for invariance of the factor loadings, and factor variances across the countries. Results provide good initial support for the factorial validity and invariance of the CAT scores. Future research is needed to cross-validate these findings and to generalise them to other countries, treatment settings, and patient populations. Copyright © 2011 Elsevier Ltd. All rights reserved.

Preliminary psychometric testing of the Fox Simple Quality-of-Life Scale.

PubMed

Fox, Sherry

2004-06-01

Although quality of life is extensively defined as subjective and multidimensional with both affective and cognitive components, few instruments capture important dimensions of the construct, and few are both conceptually congruent and user friendly for the clinical setting. The aim of this study was to develop and test a measure that would be easy to use clinically and capture both cognitive and affective components of quality of life. Initial item sources for the Fox Simple Quality-of-Life Scale (FSQOLS) were literature-based. Thirty items were compiled for content validity assessment by a panel of expert healthcare clinicians from various disciplines, predominantly nursing. Five items were removed as a result of the review because they reflected negatively worded or redundant items. The 25-item scale was mailed to 177 people with lung, colon, and ovarian cancer in various stages. Cancer types were selected theoretically, based on similarity in prognosis, degree of symptom burden, and possible meaning and experience. Of the 145 participants, all provided complete data on the FSQOLS. Psychometric evaluation of the FSQOLS included item-total correlations, principal components analysis with varimax rotation revealing two factors explaining 50% variance, reliability estimation using alpha estimates, and item-factor correlations. The FSQOLS exhibited significant convergent validity with four popular quality-of-life instruments: the Ferrans and Powers Quality of Life Index, the Functional Assessment of Cancer Therapy Scale, the Short-Form-36 Health Survey, and the General Well-Being Scale. Content validity of the scale was explored and supported using qualitative interviews of 14 participants with lung, colon and ovarian cancer, who were a subgroup of the sample for the initial instrument testing.

Development of a Computer-Adaptive Physical Function Instrument for Social Security Administration Disability Determination

PubMed Central

Ni, Pengsheng; McDonough, Christine M.; Jette, Alan M.; Bogusz, Kara; Marfeo, Elizabeth E.; Rasch, Elizabeth K.; Brandt, Diane E.; Meterko, Mark; Chan, Leighton

2014-01-01

Objectives To develop and test an instrument to assess physical function (PF) for Social Security Administration (SSA) disability programs, the SSA-PF. Item Response Theory (IRT) analyses were used to 1) create a calibrated item bank for each of the factors identified in prior factor analyses, 2) assess the fit of the items within each scale, 3) develop separate Computer-Adaptive Test (CAT) instruments for each scale, and 4) conduct initial psychometric testing. Design Cross-sectional data collection; IRT analyses; CAT simulation. Setting Telephone and internet survey. Participants Two samples: 1,017 SSA claimants, and 999 adults from the US general population. Interventions None. Main Outcome Measure Model fit statistics, correlation and reliability coefficients, Results IRT analyses resulted in five unidimensional SSA-PF scales: Changing & Maintaining Body Position, Whole Body Mobility, Upper Body Function, Upper Extremity Fine Motor, and Wheelchair Mobility for a total of 102 items. High CAT accuracy was demonstrated by strong correlations between simulated CAT scores and those from the full item banks. Comparing the simulated CATs to the full item banks, very little loss of reliability or precision was noted, except at the lower and upper ranges of each scale. No difference in response patterns by age or sex was noted. The distributions of claimant scores were shifted to the lower end of each scale compared to those of a sample of US adults. Conclusions The SSA-PF instrument contributes important new methodology for measuring the physical function of adults applying to the SSA disability programs. Initial evaluation revealed that the SSA-PF instrument achieved considerable breadth of coverage in each content domain and demonstrated noteworthy psychometric properties. PMID:23578594

Development of a computer-adaptive physical function instrument for Social Security Administration disability determination.

PubMed

Ni, Pengsheng; McDonough, Christine M; Jette, Alan M; Bogusz, Kara; Marfeo, Elizabeth E; Rasch, Elizabeth K; Brandt, Diane E; Meterko, Mark; Haley, Stephen M; Chan, Leighton

2013-09-01

To develop and test an instrument to assess physical function for Social Security Administration (SSA) disability programs, the SSA-Physical Function (SSA-PF) instrument. Item response theory (IRT) analyses were used to (1) create a calibrated item bank for each of the factors identified in prior factor analyses, (2) assess the fit of the items within each scale, (3) develop separate computer-adaptive testing (CAT) instruments for each scale, and (4) conduct initial psychometric testing. Cross-sectional data collection; IRT analyses; CAT simulation. Telephone and Internet survey. Two samples: SSA claimants (n=1017) and adults from the U.S. general population (n=999). None. Model fit statistics, correlation, and reliability coefficients. IRT analyses resulted in 5 unidimensional SSA-PF scales: Changing & Maintaining Body Position, Whole Body Mobility, Upper Body Function, Upper Extremity Fine Motor, and Wheelchair Mobility for a total of 102 items. High CAT accuracy was demonstrated by strong correlations between simulated CAT scores and those from the full item banks. On comparing the simulated CATs with the full item banks, very little loss of reliability or precision was noted, except at the lower and upper ranges of each scale. No difference in response patterns by age or sex was noted. The distributions of claimant scores were shifted to the lower end of each scale compared with those of a sample of U.S. adults. The SSA-PF instrument contributes important new methodology for measuring the physical function of adults applying to the SSA disability programs. Initial evaluation revealed that the SSA-PF instrument achieved considerable breadth of coverage in each content domain and demonstrated noteworthy psychometric properties. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Psychometric characterization of the obstetric communication assessment tool for medical education: a pilot study.

PubMed

Rodriguez, A Noel; DeWitt, Peter; Fisher, Jennifer; Broadfoot, Kirsten; Hurt, K Joseph

2016-06-11

To characterize the psychometric properties of a novel Obstetric Communication Assessment Tool (OCAT) in a pilot study of standardized difficult OB communication scenarios appropriate for undergraduate medical evaluation. We developed and piloted four challenging OB Standardized Patient (SP) scenarios in a sample of twenty-one third year OB/GYN clerkship students: Religious Beliefs (RB), Angry Father (AF), Maternal Smoking (MS), and Intimate Partner Violence (IPV). Five trained Standardized Patient Reviewers (SPRs) independently scored twenty-four randomized video-recorded encounters using the OCAT. Cronbach's alpha and Intraclass Correlation Coefficient-2 (ICC-2) were used to estimate internal consistency (IC) and inter-rater reliability (IRR), respectively. Systematic variation in reviewer scoring was assessed using the Stuart-Maxwell test. IC was acceptable to excellent with Cronbach's alpha values (and 95% Confidence Intervals [CI]): RB 0.91 (0.86, 0.95), AF 0.76 (0.62, 0.87), MS 0.91 (0.86, 0.95), and IPV 0.94 (0.91, 0.97). IRR was unacceptable to poor with ICC-2 values: RB 0.46 (0.40, 0.53), AF 0.48 (0.41, 0.54), MS 0.52 (0.45, 0.58), and IPV 0.67 (0.61, 0.72). Stuart-Maxwell analysis indicated systematic differences in reviewer stringency. Our initial characterization of the OCAT demonstrates important issues in communications assessment. We identify scoring inconsistencies due to differences in SPR rigor that require enhanced training to improve assessment reliability. We outline a rational process for initial communication tool validation that may be useful in undergraduate curriculum development, and acknowledge that rigorous validation of OCAT training and implementation is needed to create a valuable OB communication assessment tool.

Key issues affecting quality of life and patient-reported outcomes in prostate cancer: an analysis conducted in 2128 patients with initial psychometric assessment of the prostate cancer symptom scale (PCSS).

PubMed

Msaouel, Pavlos; Gralla, Richard J; Jones, Randy A; Hollen, Patricia J

2017-09-01

Evidence-based quality of life (QL) questionnaires require the identification of issues of importance to patients. The primary aim of this study was to inform providers on patient-expressed issues while enhancing the content validity of instruments assessing QL and patient-reported outcomes (PROs) in prostate cancer. The study provided additional psychometric properties for the new PRO and QL instrument, the Prostate Cancer Symptom Scale (PCSS). An anonymous web-based survey of 2128 patients with prostate cancer was conducted with patients rating 18 QL items on a five-point scale. Most respondents (74%) were aged 55-74 years, had early stage disease at diagnosis (81%) and were diagnosed within 2 years of the survey (81%). The top five-rated issues were: overall QL, ability to perform normal activities, maintaining independence, ability to sleep and not being a burden. These items were ranked as either 'very important' or 'important' by at least 88% of patients. None of the most highly ranked issues were symptoms. Instead, the highest ranked items were global issues reflecting the impact of symptoms on patients. In addition to the enhanced content validity findings, good reliability results and initial support for construct validity are reported for the PCSS. This is the largest survey providing patient-expressed background for content validity for QL and PRO measures. The findings of this study should aid development of newer practical questionnaires, such as the PCSS, which can be adapted to electronic platforms enhancing rapid and accurate PRO and QL evaluation. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Online Self-Administered Cognitive Testing Using the Amsterdam Cognition Scan: Establishing Psychometric Properties and Normative Data.

PubMed

Feenstra, Heleen Em; Vermeulen, Ivar E; Murre, Jaap Mj; Schagen, Sanne B

2018-05-30

Online tests enable efficient self-administered assessments and consequently facilitate large-scale data collection for many fields of research. The Amsterdam Cognition Scan is a new online neuropsychological test battery that measures a broad variety of cognitive functions. The aims of this study were to evaluate the psychometric properties of the Amsterdam Cognition Scan and to establish regression-based normative data. The Amsterdam Cognition Scan was self-administrated twice from home-with an interval of 6 weeks-by 248 healthy Dutch-speaking adults aged 18 to 81 years. Test-retest reliability was moderate to high and comparable with that of equivalent traditional tests (intraclass correlation coefficients: .45 to .80; .83 for the Amsterdam Cognition Scan total score). Multiple regression analyses indicated that (1) participants' age negatively influenced all (12) cognitive measures, (2) gender was associated with performance on six measures, and (3) education level was positively associated with performance on four measures. In addition, we observed influences of tested computer skills and of self-reported amount of computer use on cognitive performance. Demographic characteristics that proved to influence Amsterdam Cognition Scan test performance were included in regression-based predictive formulas to establish demographically adjusted normative data. Initial results from a healthy adult sample indicate that the Amsterdam Cognition Scan has high usability and can give reliable measures of various generic cognitive ability areas. For future use, the influence of computer skills and experience should be further studied, and for repeated measurements, computer configuration should be consistent. The reported normative data allow for initial interpretation of Amsterdam Cognition Scan performances. ©Heleen EM Feenstra, Ivar E Vermeulen, Jaap MJ Murre, Sanne B Schagen. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 30.05.2018.

Perceived experiences of atheist discrimination: Instrument development and evaluation.

PubMed

Brewster, Melanie E; Hammer, Joseph; Sawyer, Jacob S; Eklund, Austin; Palamar, Joseph

2016-10-01

The present 2 studies describe the development and initial psychometric evaluation of a new instrument, the Measure of Atheist Discrimination Experiences (MADE), which may be used to examine the minority stress experiences of atheist people. Items were created from prior literature, revised by a panel of expert researchers, and assessed psychometrically. In Study 1 (N = 1,341 atheist-identified people), an exploratory factor analysis with 665 participants suggested the presence of 5 related dimensions of perceived discrimination. However, bifactor modeling via confirmatory factor analysis and model-based reliability estimates with data from the remaining 676 participants affirmed the presence of a strong "general" factor of discrimination and mixed to poor support for substantive subdimensions. In Study 2 (N = 1,057 atheist-identified people), another confirmatory factor analysis and model-based reliability estimates strongly supported the bifactor model from Study 1 (i.e., 1 strong "general" discrimination factor) and poor support for subdimensions. Across both studies, the MADE general factor score demonstrated evidence of good reliability (i.e., Cronbach's alphas of .94 and .95; omega hierarchical coefficients of .90 and .92), convergent validity (i.e., with stigma consciousness, β = .56; with awareness of public devaluation, β = .37), and preliminary evidence for concurrent validity (i.e., with loneliness β = .18; with psychological distress β = .27). Reliability and validity evidence for the MADE subscale scores was not sufficient to warrant future use of the subscales. Limitations and implications for future research and clinical work with atheist individuals are discussed. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Development and validation of a self-efficacy scale for postoperative rehabilitation management of lung cancer patients.

PubMed

Huang, Fei-Fei; Yang, Qing; Han, Xuan Ye; Zhang, Jing-Ping; Lin, Ting

2017-08-01

The purpose of this study was to develop a Self-Efficacy Scale for Rehabilitation Management designed specifically for postoperative lung cancer patients (SESPRM-LC) and to evaluate its psychometric properties. Based on the concept of self-management of chronic disease, items were developed from literature review and semistructured interviews of 10 lung cancer patients and screened by expert consultation and pilot testing. Psychometric evaluation was done with 448 postoperative lung cancer patients recruited from 5 tertiary hospitals in Fuzhou, China, by incorporating classical test theory and item response theory methods. A 6-factor structure was illustrated by exploratory factor analysis and confirmed by confirmatory factor analysis, explaining 60.753% of the total variance. The SESPRM-LC achieved Cronbach's α of 0.694 to 0.893, 2-week test-retest reliability of 0.652 to 0.893, and marginal reliability of 0.565 to 0.934. The predictive and criterion validities were demonstrated by significant association with theoretically supported quality-of-life variables (r = 0.211-0.392, P < .01), and General Perceived Self-efficacy Scale (r = 0.465, P < .01), respectively. Item response theory analysis showed that the SESPRM-LC offers information about a broad range of self-efficacy measures and discriminates well between patients with high and low levels of self-efficacy. We demonstrated initial support for the reliability and validity of the 27-item SESPRM-LC, as a developmentally appropriate instrument for assessing self-efficacy among lung cancer patients during postoperative rehabilitation. Copyright © 2016 John Wiley & Sons, Ltd.

My Vocational Situation (MVS): Case Example and Psychometric Review.

PubMed

Nitsch, Kristian P; Pedersen, Jessica; Miliotto, Alexandra; Petersen, Brett; Robbins, Samantha; Garcia, Ana; Hoisington, Molly Ansel; The, Kimberly J; Smiley, Jill; Janikowski, Timothy

This case report provides an overview of the psychometric properties and clinical utility of the My Vocational Situation (MVS) instrument. The accompanying hypothetical case description illustrates how clinicians could use the MVS to evaluate vocational preferences and outcomes and how the MVS can be used to inform treatment planning and rehabilitation decision making. The information contained in this report is intended to familiarize clinicians with the administration and scoring of the MVS, the psychometric information necessary to interpret results obtained from the MVS, and how the results could be used to provide comprehensive, patient-centered care. It is important to note that the information provided represents only a sample of the available research literature on the MVS. Copyright © 2017 by the American Occupational Therapy Association, Inc.

Psychometric Assessment of the Job Embeddedness Instrument: A Rasch Perspective.

PubMed

Reitz, O Ed; Smith, Everett V

2018-05-01

The aim of this study was to examine the psychometric properties of the job embeddedness instrument (JEI) using a Rasch perspective in a sample of Registered Nurses (RNs). A secondary analysis of data was conducted from a previous study examining the job embeddedness of rural and urban RNs. A Rasch analysis supported the six underlying dimensions: organizational fit, community fit, organizational links, community links, organizational sacrifice, and community sacrifice. The results of this study also demonstrate additional evidence of the validity, reliability, and generalizability of the JEI inferences with a sample of RNs. In total, 38 of 39 items of the original JEI were retained in the model. The psychometric evaluation attained through this multidimensional Rasch analysis provided support for using the JEI to assess the level of job embeddedness for RNs.

Initial Psychometric Validation of the Non-Suicidal Self-Injury Scar Cognition Scale.

PubMed

Burke, Taylor A; Olino, Thomas M; Alloy, Lauren B

2017-09-01

Given the growing literature on the detrimental psychological consequences of NSSI, it is surprising that scarce research has focused on the permanent physical consequences of NSSI, scarring to one's tissue (Burke et al. 2015; Lewis 2016). Indeed, with recent research suggesting that upwards of half of those with a history of NSSI bear scarring as a result of the behavior (Burke et al. 2016), the psychological implications of scarring are important to understand. Given preliminary literature suggesting that the vast majority of individuals who bear NSSI scars ascribe a great deal of meaning to their scarring, and that this meaning varies widely, a psychometrically sound scale is needed to comprehensively and systematically assess NSSI scar-related cognitions. The present study examined the psychometric properties of the Non-Suicidal Self-Injury Scar Cognition Scale (NSSI-SCS). A sample of 110 undergraduates with at least one scar from NSSI completed the NSSI-SCS as well as measures of concurrent and divergent validity. Exploratory Factor Analysis was conducted to determine the factor structure of the NSSI-SCS. Results indicated that a five-factor solution offered the best fit for the data. Psychometric analyses support the validity of the NSSI-SCS given evidence of concurrent validity, divergent validity, and reliability. Future research should examine the test-retest reliability of the NSSI-SCS, as well as its sensitivity to change, particularly in the context of treatment research.

Initial Validation of the Children's Worry Management Scale

ERIC Educational Resources Information Center

Zeman, Janice Lillian; Cassano, Michael; Suveg, Cynthia; Shipman, Kimberly

2010-01-01

We investigated the psychometric properties of a new instrument, the Children's Worry Management Scale (CWMS). The CWMS has three subscales that specify methods of regulating worry: inhibition (the suppression of worry), dysregulation (exaggerated displays of worry), and coping (constructive ways of managing worry). Using a Caucasian, middle-class…

Development of the Levey-Nowak Embedded Librarian Presence Instrument: A Preliminary Study

ERIC Educational Resources Information Center

Levey, Janet A.; Nowak, Karen L.

2015-01-01

A cross-sectional descriptive design was used to examine the initial psychometric properties and feasibility of the newly developed Levey-Nowak Embedded Librarian Presence Instrument. The instrument was structured by a literature review identifying reoccurring concepts of presence, helpfulness, confidence, and collaboration within the embedded…

Designing an Energy Literacy Questionnaire for Middle and High School Youth

ERIC Educational Resources Information Center

DeWaters, Jan; Qaqish, Basil; Graham, Mary; Powers, Susan

2013-01-01

A measurement scale has been developed to assess secondary students' energy literacy--a citizenship understanding of energy that includes cognitive as well as affective and behavioral items. Instrument development procedures followed psychometric principles from educational and social psychology research. Initial exploration of the measure yielded…

Adolescent Domain Screening Inventory-Short Form: Development and Initial Validation

ERIC Educational Resources Information Center

Corrigan, Matthew J.

2017-01-01

This study sought to develop a short version of the ADSI, and investigate its psychometric properties. Methods: This is a secondary analysis. Analysis to determine the Cronbach's Alpha, correlations to determine concurrent criterion validity and known instrument validity and a logistic regression to determine predictive validity were conducted.…

Social Support Questionnaire for Children: Development and Initial Validation

ERIC Educational Resources Information Center

Gordon-Hollingsworth, Arlene T.; Thompson, Julia E.; Geary, Meghan A.; Schexnaildre, Mark A.; Lai, Betty S.; Kelley, Mary Lou

2016-01-01

The Social Support Questionnaire for Children (SSQC) is a 50-item scale that assesses children's social support from parents, relatives, nonrelative adults, siblings, and peers. The SSQC demonstrates good psychometric properties (e.g., internal consistency, factorial validity). Furthermore, the SSQC appears to be an ethnically sensitive measure of…

Validation of the Physical Activity Questionnaire for Older Children (PAQ-C) among Chinese children

USDA-ARS?s Scientific Manuscript database

This study initially validates the Chinese version of the Physical Activity Questionnaire for Older Children (PAQ-C), which has been identified as a potentially valid instrument to assess moderate-to-vigorous physical activity (MVPA) in children among diverse racial groups. The psychometric properti...

How Students Create Motivationally Supportive Learning Environments for Themselves: The Concept of Agentic Engagement

ERIC Educational Resources Information Center

Reeve, Johnmarshall

2013-01-01

The present study introduced "agentic engagement" as a newly proposed student-initiated pathway to greater achievement and greater motivational support. Study 1 developed the brief, construct-congruent, and psychometrically strong Agentic Engagement Scale. Study 2 provided evidence for the scale's construct and predictive validity, as…

Validation of the Social Appearance Anxiety Scale: factor, convergent, and divergent validity.

PubMed

Levinson, Cheri A; Rodebaugh, Thomas L

2011-09-01

The Social Appearance Anxiety Scale (SAAS) was created to assess fear of overall appearance evaluation. Initial psychometric work indicated that the measure had a single-factor structure and exhibited excellent internal consistency, test-retest reliability, and convergent validity. In the current study, the authors further examined the factor, convergent, and divergent validity of the SAAS in two samples of undergraduates. In Study 1 (N = 323), the authors tested the factor structure, convergent, and divergent validity of the SAAS with measures of the Big Five personality traits, negative affect, fear of negative evaluation, and social interaction anxiety. In Study 2 (N = 118), participants completed a body evaluation that included measurements of height, weight, and body fat content. The SAAS exhibited excellent convergent and divergent validity with self-report measures (i.e., self-esteem, trait anxiety, ethnic identity, and sympathy), predicted state anxiety experienced during the body evaluation, and predicted body fat content. In both studies, results confirmed a single-factor structure as the best fit to the data. These results lend additional support for the use of the SAAS as a valid measure of social appearance anxiety.

Outcome Measures for Clinical Trials in Down Syndrome

PubMed Central

Esbensen, Anna J.; Hooper, Stephen R.; Fidler, Deborah; Hartley, Sigan; Edgin, Jamie; d’Ardhuy, Xavier Liogier; Capone, George; Conners, Frances; Mervis, Carolyn B.; Abbeduto, Leonard; Rafii, Michael; Krinsky-McHale, Sharon J.; Urv, Tiina

2017-01-01

Increasingly individuals with intellectual and developmental disabilities, including Down syndrome, are being targeted for clinical trials. However, a challenge exists in effectively evaluating the outcomes of these new pharmacological interventions. Few empirically evaluated, psychometrically sound outcome measures appropriate for use in clinical trials with individuals with Down syndrome have been identified. To address this challenge, the NIH assembled leading clinicians and scientists to review existing measures and identify those that currently are appropriate for trials; those that may be appropriate after expansion of age range addition of easier items, and/or downward extension of psychometric norms; and areas where new measures need to be developed. This paper focuses on measures in the areas of cognition and behavior. PMID:28452584

Psychometrics of the self-report safe driving behavior measure for older adults.

PubMed

Classen, Sherrilene; Wen, Pey-Shan; Velozo, Craig A; Bédard, Michel; Winter, Sandra M; Brumback, Babette; Lanford, Desiree N

2012-01-01

We investigated the psychometric properties of the 68-item Safe Driving Behavior Measure (SDBM) with 80 older drivers, 80 caregivers, and 2 evaluators from two sites. Using Rasch analysis, we examined unidimensionality and local dependence; rating scale; item- and person-level psychometrics; and item hierarchy of older drivers, caregivers, and driving evaluators who had completed the SDBM. The evidence suggested the SDBM is unidimensional, but pairs of items showed local dependency. Across the three rater groups, the data showed good person (≥3.4) and item (≥3.6) separation as well as good person (≥.93) and item reliability (≥.92). Cronbach's α was ≥.96, and few items were misfitting. Some of the items did not follow the hypothesized order of item difficulty. The SDBM classified the older drivers into six ability levels, but to fully calibrate the instrument it must be refined in terms of its items (e.g., item exclusion) and then tested among participants of lesser ability. Copyright © 2012 by the American Occupational Therapy Association, Inc.

Psychometric evaluation of the Dutch version of the Subjective Opiate Withdrawal Scale (SOWS).

PubMed

Dijkstra, Boukje A G; Krabbe, Paul F M; Riezebos, Truus G M; van der Staak, Cees P F; De Jong, Cor A J

2007-01-01

To evaluate the psychometric properties of the Dutch version of the 16-item Subjective Opiate Withdrawal Scale (SOWS). The SOWS measures withdrawal symptoms at the time of assessment. The Dutch SOWS was repeatedly administered to a sample of 272 opioid-dependent inpatients of four addiction treatment centers during rapid detoxification with or without general anesthesia. Examination of the psychometric properties of the SOWS included exploratory factor analysis, internal consistency, test-retest reliability, and criterion validity. Exploratory factor analysis of the SOWS revealed a general pattern of four factors with three items not always clustered in the same factors at different points of measurement. After excluding these items from factor analysis four factors were identified during detoxification (temperature dysregulation, tractus locomotorius, tractus gastro-intestinalis and facial disinhibition). The 13-item SOWS shows high internal consistency and test-retest reliability and good validity at different stages of withdrawal. The 13-item SOWS is a reliable and valid instrument to assess opioid withdrawal during rapid detoxification. Three items were deleted because their content does not correspond directly with opioid withdrawal symptoms. Copyright (c) 2007 S. Karger AG, Basel.

Factor structure and psychometric properties of a Spanish translation of the Body Appreciation Scale-2 (BAS-2).

PubMed

Swami, Viren; García, Antonio Alías; Barron, David

2017-09-01

We examined the psychometric properties of a Spanish translation of the Body Appreciation Scale-2 (BAS-2) in a community sample of 411 women and 389 men in Almería, Spain. Participants completed the 10-item BAS-2 along with measures of appearance evaluation, body areas satisfaction, self-esteem, life satisfaction, and self-reported body mass index (BMI). Exploratory factor analyses with one split-half subsample revealed that BAS-2 scores had a one-dimensional factor structure in women and men. Confirmatory factor analysis with a second split-half subsample showed the one-dimensional factor structure had acceptable fit and was invariant across sex. There were no significant sex differences in BAS-2 scores. BAS-2 scores were significantly and positively correlated with appearance evaluation, body areas satisfaction, self-esteem, and life satisfaction. Body appreciation was significantly and negatively correlated with BMI in men, but associations in women were only significant in the second subsample. Results suggest that the Spanish BAS-2 has adequate psychometric properties. Copyright © 2017 Elsevier Ltd. All rights reserved.

Development and psychometric evaluation of the breast size satisfaction scale.

PubMed

Pahlevan Sharif, Saeed

2017-10-09

Purpose The purpose of this paper is to develop and evaluate psychometrically an instrument named the Breast Size Satisfaction Scale (BSSS) to assess breast size satisfaction. Design/methodology/approach The present scale was developed using a set of 16 computer-generated 3D images of breasts to overcome some of the limitations of existing instruments. The images were presented to participants and they were asked to select the figure that most accurately depicted their actual breast size and the figure that most closely represented their ideal breast size. Breast size satisfaction was computed by subtracting the absolute value of the difference between ideal and actual perceived size from 16, such that higher values indicate greater breast size satisfaction. Findings Study 1 ( n=65 female undergraduate students) showed good test-retest reliability and study 2 ( n=1,000 Iranian women, aged 18 years and above) provided support for convergent validity using a nomological network approach. Originality/value The BSSS demonstrated good psychometric properties and thus can be used in future studies to assess breast size satisfaction among women.

Development and psychometric testing of the nursing student mentors' competence instrument (MCI): A cross-sectional study.

PubMed

Tuomikoski, Anna-Maria; Ruotsalainen, Heidi; Mikkonen, Kristina; Miettunen, Jouko; Kääriäinen, Maria

2018-06-05

Mentors require competence at a diverse array of skills to mentor students during clinical practice. According to the latest evidence, competence at mentoring includes: knowledge, skills and attributes of individual students' learning objectives, core elements of nursing, learning processes, a reciprocal and trustful relationship, feedback, evaluation, cooperation with stakeholders, and the mentor's personal qualities. The purpose of the study was to test psychometric properties of a mentor's competence instrument developed to self-evaluate mentors' competence at mentoring nursing students in clinical practice. A cross-sectional, descriptive, explorative study design was used. Data were collected from mentors at five university hospitals in Finland in 2016. A total of 576 mentors participated in this study. The instrument was developed through systematic review, experts' evaluations, and pilot versions of the instrument tested in previous studies. The construct validity and reliability of the instrument were tested using exploratory factor analysis (EFA) with promax rotation and Cronbach's alpha. A 10-factor model showed that the instrument has acceptable construct validity. Cronbach's alpha values for the subscales observed ranged from 0.76 to 0.90. The instrument exhibited acceptable psychometric properties, thereby proving itself a valuable tool for evaluating mentors' competence at mentoring students. Further assessments of its reliability, validity and generality for measuring mentor's competence for mentoring students in different contexts and cultures are recommended. Copyright © 2018 Elsevier Ltd. All rights reserved.

Evaluation of a new computerized psychometric test battery: Effects of zolpidem and caffeine.

PubMed

Pilli, Raveendranadh; Naidu, Mur; Pingali, Usharani; Shobha, Jc

2013-10-01

To evaluate the effects of centrally active drugs using a new indigenously developed automated psychometric test system and compare the results with that obtained using pencil- and paper-based techniques. The tests were standardized in 24 healthy participants. Reproducibility of the test procedure was evaluated by performing the tests by a single experimenter on two occasions (interday reproducibility). To evaluate the sensitivity of the tests, the effects of zolpidem (5 mg) and caffeine (500 mg) versus placebo were studied in 24 healthy participants in a randomized, double-blind three-way crossover design. Psychometric tests were performed at baseline and at 1, 2, and 3 h after administration of study medication. The effects of zolpidem and caffeine on the psychomotor performance were most pronounced 1 h after administration. At this time, a significant impairment of performance in the simple reaction test (SRT), choice discrimination test (CDT), digit symbol substitution test (DSST), digit vigilance test (DVT), and card sorting test (CST) was observed with zolpidem. In contrast, caffeine showed a significant improvement in performance in CDT and DVT only. The results suggest that the tests of the computerized system are more sensitive and reliable then the pencil and paper tests in detecting the effects of central acting agents and are suitable for use in clinical areas to conduct studies with patients.

Development and psychometric properties of the Student Worry Questionnaire-30.

PubMed

Osman, A; Gutierrez, P M; Downs, W R; Kopper, B A; Barrios, F X; Haraburda, C M

2001-02-01

Described are the development and initial psychometric properties (Ns = 50 and 188) of a self-report measure, the Student Worry Questionnaire-30, for use with college undergraduates. Exploratory principal components analyses (Ns = 388, 350, and 396) with oblimin rotation indicated six domains of worrisome thinking, financial-related concerns, significant others' well-being, social adequacy concerns, academic concerns, and general anxiety symptoms. The total score and scale scores showed internal consistency of .80 to .94. Also, test-retest reliability analyses (.75 to .80) support consistency of responses over 4 wk. Strong evidence for convergent validity) was indicated. Confirmatory factor analysis confirmed the fit of the 6-factor oblique model. Limitations of the present studies, and directions for research are discussed.

A mixed methods approach to adapting and evaluating the functional assessment of HIV infection (FAHI), Swahili version, for use with low literacy populations.

PubMed

Nyongesa, Moses K; Sigilai, Antipa; Hassan, Amin S; Thoya, Janet; Odhiambo, Rachael; Van de Vijver, Fons J R; Newton, Charles R J C; Abubakar, Amina

2017-01-01

Despite bearing the largest HIV-related burden, little is known of the Health-Related Quality of Life (HRQoL) among people living with HIV in sub-Saharan Africa. One of the factors contributing to this gap in knowledge is the lack of culturally adapted and validated measures of HRQoL that are relevant for this setting. We set out to adapt the Functional Assessment of HIV Infection (FAHI) Questionnaire, an HIV-specific measure of HRQoL, and evaluate its internal consistency and validity. The three phase mixed-methods study took place in a rural setting at the Kenyan Coast. Phase one involved a scoping review to describe the evidence base of the reliability and validity of FAHI as well as the geographical contexts in which it has been administered. Phase two involved in-depth interviews (n = 38) to explore the content validity, and initial piloting for face validation of the adapted FAHI. Phase three was quantitative (n = 103) and evaluated the internal consistency, convergent and construct validities of the adapted interviewer-administered questionnaire. In the first phase of the study, we identified 16 studies that have used the FAHI. Most (82%) were conducted in North America. Only seven (44%) of the reviewed studies reported on the psychometric properties of the FAHI. In the second phase, most of the participants (37 out of 38) reported satisfaction with word clarity and content coverage whereas 34 (89%) reported satisfaction with relevance of the items, confirming the face validity of the adapted questionnaire during initial piloting. Our participants indicated that HIV impacted on their physical, functional, emotional, and social wellbeing. Their responses overlapped with items in four of the five subscales of the FAHI Questionnaire establishing its content validity. In the third phase, the internal consistency of the scale was found to be satisfactory with subscale Cronbach's α ranging from 0.55 to 0.78. The construct and convergent validity of the tool were supported by acceptable factor loadings for most of the items on the respective sub-scales and confirmation of expected significant correlations of the FAHI subscale scores with scores of a measure of common mental disorders. The adapted interviewer-administered Swahili version of FAHI questionnaire showed initial strong evidence of good psychometric properties with satisfactory internal consistency and acceptable validity (content, face, and convergent validity). It gives impetus for further validation work, especially construct validity, in similar settings before it can be used for research and clinical purposes in the entire East African region.

Psychometric Properties of the Farsi Version of “Spiritual Needs Questionnaire” for Cancer Patients in Iran: A Methodological Study

PubMed

Hatamipour, Khadijeh; Rassouli, Maryam; Yaghmaie, Farideh; Zendedel, Kazem

2018-04-25

Background and objectives: Spiritual needs are very important requirements to cancer patients. A valid and reliable instrument is needed for evaluation. This study was conducted to psychometrically evaluate a Spiritual Needs Questionnaire (SpNQ) for cancer patients in Iran. Methods: In this study, the methodology and psychometric properties of the Farsi version of the SpNQ (Büssing et al., (2010)) were evaluated, based on the model proposed by Wilde et al., (2005). The study population included cancer patients referred to the largest referral center in Iran. Some 400 subjects were selected. Then, the content, face and construct validity, as well as the internal consistency and reliability of the Farsi version were assessed. Findings: In the confirmatory factor analysis, the original four-factor version with 19 phrases was not confirmed. Subsequently, an exploratory factor analysis (EFA) was carried out in which phrases were included in three dimensions (peace and active giving, religion, and existence) that explained 48.1% of the variance. Later, a confirmatory factor analysis (CFA) was conducted, which showed a good fit of the model (CFI=0.94, GFI=0.94, RMSEA=0.071, and AGFI=0.96). Cronbach’s alpha was α=0.91 for the whole SpNQ. Cronbach’s alpha values ranged from 0.76 to 0.86 for the three factors. The intra-class correlation coefficient was ICC=0.82 between two tests performed with a two-week interval. Conclusion: The modified Farsi version of the SpNQ shows good psychometric properties for patients and can be used to investigate the spiritual needs of Iranian cancer patients. Creative Commons Attribution License

Measuring future time perspective across adulthood: development and evaluation of a brief multidimensional questionnaire.

PubMed

Brothers, Allyson; Chui, Helena; Diehl, Manfred

2014-12-01

Despite calls for the consideration of future time perspective (FTP) as a multidimensional construct, mostly unidimensional measurement instruments have been used. This study had two objectives: (a) to develop a brief multidimensional questionnaire for assessing FTP in adulthood and evaluate its psychometric properties; and (b) to examine age associations and age-group differences of the dimensions of FTP. Data were collected from 625 community-residing adults between the ages of 18 and 93, representing young, middle-aged, and older adults. The psychometric evaluation involved exploratory factor analyses (EFA) and confirmatory FA (CFA), reliability and validity analyses, and measurement invariance testing. Zero-order and partial correlations were used to examine the association of the dimensions of FTP with age, and multivariate analysis of variance was used to examine age-group differences. EFA and CFA supported a three-factor solution: Future as Open, Future as Limited, and Future as Ambiguous. Metric measurement invariance for this factor structure was confirmed across the three age groups. Reliability and validity analyses provided evidence of sound psychometric properties of the brief questionnaire. Age was negatively associated with Future as Open and positively associated with Future as Limited. Young adults exhibited significantly greater ambiguity toward the future than middle-aged or older adults. This study provides evidence in support of the psychometric properties of a new brief multidimensional FTP scale. It also provides evidence for a pattern of age associations and age-group differences consistent with life-span developmental theory. © The Author 2014. Published by Oxford University Press on behalf of The Gerontological Society of America. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Essential elements of the nursing practice environment in nursing homes: Psychometric evaluation.

PubMed

de Brouwer, Brigitte Johanna Maria; Kaljouw, Marian J; Schoonhoven, Lisette; van Achterberg, Theo

2017-06-01

To develop and psychometrically test the Essentials of Magnetism II in nursing homes. Increasing numbers and complex needs of older people in nursing homes strain the nursing workforce. Fewer adequately trained staff and increased care complexity raise concerns about declining quality. Nurses' practice environment has been reported to affect quality of care and productivity. The Essentials of Magnetism II © measures processes and relationships of practice environments that contribute to productivity and quality of care and can therefore be useful in identifying processes requiring change to pursue excellent practice environments. However, this instrument was not explicitly evaluated for its use in nursing home settings so far. In a preparatory phase, a cross-sectional survey study focused on face validity of the essentials of magnetism in nursing homes. A second cross-sectional survey design was then used to further test the instrument's validity and reliability. Psychometric testing included evaluation of content and construct validity, and reliability. Nurses (N = 456) working at 44 units of three nursing homes were included. Respondent acceptance, relevance and clarity were adequate. Five of the eight subscales and 54 of the 58 items did meet preset psychometric criteria. All essentials of magnetism are considered relevant for nursing homes. The subscales Adequacy of Staffing, Clinically Competent Peers, Patient Centered Culture, Autonomy and Nurse Manager Support can be used in nursing homes without problems. The other subscales cannot be directly applied to this setting. The valid subscales of the Essentials of Magnetism II instrument can be used to design excellent nursing practice environments that support nurses' delivery of care. Before using the entire instrument, however, the other subscales have to be improved. © 2016 John Wiley & Sons Ltd.

The design and evaluation of psychometric properties for a questionnaire on elderly abuse by family caregivers among older adults on hemodialysis

PubMed Central

Mahmoudian, Amaneh; Torabi Chafjiri, Razieh; Alipour, Atefeh; Shamsalinia, Abbas; Ghaffari, Fatemeh

2018-01-01

Introduction Older adults with chronic disease are more vulnerable to abuse. Early and accurate detection of the elderly abuse phenomenon can help identify health-promoting solutions for the elderly, their family, and society. The purpose of this study was to design and evaluate the psychometric properties of a questionnaire on elderly abuse by family caregivers among older adults on hemodialysis. Methods Qualitative and quantitative research methodologies were used to develop the questionnaire. The item pool was compiled from literature reviews and the Delphi method. The literature reviews comprised 22 studies. The psychometric properties of the questionnaire were verified using face, content, and construct validity, and the reliability was tested using Cronbach’s alpha reliability. Results A 57-item questionnaire was developed after the psychometric evaluation. The Kaiser–Meyer–Olkin index and Bartlett’s test of sphericity showed reliable results. Seven components from the exploratory content analysis including psychological misbehavior, authority deprivation, physical misbehavior, financial misbehavior, being abandoned, caring neglect, and emotional misbehavior explained 74.769% of the total variance. Cronbach’s alpha was 0.98 and the interclass correlation coefficient was r=0.91 responding to the items twice (p<0.001), which shows a high level of tool stability. Conclusion This study developed a questionnaire to assess elderly abuse by family caregivers among older adults on hemodialysis. It is recommended as a mini scale that can be used both in statistical and practical studies, and that is valid and reliable. Nurses or other health care providers can use it in health centers, dialysis centers, or at the house of the patient. PMID:29670340

Psychometric evaluation of the Swedish language Person-centred Climate Questionnaire-family version.

PubMed

Lindahl, Jeanette; Elmqvist, Carina; Thulesius, Hans; Edvardsson, David

2015-12-01

In a holistic view of care, the family is important for the patient as well as for the staff and integration of family members in health care is a growing trend. Yet, family participation in the care is sparsely investigated and valid assessment instruments are needed. Data were collected from 200 family members participating in an intervention study at an emergency department (ED) in Sweden. The Person-centred Climate Questionnaire-Family (PCQ-F) is a measure for how family members perceive the psychosocial climate. PCQ-F is a self-report instrument that contains 17 items assessing safety, everydayness and hospitality--three subscale dimensions that mirror the Swedish patient version of the questionnaire, the PCQ-P. The aim of this study was to evaluate the psychometric properties of the Swedish version of the PCQ-F in an ED context. The psychometric properties of the PCQ-F were evaluated using statistical estimates of validity and reliability and showed high content validity and internal consistency. Cronbach's Alpha was >0.7 and item-total correlations were >0.3 and <0.7. In terms of psychometrics, the findings in this study indicate that the PCQ-F can be used with satisfactory validity and reliability to explore to what degree family members perceive ED settings as being person-centred, safe, welcoming and hospitable within an everyday and decorated physical environment. As the PCQ already exists in a valid and reliable patient (PCQ-P) and staff (PCQ-S) version, this new family member version is a significant addition to the literature as it enables further comparative studies of how diverse care settings are perceived by different stakeholders. © 2015 Nordic College of Caring Science.

The development and psychometric evaluation of a safety climate measure for primary care.

PubMed

de Wet, C; Spence, W; Mash, R; Johnson, P; Bowie, P

2010-12-01

Building a safety culture is an important part of improving patient care. Measuring perceptions of safety climate among healthcare teams and organisations is a key element of this process. Existing measurement instruments are largely developed for secondary care settings in North America and many lack adequate psychometric testing. Our aim was to develop and test an instrument to measure perceptions of safety climate among primary care teams in National Health Service for Scotland. Questionnaire development was facilitated through a steering group, literature review, semistructured interviews with primary care team members, a modified Delphi and completion of a content validity index by experts. A cross-sectional postal survey utilising the questionnaire was undertaken in a random sample of west of Scotland general practices to facilitate psychometric evaluation. Statistical methods, including exploratory and confirmatory factor analysis, and Cronbach and Raykov reliability coefficients were conducted. Of the 667 primary care team members based in 49 general practices surveyed, 563 returned completed questionnaires (84.4%). Psychometric evaluation resulted in the development of a 30-item questionnaire with five safety climate factors: leadership, teamwork, communication, workload and safety systems. Retained items have strong factor loadings to only one factor. Reliability coefficients was satisfactory (α = 0.94 and ρ = 0.93). This study is the first stage in the development of an appropriately valid and reliable safety climate measure for primary care. Measuring safety climate perceptions has the potential to help primary care organisations and teams focus attention on safety-related issues and target improvement through educational interventions. Further research is required to explore acceptability and feasibility issues for primary care teams and the potential for organisational benchmarking.

Development and psychometric testing of Holistic Clinical Assessment Tool (HCAT) for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Pua, Lay Hoon; Heng, Doreen Gek Noi; Wang, Wenru

2016-09-22

A major focus in nursing education is on the judgement of clinical performance, and it is a complex process due to the diverse nature of nursing practice. A holistic approach in assessment of competency is advocated. Difficulties in the development of valid and reliable assessment measures in nursing competency have resulted in the development of assessment instruments with an increase in face and content validity, but few studies have tested these instruments psychometrically. It is essential to develop a holistic assessment tool to meet the needs of the clinical education. The study aims to develop a Holistic Clinical Assessment Tool (HCAT) and test its psychometric properties. The HCAT was developed based on the systematic literature review and the findings of qualitative studies. An expert panel was invited to evaluate the content validity of the tool. A total of 130 final-year nursing undergraduate students were recruited to evaluate the psychometric properties (i.e. factor structure, internal consistency and test-retest reliability) of the tool. The HCAT has good content validity with content validity index of .979. The exploratory factor analysis reveals a four-factor structure of the tool. The internal consistency and test-retest reliability of the HCAT are satisfactory with Cronbach alpha ranging from .789 to .965 and Intraclass Correlation Coefficient ranging from .881 to .979 for the four subscales and total scale. HCAT has the potential to be used as a valid measure to evaluate clinical competence in nursing students, and provide specific and ongoing feedback to enhance the holistic clinical learning experience. In addition, HCAT functions as a tool for self-reflection, peer-assessment and guides preceptors in clinical teaching and assessment.

The Alliance Negotiation Scale: A psychometric investigation.

PubMed

Doran, Jennifer M; Safran, Jeremy D; Muran, J Christopher

2016-08-01

This study investigates the utility and psychometric properties of a new measure of psychotherapy process, the Alliance Negotiation Scale (ANS; Doran, Safran, Waizmann, Bolger, & Muran, 2012). The ANS was designed to operationalize the theoretical construct of negotiation (Safran & Muran, 2000), and to extend our current understanding of the working alliance concept (Bordin, 1979). The ANS was also intended to improve upon existing measures such as the Working Alliance Inventory (WAI; Horvath & Greenberg, 1986, 1989) and its short form (WAI-S; Tracey & Kokotovic, 1989) by expanding the emphasis on negative therapy process. The present study investigates the psychometric validity of the ANS test scores and interpretation-including confirming its original factor structure and evaluating its internal consistency and construct validity. Construct validity was examined through the ANS' convergence and divergence with several existing scales that measure theoretically related constructs. The results bolster and extend previous findings about the psychometric integrity of the ANS, and begin to illuminate the relationship between negotiation and other important variables in psychotherapy research. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Cross-cultural adaptation, evaluation and validation of the Spouse Response Inventory: a study protocol.

PubMed

Kaiser, Ulrike; Steinmetz, Dorit; Scharnagel, Rüdiger; Jensen, Mark P; Balck, Friedrich; Sabatowski, Rainer

2014-10-14

Since the response of spouses has been proven to be an important reinforcement of pain behaviour and disability it has been addressed in research and therapy. Fordyce suggested pain behaviour and well behaviour be considered in explaining suffering in chronic pain patients. Among existing instruments concerning spouse's responses the aspect of well behaviour has not been examined so far. The SRI (Spouse Response Inventory) tries to consider pain behaviour and well behaviour and appears to be acceptable because of its brevity and close proximity to daily language. The aim of the study is the translation into German, followed by evaluation and validation, of the SRI on a German sample of patients with chronic pain. The study is comprehensively designed: initially, the focus will lie on the translation of the instrument following the guidelines for cross-cultural translation and adaptation and evaluation of the German version according to the source study. Subsequently, a validation referring to predictive, incremental and construct validation will be conducted using instruments based on similar or close but different constructs. Evaluation of the resulting SRI-G (SRI-German) will be conducted on a sample of at least 30 patients with chronic pain attending a comprehensive pain centre. For validation at least 120 patients with chronic headache, back pain, cancer related pain and somatoform pain disorder shall be included, for a total of 480 patients. Separate analyses according to specific pain diagnoses will be performed to ensure psychometric property, interpretability and control of diagnosis of specific limitations. Analyses will include comprehensive investigation of psychometric property of the scale by hierarchical regression analyses, correlation analyses, multivariate analysis of variance and exploratory factor analyses (SPSS). The study protocol was approved by the Ethics Committee of the University of Dresden (EK 335 122008) based on the Helsinki declaration. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

The Fear of Positive Evaluation Scale: assessing a proposed cognitive component of social anxiety.

PubMed

Weeks, Justin W; Heimberg, Richard G; Rodebaugh, Thomas L

2008-01-01

Cognitive-behavioral models propose that fear of negative evaluation is the core feature of social anxiety disorder. However, it may be that fear of evaluation in general is important in social anxiety, including fears of positive as well as negative evaluation. To test this hypothesis, we developed the Fear of Positive Evaluation Scale (FPES) and conducted analyses to examine the psychometric properties of the FPES, as well as test hypotheses regarding the construct of fear of positive evaluation (FPE). Responses from a large (n = 1711) undergraduate sample were utilized. The reliability, construct validity, and factorial validity of the FPES were examined; the distinction of FPE from fear of negative evaluation was evaluated utilizing confirmatory factor analysis; and the ability of FPE to predict social interaction anxiety above and beyond fear of negative evaluation was assessed. Results provide preliminary support for the psychometric properties of the FPES and the validity of the construct of FPE. The implications of FPE with respect to the study and treatment of social anxiety disorder are discussed.

Development and psychometric evaluation of a women shift workers' reproductive health questionnaire: study protocol for a sequential exploratory mixed-method study.

PubMed

Nikpour, Maryam; Tirgar, Aram; Ebadi, Abbas; Ghaffari, Fatemeh; Firouzbakht, Mojgan; Hajiahmadi, Mahmod

2018-02-06

Although shift works is a certain treat for female reproductive health, but currently, there is no standardized instrument for measuring reproductive health among female shift workers. This study aims to develop and evaluate the psychometric properties of a Women Shift Workers' Reproductive Health Questionnaire (WSW-RHQ). This is a sequential exploratory mixed-method study with a qualitative and a quantitative phase. In the qualitative phase, semi-structured interviews will be held with female shift workers who live in Mazandaran Province, Iran, additionally, the literature review will be performed by searching electronic databases. Sampling will be done in different workplaces and with maximum variation respecting female shift workers' age and job and educational and different economic situation. Interview data will be analyzed using conventional content analysis and then, the primary item pool for the questionnaire will be developed. In the quantitative phase, we will evaluate the psychometric properties of the questionnaire, i.e. its face, content, construct as well as reliability via the internal consistency, stability. Finally, a scoring system will be developed for the questionnaire. The development of WSW-RHQ will facilitate the promotion and implementation of reproductive health interventions and assessment of their effectiveness. Other scholars can cross-culturally adapt and use the questionnaire according to their immediate contexts.