Computational Psychometrics for the Measurement of Collaborative Problem Solving Skills

PubMed Central

Polyak, Stephen T.; von Davier, Alina A.; Peterschmidt, Kurt

2017-01-01

This paper describes a psychometrically-based approach to the measurement of collaborative problem solving skills, by mining and classifying behavioral data both in real-time and in post-game analyses. The data were collected from a sample of middle school children who interacted with a game-like, online simulation of collaborative problem solving tasks. In this simulation, a user is required to collaborate with a virtual agent to solve a series of tasks within a first-person maze environment. The tasks were developed following the psychometric principles of Evidence Centered Design (ECD) and are aligned with the Holistic Framework developed by ACT. The analyses presented in this paper are an application of an emerging discipline called computational psychometrics which is growing out of traditional psychometrics and incorporates techniques from educational data mining, machine learning and other computer/cognitive science fields. In the real-time analysis, our aim was to start with limited knowledge of skill mastery, and then demonstrate a form of continuous Bayesian evidence tracing that updates sub-skill level probabilities as new conversation flow event evidence is presented. This is performed using Bayes' rule and conversation item conditional probability tables. The items are polytomous and each response option has been tagged with a skill at a performance level. In our post-game analysis, our goal was to discover unique gameplay profiles by performing a cluster analysis of user's sub-skill performance scores based on their patterns of selected dialog responses. PMID:29238314

Computational Psychometrics for the Measurement of Collaborative Problem Solving Skills.

PubMed

Polyak, Stephen T; von Davier, Alina A; Peterschmidt, Kurt

2017-01-01

This paper describes a psychometrically-based approach to the measurement of collaborative problem solving skills, by mining and classifying behavioral data both in real-time and in post-game analyses. The data were collected from a sample of middle school children who interacted with a game-like, online simulation of collaborative problem solving tasks. In this simulation, a user is required to collaborate with a virtual agent to solve a series of tasks within a first-person maze environment. The tasks were developed following the psychometric principles of Evidence Centered Design (ECD) and are aligned with the Holistic Framework developed by ACT. The analyses presented in this paper are an application of an emerging discipline called computational psychometrics which is growing out of traditional psychometrics and incorporates techniques from educational data mining, machine learning and other computer/cognitive science fields. In the real-time analysis, our aim was to start with limited knowledge of skill mastery, and then demonstrate a form of continuous Bayesian evidence tracing that updates sub-skill level probabilities as new conversation flow event evidence is presented. This is performed using Bayes' rule and conversation item conditional probability tables. The items are polytomous and each response option has been tagged with a skill at a performance level. In our post-game analysis, our goal was to discover unique gameplay profiles by performing a cluster analysis of user's sub-skill performance scores based on their patterns of selected dialog responses.

The Role of Parametric Assumptions in Adaptive Bayesian Estimation

ERIC Educational Resources Information Center

Alcala-Quintana, Rocio; Garcia-Perez, Miguel A.

2004-01-01

Variants of adaptive Bayesian procedures for estimating the 5% point on a psychometric function were studied by simulation. Bias and standard error were the criteria to evaluate performance. The results indicated a superiority of (a) uniform priors, (b) model likelihood functions that are odd symmetric about threshold and that have parameter…

Bayesian Estimation of Multidimensional Item Response Models. A Comparison of Analytic and Simulation Algorithms

ERIC Educational Resources Information Center

Martin-Fernandez, Manuel; Revuelta, Javier

2017-01-01

This study compares the performance of two estimation algorithms of new usage, the Metropolis-Hastings Robins-Monro (MHRM) and the Hamiltonian MCMC (HMC), with two consolidated algorithms in the psychometric literature, the marginal likelihood via EM algorithm (MML-EM) and the Markov chain Monte Carlo (MCMC), in the estimation of multidimensional…

Psychometric properties and norms of the German ABC-Community and PAS-ADD Checklist.

PubMed

Zeilinger, Elisabeth L; Weber, Germain; Haveman, Meindert J

2011-01-01

The aim of the present study was to standardize and generate psychometric evidence of the German language versions of two well-established English language mental health instruments: the Aberrant Behavior Checklist-Community (ABC-C) and the Psychiatric Assessment Schedule for Adults with Developmental Disabilities (PAS-ADD) Checklist. New methods in this field were introduced: a simulation method for testing the factor structure and an exploration of long-term stability over two years. The checklists were both administered to a representative sample of 270 individuals with intellectual disability (ID) and, two years later in a second data collection, to 128 participants of the original sample. Principal component analysis and parallel analysis were performed. Reliability measures, long-term stability, subscale intercorrelations, as well as standardized norms were generated. Prevalence of mental health problems was examined. Psychometric properties were mostly excellent, with long-term stability showing moderate to strong effects. The original factor structure of the ABC-C was replicated. PAS-ADD Checklist produced a similar, but still different structure compared with findings from the English language area. The overall prevalence rate of mental health problems in the sample was about 20%. Considering the good results on the measured psychometric properties, the two checklists are recommended for the early detection of mental health problems in persons with ID. Copyright © 2011 Elsevier Ltd. All rights reserved.

Implementing assessments of robot-assisted technical skill in urological education: a systematic review and synthesis of the validity evidence.

PubMed

Goldenberg, Mitchell G; Lee, Jason Y; Kwong, Jethro C C; Grantcharov, Teodor P; Costello, Anthony

2018-03-31

To systematically review and synthesise the validity evidence supporting intraoperative and simulation-based assessments of technical skill in urological robot-assisted surgery (RAS), and make evidence-based recommendations for the implementation of these assessments in urological training. A literature search of the Medline, PsycINFO and Embase databases was performed. Articles using technical skill and simulation-based assessments in RAS were abstracted. Only studies involving urology trainees or faculty were included in the final analysis. Multiple tools for the assessment of technical robotic skill have been published, with mixed sources of validity evidence to support their use. These evaluations have been used in both the ex vivo and in vivo settings. Performance evaluations range from global rating scales to psychometrics, and assessments are carried out through automation, expert analysts, and crowdsourcing. There have been rapid expansions in approaches to RAS technical skills assessment, both in simulated and clinical settings. Alternative approaches to assessment in RAS, such as crowdsourcing and psychometrics, remain under investigation. Evidence to support the use of these metrics in high-stakes decisions is likely insufficient at present. © 2018 The Authors BJU International © 2018 BJU International Published by John Wiley & Sons Ltd.

Psychometric Functioning of the MMPI-2-RF VRIN-r and TRIN-r Scales with Varying Degrees of Randomness, Acquiescence, and Counter-Acquiescence

ERIC Educational Resources Information Center

Handel, Richard W.; Ben-Porath, Yossef S.; Tellegen, Auke; Archer, Robert P.

2010-01-01

In the present study, the authors evaluated the effects of increasing degrees of simulated non-content-based (random or fixed) responding on scores on the newly developed Variable Response Inconsistency-Revised (VRIN-r) and True Response Inconsistency-Revised (TRIN-r) scales of the Minnesota Multiphasic Personality Inventory-2 Restructured Form…

Simulated consultations: a sociolinguistic perspective.

PubMed

Atkins, Sarah; Roberts, Celia; Hawthorne, Kamila; Greenhalgh, Trisha

2016-01-15

Assessment of consulting skills using simulated patients is widespread in medical education. Most research into such assessment is sited in a statistical paradigm that focuses on psychometric properties or replicability of such tests. Equally important, but less researched, is the question of how far consultations with simulated patients reflect real clinical encounters--for which sociolinguistics, defined as the study of language in its socio-cultural context, provides a helpful analytic lens. In this debate article, we draw on a detailed empirical study of assessed role-plays, involving sociolinguistic analysis of talk in OSCE interactions. We consider critically the evidence for the simulated consultation (a) as a proxy for the real; (b) as performance; (c) as a context for assessing talk; and (d) as potentially disadvantaging candidates trained overseas. Talk is always a performance in context, especially in professional situations (such as the consultation) and institutional ones (the assessment of professional skills and competence). Candidates who can handle the social and linguistic complexities of the artificial context of assessed role-plays score highly--yet what is being assessed is not real professional communication, but the ability to voice a credible appearance of such communication. Fidelity may not be the primary objective of simulation for medical training, where it enables the practising of skills. However the linguistic problems and differences that arise from interacting in artificial settings are of considerable importance in assessment, where we must be sure that the exam construct adequately embodies the skills expected for real-life practice. The reproducibility of assessed simulations should not be confused with their validity. Sociolinguistic analysis of simulations in various professional contexts has identified evidence for the gap between real interactions and assessed role-plays. The contextual conditions of the simulated consultation both expect and reward a particular interactional style. Whilst simulation undoubtedly has a place in formative learning for professional communication, the simulated consultation may distort assessment of professional communication These sociolinguistic findings contribute to the on-going critique of simulations in high-stakes assessments and indicate that further research, which steps outside psychometric approaches, is necessary.

Child-Report Measures of Occupational Performance: A Systematic Review

PubMed Central

Totino, Rebekah; Doma, Kenji; Leicht, Anthony; Brown, Nicole; Cuomo, Belinda

2016-01-01

Introduction Improving occupational performance is a key service of occupational therapists and client-centred approach to care is central to clinical practice. As such it is important to comprehensively evaluate the quality of psychometric properties reported across measures of occupational performance; in order to guide assessment and treatment planning. Objective To systematically review the literature on the psychometric properties of child-report measures of occupational performance for children ages 2–18 years. Methods A systematic search of the following six electronic databases was conducted: CINAHL; PsycINFO; EMBASE; PubMed; the Health and Psychosocial Instruments (HAPI) database; and Google Scholar. The quality of the studies was evaluated against the COSMIN taxonomy of measurement properties and the overall quality of psychometric properties was evaluated using pre-set psychometric criteria. Results Fifteen articles and one manual were reviewed to assess the psychometric properties of the six measures–the PEGS, MMD, CAPE, PAC, COSA, and OSA- which met the inclusion criteria. Most of the measures had conducted good quality studies to evaluate the psychometric properties of measures (PEGS, CAPE, PAC, OSA); however, the quality of the studies for two of these measures was relatively weak (MMD, COSA). When integrating the quality of the psychometric properties of the measures with the quality of the studies, the PAC stood out as having superior psychometric qualities. Conclusions The overall quality of the psychometric properties of most measures was limited. There is a need for continuing research into the psychometric properties of child-report measures of occupational performance, and to revise and improve the psychometric properties of existing measures. PMID:26808674

The psychometrics of mental workload: multiple measures are sensitive but divergent.

PubMed

Matthews, Gerald; Reinerman-Jones, Lauren E; Barber, Daniel J; Abich, Julian

2015-02-01

A study was run to test the sensitivity of multiple workload indices to the differing cognitive demands of four military monitoring task scenarios and to investigate relationships between indices. Various psychophysiological indices of mental workload exhibit sensitivity to task factors. However, the psychometric properties of multiple indices, including the extent to which they intercorrelate, have not been adequately investigated. One hundred fifty participants performed in four task scenarios based on a simulation of unmanned ground vehicle operation. Scenarios required threat detection and/or change detection. Both single- and dual-task scenarios were used. Workload metrics for each scenario were derived from the electroencephalogram (EEG), electrocardiogram, transcranial Doppler sonography, functional near infrared, and eye tracking. Subjective workload was also assessed. Several metrics showed sensitivity to the differing demands of the four scenarios. Eye fixation duration and the Task Load Index metric derived from EEG were diagnostic of single-versus dual-task performance. Several other metrics differentiated the two single tasks but were less effective in differentiating single- from dual-task performance. Psychometric analyses confirmed the reliability of individual metrics but failed to identify any general workload factor. An analysis of difference scores between low- and high-workload conditions suggested an effort factor defined by heart rate variability and frontal cortex oxygenation. General workload is not well defined psychometrically, although various individual metrics may satisfy conventional criteria for workload assessment. Practitioners should exercise caution in using multiple metrics that may not correspond well, especially at the level of the individual operator.

Validation of online psychometric instruments for common mental health disorders: a systematic review.

PubMed

van Ballegooijen, Wouter; Riper, Heleen; Cuijpers, Pim; van Oppen, Patricia; Smit, Johannes H

2016-02-25

Online questionnaires for measuring common mental health disorders such as depression and anxiety disorders are increasingly used. The psychometrics of several pen-and-paper questionnaires have been re-examined for online use and new online instruments have been developed and tested for validity as well. This study aims to review and synthesise the literature on this subject and provide a framework for future research. We searched Medline and PsycINFO for psychometric studies on online instruments for common mental health disorders and extracted the psychometric data. Studies were coded and assessed for quality by independent raters. We included 56 studies on 62 online instruments. For common instruments such as the CES-D, MADRS-S and HADS there is mounting evidence for adequate psychometric properties. Further results are scattered over different instruments and different psychometric characteristics. Few studies included patient populations. We found at least one online measure for each of the included mental health disorders and symptoms. A small number of online questionnaires have been studied thoroughly. This study provides an overview of online instruments to refer to when choosing an instrument for assessing common mental health disorders online, and can structure future psychometric research.

Covert Hepatic Encephalopathy: Can My Patient Drive?

PubMed Central

Shaw, Jawaid; Bajaj, Jasmohan S

2016-01-01

Liver cirrhosis is a public health problem and hepatic encephalopathy (HE) is one of its main complications, which can be either overt meaning thereby evident and readily diagnosed, or covert/minimal (CHE) needing psychometric testing for diagnosis. Patients with CHE hepatic encephalopathy have deficits in multiple domains including visuo-spatial assessment, attention, response inhibition, working memory, along with psychomotor speed to name a few areas. These patients have poor navigational skills, get fatigued easily and demonstrate poor insight into their driving deficits. The combination of all these leads them to have poor driving skills leading to traffic violations and crashes as demonstrated not only on the simulation testing but also in real life driving events. There are multiple psychometric tests for CHE testing but these are not easily available and there is no uniform consensus on the gold standard testing as of yet. It does not automatically connote that all patients who test positive on driving simulation testing are unfit to drive. The physicians are encouraged to take driving history from the patient and the care- givers on every encounter and focus their counseling efforts more on patients with recent history of traffic crashes, with abnormal simulation studies and history of alcohol cessation within last year. As physicians are not trained to determine fitness to drive, their approach towards CHE patients in regards to driving restrictions should be driven by ethical principles while as respecting the local laws. PMID:28027071

Comparing the Pearson and Spearman correlation coefficients across distributions and sample sizes: A tutorial using simulations and empirical data.

PubMed

de Winter, Joost C F; Gosling, Samuel D; Potter, Jeff

2016-09-01

The Pearson product–moment correlation coefficient ( r p ) and the Spearman rank correlation coefficient ( r s ) are widely used in psychological research. We compare r p and r s on 3 criteria: variability, bias with respect to the population value, and robustness to an outlier. Using simulations across low (N = 5) to high (N = 1,000) sample sizes we show that, for normally distributed variables, r p and r s have similar expected values but r s is more variable, especially when the correlation is strong. However, when the variables have high kurtosis, r p is more variable than r s . Next, we conducted a sampling study of a psychometric dataset featuring symmetrically distributed data with light tails, and of 2 Likert-type survey datasets, 1 with light-tailed and the other with heavy-tailed distributions. Consistent with the simulations, r p had lower variability than r s in the psychometric dataset. In the survey datasets with heavy-tailed variables in particular, r s had lower variability than r p , and often corresponded more accurately to the population Pearson correlation coefficient ( R p ) than r p did. The simulations and the sampling studies showed that variability in terms of standard deviations can be reduced by about 20% by choosing r s instead of r p . In comparison, increasing the sample size by a factor of 2 results in a 41% reduction of the standard deviations of r s and r p . In conclusion, r p is suitable for light-tailed distributions, whereas r s is preferable when variables feature heavy-tailed distributions or when outliers are present, as is often the case in psychological research. PsycINFO Database Record (c) 2016 APA, all rights reserved

Can genetics help psychometrics? Improving dimensionality assessment through genetic factor modeling.

PubMed

Franić, Sanja; Dolan, Conor V; Borsboom, Denny; Hudziak, James J; van Beijsterveldt, Catherina E M; Boomsma, Dorret I

2013-09-01

In the present article, we discuss the role that quantitative genetic methodology may play in assessing and understanding the dimensionality of psychological (psychometric) instruments. Specifically, we study the relationship between the observed covariance structures, on the one hand, and the underlying genetic and environmental influences giving rise to such structures, on the other. We note that this relationship may be such that it hampers obtaining a clear estimate of dimensionality using standard tools for dimensionality assessment alone. One situation in which dimensionality assessment may be impeded is that in which genetic and environmental influences, of which the observed covariance structure is a function, differ from each other in structure and dimensionality. We demonstrate that in such situations settling dimensionality issues may be problematic, and propose using quantitative genetic modeling to uncover the (possibly different) dimensionalities of the underlying genetic and environmental structures. We illustrate using simulations and an empirical example on childhood internalizing problems.

Social Cognition Psychometric Evaluation: Results of the Initial Psychometric Study

PubMed Central

Pinkham, Amy E.; Penn, David L.; Green, Michael F.; Harvey, Philip D.

2016-01-01

Measurement of social cognition in treatment trials remains problematic due to poor and limited psychometric data for many tasks. As part of the Social Cognition Psychometric Evaluation (SCOPE) study, the psychometric properties of 8 tasks were assessed. One hundred and seventy-nine stable outpatients with schizophrenia and 104 healthy controls completed the battery at baseline and a 2–4-week retest period at 2 sites. Tasks included the Ambiguous Intentions Hostility Questionnaire (AIHQ), Bell Lysaker Emotion Recognition Task (BLERT), Penn Emotion Recognition Task (ER-40), Relationships Across Domains (RAD), Reading the Mind in the Eyes Task (Eyes), The Awareness of Social Inferences Test (TASIT), Hinting Task, and Trustworthiness Task. Tasks were evaluated on: (i) test-retest reliability, (ii) utility as a repeated measure, (iii) relationship to functional outcome, (iv) practicality and tolerability, (v) sensitivity to group differences, and (vi) internal consistency. The BLERT and Hinting task showed the strongest psychometric properties across all evaluation criteria and are recommended for use in clinical trials. The ER-40, Eyes Task, and TASIT showed somewhat weaker psychometric properties and require further study. The AIHQ, RAD, and Trustworthiness Task showed poorer psychometric properties that suggest caution for their use in clinical trials. PMID:25943125

Psychometric properties of the questionnaire of cognitive and affective empathy in a Portuguese sample.

PubMed

Queirós, Andreia; Fernandes, Eugénia; Reniers, Renate; Sampaio, Adriana; Coutinho, Joana; Seara-Cardoso, Ana

2018-01-01

Empathy is an important concept in psychology and cognitive neuroscience. Despite the controversy around its definition, most researchers would agree that empathy is a multidimensional phenomenon which involves a vicarious experience of another person's affective state and an understanding of another person's affective experience. Self-report measures of empathy constitute an important tool for both research and clinical practice. The main goal of this study was to adapt and study the psychometric properties of the Questionnaire of Cognitive and Affective Empathy (QCAE), a worldwide used measure of empathy, in a Portuguese community sample (N = 562). Confirmatory factor analyses supported the factor structure of the original QCAE. Results show that the Portuguese version of the QCAE has sound psychometric properties, with good structural validity and internal consistency for both scales (i.e., affective and cognitive) and respective subscales of the instrument (i.e., Emotion Contagion, Proximal Responsivity, Peripheral Responsivity, Perspective Taking and Online Simulation). We tested both a five correlated factor structure (Model 1) and a second-order model that postulates the affective and cognitive dimensions (Model 2). Our results show that while both models present acceptable goodness of fit indices, Model 1 performs slightly better. In conclusion, the Portuguese version of the QCAE may prove a useful tool for future cross-cultural assessments of empathy in both research and clinical practice.

Why pilots are least likely to get good decision making precisely when they need it most

NASA Technical Reports Server (NTRS)

Maher, John W.

1991-01-01

Studies of commercial aircraft incidents and accidents indicate that, in flight conditions not covered by standard operating procedures, as well as when the environment is saturated with information or unmanaged stress, cognitive shortcuts dominate aircrews' decisionmaking processes. Multidisciplinary research on such situations with high-fidelity simulators becomes critically important, as do psychometric tools which examine vigilance, personality resiliency before stressful conditions, and decisional and interpersonal mind-sets.

Psychometric characteristics of the MATRICS Consensus Cognitive Battery in a large pooled cohort of stable schizophrenia patients.

PubMed

Georgiades, Anastasia; Davis, Vicki G; Atkins, Alexandra S; Khan, Anzalee; Walker, Trina W; Loebel, Antony; Haig, George; Hilt, Dana C; Dunayevich, Eduardo; Umbricht, Daniel; Sand, Michael; Keefe, Richard S E

2017-12-01

The MATRICS Consensus Cognitive Battery (MCCB) was developed to assess cognitive treatment effects in schizophrenia clinical trials, and is considered the FDA gold standard outcome measure for that purpose. The aim of the present study was to establish pre-treatment psychometric characteristics of the MCCB in a large pooled sample. The dataset included 2616 stable schizophrenia patients enrolled in 15 different clinical trials between 2007 and 2016 within the United States (94%) and Canada (6%). The MCCB was administered twice prior to the initiation of treatment in 1908 patients. Test-retest reliability and practice effects of the cognitive composite score, the neurocognitive composite score, which excludes the domain Social Cognition, and the subtests/domains were examined using Intra-Class Correlations (ICC) and Cohen's d. Simulated regression models explored which domains explained the greatest portion of variance in composite scores. Test-retest reliability was high (ICC=0.88) for both composite scores. Practice effects were small for the cognitive (d=0.15) and neurocognitive (d=0.17) composites. Simulated bootstrap regression analyses revealed that 3 of the 7 domains explained 86% of the variance for both composite scores. The domains that entered most frequently in the top 3 positions of the regression models were Speed of Processing, Working Memory, and Visual Learning. Findings provide definitive psychometric characteristics and a benchmark comparison for clinical trials using the MCCB. The test-retest reliability of the MCCB composite scores is considered excellent and the learning effects are small, fulfilling two of the key criteria for outcome measures in cognition clinical trials. Copyright © 2017 Elsevier B.V. All rights reserved.

Cognitive performance deficits in a simulated climb of Mount Everest - Operation Everest II

NASA Technical Reports Server (NTRS)

Kennedy, R. S.; Dunlap, W. P.; Banderet, L. E.; Smith, M. G.; Houston, C. S.

1989-01-01

Cognitive function at simulated altitude was investigated in a repeated-measures within-subject study of performance by seven volunteers in a hypobaric chamber, in which atmospheric pressure was systematically lowered over a period of 40 d to finally reach a pressure equivalent to 8845 m, the approximate height of Mount Everest. The automated performance test system employed compact computer design; automated test administrations, data storage, and retrieval; psychometric properties of stability and reliability; and factorial richness. Significant impairments of cognitive function were seen for three of the five tests in the battery; on two tests, grammatical reasoning and pattern comparison, every subject showed a substantial decrement.

Developing an item bank to measure the coping strategies of people with hereditary retinal diseases.

PubMed

Prem Senthil, Mallika; Khadka, Jyoti; De Roach, John; Lamey, Tina; McLaren, Terri; Campbell, Isabella; Fenwick, Eva K; Lamoureux, Ecosse L; Pesudovs, Konrad

2018-05-05

Our understanding of the coping strategies used by people with visual impairment to manage stress related to visual loss is limited. This study aims to develop a sophisticated coping instrument in the form of an item bank implemented via Computerised adaptive testing (CAT) for hereditary retinal diseases. Items on coping were extracted from qualitative interviews with patients which were supplemented by items from a literature review. A systematic multi-stage process of item refinement was carried out followed by expert panel discussion and cognitive interviews. The final coping item bank had 30 items. Rasch analysis was used to assess the psychometric properties. A CAT simulation was carried out to estimate an average number of items required to gain precise measurement of hereditary retinal disease-related coping. One hundred eighty-nine participants answered the coping item bank (median age = 58 years). The coping scale demonstrated good precision and targeting. The standardised residual loadings for items revealed six items grouped together. Removal of the six items reduced the precision of the main coping scale and worsened the variance explained by the measure. Therefore, the six items were retained within the main scale. Our CAT simulation indicated that, on average, less than 10 items are required to gain a precise measurement of coping. This is the first study to develop a psychometrically robust coping instrument for hereditary retinal diseases. CAT simulation indicated that on an average, only four and nine items were required to gain measurement at moderate and high precision, respectively.

Ensuring relational competency in critical care: Importance of nursing students' communication skills.

PubMed

Sánchez Expósito, Judit; Leal Costa, César; Díaz Agea, José Luis; Carrillo Izquierdo, María Dolores; Jiménez Rodríguez, Diana

2018-02-01

The aim of this study was to analyse the communication skills of students in interactions with simulated critically-ill patients using a new assessment tool to study the relationships between communication skills, teamwork and clinical skills and to analyse the psychometric properties of the tool. A cross-sectional study was conducted to assess the communications skills of 52 students with critically-ill patients through the use of a new measurement tool to score video recordings of simulated clinical scenarios. The 52 students obtained low scores on their skills in communicating with patients. The reliability of the measuring instrument showed good inter-observer agreement (ICC between 0.71 and 0.90) and the validity yielded a positive correlation (p<0.01). The results provide evidence that nursing students lack skills when communicating with critically ill patients in simulated scenarios. The measuring instrument used is therefore deemed valid and reliable for assessing nursing students through a clinical simulation. Copyright © 2017 Elsevier Ltd. All rights reserved.

The Effect of Small Sample Size on Measurement Equivalence of Psychometric Questionnaires in MIMIC Model: A Simulation Study.

PubMed

Jamali, Jamshid; Ayatollahi, Seyyed Mohammad Taghi; Jafari, Peyman

2017-01-01

Evaluating measurement equivalence (also known as differential item functioning (DIF)) is an important part of the process of validating psychometric questionnaires. This study aimed at evaluating the multiple indicators multiple causes (MIMIC) model for DIF detection when latent construct distribution is nonnormal and the focal group sample size is small. In this simulation-based study, Type I error rates and power of MIMIC model for detecting uniform-DIF were investigated under different combinations of reference to focal group sample size ratio, magnitude of the uniform-DIF effect, scale length, the number of response categories, and latent trait distribution. Moderate and high skewness in the latent trait distribution led to a decrease of 0.33% and 0.47% power of MIMIC model for detecting uniform-DIF, respectively. The findings indicated that, by increasing the scale length, the number of response categories and magnitude DIF improved the power of MIMIC model, by 3.47%, 4.83%, and 20.35%, respectively; it also decreased Type I error of MIMIC approach by 2.81%, 5.66%, and 0.04%, respectively. This study revealed that power of MIMIC model was at an acceptable level when latent trait distributions were skewed. However, empirical Type I error rate was slightly greater than nominal significance level. Consequently, the MIMIC was recommended for detection of uniform-DIF when latent construct distribution is nonnormal and the focal group sample size is small.

The Effect of Small Sample Size on Measurement Equivalence of Psychometric Questionnaires in MIMIC Model: A Simulation Study

PubMed Central

Jafari, Peyman

2017-01-01

Evaluating measurement equivalence (also known as differential item functioning (DIF)) is an important part of the process of validating psychometric questionnaires. This study aimed at evaluating the multiple indicators multiple causes (MIMIC) model for DIF detection when latent construct distribution is nonnormal and the focal group sample size is small. In this simulation-based study, Type I error rates and power of MIMIC model for detecting uniform-DIF were investigated under different combinations of reference to focal group sample size ratio, magnitude of the uniform-DIF effect, scale length, the number of response categories, and latent trait distribution. Moderate and high skewness in the latent trait distribution led to a decrease of 0.33% and 0.47% power of MIMIC model for detecting uniform-DIF, respectively. The findings indicated that, by increasing the scale length, the number of response categories and magnitude DIF improved the power of MIMIC model, by 3.47%, 4.83%, and 20.35%, respectively; it also decreased Type I error of MIMIC approach by 2.81%, 5.66%, and 0.04%, respectively. This study revealed that power of MIMIC model was at an acceptable level when latent trait distributions were skewed. However, empirical Type I error rate was slightly greater than nominal significance level. Consequently, the MIMIC was recommended for detection of uniform-DIF when latent construct distribution is nonnormal and the focal group sample size is small. PMID:28713828

Simulation-Based Assessment of ECMO Clinical Specialists.

PubMed

Fehr, James J; Shepard, Mark; McBride, Mary E; Mehegan, Mary; Reddy, Kavya; Murray, David J; Boulet, John R

2016-06-01

The aims of the study were (1) to create multiple scenarios that simulate a range of urgent and emergent extracorporeal membrane oxygenation (ECMO) events and (2) to determine whether these scenarios can provide reliable and valid measures of a specialist's advanced skill in managing ECMO emergencies. Multiscenario simulation-based performance assessment was performed. The study was conducted in the Saigh Pediatric Simulation Center at St. Louis Children's Hospital. ECMO clinical specialists participated in the study. Twenty-five ECMO specialists completed 8 scenarios presenting acute events in simulated ECMO patients. Participants were evaluated by 2 separate reviewers for completion of key actions and for global performance. The scores were highest for the hemodilution scenario, whereas the air entrainment scenario had the lowest scores. Psychometric analysis demonstrated that ECMO specialists with more than 1 year of experience outperformed the specialists with less than 1 year of experience. Participants endorsed these sessions as important and representative of events that might be encountered in practice. The scenarios could serve as a component of an ECMO education curriculum and be used to assess clinical specialists' readiness to manage ECMO emergencies.

Analysis of the Empathic Concern Subscale of the Emotional Response Questionnaire in a Study Evaluating the Impact of a 3D Cultural Simulation.

PubMed

Everson, Naleya; Levett-Jones, Tracy; Pitt, Victoria; Lapkin, Samuel; Van Der Riet, Pamela; Rossiter, Rachel; Jones, Donovan; Gilligan, Conor; Courtney Pratt, Helen

2018-04-25

Abstract Background Empathic concern has been found to decline in health professional students. Few effective educational programs and a lack of validated scales are reported. Previous analysis of the Empathic Concern scale of the Emotional Response Questionnaire has reported both one and two latent constructs. Aim To evaluate the impact of simulation on nursing students' empathic concern and test the psychometric properties of the Empathic Concern scale. Methods The study used a one group pre-test post-test design with a convenience sample of 460 nursing students. Empathic concern was measured pre-post simulation with the Empathic Concern scale. Factor Analysis was undertaken to investigate the structure of the scale. Results There was a statistically significant increase in Empathic Concern scores between pre-simulation 5.57 (SD = 1.04) and post-simulation 6.10 (SD = 0.95). Factor analysis of the Empathic Concern scale identified one latent dimension. Conclusion Immersive simulation may promote empathic concern. The Empathic Concern scale measured a single latent construct in this cohort.

Genetic and Environmental Influences on Two Measures of Speed of Information Processing and Their Relation to Psychometric Intelligence: Evidence from the German Observational Study of Adult Twins.

ERIC Educational Resources Information Center

Neubauer, Alioscha C.; Spinath, Frank M.; Riemann, Rainer; Angleitner, Alois; Borkenau, Peter

2000-01-01

Administered 2 elementary cognitive task (ECT) tests and 2 psychometric intelligence tests to 169 monozygotic and 131 dizygotic pairs of twins in Germany. Reaction times correlated negatively with psychometric intelligence, and habitability estimates were substantial for both psychometric intelligence and reaction times on the ECTs. Multivariate…

The impact of underreporting and overreporting on the validity of the Personality Inventory for DSM-5 (PID-5): A simulation analog design investigation.

PubMed

Dhillon, Sonya; Bagby, R Michael; Kushner, Shauna C; Burchett, Danielle

2017-04-01

The Personality Inventory for DSM-5 (PID-5) is a 220-item self-report instrument that assesses the alternative model of personality psychopathology in Section III (Emerging Measures and Models) of DSM-5 . Despite its relatively recent introduction, the PID-5 has generated an impressive accumulation of studies examining its psychometric properties, and the instrument is also already widely and frequently used in research studies. Although the PID-5 is psychometrically sound overall, reviews of this instrument express concern that this scale does not possess validity scales to detect invalidating levels of response bias, such as underreporting and overreporting. McGee Ng et al. (2016), using a "known-groups" (partial) criterion design, demonstrated that both underreporting and overreporting grossly affect mean scores on PID-5 scales. In the current investigation, we replicate these findings using an analog simulation design. An important extension to this replication study was the finding that the construct validity of the PID-5 was also significantly compromised by response bias, with statistically significant attenuation noted in validity coefficients of the PID-5 domain scales with scales from other instruments measuring congruent constructs. This attenuation was found for underreporting and overreporting bias. We believe there is a need to develop validity scales to screen for data-distorting response bias in research contexts and in clinical assessments where response bias is likely or otherwise suspected. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Assessment of Patient Empowerment - A Systematic Review of Measures

PubMed Central

Barr, Paul J.; Scholl, Isabelle; Bravo, Paulina; Faber, Marjan J.; Elwyn, Glyn; McAllister, Marion

2015-01-01

Background Patient empowerment has gained considerable importance but uncertainty remains about the best way to define and measure it. The validity of empirical findings depends on the quality of measures used. This systematic review aims to provide an overview of studies assessing psychometric properties of questionnaires purporting to capture patient empowerment, evaluate the methodological quality of these studies and assess the psychometric properties of measures identified. Methods Electronic searches in five databases were combined with reference tracking of included articles. Peer-reviewed articles reporting psychometric testing of empowerment measures for adult patients in French, German, English, Portuguese and Spanish were included. Study characteristics, constructs operationalised and psychometric properties were extracted. The quality of study design, methods and reporting was assessed using the COSMIN checklist. The quality of psychometric properties was assessed using Terwee’s 2007 criteria. Findings 30 studies on 19 measures were included. Six measures are generic, while 13 were developed for a specific condition (N=4) or specialty (N=9). Most studies tested measures in English (N=17) or Swedish (N=6). Sample sizes of included studies varied from N=35 to N=8261. A range of patient empowerment constructs was operationalised in included measures. These were classified into four domains: patient states, experiences and capacities; patient actions and behaviours; patient self-determination within the healthcare relationship and patient skills development. Quality assessment revealed several flaws in methodological study quality with COSMIN scores mainly fair or poor. The overall quality of psychometric properties of included measures was intermediate to positive. Certain psychometric properties were not tested for most measures. Discussion Findings provide a basis from which to develop consensus on a core set of patient empowerment constructs and for further work to develop a (set of) appropriately validated measure(s) to capture this. The methodological quality of psychometric studies could be improved by adhering to published quality criteria. PMID:25970618

Signal detection theory and vestibular perception: III. Estimating unbiased fit parameters for psychometric functions.

PubMed

Chaudhuri, Shomesh E; Merfeld, Daniel M

2013-03-01

Psychophysics generally relies on estimating a subject's ability to perform a specific task as a function of an observed stimulus. For threshold studies, the fitted functions are called psychometric functions. While fitting psychometric functions to data acquired using adaptive sampling procedures (e.g., "staircase" procedures), investigators have encountered a bias in the spread ("slope" or "threshold") parameter that has been attributed to the serial dependency of the adaptive data. Using simulations, we confirm this bias for cumulative Gaussian parametric maximum likelihood fits on data collected via adaptive sampling procedures, and then present a bias-reduced maximum likelihood fit that substantially reduces the bias without reducing the precision of the spread parameter estimate and without reducing the accuracy or precision of the other fit parameters. As a separate topic, we explain how to implement this bias reduction technique using generalized linear model fits as well as other numeric maximum likelihood techniques such as the Nelder-Mead simplex. We then provide a comparison of the iterative bootstrap and observed information matrix techniques for estimating parameter fit variance from adaptive sampling procedure data sets. The iterative bootstrap technique is shown to be slightly more accurate; however, the observed information technique executes in a small fraction (0.005 %) of the time required by the iterative bootstrap technique, which is an advantage when a real-time estimate of parameter fit variance is required.

AGREEMENT AND COVERAGE OF INDICATORS OF RESPONSE TO INTERVENTION: A MULTI-METHOD COMPARISON AND SIMULATION

PubMed Central

Fletcher, Jack M.; Stuebing, Karla K.; Barth, Amy E.; Miciak, Jeremy; Francis, David J.; Denton, Carolyn A.

2013-01-01

Purpose Agreement across methods for identifying students as inadequate responders or as learning disabled is often poor. We report (1) an empirical examination of final status (post-intervention benchmarks) and dual-discrepancy growth methods based on growth during the intervention and final status for assessing response to intervention; and (2) a statistical simulation of psychometric issues that may explain low agreement. Methods After a Tier 2 intervention, final status benchmark criteria were used to identify 104 inadequate and 85 adequate responders to intervention, with comparisons of agreement and coverage for these methods and a dual-discrepancy method. Factors affecting agreement were investigated using computer simulation to manipulate reliability, the intercorrelation between measures, cut points, normative samples, and sample size. Results Identification of inadequate responders based on individual measures showed that single measures tended not to identify many members of the pool of 104 inadequate responders. Poor to fair levels of agreement for identifying inadequate responders were apparent between pairs of measures In the simulation, comparisons across two simulated measures generated indices of agreement (kappa) that were generally low because of multiple psychometric issues inherent in any test. Conclusions Expecting excellent agreement between two correlated tests with even small amounts of unreliability may not be realistic. Assessing outcomes based on multiple measures, such as level of CBM performance and short norm-referenced assessments of fluency may improve the reliability of diagnostic decisions. PMID:25364090

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

PubMed Central

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Background Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students’ communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. Methods We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Results Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Discussion Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students’ academic success. PMID:27031506

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE)--A Systematic Review of Rating Scales.

PubMed

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically sound results of the OSCEs assessing communication skills. This is especially important given that most OSCE rating scales are used for summative assessment, and thus have an impact on medical students' academic success.

Psychometric Properties of the Beck Scale for Depression (Beck Depression Inventory BDI-II)--A Study on a Sample of Students in the State of Kuwait Universities

ERIC Educational Resources Information Center

Dahem, Ahmed Mohammed Faleh

2016-01-01

The study aimed to identify the psychometric properties of the Beck Depression Inventory (BDI-II) the Arabized version by Gharib (2000); the study sample consisted of 500 male and female students from the Kuwaiti universities by 250 males and 250 females on whom the BDI-II scale was applied twice; the psychometric characteristics such as the…

Some Psychometric and Design Implications of Game-Based Learning Analytics

ERIC Educational Resources Information Center

Gibson, David; Clarke-Midura, Jody

2013-01-01

The rise of digital game and simulation-based learning applications has led to new approaches in educational measurement that take account of patterns in time, high resolution paths of action, and clusters of virtual performance artifacts. The new approaches, which depart from traditional statistical analyses, include data mining, machine…

A Simulation Comparison of Parametric and Nonparametric Dimensionality Detection Procedures

ERIC Educational Resources Information Center

Mroch, Andrew A.; Bolt, Daniel M.

2006-01-01

Recently, nonparametric methods have been proposed that provide a dimensionally based description of test structure for tests with dichotomous items. Because such methods are based on different notions of dimensionality than are assumed when using a psychometric model, it remains unclear whether these procedures might lead to a different…

Modified Test Administration Using Assistive Technology: Preliminary Psychometric Findings

ERIC Educational Resources Information Center

Warschausky, Seth; Van Tubbergen, Marie; Asbell, Shana; Kaufman, Jacqueline; Ayyangar, Rita; Donders, Jacobus

2012-01-01

This study examined the psychometric properties of test presentation and response formats that were modified to be accessible with the use of assistive technology (AT). First, the stability of psychometric properties was examined in 60 children, ages 6 to 12, with no significant physical or communicative impairments. Population-specific…

Investigating Psychometric Isomorphism for Traditional and Performance-Based Assessment

ERIC Educational Resources Information Center

Fay, Derek M.; Levy, Roy; Mehta, Vandhana

2018-01-01

A common practice in educational assessment is to construct multiple forms of an assessment that consists of tasks with similar psychometric properties. This study utilizes a Bayesian multilevel item response model and descriptive graphical representations to evaluate the psychometric similarity of variations of the same task. These approaches for…

Modern Psychometrics for Assessing Achievement Goal Orientation: A Rasch Analysis

ERIC Educational Resources Information Center

Muis, Krista R.; Winne, Philip H.; Edwards, Ordene V.

2009-01-01

Background: A program of research is needed that assesses the psychometric properties of instruments designed to quantify students' achievement goal orientations to clarify inconsistencies across previous studies and to provide a stronger basis for future research. Aim: We conducted traditional psychometric and modern Rasch-model analyses of the…

A Systematic Review of the Psychometric Properties of the Sexual Relationship Power Scale in HIV/AIDS Research

PubMed Central

McMahon, James M.; Volpe, Ellen M.; Klostermann, Keith; Trabold, Nicole; Xue, Ying

2014-01-01

The Sexual Relationship Power Scale (SRPS) was developed over a decade ago to address the lack of reliable and valid measures of relationship power in social, behavioral and medical research. The SRPS and its two subscales (relationship control [RC], decision-making dominance [DMD]) have been used extensively in the field of HIV prevention and sexual risk behavior. We performed a systematic review of the psychometric properties of the SRPS and subscales as reported in the HIV/AIDS literature from 2000 to 2012. A total of 54 published articles were identified that reported reliability or construct validity estimates of the scales. Description of the psychometric properties of the SRPS and subscales are reported according to study population, and several cross-population trends were identified. In general, the SRPS and RC subscale exhibited sound psychometric properties across multiple study populations and research settings. By contrast, the DMD subscale had relatively weak psychometric properties, especially when used with specific populations and research settings. Factors that influenced the psychometric properties of the various scales and subscales included the study population, mean age of the sample, number of items retained in the scale, and modifications to the original scales. We conclude with recommendations for (a) the application and use of the SRPS and subscales, (b) reporting of psychometric properties of the scales in the literature, and (c) areas for future research. PMID:25331613

Instruments evaluating the quality of the clinical learning environment in nursing education: A systematic review of psychometric properties.

PubMed

Mansutti, Irene; Saiani, Luisa; Grassetti, Luca; Palese, Alvisa

2017-03-01

The clinical learning environment is fundamental to nursing education paths, capable of affecting learning processes and outcomes. Several instruments have been developed in nursing education, aimed at evaluating the quality of the clinical learning environments; however, no systematic review of the psychometric properties and methodological quality of these studies has been performed to date. The aims of the study were: 1) to identify validated instruments evaluating the clinical learning environments in nursing education; 2) to evaluate critically the methodological quality of the psychometric property estimation used; and 3) to compare psychometric properties across the instruments available. A systematic review of the literature (using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines) and an evaluation of the methodological quality of psychometric properties (using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines). The Medline and CINAHL databases were searched. Eligible studies were those that satisfied the following criteria: a) validation studies of instruments evaluating the quality of clinical learning environments; b) in nursing education; c) published in English or Italian; d) before April 2016. The included studies were evaluated for the methodological quality of the psychometric properties measured and then compared in terms of both the psychometric properties and the methodological quality of the processes used. The search strategy yielded a total of 26 studies and eight clinical learning environment evaluation instruments. A variety of psychometric properties have been estimated for each instrument, with differing qualities in the methodology used. Concept and construct validity were poorly assessed in terms of their significance and rarely judged by the target population (nursing students). Some properties were rarely considered (e.g., reliability, measurement error, criterion validity), whereas others were frequently estimated, but using different coefficients and statistical analyses (e.g., internal consistency, structural validity), thus rendering comparison across instruments difficult. Moreover, the methodological quality adopted in the property assessments was poor or fair in most studies, compromising the goodness of the psychometric values estimated. Clinical learning placements represent the key strategies in educating the future nursing workforce: instruments evaluating the quality of the settings, as well as their capacity to promote significant learning, are strongly recommended. Studies estimating psychometric properties, using an increased quality of research methodologies are needed in order to support nursing educators in the process of clinical placements accreditation and quality improvement. Copyright © 2017 Elsevier Ltd. All rights reserved.

Assessing Adult Exposure to Community Violence: A Review of Definitions and Measures.

PubMed

DeCou, Christopher R; Lynch, Shannon M

2017-01-01

Although experiences of community violence are linked with negative outcomes for adults and children, few standardized measures assessing community violence exist, and available measures lack consistency concerning the definition of community violence. Further, most measures currently utilized to assess adult exposure to community violence were designed for use with children and adolescents. To address these identified concerns and make recommendations for future research, this article reviews contemporary definitions of community violence, identifies the outcomes of exposure to community violence for adults, and evaluates measures of exposure to community violence with published psychometric data employing adult samples. A systematic review of the literature was conducted to identify studies that (1) included a self-report of community violence exposure, (2) included primarily adult respondents, and (3) reported psychometric data. Seventeen studies met the inclusion criteria. Measures employed in these studies were reviewed and basic psychometric properties discussed. Notably, the Survey of Exposure to Community Violence was the most commonly used measure among these studies. Although multiple measures demonstrated limited but acceptable psychometric performance in select studies, few in-depth psychometric analyses exist for measures of adult exposure to community violence. Also, it is difficult to compare studies due to variations in definitions of community violence and multiple versions of each measure. Recommendations for future research include provision of explicit definitions of community violence and reporting psychometric data for measures. © The Author(s) 2015.

Decay of Iconic Memory Traces Is Related to Psychometric Intelligence: A Fixed-Links Modeling Approach

ERIC Educational Resources Information Center

Miller, Robert; Rammsayer, Thomas H.; Schweizer, Karl; Troche, Stefan J.

2010-01-01

Several memory processes have been examined regarding their relation to psychometric intelligence with the exception of sensory memory. This study examined the relation between decay of iconic memory traces, measured with a partial-report task, and psychometric intelligence, assessed with the Berlin Intelligence Structure test, in 111…

An NCME Instructional Module on Subscores

ERIC Educational Resources Information Center

Sinharay, Sandip; Puhan, Gautam; Haberman, Shelby J.

2011-01-01

The purpose of this ITEMS module is to provide an introduction to subscores. First, examples of subscores from an operational test are provided. Then, a review of methods that can be used to examine if subscores have adequate psychometric quality is provided. It is demonstrated, using results from operational and simulated data, that subscores…

How Task Features Impact Evidence from Assessments Embedded in Simulations and Games

ERIC Educational Resources Information Center

Almond, Russell G.; Kim, Yoon Jeon; Velasquez, Gertrudes; Shute, Valerie J.

2014-01-01

One of the key ideas of evidence-centered assessment design (ECD) is that task features can be deliberately manipulated to change the psychometric properties of items. ECD identifies a number of roles that task-feature variables can play, including determining the focus of evidence, guiding form creation, determining item difficulty and…

Psychometric Characteristics of Role-Play Assessments of Social Skill in Schizophrenia

ERIC Educational Resources Information Center

Bellack, Alan S.; Brown, Clayton H.; Thomas-Lohrman, Shannon

2006-01-01

There is an extensive literature documenting that people with schizophrenia have marked impairments in social role functioning and social skill. One of the most widely employed strategies for assessing social skill has been role-play tests: simulated social interactions that are videotaped for subsequent behavioral coding. There has been…

Identifying Promising Items: The Use of Crowdsourcing in the Development of Assessment Instruments

ERIC Educational Resources Information Center

Sadler, Philip M.; Sonnert, Gerhard; Coyle, Harold P.; Miller, Kelly A.

2016-01-01

The psychometrically sound development of assessment instruments requires pilot testing of candidate items as a first step in gauging their quality, typically a time-consuming and costly effort. Crowdsourcing offers the opportunity for gathering data much more quickly and inexpensively than from most targeted populations. In a simulation of a…

The Perfectionistic Self-Presentation Scale--Junior Form: Psychometric Properties and Association with Social Anxiety in Early Adolescents

ERIC Educational Resources Information Center

Flett, Gordon L.; Coulter, Lisa-Marie; Hewitt, Paul L.

2012-01-01

This study assessed the psychometric characteristics and correlates of the Perfectionistic Self-Presentation Scale--Junior Form (PSPS-JR). The PSPS-JR was designed for use with children and adolescents, but its psychometric properties and applications among early adolescents have not been investigated. The PSPS-JR has three subscales assessing the…

Psychometric Comparisons of Three Measures for Assessing Motor Functions in Preschoolers with Intellectual Disabilities

ERIC Educational Resources Information Center

Wuang, Y-P.; Su, C-Y.; Huang, M-H.

2012-01-01

Background: Deficit in motor performance is common in children with intellectual disabilities (ID). A motor function measure with sound psychometric properties is indispensable for clinical and research use. The purpose of this study was to compare the psychometric properties of three commonly used clinical measures for assessing motor function in…

The Dutch Memory Compensation Questionnaire: Psychometric Properties and Regression-Based Norms

ERIC Educational Resources Information Center

Van der Elst, Wim; Hoogenhout, Esther M.; Dixon, Roger A.; De Groot, Renate H. M.; Jolles, Jelle

2011-01-01

The Memory Compensation Questionnaire (MCQ) is a psychometrically sound instrument that assesses the variety and extent to which an individual compensates for actual or perceived memory losses. Until now, only an English version of the MCQ has been psychometrically evaluated. The aim of the present study was to establish a Dutch version of the MCQ…

Psychometric Characteristics of the Persian Version of the Multidimensional School Anger Inventory-Revised

ERIC Educational Resources Information Center

Aryadoust, Vahid; Akbarzadeh, Sanaz; Akbarzedeh, Sara

2011-01-01

The Multidimensional School Anger Inventory-Revised (MSAI-R) is a measurement tool to evaluate high school students' anger. Its psychometric features have been tested in the USA, Australia, Japan, Guatemala, and Italy. This study investigates the factor structure and psychometric quality of the Persian version of the MSAI-R using data from an…

Psychometric properties of carer-reported outcome measures in palliative care: A systematic review

PubMed Central

Michels, Charlotte TJ; Boulton, Mary; Adams, Astrid; Wee, Bee; Peters, Michele

2016-01-01

Background: Informal carers face many challenges in caring for patients with palliative care needs. Selecting suitable valid and reliable outcome measures to determine the impact of caring and carers’ outcomes is a common problem. Aim: To identify outcome measures used for informal carers looking after patients with palliative care needs, and to evaluate the measures’ psychometric properties. Design: A systematic review was conducted. The studies identified were evaluated by independent reviewers (C.T.J.M., M.B., M.P.). Data regarding study characteristics and psychometric properties of the measures were extracted and evaluated. Good psychometric properties indicate a high-quality measure. Data sources: The search was conducted, unrestricted to publication year, in the following electronic databases: Applied Social Sciences Index and Abstracts, Cumulative Index to Nursing and Allied Health Literature, The Cochrane Library, EMBASE, PubMed, PsycINFO, Social Sciences Citation Index and Sociological Abstracts. Results: Our systematic search revealed 4505 potential relevant studies, of which 112 studies met the inclusion criteria using 38 carer measures for informal carers of patients with palliative care needs. Psychometric properties were reported in only 46% (n = 52) of the studies, in relation to 24 measures. Where psychometric data were reported, the focus was mainly on internal consistency (n = 45, 87%), construct validity (n = 27, 52%) and/or reliability (n = 14, 27%). Of these, 24 measures, only four (17%) had been formally validated in informal carers in palliative care. Conclusion: A broad range of outcome measures have been used for informal carers of patients with palliative care needs. Little formal psychometric testing has been undertaken. Furthermore, development and refinement of measures in this field is required. PMID:26407683

Validation of the self-assessment teamwork tool (SATT) in a cohort of nursing and medical students.

PubMed

Roper, Lucinda; Shulruf, Boaz; Jorm, Christine; Currie, Jane; Gordon, Christopher J

2018-02-09

Poor teamwork has been implicated in medical error and teamwork training has been shown to improve patient care. Simulation is an effective educational method for teamwork training. Post-simulation reflection aims to promote learning and we have previously developed a self-assessment teamwork tool (SATT) for health students to measure teamwork performance. This study aimed to evaluate the psychometric properties of a revised self-assessment teamwork tool. The tool was tested in 257 medical and nursing students after their participation in one of several mass casualty simulations. Using exploratory and confirmatory factor analysis, the revised self-assessment teamwork tool was shown to have strong construct validity, high reliability, and the construct demonstrated invariance across groups (Medicine & Nursing). The modified SATT was shown to be a reliable and valid student self-assessment tool. The SATT is a quick and practical method of guiding students' reflection on important teamwork skills.

DEVELOPMENT AND PSYCHOMETRIC TESTING OF A MULTIDIMENSIONAL INSTRUMENT OF PERCEIVED DISCRIMINATION AMONG AFRICAN AMERICANS IN THE JACKSON HEART STUDY

PubMed Central

Sims, Mario; Wyatt, Sharon B.; Gutierrez, Mary Lou; Taylor, Herman A.; Williams, David R.

2009-01-01

Objective Assessing the discrimination-health disparities hypothesis requires psychometrically sound, multidimensional measures of discrimination. Among the available discrimination measures, few are multidimensional and none have adequate psychometric testing in a large, African American sample. We report the development and psychometric testing of the multidimensional Jackson Heart Study Discrimination (JHSDIS) Instrument. Methods A multidimensional measure assessing the occurrence, frequency, attribution, and coping responses to perceived everyday and lifetime discrimination; lifetime burden of discrimination; and effect of skin color was developed and tested in the 5302-member cohort of the Jackson Heart Study. Internal consistency was calculated by using Cronbach α. coefficient. Confirmatory factor analysis established the dimensions, and intercorrelation coefficients assessed the discriminant validity of the instrument. Setting Tri-county area of the Jackson, MS metropolitan statistical area. Results The JHSDIS was psychometrically sound (overall α=.78, .84 and .77, respectively, for the everyday and lifetime subscales). Confirmatory factor analysis yielded 11 factors, which confirmed the a priori dimensions represented. Conclusions The JHSDIS combined three scales into a single multidimensional instrument with good psychometric properties in a large sample of African Americans. This analysis lays the foundation for using this instrument in research that will examine the association between perceived discrimination and CVD among African Americans. PMID:19341164

Test Reliability at the Individual Level

PubMed Central

Hu, Yueqin; Nesselroade, John R.; Erbacher, Monica K.; Boker, Steven M.; Burt, S. Alexandra; Keel, Pamela K.; Neale, Michael C.; Sisk, Cheryl L.; Klump, Kelly

2016-01-01

Reliability has a long history as one of the key psychometric properties of a test. However, a given test might not measure people equally reliably. Test scores from some individuals may have considerably greater error than others. This study proposed two approaches using intraindividual variation to estimate test reliability for each person. A simulation study suggested that the parallel tests approach and the structural equation modeling approach recovered the simulated reliability coefficients. Then in an empirical study, where forty-five females were measured daily on the Positive and Negative Affect Schedule (PANAS) for 45 consecutive days, separate estimates of reliability were generated for each person. Results showed that reliability estimates of the PANAS varied substantially from person to person. The methods provided in this article apply to tests measuring changeable attributes and require repeated measures across time on each individual. This article also provides a set of parallel forms of PANAS. PMID:28936107

A Student Assessment Tool for Standardized Patient Simulations (SAT-SPS): Psychometric analysis.

PubMed

Castro-Yuste, Cristina; García-Cabanillas, María José; Rodríguez-Cornejo, María Jesús; Carnicer-Fuentes, Concepción; Paloma-Castro, Olga; Moreno-Corral, Luis Javier

2018-05-01

The evaluation of the level of clinical competence acquired by the student is a complex process that must meet various requirements to ensure its quality. The psychometric analysis of the data collected by the assessment tools used is a fundamental aspect to guarantee the student's competence level. To conduct a psychometric analysis of an instrument which assesses clinical competence in nursing students at simulation stations with standardized patients in OSCE-format tests. The construct of clinical competence was operationalized as a set of observable and measurable behaviors, measured by the newly-created Student Assessment Tool for Standardized Patient Simulations (SAT-SPS), which was comprised of 27 items. The categories assigned to the items were 'incorrect or not performed' (0), 'acceptable' (1), and 'correct' (2). 499 nursing students. Data were collected by two independent observers during the assessment of the students' performance at a four-station OSCE with standardized patients. Descriptive statistics were used to summarize the variables. The difficulty levels and floor and ceiling effects were determined for each item. Reliability was analyzed using internal consistency and inter-observer reliability. The validity analysis was performed considering face validity, content and construct validity (through exploratory factor analysis), and criterion validity. Internal reliability and inter-observer reliability were higher than 0.80. The construct validity analysis suggested a three-factor model accounting for 37.1% of the variance. These three factors were named 'Nursing process', 'Communication skills', and 'Safe practice'. A significant correlation was found between the scores obtained and the students' grades in general, as well as with the grades obtained in subjects with clinical content. The assessment tool has proven to be sufficiently reliable and valid for the assessment of the clinical competence of nursing students using standardized patients. This tool has three main components: the nursing process, communication skills, and safety management. Copyright © 2018 Elsevier Ltd. All rights reserved.

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review.

PubMed

Cordier, Reinie; Speyer, Renée; Chen, Yu-Wei; Wilkes-Gillan, Sarah; Brown, Ted; Bourke-Taylor, Helen; Doma, Kenji; Leicht, Anthony

2015-01-01

Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning. To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults. A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity. The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments.

Fitting psychometric functions using a fixed-slope parameter: an advanced alternative for estimating odor thresholds with data generated by ASTM E679.

PubMed

Peng, Mei; Jaeger, Sara R; Hautus, Michael J

2014-03-01

Psychometric functions are predominately used for estimating detection thresholds in vision and audition. However, the requirement of large data quantities for fitting psychometric functions (>30 replications) reduces their suitability in olfactory studies because olfactory response data are often limited (<4 replications) due to the susceptibility of human olfactory receptors to fatigue and adaptation. This article introduces a new method for fitting individual-judge psychometric functions to olfactory data obtained using the current standard protocol-American Society for Testing and Materials (ASTM) E679. The slope parameter of the individual-judge psychometric function is fixed to be the same as that of the group function; the same-shaped symmetrical sigmoid function is fitted only using the intercept. This study evaluated the proposed method by comparing it with 2 available methods. Comparison to conventional psychometric functions (fitted slope and intercept) indicated that the assumption of a fixed slope did not compromise precision of the threshold estimates. No systematic difference was obtained between the proposed method and the ASTM method in terms of group threshold estimates or threshold distributions, but there were changes in the rank, by threshold, of judges in the group. Overall, the fixed-slope psychometric function is recommended for obtaining relatively reliable individual threshold estimates when the quantity of data is limited.

Psychometric Properties of the MMPI-2-RF Somatic Complaints (RC1) Scale

ERIC Educational Resources Information Center

Thomas, Michael L.; Locke, Dona E. C.

2010-01-01

The MMPI-2 Restructured Form (MMPI-2-RF; Tellegen & Ben-Porath, 2008) was designed to be psychometrically superior to its MMPI-2 counterpart. However, the test has yet to be extensively evaluated in diverse clinical settings. The purpose of this study was to examine the psychometric properties of the MMPI-2-RF Somatic Complaints (RC1) scale in…

Item-Level Psychometrics and Predictors of Performance for Spanish/English Bilingual Speakers on "An Object and Action Naming Battery"

ERIC Educational Resources Information Center

Edmonds, Lisa A.; Donovan, Neila J.

2012-01-01

Purpose: There is a pressing need for psychometrically sound naming materials for Spanish/English bilingual adults. To address this need, in this study the authors examined the psychometric properties of An Object and Action Naming Battery (An O&A Battery; Druks & Masterson, 2000) in bilingual speakers. Method: Ninety-one Spanish/English…

Critical appraisal of questionnaires to assess functional impairment in individuals with mild cognitive impairment.

PubMed

Kaur, Navaldeep; Belchior, Patricia; Gelinas, Isabelle; Bier, Nathalie

2016-09-01

Mild deficits in instrumental activities of daily living (IADLs) have consistently been reported in the individuals with mild cognitive impairment (MCI). A variety of functional assessment tools, including self-and informant report questionnaires and performance-based measures, have been employed in MCI. Previously, a limited focus has been directed at appraising the quality of questionnaires. The goal of this study was to identify the questionnaires that have been validated in the MCI population. Additionally, the quality of validation studies and psychometric attributes of these questionnaires were appraised. Relevant articles were systematically searched in PsychINFO, Ovid MEDLINE, and CINAHL against specific eligibility criteria. To evaluate the methodology of the psychometric studies, the COSMIN checklist was employed. Also, the psychometric properties of the assessment tools were evaluated based upon Terwee's criteria. A total of five psychometric studies and questionnaires were critically evaluated. Varying psychometric properties were available for the chosen tools. None of the studies received the best possible rating for their methodological quality. It was found that questionnaires with high discriminative ability to distinguish MCI from other diagnostic groups were: Disability Assessment in Dementia-6 (DAD-6), Functional Activity Questionnaire (FAQ), and Alzheimer's Disease Cooperative Study/Activities of Daily Living scale adapted for MCI patients (ADCS-MCI-ADL-24). Psychometric studies with strong methodological rigor are required in the future. Considering the fact that IADL decline has been associated with dementia, early detection of functional difficulties in MCI needs to be encouraged as it will allow suitable and timely interventions to prolong functional independence of affected individuals.

Psychometric Properties of the Multiple Mini-Interview Used for Medical Admissions: Findings from Generalizability and Rasch Analyses

ERIC Educational Resources Information Center

Sebok, Stefanie S.; Luu, King; Klinger, Don A.

2014-01-01

The multiple mini-interview (MMI) has become an increasingly popular admissions method for selecting prospective students into professional programs (e.g., medical school). The MMI uses a series of short, labour intensive simulation stations and scenario interviews to more effectively assess applicants' non-cognitive qualities such as…

Does Maximizing Information at the Cut Score Always Maximize Classification Accuracy and Consistency?

ERIC Educational Resources Information Center

Wyse, Adam E.; Babcock, Ben

2016-01-01

A common suggestion made in the psychometric literature for fixed-length classification tests is that one should design tests so that they have maximum information at the cut score. Designing tests in this way is believed to maximize the classification accuracy and consistency of the assessment. This article uses simulated examples to illustrate…

Multiple Imputation of Item Scores in Test and Questionnaire Data, and Influence on Psychometric Results

ERIC Educational Resources Information Center

van Ginkel, Joost R.; van der Ark, L. Andries; Sijtsma, Klaas

2007-01-01

The performance of five simple multiple imputation methods for dealing with missing data were compared. In addition, random imputation and multivariate normal imputation were used as lower and upper benchmark, respectively. Test data were simulated and item scores were deleted such that they were either missing completely at random, missing at…

Evaluating the Psychometric Quality of Social Skills Measures: A Systematic Review

PubMed Central

Brown, Ted; Bourke-Taylor, Helen; Doma, Kenji; Leicht, Anthony

2015-01-01

Introduction Impairments in social functioning are associated with an array of adverse outcomes. Social skills measures are commonly used by health professionals to assess and plan the treatment of social skills difficulties. There is a need to comprehensively evaluate the quality of psychometric properties reported across these measures to guide assessment and treatment planning. Objective To conduct a systematic review of the literature on the psychometric properties of social skills and behaviours measures for both children and adults. Methods A systematic search was performed using four electronic databases: CINAHL, PsycINFO, Embase and Pubmed; the Health and Psychosocial Instruments database; and grey literature using PsycExtra and Google Scholar. The psychometric properties of the social skills measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Results Thirty-Six studies and nine manuals were included to assess the psychometric properties of thirteen social skills measures that met the inclusion criteria. Most measures obtained excellent overall methodological quality scores for internal consistency and reliability. However, eight measures did not report measurement error, nine measures did not report cross-cultural validity and eleven measures did not report criterion validity. Conclusions The overall quality of the psychometric properties of most measures was satisfactory. The SSBS-2, HCSBS and PKBS-2 were the three measures with the most robust evidence of sound psychometric quality in at least seven of the eight psychometric properties that were appraised. A universal working definition of social functioning as an overarching construct is recommended. There is a need for ongoing research in the area of the psychometric properties of social skills and behaviours instruments. PMID:26151362

Psychometric Properties of “Community Assessment of Psychic Experiences”: Review and Meta-analyses

PubMed Central

Mark, Winifred; Toulopoulou, Timothea

2016-01-01

The Community Assessment of Psychic Experiences (CAPE) has been used extensively as a measurement for psychosis proneness in clinical and research settings. However, no prior review and meta-analysis have comprehensively examined psychometric properties (reliability and validity) of CAPE scores across different studies. To study CAPE’s internal reliability—ie, how well scale items correlate with one another—111 studies were reviewed. Of these, 18 reported unique internal reliability coefficients using data at hand, which were aggregated in a meta-analysis. Furthermore, to confirm the number and nature of factors tapped by CAPE, 17 factor analytic studies were reviewed and subjected to meta-analysis in cases of discrepancy. Results suggested that CAPE scores were psychometrically reliable—ie, scores obtained could be attributed to true score variance. Our review of factor analytic studies supported a 3-factor model for CAPE consisting of “Positive”, “Negative”, and “Depressive” subscales; and a tripartite structure for the Negative dimension consisting of “Social withdrawal”, “Affective flattening”, and “Avolition” subdimensions. Meta-analysis of factor analytic studies of the Positive dimension revealed a tridimensional structure consisting of “Bizarre experiences”, “Delusional ideations”, and “Perceptual anomalies”. Information on reliability and validity of CAPE scores is important for ensuring accurate measurement of the psychosis proneness phenotype, which in turn facilitates early detection and intervention for psychotic disorders. Apart from enhancing the understanding of psychometric properties of CAPE scores, our review revealed questionable reporting practices possibly reflecting insufficient understanding regarding the significance of psychometric properties. We recommend increased focus on psychometrics in psychology programmes and clinical journals. PMID:26150674

The Psychometric Characteristics of the Advanced Measures of Music Audiation in a Region with Strong Non-Western Music Tradition

ERIC Educational Resources Information Center

Verdis, Athanasios; Sotiriou, Christina

2018-01-01

This study investigates the psychometric characteristics of Gordon's Advanced Measures of Music Audiation (AMMA) in a region with strong non-Western music tradition. It also examines the possibility of measuring audiation with the modern psychometric theory. The AMMA test was administered to 513 students in the city of Ioannina and a number of…

A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS).

PubMed

Dambi, Jermaine M; Corten, Lieselotte; Chiwaridzo, Matthew; Jack, Helen; Mlambo, Tecla; Jelsma, Jennifer

2018-05-02

Social support (SS) has been identified as an essential buffer to stressful life events. Consequently, there has been a surge in the evaluation of SS as a wellbeing indicator. The Multidimensional Perceived Social Support Scale (MSPSS) has evolved as one of the most extensively translated and validated social support outcome measures. Due to linguistic and cultural differences, there is need to test the psychometrics of the adapted versions. However, there is a paucity of systematic evidence of the psychometrics of adapted and translated versions of the MSPSS across settings. To understand the psychometric properties of the MSPSS for non-English speaking populations by conducting a systematic review of studies that examine the psychometric properties of non-English versions of the MSPSS. We searched Africa-Wide Information, CINAHL, Medline and PsycINFO, for articles published in English on the translation and or validation of the MSPSS. Methodological quality and quality of psychometric properties of the retrieved translations were assessed using the COSMIN checklist and a validated quality assessment criterion, respectively. The two assessments were combined to produce the best level of evidence per language/translation. Seventy articles evaluating the MSPSS in 22 languages were retrieved. Most translations [16/22] were not rigorously translated (only solitary backward-forward translations were performed, reconciliation was poorly described, or were not pretested). There was poor evidence for structural validity, as confirmatory factor analysis was performed in only nine studies. Internal consistency was reported in all studies. Most attained a Cronbach's alpha of at least 0.70 against a backdrop of fair methodological quality. There was poor evidence for construct validity. There is limited evidence supporting the psychometric robustness of the translated versions of the MSPSS, and given the variability, the individual psychometrics of a translation must be considered prior to use. Responsiveness, measurement error and cut-off values should also be assessed to increase the clinical utility and psychometric robustness of the translated versions of the MSPSS. PROSPERO - CRD42016052394.

A systematic review of psychometric testing of instruments that measure intention to work with older people.

PubMed

Che, Chong Chin; Hairi, Noran Naqiah; Chong, Mei Chan

2017-09-01

To review systematically the psychometric properties of instruments used to measure intention to work with older people. Nursing students are part of the future healthcare workforce; thus, being aware of their intention to work with older people would give valuable insights to nursing education and practice. Despite a plethora of research on measuring intention to work with older people, a valid and reliable instrument has not been identified. A systematic literature review of evidence and psychometric properties. Eight database searches were conducted between 2006 - 2016. English articles were selected based on inclusion and exclusion criteria. The COSMIN checklist was used to assess instruments reporting a psychometric evaluation of validity and reliability. Of 41 studies identified for full text review, 36 met the inclusion criteria. Seven different types of instruments were identified for psychometric evaluation. Measures of reliability were reported in eight papers and validity in five papers. Evidence for each measurement property was limited, with each instrument demonstrating a lack of information on measurement properties. Based on the COSMIN checklist, the overall quality of the psychometric properties was rated as poor to good. No single instrument was found to be optimal for use. Studies of high methodological quality are needed to properly assess the measurement properties of the instruments that are currently available. Until such studies are available, we recommend using existing instruments with caution. © 2017 John Wiley & Sons Ltd.

The Motivational Value Systems Questionnaire (MVSQ): Psychometric Analysis Using a Forced Choice Thurstonian IRT Model

PubMed Central

Merk, Josef; Schlotz, Wolff; Falter, Thomas

2017-01-01

This study presents a new measure of value systems, the Motivational Value Systems Questionnaire (MVSQ), which is based on a theory of value systems by psychologist Clare W. Graves. The purpose of the instrument is to help people identify their personal hierarchies of value systems and thus become more aware of what motivates and demotivates them in work-related contexts. The MVSQ is a forced-choice (FC) measure, making it quicker to complete and more difficult to intentionally distort, but also more difficult to assess its psychometric properties due to ipsativity of FC data compared to rating scales. To overcome limitations of ipsative data, a Thurstonian IRT (TIRT) model was fitted to the questionnaire data, based on a broad sample of N = 1,217 professionals and students. Comparison of normative (IRT) scale scores and ipsative scores suggested that MVSQ IRT scores are largely freed from restrictions due to ipsativity and thus allow interindividual comparison of scale scores. Empirical reliability was estimated using a sample-based simulation approach which showed acceptable and good estimates and, on average, slightly higher test-retest reliabilities. Further, validation studies provided evidence on both construct validity and criterion-related validity. Scale score correlations and associations of scores with both age and gender were largely in line with theoretically- and empirically-based expectations, and results of a multitrait-multimethod analysis supports convergent and discriminant construct validity. Criterion validity was assessed by examining the relation of value system preferences to departmental affiliation which revealed significant relations in line with prior hypothesizing. These findings demonstrate the good psychometric properties of the MVSQ and support its application in the assessment of value systems in work-related contexts. PMID:28979228

The Motivational Value Systems Questionnaire (MVSQ): Psychometric Analysis Using a Forced Choice Thurstonian IRT Model.

PubMed

Merk, Josef; Schlotz, Wolff; Falter, Thomas

2017-01-01

This study presents a new measure of value systems, the Motivational Value Systems Questionnaire (MVSQ), which is based on a theory of value systems by psychologist Clare W. Graves. The purpose of the instrument is to help people identify their personal hierarchies of value systems and thus become more aware of what motivates and demotivates them in work-related contexts. The MVSQ is a forced-choice (FC) measure, making it quicker to complete and more difficult to intentionally distort, but also more difficult to assess its psychometric properties due to ipsativity of FC data compared to rating scales. To overcome limitations of ipsative data, a Thurstonian IRT (TIRT) model was fitted to the questionnaire data, based on a broad sample of N = 1,217 professionals and students. Comparison of normative (IRT) scale scores and ipsative scores suggested that MVSQ IRT scores are largely freed from restrictions due to ipsativity and thus allow interindividual comparison of scale scores. Empirical reliability was estimated using a sample-based simulation approach which showed acceptable and good estimates and, on average, slightly higher test-retest reliabilities. Further, validation studies provided evidence on both construct validity and criterion-related validity. Scale score correlations and associations of scores with both age and gender were largely in line with theoretically- and empirically-based expectations, and results of a multitrait-multimethod analysis supports convergent and discriminant construct validity. Criterion validity was assessed by examining the relation of value system preferences to departmental affiliation which revealed significant relations in line with prior hypothesizing. These findings demonstrate the good psychometric properties of the MVSQ and support its application in the assessment of value systems in work-related contexts.

Psychometric Properties of the Concept Assessment Kit-Conservation.

ERIC Educational Resources Information Center

Lehnert, Linda; And Others

1986-01-01

This study investigated the psychometric properties of the Educational and Industrial Testing Service Concept Assessment Kit-Conservation (EITS Kit). Presented are an overview of the concept of conservation, a description of the EITS Kit, and results of the study. (MT)

Computerized Adaptive Testing Provides Reliable and Efficient Depression Measurement Using the CES-D Scale

PubMed Central

2017-01-01

Background The Center for Epidemiologic Studies Depression Scale (CES-D) is a measure of depressive symptomatology which is widely used internationally. Though previous attempts were made to shorten the CES-D scale, few have attempted to develop a Computerized Adaptive Test (CAT) version for the CES-D. Objective The aim of this study was to provide evidence on the efficiency and accuracy of the CES-D when administered using CAT using an American sample group. Methods We obtained a sample of 2060 responses to the CESD-D from US participants using the myPersonality application. The average age of participants was 26 years (range 19-77). We randomly split the sample into two groups to evaluate and validate the psychometric models. We used evaluation group data (n=1018) to assess dimensionality with both confirmatory factor and Mokken analysis. We conducted further psychometric assessments using item response theory (IRT), including assessments of item and scale fit to Samejima’s graded response model (GRM), local dependency and differential item functioning. We subsequently conducted two CAT simulations to evaluate the CES-D CAT using the validation group (n=1042). Results Initial CFA results indicated a poor fit to the model and Mokken analysis revealed 3 items which did not conform to the same dimension as the rest of the items. We removed the 3 items and fit the remaining 17 items to GRM. We found no evidence of differential item functioning (DIF) between age and gender groups. Estimates of the level of CES-D trait score provided by the simulated CAT algorithm and the original CES-D trait score derived from original scale were correlated highly. The second CAT simulation conducted using real participant data demonstrated higher precision at the higher levels of depression spectrum. Conclusions Depression assessments using the CES-D CAT can be more accurate and efficient than those made using the fixed-length assessment. PMID:28931496

Markov Decision Process Measurement Model.

PubMed

LaMar, Michelle M

2018-03-01

Within-task actions can provide additional information on student competencies but are challenging to model. This paper explores the potential of using a cognitive model for decision making, the Markov decision process, to provide a mapping between within-task actions and latent traits of interest. Psychometric properties of the model are explored, and simulation studies report on parameter recovery within the context of a simple strategy game. The model is then applied to empirical data from an educational game. Estimates from the model are found to correlate more strongly with posttest results than a partial-credit IRT model based on outcome data alone.

Psychometric Properties of the Scientific Inquiry Scale

ERIC Educational Resources Information Center

Ossa-Cornejo, Carlos; Díaz-Mujica, Alejandro; Aedo-Saravia, Jaime; Merino-Escobar, Jose M.; Bustos-Navarrete, Claudio

2017-01-01

Introduction: There are a few methods to study inquiry's abilities in Chile, despite its importance in science education. This study analyzes the psychometric properties of a Scientific Inquiry Scale in pedagogy students of two Chilean universities. Method: The study uses an instrumental design with 325 students from 3 pedagogy majors. As a…

Psychometric Properties of the Student Subjective Wellbeing Questionnaire with Turkish Adolescents: A Generalizability Study

ERIC Educational Resources Information Center

Renshaw, Tyler L.; Arslan, Gökmen

2016-01-01

The present study reports on the first investigation of the generalizability of the psychometric properties of the Student Subjective Wellbeing Questionnaire (SSWQ) beyond the original development and replication studies. Previous studies tested an English version of the SSWQ with urban, mostly Black/African American, low socioeconomic status,…

A Comparison of Factor Score Estimation Methods in the Presence of Missing Data: Reliability and an Application to Nicotine Dependence

ERIC Educational Resources Information Center

Estabrook, Ryne; Neale, Michael

2013-01-01

Factor score estimation is a controversial topic in psychometrics, and the estimation of factor scores from exploratory factor models has historically received a great deal of attention. However, both confirmatory factor models and the existence of missing data have generally been ignored in this debate. This article presents a simulation study…

Psychometric Evaluation of the Fear of Positive Evaluation Scale in Patients With Social Anxiety Disorder

PubMed Central

Weeks, Justin W.; Heimberg, Richard G.; Rodebaugh, Thomas L.; Goldin, Philippe R.; Gross, James J.

2014-01-01

The Fear of Positive Evaluation Scale (FPES; Weeks, Heimberg, & Rodebaugh, 2008) was designed to assess fear of positive evaluation, a proposed cognitive component of social anxiety. Although previous findings on the psychometric properties of the FPES have been highly encouraging, only one previous study has examined the psychometric profile of the FPES in a sample of patients with social anxiety disorder (Fergus et al., 2009). The primary purpose of the present study was to conduct a large multi-site examination of the psychometric profile of the FPES among patients with a principal diagnosis of social anxiety disorder (n = 226; generalized subtype: 97.8%). Responses of non-anxious control participants (n = 42) were also examined. The factorial validity, internal consistency, test-retest reliability, construct validity, and treatment sensitivity of the FPES were strongly supported by our findings. Furthermore, an FPES cutoff score was identified for distinguishing levels of fear of positive evaluation characteristic of patients with social anxiety disorder from those characteristic of the control group. Results provide additional support for the psychometric properties of the FPES in clinical samples. PMID:21966932

Reliability and validity of the Pragmatics Observational Measure (POM): a new observational measure of pragmatic language for children.

PubMed

Cordier, Reinie; Munro, Natalie; Wilkes-Gillan, Sarah; Speyer, Renée; Pearce, Wendy M

2014-07-01

There is a need for a reliable and valid assessment of childhood pragmatic language skills during peer-peer interactions. This study aimed to evaluate the psychometric properties of a newly developed pragmatic assessment, the Pragmatic Observational Measure (POM). The psychometric properties of the POM were investigated from observational data of two studies - study 1 involved 342 children aged 5-11 years (108 children with ADHD; 108 typically developing playmates; 126 children in the control group), and study 2 involved 9 children with ADHD who attended a 7-week play-based intervention. The psychometric properties of the POM were determined based on the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) taxonomy of psychometric properties and definitions for health-related outcomes; the Pragmatic Protocol was used as the reference tool against which the POM was evaluated. The POM demonstrated sound psychometric properties in all the reliability, validity and interpretability criteria against which it was assessed. The findings showed that the POM is a reliable and valid measure of pragmatic language skills of children with ADHD between the age of 5 and 11 years and has clinical utility in identifying children with pragmatic language difficulty. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Applying modern psychometric techniques to melodic discrimination testing: Item response theory, computerised adaptive testing, and automatic item generation.

PubMed

Harrison, Peter M C; Collins, Tom; Müllensiefen, Daniel

2017-06-15

Modern psychometric theory provides many useful tools for ability testing, such as item response theory, computerised adaptive testing, and automatic item generation. However, these techniques have yet to be integrated into mainstream psychological practice. This is unfortunate, because modern psychometric techniques can bring many benefits, including sophisticated reliability measures, improved construct validity, avoidance of exposure effects, and improved efficiency. In the present research we therefore use these techniques to develop a new test of a well-studied psychological capacity: melodic discrimination, the ability to detect differences between melodies. We calibrate and validate this test in a series of studies. Studies 1 and 2 respectively calibrate and validate an initial test version, while Studies 3 and 4 calibrate and validate an updated test version incorporating additional easy items. The results support the new test's viability, with evidence for strong reliability and construct validity. We discuss how these modern psychometric techniques may also be profitably applied to other areas of music psychology and psychological science in general.

Psychometric properties of the Interpersonal Relationship Inventory-Short Form for active duty female service members.

PubMed

Nayback-Beebe, Ann M; Yoder, Linda H

2011-06-01

The Interpersonal Relationship Inventory-Short Form (IPRI-SF) has demonstrated psychometric consistency across several demographic and clinical populations; however, it has not been psychometrically tested in a military population. The purpose of this study was to psychometrically evaluate the reliability and component structure of the IPRI-SF in active duty United States Army female service members (FSMs). The reliability estimates were .93 for the social support subscale and .91 for the conflict subscale. Principal component analysis demonstrated an obliquely rotated three-component solution that accounted for 58.9% of the variance. The results of this study support the reliability and validity of the IPRI-SF for use in FSMs; however, a three-factor structure emerged in this sample of FSMs post-deployment that represents "cultural context." Copyright © 2011 Wiley Periodicals, Inc.

Psychometric characteristics of health-related quality-of-life questionnaires in oropharyngeal dysphagia.

PubMed

Timmerman, Angelique A; Speyer, Renée; Heijnen, Bas J; Klijn-Zwijnenberg, Iris R

2014-04-01

Dysphagia can have severe consequences for the patient's health, influencing health-related quality of life (HRQoL). Sound psychometric properties of HRQoL questionnaires are a precondition for assessing the impact of dysphagia, the focus of this study, resulting in recommendations for the appropriate use of these questionnaires in both clinical practice and research contexts. We performed a systematic review starting with a search for and retrieval of all full-text articles on the development of HRQoL questionnaires related to oropharyngeal dysphagia and/or their psychometric validation from the electronic databases PubMed and Embase published up to June 2011. Psychometric properties were judged according to quality criteria proposed for health status questionnaires. Eight questionnaires were included in this study. Four are aimed solely at HRQoL in oropharyngeal dysphagia: the deglutition handicap index (DHI), dysphagia handicap index (DHI'), M.D. Anderson Dysphagia Inventory (MDADI), and SWAL-QOL, while the EDGQ, EORTC QLQ-STO 22, EORTC QLQ-OG 25 and EORTC QLQ-H&N35 focus on other primary diseases resulting in dysphagia. The psychometric properties of the DHI, DHI', MDADI, and SWAL-QOL were evaluated. For appropriate applicability of HRQoL questionnaires, strong scores on the psychometric criteria face validity, criterion validity, and interpretability are prerequisites. The SWAL-QOL has the strongest ratings for these criteria, while the DHI' is the most easy to apply given its 25 items and the use of a uniform scoring format. For optimal use of HRQoL questionnaires in diverse settings, it is necessary to combine psychometric and utility approaches.

Hurlbert Index of Sexual Assertiveness: a study of psychometric properties in a Spanish sample.

PubMed

Santos-Iglesias, Pablo; Sierra, Juan Carlos

2010-08-01

The study analyzed psychometric properties of a Spanish version of the Hurlbert Index of Sexual Assertiveness in a Spanish sample of 400 men and 453 women who had had a partner for the last 6 mo. or longer at the time of the study. Exploratory and confirmatory factor analyses suggested a two-factor solution with the factors Initiation and No shyness/Refusal. Internal consistency values for total scores were .87 and .83 for the factors, respectively. Convergent validity tests were also satisfactory. It is therefore reasonable to conclude that the Spanish version of the scale has appropriate psychometric properties.

Evaluation of the Psychometric Properties of the Mental Vulnerability Questionnaire in Undergraduate Students.

PubMed

Sequeira, Carlos Alberto da Cruz; Barbosa, Elsa Natalina Mendes; Nogueira, Maria José Carvalho; Sampaio, Francisco Miguel Correia

2017-10-01

Translate, adapt the language, and assess the psychometric properties of the Mental Vulnerability Questionnaire (MVQ) in a Portuguese population sample of young adults. A psychometric validation study was performed. The sample comprised 166 undergraduate students. Factor analysis was applied to extract three indicators. The MVQ showed divergent validity with the Positive Mental Health Questionnaire (p < .001) and convergent validity with the Mental Health Inventory including five items (p < .001). Reliability was verified through the assessment of internal consistency, evidencing positive outcomes (Cronbach's α = 0.81). The MVQ shows psychometric properties enabling its adaptation to clinical practice and research, essential to an effective screening of mental vulnerability. © 2016 Wiley Periodicals, Inc.

Development and Psychometric Evaluation of the Interpersonal Sexual Objectification Scale

ERIC Educational Resources Information Center

Kozee, Holly B.; Tylka, Tracy L.; Augustus-Horvath, Casey L.; Denchik, Angela

2007-01-01

This study reports on the development and psychometric evaluation of the Interpersonal Sexual Objectification Scale (ISOS). Data from 576 college women were collected in three studies. Exploratory factor analysis uncovered two factors: Body Evaluation and Unwanted Explicit Sexual Advances; confirmatory factor analysis supported this factor…

The Psychometric Properties of the Counselor Burnout Inventory in Greek School Counsellors

ERIC Educational Resources Information Center

Kounenou, Kalliopi; Gkemisi, Sofia; Nanopoulos, Panagiotis; Tsitsas, George

2018-01-01

The present study aimed at testing and exploring the psychometric properties of the Counselor Burnout Inventory (CBI) in Greek school counsellors. Two hundred school counsellors from all over Greece participated in the study. The confirmatory study revealed four dimensions of the Greek version of CBI; namely, exhaustion, deterioration in personal…

A Psychometric Study of the Infant and Toddler Intervals of the Social Emotional Assessment Measure

ERIC Educational Resources Information Center

Squires, Jane K.; Waddell, Misti L.; Clifford, Jantina R.; Funk, Kristin; Hoselton, Robert M.; Chen, Ching-I

2013-01-01

Psychometric and utility studies on Social Emotional Assessment Measure (SEAM), an innovative tool for assessing and monitoring social-emotional and behavioral development in infants and toddlers with disabilities, were conducted. The Infant and Toddler SEAM intervals were the study focus, using mixed methods, including item response theory…

The Drug Effects Questionnaire: Psychometric Support across Three Drug Types

PubMed Central

Morean, Meghan E.; de Wit, Harriet; King, Andrea C.; Sofuoglu, Mehmet; Rueger, Sandra Y.; O’Malley, Stephanie S.

2013-01-01

Rationale The Drug Effects Questionnaire (DEQ) is widely used in studies of acute subjective response (SR) to a variety of substances, but the format of the DEQ varies widely across studies, and details of its psychometric properties are lacking. Thus, the field would benefit from demonstrating the reliability and validity of the DEQ for use across multiple substances. Objective The current study evaluated the psychometric properties of several variations of DEQ items, which assessed the extent to which participants (1) feel any substance effect(s), (2) feel high, (3) like the effects, (4) dislike the effects, and (5) want more of the substance using 100mm Visual Analog Scales. Methods DEQ data from three placebo-controlled studies were analyzed to examine SR to amphetamine, nicotine, and alcohol. We evaluated the internal structure of the DEQ for use with each substance as well as relationships between scale items, measures of similar constructs, and substance-related behaviors. Results Results provided preliminary psychometric support for items assessing each DEQ construct (FEEL, HIGH, DISLIKE, LIKE, and MORE). Conclusions Based on the study results, we identify several common limitations of extant variants of the DEQ and recommend an improved version of the measure. The simplicity and brevity of the DEQ combined with its promising psychometric properties support its use in future SR research across a variety of substances. PMID:23271193

Organizational readiness for implementing change: a psychometric assessment of a new measure.

PubMed

Shea, Christopher M; Jacobs, Sara R; Esserman, Denise A; Bruce, Kerry; Weiner, Bryan J

2014-01-10

Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner's theory of organizational readiness for change. We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure's factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three. Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis. This article provides evidence in support of the ORIC measure. We believe this measure will enable testing of theories about determinants and consequences of organizational readiness and, ultimately, assist healthcare leaders to reduce the number of health organization change efforts that do not achieve desired benefits. Although ORIC shows promise, further assessment is needed to test for convergent, discriminant, and predictive validity.

Organizational readiness for implementing change: a psychometric assessment of a new measure

PubMed Central

2014-01-01

Background Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner’s theory of organizational readiness for change. Methods We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure’s factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three. Results Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis. Conclusions This article provides evidence in support of the ORIC measure. We believe this measure will enable testing of theories about determinants and consequences of organizational readiness and, ultimately, assist healthcare leaders to reduce the number of health organization change efforts that do not achieve desired benefits. Although ORIC shows promise, further assessment is needed to test for convergent, discriminant, and predictive validity. PMID:24410955

Psychometric testing of the Italian and French versions of the Care Dependency Scale.

PubMed

Zürcher, Simeon Joel; Vangelooven, Christa; Borter, Natalie; Schnyder, Daniel; Hahn, Sabine

2016-12-01

The aim of this study was to test psychometrically the Italian and French versions of the Care Dependency Scale. The Care Dependency Scale assesses changes in patients' level of care dependency including important functional and mental dimensions. Evaluation of the psychometric properties of the Italian version is still ongoing. The French version has to date not been validated. Nationwide cross-sectional point prevalence study. Data were extracted from the national, annual prevalence survey of hospital-acquired pressure ulcers and inpatient falls in Swiss acute care hospitals in 2011. A total of 799 Italian and 1068 French-speaking patients were included in the analysis. For the evaluation, the psychometric properties were tested for each language both separately and conjointly. The scales revealed high internal consistency. Factor analysis presented a one-factor solution for both versions separately as well as combined. Comparison of internal structure revealed an excellent degree of equivalence between the versions. Highly significant Spearman correlations between the Care Dependency Scale and the Braden Scale sum scores indicated satisfactory criterion validity. Both the Italian and the French versions of the Care Dependency Scale showed satisfactory psychometric properties and a high level of equivalence. Further psychometric testing, using modern test theory approaches, is required. However, the scale is recommended as a valid instrument for further use in Italian and French. © 2016 John Wiley & Sons Ltd.

Existential Measurement: A Factor Analytic Study of Some Current Psychometric Instruments.

ERIC Educational Resources Information Center

Thauberger, Patrick C.; And Others

1982-01-01

Research in existentialism and ontology has given rise to several psychometric instruments. Used both exploratory and confirmatory principal-factor analyses to study relationships among 16 existential scales. Exploratory factor analysis provided some support of the theory that the avoidance of existential confrontation is a central function of…

Self-Discrepancy: Comparisons of the Psychometric Properties of Three Instruments

ERIC Educational Resources Information Center

Watson, Neill; Bryan, Brandon C.; Thrash, Todd M.

2010-01-01

In 2 studies, the psychometric properties of 3 methods for measuring real-ideal and real ought self-discrepancies were compared: the idiographic Self-Concept Questionnaire--Personal Constructs, the nonidiographic Self-Concept Questionnaire--Conventional Constructs, and the content-free Abstract Measures. In the 1st study, 125 students at a…

Psychometric Measurement Models and Artificial Neural Networks

ERIC Educational Resources Information Center

Sese, Albert; Palmer, Alfonso L.; Montano, Juan J.

2004-01-01

The study of measurement models in psychometrics by means of dimensionality reduction techniques such as Principal Components Analysis (PCA) is a very common practice. In recent times, an upsurge of interest in the study of artificial neural networks apt to computing a principal component extraction has been observed. Despite this interest, the…

A Psychometric Evaluation of the Core Bereavement Items

ERIC Educational Resources Information Center

Holland, Jason M.; Nam, Ilsung; Neimeyer, Robert A.

2013-01-01

Despite being a routinely administered assessment of grieving, few studies have empirically examined the psychometric properties of the Core Bereavement Items (CBI). The present study investigated the factor structure, internal reliability, and concurrent validity of the CBI in a large, diverse sample of bereaved young adults (N = 1,366).…

Psychometric Structure of a Comprehensive Objective Structured Clinical Examination: A Factor Analytic Approach

ERIC Educational Resources Information Center

Volkan, Kevin; Simon, Steven R.; Baker, Harley; Todres, I. David

2004-01-01

Problem Statement and Background: While the psychometric properties of Objective Structured Clinical Examinations (OSCEs) have been studied, their latent structures have not been well characterized. This study examines a factor analytic model of a comprehensive OSCE and addresses implications for measurement of clinical performance. Methods: An…

Assessing safety climate in acute hospital settings: a systematic review of the adequacy of the psychometric properties of survey measurement tools.

PubMed

Alsalem, Gheed; Bowie, Paul; Morrison, Jillian

2018-05-10

The perceived importance of safety culture in improving patient safety and its impact on patient outcomes has led to a growing interest in the assessment of safety climate in healthcare organizations; however, the rigour with which safety climate tools were developed and psychometrically tested was shown to be variable. This paper aims to identify and review questionnaire studies designed to measure safety climate in acute hospital settings, in order to assess the adequacy of reported psychometric properties of identified tools. A systematic review of published empirical literature was undertaken to examine sample characteristics and instrument details including safety climate dimensions, origin and theoretical basis, and extent of psychometric evaluation (content validity, criterion validity, construct validity and internal reliability). Five questionnaire tools, designed for general evaluation of safety climate in acute hospital settings, were included. Detailed inspection revealed ambiguity around concepts of safety culture and climate, safety climate dimensions and the methodological rigour associated with the design of these measures. Standard reporting of the psychometric properties of developed questionnaires was variable, although evidence of an improving trend in the quality of the reported psychometric properties of studies was noted. Evidence of the theoretical underpinnings of climate tools was limited, while a lack of clarity in the relationship between safety culture and patient outcome measures still exists. Evidence of the adequacy of the psychometric development of safety climate questionnaire tools is still limited. Research is necessary to resolve the controversies in the definitions and dimensions of safety culture and climate in healthcare and identify related inconsistencies. More importance should be given to the appropriate validation of safety climate questionnaires before extending their usage in healthcare contexts different from those in which they were originally developed. Mixed methods research to understand why psychometric assessment and measurement reporting practices can be inadequate and lacking in a theoretical basis is also necessary.

The Role of Psychometrics in Individual Differences Research in Cognition: A Case Study of the AX-CPT

PubMed Central

Cooper, Shelly R.; Gonthier, Corentin; Barch, Deanna M.; Braver, Todd S.

2017-01-01

Investigating individual differences in cognition requires addressing questions not often thought about in standard experimental designs, especially regarding the psychometric properties of the task. Using the AX-CPT cognitive control task as a case study example, we address four concerns that one may encounter when researching the topic of individual differences in cognition. First, we demonstrate the importance of variability in task scores, which in turn directly impacts reliability, particularly when comparing correlations in different populations. Second, we demonstrate the importance of variability and reliability for evaluating potential failures to replicate predicted correlations, even within the same population. Third, we demonstrate how researchers can turn to evaluating psychometric properties as a way of evaluating the feasibility of utilizing the task in new settings (e.g., online administration). Lastly, we show how the examination of psychometric properties can help researchers make informed decisions when designing a study, such as determining the appropriate number of trials for a task. PMID:28928690

Validation of a pregnancy planning measure for Arabic-speaking women.

PubMed

Almaghaslah, Eman; Rochat, Roger; Farhat, Ghada

2017-01-01

The prevalence of unplanned pregnancy in Saudi Arabia has not been thoroughly investigated. To conduct a psychometric evaluation study of the Arabic version of the London Measure of Unplanned Pregnancy (LMUP). To evaluate the psychometric properties of the LMUP, we conducted a self-administered online survey among 796 ever-married Saudi women aged 20-49 years, and a re-test survey among 24 women. The psychometric properties evaluated included content validity measured by content validity index (CVI), structural validity assessed by exploratory factor analysis (EFA), substantive validity assessed by hypothesis testing, contextual stability for the test-retest assessed by weighted Kappa, and internal consistency assessed by Cronbach's alpha. The psychometric analysis of the Arabic version of LMUP exhibited valid and reliable properties. The CVIs for individual items and at the scale level were >0.7. EFA confirmed a unidimensional extraction of the scale item. Hypothesis testing confirmed expected associations. The tool was stable with weighted kappa = 0.78 and Cronbach's alpha = 0.88. In this study, the validity and reliability of the Arabic version of the LMUP were confirmed according to well-known psychometric criteria. This LMUP version can be used in research studies among Arabic-speaking women to measure unplanned pregnancy and investigate correlates and outcomes related to unplanned pregnancy.

Investigation of Psychometric Properties of the Test for Creative Thinking-Drawing Production: Evidence from Study in Latvia

ERIC Educational Resources Information Center

Kalis, Emils; Roke, Liga; Krumina, Indra

2016-01-01

The Test for Creative Thinking-Drawing Production (TCT-DP) is designed as an effective drawing-based instrument for measuring creative potential. Many studies report adaptation efforts in other cultures pointing out good psychometric properties of the instrument nonetheless revealing also some trouble spots. The present study includes adaptation…

Sensitivity and validity of psychometric tests for assessing driving impairment: effects of sleep deprivation.

PubMed

Jongen, Stefan; Perrier, Joy; Vuurman, Eric F; Ramaekers, Johannes G; Vermeeren, Annemiek

2015-01-01

To assess drug induced driving impairment, initial screening is needed. However, no consensus has been reached about which initial screening tools have to be used. The present study aims to determine the ability of a battery of psychometric tests to detect performance impairing effects of clinically relevant levels of drowsiness as induced by one night of sleep deprivation. Twenty four healthy volunteers participated in a 2-period crossover study in which the highway driving test was conducted twice: once after normal sleep and once after one night of sleep deprivation. The psychometric tests were conducted on 4 occasions: once after normal sleep (at 11 am) and three times during a single night of sleep deprivation (at 1 am, 5 am, and 11 am). On-the-road driving performance was significantly impaired after sleep deprivation, as measured by an increase in Standard Deviation of Lateral Position (SDLP) of 3.1 cm compared to performance after a normal night of sleep. At 5 am, performance in most psychometric tests showed significant impairment. As expected, largest effect sizes were found on performance in the Psychomotor Vigilance Test (PVT). Large effects sizes were also found in the Divided Attention Test (DAT), the Attention Network Test (ANT), and the test for Useful Field of View (UFOV) at 5 and 11 am during sleep deprivation. Effects of sleep deprivation on SDLP correlated significantly with performance changes in the PVT and the DAT, but not with performance changes in the UFOV. From the psychometric tests used in this study, the PVT and DAT seem most promising for initial evaluation of drug impairment based on sensitivity and correlations with driving impairment. Further studies are needed to assess the sensitivity and validity of these psychometric tests after benchmark sedative drug use.

Psychometric Examination, Adaptation, and Evaluation of the Hebrew Translation of the MMPI-2-RF VRIN-r and TRIN-r Validity Scales.

PubMed

Shkalim, Eleanor; Ben-Porath, Yossef S; Handel, Richard W; Almagor, Moshe; Tellegen, Auke

2016-01-01

In this study we examined the utility of the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF; Ben-Porath & Tellegen, 2008/2011; Tellegen & Ben-Porath, 2008/2011) Variable Response Inconsistency-Revised (VRIN-r) and True Response Inconsistency-Revised (TRIN-r) scales, including alternative versions of the scales, in the Hebrew translation of the test. First, we examined the applicability of the U.S. VRIN-r and TRIN-r scales in an Israeli Hebrew-speaking mixed clinical sample, and replaced original item pairs that did not meet the development criteria with substitution item pairs that did. Then, using the Israeli normative sample and a pure clinical sample, we compared the psychometric functioning of the adapted Hebrew-language VRIN-r and TRIN-r scales with that of the original versions of these scales under various conditions of simulated non-content-based (random and fixed) responding. Overall, results showed that the adapted versions of the scales did not improve on the original ones. We therefore recommend using the U.S. VRIN-r and TRIN-r versions, which could also facilitate cross-cultural comparisons.

Social Cognition Psychometric Evaluation: Results of the Final Validation Study.

PubMed

Pinkham, Amy E; Harvey, Philip D; Penn, David L

2018-06-06

Social cognition is increasingly recognized as an important treatment target in schizophrenia; however, the dearth of well-validated measures that are suitable for use in clinical trials remains a significant limitation. The Social Cognition Psychometric Evaluation (SCOPE) study addresses this need by systematically evaluating the psychometric properties of promising measures. In this final phase of SCOPE, eight new or modified tasks were evaluated. Stable outpatients with schizophrenia (n = 218) and healthy controls (n = 154) completed the battery at baseline and 2-4 weeks later across three sites. Tasks included the Bell Lysaker Emotion Recognition Task (BLERT), Penn Emotion Recognition Task (ER-40), Reading the Mind in the Eyes Task (Eyes), The Awareness of Social Inferences Test (TASIT), Hinting Task, Mini Profile of Nonverbal Sensitivity (MiniPONS), Social Attribution Task-Multiple Choice (SAT-MC), and Intentionality Bias Task (IBT). BLERT and ER-40 modifications included response time and confidence ratings. The Eyes task was modified to include definitions of terms and TASIT to include response time. Hinting was scored with more stringent criteria. MiniPONS, SAT-MC, and IBT were new to this phase. Tasks were evaluated on (1) test-retest reliability, (2) utility as a repeated measure, (3) relationship to functional outcome, (4) practicality and tolerability, (5) sensitivity to group differences, and (6) internal consistency. Hinting, BLERT, and ER-40 showed the strongest psychometric properties and are recommended for use in clinical trials. Eyes, TASIT, and IBT showed somewhat weaker psychometric properties and require further study. MiniPONS and SAT-MC showed poorer psychometric properties that suggest caution for their use in clinical trials.

Instruments used to assess functional limitations in workers applying for disability benefit: a systematic review.

PubMed

Spanjer, Jerry; Groothoff, Johan W; Brouwer, Sandra

2011-01-01

To systematically review the quality of the psychometric properties of instruments for assessing functional limitations in workers applying for disability benefit. Electronic searches of Medline, Embase, CINAHL and PsycINFO were performed to identify studies focusing on the psychometric properties of instruments used to assess functional limitations in workers' compensation claimants. Two independent reviewers applied the inclusion criteria to select relevant articles and then evaluated the psychometric qualities of the instruments found. Of the 712 articles that were identified, 10 studies met the inclusion criteria, reporting on four instruments: the Roland-Morris Disability Questionnaire (RMDQ), the Patient-Specific Functional Scale (PSFS), the Isernhagen Work System (IWS) and the Multiperspective Multidimensional Pain Assessment Protocol (MMPAP). The questionnaires (RMDQ and PSFS) did not focus specifically on the work situation and measured three to eight functional limitations. The psychometric qualities of the IWS were poor to moderate. For the MMPAP, only predictive validity was measured. The instruments assessed a range varying between 3 and 34 physical functional limitations. No instruments were found for assessing mental limitations in workers' compensation claimants. Studies on four instruments specifically focusing on assessing physical functional limitations in workers applying for disability benefit were found. All four instruments have limitations regarding their psychometric qualities or contents. Since the RMDQ has the best demonstrated psychometric qualities and takes little time to complete it, we recommend the RMDQ for clinicians in rehabilitation. For the assessment of functional limitations in workers applying for disability benefit a combination of questionnaires, performance tests or interviews together with the judgment by physicians looks the most promising.

Measuring the youth bullying experience: a systematic review of the psychometric properties of available instruments.

PubMed

Vessey, Judith; Strout, Tania D; DiFazio, Rachel L; Walker, Allison

2014-12-01

Bullying is a significant problem in schools and measuring this concept remains problematic. The purposes of this study were to (1) identify the published self-report measures developed to assess youth bullying; (2) evaluate their psychometric properties and instrument characteristics; and (3) evaluate the quality of identified psychometric papers evaluating youth bullying measures. A systematic review of the literature was conducted using 4 electronic databases. Data extraction and appraisal of identified instruments were completed using a standardized method and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Thirty-one articles describing 27 self-report instruments were evaluated in our analysis. Quality assessments ranged from 18% to 91%, with 6 papers reaching or exceeding a quality score of 75%. Limited evidence supporting the reliability, validity, and responsiveness of existing youth bullying measures was identified. Evidence supporting the psychometric soundness of the instruments identified was limited. Many measures were in early development and additional evaluation is necessary to validate their psychometric properties. A pool of instruments possesses acceptable initial psychometric dependability for selected assessment purposes. These findings have significant implications for assessing youth bullying and designing and evaluating school-based interventions. © 2014, American School Health Association.

Using the Rasch analysis for the psychometric validation of the Irregular Word Reading Test (TeLPI): A Portuguese test for the assessment of premorbid intelligence.

PubMed

Freitas, Sandra; Prieto, Gerardo; Simões, Mário R; Nogueira, Joana; Santana, Isabel; Martins, Cristina; Alves, Lara

2018-05-03

The present study aims to analyze the psychometric characteristics of the TeLPI (Irregular Words Reading Test), a Portuguese premorbid intelligence test, using the Rasch model for dichotomous items. The results reveal an overall adequacy and a good fit of values regarding both items and persons. A high variability of cognitive performance level and a good quality of the measurements were also found. The TeLPI has proved to be a unidimensional measure with reduced DIF effects. The present findings contribute to overcome an important gap in the psychometric validity of this instrument and provide good evidence of the overall psychometric validity of TeLPI results.

[Cross-cultural adaptation and psychometric tests of a self-efficacy scale and an adherence scale for French adolescents with Type 1 diabetes

PubMed

Colson, Sébastien; Coté, José; Collombier, Madeleine; Debout, Christophe; Bonnel, Galadriel; Reynaud, Rachel; Lagouanelle-Simeoni, Marie-Claude

2016-12-01

Introduction : many structured educational programs, using the concept of self-efficacy, have been studied in English-speaking countries. Background : tools were developed in English to assess this concept along with treatment adherence. However, there seems to be no French version of these tools in scientific literature. Aim : to adapt the tools to the French language and to test the psychometric properties of the Self-Efficacy for Diabetes Self-Management (SEDM) and the Diabetes Self-Management Profile (DSMP). Methods : a cross-cultural adaptation of the SEDM and DSMP in French was performed. The psychometric properties were tested in a pilot study that took place between January 1st and December 31st, 2015. Results : Cronbach’s alpha coefficient of SEDM in French was 0.84, test-retest reliability 0.80 and sensitivity to change was moderate. The Cronbach’s alpha and sensitivity to change of the French DSMP were low, and the test-retest was 0.71. Discussion and conclusions : the first results of the psychometric properties of French SEDM were rather encouraging. The use of the French version of DSMP seems compromised in terms of psychometric properties and the opinion of the participants.

Psychometric evaluation of the Northwick Park Dependency Scale.

PubMed

Siegert, Richard J; Turner-Stokes, Lynne

2010-11-01

To examine the psychometric properties of the Northwick Park Dependency Scale (NPDS). Review of existing literature and psychometric analysis in relation to other standardized measures of disability in a large neurorehabilitation cohort. A regional post-acute specialist inpatient neurorehabilitation unit in London, UK. A total of 569 inpatients with complex neurological disabilities (350 males, 219 females; mean age 44.4 years). The NPDS, Barthel Index, Functional Independence and Functional Assessment measures. A database search found 5 studies that examined the psychometrics of the NPDS. These supported its validity and reliability. The present study added to these by evaluating the internal consistency, factor structure, discriminatory power and responsiveness to change during rehabilitation. The NPDS was found to have good internal consistency (α = 0.90), suggesting that it can reasonably be summed to a single total score. It discriminated among people with different levels of dependency and was responsive to change, particularly in the higher dependency groups. The NPDS is a psychometrically robust tool, providing a broader range of information on nursing needs than some other commonly-used disability measures. The Special Nursing Needs subscale provides clinically useful information, but its metric properties require further development, which is now underway.

Walking simulator for evaluation of ophthalmic devices

NASA Astrophysics Data System (ADS)

Barabas, James; Woods, Russell L.; Peli, Eli

2005-03-01

Simulating mobility tasks in a virtual environment reduces risk for research subjects, and allows for improved experimental control and measurement. We are currently using a simulated shopping mall environment (where subjects walk on a treadmill in front of a large projected video display) to evaluate a number of ophthalmic devices developed at the Schepens Eye Research Institute for people with vision impairment, particularly visual field defects. We have conducted experiments to study subject's perception of "safe passing distance" when walking towards stationary obstacles. The subject's binary responses about potential collisions are analyzed by fitting a psychometric function, which gives an estimate of the subject's perceived safe passing distance, and the variability of subject responses. The system also enables simulations of visual field defects using head and eye tracking, enabling better understanding of the impact of visual field loss. Technical infrastructure for our simulated walking environment includes a custom eye and head tracking system, a gait feedback system to adjust treadmill speed, and a handheld 3-D pointing device. Images are generated by a graphics workstation, which contains a model with photographs of storefronts from an actual shopping mall, where concurrent validation experiments are being conducted.

Psychometric properties of the Spanish Burnout Inventory among staff nurses.

PubMed

Gil-Monte, P R; Manzano-García, G

2015-12-01

The burnout syndrome contributes to the deterioration in the quality of personal life as well as lower quality practice in healthcare personnel. Researchers have been concerned about the psychometric limitations of some previous questionnaires designed to evaluate burnout. The Spanish Burnout Inventory was developed to address the problems associated with other instruments, but it has not yet been validated in staff nurses. This study provides evidence that the Spanish Burnout Inventory has adequate psychometric properties to estimate burnout in staff nurses. The Spanish Burnout Inventory offers a theoretical proposal to explain the different components of burnout. The Spanish Burnout Inventory provides researchers and practitioners with an expanded conceptualization of the burnout syndrome, which can facilitate the diagnosis and treatment of nursing professionals. Researchers have been concerned about the psychometric limitations of the some previous questionnaires designed to evaluate burnout. To address these problems associated with previous instruments, the Spanish Burnout Inventory (SBI) was developed. The instrument has not yet been validated in staff nurses. The purpose of this paper was to evaluate the psychometric properties of the SBI. The sample consisted of 720 staff nurses from two Spanish general hospitals. The instrument is composed of 20 items distributed in four dimensions: Enthusiasm towards the job (five items), Psychological exhaustion (four items), Indolence (six items) and Guilt (five items). Data were subjected to confirmatory factor analysis. To assess the factorial validity of the SBI, four alternative models were tested. Results show that the four-factor model of the SBI has adequate psychometric properties for the study of burnout in staff nurses. This model fitted the data better than the alternative models. The study provides evidence of the adequate psychometric properties of a measure to evaluate burnout in nursing professionals. The SBI proposes a theoretical explanation for the different types of burnout, facilitating the diagnosis and treatment of staff nurses. © 2015 John Wiley & Sons Ltd.

Adaptation and initial psychometric study of the self-report version of Liebowitz Social Anxiety Scale (LSAS-SR).

PubMed

Dos Santos, Larissa Forni; Loureiro, Sonia Regina; Crippa, José Alexandre S; de Lima Osório, Flávia

2013-06-01

The objectives of the present study were to adapt the Liebowitz Social Anxiety Scale from the clinician administered to the self-report version (LSAS-SR) and to perform the initial psychometric studies concerning internal consistency and item analysis. The phase of adaptation was performed by two specialists in the Mental Health area and the face validity was tested by a group of 30 university students. As part of the psychometric study of the LSAS-SR, the internal consistency was assessed and the items were analyzed by applying the scale to 682 university students. The LSAS-SR proved to be easy to understand by the group studied, with no need to make any changes in the instructions for application. The scale showed adequate internal consistency (α = 0.96) as well as an acceptable correlation between items and total score (0.38-0.72). The initial psychometric studies of the LSAS-SR presented adequate indicators, stimulating the continuation of studies involving the validation and reliability of the scale not only when applied to a sample of the general population, but also when applied to clinical groups.

Psychometric Profile of an Experimental Emergent Literacy Screener for Preschoolers

ERIC Educational Resources Information Center

Bailet, Laura L.; Zettler-Greeley, Cynthia; Lewis, Kandia

2018-01-01

Home literacy activities influence children's emergent literacy progress and readiness for reading instruction. To help parents fulfill this opportunity, we developed a new Emergent Literacy Screener (ELS) and conducted 2 studies of its psychometric properties with independent prekindergarten samples. For Study 1 (n = 812, M[subscript age] = 54.4…

Psychometric Reanalysis of Happiness, Temperament, and Spirituality Scales with Children in Faith-Based Elementary Schools

ERIC Educational Resources Information Center

Cleveland, Richard E.

2014-01-01

This dissertation performed an investigation of the psychometric properties of six instruments used in the 2012 Happiness Project research study. The project revisited the 2010 study conducted by Holder, Coleman, and Wallace. Holder et al. (2010) investigated the relationships among variables relating to student happiness and spirituality while…

The Psychometric Properties of the Invitational School Survey (ISS): An Australian Study

ERIC Educational Resources Information Center

Smith, Kenneth H.; Barnard, John

2004-01-01

This study provides psychometric data on the Inviting School Survey (Purkey & Fuller, 1995) using a rating scale analysis within the framework of the Rasch measurement philosophy (Bond & Fox, 2001; Rasch, 1980). The Inviting School Survey's factor structure and internal consistency are examined and compared with the Invitational Education…

A Psychometric Analysis of the Ottawa Self-Injury Inventory-F

ERIC Educational Resources Information Center

Brown, Joshua Travis; Volk, Fred; Gearhart, Gabrielle L.

2018-01-01

Objective: This study seeks to evaluate the psychometric properties of the Ottawa Self-Injury Inventory-Functions (OSI-F) for assessing nonsuicidal self-injury (NSSI), a condition for further study in the DSM-5. Participants: Participants included 345 students who indicated a history of self-injury in a university counseling center over six…

Development and Psychometric Evaluation of a Measure of Intuitive Eating

ERIC Educational Resources Information Center

Tylka, Tracy L.

2006-01-01

Intuitive eating is characterized by eating based on physiological hunger and satiety cues rather than situational and emotional cues and is associated with psychological well-being. This study reports on the development and initial psychometric evaluation of the Intuitive Eating Scale (IES) with data collected in 4 studies from 1,260 college…

Translation of the Marlowe-Crowne Social Desirability Scale into an Equivalent Spanish Version

ERIC Educational Resources Information Center

Collazo, Andres A.

2005-01-01

A Spanish version of the Marlowe-Crowne Social Desirability Scale (MCSDS) was developed by applying a method derived from the cross-cultural and psychometric literature. The method included five sequenced studies: (a) translation and back-translation, (b) comprehension assessment, (c) psychometric equivalence study of two mixed-language versions,…

Psychometric Properties of the Teacher-Reported Motor Skills Rating Scale

ERIC Educational Resources Information Center

Kim, Helyn; Murrah, William M.; Cameron, Claire E.; Brock, Laura L.; Cottone, Elizabeth A.; Grissmer, David

2015-01-01

Children's early motor competence is associated with social development and academic achievement. However, few studies have examined teacher reports of children's motor skills. This study evaluated the psychometric properties of the Motor Skills Rating Scale (MSRS), a 19-item measure of children's teacher-reported motor skills in the classroom.…

Refinement, Application, and Evaluation of Cognitive and Affective Chemistry Measures for College Students

ERIC Educational Resources Information Center

Heredia, Keily

2013-01-01

This work describes three case studies conducted to address two major problems in the area of chemistry education research, the lack of reported psychometrics regarding instrument scores, and the need for well-characterized assessments to evaluate college chemistry curricula. The first case study describes a psychometric evaluation of the Colorado…

Capturing the post-exertional exacerbation of fatigue following physical and cognitive challenge in patients with chronic fatigue syndrome.

PubMed

Keech, Andrew; Sandler, Carolina X; Vollmer-Conna, Ute; Cvejic, Erin; Lloyd, Andrew R; Barry, Benjamin K

2015-12-01

To design and validate an instrument to capture the characteristic post-exertional exacerbation of fatigue in patients with chronic fatigue syndrome (CFS). Firstly, patients with CFS (N=19) participated in five focus group discussions to jointly explore the nature of fatigue and dynamic changes after activity, and inform development of a self-report instrument - the Fatigue and Energy Scale (FES). The psychometric properties of the FES were then examined in two case-control challenge studies: a physically-demanding challenge (moderate-intensity aerobic exercise; N=10 patients), and a cognitively-demanding challenge (simulated driving; N=11 patients). Finally, ecological validity was evaluated by recording in association with tasks of daily living (N=9). Common descriptors for fatigue included 'exhaustion', 'tiredness', 'drained of energy', 'heaviness in the limbs', and 'foggy in the head'. Based on the qualitative data, fatigue was conceptualised as consisting of 'physical' and 'cognitive' dimensions. Analysis of the psychometric properties of the FES showed good sensitivity to the changing symptoms during a post-exertional exacerbation of fatigue following both physical exercise and driving simulation challenges, as well as tasks of daily living. The 'fatigue' experienced by patients with CFS covers both physical and cognitive components. The FES captured the phenomenon of a post-exertional exacerbation of fatigue commonly reported by patients with CFS. The characteristics of the symptom response to physical and cognitive challenges were similar. Both the FES and the challenge paradigms offer key tools to reliably investigate biological correlates of the dynamic changes in fatigue. Copyright © 2015 Elsevier Inc. All rights reserved.

Instruments to assess patient comfort during hospitalization: A psychometric review.

PubMed

Lorente, Sonia; Losilla, Josep-Maria; Vives, Jaume

2018-05-01

To analyse the psychometric properties and the utility of instruments used to measure patient comfort, physical, social, psychospiritual and/or environmental, during hospitalization. There are no systematic reviews nor psychometric reviews of instruments used to measure comfort, which is considered an indicator of quality in health care associated with quicker discharges, increased patient satisfaction and better cost-benefit ratios for the institution. Psychometric review. MEDLINE, CINAHL, PsycINFO, Web of Knowledge, ProQuest Thesis&Dissertations, Google. We limited our search to studies published between 1990-2015. The psychometric analysis was performed using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN), along with the Quality Criteria for Measurement Properties. The utility of the instruments was assessed according to their cost-efficiency, acceptability and educational impact. Protocol registration in PROSPERO, CRD42016036290. Instruments reviewed showed moderate methodological quality and their utility was poorly reported. Thus, we cannot recommend any questionnaire without reservations, but the Comfort Scale, the General Comfort Questionnaire and their adaptations in adults and older patients, the Psychosocial Comfort Scale and the Incomfort des Patients de Reanimation are the most recommendable instruments to measure comfort. The methodology of the studies should be more rigorous and authors should adequately report the utility of instruments. This review provides a strategy to select the most suitable instrument to assess patient comfort according to their psychometric properties and utility, which is crucial for nurses, clinicians, researchers and institutions. © 2017 John Wiley & Sons Ltd.

Psychometric properties of startle and corrugator response in NPU, Affective Picture Viewing, and Resting State tasks

PubMed Central

Kaye, Jesse T.; Bradford, Daniel E.; Curtin, John J.

2016-01-01

The current study provides a comprehensive evaluation of critical psychometric properties of commonly used psychophysiology laboratory tasks/measures within the NIMH RDoC. Participants (N = 128) completed the No Shock, Predictable Shock, Unpredictable Shock (NPU) task, Affective Picture Viewing task, and Resting State task at two study visits separated by one week. We examined potentiation/modulation scores in NPU (predictable or unpredictable shock vs. no shock) and Affective Picture Viewing tasks (pleasant or unpleasant vs. neutral pictures) for startle and corrugator responses with two commonly used quantification methods. We quantified startle potentiation/modulation scores with raw and standardized responses. We quantified corrugator potentiation/modulation in the time and frequency domains. We quantified general startle reactivity in the Resting State Task as the mean raw startle response during the task. For these three tasks, two measures, and two quantification methods we evaluated effect size robustness and stability, internal consistency (i.e., split-half reliability), and one-week temporal stability. The psychometric properties of startle potentiation in the NPU task were good but concerns were noted for corrugator potentiation in this task. Some concerns also were noted for the psychometric properties of both startle and corrugator modulation in the Affective Picture Viewing task, in particular for pleasant picture modulation. Psychometric properties of general startle reactivity in the Resting State task were good. Some salient differences in the psychometric properties of the NPU and Affective Picture Viewing tasks were observed within and across quantification methods. PMID:27167717

Examining the Psychometric Properties of Acceptance Scale for Kindergarten-Revised (ASK-R) in Turkish

ERIC Educational Resources Information Center

Ersan, Deniz Tekin; Ata, Seda; Kaya, Sinem

2017-01-01

The aim of this study is to investigate the applicability of ASK-R among Turkish pre-school children and determine the psychometric properties (validity and reliability) of this scale. This study was conducted with 167 students from different pre-schools in Mugla. Within the aim of the study, three different methods were set down in order to…

Evaluation of the Psychometric Properties of the Parents' Proxy MPAQ-C in Chinese Population

ERIC Educational Resources Information Center

Leung, Ka Man; Chung, Pak-Kwong; Ransdell, Lynda B.; Gao, Yong

2016-01-01

We examined psychometric properties of a Modified Physical Activity Questionnaire for Children (MPAQ-C). Thirty-two parents (Study 1), 40 students (6-9 years) and one of each student's parents (Study 2), and 625 parents (Study 3) completed the MPAQ-C. The MPAQ-C (six items) measured children's physical activity (PA) after school, and during…

Instruments evaluating the self-directed learning abilities among nursing students and nurses: a systematic review of psychometric properties.

PubMed

Cadorin, Lucia; Bressan, Valentina; Palese, Alvisa

2017-11-25

Modern healthcare institutions are continuously changing, and Self-Directed Learning (SDL) abilities are considered a prerequisite for both nursing students and nurses in order to be proactive about these demanding challenges. To date, no systematic reviews of existing instruments aimed at detecting and critically evaluating SDL abilities have been published. Therefore, the aims of this review are: 1) identify the instruments for assessment of SDL abilities among nursing students and nurses; 2) critically evaluate the methodological studies quality; and 3) compare the psychometric properties of the available instruments. A psychometric-systematic-review was performed. CDSR, CINAHL, ERIC, MEDLINE, PROSPERO, SCOPUS databases were searched without restrictions in time and setting. All primary studies involving nursing students or nurses, written in English and aimed at validating SDL assessment tools, were included. Studies retrieved were evaluated according to the COnsensus-based-Standards for the selection of health Measurement-INstruments (COSMIN) panel. Study inclusion, data extraction and quality assessment were performed by researchers independently. Eleven studies were included and four tools based on Knowles's theory have emerged: 1) the Self-Directed Learning Readiness Scale; 2) the Self-Directed Learning Readiness Scale for Nursing Education; 3) the Self-Rating Scale of Self-Directed Learning, and 4) the Self-Directed Learning Instrument. A few psychometric properties have been considered in each study, from two to four out of the ten required. The quality of the methodologies used was in general, from fair to poor with the exception of one instrument (the Self-Directed-Learning-Instrument). The psychometric proprieties that emerged across the tools were good in general: the Cronbach α was from 0.73 to 0.91; structural validities have also reported good indexes both in the explorative and in the confirmative factor analyses. On the basis of the findings, the Self-Directed-Learning-Instrument can be recommended for the assessment of SDL abilities among nursing students and nurses, given the excellent methodology quality adopted in estimating the psychometric properties. However, rigorous study designs aimed at estimating psychometric properties of tools in wide samples of nursing students and nurses across different stages of professional life, from undergraduate education to professional maturity, in different cultural, educational, and work settings, are strongly recommended.

A systematic review evaluating the psychometric properties of measures of social inclusion.

PubMed

Cordier, Reinie; Milbourn, Ben; Martin, Robyn; Buchanan, Angus; Chung, Donna; Speyer, Renée

2017-01-01

Improving social inclusion opportunities for population health has been identified as a priority area for international policy. There is a need to comprehensively examine and evaluate the quality of psychometric properties of measures of social inclusion that are used to guide social policy and outcomes. To conduct a systematic review of the literature on all current measures of social inclusion for any population group, to evaluate the quality of the psychometric properties of identified measures, and to evaluate if they capture the construct of social inclusion. A systematic search was performed using five electronic databases: CINAHL, PsycINFO, Embase, ERIC and Pubmed and grey literature were sourced to identify measures of social inclusion. The psychometric properties of the social inclusion measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Of the 109 measures identified, twenty-five measures, involving twenty-five studies and one manual met the inclusion criteria. The overall quality of the reviewed measures was variable, with the Social and Community Opportunities Profile-Short, Social Connectedness Scale and the Social Inclusion Scale demonstrating the strongest evidence for sound psychometric quality. The most common domain included in the measures was connectedness (21), followed by participation (19); the domain of citizenship was covered by the least number of measures (10). No single instrument measured all aspects within the three domains of social inclusion. Of the measures with sound psychometric evidence, the Social and Community Opportunities Profile-Short captured the construct of social inclusion best. The overall quality of the psychometric properties demonstrate that the current suite of available instruments for the measurement of social inclusion are promising but need further refinement. There is a need for a universal working definition of social inclusion as an overarching construct for ongoing research in the area of the psychometric properties of social inclusion instruments.

A systematic review evaluating the psychometric properties of measures of social inclusion

PubMed Central

Milbourn, Ben; Martin, Robyn; Buchanan, Angus; Chung, Donna; Speyer, Renée

2017-01-01

Introduction Improving social inclusion opportunities for population health has been identified as a priority area for international policy. There is a need to comprehensively examine and evaluate the quality of psychometric properties of measures of social inclusion that are used to guide social policy and outcomes. Objective To conduct a systematic review of the literature on all current measures of social inclusion for any population group, to evaluate the quality of the psychometric properties of identified measures, and to evaluate if they capture the construct of social inclusion. Methods A systematic search was performed using five electronic databases: CINAHL, PsycINFO, Embase, ERIC and Pubmed and grey literature were sourced to identify measures of social inclusion. The psychometric properties of the social inclusion measures were evaluated against the COSMIN taxonomy of measurement properties using pre-set psychometric criteria. Results Of the 109 measures identified, twenty-five measures, involving twenty-five studies and one manual met the inclusion criteria. The overall quality of the reviewed measures was variable, with the Social and Community Opportunities Profile-Short, Social Connectedness Scale and the Social Inclusion Scale demonstrating the strongest evidence for sound psychometric quality. The most common domain included in the measures was connectedness (21), followed by participation (19); the domain of citizenship was covered by the least number of measures (10). No single instrument measured all aspects within the three domains of social inclusion. Of the measures with sound psychometric evidence, the Social and Community Opportunities Profile-Short captured the construct of social inclusion best. Conclusions The overall quality of the psychometric properties demonstrate that the current suite of available instruments for the measurement of social inclusion are promising but need further refinement. There is a need for a universal working definition of social inclusion as an overarching construct for ongoing research in the area of the psychometric properties of social inclusion instruments. PMID:28598984

The role of simulation in continuing medical education for acute care physicians: a systematic review.

PubMed

Khanduja, P Kristina; Bould, M Dylan; Naik, Viren N; Hladkowicz, Emily; Boet, Sylvain

2015-01-01

We systematically reviewed the effectiveness of simulation-based education, targeting independently practicing qualified physicians in acute care specialties. We also describe how simulation is used for performance assessment in this population. Data source included: DataMEDLINE, Embase, Cochrane Database of Systematic Reviews, Cochrane CENTRAL Database of Controlled Trials, and National Health Service Economic Evaluation Database. The last date of search was January 31, 2013. All original research describing simulation-based education for independently practicing physicians in anesthesiology, critical care, and emergency medicine was reviewed. Data analysis was performed in duplicate with further review by a third author in cases of disagreement until consensus was reached. Data extraction was focused on effectiveness according to Kirkpatrick's model. For simulation-based performance assessment, tool characteristics and sources of validity evidence were also collated. Of 39 studies identified, 30 studies focused on the effectiveness of simulation-based education and nine studies evaluated the validity of simulation-based assessment. Thirteen studies (30%) targeted the lower levels of Kirkpatrick's hierarchy with reliance on self-reporting. Simulation was unanimously described as a positive learning experience with perceived impact on clinical practice. Of the 17 remaining studies, 10 used a single group or "no intervention comparison group" design. The majority (n = 17; 44%) were able to demonstrate both immediate and sustained improvements in educational outcomes. Nine studies reported the psychometric properties of simulation-based performance assessment as their sole objective. These predominantly recruited independent practitioners as a convenience sample to establish whether the tool could discriminate between experienced and inexperienced operators and concentrated on a single aspect of validity evidence. Simulation is perceived as a positive learning experience with limited evidence to support improved learning. Future research should focus on the optimal modality and frequency of exposure, quality of assessment tools and on the impact of simulation-based education beyond the individuals toward improved patient care.

Psychometric Research in Reading.

ERIC Educational Resources Information Center

Davis, Frederick B.

This review of psychometric research in reading analyzes the factors which seem related to reading comprehension skills. Experimental analysis of reading comprehension by L. E. Thorndike revealed two major components: knowledge of word meanings and verbal reasoning abilities. Subsequent analysis of experimental studies of reading comprehension…

Psychometric properties of the Penn State Worry Questionnaire for children in a large clinical sample.

PubMed

Pestle, Sarah L; Chorpita, Bruce F; Schiffman, Jason

2008-04-01

The Penn State Worry Questionnaire for Children (PSWQ-C; Chorpita, Tracey, Brown, Collica, & Barlow, 1997) is a 14-item self-report measure of worry in children and adolescents. Although the PSWQ-C has demonstrated favorable psychometric properties in small clinical and large community samples, this study represents the first psychometric evaluation of the PSWQ-C in a large clinical sample (N = 491). Factor analysis indicated a two-factor structure, in contrast to all previously published findings on the measure. The PSWQ-C demonstrated favorable psychometric properties in this sample, including high internal consistency, high convergent validity with related constructs, and acceptable discriminative validity between diagnostic categories. The performance of the 3 reverse-scored items was closely examined, and results indicated retaining all 14 items.

Systematic review of the psychometric properties and theoretical grounding of instruments evaluating self-care in people with type 2 diabetes mellitus.

PubMed

Caro-Bautista, Jorge; Martín-Santos, Francisco Javier; Morales-Asencio, Jose Miguel

2014-06-01

To determine the psychometric properties and theoretical grounding of instruments that evaluate self-care behaviour or barriers in people with type 2 diabetes. There are many instruments designed to evaluate self-care behaviour or barriers in this population, but knowledge about their psychometric validation processes is lacking. Systematic review. We conducted a search for psychometric or validation studies published between January 1990-December 2012. We carried out searches in Pubmed, CINAHL, PsycINFO, ProQuolid, BibliPRO and Google SCHOLAR to identify instruments that evaluated self-care behaviours or barriers to diabetes self-care. We conducted a systematic review with the following inclusion criteria: Psychometric or clinimetric validation studies that included patients with type 2 diabetes (exclusively or partially) and which analysed self-care behaviour or barriers to self-care and proxies like self-efficacy or empowerment, from a multidimensional approach. Language: Spanish or English. Two authors independently assessed the quality of the studies and extracted data using Terwee's proposed criteria: psychometrics properties, dimensionality, theoretical ground and population used for validation through each included instrument. Sixteen instruments achieved the inclusion criteria for the review. We detected important methodological flaws in many of the selected instruments. Only the Self-management Profile for Type 2 Diabetes and Problem Areas in Diabetes Scale met half of Terwee's quality criteria. There are no instruments for identifying self-care behaviours or barriers elaborated with a strong validation process. Further research should be carried out to provide patients, clinicians and researchers with valid and reliable instruments that are methodologically solid and theoretically grounded. © 2013 John Wiley & Sons Ltd.

Examination of the Psychometric Properties of the Chinese Translated Behavioral Regulation in Exercise Questionnaire-2

ERIC Educational Resources Information Center

Chung, Pak Kwong; Liu, Jing Dong

2012-01-01

The present study was designed to examine the psychometric properties of the Chinese-translated Behavioral Regulation in Exercise Questionnaire-2 (Markland & Tobin, 2004). A sample of Chinese university students (N =555) was invited to take part in this study. Confirmatory factor analysis was employed to examine the factorial validity, and the…

The Reliability and Validity of a Progress-Monitoring Tool: A Psychometric Examination of the Phonological Awareness Skills of Preschoolers with ASD

ERIC Educational Resources Information Center

Martini, Jay R.

2017-01-01

The purpose of this study was to conduct a psychometric evaluation the "Sound Beginning" phonological awareness progress monitoring tool. This assessment was used to track emergent literacy skills of preschoolers with autism spectrum disorder who were participating in a randomized trial studying early literacy interventions. Research…

Convergent Validity of the Autism Spectrum Disorder-Diagnostic for Children (ASD-DC) and Childhood Autism Rating Scales (CARS)

ERIC Educational Resources Information Center

Matson, Johnny L.; Mahan, Sara; Hess, Julie A.; Fodstad, Jill C.; Neal, Daniene

2010-01-01

Previous studies analyzed the reliability as well as sensitivity and specificity of the Autism Spectrum Disorder-Diagnostic for Children (ASD-DC). This study further examines the psychometric properties of the ASD-DC by assessing whether the ASD-DC has convergent validity against a psychometrically sound observational instrument for Autistic…

Factor Structure and Psychometric Properties of the Injection Phobia Scale-Anxiety

ERIC Educational Resources Information Center

Olatunji, Bunmi O.; Sawchuk, Craig N.; Moretz, Melanie W.; David, Bieke; Armstrong, Thomas; Ciesielski, Bethany G.

2010-01-01

The present investigation examined the factor structure and psychometric properties of the Injection Phobia Scale-Anxiety (IPS-Anx). Principal components analysis of IPS-Anx items in Study 1 (n = 498) revealed a 2-factor structure consisting of Distal Fear and Contact Fear. However, CFA results in Study 2 (n = 567) suggest that a 1-factor…

An Examination of Research Collaboration in Psychometrics Utilizing Social Network Analysis Methods

ERIC Educational Resources Information Center

DiCrecchio, Nicole C.

2016-01-01

Co-authorship networks have been studied in many fields as a way to understand collaboration patterns. However, a comprehensive exploration of the psychometrics field has not been conducted. Also, few studies on co-author networks have included longitudinal analyses as well as data on the characteristics of authors in the network. Including both…

Psychometric Analysis of the Diagnostic Evaluation of Language Variation-Screening Test: Extension to Low-Income African American Pre-Kindergarteners

ERIC Educational Resources Information Center

Terry, Nicole P.; Petscher, Yaacov; Rhodes, Katherine T.

2017-01-01

The purpose of this study was to extend a previous investigation of the psychometrics of the "Diagnostic Evaluation of Language Variation-Screening Test" (DELV-S) to include pre-kindergarten children (primarily African American and from low-income households). The previous study (Petscher, Connor, & Al Otaiba, 2012) included a…

Psychometric Properties of the Caregiver Strain Questionnaire (CGSQ) among Caregivers of Children with Autism

ERIC Educational Resources Information Center

Khanna, Rahul; Madhavan, S. Suresh; Smith, Michael J.; Tworek, Cindy; Patrick, Julie H.; Becker-Cottrill, Barbara

2012-01-01

The purpose of this study was to test the psychometric properties of the Caregiver Strain Questionnaire (CGSQ) among caregivers of children with autism. The CGSQ was originally developed to assess burden experienced by parents of children and adolescents with serious emotional and behavioral disorders. Study data was collected from 304 primary…

The Psychometric Properties of the Difficult Behavior Self-Efficacy Scale

ERIC Educational Resources Information Center

Oh, Hyun-Kyoung; Kozub, Francis M.

2010-01-01

The study was designed to estimate the psychometric properties of Hastings and Brown's (2002a) Difficult Behavior Self-efficacy Scale. Participants were two samples of physical educators teaching in Korea (n = 229) and the United States (U.S.; n = 139). An initial translation of the questionnaire to Korean and pilot study were conducted along with…

Psychometric Reevaluation of Parental Press for Academic Achievement and Postsecondary Planning Scale

ERIC Educational Resources Information Center

Bates, Samantha; Ball, Annahita; Wilks, Scott

2016-01-01

Objective: Psychometric details of the Parental Press for Academic Achievement and Postsecondary Planning Scale (PPS), developed by Chicago Consortium of Chicago School Research, are scarce. The purpose of this study was to reexamine the properties of this 7-item measure. Method: The study utilized cross-sectional, self-reported data from 100…

A Critical Meta-Analysis of Lens Model Studies in Human Judgment and Decision-Making

PubMed Central

Kaufmann, Esther; Reips, Ulf-Dietrich; Wittmann, Werner W.

2013-01-01

Achieving accurate judgment (‘judgmental achievement’) is of utmost importance in daily life across multiple domains. The lens model and the lens model equation provide useful frameworks for modeling components of judgmental achievement and for creating tools to help decision makers (e.g., physicians, teachers) reach better judgments (e.g., a correct diagnosis, an accurate estimation of intelligence). Previous meta-analyses of judgment and decision-making studies have attempted to evaluate overall judgmental achievement and have provided the basis for evaluating the success of bootstrapping (i.e., replacing judges by linear models that guide decision making). However, previous meta-analyses have failed to appropriately correct for a number of study design artifacts (e.g., measurement error, dichotomization), which may have potentially biased estimations (e.g., of the variability between studies) and led to erroneous interpretations (e.g., with regards to moderator variables). In the current study we therefore conduct the first psychometric meta-analysis of judgmental achievement studies that corrects for a number of study design artifacts. We identified 31 lens model studies (N = 1,151, k = 49) that met our inclusion criteria. We evaluated overall judgmental achievement as well as whether judgmental achievement depended on decision domain (e.g., medicine, education) and/or the level of expertise (expert vs. novice). We also evaluated whether using corrected estimates affected conclusions with regards to the success of bootstrapping with psychometrically-corrected models. Further, we introduce a new psychometric trim-and-fill method to estimate the effect sizes of potentially missing studies correct psychometric meta-analyses for effects of publication bias. Comparison of the results of the psychometric meta-analysis with the results of a traditional meta-analysis (which only corrected for sampling error) indicated that artifact correction leads to a) an increase in values of the lens model components, b) reduced heterogeneity between studies, and c) increases the success of bootstrapping. We argue that psychometric meta-analysis is useful for accurately evaluating human judgment and show the success of bootstrapping. PMID:24391781

A critical meta-analysis of lens model studies in human judgment and decision-making.

PubMed

Kaufmann, Esther; Reips, Ulf-Dietrich; Wittmann, Werner W

2013-01-01

Achieving accurate judgment ('judgmental achievement') is of utmost importance in daily life across multiple domains. The lens model and the lens model equation provide useful frameworks for modeling components of judgmental achievement and for creating tools to help decision makers (e.g., physicians, teachers) reach better judgments (e.g., a correct diagnosis, an accurate estimation of intelligence). Previous meta-analyses of judgment and decision-making studies have attempted to evaluate overall judgmental achievement and have provided the basis for evaluating the success of bootstrapping (i.e., replacing judges by linear models that guide decision making). However, previous meta-analyses have failed to appropriately correct for a number of study design artifacts (e.g., measurement error, dichotomization), which may have potentially biased estimations (e.g., of the variability between studies) and led to erroneous interpretations (e.g., with regards to moderator variables). In the current study we therefore conduct the first psychometric meta-analysis of judgmental achievement studies that corrects for a number of study design artifacts. We identified 31 lens model studies (N = 1,151, k = 49) that met our inclusion criteria. We evaluated overall judgmental achievement as well as whether judgmental achievement depended on decision domain (e.g., medicine, education) and/or the level of expertise (expert vs. novice). We also evaluated whether using corrected estimates affected conclusions with regards to the success of bootstrapping with psychometrically-corrected models. Further, we introduce a new psychometric trim-and-fill method to estimate the effect sizes of potentially missing studies correct psychometric meta-analyses for effects of publication bias. Comparison of the results of the psychometric meta-analysis with the results of a traditional meta-analysis (which only corrected for sampling error) indicated that artifact correction leads to a) an increase in values of the lens model components, b) reduced heterogeneity between studies, and c) increases the success of bootstrapping. We argue that psychometric meta-analysis is useful for accurately evaluating human judgment and show the success of bootstrapping.

Measuring safety climate in health care.

PubMed

Flin, R; Burns, C; Mearns, K; Yule, S; Robertson, E M

2006-04-01

To review quantitative studies of safety climate in health care to examine the psychometric properties of the questionnaires designed to measure this construct. A systematic literature review was undertaken to study sample and questionnaire design characteristics (source, no of items, scale type), construct validity (content validity, factor structure and internal reliability, concurrent validity), within group agreement, and level of analysis. Twelve studies were examined. There was a lack of explicit theoretical underpinning for most questionnaires and some instruments did not report standard psychometric criteria. Where this information was available, several questionnaires appeared to have limitations. More consideration should be given to psychometric factors in the design of healthcare safety climate instruments, especially as these are beginning to be used in large scale surveys across healthcare organisations.

Psychometrics in action, science as practice.

PubMed

Pearce, Jacob

2017-07-27

Practitioners in health sciences education and assessment regularly use a range of psychometric techniques to analyse data, evaluate models, and make crucial progression decisions regarding student learning. However, a recent editorial entitled "Is Psychometrics Science?" highlighted some core epistemological and practical problems in psychometrics, and brought its legitimacy into question. This paper attempts to address these issues by applying some key ideas from history and philosophy of science (HPS) discourse. I present some of the conceptual developments in HPS that have bearing on the psychometrics debate. Next, by shifting the focus onto what constitutes the practice of science, I discuss psychometrics in action. Some incorrectly conceptualize science as an assemblage of truths, rather than an assemblage of tools and goals. Psychometrics, however, seems to be an assemblage of methods and techniques. Psychometrics in action represents a range of practices using specific tools in specific contexts. This does not render the practice of psychometrics meaningless or futile. Engaging in debates about whether or not we should regard psychometrics as 'scientific' is, however, a fruitless enterprise. The key question and focus should be whether, on what grounds, and in what contexts, the existing methods and techniques used by psychometricians can be justified or criticized.

Current psychometric and methodological issues in the measurement of overgeneral autobiographical memory.

PubMed

Griffith, James W; Sumner, Jennifer A; Raes, Filip; Barnhofer, Thorsten; Debeer, Elise; Hermans, Dirk

2012-12-01

Autobiographical memory is a multifaceted construct that is related to psychopathology and other difficulties in functioning. Across many studies, a variety of methods have been used to study autobiographical memory. The relationship between overgeneral autobiographical memory (OGM) and psychopathology has been of particular interest, and many studies of this cognitive phenomenon rely on the Autobiographical Memory Test (AMT) to assess it. In this paper, we examine several methodological approaches to studying autobiographical memory, and focus primarily on methodological and psychometric considerations in OGM research. We pay particular attention to what is known about the reliability, validity, and methodological variations of the AMT. The AMT has adequate psychometric properties, but there is great variability in methodology across studies that use it. Methodological recommendations and suggestions for future studies are presented. Copyright © 2011 Elsevier Ltd. All rights reserved.

Psychometric properties of the Depression Anxiety Stress Scales (DASS) in depressed clinical samples.

PubMed

Page, Andrew C; Hooke, Geoffrey R; Morrison, David L

2007-09-01

The psychometric properties of the Depression Anxiety Stress Scales (DASS; Lovibond & Lovibond, 1995a) were examined in depressed psychiatric hospital samples. Three studies administered the DASS and other symptom measures at admission and discharge to consecutive adult hospital patients with a primary diagnosis of depression. Study 3 aimed to address problems with the DASS by extending the response options. Study 1 found that the DASS had good reliability and validity, was moderately sensitive to change, but the Depression Scale exhibited a ceiling effect. In Study 2, confirmatory factor analysis supported a three-factor structure and the DASS continued to demonstrate good psychometric properties, but the ceiling effect was replicated. Study 3 found that by extending the response scale to include an additional option, the factor structure of the instrument as a whole was maintained, the sensitivity to treatment was increased, but the ceiling effect was only marginally reduced. The psychometric properties of the DASS were sound in clinically depressed samples, but the Depression Scale exhibited a ceiling effect that could not be resolved with minor changes to the scale. Suggestions for revisions of the DASS are made.

Psychometric Evaluation of the Chinese Virtues Questionnaire

ERIC Educational Resources Information Center

Duan, Wenjie; Ho, Samuel M. Y.; Bai, Yu; Tang, Xiaoqing

2013-01-01

Objectives: The present study examined the psychometric properties of the Chinese Virtues Questionnaire (CVQ). The reliability, factor structure, construct validity, and temporal stability of the inventory were examined. Method: A university student sample ("n" = 878) and a working adult sample ("n" = 153) were recruited.…

Development and Initial Psychometrics of Counseling Supervisor's Behavior Questionnaire

ERIC Educational Resources Information Center

Lee, Ahram; Park, Eun Hye; Byeon, Eunji; Lee, Sang Min

2016-01-01

This study describes the development and psychometric properties of the Counseling Supervisor's Behavior Questionnaire, designed to assess the specific behaviors of supervisors, which can be observed by supervisees during supervision sessions. Factor structure, construct and concurrent validity, and internal consistency reliability of the…

Emotional Considerations in Spasmodic Dysphonia: Psychometric Quantification.

ERIC Educational Resources Information Center

Cannito, Michael P.

1991-01-01

This study examined emotional characteristics of 18 female spasmodic dysphonic subjects in comparison to matched normal controls across psychometric measures of depression, anxiety, and somatic complaints. Statistically significant differences were noted between groups for all measures and over half of the dysphonic subjects exhibited clinically…

Validity, Reliability, and the Questionable Role of Psychometrics in Plastic Surgery

PubMed Central

2014-01-01

Summary: This report examines the meaning of validity and reliability and the role of psychometrics in plastic surgery. Study titles increasingly include the word “valid” to support the authors’ claims. Studies by other investigators may be labeled “not validated.” Validity simply refers to the ability of a device to measure what it intends to measure. Validity is not an intrinsic test property. It is a relative term most credibly assigned by the independent user. Similarly, the word “reliable” is subject to interpretation. In psychometrics, its meaning is synonymous with “reproducible.” The definitions of valid and reliable are analogous to accuracy and precision. Reliability (both the reliability of the data and the consistency of measurements) is a prerequisite for validity. Outcome measures in plastic surgery are intended to be surveys, not tests. The role of psychometric modeling in plastic surgery is unclear, and this discipline introduces difficult jargon that can discourage investigators. Standard statistical tests suffice. The unambiguous term “reproducible” is preferred when discussing data consistency. Study design and methodology are essential considerations when assessing a study’s validity. PMID:25289354

Psychometric properties evaluation of a new ergonomics-related job factors questionnaire developed for nursing workers.

PubMed

Coluci, Marina Zambon Orpinelli; Alexandre, Neusa Maria Costa

2014-11-01

The objectives of this study were to develop a questionnaire that evaluates the perception of nursing workers to job factors that may contribute to musculoskeletal symptoms, and to evaluate its psychometric properties. Internationally recommended methodology was followed: construction of domains, items and the instrument as a whole, content validity, and pre-test. Psychometric properties were evaluated among 370 nursing workers. Construct validity was analyzed by the factorial analysis, known-groups technique, and convergent validity. Reliability was assessed through internal consistency and stability. Results indicated satisfactory fit indices during confirmatory factor analysis, significant difference (p < 0.01) between the responses of nursing and office workers, and moderate correlations between the new questionnaire and Numeric Pain Scale, SF-36 and WRFQ. Cronbach's alpha was close to 0.90 and ICC values ranged from 0.64 to 0.76. Therefore, results indicated that the new questionnaire had good psychometric properties for use in studies involving nursing workers. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

A Comprehensive Examination of the Determinants for Food Risk Perception: Focusing on Psychometric Factors, Perceivers' Characteristics, and Media Use.

PubMed

You, Myoungsoon; Ju, Youngkee

2017-01-01

Risk characteristics within a psychometric paradigm have been of major concern in studies of food risk perception. This study compared the influence of psychometric factors, perceivers' characteristics (i.e., risk attitude, trust, and favorability of the country of origin), and that of the news media on the levels of food risk perception. The interaction of news media with the other two factors was also examined. A nationwide survey (n = 1,500) was conducted. The foods under investigation were Chinese processed foods and Japanese seafood imported to South Korea. In both cases, hierarchical multiple regression analyses revealed that psychometric factors had the greatest influence on food risk perception, followed by perceivers' characteristics and media use. In addition, our results showed that the effect of perceived benefit and dread in Chinese food were salient only for those with little media use. The implication of the interaction effect on food risk perception is discussed in terms of accessibility and limited capacity of information processing.

The Short Form of the Five-Factor Narcissism Inventory: Psychometric Equivalence of the Turkish Version

ERIC Educational Resources Information Center

Eksi, Füsun

2016-01-01

This study intends to examine the psychometric properties of the Turkish version of the short form of the Five-Factor Narcissism Inventory (FFNI-SF). The study group consists of a total of 526 university students (54% were female) whose ages range from 18 to 32. In the translational equivalence study made over a two-week interval, the FFNI-SF…

Subjective Well-Being of Gifted American College Students: An Examination of Psychometric Properties of the PWI-A

ERIC Educational Resources Information Center

Sayler, Micheal F.; Boazman, Janette; Natesan, Prathiba; Periathiruvadi, Sita

2015-01-01

This study examined the psychometric properties of the Personal Well-being Index for Adults (PWI-A), a measure of subjective well-being. The study used data from 533 high-ability American college students: honors students and participants in an early college entrance program. In earlier studies using the PWI-A, the instrument appeared to show…

Development and Psychometric Evaluation of the Reasons for Living-Older Adults Scale: A Suicide Risk Assessment Inventory

ERIC Educational Resources Information Center

Edelstein, Barry A.; Heisel, Marnin J.; McKee, Deborah R.; Martin, Ronald R.; Koven, Lesley P.; Duberstein, Paul R.; Britton, Peter C.

2009-01-01

Purpose: The purposes of these studies were to develop and initially evaluate the psychometric properties of the Reasons for Living Scale-Older Adult version (RFL-OA), an older adults version of a measure designed to assess reasons for living among individuals at risk for suicide. Design and Methods: Two studies are reported. Study 1 involved…

Psychometric Evaluation of the Theory of Mind Inventory (ToMI): A Study of Typically Developing Children and Children with Autism Spectrum Disorder

ERIC Educational Resources Information Center

Hutchins, Tiffany L.; Prelock, Patricia A.; Bonazinga, Laura

2012-01-01

Two studies examined the psychometric properties of the Theory of Mind Inventory (ToMI). In Study One, 135 caregivers completed the ToMI for children (ages 3 through 17) with autism spectrum disorder (ASD). Findings revealed excellent test-retest reliability and internal consistency. Principle Components Analysis revealed three subscales related…

Navigation skill impairment: Another dimension of the driving difficulties in minimal hepatic encephalopathy.

PubMed

Bajaj, Jasmohan S; Hafeezullah, Muhammad; Hoffmann, Raymond G; Varma, Rajiv R; Franco, Jose; Binion, David G; Hammeke, Thomas A; Saeian, Kia

2008-02-01

Patients with minimal hepatic encephalopathy (MHE) have attention, response inhibition, and working memory difficulties that are associated with driving impairment and high motor vehicle accident risk. Navigation is a complex system needed for safe driving that requires functioning working memory and other domains adversely affected by MHE. The aim of this study was to determine the effect of MHE on navigation skills and correlate them with psychometric impairment. Forty-nine nonalcoholic patients with cirrhosis (34 MHE+, 15 MHE-; divided on the basis of a battery of block design, digit symbol, and number connection test A) and 48 age/education-matched controls were included. All patients underwent the psychometric battery and inhibitory control test (ICT) (a test of response inhibition) and driving simulation. Driving simulation consisted of 4 parts: (1) training; (2) driving (outcome being accidents); (3) divided attention (outcome being missed tasks); and (4) navigation, driving along a marked path on a map in a "virtual city" (outcome being illegal turns). Illegal turns were significantly higher in MHE+ (median 1; P = 0.007) compared with MHE-/controls (median 0). Patients who were MHE+ missed more divided attention tasks compared with others (median MHE+ 1, MHE-/controls 0; P = 0.001). Similarly, accidents were higher in patients who were MHE+ (median 2.5; P = 0.004) compared with MHE- (median 1) or controls (median 2). Accidents and illegal turns were significantly correlated (P = 0.001, r = 0.51). ICT impairment was the test most correlated with illegal turns (r = 0.6) and accidents (r = 0.44), although impairment on the other tests were also correlated with illegal turns. Patients positive for MHE have impaired navigation skills on a driving simulator, which is correlated with impairment in response inhibition (ICT) and attention. This navigation difficulty may pose additional driving problems, compounding the pre-existing deleterious effect of attention deficits.

Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods.

PubMed

Hobart, J; Cano, S

2009-02-01

In this monograph we examine the added value of new psychometric methods (Rasch measurement and Item Response Theory) over traditional psychometric approaches by comparing and contrasting their psychometric evaluations of existing sets of rating scale data. We have concentrated on Rasch measurement rather than Item Response Theory because we believe that it is the more advantageous method for health measurement from a conceptual, theoretical and practical perspective. Our intention is to provide an authoritative document that describes the principles of Rasch measurement and the practice of Rasch analysis in a clear, detailed, non-technical form that is accurate and accessible to clinicians and researchers in health measurement. A comparison was undertaken of traditional and new psychometric methods in five large sets of rating scale data: (1) evaluation of the Rivermead Mobility Index (RMI) in data from 666 participants in the Cannabis in Multiple Sclerosis (CAMS) study; (2) evaluation of the Multiple Sclerosis Impact Scale (MSIS-29) in data from 1725 people with multiple sclerosis; (3) evaluation of test-retest reliability of MSIS-29 in data from 150 people with multiple sclerosis; (4) examination of the use of Rasch analysis to equate scales purporting to measure the same health construct in 585 people with multiple sclerosis; and (5) comparison of relative responsiveness of the Barthel Index and Functional Independence Measure in data from 1400 people undergoing neurorehabilitation. Both Rasch measurement and Item Response Theory are conceptually and theoretically superior to traditional psychometric methods. Findings from each of the five studies show that Rasch analysis is empirically superior to traditional psychometric methods for evaluating rating scales, developing rating scales, analysing rating scale data, understanding and measuring stability and change, and understanding the health constructs we seek to quantify. There is considerable added value in using Rasch analysis rather than traditional psychometric methods in health measurement. Future research directions include the need to reproduce our findings in a range of clinical populations, detailed head-to-head comparisons of Rasch analysis and Item Response Theory, and the application of Rasch analysis to clinical practice.

Development and psychometric validation of a questionnaire to evaluate nurses' adherence to recommendations for preventing pressure ulcers (QARPPU).

PubMed

Moya-Suárez, Ana Belén; Morales-Asencio, José Miguel; Aranda-Gallardo, Marta; Enríquez de Luna-Rodríguez, Margarita; Canca-Sánchez, José Carlos

2017-11-01

The main objective of this work is the development and psychometric validation of an instrument to evaluate nurses' adherence to the main recommendations issued for preventing pressure ulcers. An instrument was designed based on the main recommendations for the prevention of pressure ulcers published in various clinical practice guides. Subsequently, it was proceeded to evaluate the face and content validity of the instrument by an expert group. It has been applied to 249 Spanish nurses took part in a cross-sectional study to obtain a psychometric evaluation (reliability and construct validity) of the instrument. The study data were compiled from June 2015 to July 2016. From the results of the psychometric analysis, a final 18-item, 4-factor questionnaire was derived, which explained 60.5% of the variance and presented the following optimal indices of fit (CMIN/DF: 1.40 p < 0.001; GFI: 0.93; NFI: 0.92; CFI: 0.98; TLI: 0.97; RMSEA: 0.04 (90% CI 0.025-0.054). The results obtained show that the instrument presents suitable psychometric properties for evaluating nurses' adherence to recommendations for the prevention of pressure ulcers. Copyright © 2017 Tissue Viability Society. Published by Elsevier Ltd. All rights reserved.

On the Psychometric Study of Human Life History Strategies.

PubMed

Richardson, George B; Sanning, Blair K; Lai, Mark H C; Copping, Lee T; Hardesty, Patrick H; Kruger, Daniel J

2017-01-01

This article attends to recent discussions of validity in psychometric research on human life history strategy (LHS), provides a constructive critique of the extant literature, and describes strategies for improving construct validity. To place the psychometric study of human LHS on more solid ground, our review indicates that researchers should (a) use approaches to psychometric modeling that are consistent with their philosophies of measurement, (b) confirm the dimensionality of life history indicators, and (c) establish measurement invariance for at least a subset of indicators. Because we see confirming the dimensionality of life history indicators as the next step toward placing the psychometrics of human LHS on more solid ground, we use nationally representative data and structural equation modeling to test the structure of middle adult life history indicators. We found statistically independent mating competition and Super-K dimensions and the effects of parental harshness and childhood unpredictability on Super-K were consistent with past research. However, childhood socioeconomic status had a moderate positive effect on mating competition and no effect on Super-K, while unpredictability did not predict mating competition. We conclude that human LHS is more complex than previously suggested-there does not seem to be a single dimension of human LHS among Western adults and the effects of environmental components seem to vary between mating competition and Super-K.

Psychometric Evaluation of the Filipino Versions of the Duke University Religion Index and the Spiritual Coping Strategies Scale in Filipino Hemodialysis Patients.

PubMed

Cruz, Jonas Preposi; Reyes, Ralph Warren P; Colet, Paolo C; Estacio, Joel C; Caldeira, Sílvia; Vitorino, Luciano Magalhães; Koenig, Harold G

2017-08-01

This study evaluated the psychometric properties of the Filipino versions of the Duke University Religion Index (DUREL-F) and the Spiritual Coping Strategies scale (SCS-F) for hemodialysis (HD) patients in the Philippines. A convenient sample of 162 HD patients was included in this descriptive, cross-sectional study. The DUREL-F and SCS-F exhibited acceptable internal consistency and stability reliability, as well as excellent content and construct validity. The findings confirmed the soundness of the psychometric properties of the two scales. Thus, they can be used for timely and accurate assessment of religiosity and spiritual coping utilization among Filipino patients receiving HD.

Effects of frequency and duration on psychometric functions for detection of increments and decrements in sinusoids in noise.

PubMed

Moore, B C; Peters, R W; Glasberg, B R

1999-12-01

Psychometric functions for detecting increments or decrements in level of sinusoidal pedestals were measured for increment and decrement durations of 5, 10, 20, 50, 100, and 200 ms and for frequencies of 250, 1000, and 4000 Hz. The sinusoids were presented in background noise intended to mask spectral splatter. A three-interval, three-alternative procedure was used. The results indicated that, for increments, the detectability index d' was approximately proportional to delta I/I. For decrements, d' was approximately proportional to delta L. The slopes of the psychometric functions increased (indicating better performance) with increasing frequency for both increments and decrements. For increments, the slopes increased with increasing increment duration up to 200 ms at 250 and 1000 Hz, but at 4000 Hz they increased only up to 50 ms. For decrements, the slopes increased for durations up to 50 ms, and then remained roughly constant, for all frequencies. For a center frequency of 250 Hz, the slopes of the psychometric functions for increment detection increased with duration more rapidly than predicted by a "multiple-looks" hypothesis, i.e., more rapidly than the square root of duration, for durations up to 50 ms. For center frequencies of 1000 and 4000 Hz, the slopes increased less rapidly than predicted by a multiple-looks hypothesis, for durations greater than about 20 ms. The slopes of the psychometric functions for decrement detection increased with decrement duration at a rate slightly greater than the square root of duration, for durations up to 50 ms, at all three frequencies. For greater durations, the increase in slope was less than proportional to the square root of duration. The results were analyzed using a model incorporating a simulated auditory filter, a compressive nonlinearity, a sliding temporal integrator, and a decision device based on a template mechanism. The model took into account the effects of both the external noise and an assumed internal noise. The model was able to account for the major features of the data for both increment and decrement detection.

Measures of fidelity of delivery of, and engagement with, complex, face-to-face health behaviour change interventions: A systematic review of measure quality.

PubMed

Walton, Holly; Spector, Aimee; Tombor, Ildiko; Michie, Susan

2017-11-01

Understanding the effectiveness of complex, face-to-face health behaviour change interventions requires high-quality measures to assess fidelity of delivery and engagement. This systematic review aimed to (1) identify the types of measures used to monitor fidelity of delivery of, and engagement with, complex, face-to-face health behaviour change interventions and (2) describe the reporting of psychometric and implementation qualities. Electronic databases were searched, systematic reviews and reference lists were hand-searched, and 21 experts were contacted to identify articles. Studies that quantitatively measured fidelity of delivery of, and/or engagement with, a complex, face-to-face health behaviour change intervention for adults were included. Data on interventions, measures, and psychometric and implementation qualities were extracted and synthesized using narrative analysis. Sixty-six studies were included: 24 measured both fidelity of delivery and engagement, 20 measured fidelity of delivery, and 22 measured engagement. Measures of fidelity of delivery included observation (n = 17; 38.6%), self-report (n = 15; 34%), quantitatively rated qualitative interviews (n = 1; 2.3%), or multiple measures (n = 11; 25%). Measures of engagement included self-report (n = 18; 39.1%), intervention records (n = 11; 24%), or multiple measures (n = 17; 37%). Fifty-one studies (77%) reported at least one psychometric or implementation quality; 49 studies (74.2%) reported at least one psychometric quality, and 17 studies (25.8%) reported at least one implementation quality. Fewer than half of the reviewed studies measured both fidelity of delivery of, and engagement with complex, face-to-face health behaviour change interventions. More studies reported psychometric qualities than implementation qualities. Interpretation of intervention outcomes from fidelity of delivery and engagement measurements may be limited due to a lack of reporting of psychometric and implementation qualities. Statement of contribution What is already known on this subject? Evidence of fidelity and engagement is needed to understand effectiveness of complex interventions Evidence of fidelity and engagement are rarely reported High-quality measures are needed to measure fidelity and engagement What does this study add? Evidence that indicators of quality of measures are reported in some studies Evidence that psychometric qualities are reported more frequently than implementation qualities A recommendation for intervention evaluations to report indicators of quality of fidelity and engagement measures. © 2017 The Authors. British Journal of Health Psychology published by John Wiley & Sons Ltd on behalf of British Psychological Society.

Surgical simulation tasks challenge visual working memory and visual-spatial ability differently.

PubMed

Schlickum, Marcus; Hedman, Leif; Enochsson, Lars; Henningsohn, Lars; Kjellin, Ann; Felländer-Tsai, Li

2011-04-01

New strategies for selection and training of physicians are emerging. Previous studies have demonstrated a correlation between visual-spatial ability and visual working memory with surgical simulator performance. The aim of this study was to perform a detailed analysis on how these abilities are associated with metrics in simulator performance with different task content. The hypothesis is that the importance of visual-spatial ability and visual working memory varies with different task contents. Twenty-five medical students participated in the study that involved testing visual-spatial ability using the MRT-A test and visual working memory using the RoboMemo computer program. Subjects were also trained and tested for performance in three different surgical simulators. The scores from the psychometric tests and the performance metrics were then correlated using multivariate analysis. MRT-A score correlated significantly with the performance metrics Efficiency of screening (p = 0.006) and Total time (p = 0.01) in the GI Mentor II task and Total score (p = 0.02) in the MIST-VR simulator task. In the Uro Mentor task, both the MRT-A score and the visual working memory 3-D cube test score as presented in the RoboMemo program (p = 0.02) correlated with Total score (p = 0.004). In this study we have shown that some differences exist regarding the impact of visual abilities and task content on simulator performance. When designing future cognitive training programs and testing regimes, one might have to consider that the design must be adjusted in accordance with the specific surgical task to be trained in mind.

Measurement of sedentary behaviour in population health surveys: a review and recommendations

PubMed Central

LeBlanc, Allana G.; Colley, Rachel C.; Saunders, Travis J.

2017-01-01

Background The purpose of this review was to determine the most valid and reliable questions for targeting key modes of sedentary behaviour (SB) in a broad range of national and international health surveillance surveys. This was done by reviewing the SB modules currently used in population health surveys, as well as examining SB questionnaires that have performed well in psychometric testing. Methods Health surveillance surveys were identified via scoping review and contact with experts in the field. Previous systematic reviews provided psychometric information on pediatric questionnaires. A comprehensive search of four bibliographic databases was used to identify studies reporting psychometric information for adult questionnaires. Only surveys/studies published/used in English or French were included. Results The review identified a total of 16 pediatric and 18 adult national/international surveys assessing SB, few of which have undergone psychometric testing. Fourteen pediatric and 35 adult questionnaires with psychometric information were included. While reliability was generally good to excellent for questions targeting key modes of SB, validity was poor to moderate, and reported much less frequently. The most valid and reliable questions targeting specific modes of SB were combined to create a single questionnaire targeting key modes of SB. Discussion Our results highlight the importance of including SB questions in survey modules that are adaptable, able to assess various modes of SB, and that exhibit adequate reliability and validity. Future research could investigate the psychometric properties of the module we have proposed in this paper, as well as other questionnaires currently used in national and international population health surveys. PMID:29250468

Psychometrically Improved, Abbreviated Versions of Three Classic Measures of Impulsivity and Self-Control

PubMed Central

Morean, Meghan E.; DeMartini, Kelly S.; Leeman, Robert F.; Pearlson, Godfrey D.; Anticevic, Alan; Krishnan-Sarin, Suchitra; Krystal, John H.; O’Malley, Stephanie S.

2014-01-01

Self-reported impulsivity confers risk factor for substance abuse. However, the psychometric properties of many self-report impulsivity measures have been questioned, thereby undermining the interpretability of study findings using these measures. To better understand these measurement limitations and to suggest a path to assessing self-reported impulsivity with greater psychometric stability, we conducted a comprehensive psychometric evaluation of the Barratt Impulsiveness Scale-11 (BIS-11), the Behavioral Inhibition and Activation Scales (BIS/BAS), and the Brief Self Control Scale (BSCS) using data from 1,449 individuals who participated in substance use research. For each measure, we evaluated: 1) latent factor structure, 2) measurement invariance, 3) test-criterion relationships between the measures, and 4) test-criterion relations with drinking and smoking outcomes. Notably, we could not replicate the originally published latent structure for the BIS, BIS/BAS, or BSCS or any previously published alternative factor structures (English language). Using exploratory and confirmatory factor analysis, we identified psychometrically improved, abbreviated versions of each measure (i.e., 8-item, 2 factor BIS-11 [RMSEA = .06, CFI = .95]; 13-item, 4 factor BIS/BAS [RMSEA = .04, CFI = .96]; 7-item, 2 factor BSCS [RMSEA = .05, CFI = .96]). These versions evidenced: 1) stable, replicable factor structures, 2) scalar measurement invariance, ensuring our ability to make statistically interpretable comparisons across subgroups of interest (e.g., sex, race, drinking/smoking status), and 3) test-criterion relationships with each other and with drinking/smoking. This study provides strong support for using these psychometrically improved impulsivity measures, which improve data quality directly through better scale properties and indirectly through reducing response burden. PMID:24885848

Instruments for measuring meaningful learning in healthcare students: a systematic psychometric review.

PubMed

Cadorin, Lucia; Bagnasco, Annamaria; Tolotti, Angela; Pagnucci, Nicola; Sasso, Loredana

2016-09-01

To identify, evaluate and describe the psychometric properties of instruments that measure learning outcomes in healthcare students. Meaningful learning is an active process that enables a wider and deeper understanding of concepts. It is the result of an interaction between new and prior knowledge and produces a long-standing change in knowledge and skills. In the field of education, validated and reliable instruments for assessing meaningful learning are needed. A psychometric systematic review. MEDLINE CINAHL, SCOPUS, ERIC, Cochrane Library, Psychology & Behavioural Sciences Collection Database from 1990-December 2013. Using pre-determined inclusion criteria, three reviewers independently identified studies for full-text review. Then they extracted data for quality appraisal and graded instrument validity using the Consensus-based Standards for the selection of the health status Measurement INstruments checklist and the Psychometric Grading Framework. Of the 57 studies identified for full-text review, 16 met the inclusion criteria and 13 different instruments were assessed. Following quality assessment, only one instrument was considered of good quality but it measured meaningful learning only in part; the others were either fair or poor. The Psychometric Grading Framework indicated that one instrument was weak, while the others were very weak. No instrument displayed adequate validity. The systematic review produced a synthesis of the psychometric properties of tools that measure learning outcomes in students of healthcare disciplines. Measuring learning outcomes is very important when educating health professionals. The identified tools may constitute a starting point for the development of other assessment tools. © 2016 John Wiley & Sons Ltd.

Measurement of sedentary behaviour in population health surveys: a review and recommendations.

PubMed

Prince, Stephanie A; LeBlanc, Allana G; Colley, Rachel C; Saunders, Travis J

2017-01-01

The purpose of this review was to determine the most valid and reliable questions for targeting key modes of sedentary behaviour (SB) in a broad range of national and international health surveillance surveys. This was done by reviewing the SB modules currently used in population health surveys, as well as examining SB questionnaires that have performed well in psychometric testing. Health surveillance surveys were identified via scoping review and contact with experts in the field. Previous systematic reviews provided psychometric information on pediatric questionnaires. A comprehensive search of four bibliographic databases was used to identify studies reporting psychometric information for adult questionnaires. Only surveys/studies published/used in English or French were included. The review identified a total of 16 pediatric and 18 adult national/international surveys assessing SB, few of which have undergone psychometric testing. Fourteen pediatric and 35 adult questionnaires with psychometric information were included. While reliability was generally good to excellent for questions targeting key modes of SB, validity was poor to moderate, and reported much less frequently. The most valid and reliable questions targeting specific modes of SB were combined to create a single questionnaire targeting key modes of SB. Our results highlight the importance of including SB questions in survey modules that are adaptable, able to assess various modes of SB, and that exhibit adequate reliability and validity. Future research could investigate the psychometric properties of the module we have proposed in this paper, as well as other questionnaires currently used in national and international population health surveys.

Understanding the State of the Art for Measurement in Chemistry Education Research: Examining the Psychometric Evidence

ERIC Educational Resources Information Center

Arjoon, Janelle A.; Xu, Xiaoying; Lewis, Jennifer E.

2013-01-01

education community are relatively new. Because psychometric evidence dictates the validity of interpretations made from test scores, gathering and reporting validity and reliability evidence is of utmost importance. Therefore, the purpose of this study was to investigate what…

Internet Administration of Paper-and-Pencil Questionnaires Used in Couple Research: Assessing Psychometric Equivalence

ERIC Educational Resources Information Center

Brock, Rebecca L.; Barry, Robin A.; Lawrence, Erika; Dey, Jodi; Rolffs, Jaci

2012-01-01

This study examined the psychometric equivalence of paper-and-pencil and Internet formats of key questionnaires used in couple research. Self-report questionnaires assessing interpersonal constructs (relationship satisfaction, communication/conflict management, partner support, emotional intimacy) and intrapersonal constructs (individual traits,…

Cognitive Abilities Independent of IQ Correlate with Regional Brain Structure

ERIC Educational Resources Information Center

Johnson, Wendy; Jung, Rex E.; Colom, Roberto; Haier, Richard J.

2008-01-01

There is increasing evidence relating psychometric measures of general intelligence and reasoning to regional brain structure and function assessed with a variety of neuroimaging techniques. Cognitive dimensions independent of general intelligence can also be identified psychometrically and studied for any neuroanatomical correlates. Here we…

Development and Psychometric Properties of the Homophobic Bullying Scale

ERIC Educational Resources Information Center

Prati, Gabriele

2012-01-01

The study aimed to develop the Homophobic Bullying Scale and to investigate its psychometric properties. The items of the Homophobic Bullying Scale were created to measure high school students' bullying behaviors motivated by homophobia, including verbal bullying, relational bullying, physical bullying, property bullying, sexual harassment, and…

How mechanisms of perceptual decision-making affect the psychometric function

PubMed Central

Gold, Joshua I.; Ding, Long

2012-01-01

Psychometric functions are often interpreted in the context of Signal Detection Theory, which emphasizes a distinction between sensory processing and non-sensory decision rules in the brain. This framework has helped to relate perceptual sensitivity to the “neurometric” sensitivity of sensory-driven neural activity. However, perceptual sensitivity, as interpreted via Signal Detection Theory, is based on not just how the brain represents relevant sensory information, but also how that information is read out to form the decision variable to which the decision rule is applied. Here we discuss recent advances in our understanding of this readout process and describe its effects on the psychometric function. In particular, we show that particular aspects of the readout process can have specific, identifiable effects on the threshold, slope, upper asymptote, time dependence, and choice dependence of psychometric functions. To illustrate these points, we emphasize studies of perceptual learning that have identified changes in the readout process that can lead to changes in these aspects of the psychometric function. We also discuss methods that have been used to distinguish contributions of the sensory representation versus its readout to psychophysical performance. PMID:22609483

Standardized measures for substance use stigma.

PubMed

Brown, Seth A

2011-07-01

Despite indications that the stigma associated with substance use is high and may play a role in discouraging treatment participation, there is limited research in this area and only a few psychometrically sound measures of substance use stigma exist. The purpose of this study was to formulate and evaluate the psychometric properties of three substance use stigma measures. College students (N=565) completed three measures of substance use stigma that were modified from three established measures of mental illness stigma. Two of the three modified measures (Social Distance Scale for Substance Users and Affect Scale for Substance Users) emerged as having acceptable psychometric properties, whereas one modified measure (Dangerousness Scale for Substance Users) had inadequate psychometric properties. In regard to sex differences, women had significantly higher substance use stigma on the two psychometrically sound measures (p<.01). Perhaps, with standardized measures, there can be greater progress towards better understanding the mechanisms leading to high levels of substance use stigma and ultimately address failures to seek out treatment due to stigma. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Measurement properties of the CLOX Executive Clock Drawing Task in an inpatient stroke rehabilitation setting.

PubMed

Zuverza-Chavarria, Virginia; Tsanadis, John

2011-05-01

The goal of this study was to explore the psychometric properties of the CLOX Executive Clock Drawing Task (Royall, Cordes, & Polk, 1998) in persons who had sustained a stroke and were receiving inpatient rehabilitation. Rasch modeling was utilized to examine the psychometric properties of the CLOX. Separate analyses were conducted for the free draw (CLOX 1) and copy (CLOX 2) portions of the measure to investigate each presentation mode independently. The sample consisted of 66 inpatient adults who had sustained a stroke. CLOX 1 met most Rasch model expectations for item fit, unidimensionality, test reliability, and sample targeting. CLOX 2 was less psychometrically sound and contained two items with significant misfit. CLOX 2 demonstrated a significant ceiling effect that resulted in poor sample targeting. CLOX 1 is a psychometrically sound screening instrument for assessing persons with stroke receiving inpatient rehabilitation. In addition to the psychometric weaknesses of CLOX 2, its interpretive yield is minimal and clinicians may consider omitting it. Recommendations are made for using the Rasch item-person maps in clinical practice.

The measurement of place attachment: validity and generalizability of a psychometric approach

Treesearch

Daniel R. Williams; Jerry J. Vaske

2003-01-01

To enhance land managers’ ability to address deeper landscape meanings and place-specific symbolic values in natural resource decision making, this study evaluated the psychometric properties of a place attachment measure designed to capture the extent of emotions and feelings people have for places. Building on previous measurement efforts, this study examined the...

Psychometric Study of the Aberrant Behavior Checklist in Fragile X Syndrome and Implications for Targeted Treatment

ERIC Educational Resources Information Center

Sansone, Stephanie M.; Widaman, Keith F.; Hall, Scott S.; Reiss, Allan L.; Lightbody, Amy; Kaufmann, Walter E.; Berry-Kravis, Elizabeth; Lachiewicz, Ave; Brown, Elaine C.; Hessl, David

2012-01-01

Animal studies elucidating the neurobiology of fragile X syndrome (FXS) have led to multiple controlled trials in humans, with the Aberrant Behavior Checklist-Community (ABC-C) commonly adopted as a primary outcome measure. A multi-site collaboration examined the psychometric properties of the ABC-C in 630 individuals (ages 3-25) with FXS using…

Rasch Analysis for Psychometric Improvement of Science Attitude Rating Scales

ERIC Educational Resources Information Center

Oon, Pey-Tee; Fan, Xitao

2017-01-01

Students' attitude towards science (SAS) is often a subject of investigation in science education research. Survey of rating scale is commonly used in the study of SAS. The present study illustrates how Rasch analysis can be used to provide psychometric information of SAS rating scales. The analyses were conducted on a 20-item SAS scale used in an…

Psychometric Properties of the Liebowitz Social Anxiety Scale in a Longitudinal Study of Latinos with Anxiety Disorders

ERIC Educational Resources Information Center

Beard, Courtney; Rodriguez, Benjamin F.; Weisberg, Risa B.; Perry, Ashley; Keller, Martin B.

2012-01-01

The Liebowitz Social Anxiety Scale (LSAS) is one of the most commonly used measures of social anxiety symptoms. To date, no study has examined its psychometric properties in a Latino sample. The authors examined the reliability, temporal stability, and convergent validity of the LSAS in 73 Latinos diagnosed with an anxiety disorder. The original…

Examination of the Psychometric Properties of the Adult Manifest Anxiety Scale-Elderly Version Scores

ERIC Educational Resources Information Center

Lowe, Patricia A.; Reynolds, Cecil R.

2006-01-01

The psychometric properties of the Adult Manifest Anxiety Scale-Elderly Version (AMAS-E) scores were evaluated in two studies. In Study 1, the temporal stability and construct validity of the AMAS-E test scores were examined in a group of 226 older adults, aged 60 years and older. Results indicated adequate to excellent temporal stability (2-week…

The Adaptation of the Mathematics Anxiety Rating Scale-Elementary Form into Turkish, Language Validity, and Preliminary Psychometric Investigation

ERIC Educational Resources Information Center

Baloglu, Mustafa; Balgalmis, Esra

2010-01-01

The purpose of the present study was to adapt the Mathematics Anxiety Rating Scale- Elementary Form (MARS-E, Suinn, 1988) into Turkish by first doing the translation of its items and then the preliminary psychometric investigation of the Turkish form. The study included four different samples: 30 bilingual language experts, 50 Turkish language…

Psychometric Properties of Reverse-Scored Items on the CES-D in a Sample of Ethnically Diverse Older Adults

ERIC Educational Resources Information Center

Carlson, Mike; Wilcox, Rand; Chou, Chih-Ping; Chang, Megan; Yang, Frances; Blanchard, Jeanine; Marterella, Abbey; Kuo, Ann; Clark, Florence

2011-01-01

Reverse-scored items on assessment scales increase cognitive processing demands and may therefore lead to measurement problems for older adult respondents. In this study, the objective was to examine possible psychometric inadequacies of reverse-scored items on the Center for Epidemiologic Studies Depression Scale (CES-D) when used to assess…

The Impact of Escape Alternative Position Change in Multiple-Choice Test on the Psychometric Properties of a Test and Its Items Parameters

ERIC Educational Resources Information Center

Hamadneh, Iyad Mohammed

2015-01-01

This study aimed at investigating the impact changing of escape alternative position in multiple-choice test on the psychometric properties of a test and it's items parameters (difficulty, discrimination & guessing), and estimation of examinee ability. To achieve the study objectives, a 4-alternative multiple choice type achievement test…

Scale Development and Initial Tests of the Multidimensional Complex Adaptive Leadership Scale for School Principals: An Exploratory Mixed Method Study

ERIC Educational Resources Information Center

Özen, Hamit; Turan, Selahattin

2017-01-01

This study was designed to develop the scale of the Complex Adaptive Leadership for School Principals (CAL-SP) and examine its psychometric properties. This was an exploratory mixed method research design (ES-MMD). Both qualitative and quantitative methods were used to develop and assess psychometric properties of the questionnaire. This study…

Psychometric Properties of the Resiliency Scales for Children and Adolescents and Use for Youth with Psychiatric Disorders

ERIC Educational Resources Information Center

Prince-Embury, Sandra

2010-01-01

This study examines psychometric properties of the Resiliency Scales for Children and Adolescents (RSCA) in two clinical samples: one child sample (n = 110) and one adolescent sample (n = 178). The purpose of the study was to examine the distribution characteristics and internal consistency of RSCA scale, subscale, and index scores for youth who…

Smoking habit and psychometric scores: a community study.

PubMed

Waal-Manning, H J; de Hamel, F A

1978-09-13

During the Milton health survey subjects completed a psychometric inventory consisting of the 48 questions of the Middlesex Hospital questionnaire (MHQ) and 26 from the hostility and direction of hostility questionnaire (HDHQ) designed to examine nine psychological dimensions. The 1209 subjects were classified into smoking categories and the scores for each psychometric trait were calculated. Women scored higher than men and heavy smokers scored higher than "never smokers". The psychometric traits and the scores of the four smoking categories after correcting for age and Quetelet's index showed statistically significant differences by analysis of variance in respect of somatic anxiety and depression for both men and women; and free-floating anxiety, phobic anxiety, hysteria, acting out hostility, self criticism and guilt in women. For somatic anxiety the increase in score almost exactly paralleled the increasing quantity of tobacco consumed.

A note on contemporary psychometrics.

PubMed

Vitoratou, Silia; Pickles, Andrew

2017-12-01

Psychometrics provide the mathematical underpinnings for psychological assessment. From the late 19th century, a plethora of methodological research achievements equipped researchers and clinicians with efficient tools whose practical value becomes more evident in the era of the internet and big data. Nowadays, powerful probabilistic models exist for most types of data and research questions. As the usability of the psychometric scales is better comprehended, there is an increased interest in applied research outcomes. Paradoxically, while the interest in applications for psychometric scales increases, publishing research on the development and/or evaluation of those scales per se, is not welcomed by many relevant journals. This special issue in psychometrics is therefore a great opportunity to briefly review the main ideas and methods used in psychometrics, and to discuss the challenges in contemporary applied psychometrics.

Sensitivity and Validity of Psychometric Tests for Assessing Driving Impairment: Effects of Sleep Deprivation

PubMed Central

Jongen, Stefan; Perrier, Joy; Vuurman, Eric F.; Ramaekers, Johannes G.; Vermeeren, Annemiek

2015-01-01

Objective To assess drug induced driving impairment, initial screening is needed. However, no consensus has been reached about which initial screening tools have to be used. The present study aims to determine the ability of a battery of psychometric tests to detect performance impairing effects of clinically relevant levels of drowsiness as induced by one night of sleep deprivation. Methods Twenty four healthy volunteers participated in a 2-period crossover study in which the highway driving test was conducted twice: once after normal sleep and once after one night of sleep deprivation. The psychometric tests were conducted on 4 occasions: once after normal sleep (at 11 am) and three times during a single night of sleep deprivation (at 1 am, 5 am, and 11 am). Results On-the-road driving performance was significantly impaired after sleep deprivation, as measured by an increase in Standard Deviation of Lateral Position (SDLP) of 3.1 cm compared to performance after a normal night of sleep. At 5 am, performance in most psychometric tests showed significant impairment. As expected, largest effect sizes were found on performance in the Psychomotor Vigilance Test (PVT). Large effects sizes were also found in the Divided Attention Test (DAT), the Attention Network Test (ANT), and the test for Useful Field of View (UFOV) at 5 and 11 am during sleep deprivation. Effects of sleep deprivation on SDLP correlated significantly with performance changes in the PVT and the DAT, but not with performance changes in the UFOV. Conclusion From the psychometric tests used in this study, the PVT and DAT seem most promising for initial evaluation of drug impairment based on sensitivity and correlations with driving impairment. Further studies are needed to assess the sensitivity and validity of these psychometric tests after benchmark sedative drug use. PMID:25668292

Measuring the Jungian personality types of Hispanic high school students.

PubMed

Mittag, K C

1999-09-01

Measures of normal variations in personality, called psychological type, are frequently used in education (e.g., to identify learning styles) and counseling (e.g., in career counseling). However, the most frequently-used measure of types, developed by Myers and Briggs, has been criticized on various psychometric grounds. The present study investigated the psychometric properties of an alternative measure, the Personal Preferences Self-Description Questionnaire (PPSDQ), which employs normative rather than ipsative (forced-choice) items. Because previous studies of the measure have primarily used older and highly literate participants, the present study was conducted with 328 Hispanic high school students to determine whether the sound psychometric quality of PPSDQ scores was compromised by vocabulary or language issues. The results of reliability and factor analyses were generally favorable as regards PPSDQ score integrity.

Psychometric Assessment of the Job Embeddedness Instrument: A Rasch Perspective.

PubMed

Reitz, O Ed; Smith, Everett V

2018-05-01

The aim of this study was to examine the psychometric properties of the job embeddedness instrument (JEI) using a Rasch perspective in a sample of Registered Nurses (RNs). A secondary analysis of data was conducted from a previous study examining the job embeddedness of rural and urban RNs. A Rasch analysis supported the six underlying dimensions: organizational fit, community fit, organizational links, community links, organizational sacrifice, and community sacrifice. The results of this study also demonstrate additional evidence of the validity, reliability, and generalizability of the JEI inferences with a sample of RNs. In total, 38 of 39 items of the original JEI were retained in the model. The psychometric evaluation attained through this multidimensional Rasch analysis provided support for using the JEI to assess the level of job embeddedness for RNs.

Computerized Testing in a Hospital Setting: Psychometric and Psychological Effects.

ERIC Educational Resources Information Center

Peterson, Leif; And Others

1996-01-01

This Swedish study sought to evaluate a touch-screen computer-based (CB) test administration system in a hospital setting in comparison with paper-and-pencil administrative routine. Patients were given psychometric tests (involving depression, mood, and intelligence measurement) in both formats. Patient pleasantness, activation, and calmness were…

The Alzheimer's Disease Knowledge Scale: Development and Psychometric Properties

ERIC Educational Resources Information Center

Carpenter, Brian D.; Balsis, Steve; Otilingam, Poorni G.; Hanson, Priya K.; Gatz, Margaret

2009-01-01

Purpose: This study provides preliminary evidence for the acceptability, reliability, and validity of the new Alzheimer's Disease Knowledge Scale (ADKS), a content and psychometric update to the Alzheimer's Disease Knowledge Test. Design and Methods: Traditional scale development methods were used to generate items and evaluate their psychometric…

A Psychometric Evaluation of the Self-Presentational Efficacy Scale

ERIC Educational Resources Information Center

Lamarche, Larkin; Gammage, Kimberley L.; Sullivan, Philip J.; Gabriel, David A.

2013-01-01

This study examined the psychometric properties of the Self-Presentational Efficacy Scale (SPES) developed by Gammage, Hall, and Martin Ginis (2004). University students (196 men and 269 women) completed the SPES and measures of social physique anxiety, fear of negative evaluation, and physical activity. Participants also completed the SPES a…

School bonding in early adolescents: Psychometrics of the brief survey of school bonding

USDA-ARS?s Scientific Manuscript database

The comprehensive assessment of middle school student bonding is important for basic research and to evaluate interventions. Of over 30 tools reviewed, this study examined the psychometric properties of three that together assessed the four constructs identified by Hirschi as key elements. With some...

Item-Based Psychometrics of the Preschool Behavioral and Emotional Rating Scale

ERIC Educational Resources Information Center

Cress, Cynthia J.; Lambert, Matthew C.; Epstein, Michael H.

2014-01-01

The Preschool Behavioral and Emotional Rating Scale (PreBERS) is an assessment of emotional and behavioral strengths in preschoolers with well-established reliability and validity for educational and clinical application in children with and without disabilities. The present study provides further evidence of psychometric rigor for items and…

Psychometric Properties of the Chinese Version of the Social Communication Questionnaire

ERIC Educational Resources Information Center

Gau, Susan Shur-Fen; Lee, Chi-Mei; Lai, Meng-Chuan; Chiu, Yen-Nan; Huang, Ya-Fen; Kao, Jen-Der; Wu, Yu-Yu

2011-01-01

This study aimed to examine the psychometric properties of the Chinese version of the Social Communication Questionnaire (SCQ). We assessed 736 participants (male, 80.1%) aged 2-18, who were clinically diagnosed with autism spectrum disorders (ASD) including autistic disorder, Asperger's disorder, or pervasive developmental disorders, not…

Factor Structure and Basic Psychometric Properties of the "Transition Assessment" and "Goal Generator"

ERIC Educational Resources Information Center

Hennessey, Maeghan N.; Terry, Robert; Martin, James E.; McConnell, Amber E.; Willis, Donna M.

2017-01-01

The researchers examined the theoretical factor structure fit and psychometric properties of the Transition Assessment and Goal Generator (TAGG). In the first study, 349 transition-aged students with disabilities, their special educators, and family members completed TAGG assessments, and using exploratory factor analysis (EFA)/confirmatory factor…

Psychometrics of the Revised College Student Subjective Wellbeing Questionnaire

ERIC Educational Resources Information Center

Renshaw, Tyler L.

2018-01-01

The College Student Subjective Wellbeing Questionnaire (CSSWQ) is a 15-item self-report rating scale for measuring four classes of college-specific wellbeing behavior: academic efficacy, academic satisfaction, school connectedness, and college gratitude. The present study investigated the psychometrics of a revised version of this measure, which…

The Psychometric Properties of the Perceived Motivational Climate in Exercise Questionnaire

ERIC Educational Resources Information Center

Brown, Theresa C.; Fry, Mary D.; Little, Todd D.

2013-01-01

Given the potential benefits of understanding how climate may influence individuals' motivational outcomes, there exists a need for instrumentation measuring exercise setting climates. The purpose of this study was to validate further the psychometric properties of the Perceived Motivational Climate in Exercise Questionnaire (Huddleston, Fry &…

Assessing Protection from Suicidal Risk: Psychometric Properties of the Suicide Resilience Inventory

ERIC Educational Resources Information Center

Rutter, Philip A.; Freedenthal, Stacey; Osman, Augustine

2008-01-01

This study investigated psychometric properties of the Suicide Resilience Inventory-25 (SRI-25) in a diverse sample of 239 college students. Participants completed the SRI-25, Beck Hopelessness Scale (BHS), Suicidal Ideation Questionnaire, and the Multidimensional Scale of Perceived Social Support (MSPSS). Confirmatory factor analysis supported…

Parent Behavior Importance and Parent Behavior Frequency Questionnaires: Psychometric Characteristics

ERIC Educational Resources Information Center

Mowder, Barbara A.; Sanders, Michelle

2008-01-01

This study examined the psychometric characteristics of two parenting measures: the Parent Behavior Importance Questionnaire (PBIQ) and Parent Behavior Frequency Questionnaire (PBFQ). Both research questionnaires are based on the parent development theory (PDT) and offer parent as well as non-parent respondents the opportunity to rate 38 parenting…

Factor Structure and Basic Psychometric Properties of the "Transition Assessment and Goal Generator"

ERIC Educational Resources Information Center

Hennessey, Maeghan N.; Terry, Robert; Martin, James E.; McConnell, Amber E.; Willis, Donna M.

2018-01-01

We examined the theoretical factor structure fit and psychometric properties of the "Transition Assessment and Goal Generator" (TAGG). In the first study, 349 transition-aged students with disabilities, their special educators, and family members completed TAGG assessments, and using exploratory factor analysis (EFA)/confirmatory factor…

Psychometric Support for the Ownership in Exercise and Empowerment in Exercise Scales

ERIC Educational Resources Information Center

Moore, E. Whitney G.; Fry, Mary D.

2014-01-01

This study's purpose was to examine the psychometric properties of two new scales developed to quantitatively measure participants' ownership in exercise classes and empowerment, with respect to exercise. These two outcome measures will compliment Achievement Goal Perspective Theory (AGPT) grounded research to better understand participants'…

College Students' Perceptions of Professor/Instructor Bullying: Questionnaire Development and Psychometric Properties

ERIC Educational Resources Information Center

Marraccini, Marisa E.; Weyandt, Lisa L.; Rossi, Joseph S.

2015-01-01

Objective: This study developed and examined the psychometric properties of a newly formed measure designed to assess professor/instructor bullying, as well as teacher bullying occurring prior to college. Additionally, prevalence of instructor bullying and characteristics related to victims of instructor bullying were examined. Participants:…

Assessing the Psychometric Properties of the Achievement Goals Questionnaire across Task Contexts

ERIC Educational Resources Information Center

Muis, Krista R.; Winne, Philip H.

2012-01-01

A program of research is necessary to examine the psychometric properties of instruments designed to measure individuals' achievement goal orientations. Recently, research on achievement goal orientation has examined the stability of achievement goals to assess how context might influence individuals' achievement goals. Accordingly, studies are…

Psychometric Properties of Characteristics of Teacher Professional Development Instrument

ERIC Educational Resources Information Center

Soine, Karen M.

2011-01-01

This primary purpose of the study was to expand the work of Garet, Porter, Desimone, Birman, and Yoon (2001) by creating and psychometrically testing an instrument designed to measure teachers' perceptions of characteristics of professional development. Elementary teachers (n = 406) from five school districts in Washington State participating in a…

Measuring Violence Risk and Outcomes among Mexican American Adolescent Females

ERIC Educational Resources Information Center

Cervantes, Richard C.; Duenas, Norma; Valdez, Avelardo; Kaplan, Charles

2006-01-01

Central to the development of culturally competent violence prevention programs for Hispanic youth is the development of psychometrically sound violence risk and outcome measures for this population. A study was conducted to determine the psychometric properties of two commonly used violence measures, in this case for Mexican American adolescent…

Psychometric Properties of the Psychopathy Checklist: Youth Version Among Portuguese Juvenile Delinquents.

PubMed

Pechorro, Pedro; Barroso, Ricardo; Maroco, João; Vieira, Rui Xavier; Gonçalves, Rui Abrunhosa

2015-11-01

The main aim of the present study was to examine some psychometric properties of the Psychopathy Checklist: Youth Version (PCL:YV) among Portuguese juvenile delinquents. With forensic sample of 192 incarcerated male participants, the Portuguese version of the PCL:YV demonstrated promising psychometric properties of the three-factor model of youth psychopathy, internal consistency, convergent validity, concurrent validity, and retrospective validity that generally justify its use among Portuguese youths. Statistically significant associations were found with age of criminal onset, frequency of crimes, number of victims, and use of physical violence. © The Author(s) 2014.

Scale Refinement and Initial Evaluation of a Behavioral Health Function Measurement Tool for Work Disability Evaluation

PubMed Central

Marfeo, Elizabeth E.; Ni, Pengsheng; Bogusz, Kara; Meterko, Mark; McDonough, Christine M.; Chan, Leighton; Rasch, Elizabeth K.; Brandt, Diane E.; Jette, Alan M.

2014-01-01

Objectives To use item response theory (IRT) data simulations to construct and perform initial psychometric testing of a newly developed instrument, the Social Security Administration Behavioral Health Function (SSA-BH) instrument, that aims to assess behavioral health functioning relevant to the context of work. Design Cross-sectional survey followed by item response theory (IRT) calibration data simulations Setting Community Participants A sample of individuals applying for SSA disability benefits, claimants (N=1015), and a normative comparative sample of US adults (N=1000) Interventions None. Main Outcome Measure Social Security Administration Behavioral Health Function (SSA-BH) measurement instrument Results Item response theory analyses supported the unidimensionality of four SSA-BH scales: Mood and Emotions (35 items), Self-Efficacy (23 items), Social Interactions (6 items), and Behavioral Control (15 items). All SSA-BH scales demonstrated strong psychometric properties including reliability, accuracy, and breadth of coverage. High correlations of the simulated 5- or 10- item CATs with the full item bank indicated robust ability of the CAT approach to comprehensively characterize behavioral health function along four distinct dimensions. Conclusions Initial testing and evaluation of the SSA-BH instrument demonstrated good accuracy, reliability, and content coverage along all four scales. Behavioral function profiles of SSA claimants were generated and compared to age and sex matched norms along four scales: Mood and Emotions, Behavioral Control, Social Interactions, and Self-Efficacy. Utilizing the CAT based approach offers the ability to collect standardized, comprehensive functional information about claimants in an efficient way, which may prove useful in the context of the SSA’s work disability programs. PMID:23542404

The quality of dying and death measurement instruments: A systematic psychometric review.

PubMed

Gutiérrez Sánchez, Daniel; Pérez Cruzado, David; Cuesta-Vargas, Antonio I

2018-04-19

To identify instruments that could assess the quality of dying and death and their psychometric properties. To assess the methodological quality of studies on measurement properties. A high quality of death is regarded as a goal at the end of life and, therefore, an assessment of the end of life experience is essential. Many instruments have been developed to evaluate the quality of dying and death. The selection of the most appropriate measure to be used in clinical and research settings is crucial. Psychometric systematic review. We systematically searched ProQuest Medline, SciELO and ProQuest PsycINFO from 1970 - May 2016. Identification and evaluation of instruments that assessed quality of dying and death. Papers were evaluated by two independent reviewers according to the COSMIN checklist with a 4-point scale. A total of 19 studies were included in this review. Seven instruments were found that were specifically designed for assessing quality of dying and death. A retrospective carer proxy report to evaluate this construct was used in most of the papers. The methodological quality of the studies was fair for most of the psychometric characteristics analyzed. Many instruments have been developed to assess the quality of dying and death. The Quality of Dying and Death Questionnaire is the best available measure of the quality of dying and death. It is the only questionnaire identified in this review where all psychometric properties according to the COSMIN checklist have been evaluated. © 2018 John Wiley & Sons Ltd.

Visuo-spatial ability in colonoscopy simulator training.

PubMed

Luursema, Jan-Maarten; Buzink, Sonja N; Verwey, Willem B; Jakimowicz, J J

2010-12-01

Visuo-spatial ability is associated with a quality of performance in a variety of surgical and medical skills. However, visuo-spatial ability is typically assessed using Visualization tests only, which led to an incomplete understanding of the involvement of visuo-spatial ability in these skills. To remedy this situation, the current study investigated the role of a broad range of visuo-spatial factors in colonoscopy simulator training. Fifteen medical trainees (no clinical experience in colonoscopy) participated in two psycho-metric test sessions to assess four visuo-spatial ability factors. Next, participants trained flexible endoscope manipulation, and navigation to the cecum on the GI Mentor II simulator, for four sessions within 1 week. Visualization, and to a lesser degree Spatial relations were the only visuo-spatial ability factors to correlate with colonoscopy simulator performance. Visualization additionally covaried with learning rate for time on task on both simulator tasks. High Visualization ability indicated faster exercise completion. Similar to other endoscopic procedures, performance in colonoscopy is positively associated with Visualization, a visuo-spatial ability factor characterized by the ability to mentally manipulate complex visuo-spatial stimuli. The complexity of the visuo-spatial mental transformations required to successfully perform colonoscopy is likely responsible for the challenging nature of this technique, and should inform training- and assessment design. Long term training studies, as well as studies investigating the nature of visuo-spatial complexity in this domain are needed to better understand the role of visuo-spatial ability in colonoscopy, and other endoscopic techniques.

Effects of prolonged wakefulness combined with alcohol and hands-free cell phone divided attention tasks on simulated driving.

PubMed

Iudice, A; Bonanni, E; Gelli, A; Frittelli, C; Iudice, G; Cignoni, F; Ghicopulos, I; Murri, L

2005-03-01

Simulated driving ability was assessed following administration of alcohol, at an estimated blood level of 0.05%, and combined prolonged wakefulness, while participants were undertaking divided attention tasks over a hands-free mobile phone. Divided attention tasks were structured to provide a sustained cognitive workload to the subjects. Twenty three young healthy individuals drove 10 km simulated driving under four conditions in a counterbalanced, within-subject design: alcohol, alcohol and 19 h wakefulness, alcohol and 24 h wakefulness, and while sober. Study measures were: simulated driving, self-reported sleepiness, critical flicker fusion threshold (CFFT), Stroop word-colour interference test (Stroop) and simple visual reaction times (SVRT). As expected, subjective sleepiness was highly correlated with both sleep restriction and alcohol consumption. The combination of alcohol and 24 h sustained wakefulness produced the highest driving impairment, significantly beyond the alcohol effect itself. Concurrent alcohol and 19 h wakefulness significantly affected only driving time-to-collision. No significant changes of study measures occurred following alcohol intake in unrestricted sleep conditions. CFFT, SVRT and Stroop results showed a similar trend in the four study conditions. Thus apparently 'safe' blood alcohol levels in combination with prolonged wakefulness resulted in significant driving impairments. In normal sleep conditions alcohol effects on driving were partially counteracted by the concomitant hands-free phone based psychometric tasks. 2005 John Wiley & Sons, Ltd.

Examination of personality characteristics in a Turkish sample: development of Basic Personality Traits Inventory.

PubMed

Gençöz, Tülin; Öcül, Öznur

2012-01-01

The aim of the present study was to test the cross-cultural validity of the five-factor nature of personality. For this aim, an indigenous, psychometrically strong instrument measuring the basic personality dimensions within Turkish culture and language was developed through three consecutive studies. The first study aimed to reveal the adjectives that have been most frequently used to define people in the Turkish culture. In the second study, factor analysis of these personality characteristics revealed big five personality factors, along with the sixth factor, which had been called as the Negative Valence factor. The adjectives that most strongly represented and differentiated each factor constituted 45-item "Basic Personality Traits Inventory". Finally, in the third study, psychometric characteristics of the Basic Personality Traits Inventory were examined. Factor structure and psychometric properties of this instrument confirmed that five-factor nature of personality may not hold true in every culture.

Development and Psychometric Evaluation of the Reasons for Living—Older Adults Scale: A Suicide Risk Assessment Inventory

PubMed Central

Edelstein, Barry A.; Heisel, Marnin J.; McKee, Deborah R.; Martin, Ronald R.; Koven, Lesley P.; Duberstein, Paul R.; Britton, Peter C.

2009-01-01

Purpose: The purposes of these studies were to develop and initially evaluate the psychometric properties of the Reasons for Living Scale—Older Adult version (RFL-OA), an older adults version of a measure designed to assess reasons for living among individuals at risk for suicide. Design and Methods: Two studies are reported. Study 1 involved instrument development with 106 community-dwelling older adults, and initial psychometric evaluation with a second sample of 119 community-dwelling older adults. Study 2 evaluated the psychometric properties of the RFL-OA in a clinical sample. One hundred eighty-one mental health patients 50 years or older completed the RFL-OA and measures of depression, suicide ideation at the current time and at the worst point in one's life, and current mental status and physical functioning. Results: Strong psychometric properties were demonstrated for the RFL-OA, with high internal consistency (Cronbach's alpha coefficient). Convergent validity was evidenced by negative associations among RFL-OA scores and measures of depression and suicide ideation. RFL-OA scores predicted current and worst-episode suicide ideation above and beyond current depression. Discriminant validity was evidenced with measures of current mental status and physical functioning. Criterion-related validity was also demonstrated with respect to lifetime history of suicidal behavior. Implications: These findings provide preliminary support for the validity and reliability of the RFL-OA. The findings also support the potential value of attending to reasons for living during clinical treatment with depressed older adults and others at risk for suicide. PMID:19546114

Modern psychometrics for assessing achievement goal orientation: a Rasch analysis.

PubMed

Muis, Krista R; Winne, Philip H; Edwards, Ordene V

2009-09-01

A program of research is needed that assesses the psychometric properties of instruments designed to quantify students' achievement goal orientations to clarify inconsistencies across previous studies and to provide a stronger basis for future research. We conducted traditional psychometric and modern Rasch-model analyses of the Achievement Goals Questionnaire (AGQ, Elliot & McGregor, 2001) and the Patterns of Adaptive Learning Scale (PALS, Midgley et al., 2000) to provide an in-depth analysis of the two most popular instruments in educational psychology. For Study 1, 217 undergraduate students enrolled in educational psychology courses participated. Thirty-four were male and 181 were female (two did not respond). Participants completed the AGQ in the context of their educational psychology class. For Study 2, 126 undergraduate students enrolled in educational psychology courses participated. Thirty were male and 95 were female (one did not respond). Participants completed the PALS in the context of their educational psychology class. Traditional psychometric assessments of the AGQ and PALS replicated previous studies. For both, reliability estimates ranged from good to very good for raw subscale scores and fit for the models of goal orientations were good. Based on traditional psychometrics, the AGQ and PALS are valid and reliable indicators of achievement goals. Rasch analyses revealed that estimates of reliability for items were very good but respondent ability estimates varied from poor to good for both the AGQ and PALS. These findings indicate that items validly and reliably reflect a group's aggregate goal orientation, but using either instrument to characterize an individual's goal orientation is hazardous.

Psychometrics of Multiple Choice Questions with Non-Functioning Distracters: Implications to Medical Education.

PubMed

Deepak, Kishore K; Al-Umran, Khalid Umran; AI-Sheikh, Mona H; Dkoli, B V; Al-Rubaish, Abdullah

2015-01-01

The functionality of distracters in a multiple choice question plays a very important role. We examined the frequency and impact of functioning and non-functioning distracters on psychometric properties of 5-option items in clinical disciplines. We analyzed item statistics of 1115 multiple choice questions from 15 summative assessments of undergraduate medical students and classified the items into five groups by their number of non-functioning distracters. We analyzed the effect of varying degree of non-functionality ranging from 0 to 4, on test reliability, difficulty index, discrimination index and point biserial correlation. The non-functionality of distracters inversely affected the test reliability and quality of items in a predictable manner. The non-functioning distracters made the items easier and lowered the discrimination index significantly. Three non-functional distracters in a 5-option MCQ significantly affected all psychometric properties (p < 0.5). The corrected point biserial correlation revealed that the items with 3 functional options were psychometrically as effective as 5-option items. Our study reveals that a multiple choice question with 3 functional options provides lower most limit of item format that has adequate psychometric property. The test containing items with less number of functioning options have significantly lower reliability. The distracter function analysis and revision of nonfunctioning distracters can serve as important methods to improve the psychometrics and reliability of assessment.

Health impacts of large releases of radionuclides. Mental health, stress and risk perception: insights from psychological research.

PubMed

Renn, O

1997-01-01

Risk perceptions are only slightly correlated with the expected values of a probability distribution for negative health impacts. Psychometric studies have documented that context variables such as dread or personal control are important predictors for the perceived seriousness of risk. Studies about cultural patterns of risk perceptions emphasize different response sets to risk information, depending on cultural priorities such as social justice versus personal freedom. This chapter reports the major psychological research results pertaining to the factors that govern individual risk perception and discusses the psychometric effects due to people's risk perception and the experience of severe stress. The relative importance of the psychometric context variables, the signals pertaining to each health risks and symbolic beliefs are explained.

Psychometric Properties of the Positive and Negative Affect Scale for Children (PANAS-C) in Children with Anxiety Disorders

ERIC Educational Resources Information Center

Hughes, Alicia A.; Kendall, Philip C.

2009-01-01

This study investigated the psychometric properties of the Positive and Negative Affect Scale for Children (PANAS-C) (Laurent et al. Psychol Asses 1: 326-338, 1999) in a sample of 139 children (ages 7-14 years) diagnosed with a principal anxiety disorder. Results from this study provided support for the convergent validity of the PANAS-C with…

Validity and Reliability of a Parental Self-Efficacy Instrument in the Healthy School Start Prevention Trial of Childhood Obesity

ERIC Educational Resources Information Center

Bohman, Benjamin; Nyberg, Gisela; Sundblom, Elinor; Schäfer Elinder, Liselotte

2014-01-01

Introduction: Measures of parental self-efficacy (PSE) for healthy dietary or physical activity (PA) behaviors in children have been used in several studies; however, further psychometric validation of PSE for these behaviors is needed. The purpose of the present study was to evaluate the psychometric properties of a new PSE instrument. Methods:…

Psychometric Evaluation of the Social Problem-Solving Inventory-Revised among Overweight or Obese Adults

ERIC Educational Resources Information Center

Wang, Jing; Matthews, Judith T.; Sereika, Susan M.; Chasens, Eileen R.; Ewing, Linda J.; Burke, Lora E.

2013-01-01

Problem solving is a key component of weight loss programs. The Social Problem Solving Inventory-Revised (SPSI-R) has not been evaluated in weight loss studies. The purpose of this study was to evaluate the psychometrics of the SPSI-R. Cronbach's a (0.95 for total score; 0.67-0.92 for subscales) confirmed internal consistency reliability. The…

The Measurement of Executive Function at Age 3 Years: Psychometric Properties and Criterion Validity of a New Battery of Tasks

ERIC Educational Resources Information Center

Willoughby, Michael T.; Blair, Clancy B.; Wirth, R. J.; Greenberg, Mark

2010-01-01

In this study, the authors examined the psychometric properties and criterion validity of a newly developed battery of tasks that were designed to assess executive function (EF) abilities in early childhood. The battery was included in the 36-month assessment of the Family Life Project (FLP), a prospective longitudinal study of 1,292 children…

Psychometric Evaluation of Three Psychosocial Measures Associated with Physical Activity among Adolescent Girls

ERIC Educational Resources Information Center

Ling, Jiying; Robbins, Lorraine B.

2017-01-01

The purpose of this study was to evaluate the psychometric properties of a Perceived Benefits Scale, a Perceived Barriers Scale, and a Physical Activity Enjoyment Scale with data from a group randomized controlled trial (RCT) and a test-retest study with 1-week interval. In the group RCT at baseline and Week 17, 1,012 fifth- to eighth-grade girls…

Translation, adaptation and validation of the Coronary Revascularization Outcome Questionnaire into Greek.

PubMed

Takousi, Maria G; Schmeer, Stefanie; Manaras, Irene; Olympios, Christoforos D; Fakiolas, Constantine N; Makos, Georgios; Troop, Nick A

2016-04-01

Evaluating the impact of coronary revascularization on patients' health related quality of life with a patient-based and disease-specific tool is important for drawing conclusions about treatment and outcomes. This study reports on the translation, adaptation and psychometric evaluation of a Greek version of the Coronary Revascularization Outcome Questionnaire (CROQ-Gr). A total of 609 (81.7% male) patients who had undergone coronary revascularization (percutaneous coronary intervention or coronary artery bypass grafting) were recruited from four hospitals in Athens. After translating the CROQ into Greek, a preliminary qualitative study and a pilot quantitative study were conducted. A full psychometric evaluation was carried out on the main study's data. The psychometric evaluation demonstrated that the CROQ-Gr is acceptable to patients (high response rate, low missing data) and has a good level of reliability (internal consistency >0.70, test-retest reliability >0.90) and validity (both content and construct validity). The results of this study show the CROQ-Gr to be a psychometrically rigorous patient-based measure of outcomes of coronary revascularization. It would be appropriate for use in evaluative research as well as a routine clinical tool to aid cardiologists in monitoring the outcomes of care. © The European Society of Cardiology 2015.

Factorial structure and psychometric properties of a brief version of the Reminiscence Functions Scale with Chinese older adults.

PubMed

Lou, Vivian W Q; Choy, Jacky C P

2014-05-01

The current study aims to examine the factorial structure and psychometric properties of a brief version of the Reminiscence Functions Scale (RFS), a 14-item assessment tool of reminiscence functions, with Chinese older adults. The scale, covering four reminiscence functions (boredom reduction, bitterness revival, problem solving, and identity) was translated from English into Chinese and administered to older adults (N=675). Confirmatory factor analysis and hierarchical confirmatory factor analysis were conducted to examine its factorial structure, and its psychometric properties and criterion validity were examined. Confirmatory factor analysis supports a second-order model comprising one second-order factor and four first-order factors of RFS. The Cronbach's alpha of the subscales ranged from 0.75 to 0.90. The brief RFS contains a second-order factorial structure. Its psychometric properties support it as a sound instrument for measuring reminiscence functions among Chinese older adults.

Measuring students' perceptions of plagiarism: modification and Rasch validation of a plagiarism attitude scale.

PubMed

Howard, Steven J; Ehrich, John F; Walton, Russell

2014-01-01

Plagiarism is a significant area of concern in higher education, given university students' high self-reported rates of plagiarism. However, research remains inconsistent in prevalence estimates and suggested precursors of plagiarism. This may be a function of the unclear psychometric properties of the measurement tools adopted. To investigate this, we modified an existing plagiarism scale (to broaden its scope), established its psychometric properties using traditional (EFA, Cronbach's alpha) and modern (Rasch analysis) survey evaluation approaches, and examined results of well-functioning items. Results indicated that traditional and modern psychometric approaches differed in their recommendations. Further, responses indicated that although most respondents acknowledged the seriousness of plagiarism, these attitudes were neither unanimous nor consistent across the range of issues assessed. This study thus provides rigorous psychometric testing of a plagiarism attitude scale and baseline data from which to begin a discussion of contextual, personal, and external factors that influence students' plagiarism attitudes.

Psychometric evaluation of the Revised Professional Practice Environment (RPPE) scale.

PubMed

Erickson, Jeanette Ives; Duffy, Mary E; Ditomassi, Marianne; Jones, Dorothy

2009-05-01

The purpose was to examine the psychometric properties of the Revised Professional Practice Environment (RPPE) scale. Despite renewed focus on studying health professionals' practice environments, there are still few reliable and valid instruments available to assist nurse administrators in decision making. A psychometric evaluation using a random-sample cross-validation procedure (calibration sample [CS], n = 775; validation sample [VS], n = 775) was undertaken. Cronbach alpha internal consistency reliability of the total score (r = 0.93 [CS] and 0.92 [VS]), resulting subscale scores (r range: 0.80-0.87 [CS], 0.81-0.88 [VS]), and principal components analyses with Varimax rotation and Kaiser normalization (8 components, 59.2% variance [CS], 59.7% [VS]) produced almost identical results in both samples. The multidimensional RPPE is a psychometrically sound measure of 8 components of the professional practice environment in the acute care setting and sufficiently reliable and valid for use as independent subscales in healthcare research.

An evaluation of the HM prison service "thinking skills programme" using psychometric assessments.

PubMed

Gobbett, Matthew J; Sellen, Joselyn L

2014-04-01

The most widely implemented offending behaviour programme in the United Kingdom was Enhanced Thinking Skills (ETS), a cognitive-behavioural group intervention that aimed to develop participant's general cognitive skills. A new offending behaviour programme has been developed to replace ETS: the Thinking Skills Programme (TSP). This study reports an evaluation of the effectiveness of TSP using psychometric assessments. Phasing of the two programmes created an opportunity to compare the two programmes consecutively. Forty participants, 20 from each programme, completed a range of psychometric measures to examine cognition, attitudes, and thinking styles. Analysis of pre- and post-programme psychometric results indicated that participants of TSP demonstrated improvements on 14 of the 15 scales, 9 of which were statistically significant. Effect sizes between pre-post results were generally greater for TSP than ETS, demonstrating that TSP had a more positive impact on the thinking styles and attitudes of participants than the ETS programme.

Development of a Computerized Adaptive Test for Anxiety Based on the Dutch-Flemish Version of the PROMIS Item Bank.

PubMed

Flens, Gerard; Smits, Niels; Terwee, Caroline B; Dekker, Joost; Huijbrechts, Irma; Spinhoven, Philip; de Beurs, Edwin

2017-12-01

We used the Dutch-Flemish version of the USA PROMIS adult V1.0 item bank for Anxiety as input for developing a computerized adaptive test (CAT) to measure the entire latent anxiety continuum. First, psychometric analysis of a combined clinical and general population sample ( N = 2,010) showed that the 29-item bank has psychometric properties that are required for a CAT administration. Second, a post hoc CAT simulation showed efficient and highly precise measurement, with an average number of 8.64 items for the clinical sample, and 9.48 items for the general population sample. Furthermore, the accuracy of our CAT version was highly similar to that of the full item bank administration, both in final score estimates and in distinguishing clinical subjects from persons without a mental health disorder. We discuss the future directions and limitations of CAT development with the Dutch-Flemish version of the PROMIS Anxiety item bank.

Item-level psychometrics of the ADL instrument of the Korean National Survey on persons with physical disabilities.

PubMed

Hong, Ickpyo; Lee, Mi Jung; Kim, Moon Young; Park, Hae Yean

2017-10-01

The aim of this study is to investigate the psychometrics of the 12 items of an instrument assessing activities of daily living (ADL) using an item response theory model. A total of 648 adults with physical disabilities and having difficulties in ADLs were retrieved from the 2014 Korean National Survey on People with Disabilities. The psychometric testing included factor analysis, internal consistency, precision, and differential item functioning (DIF) across categories including sex, older age, marital status, and physical impairment area. The sample had a mean age of 69.7 years old (SD = 13.7). The majority of the sample had lower extremity impairments (62.0%) and had at least 2.1 chronic conditions. The instrument demonstrated unidimensional construct and good internal consistency (Cronbach's alpha = 0.95). The instrument precisely estimated person measures within a wide range of theta values (-2.22 logits < θ < 0.27 logits) with a reliability of 0.9. Only the changing position item demonstrated misfit (χ 2  = 36.6, df = 17, p = 0.0038), and the dressing item demonstrated DIF on the impairment type (upper extremity/others, McFadden's Pseudo R 2  > 5.0%). Our findings indicate that the dressing item would need to be modified to improve its psychometrics. Overall, the ADL instrument demonstrates good psychometrics, and thus, it may be used as a standardized instrument for measuring disability in rehabilitation contexts. However, the findings are limited to adults with physical disabilities. Future studies should replicate psychometric testing for survey respondents with other disorders and for children.

An evaluation of psychometric properties of caregiver burden outcome measures used in caregivers of children with cerebral palsy: a systematic review protocol.

PubMed

Dambi, Jermaine M; Jelsma, Jennifer; Mlambo, Tecla; Chiwaridzo, Matthew; Dangarembizi-Munambah, Nyaradzai; Corten, Lieselotte

2016-03-09

Cerebral palsy (CP) is the most common, life-long paediatric disability. Taking care of a child with CP often results in caregiver burden/strain in the long run. As caregivers play an essential role in the rehabilitation of these children, it is therefore important to routinely screen for health outcomes in informal caregivers. Consequently, a plethora of caregiver burden outcome measures have been developed; however, there is a dearth of evidence of the most psychometrically sound tools. Therefore, the broad objective of this systematic review is to evaluate the psychometrical properties and clinical utility of tools used to measure caregiver burden in caregivers of children with CP. This is a systematic review for the evaluation of the psychometric properties of caregiver burden outcome tools. Two independent and blinded reviewers will search articles on PubMed, Scopus, Web of Science, CINAHL, PsychINFO and Africa-Wide Google Scholar. Information will be analysed using predefined criteria. Thereafter, three independent reviewers will then screen the retrieved articles. The methodological quality of studies on the development and validation of the identified tools will be evaluated using the four point COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Finally, the psychometric properties of the tools which were developed and validated from methodological sound studies will then be analysed using predefined criteria. The proposed systematic review will give an extensive review of the psychometrical properties of tools used to measure caregiver burden in caregivers of children with CP. We hope to identify tools that can be used to accurately screen for caregiver burden both in clinical setting and for research purposes. PROSPERO CRD42015028026.

The development and psychometrical evaluation of a set of instruments to evaluate the effectiveness of diabetes patient education.

PubMed

Duprez, Veerle; De Pover, Marleen; De Spiegelaere, Marc; Beeckman, Dimitri

2014-02-01

To develop a set of psychometrically sound instruments to assess knowledge, self-management and self-efficacy of diabetic patients. Furthermore, a survey to evaluate the satisfaction about diabetes education for patients was developed and tested. Treatment and secondary prevention of diabetes require a complex combination of care components. Patients' education has been accepted to improve diabetes knowledge, self-management and self-efficacy. Psychometrically sound instruments are needed to measure these patient-centred outcomes. Psychometric instrument validation. The first phase included a systematic literature review to develop the instruments. Content validity was evaluated using a two-round Delphi procedure involving diabetes experts. The content validity of the instruments was excellent. In a second phase, a convenience sample of 188 diabetic patients in two hospitals in one specific care region in Belgium participated in the psychometric evaluation. The criterion-related validity and internal consistency reliability were evaluated. The study produced a 21-item knowledge instrument, reflecting knowledge about 'glycemic control' and 'medico-social management aspects'. The self-management instrument included 32 statements, reflecting 'treatment and compliance' and 'general lifestyle'. The self-efficacy instrument included 30 items, reflecting 'nutrition', 'treatment' and 'regimen'. The patient satisfaction survey included 36 items, reflecting satisfaction about the relationship among the diabetes specialist, the diabetes educator, podiatrist and dietician. An instrument set with sound psychometric characteristics was developed to assess knowledge, self-management and self-efficacy of diabetic patients. Future studies should focus on the association between the instrument outcomes and clinical patient outcomes. The current instrument can support the design of educational interventions and training programmes and reduce inconsistencies in the information that patients receive. Furthermore, the instruments can be used for benchmarking the quality of diabetic patient education. © 2013 Blackwell Publishing Ltd.

Cross-Cultural Comparison of a French Canadian and U.S. Developmental Screening Test

ERIC Educational Resources Information Center

Dionne, Carmen; Squires, Jane; Leclerc, Danielle; Peloquin, Josianne; McKinnon, Suzie

2006-01-01

The psychometric properties of the Ages & Stages Questionnaires (ASQ) (Bricker & Squires, 1999) used in a French-Canadian preschool population were compared with psychometric data derived from U.S. normative studies. The ASQ was translated into French (Bonin, Robaey, Vandaele, Bastin, & Lacroix, 2000) and used in four early childhood…

Classroom Community Scale in the Blended Learning Environment: A Psychometric Review

ERIC Educational Resources Information Center

Barnard-Brak, Lucy; Shiu, William

2010-01-01

The Classroom Community Scale (CCS) has been utilized in previous research to measure sense of community of learners including those learners in blended learning environments. In the current study, the CCS was examined with respect to its psychometric properties in the blended learning environment. Reliability analyses indicate an acceptable level…

Psychometric Consequences of Subpopulation Item Parameter Drift

ERIC Educational Resources Information Center

Huggins-Manley, Anne Corinne

2017-01-01

This study defines subpopulation item parameter drift (SIPD) as a change in item parameters over time that is dependent on subpopulations of examinees, and hypothesizes that the presence of SIPD in anchor items is associated with bias and/or lack of invariance in three psychometric outcomes. Results show that SIPD in anchor items is associated…

Psychometric Support for a New Measure of Authoritative, Authoritarian, and Permissive Parenting Practices: Cross-Cultural Connections.

ERIC Educational Resources Information Center

Robinson, Clyde C.; And Others

This study examined the psychometric characteristics of a 62-item parenting questionnaire completed by parents from the United States, Australia, China, and Russia. Factor analyses yielded three global parenting dimensions for each culture which were consistent with D. Baumrind's (1971) authoritative, authoritarian, and permissive typologies. The…

Adaptation and Psychometric Evaluation of a Resilience Measure in Greek Elementary School Students

ERIC Educational Resources Information Center

Nearchou, Finiki A.; Stogiannidou, Ariadni; Kiosseoglou, Grigoris

2014-01-01

This study aimed to adapt the Resilience Youth Development Module (RYDM) and assess its psychometric properties in terms of internal consistency and convergent validity in Greek elementary students. Participants (N = 346) completed a battery of self-report questionnaires, including the RYDM, School Connectedness Scale, and Strengths and…

Finding Pearls: Psychometric Reevaluation of the Simpson-Troost Attitude Questionnaire (STAQ)

ERIC Educational Resources Information Center

Owen, Steven V.; Toepperwein, Mary Anne; Marshall, Carolyn E.; Lichtenstein, Michael J.; Blalock, Cheryl L.; Liu, Yan; Pruski, Linda A.; Grimes, Kandi

2008-01-01

The Simpson-Troost Attitude Questionnaire (STAQ) was developed as part of a study to assess adolescent commitment to and achievement in science. For this psychometric reappraisal of the 57-item STAQ, data were analyzed from a convenience sample of 1,754 secondary students. Confirmatory and exploratory factor analyses were applied, and results…

A Psychometric Evaluation of the Anatomy Learning Experiences Questionnaire and Correlations with Learning Outcomes

ERIC Educational Resources Information Center

Choi-Lundberg, Derek L.; Williams, Anne-Marie M.; Zimitat, Craig

2017-01-01

The Anatomy Learning Experiences Questionnaire (ALEQ) was designed by Smith and Mathias to explore students' perceptions and experiences of learning anatomy. In this study, the psychometric properties of a slightly altered 34-item ALEQ (ALEQ-34) were evaluated, and correlations with learning outcomes investigated, by surveying first- and…

Measuring Gratitude in Youth: Assessing the Psychometric Properties of Adult Gratitude Scales in Children and Adolescents

ERIC Educational Resources Information Center

Froh, Jeffrey J.; Fan, Jinyan; Emmons, Robert A.; Bono, Giacomo; Huebner, E. Scott; Watkins, Philip

2011-01-01

Before the developmental trajectory, outcomes, and related interventions of gratitude can be accurately and confidently studied among the youth, researchers must ensure that they have psychometrically sound measures of gratitude that are suitable for this population. Thus, considering that no known scales were specifically designed to measure…

Psychometric Properties of the Schedule for Nonadaptive and Adaptive Personality in a PTSD Sample

ERIC Educational Resources Information Center

Wolf, Erika J.; Harrington, Kelly M.; Miller, Mark W.

2011-01-01

This study evaluated the psychometric characteristics of the Schedule for Nonadaptive and Adaptive Personality (SNAP; Clark, 1996) in 280 individuals who screened positive for posttraumatic stress disorder (PTSD). The SNAP validity, trait, temperament, and personality disorder (PD) scales were compared with scales on the Brief Form of the…

Psychometric Evaluation of the Exercise Identity Scale among Greek Adults and Cross-Cultural Validity

ERIC Educational Resources Information Center

Vlachopoulos, Symeon P.; Kaperoni, Maria; Moustaka, Frederiki C.; Anderson, Dean F.

2008-01-01

The present study reported on translating the Exercise Identity Scale (EIS: Anderson & Cychosz, 1994) into Greek and examining its psychometric properties and cross-cultural validity based on U.S. individuals' EIS responses. Using four samples comprising 33, 103, and 647 Greek individuals, including exercisers and nonexercisers, and a similar…

Attitudes toward Violence Scale: Psychometric Properties with a High School Sample

ERIC Educational Resources Information Center

Davidson, M. Meghan; Canivez, Gary L.

2012-01-01

Youth violence represents a serious problem affecting individuals, communities, and the larger society. Greater efforts aimed at the eradication of youth violence are necessary, and work in this field could be enhanced by psychometrically strong measures. The present study examined the factor structure of the Attitudes Toward Violence Scale (ATV)…

The Development and Psychometric Properties of the Selective Mutism Questionnaire

ERIC Educational Resources Information Center

Bergman, R. Lindsey; Keller, Melody L.; Piacentini, John; Bergman, Andrea J.

2008-01-01

Research on selective mutism (SM) has been limited by the absence of standardized, psychometrically sound assessment measures. The purpose of our investigation was to present two studies that examined the factor structure and initial reliability and validity of the Selective Mutism Questionnaire (SMQ), a 17-item parent report measure of failure to…

Psychometrics and Validation of a Brief Rating Measure of Parent-Infant Interaction: Manchester Assessment of Caregiver-Infant Interaction

ERIC Educational Resources Information Center

Wan, Ming Wai; Brooks, Ami; Green, Jonathan; Abel, Kathryn; Elmadih, Alya

2017-01-01

This study investigated the psychometrics of a recently developed global rating measure of videotaped parent-infant interaction, the "Manchester Assessment of Caregiver-Infant Interaction" (MACI), in a normative sample. Inter-rater reliability, stability over time, and convergent and discriminant validity were tested. Six-minute play…

The Psychometric Properties of the Swedish Version of the EB Process Assessment Scale

ERIC Educational Resources Information Center

Nyström, Siv; Åhsberg, Elizabeth

2016-01-01

Objective: This study examines whether the psychometric properties of the short version of the Evidence-Based Practice Process Assessment Scale (EBPPAS) remain satisfactory when translated and transferred to the context of Swedish welfare services. Method: The Swedish version of EBPPAS was tested on a sample of community-based professionals in…

Psychometric Properties of the Chinese Cultural Beliefs about Adversity Scale

ERIC Educational Resources Information Center

Leung, Janet T. Y.; Shek, Daniel T. L.

2013-01-01

Objective: The purpose of the study was to examine the psychometric properties of the Chinese Cultural Beliefs about Adversity scale (CBA). Methods: The CBA was administered in a sample of 275 Chinese parents experiencing economic disadvantage. Results: The CBA was found to be internally consistent. Consistent with the conceptual framework, factor…

Psychometric Properties and Norms of the German ABC-Community and PAS-ADD Checklist

ERIC Educational Resources Information Center

Zeilinger, Elisabeth L.; Weber, Germain; Haveman, Meindert J.

2011-01-01

Aim: The aim of the present study was to standardize and generate psychometric evidence of the German language versions of two well-established English language mental health instruments: the "Aberrant Behavior Checklist-Community" (ABC-C) and the "Psychiatric Assessment Schedule for Adults with Developmental Disabilities" (PAS-ADD) Checklist. New…

IQs Are Very Strong but Imperfect Indicators of Psychometric "g": Results from Joint Confirmatory Factor Analysis

ERIC Educational Resources Information Center

Farmer, Ryan L.; Floyd, Randy G.; Reynolds, Matthew R.; Kranzler, John H.

2014-01-01

The most global score yielded by intelligence tests, IQs, are supported by substantial validity evidence and have historically been central to the identification of intellectual disabilities, learning disabilities, and giftedness. This study examined the extent to which IQs measure the ability they target, psychometric "g." Data from…

Psychometric Properties of the HOME Inventory Using Rasch Analysis

ERIC Educational Resources Information Center

Glad, Johan; Kottorp, Anders; Jergeby, Ulla; Gustafsson, Carina; Sonnander, Karin

2014-01-01

Objectives: The aim of this pilot study was to explore psychometric properties of two versions of the Home Observation for Measurement of the Environment Inventory in a Swedish social service sample. Method: Social workers employed at 22 Swedish child protections agencies participated in the data collection. Both classic test theory approaches and…

Psychometric Assessment of the Mindful Attention Awareness Scale (MAAS) among Chinese Adolescents

ERIC Educational Resources Information Center

Black, David S.; Sussman, Steve; Johnson, C. Anderson; Milam, Joel

2012-01-01

The Mindful Attention Awareness Scale (MAAS) has the longest empirical track record as a valid measure of trait mindfulness. Most of what is understood about trait mindfulness comes from administering the MAAS to relatively homogenous samples of Caucasian adults. This study rigorously evaluates the psychometric properties of the MAAS among Chinese…

A Korean Language Translation of the Questions about Behavior Function: Initial Psychometric Evaluation

ERIC Educational Resources Information Center

Dixon, Dennis R.; Jang, Jina; Chung, Kyong-Mee; Jung, Woo Hyun; Matson, Johnny L.

2013-01-01

Identifying the function of behavior is crucial in formulating functionally-based treatment programs for people with challenging behaviors. The Questions About Behavior Function (QABF) is a well-established instrument with sound psychometric properties. The present study describes the development process for a Korean version of the QABF. The…

Development and Psychometric Evaluation of the Independent School Teacher Development Inventory

ERIC Educational Resources Information Center

Murray, John M.

2012-01-01

In this study the author examined the psychometrics of an instrument, the Independent School Teacher Development Inventory, designed to assess the professional learning opportunities in U.S. independent schools. The inventory was sent to 3,422 independent school administrators and of these, 2,474 returned completed surveys. Exploratory factor…

Assessing Readiness for Change in Adolescents with Eating Disorders

ERIC Educational Resources Information Center

Geller, Josie; Brown, Krista E.; Zaitsoff, Shannon L.; Menna, Rosanne; Bates, Mollie E.; Dunn, Erin C.

2008-01-01

The Readiness and Motivation Interview (RMI) is a semistructured interview measure of readiness and motivation to change that can be used for all eating disorder diagnoses. The RMI has demonstrated excellent psychometric properties and has both clinical and predictive utility in adult samples. This study examined the psychometric properties of the…

The Psychometric Properties of the School Engagement Measure in Adolescents in Singapore

ERIC Educational Resources Information Center

Yusof, Noradlin; Ang, Rebecca P.; Oei, Tian Po S.

2017-01-01

This study examined the psychometric properties of the school engagement measure (SEM) in Singapore. The sample consisted of 1,027 students from a multi-ethnic Singapore adolescent community. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) confirmed that the two-factor solution, namely, (a) Emotional and (b) Cognitive…

Using a Sampling Strategy to Address Psychometric Challenges in Tutorial-Based Assessments

ERIC Educational Resources Information Center

Eva, Kevin W.; Solomon, Patty; Neville, Alan J.; Ladouceur, Michael; Kaufman, Karyn; Walsh, Allyn; Norman, Geoffrey R.

2007-01-01

Introduction: Tutorial-based assessment, despite providing a good match with the philosophy adopted by educational programmes that emphasize small group learning, remains one of the greatest challenges for educators working in this context. The current study was performed in an attempt to assess the psychometric characteristics of tutorial-based…

Psychometric Properties of the Revised Purdue Spatial Visualization Tests: Visualization of Rotations (The Revised PSVT-R)

ERIC Educational Resources Information Center

Yoon, So Yoon

2011-01-01

Working under classical test theory (CTT) and item response theory (IRT) frameworks, this study investigated psychometric properties of the Revised Purdue Spatial Visualization Tests: Visualization of Rotations (Revised PSVT:R). The original version, the PSVT:R was designed by Guay (1976) to measure spatial visualization ability in…

Measuring the Youth Bullying Experience: A Systematic Review of the Psychometric Properties of Available Instruments

ERIC Educational Resources Information Center

Vessey, Judith; Strout, Tania D.; DiFazio, Rachel L.; Walker, Allison

2014-01-01

Background: Bullying is a significant problem in schools and measuring this concept remains problematic. The purposes of this study were to (1) identify the published self-report measures developed to assess youth bullying; (2) evaluate their psychometric properties and instrument characteristics; and (3) evaluate the quality of identified…

Academic Underachievement among Children with Epilepsy: Proportion Exceeding Psychometric Criteria for Learning Disability and Associated Risk Factors

ERIC Educational Resources Information Center

Fastenau, Philip S.; Shen, Jianzhao; Dunn, David W.; Austin, Joan K.

2008-01-01

This study assessed rates of learning disabilities (LD) by several psychometric definitions in children with epilepsy and identified risk factors. Participants (N = 173, ages 8-15 years) completed IQ screening, academic achievement testing, and structured interviews. Children with significant head injury, chronic physical conditions, or mental…

Psychometric Qualities of the German Version of the Posttraumatic Diagnostic Scale (PTDS)

ERIC Educational Resources Information Center

Griesel, Dorothee; Wessa, Michele; Flor, Herta

2006-01-01

In the present study, the psychometric properties of the German version of the Posttraumatic Diagnostic Scale (PTDS; A. Ehlers, R. Steil, H. Winter, & E. B. Foa, 1996) were evaluated in a sample of 143 trauma survivors. To investigate convergent and discriminant validity of this questionnaire, the authors assessed posttraumatic stress disorder…

The Development of a Brief Measure of Learner Autonomy in University Students

ERIC Educational Resources Information Center

Macaskill, Ann; Taylor, Elissa

2010-01-01

A great deal of attention is paid to the requirement for university students to become autonomous learners. A review of the literature revealed a lack of relatively short psychometrically sound measures of autonomous learning despite its purported importance. This study aimed to develop a brief, psychometrically sound, measure of autonomous…

Psychometric Properties of the Therapeutic Alliance Scale for Caregivers and Parents

ERIC Educational Resources Information Center

Accurso, Erin C.; Hawley, Kristin M.; Garland, Ann F.

2013-01-01

This study examined the psychometric properties of the Therapeutic Alliance Scale for Caregivers and Parents (TASCP) in a sample of 209 caregivers whose children (4-13 years of age) presented with disruptive behavior problems to a publicly funded outpatient mental health clinic in San Diego County. Information about therapeutic alliance was…

Psychometric Properties of Scores from the Web-based LibQUAL+ Study of Perceptions of Library Service Quality.

ERIC Educational Resources Information Center

Cook, Colleen; Thompson, Bruce

2001-01-01

Investigated the psychometric integrity of scores from the LibQUAL+ evaluation of perceived library service quality conducted by ARL (Association of Research Libraries). Examines score structure, score reliability, score correlation and concurrent validity coefficients, scale means, and scale standardized norms, and considers the potential of the…

New Reliability and Validity Evidence of the Emotional Intelligence Scale

ERIC Educational Resources Information Center

Zhoc, Karen C. H.; Li, Johnson C. H.; Webster, Beverley J.

2017-01-01

Emotional Intelligence Scale (EIS) is a popular EI measure. Yet, it has been criticized for an unclear factor structure, and its psychometric properties were mainly examined in the Western context. This study was to evaluate its psychometric properties based on 1,724 Hong Kong undergraduate students, including its (a) factor structure, (b)…

The Psychometric Evaluation of a Questionnaire to Measure Attitudes towards Inclusive Education

ERIC Educational Resources Information Center

de Boer, Anke; Timmerman, Marieke; Pijl, Sip Jan; Minnaert, Alexander

2012-01-01

In many countries, there has been a development towards the inclusion of students with special educational needs in regular education. Over the past decade, this has resulted in an increased interest in attitudes towards this educational change of those directly involved. This current study aims at the development, psychometric evaluation, and…

The Implicit Curriculum Survey: An Examination of the Psychometric Properties

ERIC Educational Resources Information Center

Grady, Melissa D.; Swick, Danielle C.; Powers, Joelle D.

2018-01-01

This study examined the psychometric properties of the Implicit Curriculum Survey (ICS) using an exploratory factor analysis (EFA). Students enrolled in four different MSW programs (N = 262) from different geographic locations completed the ICS, which is a Web-based survey. The domains of the ICS include field, academics, community, diversity,…

Psychometric Properties of the Mental Retardation Attitude Inventory-Revised in Chinese College Students

ERIC Educational Resources Information Center

Hampton, N. Z.; Xiao, F.

2008-01-01

Background: This study examines the psychometric properties of the Mental Retardation Attitude Inventory-Revised (MRAI-R; Antonak & Harth) in Chinese college students. The research questions included: (1) Is the MRAI-R a reliable measure for Chinese college student? (2) Is the MRAI-R related to familiarity with people with intellectual…

Psychometric Evaluation of the Italian Adaptation of the Test of Inferential and Creative Thinking

ERIC Educational Resources Information Center

Faraci, Palmira; Hell, Benedikt; Schuler, Heinz

2016-01-01

This article describes the psychometric properties of the Italian adaptation of the "Analyse des Schlussfolgernden und Kreativen Denkens" (ASK; Test of Inferential and Creative Thinking) for measuring inferential and creative thinking. The study aimed to (a) supply evidence for the factorial structure of the instrument, (b) describe its…

Examining the Psychometric Properties of the Identify as a Professional Social Worker Subscale

ERIC Educational Resources Information Center

Farmer, Antoinette Y.

2017-01-01

The purpose of this study was to examine the psychometric properties of the Identify as a Professional Social Worker Subscale, which assessed the Council on Social Work Education--prescribed competency "identify as a professional social worker and conduct oneself accordingly." The results of confirmatory factory analysis indicated that…

Development and Validation of the Frost Multidimensional Perfectionism Scale--Brief

ERIC Educational Resources Information Center

Burgess, Alexandra M.; Frost, Randy O.; DiBartolo, Patricia Marten

2016-01-01

Twenty-five years ago, one of the first empirically validated measures of perfectionism, the Frost et al. Multidimensional Perfectionism Scale (F-MPS) was published. Since that time, psychometric studies of the original F-MPS have provided a plethora of evidence to support the potential development of a shorter yet still psychometrically robust…

A Psychometric Evaluation of the CDRS and MADRS in Assessing Depressive Symptoms in Children

ERIC Educational Resources Information Center

Jain, Shailesh; Carmody, Thomas J.; Trivedi, Madhukar H.; Hughes, Carroll; Bernstein, Ira H.; Morris, David W.; Emslie, Graham J.; Rush, A. John

2007-01-01

Objective: This study compared the psychometric properties of the Children's Depression Rating Scale-Revised (CDRS-R) and the Montgomery-Asberg Depression Rating Scale (MADRS) in children with major depressive disorder. Method: Children (N = 96; ages 8 to 11 years inclusive) with nonpsychotic major depressive disorder were enrolled. Participants…

The Alliance Negotiation Scale: A psychometric investigation.

PubMed

Doran, Jennifer M; Safran, Jeremy D; Muran, J Christopher

2016-08-01

This study investigates the utility and psychometric properties of a new measure of psychotherapy process, the Alliance Negotiation Scale (ANS; Doran, Safran, Waizmann, Bolger, & Muran, 2012). The ANS was designed to operationalize the theoretical construct of negotiation (Safran & Muran, 2000), and to extend our current understanding of the working alliance concept (Bordin, 1979). The ANS was also intended to improve upon existing measures such as the Working Alliance Inventory (WAI; Horvath & Greenberg, 1986, 1989) and its short form (WAI-S; Tracey & Kokotovic, 1989) by expanding the emphasis on negative therapy process. The present study investigates the psychometric validity of the ANS test scores and interpretation-including confirming its original factor structure and evaluating its internal consistency and construct validity. Construct validity was examined through the ANS' convergence and divergence with several existing scales that measure theoretically related constructs. The results bolster and extend previous findings about the psychometric integrity of the ANS, and begin to illuminate the relationship between negotiation and other important variables in psychotherapy research. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Comparing adaptive procedures for estimating the psychometric function for an auditory gap detection task.

PubMed

Shen, Yi

2013-05-01

A subject's sensitivity to a stimulus variation can be studied by estimating the psychometric function. Generally speaking, three parameters of the psychometric function are of interest: the performance threshold, the slope of the function, and the rate at which attention lapses occur. In the present study, three psychophysical procedures were used to estimate the three-parameter psychometric function for an auditory gap detection task. These were an up-down staircase (up-down) procedure, an entropy-based Bayesian (entropy) procedure, and an updated maximum-likelihood (UML) procedure. Data collected from four young, normal-hearing listeners showed that while all three procedures provided similar estimates of the threshold parameter, the up-down procedure performed slightly better in estimating the slope and lapse rate for 200 trials of data collection. When the lapse rate was increased by mixing in random responses for the three adaptive procedures, the larger lapse rate was especially detrimental to the efficiency of the up-down procedure, and the UML procedure provided better estimates of the threshold and slope than did the other two procedures.

The Yale Craving Scale: Development and psychometric properties.

PubMed

Rojewski, Alana M; Morean, Meghan E; Toll, Benjamin A; McKee, Sherry A; Krishnan-Sarin, Suchitra; Green, Barry G; Bartoshuk, Linda M; O'Malley, Stephanie S

2015-09-01

The current study presents a psychometric evaluation of the Yale Craving Scale (YCS), a novel measure of craving for cigarettes and alcohol, respectively. The YCS is the first craving measure to use a generalized Labeled Magnitude Scale (gLMS) as the scoring format, which facilitates between-group comparisons of subjective craving and eliminates ceiling effects by assessing the full range of imaginable sensation intensities. Psychometric evaluations of the YCS for use with cigarettes (YCS Smoking) and alcohol (YCS Drinking) included assessments of latent factor structure, internal consistency, ceiling effects, and test-criterion relationships. Study samples included 493 treatment-seeking smokers and 213 heavy drinkers. Factor analyses of the 5-item YCS Smoking and Drinking scores confirmed a 1-factor scale. The YCS Smoking and Drinking scores evidenced: (1) good internal consistency, (2) scalar measurement invariance within several subgroups (e.g., smoking/drinking status; nicotine/alcohol dependence), (3) convergent relationships with extant craving measures, and (4) concurrent relationships with smoking/drinking outcomes. These results suggest that the YCS represents a psychometrically sound scale for assessing smoking and drinking urges in dependent populations. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Detection of malingering: psychometric evaluation of the Chinese version of the structured interview of reported symptoms-2

PubMed Central

2013-01-01

Background Malingering detection has emerged as an important issue in clinical and forensic settings. The Structured Interview of Reported Symptoms-2 (SIRS-2) was designed to assess the feigned symptoms in both clinical and non-clinical subjects. The aim of the study was to examine the reliability and validity of the Chinese version of this scale. Methods Two studies were conducted to evaluate the reliability and validity of the Chinese Version of SIRS-2. In Study one, with a simulation design, the subjects included a. 40 students asked to simulate symptoms of mental illness; b. 40 general psychiatric inpatients and c. 40 students asked to reply to questions honestly. Scales scores for feigning symptoms among three groups were carried out for discriminant validity of the Chinese Version of SIRS-2. Minnesota Multiphasic Personality Inventory-2(MMPI-2) was administered in 80 undergraduate students. In Study two, with a known-groups comparison design, scales scores for feigning symptoms were compared between 20 suspected malingerers and 80 psychiatric outpatients from two forensic centers using the Chinese Version of SIRS-2. Results The Chinese Version of SIRS-2 demonstrated satisfactory internal consistency in both study one and two. In study one, criterion validity of this scale was supported by its significantly positive correlation with the MMPI-2 (r = 0.282 ~ 0.481 for Infrequency), and by its significantly negative correlation with the MMPI-2 (r = -0.255 ~ -0.519 for Lie and -0.205 ~ 0.391 for Correction). Scores of 10 out of 13 subscales of the Chinese Version of SIRS-2 for simulators were significantly higher than scores of honest students and general psychiatric patients. In study two, the mean scores of the Chinese Version of 13 subscales for suspected malingerers were significantly higher than those of psychiatric outpatients. For discriminant validity, it yielded a large effect size (d = 1.80) for the comparison of the participant groups in study one and two. Moreover, the sensitivity (proportion of malingerers accurately identified by the measure) and specificity (proportion of people accurately classified as responding honestly) of the Chinese version of SIRS-2 in the detection of malingering in these two studies are acceptable. Conclusions The Chinese version of the SIRS-2 has good psychometric properties and is a valid and reliable tool for detection of malingering in Chinese populations. PMID:24106829

The Psychometric Toolbox: An Excel Package for Use in Measurement and Psychometrics Courses

ERIC Educational Resources Information Center

Ferrando, Pere J.; Masip-Cabrera, Antoni; Navarro-González, David; Lorenzo-Seva, Urbano

2017-01-01

The Psychometric Toolbox (PT) is a user-friendly, non-commercial package mainly intended to be used for instructional purposes in introductory courses of educational and psychological measurement, psychometrics and statistics. The PT package is organized in six separate modules or sub-programs: Data preprocessor (descriptive analyses and data…

Hangover in Post-College-Aged Drinkers: Psychometric Properties of the Hangover Symptom Scale (HSS) and the Hangover Symptom Scale-Short Form (HSS-5).

PubMed

Chavarria, Jesus; Rueger, Sandra Y; King, Andrea C

2018-04-16

Alcohol hangovers have been found to be a common and costly consequence of alcohol misuse. However, there is only limited psychometric support for instruments to accurately measure hangovers beyond the college-age years. This study investigated the psychometric properties of the Hangover Symptom Scale (HSS) and the Hangover Symptom Scale-Short Form (HSS-5) including the internal consistency, convergent and discriminant validity, construct validity, and the measurement invariance of these scales between light and heavy drinkers, individuals with a positive and negative family history of alcohol use disorder (AUD), and men and women in a post-college-aged sample. The association of the HSS and HSS-5 with alcohol use problems was also tested. Participants were 294 nonalcoholic light and heavy social drinkers (age range 21 to 35 years; 57.8% male) enrolled in the Chicago Social Drinking Project. They completed the HSS as part of a take-home packet completed outside of the laboratory. The psychometric properties of the HSS and HSS-5 were tested. Stronger psychometric support was found for the HSS-5 relative to the full HSS. While both measures demonstrated strong internal consistency reliability, convergent and discriminant validity, and an association with alcohol use problems, only the HSS-5 showed construct validity as determined by confirmatory factor analysis. Further, only the HSS-5 showed measurement invariance between men and women, light and heavy drinkers, and individuals with a positive and negative family history of AUD. This was the first study to examine the psychometric properties of the HSS and HSS-5 in a post-college-aged sample and the first to investigate the measurement invariance of these measures as a function of sex, drinking history, and family history of AUD. This study supports the use of the HSS-5 as a reliable and valid brief measure of frequency of hangover symptoms. Copyright © 2018 by the Research Society on Alcoholism.

How mechanisms of perceptual decision-making affect the psychometric function.

PubMed

Gold, Joshua I; Ding, Long

2013-04-01

Psychometric functions are often interpreted in the context of Signal Detection Theory, which emphasizes a distinction between sensory processing and non-sensory decision rules in the brain. This framework has helped to relate perceptual sensitivity to the "neurometric" sensitivity of sensory-driven neural activity. However, perceptual sensitivity, as interpreted via Signal Detection Theory, is based on not just how the brain represents relevant sensory information, but also how that information is read out to form the decision variable to which the decision rule is applied. Here we discuss recent advances in our understanding of this readout process and describe its effects on the psychometric function. In particular, we show that particular aspects of the readout process can have specific, identifiable effects on the threshold, slope, upper asymptote, time dependence, and choice dependence of psychometric functions. To illustrate these points, we emphasize studies of perceptual learning that have identified changes in the readout process that can lead to changes in these aspects of the psychometric function. We also discuss methods that have been used to distinguish contributions of the sensory representation versus its readout to psychophysical performance. Copyright © 2012 Elsevier Ltd. All rights reserved.

Score Reliability and Validity of the Student Risk Screening Scale: A Psychometrically Sound, Feasible Tool for Use in Urban Middle Schools

ERIC Educational Resources Information Center

Lane, Kathleen Lynne; Bruhn, Allison L.; Eisner, Shanna L.; Kalberg, Jemma Robertson

2010-01-01

In this article, the authors examine the psychometric properties of the "Student Risk Screening Scale" (SRSS) for use in urban middle schools. Results of Studies 1 and 2 suggest strong internal consistency and test-retest stability. Study 1 supports the predictive validity of the SRSS, with students at low risk being able to be differentiated from…

Assessment of Psychopathological Problems in the School Context: The Psychometric Properties of a Portuguese Version of the Adolescent Psychopathology Scale--Short Form

ERIC Educational Resources Information Center

Lemos, Ida Timoteo; Faisca, Luis Madeira; Valadas, Sandra Teodosio

2011-01-01

The psychometric properties of a Portuguese version of the Adolescent Psychopathology Scale-Short Form (APS-SF) were studied in a sample of 656 Portuguese adolescents, aged 12 to 19 years, assessed in school context. Also, the aim of the study was to gather data concerning age- and gender-related differences in the expression of psychopathological…

Early Childhood Longitudinal Study-Kindergarten Class of 1998-99 (ECLS-K), Psychometric Report for Kindergarten through First Grade. NCES Working Paper No. 2002-05

ERIC Educational Resources Information Center

Rock, Donald A.; Pollack, Judith M.

2002-01-01

This report documents the design, development, and psychometric characteristics of the assessment instruments used in the Early Childhood Longitudinal Study-Kindergarten Class of 1998-99 (ECLS-K). The ECLS-K is sponsored by the U.S. Department of Education, National Center for Education Statistics. The ECLS-K was designed to assess the…

Assessing positive and negative experiences: validation of a new measure of well-being in an Italian population.

PubMed

Corno, Giulia; Molinari, Guadalupe; Baños, Rosa Maria

2016-01-01

The aim of this study is to explore the psychometric properties of an affect scale, the Scale of Positive and Negative Experience (SPANE), in an Italian-speaking population. The results of this study demonstrate that the Italian version of the SPANE has psychometric properties similar to those shown by the original and previous versions, and it presents satisfactory reliability and factorial validity. The results of the Confirmatory Factor Analysis support the expected two-factor structure, positive and negative feeling, which characterized the previous versions. As expected, measures of negative affect, anxiety, negative future expectances, and depression correlated positively with the negative experiences SPANE subscale, and negatively with the positive experiences SPANE subscale. Results of this study demonstrate that the Italian version of the SPANE has psychometric properties similar to those shown by the original and previous versions, and it presents satisfactory reliability and factorial validity. The use of this instrument provides clinically useful information about a person’s overall emotional experience and it is an indicator of well-being. Although further studies are required to confirm the psychometric characteristics of the scale, the SPANE Italian version is expected to improve theoretical and empirical research on the well-being of the Italian population.

Cultural adaptation and validation of the Lasater Clinical Judgment Rubric in nursing students in Spain.

PubMed

Román-Cereto, Montserrat; García-Mayor, Silvia; Kaknani-Uttumchandani, Shakira; García-Gámez, Marina; León-Campos, Alvaro; Fernández-Ordóñez, Eloisa; Ruiz-García, Maria Luisa; Martí-García, C; López-Leiva, Inmaculada; Lasater, Kathie; Morales-Asencio, José Miguel

2018-05-01

The clinical judgment and decision-making abilities of nurses can influence many health outcomes, hence the importance of addressing these qualities in university studies. In this respect, clinical simulation is a commonly employed teaching method. The evaluation of simulation activities requires standardised instruments, such as the Lasater Clinical Judgment Rubric, which is widely used for this purpose, although a culturally adapted and validated version in Spain is not available. To obtain a Spanish culturally adapted and validated version of the rubric for undergraduate students of nursing. Cultural adaptation and psychometric validation study carried out with undergraduate nursing students in the simulation laboratories at the University of Málaga (Spain). A process of translation/back-translation and cultural adaptation was carried out in accordance with international standards. The rubric was empirically evaluated in standardised scenarios with high and medium-fidelity simulators. Each student took part in two different simulation sessions, led by two instructors. In each simulation, the data were collected by two independent observers. 152 observations were obtained from 76 students. The interobserver reliability was high, with an intraclass correlation coefficient of 0.93 (95% CI 0.92-0.95) (p = 0.0001) and Cronbach's alpha of 0.93. According to the confirmatory factor analysis, the fit of the model was satisfactory in all indices, with a χ 2 /df value of 1.08, GFI 0.96, TLI 0.99, NFI 0.97 and RMSEA 0.24 (90% CI 0.000-0.066). The rubric obtained is culturally adapted to the Spanish educational context, and is valid and reliable for nursing students. Further prospective studies should be undertaken to evaluate the responsiveness, potential for transfer to clinical practice and cost-benefit ratios of different simulation designs. Copyright © 2018 Elsevier Ltd. All rights reserved.

Future of Psychometrics: Ask What Psychometrics Can Do for Psychology

ERIC Educational Resources Information Center

Sijtsma, Klaas

2012-01-01

I address two issues that were inspired by my work on the Dutch Committee on Tests and Testing (COTAN). The first issue is the understanding of problems test constructors and researchers using tests have of psychometric knowledge. I argue that this understanding is important for a field, like psychometrics, for which the dissemination of…

Psychometric analysis of five measures of spatial ability.

PubMed

Hogan, Thomas P

2012-02-01

This study analyzed psychometric properties of five measures of spatial ability on 96 young adults, with supplementary analysis for three of the measures on another sample of 71 young adults. Two measures were taken from the widely cited Kit of Factor-Referenced Cognitive Tests and three other measures were taken from a relatively new source originally intended as laboratory demonstrations. Previous research provided limited information on the psychometric properties of the measures. All five measures yielded adequate reliability and loaded on a single factor. Three measures yielded markedly skewed distributions. Two measures showed clear sex differences with men scoring higher but this difference seemed contaminated by a speed factor; three measures did not show a sex difference. Recommendations for use of the measures in future studies are provided.

The Swedish version of the multidimensional scale of perceived social support (MSPSS)--a psychometric evaluation study in women with hirsutism and nursing students.

PubMed

Ekbäck, Maria; Benzein, Eva; Lindberg, Magnus; Arestedt, Kristofer

2013-10-10

The Multidimensional Scale of Perceived Social Support (MSPSS) is a short instrument, developed to assess perceived social support. The original English version has been widely used. The original scale has demonstrated satisfactory psychometric properties in different settings, but no validated Swedish version has been available. The aim was therefore to translate, adapt and psychometrically evaluate the Multidimensional Scale of Perceived Social Support for use in a Swedish context. In total 281 participants accepted to join the study, a main sample of 127 women with hirsutism and a reference sample of 154 nursing students. The MSPSS was translated and culturally adapted according to the rigorous official process approved by WHO. The psychometric evaluation included item analysis, evaluation of factor structure, known-group validity, internal consistency and reproducibility. The original three-factor structure was reproduced in the main sample of women with hirsutism. An equivalent factor structure was demonstrated in a cross-validation, based on the reference sample of nursing students. Known-group validity was supported and internal consistency was good for all scales (α = 0.91-0.95). The test-retest showed acceptable to very good reproducibility for the items (κw = 0.58-0.85) and the scales (ICC = 0.89-0.92; CCC = 0.89-0.92). The Swedish version of the MSPSS is a multidimensional scale with sound psychometric properties in the present study sample. The simple and short format makes it a useful tool for measuring perceived social support.

[Can Psychometric Tests Predict Success in the Selection Interview for Medical School? A Cross-Sectional Study at One German Medical School].

PubMed

Kötter, T; Obst, K U; Brüheim, L; Eisemann, N; Voltmer, E; Katalinic, A

2017-07-01

Background The final exam grade is the main selection criterion for medical school application in Germany. For academic success, it seems to be a reliable predictor. Its use as the only selection criterion is, however, criticised. At some universities, personal interviews are part of the selection process. However, these are very time consuming and are of doubtful validity. The (additional) use of appropriate psychometric instruments could reduce the cost and increase the validity. This study investigates the extent to which psychometric instruments can predict the outcome of a personal selection interview. Methods This is a cross-sectional study on the correlation of the results of psychometric instruments with those of the personal selection interview as part of the application process. As the outcome, the score of the selection interview was used. The NEO - Five Factor Inventory, the Hospital Anxiety and Depression Scale (HADS) and the questionnaire to identify work-related behaviour and experience patterns (AVEM) were used as psychometric interviews. Results There was a statistically significant correlation with the results of the personal selection interview for the sum score of the depression scale from the HADS and the sum score for the dimension of life satisfaction of the AVEM. In addition, those participants who did not previously complete an application training achieved a better result in the selection interview. Conclusion The instruments used measure different aspects than the interviews and cannot replace them. It remains to be seen whether the selected parameters are able to predict academic success. © Georg Thieme Verlag KG Stuttgart · New York.

The Psychometric Properties of the Voice Handicap Index in People With Parkinson's Disease.

PubMed

Guimaraes, I; Cardoso, R; Pinto, S; Ferreira, J J

2017-03-01

Psychosocial impact of dysphonia in people with Parkinson disease (PD) has been described with the Voice Handicap Index (VHI); however, its psychometric properties when applied in this population are not described. The objective of this study was to examine the psychometric properties of the VHI in people with PD. A cross-sectional study of 151 subjects without cognitive impairment (90 people with PD and 61 controls) was carried out. The VHI was applied along with clinician-based (Mini Mental State Examination, Hoehn and Yahr staging, and Movement Disorder Society-Unified Parkinson's Disease Rating Scale) and patient-based (self-rated voice severity) outcome measures. The psychometric properties of the VHI analyzed were the feasibility, reliability, and construct validity. The average age of the PD population studied was 67 years; 51% had a primary level of education and 81% were retired. On average, they had disease onset duration of 11 years, a mild disease stage, mild to moderate global motor disability and impairment, and a normal to mild self-rated voice severity. The psychometric attributes of the VHI demonstrated that the questionnaire is feasible (missing data less than 1%), reliable (Cronbach α > 0.9), and valid (71.5% of the total variance is explained by five factors, correlates with voice severity, PD disability, and impairment, and differentiates subjects with PD from subjects without PD). The VHI is a reliable and valid tool that can be recommended for the population under study although further work is required to investigate its utility in advanced stages of disease. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Psychometric Testing of the Chinese Version of the Decisional Balance Scale (CDBS)

ERIC Educational Resources Information Center

Chen, Huey-Shys; Sheu, Jiunn-Jye; Chen, W. William

2006-01-01

The purpose of this study was to conduct psychometric testing on the Chinese version of the decisional balance scale (CDBS) with Taiwanese seventh, eighth, and ninth graders who were recruited from the Taipei metropolitan area. A random cluster sampling method was used with 554 adolescents between the ages of 13 and 17 years. Factor analysis…

Psychometric Evaluation of the Malay Satisfaction with Life Scale

ERIC Educational Resources Information Center

Swami, Viren; Chamorro-Premuzic, Tomas

2009-01-01

The Satisfaction With Life Scale (SWLS) is one of the most widely used scales for the measurement of subjective well-being across the globe, but no satisfactory version exists for use among Malay-speaking populations. The present study reports on the translation of a new Malay SWLS and examines its psychometric properties in a community sample of…

An Evaluation of the Psychometric Properties of an Advising Survey for Medical and Professional Program Students

ERIC Educational Resources Information Center

Royal, Kenneth D.; Gonzalez, Liara M.

2016-01-01

The purpose of this study was to evaluate the psychometric properties of a newly developed instrument intended to measure faculty competence as it pertains to their role as advisors, particularly in medical and professional programs. A total of 166 students completed the Faculty Advisor's Skills and Behaviors Inventory (FASBI). The psychometric…

Psychometric Properties of the Chinese Version of the Social Responsiveness Scale

ERIC Educational Resources Information Center

Gau, Susan Shur-Fen; Liu, Li-Ting; Wu, Yu-Yu; Chiu, Yen-Nan; Tsai, Wen-Che

2013-01-01

This study evaluated the psychometric properties of the Chinese version of the Social Responsiveness Scale (Chinese SRS). We assessed 1419 grade 1 to grade 8 students from northern Taiwan and 401 clinic-based participants (aged 3-20, male 90.3%). All clinic-based participants were clinically diagnosed with autism spectrum disorders (ASDs),…

A Critical Examination of the Technical Adequacy of a Curriculum-Based Assessment Using Rasch Analyses

ERIC Educational Resources Information Center

Winchell, Brooke

2011-01-01

The purpose of the study was to (a) examine the psychometric properties of The Assessment, Evaluation, and Programming System for Infants and Children (AEPS Test); (b) provide a process for establishing psychometric properties for other Curriculum Based Assessments (CBAs); and (c) identify and guide evaluation and subsequent revisions of the AEPS…

Professor-Student Rapport Scale: Psychometric Properties of the Brief Version

ERIC Educational Resources Information Center

Ryan, Rebecca

2014-01-01

The original Professor-Student Rapport Scale contained 34 items and predicted several single-item student outcomes. A high level of internal consistency encouraged the development of a shorter measure in order to address apparent redundancy. Our goals in the current study were to provide psychometric data for the brief version of the scale and to…

Investigating the Psychometric Properties of the ACEI Global Guidelines Assessment (GGA) in Four Countries

ERIC Educational Resources Information Center

Hardin, Belinda J.; Bergen, Doris; Hung, Hsuan-Fang

2013-01-01

The ACEI Global Guidelines Assessment (GGA) was developed to provide an international assessment tool that can be used by early childhood educators to develop, assess, and improve program quality worldwide. This pilot study was conducted in four countries to investigate the psychometric properties of the GGA within and across different countries.…

Item response modeling: A psychometric assessment of the children's fruit, vegetable, water, and physical activity self-efficacy scales among Chinese children

USDA-ARS?s Scientific Manuscript database

This study aimed to evaluate the psychometric properties of four self-efficacy scales (i.e., self-efficacy for fruit (FSE), vegetable (VSE), and water (WSE) intakes, and physical activity (PASE)) and to investigate their differences in item functioning across sex, age, and body weight status groups ...

A Psychometric Comparison of the Beck Depression Inventory-II in English and Spanish

ERIC Educational Resources Information Center

Wiebe, John S.; Penley, Julie A.

2005-01-01

The Beck Depression Inventory-II (BDI-II; A. T. Beck, R. A. Steer, & G. K. Brown, 1996) is a widely used measure of depressive symptomatology originally authored in English and then translated to Spanish. However, there are very limited data available on the Spanish translation. This study compared the psychometric characteristics of the…

Psychometric Properties of the Autism-Spectrum Quotient for Assessing Low and High Levels of Autistic Traits in College Students

ERIC Educational Resources Information Center

Stevenson, Jennifer L.; Hart, Kari R.

2017-01-01

The current study systematically investigated the effects of scoring and categorization methods on the psychometric properties of the Autism-Spectrum Quotient. Four hundred and three college students completed the Autism-Spectrum Quotient at least once. Total scores on the Autism-Spectrum Quotient had acceptable internal consistency and…

Psychometric Properties of the Teachers' Sense of Efficacy Scale within the Greek Educational Context

ERIC Educational Resources Information Center

Tsigilis, Nikolaos; Koustelios, Athanasios; Grammatikopoulos, Vasilios

2010-01-01

Many concerns have been raised about the validity of the existing instruments measuring teachers' efficacy. Recently, a new instrument to measure teachers' perceived efficacy has been presented, namely, the Teachers' Sense of Efficacy Scale (TSES). The purpose of the present study is to examine the psychometric properties of the TSES in the Greek…

Internet Administration of the Paper-and-Pencil Gifted Rating Scale: Assessing Psychometric Equivalence

ERIC Educational Resources Information Center

Yarnell, Jordy B.; Pfeiffer, Steven I.

2015-01-01

The present study examined the psychometric equivalence of administering a computer-based version of the Gifted Rating Scale (GRS) compared with the traditional paper-and-pencil GRS-School Form (GRS-S). The GRS-S is a teacher-completed rating scale used in gifted assessment. The GRS-Electronic Form provides an alternative method of administering…

Psychometric Properties of a Suicide Screen for Adjudicated Youth in Residential Care

ERIC Educational Resources Information Center

Langhinrichsen-Rohling, Jennifer; Hudson, Kenneth; Lamis, Dorian A.; Carr, Nicole

2012-01-01

There is a need to efficiently and effectively screen adjudicated youth residing within the juvenile justice system for suicide proneness. Accordingly, in the current study, the psychometric properties of the Life Attitude Schedule: Short Form (LAS:S), a 24-item risk assessment for suicide proneness, were assessed using data from adjudicated youth…

Psychometric Evaluation of the Chinese Version of the Existential Anxiety Questionnaire in a Sample of Chinese Adolescents Living in Hong Kong

ERIC Educational Resources Information Center

To, Siu-ming; Chan, Wallace Chi-ho

2016-01-01

Background: While Western academia has increasingly recognized the importance of studying existential anxiety among adolescents, psychometrically valid and reliable tools for measuring this construct remain unavailable in Chinese societies. Objective: This research investigated the empirical viability of the construct of existential anxiety in…

Psychometric Properties of an Instrument to Measure Social and Pedagogical School Climate among Teachers (PESOC)

ERIC Educational Resources Information Center

Hultin, H.; Ferrer-Wreder, L.; Eichas, K.; Karlberg, M.; Grosin, L.; Galanti, M. R.

2018-01-01

This study investigated the psychometric properties of a teacher-reported version of a Swedish school climate instrument called the Pedagogical and Social Climate (PESOC), which consists of 95 items covering cultural, structural and social factors. A sample of 348 teachers from 19 Swedish secondary schools was used. Multilevel confirmatory factor…

Examining the Psychometric Properties of the" Emotional Regulation Checklist" in 4- and 5-Year-Old Preschoolers

ERIC Educational Resources Information Center

Danisman, Sahin; Iman, Esra Dereli; Demircan, Zeynep Akin; Yaya, Dilara

2016-01-01

Introduction: Emotional Regulation Checklist is frequently used to determine emotional developments of children by teacher and parents of children. The purpose of this study was to examining the Psychometric Properties of "Emotional Regulation Check List" for 4-5 years age in preschool children. Method: The sample of the research was…

Development and Initial Psychometric Properties of the Computer Assisted Maltreatment Inventory (CAMI): A Comprehensive Self-Report Measure of Child Maltreatment History

ERIC Educational Resources Information Center

DiLillo, David; Hayes-Skelton, Sarah A.; Fortier, Michelle A.; Perry, Andrea R.; Evans, Sarah E.; Messman Moore, Terri L.; Walsh, Kate; Nash, Cindy; Fauchier, Angele

2010-01-01

Objectives: The present study reports on the development and initial psychometric properties of the Computer Assisted Maltreatment Inventory (CAMI), a web-based self-report measure of child maltreatment history, including sexual and physical abuse, exposure to interparental violence, psychological abuse, and neglect. Methods: The CAMI was…

A Review of Standardized Tests of Nonverbal Oral and Speech Motor Performance in Children

ERIC Educational Resources Information Center

McCauley, Rebecca J.; Strand, Edythe A.

2008-01-01

Purpose: To review the content and psychometric characteristics of 6 published tests currently available to aid in the study, diagnosis, and treatment of motor speech disorders in children. Method: We compared the content of the 6 tests and critically evaluated the degree to which important psychometric characteristics support the tests' use for…

A Psychometric Evaluation of the Achievement Goal Questionnaire-Revised in Singapore Secondary Students

ERIC Educational Resources Information Center

Ning, Hoi Kwan

2017-01-01

This study examined the psychometric properties of the Achievement Goal Questionnaire-Revised (AGQ-R) in a sample of Singapore secondary students (N = 1,171). Confirmatory factor analyses provided support for the AGQ-R in measuring the four achievements goals delineated in the 2 × 2 framework. Measurement invariance across ethnic groups was…

School Bonding in Early Adolescence: Psychometrics of the Brief Survey of School Bonding

ERIC Educational Resources Information Center

Whiteside-Mansell, Leanne; Weber, Judith L.; Moore, Page C.; Johnson, Danya; Williams, Ed R.; Ward, Wendy L.; Robbins, James M.; Phillips, B. Allyson

2015-01-01

The comprehensive assessment of middle school student bonding is important for basic research and to evaluate interventions. In this study, the psychometric properties of three assessment tools found in the literature were examined individually and then combined to create a shorter survey. With minor modifications, the tools were found to be…

Psychometric Analysis of the Systematic Observation of Red Flags for Autism Spectrum Disorder in Toddlers

ERIC Educational Resources Information Center

Dow, Deanna; Guthrie, Whitney; Stronach, Sheri T.; Wetherby, Amy M.

2017-01-01

The purpose of this study was to examine the utility of the Systematic Observation of Red Flags as an observational level-two screening measure to detect risk for autism spectrum disorder in toddlers when used with a video-recorded administration of the Communication and Symbolic Behavior Scales. Psychometric properties of the Systematic…

Thwarted Belongingness and Perceived Burdensomeness: Construct Validity and Psychometric Properties of the Interpersonal Needs Questionnaire

ERIC Educational Resources Information Center

Van Orden, Kimberly A.; Cukrowicz, Kelly C.; Witte, Tracy K.; Joiner, Thomas E., Jr.

2012-01-01

The present study examined the psychometric properties and construct validity of scores derived from the Interpersonal Needs Questionnaire (INQ) using latent variable modeling with 5 independent samples varying in age and level of psychopathology. The INQ was derived from the interpersonal theory of suicide and was developed to measure thwarted…

Psychometric Properties of Adaptation of the Social Efficacy and Outcome Expectations Scale to Turkish

ERIC Educational Resources Information Center

Bakioglu, Fuad; Turkum, Ayse Sibel

2017-01-01

The aim of this study was to examine the psychometric properties of the Social Efficacy and Outcome Expectations Scale (SEOES) on Turkish. The sample group included two groups of university students (ns = 440, 359). The validity of the scale was assessed using exploratory factor analysis, confirmatory factor analysis and concurrent validity, and…

Psychometric Properties of the Penn State Worry Questionnaire for Children in a Large Clinical Sample

ERIC Educational Resources Information Center

Pestle, Sarah L.; Chorpita, Bruce F.; Schiffman, Jason

2008-01-01

The Penn State Worry Questionnaire for Children (PSWQ-C; Chorpita, Tracey, Brown, Collica, & Barlow, 1997) is a 14-item self-report measure of worry in children and adolescents. Although the PSWQ-C has demonstrated favorable psychometric properties in small clinical and large community samples, this study represents the first psychometric…

Measuring Physician Cognitive Load: Validity Evidence for a Physiologic and a Psychometric Tool

ERIC Educational Resources Information Center

Szulewski, Adam; Gegenfurtner, Andreas; Howes, Daniel W.; Sivilotti, Marco L. A.; van Merriënboer, Jeroen J. G.

2017-01-01

In general, researchers attempt to quantify cognitive load using physiologic and psychometric measures. Although the construct measured by both of these metrics is thought to represent overall cognitive load, there is a paucity of studies that compares these techniques to one another. The authors compared data obtained from one physiologic tool…

Early Childhood Longitudinal Study, Birth Cohort (ECLS-B): Psychometric Report for the 2-Year Data Collection. Methodology Report. NCES 2007-084

ERIC Educational Resources Information Center

Andreassen, Carol; Fletcher, Philip

2007-01-01

This methodology report documents the design, development, and psychometric characteristics of the assessment instruments used in the second wave of the ECLS-B. The assessment instruments discussed measure children's cognitive development (BSF-R), socioemotional functioning (Two Bags Task), security of attachment (TAS-45), and physical development…

Psychometric Analysis of the Orientations to Happiness Questionnaire in Taiwanese Undergraduate Students

ERIC Educational Resources Information Center

Chen, Lung Hung; Tsai, Ying-Mei; Chen, Mei-Yen

2010-01-01

The aim of this study was to examine the psychometric properties of the Orientations to Happiness Questionnaire (OHQ; Peterson et al. in "J Happiness Stud" 6(1):25-41, 2005) in Taiwanese students. The participants were 578 undergraduate students (M[subscript age] = 18.64, SD = 1.02) and completed the OHQ, satisfaction with life scale…

Psychometric Properties of the Disability Assessment Schedule (DAS) for Behavior Problems: An Independent Investigation

ERIC Educational Resources Information Center

Tsakanikos, Elias; Underwood, Lisa; Sturmey, Peter; Bouras, Nick; McCarthy, Jane

2011-01-01

The present study employed the Disability Assessment Schedule (DAS) to assess problem behaviors in a large sample of adults with ID (N = 568) and evaluate the psychometric properties of this instrument. Although the DAS problem behaviors were found to be internally consistent (Cronbach's [alpha] = 0.87), item analysis revealed one weak item…

The Psychometric Properties of the Inventory of Callous-Unemotional Traits in an Undergraduate Sample

ERIC Educational Resources Information Center

Kimonis, Eva R.; Branch, Jessica; Hagman, Brett; Graham, Nicole; Miller, Cailey

2013-01-01

In the present study, the psychometric properties and factor structure of the 24-item Inventory of Callous-Unemotional Traits (ICU) were tested in a sample of 687 college students. Results support a similar 3-factor structure to that identified in samples of youths, in whom this measure was previously validated. Correlations with external…

Psychometric Properties of the Spence Children's Anxiety Scale: Parent Report in Children with Autism Spectrum Disorder

ERIC Educational Resources Information Center

Jitlina, Katia; Zumbo, Bruno; Mirenda, Pat; Ford, Laurie; Bennett, Teresa; Georgiades, Stelios; Waddell, Charlotte; Smith, Isabel M.; Volden, Joanne; Duku, Eric; Zwaigenbaum, Lonnie; Szatmari, Peter; Vaillancourt, Tracy; Elsabbagh, Mayada

2017-01-01

Although anxiety is frequently reported in children with autism spectrum disorder (ASD), existing anxiety scales are often psychometrically inappropriate for this population. This study examined the internal structure, reliability, convergent and discriminant validity of the Spence Children's Anxiety Scale-Parent Report (SCAS-P; Spence 1999) in…

Psychometric Properties of Virtual Reality Vignette Performance Measures: A Novel Approach for Assessing Adolescents' Social Competency Skills

ERIC Educational Resources Information Center

Paschall, Mallie J.; Fishbein, Diana H.; Hubal, Robert C.; Eldreth, Diana

2005-01-01

This study examined the psychometric properties of performance measures for three novel, interactive virtual reality vignette exercises developed to assess social competency skills of at-risk adolescents. Performance data were collected from 117 African-American male 15-17 year olds. Data for 18 performance measures were obtained, based on…

Assessing the Psychometric Properties of a Scenario-Based Measure of Achievement Guilt and Shame

ERIC Educational Resources Information Center

Thompson, Ted; Sharp, Jessica; Alexander, James

2008-01-01

In this study, the psychometric properties of the scenario-based Achievement Guilt and Shame Scale (AGSS) were established. The AGSS and scales assessing interpersonal guilt and shame, high standards, overgeneralization, self-criticism, self-esteem, academic self-concept, fear of failure, and tendency to respond in a socially desirable manner were…

Psychometric Characteristics of the Duke Social Support Index in a Young Rural Chinese Population

ERIC Educational Resources Information Center

Jia, Cunxian; Zhang, Jie

2012-01-01

The study is aimed to examine the psychometric characteristics of the Duke Social Support Scale (DSSI) in young rural Chinese individuals (379 suicides, 411 controls) aged 15-34 years. Social support was measured by 23-item DSSI, which included Social Interaction Scale, Subjective Social Support, and Instrumental Social Support. DSSI had high…

Development and Psychometric Evaluation of the Yale-Brown Obsessive-Compulsive Scale--Second Edition

ERIC Educational Resources Information Center

Storch, Eric A.; Rasmussen, Steven A.; Price, Lawrence H.; Larson, Michael J.; Murphy, Tanya K.; Goodman, Wayne K.

2010-01-01

The Yale-Brown Obsessive-Compulsive Scale (Y-BOCS; Goodman, Price, Rasmussen, Mazure, Delgado, et al., 1989) is acknowledged as the gold standard measure of obsessive-compulsive disorder (OCD) symptom severity. A number of areas where the Y-BOCS may benefit from revision have emerged in past psychometric studies of the Severity Scale and Symptom…

Factor Structure and Psychometric Properties of the Young Schema Questionnaire (Short Form) in Chinese Undergraduate Students

ERIC Educational Resources Information Center

Cui, Lixia; Lin, Wenwen; Oei, Tian P. S.

2011-01-01

This study investigated cross-cultural differences in the factor structure and psychometric properties of the Young Schema Questionnaire (short form; YSQ-SF). The participants were 712 Chinese undergraduate students. The total sample was randomly divided into two sub-samples. Exploratory Factor Analysis (EFA) was conducted on questionnaire results…

Psychometric Properties of the Beck Depression Inventory-II (BDI-II) among Community-Dwelling Older Adults

ERIC Educational Resources Information Center

Segal, Daniel L.; Coolidge, Frederick L.; Cahill, Brian S.; O'Riley, Alisa A.

2008-01-01

The psychometric properties of the Beck Depression Inventory-II (BDI-II) as a self-administered screening tool for depressive symptoms were examined in a sample of community-dwelling older and younger adults. Participants completed the BDI-II, the Center for Epidemiologic Studies Depression Scale, the Coolidge Axis II Inventory, the Perceived…

Development and Psychometric Testing of the Dogs and WalkinG Survey (DAWGS)

ERIC Educational Resources Information Center

Richards, Elizabeth A.; McDonough, Meghan H.; Edwards, Nancy E.; Lyle, Roseann M.; Troped, Philip J.

2013-01-01

Purpose: Dog owners represent 40% of the population, a promising audience to increase population levels of physical activity. The purpose of this study was to develop and test the psychometric properties of a new instrument to assess social-cognitive theory constructs related to dog walking. Method: Dog owners ("N" = 431) completed the…

Psychometric Properties of the Fatigue Severity Scale in Polio Survivors

ERIC Educational Resources Information Center

Burger, Helena; Franchignoni, Franco; Puzic, Natasa; Giordano, Andrea

2010-01-01

The objective of this study was to evaluate by means of classical test theory and Rasch analysis the scaling characteristics and psychometric properties of the Fatigue Severity Scale (FSS) in polio survivors. A questionnaire, consisting of five general questions (sex, age, age at time of acute polio, sequelae of polio, and new symptoms), the FSS,…

Examining the Psychometric Properties of the Achievement Goals Questionnaire among Nigerian Preservice Mathematics and Science Teachers

ERIC Educational Resources Information Center

Awofala, Adeneye O. A.; Arigbabu, Abayomi A.; Fatade, Alfred O.; Awofala, Awoyemi A.

2013-01-01

Introduction: The stability of the achievement goal orientation across different contexts has been a source of further research since the new millennium. Through theoretically-driven and empirically-based analyses, this study investigated the psychometric properties of the Elliot and McGregor 2x2 framework for achievement goal questionnaire within…

A Comparison of Domain-Referenced and Classic Psychometric Test Construction Methods.

ERIC Educational Resources Information Center

Willoughby, Lee; And Others

This study compared a domain referenced approach with a traditional psychometric approach in the construction of a test. Results of the December, 1975 Quarterly Profile Exam (QPE) administered to 400 examinees at a university were the source of data. The 400 item QPE is a five alternative multiple choice test of information a "safe"…

The Autism Impact Measure (AIM): Initial Development of a New Tool for Treatment Outcome Measurement

ERIC Educational Resources Information Center

Kanne, Stephen M.; Mazurek, Micah O.; Sikora, Darryn; Bellando, Jayne; Branum-Martin, Lee; Handen, Benjamin; Katz, Terry; Freedman, Brian; Powell, Mary Paige; Warren, Zachary

2014-01-01

The current study describes the development and psychometric properties of a new measure targeting sensitivity to change of core autism spectrum disorder (ASD) symptoms, the Autism Impact Measure (AIM). The AIM uses a 2-week recall period with items rated on two corresponding 5-point scales (frequency and impact). Psychometric properties were…

Assessing AD/HD in College Students: Psychometric Properties of the Barkley Self-Report Form

ERIC Educational Resources Information Center

Ladner, Jennifer M.; Schulenberg, Stefan E.; Smith, C. Veronica; Dunaway, Marcella H.

2011-01-01

The Barkley Current Symptoms Scale (BCSS)--Self-Report Form was designed to assess attention-deficit/hyperactivity disorder. The purpose of the current study was to add to BCSS psychometric literature in a sample of university students. Comparisons with normative data are provided, and implications for these findings are offered. (Contains 5…

“Connectedness to Nature Scale”: Validity and Reliability in the French Context

PubMed Central

Navarro, Oscar; Olivos, Pablo; Fleury-Bahi, Ghozlane

2017-01-01

Connectedness to nature represents the relationship of the self with the natural environment and has been operationalized using different scales. One of the most systematically studied in the Anglo-Saxon context is the Connectedness to Nature Scale (CNS). In an attempt to study the psychometric properties of this instrument in a French-speaking context, three studies (Study 1 n = 204, Study 2 n = 153, and Study 3 n = 322) were carried out in France to provide evidence of the internal consistency of the CNS, as well as its convergent, discriminant, and predictive validity. Moreover, as anticipated, positive correlations between the CNS and the environmental identity and environmental concerns scales were observed. Based on factorial analyses of maximum likelihood and reliability, an improvement in the psychometric properties was identified by eliminating three items. Through confirmatory factor analysis, the factorial structure and the psychometric properties of the CNS French version were confirmed, as well as their significate regression prediction on eudaimonic wellbeing. PMID:29312052

Psycho-oncology assessment in Chinese populations: a systematic review of quality of life and psychosocial measures.

PubMed

Hyde, M K; Chambers, S K; Shum, D; Ip, D; Dunn, J

2016-09-01

This systematic review describes psychosocial and quality of life (QOL) measures used in psycho-oncology research with cancer patients and caregivers in China. Medline and PsycINFO databases were searched (1980-2014). Studies reviewed met the following criteria: English language; peer-reviewed; sampled Chinese cancer patients/caregivers; developed, validated or assessed psychometric properties of psychosocial or QOL outcome measures; and reported validation data. The review examined characteristics of measures and participants, translation and cultural adaptation processes and psychometric properties of the measures. Ninety five studies met review criteria. Common characteristics of studies reviewed were they: assessed primarily QOL measures, sampled patients with breast, colorectal, or head and neck cancer, and validated existing measures (>80%) originating in North America or Europe. Few studies reported difficulties translating measures. Regarding psychometric properties of the measures >50% of studies reported subscale reliabilities <α = 0.70, <50% reported test-retest reliability, and <30% reported divergent validity. Few reported sensitivity, specificity or responsiveness. Improved accuracy and transparency of reporting for translation, cultural adaptation and psychometric testing of psychosocial measures is needed. Developing support structures for translating and validating psychosocial measures would enable this and ensure Chinese psycho-oncology clinical practice and research keeps pace with international focus on patient reported outcome measures and data management. © 2015 John Wiley & Sons Ltd.

A Psychometric Analysis and Standardization of the Behavior Assessment System for Children-2, Self-Report of Personality, Child Version among a Korean Sample

ERIC Educational Resources Information Center

Ahn, Christine M.; Ebesutani, Chad; Kamphaus, Randy

2014-01-01

The psychometric properties of the Korean version of the Behavior Assessment System for Children-2, Self-Report of Personality, Child Form (K-BASC-2 SRP-C) are reported. A total of 1100 Korean children ages 8-11 years participated in the study to establish normative data. The results of this study generally supported the factor structure and…

The technological influence on health professionals' care: translation and adaptation of scales1

PubMed Central

Almeida, Carlos Manuel Torres; Almeida, Filipe Nuno Alves dos Santos; Escola, Joaquim José Jacinto; Rodrigues, Vitor Manuel Costa Pereira

2016-01-01

Objectives: in this study, two research tools were validated to study the impact of technological influence on health professionals' care practice. Methods: the following methodological steps were taken: bibliographic review, selection of the scales, translation and cultural adaptation and analysis of psychometric properties. Results: the psychometric properties of the scale were assessed based on its application to a sample of 341 individuals (nurses, physicians, final-year nursing and medical students). The validity, reliability and internal consistency were tested. Two scales were found: Caring Attributes Questionnaire (adapted) with a Cronbach's Alpha coefficient of 0.647 and the Technological Influence Questionnaire (adapted) with an Alpha coefficient of 0.777. Conclusions: the scales are easy to apply and reveal reliable psychometric properties, an additional quality as they permit generalized studies on a theme as important as the impact of technological influence in health care. PMID:27143537

Bifactor and Item Response Theory Analyses of Interviewer Report Scales of Cognitive Impairment in Schizophrenia

PubMed Central

Reise, Steven P.; Ventura, Joseph; Keefe, Richard S. E.; Baade, Lyle E.; Gold, James M.; Green, Michael F.; Kern, Robert S.; Mesholam-Gately, Raquelle; Nuechterlein, Keith H.; Seidman, Larry J.; Bilder, Robert

2011-01-01

We conducted psychometric analyses of two interview-based measures of cognitive deficits: the 21-item Clinical Global Impression of Cognition in Schizophrenia (CGI-CogS; Ventura et al., 2008), and the 20-item Schizophrenia Cognition Rating Scale (SCoRS; Keefe et al., 2006), which were administered on two occasions to a sample of people with schizophrenia. Traditional psychometrics, bifactor analysis, and item response theory (IRT) methods were used to explore item functioning, dimensionality, and to compare instruments. Despite containing similar item content, responses to the CGI-CogS demonstrated superior psychometric properties (e.g., higher item-intercorrelations, better spread of ratings across response categories), relative to the SCoRS. We argue that these differences arise mainly from the differential use of prompts and how the items are phrased and scored. Bifactor analysis demonstrated that although both measures capture a broad range of cognitive functioning (e.g., working memory, social cognition), the common variance on each is overwhelmingly explained by a single general factor. IRT analyses of the combined pool of 41 items showed that measurement precision is peaked in the mild to moderate range of cognitive impairment. Finally, simulated adaptive testing revealed that only about 10 to 12 items are necessary to achieve latent trait level estimates with reasonably small standard errors for most individuals. This suggests that these interview-based measures of cognitive deficits could be shortened without loss of measurement precision. PMID:21381848

Psychophysics with children: Investigating the effects of attentional lapses on threshold estimates.

PubMed

Manning, Catherine; Jones, Pete R; Dekker, Tessa M; Pellicano, Elizabeth

2018-03-26

When assessing the perceptual abilities of children, researchers tend to use psychophysical techniques designed for use with adults. However, children's poorer attentiveness might bias the threshold estimates obtained by these methods. Here, we obtained speed discrimination threshold estimates in 6- to 7-year-old children in UK Key Stage 1 (KS1), 7- to 9-year-old children in Key Stage 2 (KS2), and adults using three psychophysical procedures: QUEST, a 1-up 2-down Levitt staircase, and Method of Constant Stimuli (MCS). We estimated inattentiveness using responses to "easy" catch trials. As expected, children had higher threshold estimates and made more errors on catch trials than adults. Lower threshold estimates were obtained from psychometric functions fit to the data in the QUEST condition than the MCS and Levitt staircases, and the threshold estimates obtained when fitting a psychometric function to the QUEST data were also lower than when using the QUEST mode. This suggests that threshold estimates cannot be compared directly across methods. Differences between the procedures did not vary significantly with age group. Simulations indicated that inattentiveness biased threshold estimates particularly when threshold estimates were computed as the QUEST mode or the average of staircase reversals. In contrast, thresholds estimated by post-hoc psychometric function fitting were less biased by attentional lapses. Our results suggest that some psychophysical methods are more robust to attentiveness, which has important implications for assessing the perception of children and clinical groups.

Psychometric validation of the POSIT for screening alcohol and other drugs risk consumption among adolescents.

PubMed

Araujo, Manuel; Golpe, Sandra; Braña, Teresa; Varela, Jesús; Rial, Antonio

2018-04-15

Early detection of alcohol and drug abuse among adolescents is decisive not only for rapid referral and intervention in cases of risk, but also as an indicator for use in the evaluation of prevention programs and public policies to reduce consumption. One of the most widely-used screening instruments in the world is the Problem Oriented Screening Instrument for Teenagers (POSIT) (Rahdert, 1991), whose substance use and abuse subscale (POSITUAS) is a brief tool of enormous applied potential. However, there is still no empirical validation study that would ensure its good psychometric performance in Spain. The aim of this paper is to analyse the psychometric properties of POSITUAS among Spanish adolescents. For this purpose, 569 students aged between 12 and 18 years (M = 14.71; SD = 1.79) were personally interviewed. The study sample was selected through two-stage sampling. The results obtained, using the Adolescent Diagnostic Interview (Winters & Henly, 1993) as the gold criterion, allow us to inform that the Spanish version of the POSITUAS has excellent psychometric behaviour, both at the level of internal consistency (a  = .82) as well as regards sensitivity (94.3%) and specificity (83.9%), with an area under the ROC curve of .953. Also, the realisation of a Confirmatory Factor Analysis allows for verifying the one-dimensional character of the scale. As a result, POSITUAS is made available to researchers and professionals in the field of addictive behaviours for use with a minimum of psychometric guarantees.

Social cognition in schizophrenia: Factor structure of emotion processing and theory of mind.

PubMed

Browne, Julia; Penn, David L; Raykov, Tenko; Pinkham, Amy E; Kelsven, Skylar; Buck, Benjamin; Harvey, Philip D

2016-08-30

Factor analytic studies examining social cognition in schizophrenia have yielded inconsistent results most likely due to the varying number and quality of measures. With the recent conclusion of Phase 3 of the Social Cognition Psychometric Evaluation (SCOPE) Study, the most psychometrically sound measures of social cognition have been identified. Therefore, the aims of the present study were to: 1) examine the factor structure of social cognition in schizophrenia through the utilization of psychometrically sound measures, 2) examine the stability of the factor structure across two study visits, 3) compare the factor structure of social cognition in schizophrenia to that in healthy controls, and 4) examine the relationship between the factors and relevant outcome measures including social functioning and symptoms. Results supported a one-factor model for the patient and healthy control samples at both visits. This single factor was significantly associated with negative symptoms in the schizophrenia sample and with social functioning in both groups at both study visits. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

"Who does this body belong to?" The development and psychometric evaluation of the Body Experience during Pregnancy Scale.

PubMed

Talmon, Anat; Ginzburg, Karni

2018-05-25

Women's experiences of their bodies during pregnancy may reflect their reactions to concrete physical changes as well as self-representations during the transition to motherhood. However, adequate measures of the body experience during pregnancy are lacking. This study aims to evaluate the psychometric properties of a new measure, the Body Experience during Pregnancy Scale (BEPS). In Study 1, the BEPS was administered to 423 pregnant women. In Study 2, 373 pregnant women completed the BEPS, as well as questionnaires assessing body shame, disrupted body boundaries, and well-being. Three BEPS subscales emerged from Study 1: body agency, body estrangement, and body visibility. In Study 2, a confirmatory factor analysis replicated the scale's structure. The factors were significantly correlated with measures of body shame, disrupted body boundaries, and well-being. The results of the present analyses suggest that the BEPS has good psychometric properties, making it useful in future research. Copyright © 2018 Elsevier Ltd. All rights reserved.

Social cognition in schizophrenia: Factor structure of emotion processing and theory of mind

PubMed Central

Browne, Julia; Penn, David L.; Raykov, Tenko; Pinkham, Amy E.; Kelsven, Skylar; Buck, Benjamin; Harvey, Philip D.

2018-01-01

Factor analytic studies examining social cognition in schizophrenia have yielded inconsistent results most likely due to the varying number and quality of measures. With the recent conclusion of Phase 3 of the Social Cognition Psychometric Evaluation (SCOPE) Study, the most psychometrically sound measures of social cognition have been identified. Therefore, the aims of the present study were to: 1) examine the factor structure of social cognition in schizophrenia through the utilization of psychometrically sound measures, 2) examine the stability of the factor structure across two study visits, 3) compare the factor structure of social cognition in schizophrenia to that in healthy controls, and 4) examine the relationship between the factors and relevant outcome measures including social functioning and symptoms. Results supported a one-factor model for the patient and healthy control samples at both visits. This single factor was significantly associated with negative symptoms in the schizophrenia sample and with social functioning in both groups at both study visits. PMID:27280525

Cognitive deficits are associated with poorer simulated driving in older adults with heart failure

PubMed Central

2013-01-01

Background Cognitive impairment is prevalent in older adults with heart failure (HF) and associated with reduced functional independence. HF patients appear at risk for reduced driving ability, as past work in other medical samples has shown cognitive dysfunction to be an important contributor to driving performance. The current study examined whether cognitive dysfunction was independently associated with reduced driving simulation performance in a sample of HF patients. Methods 18 persons with HF (67.72; SD = 8.56 year) completed echocardiogram and a brief neuropsychological test battery assessing global cognitive function, attention/executive function, memory and motor function. All participants then completed the Kent Multidimensional Assessment Driving Simulation (K-MADS), a driving simulator scenario with good psychometric properties. Results The sample exhibited an average Mini Mental State Examination (MMSE) score of 27.83 (SD = 2.09). Independent sample t-tests showed that HF patients performed worse than healthy adults on the driving simulation scenario. Finally, partial correlations showed worse attention/executive and motor function were independently associated with poorer driving simulation performance across several indices reflective of driving ability (i.e., centerline crossings, number of collisions, % of time over the speed limit, among others). Conclusion The current findings showed that reduced cognitive function was associated with poor simulated driving performance in older adults with HF. If replicated using behind-the-wheel testing, HF patients may be at elevated risk for unsafe driving and routine driving evaluations in this population may be warranted. PMID:24499466

Development of a Computer-Adaptive Physical Function Instrument for Social Security Administration Disability Determination

PubMed Central

Ni, Pengsheng; McDonough, Christine M.; Jette, Alan M.; Bogusz, Kara; Marfeo, Elizabeth E.; Rasch, Elizabeth K.; Brandt, Diane E.; Meterko, Mark; Chan, Leighton

2014-01-01

Objectives To develop and test an instrument to assess physical function (PF) for Social Security Administration (SSA) disability programs, the SSA-PF. Item Response Theory (IRT) analyses were used to 1) create a calibrated item bank for each of the factors identified in prior factor analyses, 2) assess the fit of the items within each scale, 3) develop separate Computer-Adaptive Test (CAT) instruments for each scale, and 4) conduct initial psychometric testing. Design Cross-sectional data collection; IRT analyses; CAT simulation. Setting Telephone and internet survey. Participants Two samples: 1,017 SSA claimants, and 999 adults from the US general population. Interventions None. Main Outcome Measure Model fit statistics, correlation and reliability coefficients, Results IRT analyses resulted in five unidimensional SSA-PF scales: Changing & Maintaining Body Position, Whole Body Mobility, Upper Body Function, Upper Extremity Fine Motor, and Wheelchair Mobility for a total of 102 items. High CAT accuracy was demonstrated by strong correlations between simulated CAT scores and those from the full item banks. Comparing the simulated CATs to the full item banks, very little loss of reliability or precision was noted, except at the lower and upper ranges of each scale. No difference in response patterns by age or sex was noted. The distributions of claimant scores were shifted to the lower end of each scale compared to those of a sample of US adults. Conclusions The SSA-PF instrument contributes important new methodology for measuring the physical function of adults applying to the SSA disability programs. Initial evaluation revealed that the SSA-PF instrument achieved considerable breadth of coverage in each content domain and demonstrated noteworthy psychometric properties. PMID:23578594

Scale refinement and initial evaluation of a behavioral health function measurement tool for work disability evaluation.

PubMed

Marfeo, Elizabeth E; Ni, Pengsheng; Haley, Stephen M; Bogusz, Kara; Meterko, Mark; McDonough, Christine M; Chan, Leighton; Rasch, Elizabeth K; Brandt, Diane E; Jette, Alan M

2013-09-01

To use item response theory (IRT) data simulations to construct and perform initial psychometric testing of a newly developed instrument, the Social Security Administration Behavioral Health Function (SSA-BH) instrument, that aims to assess behavioral health functioning relevant to the context of work. Cross-sectional survey followed by IRT calibration data simulations. Community. Sample of individuals applying for Social Security Administration disability benefits: claimants (n=1015) and a normative comparative sample of U.S. adults (n=1000). None. SSA-BH measurement instrument. IRT analyses supported the unidimensionality of 4 SSA-BH scales: mood and emotions (35 items), self-efficacy (23 items), social interactions (6 items), and behavioral control (15 items). All SSA-BH scales demonstrated strong psychometric properties including reliability, accuracy, and breadth of coverage. High correlations of the simulated 5- or 10-item computer adaptive tests with the full item bank indicated robust ability of the computer adaptive testing approach to comprehensively characterize behavioral health function along 4 distinct dimensions. Initial testing and evaluation of the SSA-BH instrument demonstrated good accuracy, reliability, and content coverage along all 4 scales. Behavioral function profiles of Social Security Administration claimants were generated and compared with age- and sex-matched norms along 4 scales: mood and emotions, behavioral control, social interactions, and self-efficacy. Using the computer adaptive test-based approach offers the ability to collect standardized, comprehensive functional information about claimants in an efficient way, which may prove useful in the context of the Social Security Administration's work disability programs. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Development of a computer-adaptive physical function instrument for Social Security Administration disability determination.

PubMed

Ni, Pengsheng; McDonough, Christine M; Jette, Alan M; Bogusz, Kara; Marfeo, Elizabeth E; Rasch, Elizabeth K; Brandt, Diane E; Meterko, Mark; Haley, Stephen M; Chan, Leighton

2013-09-01

To develop and test an instrument to assess physical function for Social Security Administration (SSA) disability programs, the SSA-Physical Function (SSA-PF) instrument. Item response theory (IRT) analyses were used to (1) create a calibrated item bank for each of the factors identified in prior factor analyses, (2) assess the fit of the items within each scale, (3) develop separate computer-adaptive testing (CAT) instruments for each scale, and (4) conduct initial psychometric testing. Cross-sectional data collection; IRT analyses; CAT simulation. Telephone and Internet survey. Two samples: SSA claimants (n=1017) and adults from the U.S. general population (n=999). None. Model fit statistics, correlation, and reliability coefficients. IRT analyses resulted in 5 unidimensional SSA-PF scales: Changing & Maintaining Body Position, Whole Body Mobility, Upper Body Function, Upper Extremity Fine Motor, and Wheelchair Mobility for a total of 102 items. High CAT accuracy was demonstrated by strong correlations between simulated CAT scores and those from the full item banks. On comparing the simulated CATs with the full item banks, very little loss of reliability or precision was noted, except at the lower and upper ranges of each scale. No difference in response patterns by age or sex was noted. The distributions of claimant scores were shifted to the lower end of each scale compared with those of a sample of U.S. adults. The SSA-PF instrument contributes important new methodology for measuring the physical function of adults applying to the SSA disability programs. Initial evaluation revealed that the SSA-PF instrument achieved considerable breadth of coverage in each content domain and demonstrated noteworthy psychometric properties. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Student ERI: Psychometric properties of a new brief measure of effort-reward imbalance among university students.

PubMed

Wege, Natalia; Li, Jian; Muth, Thomas; Angerer, Peter; Siegrist, Johannes

2017-03-01

Psychosocial stress among university students, particularly medical students, is considered a widely prevalent problem. There is a need for valid measurement of an adverse psychosocial stress environment in university settings. The aim of this study was to examine the psychometric properties of a newly developed short student version of the effort-reward imbalance (ERI) questionnaire in a sample of medical students. A cross-sectional survey with a self-administrated questionnaire containing three scales was conducted among 406 medical students. Item-total correlations and Cronbach's alpha were calculated to assess the internal consistency of the scales. Confirmatory factor analysis was applied to test factorial validity of the questionnaire structure. The student version of the ERI questionnaire provides acceptable psychometric properties. The Cronbach's alpha coefficients for effort, reward, and over-commitment were 0.67, 0.65, and 0.79, respectively. Confirmatory factor analysis displayed a satisfactory fit of the data structure with the theoretical concept (GFI>0.94). This student version of the ERI questionnaire provides a psychometrically tested tool for studies focussing on psychosocial environment in university settings. Further applications of this approach in other student groups are needed, in addition to prospective studies assessing associations with health outcomes. Copyright © 2017 Elsevier Inc. All rights reserved.

Psychometric Properties of the Diabetes Management Self-Efficacy Scale in Korean Patients with Type 2 Diabetes.

PubMed

Lee, Eun-Hyun; van der Bijl, Jaap; Shortridge-Baggett, Lillie M; Han, Seung Jin; Moon, Seung Hei

2015-01-01

Objectives. The aims of this study were to perform a cultural translation of the DMSES and evaluate the psychometric properties of the translated scale in a Korean population with type 2 diabetics. Methods. This study was conducted in patients with diabetes recruited from university hospitals. The first stage of this study involved translating the DMSES into Korean using a forward- and backward-translation technique. The content validity was assessed by an expert group. In the second stage, the psychometric properties of the Korean version of the DMSES (K-DMSES) were evaluated. Results. The content validity of the K-DMSES was satisfactory. Sixteen-items clustered into four-subscales were extracted by exploratory factor analysis, and supported by confirmatory factor analysis. The construct validity of the K-DMSES with the Summary of Diabetes Self-Care Activities scale was satisfactory (r = 0.50, P<0.001). The Cronbach's alpha and intraclass correlation coefficient were 0.92 and 0.85 (P<0.001; 95% CI = 0.75-0.91), respectively, which indicate excellent internal consistency reliability and test-retest reliability. Conclusions. The K-DMSES is a brief instrument that has demonstrated good psychometric properties. It is therefore feasible to use in practice, and is ready for use in clinical research involving Korean patients with type 2 diabetes.

[Has the translation process impact on the psychometric structure of a questionnaire?].

PubMed

Pook, Martin; Tuschen-Caffier, Brunna; Kaufmann, Ulrike

2006-01-01

Little is known about the impact of item translation on the psychometric structure of questionnaires. The analysis of different translation versions within the same language provides an opportunity to address this question. Therefore, in the present study, two of the six available German translations of Eating Disorder Inventory (EDI) were compared with respect to their psychometric structure. A total of 449 female students completed the short forms of the EDI (consisting of the subscales drive for thinness, bulimia and body dissatisfaction). Structural equation modeling revealed that the item contents in both translations had been interpreted equivalently by the participants. In addition, the structural relations among the factors were equivalent across both versions. Whereas invariance of item-pair reliability was not tenable, the distribution of raw scores of the scales was similar. All in all, the findings suggest a very large degree of similarity in the psychometric structure of the alternative translations of the EDI versions. The results are discussed with respect to the lack of standards for the translation of questionnaires.

Psychometric Comparison of Self- and Informant-Reports of Personality

PubMed Central

Olino, Thomas M.; Klein, Daniel N.

2017-01-01

Self-reports are the most relied on assessment method in psychology. In the area of personality, informant-reports are a reasonable alternative assessment strategy. However, agreement between self- and informant-reports of personality is only moderately good. A portion of the observed discrepancies between self- and informant-reports of personality may come from differences in psychometric measurement across raters. That is, it is unknown whether the constructs assessed via self- and informant-reports are psychometrically identical. We examined four key personality scales—Well-Being, Social Closeness, Stress Reaction, and Harm Avoidance—in male and female dyads who provided self- and informant-reports for their partner. Similarities in self- and informant-reports of personality were evaluated by testing measurement invariance. Overall, models supported configural, metric, and scalar invariance for each of the four personality dimensions. These results suggest that the same psychometric constructs are assessed via self- and informant-reports of these personality dimensions. Informant-reports can be used in studies to avoid biases from relying solely on self-reports. PMID:25612626

The Youth Psychopathic Traits Inventory: Measurement Invariance and Psychometric Properties among Portuguese Youths

PubMed Central

Pechorro, Pedro; Ribeiro da Silva, Diana; Andershed, Henrik; Rijo, Daniel; Abrunhosa Gonçalves, Rui

2016-01-01

The aim of the present study was to examine the psychometric properties of the Youth Psychopathic Traits Inventory (YPI) among a mixed-gender sample of 782 Portuguese youth (M = 15.87 years; SD = 1.72), in a school context. Confirmatory factor analysis revealed the expected three-factor first-order structure. Cross-gender measurement invariance and cross-sample measurement invariance using a forensic sample of institutionalized males were also confirmed. The Portuguese version of the YPI demonstrated generally adequate psychometric properties of internal consistency, mean inter-item correlation, convergent validity, discriminant validity, and criterion-related validity of statistically significant associations with conduct disorder symptoms, alcohol abuse, drug use, and unprotected sex. In terms of known-groups validity, males scored higher than females, and males from the school sample scored lower than institutionalized males. The use of the YPI among the Portuguese male and female youth population is psychometrically justified, and it can be a useful measure to identify adolescents with high levels of psychopathic traits. PMID:27571095

Screening Avoidant/Restrictive Food Intake Disorder (ARFID) in children: Outcomes from utilitarian versus specialist psychometrics.

PubMed

Dovey, Terence M; Aldridge, Victoria K; Martin, Clarissa I; Wilken, Markus; Meyer, Caroline

2016-12-01

This study assessed the specificity and sensitivity of two commonly used psychometric methods to assess ARFID in children. To achieve this, a sample of 329 mothers and one father completed the Behavioral Pediatrics Feeding Assessment Scale (BPFAS) and the Child Food Neophobia Scale (CFNS). A Receiver Operating Characteristic (ROC) analysis indicated that both measures were able to successfully differentiate a known clinical sample from those of typically developing population. Although the BPFAS was more accurate at differentiating ARFID from the general population, the CFNS was acceptable and on some metrics better than its longer counterpart. The ability of a food neophobia scale to differentiate clinical and population samples, and detect gradation of food avoidance within the population sample, suggests that the multitude of psychometric measures available may be measuring similar constructs. Therefore, confidence can be expected in cross-site comparisons despite each using different psychometric measures of food avoidance in children. Copyright © 2016 Elsevier Ltd. All rights reserved.

Psychometric evaluation of the shortened resilience scale among Alzheimer's caregivers.

PubMed

Wilks, Scott E

2008-01-01

The purpose of this study was to evaluate psychometric properties of the shortened Resilience Scale (15-item version RS15) among a sample of Alzheimer's caregivers. Self-reported data were collected from 229 participants at 2 Alzheimer's caregiver conferences. RS15 principal axis factoring indicated a single-dimensional solution with all items loaded. Reliability was strong. Convergent validity for the RS15 was suggested through its correlations with stress, family support, and friend support. Odds ratios showed significant likelihoods of high resilience given low stress and high social support. The results confirmed the RS15 to be a psychometrically sound measure that can be used to appraise the efficacy of adaptability among Alzheimer's caregivers.

Development and psychometric testing of a chinese version of the caregiver burden index for parents of children with allergies.

PubMed

Liu, Pei-Ching; Gau, Bih-Shya; Hung, Chao-Chia

2015-01-01

BACKGROUNG: No specific instrument has thus far been developed for measuring the caregiver burden perceived by parents of children with allergies (CWA). To determine the psychometric properties of the Caregiver Burden Index (CBI). A mixed-methods design was adopted to evaluate the psychometric properties of the scale. The content validity index was 0.89, and the internal consistency was high with a coefficient alpha of 0.98. Three factors were extracted after exploratory factor analysis. The study findings suggest that the CBI has sufficient reliability and validity to evaluate the caregiver burden of parents of CWA. Copyright © 2015 Elsevier Inc. All rights reserved.

A Psychometric Evaluation of the Behavioral Inhibition Questionnaire in a Non-Clinical Sample of Dutch Children and Adolescents

ERIC Educational Resources Information Center

Broeren, Suzanne; Muris, Peter

2010-01-01

The Behavioral Inhibition Questionnaire (BIQ) is a parent-rating scale for measuring temperamental characteristics referring to shyness, fearfulness, and withdrawal in young, preschool children. The present study evaluated the psychometric properties of the BIQ in a Dutch community sample of children with a broad age range. For this purpose, the…

Psychometric Assessment and Reporting Practices: Incongruence between Theory and Practice

ERIC Educational Resources Information Center

Slaney, Kathleen L.; Tkatchouk, Masha; Gabriel, Stephanie M.; Maraun, Michael D.

2009-01-01

The aim of the current study is twofold: (a) to investigate the rates at which researchers assess and report on the psychometric properties of the measures they use in their research and (b) to examine whether or not researchers appear to be generally employing sound/unsound rationales when it comes to how they conduct test evaluations. Based on a…

Support for Alzheimer's Caregivers: Psychometric Evaluation of Familial and Friend Support Measures

ERIC Educational Resources Information Center

Wilks, Scott E.

2009-01-01

Objective: Information on the shortened, 20-item version of the Perceived Social Support Scale (S-PSSS) is scarce. The purpose of this study is to evaluate the psychometric properties of the S-PSSS Family (SSfa) and Friends (SSfr) subscales. Method: Because of their common coping method of social support, a cross-sectional sample of Alzheimer's…

The Empathy and Systemizing Quotient: The Psychometric Properties of the Dutch Version and a Review of the Cross-Cultural Stability

ERIC Educational Resources Information Center

Groen, Y.; Fuermaier, A. B. M.; Den Heijer, A. E.; Tucha, O.; Althaus, M.

2015-01-01

The "Empathy Quotient" (EQ) and "Systemizing Quotient" (SQ) are used worldwide to measure people's empathizing and systemizing cognitive styles. This study investigates the psychometric properties of the Dutch EQ and SQ in healthy participants (n = 685), and high functioning males with autism spectrum disorder (n = 42). Factor…

Examination of the Psychometric Properties of the Knowledge of Aging for Social Work Quiz

ERIC Educational Resources Information Center

Nakao, Kayoko C.; Damron-Rodriguez, JoAnn; Lawrance, Frances P.; Volland, Patricia J.

2013-01-01

Using graduate social work students' data ("n" = 481) in the Hartford Partnership Program for Aging Education (HPPAE) in the United States, the study examined psychometric properties of the Knowledge of Aging for Social Work Quiz (KASW), a revision of the Facts on Aging Quiz, to evaluate biopsychosocial knowledge relevant to social work.…

The Career Transition Inventory: A Psychometric Evaluation of a French Version (CTI-F)

ERIC Educational Resources Information Center

Fernandez, Anne; Fouquereau, Evelyne; Heppner, Mary J.

2008-01-01

The Career Transition Inventory (CTI) is a well-known measure for assessing perceptions of psychological resources when adults undergo a career change. The purpose of this study was to conduct a psychometric evaluation of a French version of the CTI (CTI-F). A total of 1,042 French volunteer participants completed the CTI-F. The procedure used…

Psychometric Evaluation of an Arabic Version of the Spiritual Involvement and Beliefs Scale in Jordanian Muslim College Nursing Students

ERIC Educational Resources Information Center

Musa, Ahmad S.

2015-01-01

A review of the nursing and health-related literature on spirituality revealed that no valid and reliable research tool exists in Arabic for measuring spiritual beliefs and practices for Arab Muslim population. This study translated the Spiritual Involvement and Beliefs Scale (SIBS) into Arabic and examined the psychometric properties of the…

Psychometric Qualities of the UCLA Loneliness Scale-Version 3 as Applied in a Turkish Culture

ERIC Educational Resources Information Center

Durak, Mithat; Senol-Durak, Emre

2010-01-01

The University of California, Los Angeles, Loneliness Scale-Version 3 (UCLA LS3) is the most frequently used loneliness assessment tool. This study aimed to examine the psychometric properties of the UCLA LS3 by utilizing two separate and independent samples: Turkish university students (n = 481) and elderly (n = 284). The results demonstrate that…

The Children’s Behavior Questionnaire very short scale: Psychometric properties and development of a one-item temperament scale

USDA-ARS?s Scientific Manuscript database

Little research has been conducted on the psychometrics of the very short scale (36 items) of the Children’s Behavior Questionnaire, and no one-item temperament scale has been tested for use in applied work. In this study, 237 United States caregivers completed a survey to define their child’s behav...

Quality of Life Assessment for Physical Activity and Health Promotion: Further Psychometrics and Comparison of Measures

ERIC Educational Resources Information Center

Gill, Diane L.; Reifsteck, Erin J.; Adams, Melanie M.; Shang, Ya-Ting

2015-01-01

Despite the clear relationship between physical activity and quality of life, few sound, relevant quality of life measures exist. Gill and colleagues developed a 32-item quality of life survey, and provided initial psychometric evidence. This study further examined that quality of life survey in comparison with the widely used short form (SF-36)…

The Shortened Raven Standard Progressive Matrices: Item Response Theory-Based Psychometric Analyses and Normative Data

ERIC Educational Resources Information Center

Van der Elst, Wim; Ouwehand, Carolijn; van Rijn, Peter; Lee, Nikki; Van Boxtel, Martin; Jolles, Jelle

2013-01-01

The purpose of the present study was to evaluate the psychometric properties of a shortened version of the Raven Standard Progressive Matrices (SPM) under an item response theory framework (the one- and two-parameter logistic models). The shortened Raven SPM was administered to N = 453 cognitively healthy adults aged between 24 and 83 years. The…

Psychometric Properties of Eating Disorder Instruments in Black and White Young Women: Internal Consistency, Temporal Stability, and Validity

ERIC Educational Resources Information Center

Bardone-Cone, Anna M.; Boyd, Clarissa A.

2007-01-01

Most of the major instruments in the eating disorder field have documented psychometric support only in predominantly White samples. The current study examined the internal consistency, temporal stability, and convergent and discriminant validity of a variety of eating disorder measures in Black (n = 97) and White (n = 179) female undergraduates.…

A Review of Psychometric Assessment and Reporting Practices: An Examination of Measurement-Oriented versus Non-Measurement-Oriented Domains

ERIC Educational Resources Information Center

Slaney, Kathleen L.; Tkatchouk, Masha; Gabriel, Stephanie M.; Ferguson, Leona P.; Knudsen, Jared R. S.; Legere, Julien C.

2010-01-01

The primary aim of the present study is to determine whether the psychometric evaluation practices and test-analytic rationales of researchers publishing in journals with a measurement focus differ from those of researchers publishing in journals with varying substantive research foci. Several components of two different samples of articles were…

Factor Structure and Psychometric Properties of the Revised Home Situations Questionnaire for Autism Spectrum Disorder: The Home Situations Questionnaire-Autism Spectrum Disorder

ERIC Educational Resources Information Center

Chowdhury, Monali; Aman, Michael G.; Lecavalier, Luc; Smith, Tristram; Johnson, Cynthia; Swiezy, Naomi; McCracken, James T.; King, Bryan; McDougle, Christopher J.; Bearss, Karen; Deng, Yanhong; Scahill, Lawrence

2016-01-01

Previously, we adapted the Home Situations Questionnaire to measure behavioral non-compliance in everyday settings in children with pervasive developmental disorders. In this study, we further revised this instrument for use in autism spectrum disorder and examined its psychometric properties (referred to as the Home Situations…

Psychometric Evaluation of the Serbian Version of the Multidimensional Students' Life Satisfaction Scale

ERIC Educational Resources Information Center

Jovanovic, Veljko; Zuljevic, Dragan

2013-01-01

The main purpose of this study was to evaluate psychometric properties of the Serbian version of the Multidimensional Students' Life Satisfaction Scale (MSLSS). The research was carried out on a sample of 408 high school students (250 females, 158 males), with the mean age 16.6. The Serbian version of the MSLSS has demonstrated good psychometric…

Validation of the Beck Depression Inventory-II in a Low-Income African American Sample of Medical Outpatients

ERIC Educational Resources Information Center

Grothe, Karen B.; Dutton, Gareth R.; Jones, Glenn N.; Bodenlos, Jamie; Ancona, Martin; Brantley, Phillip J.

2005-01-01

The psychometric properties of the Beck Depression Inventory-II (BDI-II) are well established with primarily Caucasian samples. However, little is known about its reliability and validity with minority groups. This study evaluated the psychometric properties of the BDI-II in a sample of low-income African American medical outpatients (N = 220).…

Examination of the Psychometric Properties of the Environmental School Transition Anxiety Scale

ERIC Educational Resources Information Center

Loke, Stephen W.; Lowe, Patricia A.

2013-01-01

A pilot study was conducted to examine the psychometric properties of the Environmental School Transition Anxiety Scale (E-STAS) with a sample of 220 fourth- to sixth-grade students who were about to or had completed their school transition. The results of an exploratory factor analysis (EFA) of the students' responses on the E-STAS produced a…

The Psychometric Analysis of the Persian Version of the Strategy Inventory for Language Learning of Rebecca L. Oxford

ERIC Educational Resources Information Center

Fazeli, Seyed Hossein

2012-01-01

The current study aims to analyze the psychometric qualities of the Persian adapted version of Strategy Inventory for Language Learning (SILL) developed by Rebecca L. Oxford (1990). Three instruments were used: Persian adapted version of SILL, a Background Questionnaire, and Test of English as a Foreign Language. Two hundred and thirteen Iranian…

Psychometric Support of the School Climate Measure in a Large, Diverse Sample of Adolescents: A Replication and Extension

ERIC Educational Resources Information Center

Zullig, Keith J.; Collins, Rani; Ghani, Nadia; Patton, Jon M.; Huebner, E. Scott; Ajamie, Jean

2014-01-01

Background: The School Climate Measure (SCM) was developed and validated in 2010 in response to a dearth of psychometrically sound school climate instruments. This study sought to further validate the SCM on a large, diverse sample of Arizona public school adolescents (N = 20,953). Methods: Four SCM domains (positive student-teacher relationships,…

Conceptual and Psychometric Properties of a Self-Efficacy Perception Scale Based on Teaching Turkish as a Foreign Language

ERIC Educational Resources Information Center

Sahin, Cavus; Eryaman, Mustafa Yunus; Kocer, Tugba; Kocer, Omer

2013-01-01

The main purpose of this descriptive research study is to investigate the conceptual and psychometric properties of a self-efficacy perception scale developed for determining self-efficacy perception of 3rd and 4th grade Turkish pre-service teachers, who took Turkish as a Foreign Language (TFL) course theoretically in undergraduate level, towards…

Measuring Grief Following Miscarriage: Psychometric Properties of the Chinese Version of the Perinatal Grief Scale

ERIC Educational Resources Information Center

Lai, Beatrice P. Y.; Chung, Tony K. H.; Lee, Dominic T. S.; Kong, Grace W. S.; Lok, Ingrid H.

2013-01-01

Grief following miscarriage is a complex psychological response. This study was conducted to examine the psychometric properties of the Chinese version of the Perinatal Grief Scale (PGS). A total of 280 Chinese women completed the PGS immediately following a diagnosis of miscarriage (baseline) and were reassessed at 12 months follow-up. The factor…

Psychometric Evaluation of the Connor-Davidson Resilience Scale (CD-RISC) Using Iranian Students

ERIC Educational Resources Information Center

Khoshouei, Mahdieh Sadat

2009-01-01

The purpose of this study was to evaluate the psychometric properties of the Persian version of the Connor-Davidson Resilience Scale (CD-RISC). The CD-RISC was completed by a sample of 323 Isfahan university students (168 females, 155 males) aged 19-34 years. A maximum likelihood method with an oblique solution resulted in four factors…

Mother Reports of Maternal Support Following Child Sexual Abuse: Preliminary Psychometric Data on the Maternal Self-Report Support Questionnaire (MSSQ)

ERIC Educational Resources Information Center

Smith, Daniel W.; Sawyer, Genelle K.; Jones, Lisa M.; Cross, Theodore; McCart, Michael R.; Ralston, M. Elizabeth

2010-01-01

Objective: Maternal support is an important factor in predicting outcomes following disclosure of child sexual abuse; however, definition of the construct has been unclear and existing measures of maternal support are utilized inconsistently and have limited psychometric data. The purpose of this study was to develop a reliable and valid…

Psychometric Evaluation of a Chinese Version of the eHealth Literacy Scale (eHEALS) in School Age Children

ERIC Educational Resources Information Center

Koo, Malcolm; Norman, Cameron D.; Chang, Hsiao-Mei

2012-01-01

The eight-item eHealth Literacy Scale (eHEALS) is a previously validated scale developed to assess consumers' combined knowledge, comfort, and perceived skills at finding, evaluating, and applying electronic health information to health problems. In the present study, a Chinese version of the eHEALS was developed and its psychometric properties…

An Item-Level Psychometric Analysis of the Personality Assessment Inventory: Clinical Scales in a Psychiatric Inpatient Unit

ERIC Educational Resources Information Center

Siefert, Caleb J.; Sinclair, Samuel J.; Kehl-Fie, Kendra A.; Blais, Mark A.

2009-01-01

Multi-item multiscale self-report measures are increasingly used in inpatient assessments. When considering a measure for this setting, it is important to evaluate the psychometric properties of the clinical scales and items to ensure that they are functioning as intended in a highly distressed clinical population. The present study examines scale…

Psychometric Properties of the Epistemological Development in Teaching Learning Questionnaire (EDTLQ): An Inventory to Measure Higher Order Epistemological Development

ERIC Educational Resources Information Center

Kjellström, Sofia; Golino, Hudson; Hamer, Rebecca; Van Rossum, Erik Jan; Almers, Ellen

2016-01-01

Qualitative research supports a developmental dimension in views on teaching and learning, but there are currently no quantitative tools to measure the full range of this development. To address this, we developed the Epistemological Development in Teaching and Learning Questionnaire (EDTLQ). In the current study the psychometric properties of the…

Psychometric Validation and Normative Data of a Second Chinese Version of the Hooper Visual Organization Test in Children

ERIC Educational Resources Information Center

Lin, Yueh-Hsien; Su, Chwen-Yng; Guo, Wei-Yuan; Wuang, Yee-Pay

2012-01-01

The Hooper Visual Organization Test (HVOT) is a measure of visuosynthetic ability. Previously, the psychometric properties of the HVOT have been evaluated for Chinese-speaking children aged 5-11 years. This study reports development and further evidence of reliability and validity for a second version involving an extended age range of healthy…

Psychometrics of the Emotional Intelligence Scale in Elite, Amateur, and Non-Athletes

ERIC Educational Resources Information Center

Vaughan, Robert; Laborde, Sylvain

2018-01-01

The purpose of this study was to assess the psychometrics properties of the Emotional Intelligence Scale and assess the measurement invariance across elite (n = 367), amateur (n = 629), and non-athletes (n = 550). In total, 1,546 participants from various sports completed the emotional intelligence scale. Several competing models were compared…

Sudanese Students' Perceptions of Their Class Activities: Psychometric Properties and Measurement Invariance of My Class Activities--Arabic Language Version

ERIC Educational Resources Information Center

Pereira, Nielsen; Bakhiet, Salaheldin Farah; Gentry, Marcia; Balhmar, Tahani Abdulrahman; Hakami, Sultan Mohammed

2017-01-01

This study examined the psychometric properties and measurement invariance of the Arabic version of "My Class Activities" (MCA), an instrument designed to measure students' perceptions of interest, challenge, choice, and enjoyment in classrooms. Scores of 3,516 Sudanese students in Grades 2 to 8 were used. Confirmatory factor analysis…

The Continuum of Conflict and Control Relationship Scale (CCC-RS): Psychometrics for a Measure Designed to Discriminate among Types of Intimate Partner Violence

ERIC Educational Resources Information Center

Carlson, Ryan G.; Rogers, Tiffany L.; Wheeler, Naomi J.; Kelchner, Viki; Griffith, Sandy-Ann M.; Liu, Xun

2017-01-01

Intimate partner violence (IPV) classifications have treatment implications for couples. This study tested the psychometrics of the Continuum of Conflict and Control Relationship Scale (CCC-RS) and examined differences between violence severity and CCC-RS scales. A sample of 575 low-income, ethnically diverse participants contributed data. Results…

Behavioral and Psychometric Characteristics of Educable Mentally Retarded, Emotionally Handicapped, Learning Disabled, At-Risk and Normal Students. Final Report.

ERIC Educational Resources Information Center

Sherry, Lee

The study, involving 100 children (11 and 12 years old), was designed to generate descriptive data regarding the behavioral and psychometric characteristics of exceptional children in the public schools. A review of the literature revealed that it is difficult to make a differential diagnosis among educable mentally retarded (EMR), emotionally…

Assessing Psychological Inflexibility: The Psychometric Properties of the Avoidance and Fusion Questionnaire for Youth in Two Adult Samples

ERIC Educational Resources Information Center

Fergus, Thomas A.; Valentiner, David P.; Gillen, Michael J.; Hiraoka, Regina; Twohig, Michael P.; Abramowitz, Jonathan S.; McGrath, Patrick B.

2012-01-01

The current study examined whether the Avoidance and Fusion Questionnaire for Youth (AFQ-Y; L. A. Greco, W. Lambert, & R. A. Baer, 2008), a self-report measure of psychological inflexibility for children and adolescents, might be useful for measuring psychological inflexibility for adults. The psychometric properties of the AFQ-Y were examined…

Psychometric Evaluation of the Fear of Positive Evaluation Scale in Patients with Social Anxiety Disorder

ERIC Educational Resources Information Center

Weeks, Justin W.; Heimberg, Richard G.; Rodebaugh, Thomas L.; Goldin, Philippe R.; Gross, James J.

2012-01-01

The Fear of Positive Evaluation Scale (FPES; J. W. Weeks, R. G. Heimberg, & T. L. Rodebaugh, 2008) was designed to assess fear of positive evaluation, a proposed cognitive component of social anxiety. Although previous findings on the psychometric properties of the FPES have been highly encouraging, only 1 previous study has examined the…

Psychometric Properties of the Sutter-Eyberg Student Behavior Inventory with Rural Middle School and High School Children

ERIC Educational Resources Information Center

Floyd, Erin M.; Rayfield, Arista; Eyberg, Sheila M.; Riley III, Joseph L.

2004-01-01

This study examined the psychometric properties of the Sutter-Eyberg Student Behavior Inventory (SESBI) in a rural sample of children and adolescents. Thirty-eight 5th- through 12th-grade teachers completed the SESBI on 726 children in their classrooms. High Cronbach's alphas supported the reliability of the SESBI scales in this population. Higher…

A Psychometric Analysis of the Child Behavior Checklist for Elementary School Children in Qatar

ERIC Educational Resources Information Center

Al-Hendawi, Maha; Keller, Clayton; Cloninger, Lea

2016-01-01

The Child Behavior Checklist for children 6 to 18 (CBCL/6-18) is a widely used, standardized parent rating scale. However, few studies have tested the psychometric properties of this instrument in the Arab world despite the great need for such instruments to support the identification and education of children with emotional, behavioral, and…

An Evaluation of the Psychometric Properties of Three Different Forms of Daly and Miller's Writing Apprehension Test through Rasch Analysis

ERIC Educational Resources Information Center

Güler, Nese; Ilhan, Mustafa; Güneyli, Ahmet; Demir, Süleyman

2017-01-01

This study evaluates the psychometric properties of three different forms of the Writing Apprehension Test (WAT; Daly & Miller, 1975) through Rasch analysis. For this purpose, the fit statistics and correlation coefficients, and the reliability, separation ratio, and chi-square values for the facets of item and person calculated for the…

The Development and Psychometric Assessment of a Scale to Measure the Severity of Examination Anxiety among Undergraduate University Students

ERIC Educational Resources Information Center

Bedewy, Dalia; Gabriel, Adel

2013-01-01

The study reported here aimed to develop and psychometrically assess an instrument to measure examination anxiety among undergraduate university students. Based on empirical evidence and recent literature review we developed a 12 item scale to measure the severity of examination anxiety. The instrument was administered to students, two weeks…

Brief Report: An Independent Replication and Extension of Psychometric Evidence Supporting the Theory of Mind Inventory

ERIC Educational Resources Information Center

Greenslade, Kathryn J.; Coggins, Truman E.

2016-01-01

This study presents an independent replication and extension of psychometric evidence supporting the "Theory of Mind Inventory" ("ToMI"). Parents of 20 children with ASD (4; 1-6; 7 years; months) and 20 with typical development (3; 1-6; 5), rated their child's theory of mind abilities in everyday situations. Other parent report…

Self-rating of daily time management in children: psychometric properties of the Time-S.

PubMed

Sköld, Annika; Janeslätt, Gunnel Kristina

2017-05-01

Impaired ability to manage time has been shown in several diagnoses common in childhood. Impaired ability involves activities and participation domain (daily time management, DTM) and body function and structure domain (time-processing ability, TPA). DTM needs to be evaluated from an individual's own perspective. To date, there has been a lack of self-rating instruments for children that focus on DTM. The aim of this study is to describe psychometric properties of Time-S when used in children aged 10-17 years with a diagnosis of ADHD, Autism, CP or mild ID. Further, to test whether TPA correlates with self-rated DTM. Eighty-three children aged 10-17 years participated in the study. Rasch analysis was used to assess psychometric properties. Correlation analysis was performed between Time-S and a measure of TPA. The 21 items of the Time-S questionnaire fit into a unitary construct measuring self-perceived daily management of an individual's time. A non-significant, small correlation was found between TPA and DTM. The results indicate good psychometric properties for the questionnaire. The questionnaire is potentially useful in intervention planning and evaluation.

Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 1—Psychometric Characteristics of 5 Paradigms

PubMed Central

Reddy, L. Felice; Horan, William P.; Barch, Deanna M.; Buchanan, Robert W.; Dunayevich, Eduardo; Gold, James M.; Lyons, Naomi; Marder, Stephen R.; Treadway, Michael T.; Wynn, Jonathan K.; Young, Jared W.; Green, Michael F.

2015-01-01

Impairments in willingness to exert effort contribute to the motivational deficits characteristic of the negative symptoms of schizophrenia. The current study evaluated the psychometric properties of 5 new or adapted paradigms to determine their suitability for use in clinical trials of schizophrenia. This study included 94 clinically stable participants with schizophrenia and 40 healthy controls. The effort-based decision-making battery was administered twice to the schizophrenia group (baseline, 4-week retest) and once to the control group. The 5 paradigms included 1 that assesses cognitive effort, 1 perceptual effort, and 3 that assess physical effort. Each paradigm was evaluated on (1) patient vs healthy control group differences, (2) test-retest reliability, (3) utility as a repeated measure (ie, practice effects), and (4) tolerability. The 5 paradigms showed varying psychometric strengths and weaknesses. The Effort Expenditure for Rewards Task showed the best reliability and utility as a repeated measure, while the Grip Effort Task had significant patient-control group differences, and superior tolerability and administration duration. The other paradigms showed weaker psychometric characteristics in their current forms. These findings highlight challenges in adapting effort and motivation paradigms for use in clinical trials. PMID:26142081

Construction and psychometric characteristics of the self-concept scale of interaction in the classroom.

PubMed

Lobos Peña, Karla; Díaz Mújica, Alejandro; Bustos Navarrete, Claudio; Pérez Villalobos, María Victoria

2015-01-01

Both construction and psychometric characteristics of a self-concept scale associated with observable behaviors by students and teacher, useful to guide a pedagogic intervention in the classroom are presented. A total of 1,385 primary school students, aged between 8 and 12 years, from 24 high-social vulnerability schools of the Province of Concepción, Chile, participated in the study. The scale was constructed, including a theoretical review of the construct, pilot application with students and interjudge reliability. For the study of psychometric characteristics, exploratory factorial analysis (EFA), confirmatory factorial analysis (CFA), factorial invariance and recurrent validity were performed. A self-report instrument with 22 items shows a three-factor structure, with an explained variance of 44.71% and a high level of fi t for the model. CFA in two different samples showed fi t indicators for configural invariance. It also has concurrent validity. The scale has good psychometric properties to assess the academic self-concept in the dimensions of Capacity, Work Procedure, and Participation in class. This can be useful to guide an educational intervention in the context of the teacher-student interaction in the classroom, in primary schools with high socio-economic vulnerability.

Psychometrics and its discontents: an historical perspective on the discourse of the measurement tradition.

PubMed

Schoenherr, Jordan Richard; Hamstra, Stanley J

2016-08-01

Psychometrics has recently undergone extensive criticism within the medical education literature. The use of quantitative measurement using psychometric instruments such as response scales is thought to emphasize a narrow range of relevant learner skills and competencies. Recent reviews and commentaries suggest that a paradigm shift might be presently underway. We argue for caution, in that the psychometrics approach and the quantitative account of competencies that it reflects is based on a rich discussion regarding measurement and scaling that led to the establishment of this paradigm. Rather than reflecting a homogeneous discipline focused on core competencies devoid of consideration of context, the psychometric community has a history of discourse and debate within the field, with an acknowledgement that the techniques and instruments developed within psychometrics are heuristics that must be used pragmatically.

The German VR Simulation Realism Scale--psychometric construction for virtual reality applications with virtual humans.

PubMed

Poeschl, Sandra; Doering, Nicola

2013-01-01

Virtual training applications with high levels of immersion or fidelity (for example for social phobia treatment) produce high levels of presence and therefore belong to the most successful Virtual Reality developments. Whereas display and interaction fidelity (as sub-dimensions of immersion) and their influence on presence are well researched, realism of the displayed simulation depends on the specific application and is therefore difficult to measure. We propose to measure simulation realism by using a self-report questionnaire. The German VR Simulation Realism Scale for VR training applications was developed based on a translation of scene realism items from the Witmer-Singer-Presence Questionnaire. Items for realism of virtual humans (for example for social phobia training applications) were supplemented. A sample of N = 151 students rated simulation realism of a Fear of Public Speaking application. Four factors were derived by item- and principle component analysis (Varimax rotation), representing Scene Realism, Audience Behavior, Audience Appearance and Sound Realism. The scale developed can be used as a starting point for future research and measurement of simulation realism for applications including virtual humans.

Measuring (shared) decision-making--a review of psychometric instruments.

PubMed

Simon, Daniela; Loh, Andreas; Härter, Martin

2007-01-01

In recent years shared decision-making (SDM) has gained importance as an appropriate approach to patient-physician communication and decision-making. However, there is a conceptual variety that implies problems of inconsistent measurement, of defining relationships of SDM and outcome measures, and of comparisons across different studies. This article presents the results of a literature search of psychometric instruments measuring aspects of decision-making. Altogether 18 scales were found. The majority covers the patients' perspective and relates to preferences for information and participation, decisional conflict, self-efficacy as well as to the evaluation of decision-making process and outcomes. The scales differ widely in their extent of validation. Although this review is not exhaustive, it presents a variety of available decision-making instruments. Yet, many of them still need to show their psychometric quality for other settings in further studies.

Effect of Alternate Nostril Breathing Exercise on Experimentally Induced Anxiety in Healthy Volunteers Using the Simulated Public Speaking Model: A Randomized Controlled Pilot Study.

PubMed

Kamath, Ashwin; Urval, Rathnakar P; Shenoy, Ashok K

2017-01-01

A randomized controlled pilot study was carried out to determine the effect of a 15-minute practice of ANB exercise on experimentally induced anxiety using the simulated public speaking model in yoga-naïve healthy young adults. Thirty consenting medical students were equally divided into test and control groups. The test group performed alternate nostril breathing exercise for 15 minutes, while the control group sat in a quiet room before participating in the simulated public speaking test (SPST). Visual Analog Mood Scale and Self-Statements during Public Speaking scale were used to measure the mood state at different phases of the SPST. The psychometric scores of both groups were comparable at baseline. Repeated-measures ANOVA showed a significant effect of phase ( p < 0.05), but group and gender did not have statistically significant influence on the mean anxiety scores. However, the test group showed a trend towards lower mean scores for the anxiety factor when compared with the control group. Considering the limitations of this pilot study and the trend seen towards lower anxiety in the test group, alternate nostril breathing may have potential anxiolytic effect in acute stressful situations. A study with larger sample size is therefore warranted. This trial is registered with CTRI/2014/03/004460.

Effect of Alternate Nostril Breathing Exercise on Experimentally Induced Anxiety in Healthy Volunteers Using the Simulated Public Speaking Model: A Randomized Controlled Pilot Study

PubMed Central

Urval, Rathnakar P.; Shenoy, Ashok K.

2017-01-01

A randomized controlled pilot study was carried out to determine the effect of a 15-minute practice of ANB exercise on experimentally induced anxiety using the simulated public speaking model in yoga-naïve healthy young adults. Thirty consenting medical students were equally divided into test and control groups. The test group performed alternate nostril breathing exercise for 15 minutes, while the control group sat in a quiet room before participating in the simulated public speaking test (SPST). Visual Analog Mood Scale and Self-Statements during Public Speaking scale were used to measure the mood state at different phases of the SPST. The psychometric scores of both groups were comparable at baseline. Repeated-measures ANOVA showed a significant effect of phase (p < 0.05), but group and gender did not have statistically significant influence on the mean anxiety scores. However, the test group showed a trend towards lower mean scores for the anxiety factor when compared with the control group. Considering the limitations of this pilot study and the trend seen towards lower anxiety in the test group, alternate nostril breathing may have potential anxiolytic effect in acute stressful situations. A study with larger sample size is therefore warranted. This trial is registered with CTRI/2014/03/004460. PMID:29159176

Cross-cultural psychometric assessment of the VAGUS insight into psychosis scale - Spanish version.

PubMed

de León, Patricia Ponce; Gerretsen, Philip; Shah, Parita; Saracco-Alvarez, Ricardo; Graff-Guerrero, Ariel; Fresán, Ana

2018-01-01

Impaired insight into illness, a core feature of schizophrenia with negative clinical implications, is a multidimensional phenomenon existing on a continuum. However, the degree to which illness perception in distinct cultures influences the appraisal of insight into illness in schizophrenia remains unclear. As such, we aimed to determine if the psychometric properties of the VAGUS insight into psychosis scale (www.vagusonline.com), which was originally assessed in English speaking Canadians, were similar in a sample of Latino Mexican Spanish speaking patients with schizophrenia. To accomplish this, the VAGUS - Self-Report (SR) version was translated from English to Spanish and psychometrically evaluated in 95 participants. The Spanish version of the VAGUS-SR was internally consistent (ᾳ = 0.713), and demonstrated good convergent and discriminant validity with the subscales of the Positive and Negative Syndrome Scale. Factor analysis identified two components of insight, congruent with two of the components of the English version of the VAGUS-SR. In conclusion, the VAGUS-SR is a brief, novel, and valid measure of insight into illness in schizophrenia, which demonstrated similar psychometric properties in two culturally and linguistically distinct samples with schizophrenia. Future studies should assess whether the VAGUS demonstrates similar psychometric properties in non-Western cultures. Copyright © 2017 Elsevier B.V. All rights reserved.

Psychometric properties of the French versions of the Perceived Stress Scale.

PubMed

Lesage, Francois-Xavier; Berjot, Sophie; Deschamps, Frederic

2012-06-01

This study was conducted to examine the psychometric properties of the French versions of the Perceived Stress Scale (PSS) and to compare the appropriateness of the three versions of this scale (14 items, 10 items, or 4 items) in a sample of workers. Five hundred and one workers were randomly selected in several occupational health care centers of the North of France during 2010. Participants completed a questionnaire including demographic variables and the PSS. The psychometric properties of this scale were analyzed: internal consistency, factorial structure, and discriminative sensibility. For the PSS-14 and PSS-10, the Exploratory Factor Analysis (EFA) provided a two-factor structure, corresponding to the positively and negatively worded items. Those two factors were significantly correlated (r = 0.43 and 0.50, respectively). For the PSS-4, the EFA yielded a one-factor structure. The reliability was high for all three versions of the PSS (Cronbach's α values ranged from 0.73 to 0.84). The results concerning the effects of age, gender, marital, parental and occupational statuses showed that the 10-item version had the best discriminative sensibility. The findings confirmed satisfactory psychometric properties of all the three French versions of the PSS. We recommend the use of the PSS-10 in research settings because of its good psychometric properties.

Development and psychometric evaluation of the Premarital Sexual Behavior Assessment Scale for Young Women (PSAS-YW): an exploratory mixed method study.

PubMed

Rahmani, Azam; Merghati-Khoei, Effat; Moghadam-Banaem, Lida; Hajizadeh, Ebrahim; Hamdieh, Mostafa; Montazeri, Ali

2014-06-13

Premarital sexual behaviors are important issue for women's health. The present study was designed to develop and examine the psychometric properties of a scale in order to identify young women who are at greater risk of premarital sexual behavior. This was an exploratory mixed method investigation. Indeed, the study was conducted in two phases. In the first phase, qualitative methods (focus group discussion and individual interview) were applied to generate items and develop the questionnaire. In the second phase, psychometric properties (validity and reliability) of the questionnaire were assessed. In the first phase an item pool containing 53 statements related to premarital sexual behavior was generated. In the second phase item reduction was applied and the final version of the questionnaire containing 26 items was developed. The psychometric properties of this final version were assessed and the results showed that the instrument has a good structure, and reliability. The results from exploratory factory analysis indicated a 5-factor solution for the instrument that jointly accounted for the 57.4% of variance observed. The Cronbach's alpha coefficient for the instrument was found to be 0.87. This study provided a valid and reliable scale to identify premarital sexual behavior in young women. Assessment of premarital sexual behavior might help to improve women's sexual abstinence.

Development and psychometric evaluation of the Premarital Sexual Behavior Assessment Scale for Young Women (PSAS-YW): an exploratory mixed method study

PubMed Central

2014-01-01

Background Premarital sexual behaviors are important issue for women’s health. The present study was designed to develop and examine the psychometric properties of a scale in order to identify young women who are at greater risk of premarital sexual behavior. Method This was an exploratory mixed method investigation. Indeed, the study was conducted in two phases. In the first phase, qualitative methods (focus group discussion and individual interview) were applied to generate items and develop the questionnaire. In the second phase, psychometric properties (validity and reliability) of the questionnaire were assessed. Results In the first phase an item pool containing 53 statements related to premarital sexual behavior was generated. In the second phase item reduction was applied and the final version of the questionnaire containing 26 items was developed. The psychometric properties of this final version were assessed and the results showed that the instrument has a good structure, and reliability. The results from exploratory factory analysis indicated a 5-factor solution for the instrument that jointly accounted for the 57.4% of variance observed. The Cronbach’s alpha coefficient for the instrument was found to be 0.87. Conclusion This study provided a valid and reliable scale to identify premarital sexual behavior in young women. Assessment of premarital sexual behavior might help to improve women’s sexual abstinence. PMID:24924696

Influence of Study Design on Outcomes Following Reflexology Massage: An Integrative and Critical Review of Interventional Studies.

PubMed

McVicar, Andrew; Greenwood, Christina; Ellis, Carol; LeForis, Chantelle

2016-09-01

Interpretation of the efficacy of reflexology is hindered by inconsistent research designs and complicated by professional views that criteria of randomized controlled trials (RCTs)are not ideal to research holistic complementary and alternative medicine practice. The influence of research designs on study outcomes is not known. This integrative review sought to evaluate this possibility. Thirty-seven interventional studies (2000-2014) were identified; they had RCT or non-RCT design and compared reflexology outcomes against a control/comparison group. Viability of integrating RCT and non-RCT studies into a single database was first evaluated by appraisal of 16 reporting fields related to study setting and objectives, sample demographics, methodologic design, and treatment fidelity and assessment against Jadad score quality criteria for RCTs. For appraisal, the database was stratified into RCT/non-RCT or Jadad score of 3 or more or less than 3. Deficits in reporting were identified for blind assignment of participants, dropout/completion rate, and School of Reflexology. For comparison purposes, these fields were excluded from subsequent analysis for evidence of association between design fields and of fields with study outcomes. Thirty-one studies applied psychometric tools and 20 applied biometric tools (14 applied both). A total of 116 measures were used. Type of measure was associated with study objectives (p < 0.001; chi-square), in particular of psychometric measures with a collated "behavioral/cognitive" objective. Significant outcomes were more likely (p < 0.001; chi-square) for psychometric than for biometric measures. Neither type of outcome was associated with choice of RCT or non-RCT method, but psychometric responses were associated (p = 0.007) with a nonmassage control strategy. The review supports psychometric responses to reflexology when study design uses a nonmassage control strategy. Findings suggest that an evaluation of outcomes against sham reflexology massage and other forms of massage, as well as a narrower focus of study objective, may clarify whether there is a relationship between study design and efficacy of reflexology.

The Cervical Dystonia Impact Profile (CDIP-58): Can a Rasch developed patient reported outcome measure satisfy traditional psychometric criteria?

PubMed Central

Cano, Stefan J; Warner, Thomas T; Thompson, Alan J; Bhatia, Kailash P; Fitzpatrick, Ray; Hobart, Jeremy C

2008-01-01

Background The United States Food and Drug Administration (FDA) are currently producing guidelines for the scientific adequacy of patient reported outcome measures (PROMs) in clinical trials, which will have implications for the selection of scales used in future clinical trials. In this study, we examine how the Cervical Dystonia Impact Profile (CDIP-58), a rigorous Rasch measurement developed neurologic PROM, stands up to traditional psychometric criteria for three reasons: 1) provide traditional psychometric evidence for the CDIP-58 in line with proposed FDA guidelines; 2) enable researchers and clinicians to compare it with existing dystonia PROMs; and 3) help researchers and clinicians bridge the knowledge gap between old and new methods of reliability and validity testing. Methods We evaluated traditional psychometric properties of data quality, scaling assumptions, targeting, reliability and validity in a group of 391 people with CD. The main outcome measures used were the CDIP-58, Medical Outcome Study Short Form-36, the 28-item General Health Questionnaire, and Hospital and Anxiety and Depression Scale. Results A total of 391 people returned completed questionnaires (corrected response rate 87%). Analyses showed: 1) data quality was high (low missing data ≤ 4%, subscale scores could be computed for > 96% of the sample); 2) item groupings passed tests for scaling assumptions; 3) good targeting (except for the Sleep subscale, ceiling effect = 27%); 4) good reliability (Cronbach's alpha ≥ 0.92, test-retest intraclass correlations ≥ 0.83); and 5) validity was supported. Conclusion This study has shown that new psychometric methods can produce a PROM that stands up to traditional criteria and supports the clinical advantages of Rasch analysis. PMID:18684327

The cervical dystonia impact profile (CDIP-58): can a Rasch developed patient reported outcome measure satisfy traditional psychometric criteria?

PubMed

Cano, Stefan J; Warner, Thomas T; Thompson, Alan J; Bhatia, Kailash P; Fitzpatrick, Ray; Hobart, Jeremy C

2008-08-06

The United States Food and Drug Administration (FDA) are currently producing guidelines for the scientific adequacy of patient reported outcome measures (PROMs) in clinical trials, which will have implications for the selection of scales used in future clinical trials. In this study, we examine how the Cervical Dystonia Impact Profile (CDIP-58), a rigorous Rasch measurement developed neurologic PROM, stands up to traditional psychometric criteria for three reasons: 1) provide traditional psychometric evidence for the CDIP-58 in line with proposed FDA guidelines; 2) enable researchers and clinicians to compare it with existing dystonia PROMs; and 3) help researchers and clinicians bridge the knowledge gap between old and new methods of reliability and validity testing. We evaluated traditional psychometric properties of data quality, scaling assumptions, targeting, reliability and validity in a group of 391 people with CD. The main outcome measures used were the CDIP-58, Medical Outcome Study Short Form-36, the 28-item General Health Questionnaire, and Hospital and Anxiety and Depression Scale. A total of 391 people returned completed questionnaires (corrected response rate 87%). Analyses showed: 1) data quality was high (low missing data < or = 4%, subscale scores could be computed for > 96% of the sample); 2) item groupings passed tests for scaling assumptions; 3) good targeting (except for the Sleep subscale, ceiling effect = 27%); 4) good reliability (Cronbach's alpha > or = 0.92, test-retest intraclass correlations > or = 0.83); and 5) validity was supported. This study has shown that new psychometric methods can produce a PROM that stands up to traditional criteria and supports the clinical advantages of Rasch analysis.

Health-related quality-of-life outcome measures in paediatric palliative care: A systematic review of psychometric properties and feasibility of use

PubMed Central

Coombes, Lucy H; Wiseman, Theresa; Lucas, Grace; Sangha, Amrit; Murtagh, Fliss EM

2016-01-01

Background: The number of children worldwide requiring palliative care services is increasing due to advances in medical care and technology. The use of outcome measures is important to improve the quality and effectiveness of care. Aim: To systematically identify health-related quality-of-life outcome measures that could be used in paediatric palliative care and examine their feasibility of use and psychometric properties. Design: A systematic literature review and analysis of psychometric properties. Data sources: PsychInfo, Medline and EMBASE were searched from 1 January 1990 to 10 December 2014. Hand searches of the reference list of included studies and relevant reviews were also performed. Results: From 3460 articles, 125 papers were selected for full-text assessment. A total of 41 articles met the eligibility criteria and examined the psychometric properties of 22 health-related quality-of-life measures. Evidence was limited as at least half of the information on psychometric properties per instrument was missing. Measurement error was not analysed in any of the included articles and responsiveness was only analysed in one study. The methodological quality of included studies varied greatly. Conclusion: There is currently no ‘ideal’ outcome assessment measure for use in paediatric palliative care. The domains of generic health-related quality-of-life measures are not relevant to all children receiving palliative care and some domains within disease-specific measures are only relevant for that specific population. Potential solutions include adapting an existing measure or developing more individualized patient-centred outcome and experience measures. Either way, it is important to continue work on outcome measurement in this field. PMID:27247087

Linguistic and psychometric validation of the MSSS-88 questionnaire for patients with multiple sclerosis and spasticity in Germany.

PubMed

Henze, Thomas; von Mackensen, Sylvia; Lehrieder, Gerald; Zettl, Uwe K; Pfiffner, Carmen; Flachenecker, Peter

2014-08-01

Multiple sclerosis (MS) is an inflammatory disease where many of the patients suffer from spasticity impacting their quality-of-life. The purpose of this paper was to linguistically validate and psychometrically test the Multiple Sclerosis Spasticity Scale (MSSS-88) in German speaking MS patients. The study had two stages: 1) forward/backward translations of the original MSSS-88 scale into German, discussions with MS-experts and cognitive debriefings with MS patients; 2) psychometric evaluation of the German version. Data collection took part in an observational multi-centre study in Germany (MOVE2). The German translation of the MSSS-88 scale was discussed with three MS-experts; followed by two cognitive debriefing sessions with 12 MS patients. For psychometric evaluation the MSSS-88 was filled in by 87 MS patients with a mean age of 50.2 ± 10.4 years; 26.4% of them had severe spasticity. Data quality was acceptable. Missing data for items of the MSSS-88 were low (range 0-5.75%). Psychometric testing of the MSSS-88 revealed excellent values for reliability and validity. Significant differences between groups regarding severity, grading, type and self-ratings of MS-spasticity and sleep disturbances were found. Sensitivity to change could be demonstrated for the MSSS-88 in the group of MS patients treated with cannabinoid oromucosal spray vs. non-treated patients. In the treated group significant changes with a moderate effect size were found for 'muscle spasms', 'emotional health' and 'pain/discomfort'. No significant changes could be detected in the non-treated group. Preliminary evidence from this small study supports reliability, validity, and responsiveness of the German version of the MSSS-88 for measuring the impact of spasticity in MS.

Children and Young People-Mental Health Safety Assessment Tool (CYP-MH SAT) study: Protocol for the development and psychometric evaluation of an assessment tool to identify immediate risk of self-harm and suicide in children and young people (10–19 years) in acute paediatric hospital settings

PubMed Central

Walker, Gemma M; Carter, Tim; Aubeeluck, Aimee; Witchell, Miranda; Coad, Jane

2018-01-01

Introduction Currently, no standardised, evidence-based assessment tool for assessing immediate self-harm and suicide in acute paediatric inpatient settings exists. Aim The aim of this study is to develop and test the psychometric properties of an assessment tool that identifies immediate risk of self-harm and suicide in children and young people (10–19 years) in acute paediatric hospital settings. Methods and analysis Development phase: This phase involved a scoping review of the literature to identify and extract items from previously published suicide and self-harm risk assessment scales. Using a modified electronic Delphi approach, these items will then be rated according to their relevance for assessment of immediate suicide or self-harm risk by expert professionals. Inclusion of items will be determined by 65%–70% consensus between raters. Subsequently, a panel of expert members will convene to determine the face validity, appropriate phrasing, item order and response format for the finalised items. Psychometric testing phase: The finalised items will be tested for validity and reliability through a multicentre, psychometric evaluation. Psychometric testing will be undertaken to determine the following: internal consistency, inter-rater reliability, convergent, divergent validity and concurrent validity. Ethics and dissemination Ethical approval was provided by the National Health Service East Midlands—Derby Research Ethics Committee (17/EM/0347) and full governance clearance received by the Health Research Authority and local participating sites. Findings from this study will be disseminated to professionals and the public via peer-reviewed journal publications, popular social media and conference presentations. PMID:29654046

Seeking a balance between the statistical and scientific elements in psychometrics.

PubMed

Wilson, Mark

2013-04-01

In this paper, I will review some aspects of psychometric projects that I have been involved in, emphasizing the nature of the work of the psychometricians involved, especially the balance between the statistical and scientific elements of that work. The intent is to seek to understand where psychometrics, as a discipline, has been and where it might be headed, in part at least, by considering one particular journey (my own). In contemplating this, I also look to psychometrics journals to see how psychometricians represent themselves to themselves, and in a complementary way, look to substantive journals to see how psychometrics is represented there (or perhaps, not represented, as the case may be). I present a series of questions in order to consider the issue of what are the appropriate foci of the psychometric discipline. As an example, I present one recent project at the end, where the roles of the psychometricians and the substantive researchers have had to become intertwined in order to make satisfactory progress. In the conclusion I discuss the consequences of such a view for the future of psychometrics.

Bem Sex Role Inventory Validation in the International Mobility in Aging Study.

PubMed

Ahmed, Tamer; Vafaei, Afshin; Belanger, Emmanuelle; Phillips, Susan P; Zunzunegui, Maria-Victoria

2016-09-01

This study investigated the measurement structure of the Bem Sex Role Inventory (BSRI) with different factor analysis methods. Most previous studies on validity applied exploratory factor analysis (EFA) to examine the BSRI. We aimed to assess the psychometric properties and construct validity of the 12-item short-form BSRI in a sample administered to 1,995 older adults from wave 1 of the International Mobility in Aging Study (IMIAS). We used Cronbach's alpha to assess internal consistency reliability and confirmatory factor analysis (CFA) to assess psychometric properties. EFA revealed a three-factor model, further confirmed by CFA and compared with the original two-factor structure model. Results revealed that a two-factor solution (instrumentality-expressiveness) has satisfactory construct validity and superior fit to data compared to the three-factor solution. The two-factor solution confirms expected gender differences in older adults. The 12-item BSRI provides a brief, psychometrically sound, and reliable instrument in international samples of older adults.

Assessing coach motivation: the development of the Coach Motivation Questionnaire (CMQ).

PubMed

McLean, Kristy N; Mallett, Clifford J; Newcombe, Peter

2012-04-01

The aim of this research was to develop and assess the psychometric properties of the Coach Motivation Questionnaire (CMQ). Study 1 focused on the compilation and pilot testing of potential questionnaire items. Consistent with self-determination theory, items were devised to tap into six forms of motivation: amotivation, external regulation, introjected regulation, identified regulation, integrated regulation, and intrinsic motivation. The purpose of the second study (N = 556) was to empirically examine the psychometric properties of the CMQ. Items were subjected to confirmatory factor analyses to determine the fit of the a priori model. In addition, the validity of the questionnaire was assessed through links with the theoretically related concepts of intrinsic need satisfaction, well-being, and goal orientation. Together with test-retest reliability (Study 3), these results showed preliminary support for the psychometric properties of the CMQ. Finally, using an independent sample (N = 254), the fourth study confirmed the factor structure and supports the use of the CMQ in future coaching research.

Evaluating Patient Reported Outcome Measures (PROMs) for bladder cancer: a systematic review using the COSMIN checklist.

PubMed

Mason, Samantha J; Catto, James Wf; Downing, Amy; Bottomley, Sarah E; Glaser, Adam W; Wright, Penny

2018-05-03

Patient Reported Outcome Measures (PROMs) are important tools used to understand patient focused outcomes from care. Various PROMs have been developed for patients with Bladder Cancer (BC), although the disease's heterogeneity makes selection difficult. Accurate measurement of Health Related Quality of Life (HRQL) can only be achieved if the PROM chosen is 'fit for purpose' (i.e. psychometrically sound). Systematic reviews of psychometric properties are useful for selecting the best PROM for a specific purpose. The COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) developed a checklist to improve the selection of health measurement instruments as part of a review process. Our aims were to undertake a systematic review, using the COSMIN criteria, to assess the quality of studies that report the psychometric properties of PROMs used with people with BC and determine the psychometric quality of these PROMs. An electronic search of seven databases including PubMed, MEDLINE and EMBASE (PROSPERO reference CRD42016051974) was undertaken to identify English language publications, published between January 1990 and September 2017 that evaluated psychometric properties of PROMs used in BC research. Two researchers independently screened abstracts and selected full text papers. Studies were rated on methodological quality using the COSMIN checklist. Overall, 4,663 records were screened and 23 studies, reporting outcomes in 3,568 patients, were evaluated using the COSMIN checklist. Most PROMs had limited information reported about their psychometric properties. Studies reporting on the Bladder Cancer Index (BCI) and Functional Assessment of Cancer Therapy Vanderbilt Cystectomy Index (FACT-VCI) provided the most detail and these PROMs could be evaluated on the most COSMIN properties. Based on the available evidence, no existing PROM stands out as the most appropriate to measure HRQL in BC populations. This is due to two factors; (i) the heterogeneity of BC and its treatments (ii) no PROM was evaluated on all COSMIN measurement properties due to a lack of validation studies. We suggest future evaluation of generic, cancer generic and BC specific PROMs to better understand their application with BC populations and propose strategies to help clinicians and researchers. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Psychometric properties of the Calgary Cambridge guides to assess communication skills of undergraduate medical students.

PubMed

Simmenroth-Nayda, Anne; Heinemann, Stephanie; Nolte, Catharina; Fischer, Thomas; Himmel, Wolfgang

2014-12-06

The aim of this study was to analyse the psychometric properties of the short version of the Calgary Cambridge Guides and to decide whether it can be recommended for use in the assessment of communications skills in young undergraduate medical students. Using a translated version of the Guide, 30 members from the Department of General Practice rated 5 videotaped encounters between students and simulated patients twice. Item analysis should detect possible floor and/or ceiling effects. The construct validity was investigated using exploratory factor analysis. Intra-rater reliability was measured in an interval of 3 months, inter-rater reliability was assessed by the intraclass correlation coefficient. The score distribution of the items showed no ceiling or floor effects. Four of the five factors extracted from the factor analysis represented important constructs of doctor-patient communication The ratings for the first and second round of assessing the videos correlated at 0.75 (p<0.0001). Intraclass correlation coefficients for each item ranged were moderate and ranged from 0.05 to 0.57. Reasonable score distributions of most items without ceiling or floor effects as well as a good test-retest reliability and construct validity recommend the C-CG as an instrument for assessing communication skills in undergraduate medical students. Some deficiencies in inter-rater reliability are a clear indication that raters need a thorough instruction before using the C-CG.

Stimulating innovations in the measurement of parenting constructs.

PubMed

Mâsse, Louise C; Watts, Allison W

2013-08-01

Parents can play a crucial role in the development of children's behaviors associated with dietary habits, physical activity, and sedentary lifestyles. Many parenting practices and/or styles measures have been developed; however, there is little agreement as to how the influence of parenting should be measured. More importantly, our ability to relate parenting practices and/or styles to children's behaviors depends on its accurate assessment. While there is a need to standardize our assessment to further advance knowledge in this area, this article will discuss areas that may stimulate advances in the measurement of parenting constructs. Because self-report measures are important for the assessment of parenting, this article discusses whether solutions to improve self-report measures may lie in: (1) Improving the questions asked; (2) improving the methods used to correct for social desirability or measurement errors; (3) changing our measurement paradigm to assess implicit parenting behaviors; (4) changing how self-report is collected by taking advantage of ecological momentary assessment methods; (5) using better psychometric methods to validate parenting measures or alternatively using advances in psychometric methods, such as item banking and computerized adaptive testing, to solve common administration issues (i.e., response burden and comparability of results across studies); and (6) employing novel technologies to collect data such as portable technologies, gaming, and virtual reality simulation. This article will briefly discuss the potential of technologies to measure parenting constructs.

Stimulating Innovations in the Measurement of Parenting Constructs

PubMed Central

Watts, Allison W.

2013-01-01

Abstract Parents can play a crucial role in the development of children's behaviors associated with dietary habits, physical activity, and sedentary lifestyles. Many parenting practices and/or styles measures have been developed; however, there is little agreement as to how the influence of parenting should be measured. More importantly, our ability to relate parenting practices and/or styles to children's behaviors depends on its accurate assessment. While there is a need to standardize our assessment to further advance knowledge in this area, this article will discuss areas that may stimulate advances in the measurement of parenting constructs. Because self-report measures are important for the assessment of parenting, this article discusses whether solutions to improve self-report measures may lie in: (1) Improving the questions asked; (2) improving the methods used to correct for social desirability or measurement errors; (3) changing our measurement paradigm to assess implicit parenting behaviors; (4) changing how self-report is collected by taking advantage of ecological momentary assessment methods; (5) using better psychometric methods to validate parenting measures or alternatively using advances in psychometric methods, such as item banking and computerized adaptive testing, to solve common administration issues (i.e., response burden and comparability of results across studies); and (6) employing novel technologies to collect data such as portable technologies, gaming, and virtual reality simulation. This article will briefly discuss the potential of technologies to measure parenting constructs. PMID:23944924

Parent and Teacher SNAP-IV Ratings of Attention Deficit Hyperactivity Disorder Symptoms: Psychometric Properties and Normative Ratings from a School District Sample

ERIC Educational Resources Information Center

Bussing, Regina; Fernandez, Melanie; Harwood, Michelle; Hou, Wei; Garvan, Cynthia Wilson; Eyberg, Sheila M.; Swanson, James M.

2008-01-01

To examine Swanson, Nolan, and Pelham-IV (SNAP-IV) psychometric properties, parent (N = 1,613) and teacher (N = 1,205) data were collected from a random elementary school student sample in a longitudinal attention deficit hyperactivity disorder (ADHD) detection study. SNAP-IV reliability was acceptable. Factor structure indicated two ADHD factors…

How to Achieve Accurate Peer Assessment for High Value Written Assignments in a Senior Undergraduate Course

ERIC Educational Resources Information Center

Jeffery, Daniel; Yankulov, Krassimir; Crerar, Alison; Ritchie, Kerry

2016-01-01

The psychometric measures of accuracy, reliability and validity of peer assessment are critical qualities for its use as a supplement to instructor grading. In this study, we seek to determine which factors related to peer review are the most influential on these psychometric measures, with a primary focus on the accuracy of peer assessment or how…

Measuring Ocean Literacy in Pre-Service Teachers: Psychometric Properties of the Greek Version of the Survey of Ocean Literacy and Experience (SOLE)

ERIC Educational Resources Information Center

Markos, Angelos; Boubonari, Theodora; Mogias, Athanasios; Kevrekidis, Theodoros

2017-01-01

The aim of the present study was to respond to the increasing demand for comprehensive tools for the measurement of ocean literacy, by investigating the psychometric characteristics of a Greek version of the Survey of Ocean Literacy and Experience (SOLE), an instrument that assesses conceptual understanding of general ocean sciences content,…

Career Adapt-Abilities Scale in a French-Speaking Swiss Sample: Psychometric Properties and Relationships to Personality and Work Engagement

ERIC Educational Resources Information Center

Rossier, Jerome; Zecca, Gregory; Stauffer, Sarah D.; Maggiori, Christian; Dauwalder, Jean-Pierre

2012-01-01

The aim of this study was to analyze the psychometric properties of the Career Adapt-Abilities Scale (CAAS) in a French-speaking Swiss sample and its relationship with personality dimensions and work engagement. The heterogeneous sample of 391 participants (M[subscript age] = 39.59, SD = 12.30) completed the CAAS-International and a short version…

Governing by Testing: Circulation, Psychometric Knowledge, Experts and the "Alliance for Progress" in Latin America during the 1960s and 1970s

ERIC Educational Resources Information Center

Alarcón, Cristina

2015-01-01

This paper analyzes the activities, members, and effects of an inter-American expert network for the diffusion of psychometric knowledge, specifically of standardized aptitude testing for university admission in Latin America during the 1960s and 1970s. Within the framework of educational transfer studies, the role of international,…

Measuring Adolescent Life Satisfaction: Psychometric Properties of the Satisfaction With Life Scale in a Sample of Italian Adolescents and Young Adults

ERIC Educational Resources Information Center

Di Fabio, Annamaria; Gori, Alessio

2016-01-01

This study examined the factor structure and the psychometric properties of the Satisfaction With Life Scale (SWLS) in a sample of 1,515 Italian (females = 60.26%, males = 39.74%) adolescents and young adults (M[subscript age] = 17.6 years, SD = 1.21). Results confirmed the unidimensionality, good reliability, and concurrent validity of the…

Development and Psychometric Evaluation of a Psychosocial Quality-of-Life Questionnaire for Individuals with Autism and Related Developmental Disorders

ERIC Educational Resources Information Center

Markowitz, Leslie A.; Reyes, Charina; Embacher, Rebecca A.; Speer, Leslie L.; Roizen, Nancy; Frazier, Thomas W.

2016-01-01

This study investigated the psychometric properties of the Child and Family Quality of Life scale, a measure of psychosocial quality of life in those with autism and related developmental disorders. Parents of 212 children suspected of autism spectrum disorder completed the Child and Family Quality of Life prior to a diagnostic evaluation. Results…

Factor Structure and Psychometric Properties of the Multidimensional Anxiety Scale for Children in an African American Adolescent Sample

ERIC Educational Resources Information Center

Kingery, Julie Newman; Ginsburg, Golda S.; Burstein, Marcy

2009-01-01

The current study examined the psychometric properties and factor structure of the Multidimensional Anxiety Scale for Children (MASC) among a community sample of 118 African American students (58 females; ages 14-19 years; mean age = 15.79) in an urban, parochial high school. Adolescents completed the MASC and several other self-report measures of…

Psychometric Properties of a Scale to Assess Parental Self-Efficacy for Influencing Children's Dietary, Physical Activity, Sedentary, and Screen Time Behaviors in Disadvantaged Areas

ERIC Educational Resources Information Center

Norman, Åsa; Bohman, Benjamin; Nyberg, Gisela; Schäfer Elinder, Liselotte

2018-01-01

Background: According to social cognitive theory, self-efficacy is central to behavior change. Consequently, parental self-efficacy (PSE) for influencing children's dietary, physical activity (PA), sedentary, and screen time behaviors is important for child obesity prevention. The aim of this study was to evaluate the psychometric properties of an…

Assessing Women's Negative Commentary on Their Own Bodies: A Psychometric Investigation of the Negative Body Talk Scale

ERIC Educational Resources Information Center

Engeln-Maddox, Renee; Salk, Rachel H.; Miller, Steven A.

2012-01-01

Our article details the development of the self-report Negative Body Talk (NBT) scale and five studies (all conducted with samples of U.S. undergraduate women) supporting the psychometric soundness of scores on this measure. The NBT scale measures women's tendency to engage in negatively valenced commentary about the weight and shape of their own…

Examination of the Psychometric Properties of the Test Anxiety Scale for Elementary Students (TAS-E) Scores

ERIC Educational Resources Information Center

Lowe, Patricia A.; Grumbein, Matthew J.; Raad, Jennifer M.

2011-01-01

The psychometric properties of the Test Anxiety Scale for Elementary Students (TAS-E) scores were examined. In Study 1, an exploratory factor analysis (EFA) was performed on the responses of 997 students in Grades 2 to 6 on the TAS-E. The results of the EFA produced a four-factor solution: Physiological Hyperarousal, Social Concerns, Task…

Psychometric Adequacy and Comparability of the Short and Full forms of the Personality Assessment Inventory

ERIC Educational Resources Information Center

Frazier, Thomas W.; Naugle, Richard I.; Haggerty, Kathryn A.

2006-01-01

The 160-item short form of the Personality Assessment Inventory (PAI) was developed for situations in which respondents complete only the 1st half of the test. The present study evaluates the adequacy and comparability of the full and short forms of the PAI in terms of a wide range of psychometric characteristics. In all, 421 participants…

Psychometric Properties of the Acceptance and Action Questionnaire-II for Chinese College Students and Elite Chinese Athletes

ERIC Educational Resources Information Center

Zhang, Chun-Qing; Chung, Pak-Kwong; Si, Gangyan; Liu, Jing Dong

2014-01-01

The purpose of the present study was to examine the psychometric properties of the Chinese version of the Acceptance and Action Questionnaire-II (AAQ-II) across two samples of Chinese college students (n = 183 and n = 366) and a sample of elite Chinese athletes (n = 330). Exploratory and confirmatory factor analyses supported the existence of a…

Psychometric Properties of the Children's Depression Inventory: An Item Response Theory Analysis across Age in a Nonclinical, Longitudinal, Adolescent Sample

ERIC Educational Resources Information Center

Lee, Young-Sun; Krishnan, Anita; Park, Yoon Soo

2012-01-01

The purpose of this study was to investigate psychometric properties of the Children's Depression Inventory within a nonclinical and longitudinal sample (8th and 12th grades). Using the Rasch rating scale, most items represented one dimension. There was adequate separation among items and no overlap between ranges of item difficulties with latent…

European Science Notes. Volume 39, Number 7.

DTIC Science & Technology

1985-07-01

Cardinet, Tourneur, differentiation" is then defined as and Allal especially helpful. those facets within and between which a given study seeks comparisons...fixed versus random-finite designation especially with respect to substantive must be made independently for each rather than purely psychometric theory...of needs to be considered. He thus derives purely psychometric models in conven- new formulations, based on the Spearman tional, and especially in

Incomplete Psychometric Equivalence of Scores Obtained on the Manual and the Computer Version of the Wisconsin Card Sorting Test?

ERIC Educational Resources Information Center

Steinmetz, Jean-Paul; Brunner, Martin; Loarer, Even; Houssemand, Claude

2010-01-01

The Wisconsin Card Sorting Test (WCST) assesses executive and frontal lobe function and can be administered manually or by computer. Despite the widespread application of the 2 versions, the psychometric equivalence of their scores has rarely been evaluated and only a limited set of criteria has been considered. The present experimental study (N =…

M-Learning: A Psychometric Study of the Mobile Learning Perception Scale and the Relationships between Teachers' Perceptions and School Level

ERIC Educational Resources Information Center

Roche, Allyn J.

2013-01-01

The purpose of this research was to evaluate the psychometric properties of Uzunboylu and Ozdamli (2011) Mobile Learning Perception Scale (MLPS) in order to determine whether it was an acceptable instrument to measure U.S. teachers' perception of mobile learning (m-learning) in the classroom. A second purpose was to determine if relationships…

Strategies Used by Families to Simplify Tasks for Individuals with Alzheimer's Disease and Related Disorders: Psychometric Analysis of the Task Management Strategy Index (TMSI)

ERIC Educational Resources Information Center

Gitlin, Laura N.; Winter, Laraine; Dennis, Marie P.; Corcoran, Mary; Schinfeld, Sandy; Hauck, Walter W.

2002-01-01

Purpose: Little is known about the specific behavioral strategies used by families to manage the physical dependency of persons with Alzheimer's disease and related disorders (ADRD). This study reports the psychometric properties of the Task Management Strategy Index (TMSI), a measure designed to identify actions taken by caregivers to simplify…

The Risk-Taking and Self-Harm Inventory for Adolescents: Development and Psychometric Evaluation

ERIC Educational Resources Information Center

Vrouva, Ioanna; Fonagy, Peter; Fearon, Pasco R. M.; Roussow, Trudie

2010-01-01

In this study, we report on the development and psychometric evaluation of the Risk-Taking (RT) and Self-Harm (SH) Inventory for Adolescents (RTSHIA), a self-report measure designed to assess adolescent RT and SH in community and clinical settings. 651 young people from secondary schools in England ranging in age from 11.6 years to 18.7 years and…

A Psychometric Measurement Model for Adult English Language Learners: Pearson Test of English Academic

ERIC Educational Resources Information Center

Pae, Hye K.

2012-01-01

The aim of this study was to apply Rasch modeling to an examination of the psychometric properties of the "Pearson Test of English Academic" (PTE Academic). Analyzed were 140 test-takers' scores derived from the PTE Academic database. The mean age of the participants was 26.45 (SD = 5.82), ranging from 17 to 46. Conformity of the participants'…

The Teacher Sense of Efficacy Scale: Validation Evidence and Behavioral Prediction. WCER Working Paper No. 2006-7

ERIC Educational Resources Information Center

Heneman, Herbert G., III; Kimball, Steven; Milanowski, Anthony

2006-01-01

The present study contributes to knowledge of the construct validity of the short form of the Teacher Sense of Efficacy Scale (and by extension, given their similar content and psychometric properties, to the long form). The authors' research involves: (1) examining the psychometric properties of the TSES on a large sample of elementary, middle,…

Psychometric Properties of the Child and Youth Resilience Measure (CYRM-28) among Samples of French Canadian Youth

ERIC Educational Resources Information Center

Daigneault, Isabelle; Dion, Jacinthe; Hebert, Martine; McDuff, Pierre; Collin-Vezina, Delphine

2013-01-01

Objective: Explore the psychometric properties of the French Canadian version of the Child and Youth Resilience Measure (CYRM-28, Resilience Research Center, 2009; Ungar et al., 2008) in youth samples. Method: Two investigations were conducted. Participants in Study 1 were 589 youth (60% female) in grades 10-12 from 2 urban public high schools.…

Psychometric Properties of Spanish Adaptation of the PDD-MRS Scale in Adults with Intellectual Developmental Disorders: The EVTEA-DI Scale

ERIC Educational Resources Information Center

Cortés, Maria José; Orejuela, Carmen; Castellví, Gemma; Folch, Annabel; Rovira, Lluís; Salvador-Carulla, Luis; Irazábal, Marcia; Muñoz, Silvia; Haro, Josep Maria; Vilella, Elisabet; Martínez-Leal, Rafael

2018-01-01

Strategies for the early detection of autism spectrum disorders (ASD) in people with intellectual developmental disorder (IDD) are urgently needed, but few specific tools have been developed. The present study examines the psychometric properties of the EVTEA-DI, a Spanish adaptation of the PDD-MRS, in a large randomized sample of 979 adults with…

The Screening Tool of Feeding Problems Applied to Children (STEP-CHILD): Psychometric Characteristics and Associations with Child and Parent Variables

ERIC Educational Resources Information Center

Seiverling, Laura; Hendy, Helen M.; Williams, Keith

2011-01-01

The present study evaluated the 23-item Screening Tool for Feeding Problems (STEP; Matson & Kuhn, 2001) with a sample of children referred to a hospital-based feeding clinic to examine the scale's psychometric characteristics and then demonstrate how a children's revision of the STEP, the STEP-CHILD is associated with child and parent variables.…

A Psychometric Analysis of the Positive and Negative Affect Schedule for Children-Parent Version in a School Sample

ERIC Educational Resources Information Center

Ebesutani, Chad; Okamura, Kelsie; Higa-McMillan, Charmaine; Chorpita, Bruce F.

2011-01-01

The current study was the 1st to examine the psychometric properties of the Positive and Negative Affect Schedule for Children-Parent Version (PANAS-C-P) using a large school-based sample of children and adolescents ages 8 to 18 (N = 606). Confirmatory factor analysis supported a 2-factor (correlated) model of positive affect (PA) and negative…

Investigation of the Psychometric Attributes of the Test of Silent Contextual Reading Fluency

ERIC Educational Resources Information Center

Bell, Sherry Mee; McCallum, R. Steve; Kirk, Emily R.; Fuller, Emily J.; McCane-Bowling, Sara

2007-01-01

The purpose of this study was to examine the psychometric integrity of the "Test of Silent Contextual Reading Fluency" (TOSCRF) by D. D. Hammill, J. L. Wiederholt, and E. A. Allen (2006). The TOSCRF is a recently published assessment of reading fluency for ages 7 years 0 months to 18 years 11 months that can be administered individually or in a…

Psychometric Features of the General Aptitude Test-Verbal Part (GAT-V): A Large-Scale Assessment of High School Graduates in Saudi Arabia

ERIC Educational Resources Information Center

Dimitrov, Dimiter M.; Shamrani, Abdul Rahman

2015-01-01

This study examines the psychometric features of a General Aptitude Test-Verbal Part, which is used with assessments of high school graduates in Saudi Arabia. The data supported a bifactor model, with one general factor and three content domains (Analogy, Sentence Completion, and Reading Comprehension) as latent aspects of verbal aptitude.

Modeling the Test-Taking Motivation Construct through Investigation of Psychometric Properties of an Expectancy-Value-Based Questionnaire

ERIC Educational Resources Information Center

Knekta, Eva; Eklöf, Hanna

2015-01-01

The aim of this study was to evaluate the psychometric properties of an expectancy-value-based questionnaire measuring five aspects of test-taking motivation (effort, expectancies, importance, interest, and test anxiety). The questionnaire was distributed to a sample of Swedish Grade 9 students taking a low-stakes (n = 1,047) or a high-stakes (n =…

Development and Preliminary Examination of the Psychometric Properties of the Psychoeducational Group Alliance Scale for Children (PGA-c) in Two Samples of Children Participating in Groups

ERIC Educational Resources Information Center

Brouzos, Andreas; Vassilopoulos, Stephanos P.; Baourda, Vasiliki C.

2018-01-01

Studies examining processes in youth group psychotherapy are scarce. This article reports on the development and psychometric properties of the Psychoeducational Group Alliance Scale for Children (PGAS-c). This scale was designed to assess the therapeutic alliance that develops between the members and the facilitator in a psychoeducational group…

Doctor performance assessment in daily practise: does it help doctors or not? A systematic review.

PubMed

Overeem, Karlijn; Faber, Marjan J; Arah, Onyebuchi A; Elwyn, Glyn; Lombarts, Kiki M J M H; Wollersheim, Hub C; Grol, Richard P T M

2007-11-01

Continuous assessment of individual performance of doctors is crucial for life-long learning and quality of care. Policy-makers and health educators should have good insights into the strengths and weaknesses of the methods available. The aim of this study was to systematically evaluate the feasibility of methods, the psychometric properties of instruments that are especially important for summative assessments, and the effectiveness of methods serving formative assessments used in routine practise to assess the performance of individual doctors. We searched the MEDLINE (1966-January 2006), PsychINFO (1972-January 2006), CINAHL (1982-January 2006), EMBASE (1980-January 2006) and Cochrane (1966-2006) databases for English language articles, and supplemented this with a hand-search of reference lists of relevant studies and bibliographies of review articles. Studies that aimed to assess the performance of individual doctors in routine practise were included. Two reviewers independently abstracted data regarding study design, setting and findings related to reliability, validity, feasibility and effectiveness using a standard data abstraction form. A total of 64 articles met our inclusion criteria. We observed 6 different methods of evaluating performance: simulated patients; video observation; direct observation; peer assessment; audit of medical records, and portfolio or appraisal. Peer assessment is the most feasible method in terms of costs and time. Little psychometric assessment of the instruments has been undertaken so far. Effectiveness of formative assessments is poorly studied. All systems but 2 rely on a single method to assess performance. There is substantial potential to assess performance of doctors in routine practise. The longterm impact and effectiveness of formative performance assessments on education and quality of care remains hardly known. Future research designs need to pay special attention to unmasking effectiveness in terms of performance improvement.

Validation of a Spanish translation of the Gratitude Questionnaire (GQ-6) with a Chilean sample of adults and high schoolers.

PubMed

Langer, Álvaro I; Ulloa, Valentina G; Aguilar-Parra, José M; Araya-Véliz, Claudio; Brito, Gonzalo

2016-03-31

Recent studies have associated positive emotions with several variables such as learning, coping strategies or assertive behaviour. The concept of gratitude has been specifically defined as a tendency to recognise and respond to people or situations with grateful emotion. Unfortunately in Latin America, no validated measures of gratitude on different populations are available. The aim of this study was to analyse the psychometric properties of the Gratitude Questionnaire (GQ-6) in two Chilean samples. Two studies were conducted: the first with 668 high school adolescents (390 women and 278 men, with ages ranging between 12 and 20, and a mean age 15.54 ± 1.22) and the second with 331 adults (231 women and 100 men, with an average age of 37.59 ± 12.6). An analysis of the psychometric properties of the GQ-6 scale to determine the validity and reliability of the instrument in Chilean adolescents and adults was performed. Bivariate correlations, multiple regression analyses, exploratory factor analysis (EFA) and Monte Carlo simulations were carried out. Finally, a confirmatory factor analysis (CFA) was performed. A single-factor solution was found in both studies, a 5 item version for the adolescents and 6 items for adults. This factorial solution was invariant across genders. Reliability of the GQ was adequate in both samples (using Cronbach's alpha coefficient). In addition convergent and discriminate validity were assessed. Additionally, a negative correlation between the GQ-5 and depression in adolescents and a positive correlation between the GQ-6 and happiness in adults was found. The GQ is a suitable measure for evaluating a person's disposition toward gratitude in Chilean adolescents and adults. This instrument may contribute to the advancement of the study of positive emotions in Latin America.

A female sex offender with multiple paraphilias: a psychologic, physiologic (laboratory sexual arousal) and endocrine case study.

PubMed

Cooper, A J; Swaminath, S; Baxter, D; Poulin, C

1990-05-01

A 20 year old female pedophile exhibiting multiple paraphilias and who had been both a victim of incest and an active participant, undertook extensive clinical, psychometric, endocrine and laboratory sexual arousal studies. Her psychiatric, psychometric and physiologic arousal profiles showed similarities to those of a sizable proportion of male child molesters, especially incestors. It is suggested that laboratory arousal tests (using the vaginal photoplethysmograph) may have a role in the assessment of some female sex offenders.

A Psychometric Evaluation of the Santa Clara Strength of Religious Faith Questionnaire among Students from Poland and Chile.

PubMed

Wnuk, Marcin

2017-01-01

This study verifies the psychometric properties of the Santa Clara Strength of Religious Faith Questionnaire (SCSORFQ). This measure consists of 10 items regarding strength of religious faith, regardless of religious denomination or affiliation. Participants were 177 students from Chile and 393 students from Poland. The SCSORFQ method is a reliable measure with good internal consistency evaluated by the α-Cronbach coefficient. Factor analysis statistically confirmed the unidimensional structure of the SCSORFQ. The strength of religious faith in both student groups was moderate to strong correlated with public or private aspects of religiousness and strong correlated with spiritual experiences. It was weakly correlated with the cognitive indicator of well-being as satisfaction with life as well as with existential variables like hope and meaning of life. The results confirm that the SCSORFQ is psychometrically sound and is therefore recommended for use by researchers studying the construct of religiousness.

The Eastland Prostate Cancer Survey: instrument development and psychometric testing.

PubMed

Eastland, Taryn Y; Dancy, Barbara L

2013-03-01

African-American (AA) women could be instrumental in communicating positive prostate screening behavior to the significant males in their lives. However, little is known about AA women's prostate cancer attitudes, perceived behavioral control, subjective norms, intentions, behaviors, and knowledge regarding prostate cancer screening. This study describes the development and psychometric testing of the Eastland Prostate Cancer Survey (EPCS). A nonexperimental, correlational study with 200 AA women was used to test the psychometric properties of the six-subscale EPCS with 66 items. Construct validity, internal consistency, and test-retest reliability for the EPCS were acceptable and resulted in an eight-subscale EPCS with 56 items. Cronbach's alphas for the subscales ranged from 0.69 to 0.92. The EPCS is a culturally sensitive, gender-relevant instrument that could be used by community health providers to develop community health programs aimed at engaging AA women in the promotion of prostate cancer screening for AA men.

Psychometric properties of the Thai Spiritual Well-Being Scale.

PubMed

Chaiviboontham, Suchira; Phinitkhajorndech, Noppawan; Hanucharurnkul, Somchit; Noipiang, Thaniya

2016-04-01

The purpose of this study was to investigate the psychometric properties of the modified Thai Spiritual Well-Being Scale in patients with advanced cancer. This cross-sectional study was employed to investigate psychometric properties. Some 196 participants from three tertiary hospitals in Bangkok and suburban Thailand were asked to complete a Personal Information Questionnaire (PIQ), The Memorial Symptom Assessment Scale (MSAS), and the Spiritual Well-Being Scale (SWBS). Validity was determined by known-group, concurrent, and constructs validity. Reliability was estimated using internal consistency by Cronbach's α coefficients. Three factors were extracted: so-called existential well-being, religious well-being, and peacefulness accounted for 71.44% of total variance. The Cronbach's α coefficients for total SWB, EWB, RWB, and peacefulness were 0.96, 0.94, and 0.93, respectively. These findings indicate that the Thai SWBS is a valid and reliable instrument, and it presented one more factor than the original version.

Psychometric Testing of the Persian Version of the Perceived Perioperative Competence Scale-Revised.

PubMed

Ajorpaz, Neda Mirbagher; Tafreshi, Mansoureh Zagheri; Mohtashami, Jamileh; Zayeri, Farid; Rahemi, Zahra

2017-12-01

The clinical competence of nursing students in operating room (OR) is an important issue in nursing education. The purpose of this study was to evaluate the psychometric properties of the Persian Perceived Perioperative Competence Scale-Revised (PPCS-R) instrument. This cross-sectional study was conducted across 12 universities in Iran. The psychometric properties and factor structure of the PPCS-R for OR students was examined. Based on the results of factor analysis, seven items were removed from the original version of the scale. The fitness indices of the Persian scale include comparative fit index (CFI) = .90, goodness-of-fit-index (GFI) = .86, adjusted goodness-of-fit index (AGFI) = .90, normed fit index (NFI) = .84, and root mean square error of approximation (RMSEA) = .04. High validity and reliability indicated the scale's value for measuring perceived perioperative competence of Iranian OR students.

Examining the Psychometric Properties of the Family Accommodation Scale-Parent-Report (FAS-PR)

PubMed Central

Sapyta, Jeffrey; Garcia, Abbe; Freeman, Jennifer B.; Franklin, Martin E.; Foa, Edna; March, John

2011-01-01

Growing research has examined parental accommodation among the families of children with obsessive-compulsive disorder (OCD). However, these studies have utilized a parent-report (PR) version of a measure, the Family Accommodation Scale (FAS) that has never received proper psychometric validation. In turn, previously derived subscales have been developed via clinical rather than empirical evidence. This study aims to conduct a comprehensive psychometric analysis of the FAS-PR utilizing data collected from 96 youths with OCD. Exploratory factors analysis was conducted and revealed a 12-item scale yielding two separate, yet related subscales, Avoidance of Triggers (AT) and Involvement in Compulsions (IC). Subsequent analyses revealed good internal consistency and convergent and discriminant validity. These findings suggest that future research should seek to examine factors that may impact various facets to accommodation as well as the role these facets plays in predicting treatment outcome. Limitations are discussed. PMID:21743772

Preliminary Psychometric Analysis of the Modified Perceived Value of Certification Tool for the Nurse Educator.

PubMed

Barbe, Tammy

2015-01-01

The purpose of this study was to examine psychometric properties of the Perceived Value of Certification Tool© with a focus on nurse educator certification (PVCT-NE) in a sample of nurse educators. Greater understanding of faculty perceptions of certification is necessary to facilitate a strong cadre of nursing faculty; however, research around nurse educator certification is limited by a lack of reliable and valid instruments to measure such perceptions. Twenty-four nursing faculty from one university participated in the psychometric study, which involved completion of the PVCT-NE in a web-based survey format. Internal consistency reliability was excellent. Cronbach's alpha for the total PVCT-NE was .94 (.93 for the intrinsic subscale and .86 for the extrinsic subscale). A content validity index of .95 was obtained. There is preliminary evidence that the PVCT-NE is a reliable and valid instrument to measure perceived value of certification in nurse educators.

Translation and cross-cultural adaptation of the Clinical Competence Questionnaire for use in Brazil 1

PubMed Central

Kwiatkoski, Danielle Ritter; Mantovani, Maria de Fátima; Pereira, Evani Marques; Bortolato-Major, Carina; Mattei, Ângela Taís; Peres, Aida Maris

2017-01-01

ABSTRACT Objective: translating and transculturally adapting the Clinical Competence Questionnaire to Brazilian senior undergraduate Nursing students, as well as measuring psychometric properties of the questionnaire. Method: a methodological study carried out in six steps: translation of the Clinical Competence Questionnaire instrument, consensus of the translations, back-translation, analysis by an expert committee, pre-testing and then presentation of the cross-cultural adaptation process to the developers. Psychometric properties were measured using Cronbach's alpha, intraclass correlation coefficient and content validity index. Results: the instrument was translated, transculturally adapted and its final version consisted of 48 items. Cronbach's alpha coefficient was 0.90, and the agreement index of the items was 99% for students and 98% for evaluators. Conclusion: the Clinical Competence Questionnaire was translated and adapted to Brazilian students, and the psychometric properties of the Portuguese version of the questionnaire presented satisfactory internal consistency regarding the studied sample. PMID:28591303

[Social values and addiction: applicability and psychometric properties of VAL-89 questionnaire].

PubMed

Pedrero Perez, Eduardo Jose; Rojo Mota, Gloria; Olivar Arroyo, Alvaro

2008-01-01

To study the psychometric properties of the VAL-89 questionnaire and its possible use in addict individuals who ask for treatment. Analysis of the psychometric properties of the questionnaire and its factorial structure, applying it to 792 individuals. 365 of them were substance users seeking treatment and 427 were general population. Reliability of the questionnaire is confirmed, although its factorial structure appears to be different from the original. In our study appear 12 factors, instead of the original 10. These factors are named: Power, Stimulation, Submission, Tradition, Spirituality, Self-Sufficience, Hedonism, Sociability, Universality, Convencionalism, Idealism and Self-Realization. These factors are distributed through several dimensions represented by four axis: individual-social, dominance-equality, tradition-pleasure and great values-anomie. The VAL-89 questionnaire seems to be a useful tool to explore which are the more appreciated social values, being of special interest to know which are specially selected by addict individuals.

Psychometric properties of the revised conscientiousness dimension of Inventário Dimensional Clínico da Personalidade (IDCP).

PubMed

Carvalho, Lucas de Francisco; Souza, Bruna Daniela Balbino de; Primi, Ricardo

2014-01-01

This study investigated the psychometric properties of the revised scale of conscientiousness of a clinical personality inventory (Inventário Dimensional Clínico da Personalidade, IDCP). One hundred and twenty participants (68 women; 56.7%) aged 18 to 53 years (mean = 22.58, standard deviation = 6.19) were recruited by convenience and answered the IDCP and the NEO Personality Inventory - Revised. The analysis of internal structure, association with external variables and reliability of the dimension under review confirmed its validity. The psychometric characteristics of the revised dimension seem to be more adequate than those of the original version and more focused on pathological functioning, which was expected and desirable.

A Systematic Review of the Psychometric Properties of Composite LGBT Prejudice and Discrimination Scales.

PubMed

Morrison, Melanie A; Bishop, C J; Morrison, Todd G

2018-01-08

Prejudice and discrimination against LGBT individuals is widespread and has been shown to have negative consequences for sexual and gender minority persons' physical and psychological wellbeing. A recent and problematic trend in the literature is to compositely measure prejudice toward and discrimination against LGBT persons. As such, a review of the psychometric properties of scales assessing, in a combinatory fashion, negative attitudes and/or behaviors toward LGBT persons is warranted. In the current study, 32 scales were identified, and their psychometric properties were evaluated. Most of the scales reviewed did not provide sufficient information regarding item development and refinement, scale dimensionality, scale score reliability, or validity. Properties of the reviewed scales are summarized, and recommendations for better measurement practice are articulated.

Psychometric properties of the Swedish version of the Self-Transcendence Scale among very old people.

PubMed

Lundman, Berit; Årestedt, Kristofer; Norberg, Astrid; Norberg, Catharina; Fischer, Regina Santamäki; Lövheim, Hugo

2015-01-01

This study tested the psychometric properties of a Swedish version of the Self-Transcendence Scale (STS). Cohen's weighted kappa, agreement, absolute reliability, relative reliability, and internal consistency were calculated, and the underlying structure of the STS was established by exploratory factor analysis. There were 2 samples available: 1 including 194 people aged 85-103 years and a convenience sample of 60 people aged 21-69 years. Weighted kappa values ranged from .40 to .89. The intraclass correlation coefficient for the original STS was .763, and the least significant change between repeated tests was 6.25 points. The revised STS was found to have satisfactory psychometric properties, and 2 of the 4 underlying dimensions in Reed's self-transcendence theory were supported.

The Brief Peer Conflict Scale: Psychometric Properties Among a Sample of Incarcerated Male Juvenile Offenders.

PubMed

Pechorro, Pedro; Russell, Justin D; Ayala-Nunes, Lara; Gonçalves, Rui Abrunhosa; Nunes, Cristina

2018-06-01

Aggression can be considered a multidimensional construct that influences various forms of antisocial behavior, including juvenile delinquency and conduct problems. The aim of the present study was to assess the psychometric properties of the Brief Peer Conflict Scale-20 item version (PCS-20) among a Portuguese forensic sample (N = 192) of incarcerated male juvenile offenders ( M = 16.62 years; SD = 1.52 years; age range = 13-18 years). The PCS-20 demonstrated good psychometric properties in terms of its four-factor structure, internal consistency, convergent validity, and discriminant validity that generally justify its use among incarcerated male youth. The findings provide additional support for the extension of the PCS-20 across different cultures, ethnic groups, and samples.

A Brief Scale to Measure Problematic Sexually Explicit Media Consumption: Psychometric Properties of the Compulsive Pornography Consumption (CPC) Scale among Men who have Sex with Men

PubMed Central

Noor, Syed WB; Simon Rosser, B. R.; Erickson, Darin J.

2015-01-01

Although the phenomenon of hypersexuality has been described in the literature, and scales of compulsive sexual behavior have been published, the existing measures do not assess compulsive sexually explicit media (SEM) consumption. This study tested the psychometric properties of a new scale, the Compulsive Pornography Consumption (CPC). Exploratory and confirmatory factor analyses results showed good psychometric performance of a five item two factor preoccupation-compulsivity solution. As hypothesized, the scale correlates positively with compulsive sexual behavior, internalized homonegativity, and negatively with sexual self-esteem. The scale will enable researchers to investigate the etiologic factors of compulsive SEM use, and enable clinicians to assess problematic consumption. PMID:25838755

Psychometric Properties of IRT Proficiency Estimates

ERIC Educational Resources Information Center

Kolen, Michael J.; Tong, Ye

2010-01-01

Psychometric properties of item response theory proficiency estimates are considered in this paper. Proficiency estimators based on summed scores and pattern scores include non-Bayes maximum likelihood and test characteristic curve estimators and Bayesian estimators. The psychometric properties investigated include reliability, conditional…

Psychometrics of the screen for adult anxiety related disorders (SCAARED)- A new scale for the assessment of DSM-5 anxiety disorders.

PubMed

Angulo, Melina; Rooks, Brian T; Gill, MaryKay; Goldstein, Tina; Sakolsky, Dara; Goldstein, Benjamin; Monk, Kelly; Hickey, Mary Beth; Diler, Rasim S; Hafeman, Danella; Merranko, John; Axelson, David; Birmaher, Boris

2017-07-01

To examine the psychometrics of the Screen for Adult Anxiety Related Disorders (SCAARED). The SCAARED was adapted from the Screen for Child Anxiety Related Emotional Disorders. Participants (N=336) ages 18-27 years old were evaluated using the Structured Clinical Interview for DSM-IV Disorders (SCID). The SCAARED was completed at or within two-weeks before the SCID. The psychometrics of the SCAARED were analyzed using standard statistical analyses including principal components, and Receiver Operant Curve analyses. A replication was performed in an age/sex matched independent sample (N=158). The SCAARED showed four factors: somatic/panic/agoraphobia, generalized anxiety, separation anxiety, and social anxiety. The total and each factor scores demonstrated good internal consistency (α=0.86-0.97) and good discriminant validity between anxiety and other disorders and within anxiety disorders for generalized and social anxiety. Area Under the Curve for the total and each of the factor scores ranged between 0.72 and 0.84 (p<0.0001). These results were replicated in the independent sample. The SCAARED showed excellent psychometric properties supporting its use to screen adults for anxiety disorders, longitudinal studies following youth into adulthood and studies comparing child and adult populations. Further replication studies in larger community and clinical samples are indicated. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

Disruptive behavior scale for adolescents (DISBA): development and psychometric properties.

PubMed

Karimy, Mahmood; Fakhri, Ahmad; Vali, Esmaeel; Vali, Farzaneh; Veiga, Feliciano H; Stein, L A R; Araban, Marzieh

2018-01-01

Growing evidence indicates that if disruptive behavior is left unidentified and untreated, a significant proportion of these problems will persist and may develop into problems linked with delinquency, substance abuse, and violence. Research is needed to develop valid and reliable measures of disruptive behavior to assist recognition and impact of treatments on disruptive behavior. The aim of this study was to develop and evaluate the psychometric properties of a scale for disruptive behavior in adolescents. Six hundred high school students (50% girls), ages ranged 15-18 years old, selected through multi stage random sampling. Psychometrics of the disruptive behavior scale for adolescents (DISBA) (Persian version) was assessed through content validity, explanatory factor analysis (EFA) using Varimax rotation and confirmatory factor analysis (CFA). The reliability of this scale was assessed via internal consistency and test-retest reliability. EFA revealed four factors accounting for 59% of observed variance. The final 29-item scale contained four factors: (1) aggressive school behavior, (2) classroom defiant behavior, (3) unimportance of school, and (4) defiance to school authorities. Furthermore, CFA produced a sufficient Goodness of Fit Index > 0.90. Test-retest and internal consistency reliabilities were acceptable at 0.85 and 0.89, respectively. The findings from this study suggest that the Iranian version of DISBA questionnaire has content validity. Further studies are needed to evaluate stronger psychometric properties for DISBA.

Psychometric Evaluation of the Workstyle Short Form among Nursing Assistants with Work-Related Musculoskeletal Symptoms.

PubMed

Cheung, Kin; Ching, Shirley S Y; Ma, Ka Yan; Szeto, Grace

2018-04-22

The Workstyle Short Form (24 items) (WSF-24) has been tested for its psychometric properties on work-related upper-extremity musculoskeletal symptoms (WRUEMSs) among office workers. However, the impact of workstyle should not only be limited to WRUEMSs and the sedentary workforce. The purpose of this study was to test the psychometric properties of the modified 24-item Chinese WSF (C-WSF-24) to identify work-related musculoskeletal symptoms (WRMSs) in various body parts among nursing assistants (NAs) working in nursing homes. Four hundred and thirty-nine NAs participated in the study. The results of the factor analysis were that a four-factor solution (working through pain, social reactivity at work, demands at work and breaks) accounted for 56.45% of the total variance. Furthermore, validation against known groups showed that the total score and subscale scores of the C-WSF-24 had the ability to discriminate between NAs with and without WRMSs in various body parts (such as low back and lower extremities). Additionally, C-WSF-24 had a statistically significant association with the contributing factors to WRMSs. This is the first study to examine the psychometric properties of the C-WSF-24 in the non-sedentary workforce, with a focus on various body parts of WRMSs. The results demonstrated that C-WSF-24 is reliable and valid for assessing WRMSs in various body parts among NAs.

Psychometric Evaluation of the Workstyle Short Form among Nursing Assistants with Work-Related Musculoskeletal Symptoms

PubMed Central

Ching, Shirley S. Y.; Ma, Ka Yan; Szeto, Grace

2018-01-01

The Workstyle Short Form (24 items) (WSF-24) has been tested for its psychometric properties on work-related upper-extremity musculoskeletal symptoms (WRUEMSs) among office workers. However, the impact of workstyle should not only be limited to WRUEMSs and the sedentary workforce. The purpose of this study was to test the psychometric properties of the modified 24-item Chinese WSF (C-WSF-24) to identify work-related musculoskeletal symptoms (WRMSs) in various body parts among nursing assistants (NAs) working in nursing homes. Four hundred and thirty-nine NAs participated in the study. The results of the factor analysis were that a four-factor solution (working through pain, social reactivity at work, demands at work and breaks) accounted for 56.45% of the total variance. Furthermore, validation against known groups showed that the total score and subscale scores of the C-WSF-24 had the ability to discriminate between NAs with and without WRMSs in various body parts (such as low back and lower extremities). Additionally, C-WSF-24 had a statistically significant association with the contributing factors to WRMSs. This is the first study to examine the psychometric properties of the C-WSF-24 in the non-sedentary workforce, with a focus on various body parts of WRMSs. The results demonstrated that C-WSF-24 is reliable and valid for assessing WRMSs in various body parts among NAs. PMID:29690544

Psychometric testing of the Chinese version of the medical outcomes study social support survey (MOS-SSS-C).

PubMed

Yu, Doris S F; Lee, Diana T F; Woo, Jean

2004-04-01

The purpose of this study was to assess the psychometric properties of the Chinese version of the Medical Outcomes Study Social Support Survey (MOS-SSS-C) in a sample of 110 patients. Criterion-related and construct validities of the MOS-SSS-C were evaluated by correlations with the Chinese version of the Multidimensional Perceived Social Support Survey (r =.82) and the Hospital Anxiety and Depression Scale (r = -.58). Confirmatory factor analysis affirmed the four-factor structure of the MOS-SSS-C in measuring the functional aspects of perceived social support. Cronbach's alphas for the subscales ranged from.93 to.96, whereas the alpha for the overall scale was.98. The 2-week test-retest reliability of the MOS-SSS-C as measured by the intraclass correlation coefficient was.84. The MOS-SSS-C is a psychometrically sound multidimensional measure for the evaluation of functional aspects of perceived social support by Chinese patients with chronic disease. Copyright 2004 Wiley Periodicals, Inc.

The individualized neuromuscular quality of life questionnaire: cultural translation and psychometric validation for the Dutch population.

PubMed

Seesing, Femke M; van Vught, Lisanne Ewm; Rose, Michael R; Drost, Gea; van Engelen, Baziel G M; van der Wilt, Gert-Jan

2015-04-01

In this study we describe the translation and psychometric evaluation of the Dutch Individualized Neuromuscular Quality of Life (INQoL) questionnaire. Backward and forward translation of the questionnaire was executed, and psychometric properties were assessed on the basis of reliability and validity. Two hundred six patients were included in the study. Reliability analyses resulted in Cronbach alpha values of >0.70 for all subdomains. Known-group validity showed a significant correlation between INQoL scores and severity as well as age for the majority of subdomains. Item-total correlation for overall quality of life was satisfactory. Concurrent validity with the SF-36 and EQ-5D was good (range of Spearman correlation coefficients -0.43 to -0.76). This study resulted in a questionnaire that is appropiate for use in the Dutch-speaking population to measure quality of life among patients with a wide variety of muscle disorders. This confirms and extends data obtained in the UK, US, Italy, and Serbia. © 2014 Wiley Periodicals, Inc.

Assessing Collectivism in Latino, Asian/Pacific Islander, and African American Men Who Have Sex With Men: A Psychometric Evaluation.

PubMed

Sauceda, John A; Paul, Jay P; Gregorich, Steven E; Choi, Kyung-Hee

2016-02-01

The study of collectivism has implications for HIV prevention research, especially in studies that use a social networking or community mobilization approach. However, research on collectivism in race/ethnicity and sexual minority groups is limited. We psychometrically evaluated a brief version of the Individualism-Collectivism Interpersonal Assessment Inventory (ICIAI) in a chain-referral sample of 400 Latino, 393 Asian/Pacific Islander, and 403 African American men who have sex with men (MSM). Data were collected via a one-time survey on demographics, the ICIAI, acculturation, and ethnicity identity. We conducted a multiple groups confirmatory factor analysis to assess for measurement invariance across the three groups of MSM, as well as tested its reliability and validity. The ICIAI evidenced good psychometric properties and was invariant across all groups. We highlight implications for how this measure of collectivism can be applied toward the study of HIV prevention and in lesbian, gay, bisexual and transgender communities.

Assessing collectivism in Latino, Asian/Pacific Islander and African American men who have sex with men: A psychometric evaluation

PubMed Central

Sauceda, John A.; Paul, Jay P.; Gregorich, Steven E.; Choi, Kyung-Hee

2015-01-01

The study of collectivism has implications for HIV prevention research, especially in studies that use a social networking or community mobilization approach. However, research on collectivism in race/ethnicity and sexual minority groups is limited. We psychometrically evaluated a brief version of the Individualism-Collectivism Interpersonal Assessment Inventory (ICIAI) in a chain-referral sample of 400 Latino, 393 Asian/Pacific Islander, and 403 African American men who have sex with men (MSM). Data were collected via a one-time survey on demographics, the ICIAI, acculturation, and ethnicity identity. We conducted a multiple groups confirmatory factor analysis to assess for measurement invariance across the three groups of MSM, as well as tested its reliability and validity. The ICIAI evidenced good psychometric properties and was invariant across all groups. We highlight implications for how this measure of collectivism can be applied toward the study of HIV prevention and in lesbian, gay, bisexual and transgender communities. PMID:26829254

[A short version of the Narcissistic Personality Inventory (NPI-15): dimensionality and psychometric properties in a representative sample of the German population].

PubMed

Spangenberg, Lena; Romppel, Matthias; Bormann, Bianca; Hofmeister, Dirk; Brähler, Elmar; Strauß, Bernhard

2013-08-01

The Narcissistic Personality Inventory (NPI) is a commonly used measure of narcissism. This study administered a 15 item short version of the NPI (NPI-15). Central aims of the present study were to examine its dimensionality, and to provide data on its psychometric properties. NPI-15 and Hospital Anxiety and Depression Scale (HADS-D) were assessed in a representative sample of the German population (N=2,512). According to Scree-plot and model fit, a solution with 2 or 3 factors seemed feasible. Because of factor loadings and item-level associations to depression/anxiety we decided to favour a 2-factor-solution. 2 subscales reflecting different facets of narcissism were compiled (leadership ability/personality [LA/LP], grandiosity [G]). The psychometric properties of these scales were good (LA/LP) respectively unsatisfactory (G). The validity of the NPI-15 needs to be further studied. © Georg Thieme Verlag KG Stuttgart · New York.

Psychometric Evaluation of Two Appetite Questionnaires in Patients With Heart Failure.

PubMed

Andreae, Christina; Strömberg, Anna; Sawatzky, Richard; Årestedt, Kristofer

2015-12-01

Decreased appetite in heart failure (HF) may lead to undernutrition which could negatively influence prognosis. Appetite is a complex clinical issue that is often best measured with the use of self-report instruments. However, there is a lack of self-rated appetite instruments. The Council on Nutrition Appetite Questionnaire (CNAQ) and the Simplified Nutritional Appetite Questionnaire (SNAQ) are validated instruments developed primarily for elderly people. Yet, the psychometric properties have not been evaluated in HF populations. The aim of the present study was to evaluate the psychometric properties of CNAQ and SNAQ in patients with HF. A total of 186 outpatients with reduced ejection fraction and New York Heart Association (NYHA) functional classifications II-IV were included (median age 72 y; 70% men). Data were collected with the use of a questionnaire that included the CNAQ and SNAQ. The psychometric evaluation included data quality, factor structure, construct validity, known-group validity, and internal consistency. Unidimensionality was supported by means of parallel analysis and confirmatory factor analyses (CFAs). The CFA results indicated sufficient model fit. Both construct validity and known-group validity were supported. Internal consistency reliability was acceptable, with ordinal coefficient alpha estimates of 0.82 for CNAQ and 0.77 for SNAQ. CNAQ and SNAQ demonstrated sound psychometric properties and can be used to measure appetite in patients with HF. Copyright © 2015 Elsevier Inc. All rights reserved.

Systematic review of self-concept measures for primary school aged children with cerebral palsy.

PubMed

Cheong, Sau Kuan; Johnston, Leanne M

2013-10-01

This study involved a systematic review aimed to identify self-concept measures that provided published psychometrics for primary school aged children (8-12 years) with cerebral palsy (CP). Six electronic databases (PubMed, MEDLINE, CINAHL, PsycINFO, PsycARTICLES and Web of Science) were searched to identify assessments that (1) measured self-concept; (2) in children aged 8-12 years; (3) with CP; (4) with psychometrics available. The Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) checklist was used to evaluate psychometric properties and the CanChild Outcome Measure Rating Form was used to evaluate clinical utility. Search yielded 271 papers, of which five met inclusion criteria. These papers reported five measures of self-concept with psychometric properties for the target population: the Rosenberg Self-Esteem Index, Self-Description Questionnaire-I, Self-Perception Profile for Children (original) and two separate modifications of the Self-Perception Profile for Children. Currently, no self-concept measures published in English had sufficient psychometric data for children with CP. The Self-Description Questionnaire-I and the Self-Perception Profile for Children were promising options. Further research is required (a) to determine self-concept construct components important for children with CP and (b) to examine the relative strength, validity, reliability and clinical utility of self-concept measures for the target population. Copyright © 2013 Elsevier Ltd. All rights reserved.

An interventionist adherence scale for a specialized brief negotiation interview focused on treatment engagement for opioid use disorders.

PubMed

Pantalon, Michael V; Dziura, James; Li, Fang-Yong; Owens, Patricia H; O'Connor, Patrick G; D'Onofrio, Gail

2017-01-01

No psychometrically validated instrument for evaluating the extent to which interventionists correctly implement brief interventions designed to motivate treatment engagement for opioid use disorders has been reported in the literature. The objective of this study was to develop and examine the psychometric properties of the Brief Negotiation Interview (BNI) Adherence Scale for Opioid Use Disorders (BAS-O). In the context of a randomized controlled trial evaluating the efficacy of 3 models of emergency department care for opioid use disorders, the authors developed and subsequently examined the psychometric properties of the BAS-O, a 38-item scale that required raters to answer whether or not ("Yes" or "No") each of the critical actions of the BNI was correctly implemented by the research interventionist. BAS-O items pertained to the BNI's 4 steps: (1) Raise the Subject, (2) Provide Feedback, (3) Enhance Motivation, and (4) Negotiate and Advise. A total of 215 audio-recorded BNI and 88 control encounters were rated by 3 trained raters who were independent of the study team and blind to study hypotheses, treatment, and assignment. The results indicated the BAS-O has fair to excellent psychometric properties, in terms of good internal consistency, excellent interrater reliability, discriminant validity, and construct validity, and fair predictive validity. A 13-item, 2-factor solution accounted for nearly 80% of the variance, where factor 1 addressed "Autonomy and Planning" (7 items) and factor 2 addressed "Motivation and Problems" (6 items). However, predictive validity was found for only one of the BAS-O factor items (i.e., Telling patients that treatment will address a range of issues related to their opioid use disorder). This study suggests that the BAS-O is a psychometrically valid measure of adherence to the specialized BNI for motivating treatment engagement in patients with opioid use disorders, thus providing a brief (13-item), objective method of evaluating BNI skill performance.

The influence of veteran race and psychometric testing on veterans affairs posttraumatic stress disorder (PTSD) disability exam outcomes.

PubMed

Marx, Brian P; Engel-Rebitzer, Eden; Bovin, Michelle J; Parker-Guilbert, Kelly S; Moshier, Samantha; Barretto, Kenneth; Szafranski, Derek; Gallagher, Matthew W; Holowka, Darren W; Rosen, Raymond C; Keane, Terence M

2017-06-01

This study examined the influence of veterans' race and examiners' use of psychometric testing during a Department of Veterans Affairs posttraumatic stress disorder (PTSD) disability examination on diagnostic and service connection status outcomes. Participants were 764 veterans enrolled in a national longitudinal registry. Current and lifetime PTSD diagnostic status was determined with the Structured Clinical Interview for DSM-IV (SCID) and was compared with PTSD diagnosis conferred upon veterans by their compensation and pension (C&P) examiners as well as with ultimate Veterans Affairs (VA) PTSD service connected status. The concordance rate between independent SCID current PTSD diagnosis and PTSD disability examination diagnosis was 70.4%, and between SCID lifetime PTSD diagnosis and PTSD disability examination diagnosis was 77.7%. Among veterans with current SCID diagnosed PTSD, Black veterans were significantly less likely than White veterans to receive a PTSD diagnosis from their C&P examiner (odds ratio [OR] = .39, p = .003, confidence interval [CI] = .20-.73). Among veterans without current SCID diagnosed PTSD, White veterans were significantly more likely than Black veterans to receive a PTSD diagnosis from their C&P examiner (OR = 4.07, p = .005, CI = 1.51-10.92). Splitting the sample by use of psychometric testing revealed that examinations that did not include psychometric testing demonstrated the same relation between veteran race and diagnostic concordance. However, for examinations in which psychometric testing was used, the racial disparity between SCID PTSD status and disability exam PTSD status was no longer significant. Results suggest that psychometric testing may reduce disparities in VA PTSD disability exam outcomes. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Examination of Psychometric Properties of a Translated Social-Emotional Screening Test: The Taiwanese Version of The Ages and Stages Questionnaires: Social-Emotional

ERIC Educational Resources Information Center

Chen, Chieh-Yu

2017-01-01

Investigating the psychometric properties of a screening instrument for young children is necessary to ascertain its quality and accuracy. In light of the important role culture plays on human beliefs and parenting styles, a newly translated and adapted test needs to be studied. Evaluating outcomes on a translated version of a test may reveal…

A Psychometric Revision of the European American Values Scale for Asian Americans Using the Rasch Model

ERIC Educational Resources Information Center

Hong, Sehee; Kim, Bryan S. K.; Wolfe, Maren M.

2005-01-01

In this study, the 18-item European American Values Scale for Asian Americans (M. M. Wolfe, P. H. Yang, E. C. Wong, & D. R. Atkinson, 2001) was revised on the basis of results from a psychometric analysis using the Rasch Model (G. Rasch, 1960). The results led to the establishment of the 25-item European American Values Scale for Asian…

Achievement Testing with the Wechsler Quicktest: An Examination of Its Psychometric Properties and Applied Utility with a Greek-Cypriot Sample

ERIC Educational Resources Information Center

Vrachimi-Souroulla, Andry; Panayiotou, Georgia; Kokkinos, Constantinos M.; Lamprianou, Iasonas

2011-01-01

The study aimed to field-test a Greek version of the Wechsler Quicktest and to examine its psychometric properties. The Quicktest was individually administered to 208 students, aged 5-14 years, along with a reading test. Based on the Rasch analysis, data for the Quicktest subtests showed acceptable fit to the model. Also, correlations were found…

Psychometric Properties of a Parental Questionnaire for Assessing Correlates of Toddlers' Physical Activity and Sedentary Behavior

ERIC Educational Resources Information Center

Carson, Valerie; Hesketh, Kylie D.; Rhodes, Ryan E.; Rinaldi, Christina; Rodgers, Wendy; Spence, John C.

2017-01-01

This study examined the psychometric properties of a questionnaire developed with the guidance of the socialization model of child behaviour to understand modifiable correlates of toddlers' physical activity and sedentary behaviour. Findings are based on 118 parents (33.7 ± 4.9 years; 86% female) of toddlers (19.3 ± 2.7 months; 48% female) from…

Psychometrics of the scale of attitudes toward physician-pharmacist collaboration: a study with medical students.

PubMed

Hojat, Mohammadreza; Spandorfer, John; Isenberg, Gerald A; Vergare, Michael J; Fassihi, Reza; Gonnella, Joseph S

2012-01-01

Despite the emphasis placed on interdisciplinary education and interprofessional collaboration between physicians and pharmacologists, no psychometrically sound instrument is available to measure attitudes toward collaborative relationships. This study was designed to examine psychometrics of an instrument for measuring attitudes toward physician-pharmacist collaborative relationships for administration to students in medical and pharmacy schools and to physicians and pharmacists. The Scale of Attitudes Toward Physician-Pharmacist Collaboration was completed by 210 students at Jefferson Medical College. Factor analysis and correlational methods were used to examine psychometrics of the instrument. Consistent with the conceptual framework of interprofessional collaboration, three underlying constructs, namely "responsibility and accountability;" "shared authority;" and "interdisciplinary education" emerged from the factor analysis of the instrument providing support for its construct validity. The reliability coefficient alpha for the instrument was 0.90. The instrument's criterion-related validity coefficient with scores of a validated instrument (Jefferson Scale of Attitudes Toward Physician-Nurse Collaboration) was 0.70. Findings provide support for the validity and reliability of the instrument for medical students. The instrument has the potential to be used for the evaluation of interdisciplinary education in medical and pharmacy schools, and for the evaluation of patient outcomes resulting from collaborative physician-pharmacist relationships.

SNOT-22: psychometric properties and cross-cultural adaptation into the Portuguese language spoken in Brazil.

PubMed

Caminha, Guilherme Pilla; Melo Junior, José Tavares de; Hopkins, Claire; Pizzichini, Emilio; Pizzichini, Marcia Margaret Menezes

2012-12-01

Rhinosinusitis is a highly prevalent disease and a major cause of high medical costs. It has been proven to have an impact on the quality of life through generic health-related quality of life assessments. However, generic instruments may not be able to factor in the effects of interventions and treatments. SNOT-22 is a major disease-specific instrument to assess quality of life for patients with rhinosinusitis. Nevertheless, there is still no validated SNOT-22 version in our country. Cross-cultural adaptation of the SNOT-22 into Brazilian Portuguese and assessment of its psychometric properties. The Brazilian version of the SNOT-22 was developed according to international guidelines and was broken down into nine stages: 1) Preparation 2) Translation 3) Reconciliation 4) Back-translation 5) Comparison 6) Evaluation by the author of the SNOT-22 7) Revision by committee of experts 8) Cognitive debriefing 9) Final version. Second phase: prospective study consisting of a verification of the psychometric properties, by analyzing internal consistency and test-retest reliability. Cultural adaptation showed adequate understanding, acceptability and psychometric properties. We followed the recommended steps for the cultural adaptation of the SNOT-22 into Portuguese language, producing a tool for the assessment of patients with sinonasal disorders of clinical importance and for scientific studies.

Psychometric properties of the Beck Depression Inventory-II: a comprehensive review.

PubMed

Wang, Yuan-Pang; Gorenstein, Clarice

2013-01-01

To review the psychometric properties of the Beck Depression Inventory-II (BDI-II) as a self-report measure of depression in a variety of settings and populations. Relevant studies of the BDI-II were retrieved through a search of electronic databases, a hand search, and contact with authors. Retained studies (k = 118) were allocated into three groups: non-clinical, psychiatric/institutionalized, and medical samples. The internal consistency was described as around 0.9 and the retest reliability ranged from 0.73 to 0.96. The correlation between BDI-II and the Beck Depression Inventory (BDI-I) was high and substantial overlap with measures of depression and anxiety was reported. The criterion-based validity showed good sensitivity and specificity for detecting depression in comparison to the adopted gold standard. However, the cutoff score to screen for depression varied according to the type of sample. Factor analysis showed a robust dimension of general depression composed by two constructs: cognitive-affective and somatic-vegetative. The BDI-II is a relevant psychometric instrument, showing high reliability, capacity to discriminate between depressed and non-depressed subjects, and improved concurrent, content, and structural validity. Based on available psychometric evidence, the BDI-II can be viewed as a cost-effective questionnaire for measuring the severity of depression, with broad applicability for research and clinical practice worldwide.

Effort-Based Decision-Making Paradigms for Clinical Trials in Schizophrenia: Part 1—Psychometric Characteristics of 5 Paradigms.

PubMed

Reddy, L Felice; Horan, William P; Barch, Deanna M; Buchanan, Robert W; Dunayevich, Eduardo; Gold, James M; Lyons, Naomi; Marder, Stephen R; Treadway, Michael T; Wynn, Jonathan K; Young, Jared W; Green, Michael F

2015-09-01

Impairments in willingness to exert effort contribute to the motivational deficits characteristic of the negative symptoms of schizophrenia. The current study evaluated the psychometric properties of 5 new or adapted paradigms to determine their suitability for use in clinical trials of schizophrenia. This study included 94 clinically stable participants with schizophrenia and 40 healthy controls. The effort-based decision-making battery was administered twice to the schizophrenia group (baseline, 4-week retest) and once to the control group. The 5 paradigms included 1 that assesses cognitive effort, 1 perceptual effort, and 3 that assess physical effort. Each paradigm was evaluated on (1) patient vs healthy control group differences, (2) test-retest reliability, (3) utility as a repeated measure (ie, practice effects), and (4) tolerability. The 5 paradigms showed varying psychometric strengths and weaknesses. The Effort Expenditure for Rewards Task showed the best reliability and utility as a repeated measure, while the Grip Effort Task had significant patient-control group differences, and superior tolerability and administration duration. The other paradigms showed weaker psychometric characteristics in their current forms. These findings highlight challenges in adapting effort and motivation paradigms for use in clinical trials. Published by Oxford University Press on behalf of the Maryland Psychiatric Research Center 2015.