Development of a Simple 12-Item Theory-Based Instrument to Assess the Impact of Continuing Professional Development on Clinical Behavioral Intentions

PubMed Central

Légaré, France; Borduas, Francine; Freitas, Adriana; Jacques, André; Godin, Gaston; Luconi, Francesca; Grimshaw, Jeremy

2014-01-01

Background Decision-makers in organizations providing continuing professional development (CPD) have identified the need for routine assessment of its impact on practice. We sought to develop a theory-based instrument for evaluating the impact of CPD activities on health professionals' clinical behavioral intentions. Methods and Findings Our multipronged study had four phases. 1) We systematically reviewed the literature for instruments that used socio-cognitive theories to assess healthcare professionals' clinically-oriented behavioral intentions and/or behaviors; we extracted items relating to the theoretical constructs of an integrated model of healthcare professionals' behaviors and removed duplicates. 2) A committee of researchers and CPD decision-makers selected a pool of items relevant to CPD. 3) An international group of experts (n = 70) reached consensus on the most relevant items using electronic Delphi surveys. 4) We created a preliminary instrument with the items found most relevant and assessed its factorial validity, internal consistency and reliability (weighted kappa) over a two-week period among 138 physicians attending a CPD activity. Out of 72 potentially relevant instruments, 47 were analyzed. Of the 1218 items extracted from these, 16% were discarded as improperly phrased and 70% discarded as duplicates. Mapping the remaining items onto the constructs of the integrated model of healthcare professionals' behaviors yielded a minimum of 18 and a maximum of 275 items per construct. The partnership committee retained 61 items covering all seven constructs. Two iterations of the Delphi process produced consensus on a provisional 40-item questionnaire. Exploratory factorial analysis following test-retest resulted in a 12-item questionnaire. Cronbach's coefficients for the constructs varied from 0.77 to 0.85. Conclusion A 12-item theory-based instrument for assessing the impact of CPD activities on health professionals' clinical behavioral

[Quality of advanced practice nurse counseling in home care settings (APN-BQ): psychometric testing of the instrument].

PubMed

Petry, Heidi; Suter-Riederer, Susanne; Kerker-Specker, Carmen; Imhof, Lorenz

2014-12-01

Patient centred and individually-tailored counselling of older people with a chronic condition who live at home is a useful intervention to support their independence. The paper presents the development and psychometric testing of the APN-BQ Instrument, to measure patient-centeredness. To measure the quality of an in-home counselling intervention, a 23-item questionnaire was developed and tested with 206 people 80 years and older. Principal component analysis with Varimax Rotation was conducted (n = 206). Analysis revealed a four factor (fs = 0.91) model scoring in 19 items. All factors loaded > 0.45. Cronbach's alpha was 0.86. The utility and acceptance of the instrument was confirmed by the high response rate (100 %) and the fact that participants answered 98.8 % of all questions. The APN-BQ has shown to be a reliable Instrument with good content and construct validity. It is a tool for APNs to measure structure, process, and outcome quality of a patient-centred and individually-tailored counselling program, including the degree of patient participation, and patient empowerment.

Identifying Promising Items: The Use of Crowdsourcing in the Development of Assessment Instruments

ERIC Educational Resources Information Center

Sadler, Philip M.; Sonnert, Gerhard; Coyle, Harold P.; Miller, Kelly A.

2016-01-01

The psychometrically sound development of assessment instruments requires pilot testing of candidate items as a first step in gauging their quality, typically a time-consuming and costly effort. Crowdsourcing offers the opportunity for gathering data much more quickly and inexpensively than from most targeted populations. In a simulation of a…

Raters Interpret Positively and Negatively Worded Items Similarly in a Quality of Life Instrument for Children

PubMed Central

Lin, Chung-Ying; Strong, Carol; Tsai, Meng-Che; Lee, Chih-Ting

2017-01-01

Measurement invariance is an important assumption to meaningfully compare children’s quality of life (QoL) between different raters (eg, children and parents) and across genders. Moreover, QoL instruments may combine using negatively and positively worded items—a common method to reduce response bias. However, the wording effects may have different levels of impact on different raters and genders. Our aim was to investigate the measurement invariance of Kid-KINDL, a commonly used QoL instrument, across genders and raters and to consider the wording effects simultaneously. Third to sixth graders (208 boys and 235 girls) completed the self-rated Kid-KINDL, and 1 parent each of 241 children completed the parent-rated Kid-KINDL. The wording effects were accounted for by correlated traits-uncorrelated methods model. The measurement invariance was examined using multigroup confirmatory factor analysis. Item loadings and item intercepts were invariant across gender and rater when we simultaneously accounted for the wording effects of Kid-KINDL. Our results suggest that Kid-KINDL could be used to compare QoL across gender and that parent-rated Kid-KINDL could be used to measure children’s QoL. Specifically, the invariant factor loadings across child-rated and parent-rated Kid-KINDL suggest that the score weights in each item were the same for both children and parents (ie, the important items identified by the children are the same items identified by the parents). The invariant item intercepts suggest that both children and parents share the same threshold for each item. Based on the results, we tentatively recommend that each score of a parent-rated Kid-KINDL can stand for each child’s QoL. PMID:28292193

Caries Risk Assessment Item Importance

PubMed Central

Chaffee, B.W.; Featherstone, J.D.B.; Gansky, S.A.; Cheng, J.; Zhan, L.

2016-01-01

were independently associated with providers’ risk determination than with future caries status. These university dental providers considered many items in decision making regarding patient risk, suggesting that, in turn, these comprehensive CRA forms could also aid individualized care, linking risk assessment to disease management. Knowledge Transfer Statement: Caries risk assessment (CRA) is widely recommended for patient-tailored, prevention-focused caries management. Studies show mixed predictive performance of pediatric CRA instruments, but little is known regarding how information captured in CRA forms guides clinical decision making. This study, in high-caries prevalence 6- to 72-mo-olds, demonstrates the following: 1) most items in a CRA instrument were independently associated with practitioners’ risk designations, 2) practitioners’ risk designations were significantly associated with future disease, and 3) of baseline measures associated with future caries, evident decay was the strongest independent indicator of future caries status. Although current disease (resulting from existing pathological and protective factor imbalance) may sufficiently predict future caries status in populations, other CRA items incorporated during risk categorization could aid practitioners to develop individualized intervention strategies against identified risk factors. PMID:27403458

A Rasch Differential Item Functioning Analysis of the Massachusetts Youth Screening Instrument: Identifying Race and Gender Differential Item Functioning among Juvenile Offenders

ERIC Educational Resources Information Center

Cauffman, Elizabeth; MacIntosh, Randall

2006-01-01

The juvenile justice system needs a tool that can identify and assess mental health problems among youths quickly with validity and reliability. The goal of this article is to evaluate the racial/ethnic and gender differential item functioning (DIF) of the Massachusetts Youth Screening Instrument-Second Version (MAYSI-2) using the Rasch Model.…

Differential Item Functioning in Primary Healthcare Evaluation Instruments by French/English Version, Educational Level and Urban/Rural Location

PubMed Central

Haggerty, Jeannie L.; Bouharaoui, Fatima; Santor, Darcy A.

2011-01-01

Evaluating the extent to which groups or subgroups of individuals differ with respect to primary healthcare experience depends on first ruling out the possibility of bias. Objective: To determine whether item or subscale performance differs systematically between French/English, high/low education subgroups and urban/rural residency. Method: A sample of 645 adult users balanced by French/English language (in Quebec and Nova Scotia, respectively), high/low education and urban/rural residency responded to six validated instruments: the Primary Care Assessment Survey (PCAS); the Primary Care Assessment Tool – Short Form (PCAT-S); the Components of Primary Care Index (CPCI); the first version of the EUROPEP (EUROPEP-I); the Interpersonal Processes of Care Survey, version II (IPC-II); and part of the Veterans Affairs National Outpatient Customer Satisfaction Survey (VANOCSS). We normalized subscale scores to a 0-to-10 scale and tested for between-group differences using ANOVA tests. We used a parametric item response model to test for differences between subgroups in item discriminability and item difficulty. We re-examined group differences after removing items with differential item functioning. Results: Experience of care was assessed more positively in the English-speaking (Nova Scotia) than in the French-speaking (Quebec) respondents. We found differential English/French item functioning in 48% of the 153 items: discriminability in 20% and differential difficulty in 28%. English items were more discriminating generally than the French. Removing problematic items did not change the differences in French/English assessments. Differential item functioning by high/low education status affected 27% of items, with items being generally more discriminating in high-education groups. Between-group comparisons were unchanged. In contrast, only 9% of items showed differential item functioning by geography, affecting principally the accessibility attribute. Removing

A Comparison of a Bayesian and a Maximum Likelihood Tailored Testing Procedure.

ERIC Educational Resources Information Center

McKinley, Robert L.; Reckase, Mark D.

A study was conducted to compare tailored testing procedures based on a Bayesian ability estimation technique and on a maximum likelihood ability estimation technique. The Bayesian tailored testing procedure selected items so as to minimize the posterior variance of the ability estimate distribution, while the maximum likelihood tailored testing…

Retest of a Principal Components Analysis of Two Household Environmental Risk Instruments.

PubMed

Oneal, Gail A; Postma, Julie; Odom-Maryon, Tamara; Butterfield, Patricia

2016-08-01

Household Risk Perception (HRP) and Self-Efficacy in Environmental Risk Reduction (SEERR) instruments were developed for a public health nurse-delivered intervention designed to reduce home-based, environmental health risks among rural, low-income families. The purpose of this study was to test both instruments in a second low-income population that differed geographically and economically from the original sample. Participants (N = 199) were recruited from the Women, Infants, and Children (WIC) program. Paper and pencil surveys were collected at WIC sites by research-trained student nurses. Exploratory principal components analysis (PCA) was conducted, and comparisons were made to the original PCA for the purpose of data reduction. Instruments showed satisfactory Cronbach alpha values for all components. HRP components were reduced from five to four, which explained 70% of variance. The components were labeled sensed risks, unseen risks, severity of risks, and knowledge. In contrast to the original testing, environmental tobacco smoke (ETS) items was not a separate component of the HRP. The SEERR analysis demonstrated four components explaining 71% of variance, with similar patterns of items as in the first study, including a component on ETS, but some differences in item location. Although low-income populations constituted both samples, differences in demographics and risk exposures may have played a role in component and item locations. Findings provided justification for changing or reducing items, and for tailoring the instruments to population-level risks and behaviors. Although analytic refinement will continue, both instruments advance the measurement of environmental health risk perception and self-efficacy. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

A Non-Parametric Item Response Theory Evaluation of the CAGE Instrument Among Older Adults.

PubMed

Abdin, Edimansyah; Sagayadevan, Vathsala; Vaingankar, Janhavi Ajit; Picco, Louisa; Chong, Siow Ann; Subramaniam, Mythily

2018-02-23

The validity of the CAGE using item response theory (IRT) has not yet been examined in older adult population. This study aims to investigate the psychometric properties of the CAGE using both non-parametric and parametric IRT models, assess whether there is any differential item functioning (DIF) by age, gender and ethnicity and examine the measurement precision at the cut-off scores. We used data from the Well-being of the Singapore Elderly study to conduct Mokken scaling analysis (MSA), dichotomous Rasch and 2-parameter logistic IRT models. The measurement precision at the cut-off scores were evaluated using classification accuracy (CA) and classification consistency (CC). The MSA showed the overall scalability H index was 0.459, indicating a medium performing instrument. All items were found to be homogenous, measuring the same construct and able to discriminate well between respondents with high levels of the construct and the ones with lower levels. The item discrimination ranged from 1.07 to 6.73 while the item difficulty ranged from 0.33 to 2.80. Significant DIF was found for 2-item across ethnic group. More than 90% (CC and CA ranged from 92.5% to 94.3%) of the respondents were consistently and accurately classified by the CAGE cut-off scores of 2 and 3. The current study provides new evidence on the validity of the CAGE from the IRT perspective. This study provides valuable information of each item in the assessment of the overall severity of alcohol problem and the precision of the cut-off scores in older adult population.

On Studying Common Factor Dominance and Approximate Unidimensionality in Multicomponent Measuring Instruments with Discrete Items

ERIC Educational Resources Information Center

Raykov, Tenko; Marcoulides, George A.

2018-01-01

This article outlines a procedure for examining the degree to which a common factor may be dominating additional factors in a multicomponent measuring instrument consisting of binary items. The procedure rests on an application of the latent variable modeling methodology and accounts for the discrete nature of the manifest indicators. The method…

The use of instrumented gait analysis for individually tailored interdisciplinary interventions in children with cerebral palsy: a randomised controlled trial protocol.

PubMed

Rasmussen, Helle Mätzke; Pedersen, Niels Wisbech; Overgaard, Søren; Hansen, Lars Kjaersgaard; Dunkhase-Heinl, Ulrike; Petkov, Yanko; Engell, Vilhelm; Baker, Richard; Holsgaard-Larsen, Anders

2015-12-07

Children with cerebral palsy (CP) often have an altered gait. Orthopaedic surgery, spasticity management, physical therapy and orthotics are used to improve the gait. Interventions are individually tailored and are planned on the basis of clinical examinations and standardised measurements to assess walking ('care as usual'). However, these measurements do not describe features in the gait that reflect underlying neuro-musculoskeletal impairments. This can be done with 3-dimensional instrumented gait analysis (IGA). The aim of this study is to test the hypothesis that improvements in gait following individually tailored interventions when IGA is used are superior to those following 'care as usual'. A prospective, single blind, randomised, parallel group study will be conducted. Children aged 5 to 8 years with spastic CP, classified at Gross Motor Function Classification System levels I or II, will be included. The interventions under investigation are: 1) individually tailored interdisciplinary interventions based on the use of IGA, and 2) 'care as usual'. The primary outcome is gait measured by the Gait Deviation Index. Secondary outcome measures are: walking performance (1-min walk test) and patient-reported outcomes of functional mobility (Pediatric Evaluation of Disability Inventory), health-related quality of life (The Pediatric Quality of Life Inventory Cerebral Palsy Module) and overall health, pain and participation (The Pediatric Outcome Data Collection Instrument). The primary endpoint for assessing the outcome of the two interventions will be 52 weeks after start of intervention. A follow up will also be performed at 26 weeks; however, exclusively for the patient-reported outcomes. To our knowledge, this is the first randomised controlled trial comparing the effects of an individually tailored interdisciplinary intervention based on the use of IGA versus 'care as usual' in children with CP. Consequently, the study will provide novel evidence for the

"When I saw walking I just kind of took it as wheeling": interpretations of mobility-related items in generic, preference-based health state instruments in the context of spinal cord injury.

PubMed

Michel, Yvonne Anne; Engel, Lidia; Rand-Hendriksen, Kim; Augestad, Liv Ariane; Whitehurst, David Gt

2016-11-28

In health economic analyses, health states are typically valued using instruments with few items per dimension. Due to the generic (and often reductionist) nature of such instruments, certain groups of respondents may experience challenges in describing their health state. This study is concerned with generic, preference-based health state instruments that provide information for decisions about the allocation of resources in health care. Unlike physical measurement instruments, preference-based health state instruments provide health state values that are dependent on how respondents interpret the items. This study investigates how individuals with spinal cord injury (SCI) interpret mobility-related items contained within six preference-based health state instruments. Secondary analysis of focus group transcripts originally collected in Vancouver, Canada, explored individuals' perceptions and interpretations of mobility-related items contained within the 15D, Assessment of Quality of Life 8-dimension (AQoL-8D), EQ-5D-5L, Health Utilities Index (HUI), Quality of Well-Being Scale Self-Administered (QWB-SA), and the 36-item Short Form health survey version 2 (SF-36v2). Ritchie and Spencer's 'Framework Approach' was used to perform thematic analysis that focused on participants' comments concerning the mobility-related items only. Fifteen individuals participated in three focus groups (five per focus group). Four themes emerged: wording of mobility (e.g., 'getting around' vs 'walking'), reference to aids and appliances, lack of suitable response options, and reframing of items (e.g., replacing 'walking' with 'wheeling'). These themes reflected item features that respondents perceived as relevant in enabling them to describe their mobility, and response strategies that respondents could use when faced with inaccessible items. Investigating perceptions to mobility-related items within the context of SCI highlights substantial variation in item interpretation across six

Use of Adult Patient Focus Groups to Develop the Initial Item Bank for a Cochlear Implant Quality-of-Life Instrument.

PubMed

McRackan, Theodore R; Velozo, Craig A; Holcomb, Meredith A; Camposeo, Elizabeth L; Hatch, Jonathan L; Meyer, Ted A; Lambert, Paul R; Melvin, Cathy L; Dubno, Judy R

2017-10-01

No instrument exists to assess quality of life (QOL) in adult cochlear implant (CI) users that has been developed and validated using accepted scientific standards. To develop a CI-specific QOL instrument for adults in accordance with the Patient Reported Outcomes Measurement Information System (PROMIS) guidelines. As required in the PROMIS guidelines, patient focus groups participated in creation of the initial item bank. Twenty-three adult CI users were divided into 1 of 3 focus groups stratified by word recognition ability. Three moderator-led focus groups were conducted based on grounded theory on December 3, 2016. Two reviewers independently analyzed focus group recordings and transcripts, with a third reviewer available to resolve discrepancies. All data were reviewed and reported according to the Consolidated Criteria for Reporting Qualitative Research. The setting was a tertiary referral center. Coded focus group data. The 23 focus group participants (10 [43%] female; mean [range] age, 68.1 [46.2-84.2] years) represented a wide range of income levels, education levels, listening modalities, CI device manufacturers, duration of CI use, and age at implantation. Data saturation was determined to be reached before the conclusion of each of the focus groups. After analysis of the transcripts, the central themes identified were communication, emotion, environmental sounds, independence and work function, listening effort, social isolation and ability to socialize, and sound clarity. Cognitive interviews were carried out on 20 adult CI patients who did not participate in the focus groups to ensure item clarity. Based on these results, the initial QOL item bank and prototype were developed. Patient focus groups drawn from the target population are the preferred method of identifying content areas and domains for developing the item bank for a CI-specific QOL instrument. Compared with previously used methods, the use of patient-centered item development for a CI

Item validity vs. item discrimination index: a redundancy?

NASA Astrophysics Data System (ADS)

Panjaitan, R. L.; Irawati, R.; Sujana, A.; Hanifah, N.; Djuanda, D.

2018-03-01

In several literatures about evaluation and test analysis, it is common to find that there are calculations of item validity as well as item discrimination index (D) with different formula for each. Meanwhile, other resources said that item discrimination index could be obtained by calculating the correlation between the testee’s score in a particular item and the testee’s score on the overall test, which is actually the same concept as item validity. Some research reports, especially undergraduate theses tend to include both item validity and item discrimination index in the instrument analysis. It seems that these concepts might overlap for both reflect the test quality on measuring the examinees’ ability. In this paper, examples of some results of data processing on item validity and item discrimination index were compared. It would be discussed whether item validity and item discrimination index can be represented by one of them only or it should be better to present both calculations for simple test analysis, especially in undergraduate theses where test analyses were included.

Pancreatitis Quality of Life Instrument: Development of a new instrument

PubMed Central

Bova, Carol; Barton, Bruce; Hartigan, Celia

2014-01-01

Objectives: The goal of this project was to develop the first disease-specific instrument for the evaluation of quality of life in chronic pancreatitis. Methods: Focus groups and interview sessions were conducted, with chronic pancreatitis patients, to identify items felt to impact quality of life which were subsequently formatted into a paper-and-pencil instrument. This instrument was used to conduct an online survey by an expert panel of pancreatologists to evaluate its content validity. Finally, the modified instrument was presented to patients during precognitive testing interviews to evaluate its clarity and appropriateness. Results: In total, 10 patients were enrolled in the focus groups and interview sessions where they identified 50 items. Once redundant items were removed, the 40 remaining items were made into a paper-and-pencil instrument referred to as the Pancreatitis Quality of Life Instrument. Through the processes of content validation and precognitive testing, the number of items in the instrument was reduced to 24. Conclusions: This marks the development of the first disease-specific instrument to evaluate quality of life in chronic pancreatitis. It includes unique features not found in generic instruments (economic factors, stigma, and spiritual factors). Although this marks a giant step forward, psychometric evaluation is still needed prior to its clinical use. PMID:26770703

Measuring nursing competencies in the operating theatre: instrument development and psychometric analysis using Item Response Theory.

PubMed

Nicholson, Patricia; Griffin, Patrick; Gillis, Shelley; Wu, Margaret; Dunning, Trisha

2013-09-01

Concern about the process of identifying underlying competencies that contribute to effective nursing performance has been debated with a lack of consensus surrounding an approved measurement instrument for assessing clinical performance. Although a number of methodologies are noted in the development of competency-based assessment measures, these studies are not without criticism. The primary aim of the study was to develop and validate a Performance Based Scoring Rubric, which included both analytical and holistic scales. The aim included examining the validity and reliability of the rubric, which was designed to measure clinical competencies in the operating theatre. The fieldwork observations of 32 nurse educators and preceptors assessing the performance of 95 instrument nurses in the operating theatre were used in the calibration of the rubric. The Rasch model, a particular model among Item Response Models, was used in the calibration of each item in the rubric in an attempt at improving the measurement properties of the scale. This is done by establishing the 'fit' of the data to the conditions demanded by the Rasch model. Acceptable reliability estimates, specifically a high Cronbach's alpha reliability coefficient (0.940), as well as empirical support for construct and criterion validity for the rubric were achieved. Calibration of the Performance Based Scoring Rubric using Rasch model revealed that the fit statistics for most items were acceptable. The use of the Rasch model offers a number of features in developing and refining healthcare competency-based assessments, improving confidence in measuring clinical performance. The Rasch model was shown to be useful in developing and validating a competency-based assessment for measuring the competence of the instrument nurse in the operating theatre with implications for use in other areas of nursing practice. Crown Copyright © 2012. Published by Elsevier Ltd. All rights reserved.

The Rasch Model and Missing Data, with an Emphasis on Tailoring Test Items.

ERIC Educational Resources Information Center

de Gruijter, Dato N. M.

Many applications of educational testing have a missing data aspect (MDA). This MDA is perhaps most pronounced in item banking, where each examinee responds to a different subtest of items from a large item pool and where both person and item parameter estimates are needed. The Rasch model is emphasized, and its non-parametric counterpart (the…

The Communicative Participation Item Bank (CPIB): Item bank calibration and development of a disorder-generic short form

PubMed Central

Baylor, Carolyn; Yorkston, Kathryn; Eadie, Tanya; Kim, Jiseon; Chung, Hyewon; Amtmann, Dagmar

2015-01-01

Purpose The purpose of this study was to calibrate the items for the Communicative Participation Item Bank (CPIB) using Item Response Theory (IRT). One overriding objective was to examine if the IRT item parameters would be consistent across different diagnostic groups, thereby allowing creation of a disorder-generic instrument. The intended outcomes were the final item bank and a short form ready for clinical and research applications. Methods Self-report data were collected from 701 individuals representing four diagnoses: multiple sclerosis, Parkinson’s disease, amyotrophic lateral sclerosis and head and neck cancer. Participants completed the CPIB and additional self-report questionnaires. CPIB data were analyzed using the IRT Graded Response Model (GRM). Results The initial set of 94 candidate CPIB items were reduced to an item bank of 46 items demonstrating unidimensionality, local independence, good item fit, and good measurement precision. Differential item function (DIF) analyses detected no meaningful differences across diagnostic groups. A 10-item, disorder-generic short form was generated. Conclusions The CPIB provides speech-language pathologists with a unidimensional, self-report outcomes measurement instrument dedicated to the construct of communicative participation. This instrument may be useful to clinicians and researchers wanting to implement measures of communicative participation in their work. PMID:23816661

Accommodating subject and instrument variations in spectroscopic determinations

DOEpatents

Haas, Michael J [Albuquerque, NM; Rowe, Robert K [Corrales, NM; Thomas, Edward V [Albuquerque, NM

2006-08-29

A method and apparatus for measuring a biological attribute, such as the concentration of an analyte, particularly a blood analyte in tissue such as glucose. The method utilizes spectrographic techniques in conjunction with an improved instrument-tailored or subject-tailored calibration model. In a calibration phase, calibration model data is modified to reduce or eliminate instrument-specific attributes, resulting in a calibration data set modeling intra-instrument or intra-subject variation. In a prediction phase, the prediction process is tailored for each target instrument separately using a minimal number of spectral measurements from each instrument or subject.

[Assessment of criminal responsibility in paraphilic disorder. Can the severity of the disorder be assessed with items of standardized prognostic instruments?].

PubMed

Briken, P; Müller, J L

2014-03-01

Assessment of the severity of paraphilic disorders is an important aspect of psychiatric court reports for assessing criminal responsibility and placement in a forensic psychiatric hospital according to the German penal code (§§ 20, 21, 63 StGB). The minimum requirements for appraisal of criminal responsibility published by an interdisciplinary working group under the guidance of the German Federal Court of Justice define the standards for this procedure. This paper presents a research concept that aims to assess the severity of paraphilic disorders by using items of standardized prognostic instruments. In addition to a formal diagnosis according to the international classification of diseases (ICD) and the diagnostic and statistical manual of mental diseases (DSM) criteria, the items "deviant sexual interests" and "sexual preoccupations" from the prognosis instrument Stable 2007 are used to assess the severity of paraphilic disorders. Other criteria, such as "relationship deficits" are used to support the appraisal of the severity of the disorder. The items "sexual preoccupation", "emotional collapse" and "collapse of social support" from the prognosis instrument Acute 2007 are used to assess the capacity for self-control. In a next step the validity and reliability of this concept will be tested.

Development of an Instrument to Measure Behavioral Health Function for Work Disability: Item Pool Construction and Factor Analysis

PubMed Central

Marfeo, Elizabeth E.; Ni, Pengsheng; Haley, Stephen M.; Jette, Alan M.; Bogusz, Kara; Meterko, Mark; McDonough, Christine M.; Chan, Leighton; Brandt, Diane E.; Rasch, Elizabeth K.

2014-01-01

Objectives To develop a broad set of claimant-reported items to assess behavioral health functioning relevant to the Social Security disability determination processes, and to evaluate the underlying structure of behavioral health functioning for use in development of a new functional assessment instrument. Design Cross-sectional. Setting Community. Participants Item pools of behavioral health functioning were developed, refined, and field-tested in a sample of persons applying for Social Security disability benefits (N=1015) who reported difficulties working due to mental or both mental and physical conditions. Interventions None. Main Outcome Measure Social Security Administration Behavioral Health (SSA-BH) measurement instrument Results Confirmatory factor analysis (CFA) specified that a 4-factor model (self-efficacy, mood and emotions, behavioral control, and social interactions) had the optimal fit with the data and was also consistent with our hypothesized conceptual framework for characterizing behavioral health functioning. When the items within each of the four scales were tested in CFA, the fit statistics indicated adequate support for characterizing behavioral health as a unidimensional construct along these four distinct scales of function. Conclusion This work represents a significant advance both conceptually and psychometrically in assessment methodologies for work related behavioral health. The measurement of behavioral health functioning relevant to the context of work requires the assessment of multiple dimensions of behavioral health functioning. Specifically, we identified a 4-factor model solution that represented key domains of work related behavioral health functioning. These results guided the development and scale formation of a new SSA-BH instrument. PMID:23548542

Development of an instrument to measure behavioral health function for work disability: item pool construction and factor analysis.

PubMed

Marfeo, Elizabeth E; Ni, Pengsheng; Haley, Stephen M; Jette, Alan M; Bogusz, Kara; Meterko, Mark; McDonough, Christine M; Chan, Leighton; Brandt, Diane E; Rasch, Elizabeth K

2013-09-01

To develop a broad set of claimant-reported items to assess behavioral health functioning relevant to the Social Security disability determination processes, and to evaluate the underlying structure of behavioral health functioning for use in development of a new functional assessment instrument. Cross-sectional. Community. Item pools of behavioral health functioning were developed, refined, and field tested in a sample of persons applying for Social Security disability benefits (N=1015) who reported difficulties working because of mental or both mental and physical conditions. None. Social Security Administration Behavioral Health (SSA-BH) measurement instrument. Confirmatory factor analysis (CFA) specified that a 4-factor model (self-efficacy, mood and emotions, behavioral control, social interactions) had the optimal fit with the data and was also consistent with our hypothesized conceptual framework for characterizing behavioral health functioning. When the items within each of the 4 scales were tested in CFA, the fit statistics indicated adequate support for characterizing behavioral health as a unidimensional construct along these 4 distinct scales of function. This work represents a significant advance both conceptually and psychometrically in assessment methodologies for work-related behavioral health. The measurement of behavioral health functioning relevant to the context of work requires the assessment of multiple dimensions of behavioral health functioning. Specifically, we identified a 4-factor model solution that represented key domains of work-related behavioral health functioning. These results guided the development and scale formation of a new SSA-BH instrument. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Contextual Differential Item Functioning: Examining the Validity of Teaching Self-Efficacy Instruments Using Hierarchical Generalized Linear Modeling

ERIC Educational Resources Information Center

Zhao, Jing

2012-01-01

The purpose of the study is to further investigate the validity of instruments used for collecting preservice teachers' perceptions of self-efficacy adapting the three-level IRT model described in Cheong's study (2006). The focus of the present study is to investigate whether the polytomously-scored items on the preservice teachers' self-efficacy…

[Disabled person's satisfaction with health and social care--an internationally developed instrument].

PubMed

Kullmann, Lajos; Paulik, Edit

2011-02-01

Quality of health and social care is being assessed by largely different methods. Obtaining comparable and valuable data is difficult. Thus, internationally developed instruments have special value. A set of instruments has been developed simultaneously using World Health Organization's instrument development method. One of these is the instrument "Quality of Care and Support for People with Disabilities". Response scales contain five options for physically and three for intellectually disabled persons. Psychometric analysis of the Hungarian instrument version was based on interviews with 151 physically and 166 intellectually disabled persons. Answering rate was high, above 95% with the exception of one item. Internal consistency of the two instrument versions by Cronbach's alpha is 0.845 and 0.745 respectively. Lowest satisfaction was found in the domain "information" in both groups that correlates significantly with health conditions at p < 0.01 and p < 0.05 level respectively. The field trial confirms validity and reliability of the instrument. Its wider use may help the evaluation of satisfaction concerning different components of quality of care, consequently better tailoring of services to needs.

Measuring social science concepts in pharmacy education research: From definition to item analysis of self-report instruments.

PubMed

Cor, M Ken

Interpreting results from quantitative research can be difficult when measures of concepts are constructed poorly, something that can limit measurement validity. Social science steps for defining concepts, guidelines for limiting construct-irrelevant variance when writing self-report questions, and techniques for conducting basic item analysis are reviewed to inform the design of instruments to measure social science concepts in pharmacy education research. Based on a review of the literature, four main recommendations emerge: These include: (1) employ a systematic process of conceptualization to derive nominal definitions; (2) write exact and detailed operational definitions for each concept, (3) when creating self-report questionnaires, write statements and select scales to avoid introducing construct-irrelevant variance (CIV); and (4) use basic item analysis results to inform instrument revision. Employing recommendations that emerge from this review will strengthen arguments to support measurement validity which in turn will support the defensibility of study finding interpretations. An example from pharmacy education research is used to contextualize the concepts introduced. Copyright © 2017 Elsevier Inc. All rights reserved.

Development of a self-report physical function instrument for disability assessment: item pool construction and factor analysis.

PubMed

McDonough, Christine M; Jette, Alan M; Ni, Pengsheng; Bogusz, Kara; Marfeo, Elizabeth E; Brandt, Diane E; Chan, Leighton; Meterko, Mark; Haley, Stephen M; Rasch, Elizabeth K

2013-09-01

To build a comprehensive item pool representing work-relevant physical functioning and to test the factor structure of the item pool. These developmental steps represent initial outcomes of a broader project to develop instruments for the assessment of function within the context of Social Security Administration (SSA) disability programs. Comprehensive literature review; gap analysis; item generation with expert panel input; stakeholder interviews; cognitive interviews; cross-sectional survey administration; and exploratory and confirmatory factor analyses to assess item pool structure. In-person and semistructured interviews and Internet and telephone surveys. Sample of SSA claimants (n=1017) and a normative sample of adults from the U.S. general population (n=999). Not applicable. Model fit statistics. The final item pool consisted of 139 items. Within the claimant sample, 58.7% were white; 31.8% were black; 46.6% were women; and the mean age was 49.7 years. Initial factor analyses revealed a 4-factor solution, which included more items and allowed separate characterization of: (1) changing and maintaining body position, (2) whole body mobility, (3) upper body function, and (4) upper extremity fine motor. The final 4-factor model included 91 items. Confirmatory factor analyses for the 4-factor models for the claimant and the normative samples demonstrated very good fit. Fit statistics for claimant and normative samples, respectively, were: Comparative Fit Index=.93 and .98; Tucker-Lewis Index=.92 and .98; and root mean square error approximation=.05 and .04. The factor structure of the physical function item pool closely resembled the hypothesized content model. The 4 scales relevant to work activities offer promise for providing reliable information about claimant physical functioning relevant to work disability. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Development of a Self-Report Physical Function Instrument for Disability Assessment: Item Pool Construction and Factor Analysis

PubMed Central

McDonough, Christine M.; Jette, Alan M.; Ni, Pengsheng; Bogusz, Kara; Marfeo, Elizabeth E; Brandt, Diane E; Chan, Leighton; Meterko, Mark; Haley, Stephen M.; Rasch, Elizabeth K.

2014-01-01

Objectives To build a comprehensive item pool representing work-relevant physical functioning and to test the factor structure of the item pool. These developmental steps represent initial outcomes of a broader project to develop instruments for the assessment of function within the context of Social Security Administration (SSA) disability programs. Design Comprehensive literature review; gap analysis; item generation with expert panel input; stakeholder interviews; cognitive interviews; cross-sectional survey administration; and exploratory and confirmatory factor analyses to assess item pool structure. Setting In-person and semi-structured interviews; internet and telephone surveys. Participants A sample of 1,017 SSA claimants, and a normative sample of 999 adults from the US general population. Interventions Not Applicable. Main Outcome Measure Model fit statistics Results The final item pool consisted of 139 items. Within the claimant sample 58.7% were white; 31.8% were black; 46.6% were female; and the mean age was 49.7 years. Initial factor analyses revealed a 4-factor solution which included more items and allowed separate characterization of: 1) Changing and Maintaining Body Position, 2) Whole Body Mobility, 3) Upper Body Function and 4) Upper Extremity Fine Motor. The final 4-factor model included 91 items. Confirmatory factor analyses for the 4-factor models for the claimant and the normative samples demonstrated very good fit. Fit statistics for claimant and normative samples respectively were: Comparative Fit Index = 0.93 and 0.98; Tucker-Lewis Index = 0.92 and 0.98; Root Mean Square Error Approximation = 0.05 and 0.04. Conclusions The factor structure of the Physical Function item pool closely resembled the hypothesized content model. The four scales relevant to work activities offer promise for providing reliable information about claimant physical functioning relevant to work disability. PMID:23542402

A Basic Test Theory Generalizable to Tailored Testing. Technical Report No. 1.

ERIC Educational Resources Information Center

Cliff, Norman

Measures of consistency and completeness of order relations derived from test-type data are proposed. The measures are generalized to apply to incomplete data such as tailored testing. The measures are based on consideration of the items-plus-persons by items-plus-persons matrix as an adjacency matrix in which a 1 means that the row element…

Feasibility and Acceptability of a Colocated Homeless-Tailored Primary Care Clinic and Emergency Department.

PubMed

Gabrielian, Sonya; Chen, Jennifer C; Minhaj, Beena P; Manchanda, Rishi; Altman, Lisa; Koosis, Ella; Gelberg, Lillian

2017-10-01

Homeless adults have low primary care engagement and high emergency department (ED) utilization. Homeless-tailored, patient-centered medical homes (PCMH) decrease this population's acute care use. We studied the feasibility (focused on patient recruitment) and acceptability (conceptualized as clinicians' attitudes/beliefs) of a pilot initiative to colocate a homeless-tailored PCMH with an ED. After ED triage, low-acuity patients appropriate for outpatient care were screened for homelessness; homeless patients chose between a colocated PCMH or ED visit. To study feasibility, we captured (from May to September 2012) the number of patients screened for homelessness, positive screens, unique patients seen, and primary care visits. We focused on acceptability to ED clinicians (physicians, nurses, social workers); we sent a 32-item survey to ED clinicians (n = 57) who worked during clinic hours. Questions derived from an instrument measuring clinician attitudes toward homeless persons; acceptability of homelessness screening and the clinic itself were also explored. Over the 5 months of interest, 281 patients were screened; 172 (61.2%) screened positive for homelessness; 112 (65.1%) of these positive screens were seen over 215 visits. Acceptability data were obtained from 56% (n = 32) of surveyed clinicians. Attitudes toward homeless patients were similar to prior studies of primary care physicians. Most (54.6%) clinicians agreed with the homelessness screening procedures. Nearly all (90.3%) clinicians supported expansion of the homeless-tailored clinic; a minority (42.0%) agreed that ED colocation worked well. Our data suggest the feasibility of recruiting patients to a homeless-tailored primary care clinic colocated with the ED; however, the clinic's acceptability was mixed. Future quality improvement work should focus on tailoring the clinic to increase its acceptability among ED clinicians, while assessing its impact on health, housing, and costs.

Feasibility and Acceptability of a Colocated Homeless-Tailored Primary Care Clinic and Emergency Department

PubMed Central

Gabrielian, Sonya; Chen, Jennifer C.; Minhaj, Beena P.; Manchanda, Rishi; Altman, Lisa; Koosis, Ella; Gelberg, Lillian

2017-01-01

Objectives: Homeless adults have low primary care engagement and high emergency department (ED) utilization. Homeless-tailored, patient-centered medical homes (PCMH) decrease this population’s acute care use. We studied the feasibility (focused on patient recruitment) and acceptability (conceptualized as clinicians’ attitudes/beliefs) of a pilot initiative to colocate a homeless-tailored PCMH with an ED. After ED triage, low-acuity patients appropriate for outpatient care were screened for homelessness; homeless patients chose between a colocated PCMH or ED visit. Methods: To study feasibility, we captured (from May to September 2012) the number of patients screened for homelessness, positive screens, unique patients seen, and primary care visits. We focused on acceptability to ED clinicians (physicians, nurses, social workers); we sent a 32-item survey to ED clinicians (n = 57) who worked during clinic hours. Questions derived from an instrument measuring clinician attitudes toward homeless persons; acceptability of homelessness screening and the clinic itself were also explored. Results: Over the 5 months of interest, 281 patients were screened; 172 (61.2%) screened positive for homelessness; 112 (65.1%) of these positive screens were seen over 215 visits. Acceptability data were obtained from 56% (n = 32) of surveyed clinicians. Attitudes toward homeless patients were similar to prior studies of primary care physicians. Most (54.6%) clinicians agreed with the homelessness screening procedures. Nearly all (90.3%) clinicians supported expansion of the homeless-tailored clinic; a minority (42.0%) agreed that ED colocation worked well. Conclusion: Our data suggest the feasibility of recruiting patients to a homeless-tailored primary care clinic colocated with the ED; however, the clinic’s acceptability was mixed. Future quality improvement work should focus on tailoring the clinic to increase its acceptability among ED clinicians, while assessing its impact on

The 4-Item Negative Symptom Assessment (NSA-4) Instrument: A Simple Tool for Evaluating Negative Symptoms in Schizophrenia Following Brief Training.

PubMed

Alphs, Larry; Morlock, Robert; Coon, Cheryl; van Willigenburg, Arjen; Panagides, John

2010-07-01

Objective. To assess the ability of mental health professionals to use the 4-item Negative Symptom Assessment instrument, derived from the Negative Symptom Assessment-16, to rapidly determine the severity of negative symptoms of schizophrenia.Design. Open participation.Setting. Medical education conferences.Participants. Attendees at two international psychiatry conferences.Measurements. Participants read a brief set of the 4-item Negative Symptom Assessment instructions and viewed a videotape of a patient with schizophrenia. Using the 1 to 6 4-item Negative Symptom Assessment severity rating scale, they rated four negative symptom items and the overall global negative symptoms. These ratings were compared with a consensus rating determination using frequency distributions and Chi-square tests for the proportion of participant ratings that were within one point of the expert rating.Results. More than 400 medical professionals (293 physicians, 50% with a European practice, and 55% who reported past utilization of schizophrenia ratings scales) participated. Between 82.1 and 91.1 percent of the 4-items and the global rating determinations by the participants were within one rating point of the consensus expert ratings. The differences between the percentage of participant rating scores that were within one point versus the percentage that were greater than one point different from those by the consensus experts was significant (p<0.0001). Participants rating of negative symptoms using the 4-item Negative Symptom Assessment did not generally differ among the geographic regions of practice, the professional credentialing, or their familiarity with the use of schizophrenia symptom rating instruments.Conclusion. These findings suggest that clinicians from a variety of geographic practices can, after brief training, use the 4-item Negative Symptom Assessment effectively to rapidly assess negative symptoms in patients with schizophrenia.

Few items in the thyroid-related quality of life instrument ThyPRO exhibited differential item functioning.

PubMed

Watt, Torquil; Groenvold, Mogens; Hegedüs, Laszlo; Bonnema, Steen Joop; Rasmussen, Åse Krogh; Feldt-Rasmussen, Ulla; Bjorner, Jakob Bue

2014-02-01

To evaluate the extent of differential item functioning (DIF) within the thyroid-specific quality of life patient-reported outcome measure, ThyPRO, according to sex, age, education and thyroid diagnosis. A total of 838 patients with benign thyroid diseases completed the ThyPRO questionnaire (84 five-point items, 13 scales). Uniform and nonuniform DIF were investigated using ordinal logistic regression, testing for both statistical significance and magnitude (∆R(2) > 0.02). Scale level was estimated by the sum score, after purification. Twenty instances of DIF in 17 of the 84 items were found. Eight according to diagnosis, where the goiter scale was the one most affected, possibly due to differing perceptions in patients with auto-immune thyroid diseases compared to patients with simple goiter. Eight DIFs according to age were found, of which 5 were in positively worded items, which younger patients were more likely to endorse; one according to gender: women were more likely to report crying, and three according to educational level. The vast majority of DIF had only minor influence on the scale scores (0.1-2.3 points on the 0-100 scales), but two DIF corresponded to a difference of 4.6 and 9.8, respectively. Ordinal logistic regression identified DIF in 17 of 84 items. The potential impact of this on the present scales was low, but items displaying DIF could be avoided when developing abbreviated scales, where the potential impact of DIF (due to fewer items) will be larger.

Communication preferences of chronically ill adolescents: development of an assessment instrument.

PubMed

Klosinski, Matthias G; Farin, Erik

2015-09-01

The purpose of this study was to develop and psychometrically test a patient-oriented, theory-based questionnaire to capture the communication preferences of chronically ill adolescents in provider-patient interaction. In a qualitative prestudy, patients were asked to express their preferences in focus groups. From those results and relying on previous research findings, we generated questionnaire items and in a second pretest, examined them in 1-to-1 cognitive interviews for comprehensibility and acceptance. The resultant questionnaire was then psychometrically tested in the main study on 423 chronically ill inpatient adolescents aged 12 to 17 years in 14 rehabilitation clinics in Germany. Numerous preferences were extractable from the focus-group interviews and transferred into 106 Items. Psychometric testing of the questionnaire resulted in 3 scales encompassing 27 items. These we describe as the emotional-affective communication component (EAC), instrumental communication component (IC), and adolescent-specific communication component (ASC). Confirmatory factor analysis revealed the scales EAC und IC to be good to very good, and the ASC scale as satisfactory regarding unidimensionality. The participants gave the questionnaire high marks for comprehensibility, acceptance, and relevance. The 3 scales' Cronbach's alpha falls between .78 and .92. A questionnaire with 27 items is now available for application as a psychometrically tested and simple-to-use measuring instrument. Research is still needed concerning the generalizability to other patient groups (e.g., the acutely ill or outpatients) and whether it can be tailored for use by different types of care providers or to accommodate the communication preferences of parents. (c) 2015 APA, all rights reserved.

Development of an item bank for food parenting practices based on published instruments and reports from Canadian and US parents.

PubMed

O'Connor, Teresia M; Pham, Truc; Watts, Allison W; Tu, Andrew W; Hughes, Sheryl O; Beauchamp, Mark R; Baranowski, Tom; Mâsse, Louise C

2016-08-01

Research to understand how parents influence their children's dietary intake and eating behaviors has expanded in the past decades and a growing number of instruments are available to assess food parenting practices. Unfortunately, there is no consensus on how constructs should be defined or operationalized, making comparison of results across studies difficult. The aim of this study was to develop a food parenting practice item bank with items from published scales and supplement with parenting practices that parents report using. Items from published scales were identified from two published systematic reviews along with an additional systematic review conducted for this study. Parents (n = 135) with children 5-12 years old from the US and Canada, stratified to represent the demographic distribution of each country, were recruited to participate in an online semi-qualitative survey on food parenting. Published items and parent responses were coded using the same framework to reduce the number of items into representative concepts using a binning and winnowing process. The literature contributed 1392 items and parents contributed 1985 items, which were reduced to 262 different food parenting concepts (26% exclusive from literature, 12% exclusive from parents, and 62% represented in both). Food parenting practices related to 'Structure of Food Environment' and 'Behavioral and Educational' were emphasized more by parent responses, while practices related to 'Consistency of Feeding Environment' and 'Emotional Regulation' were more represented among published items. The resulting food parenting item bank should next be calibrated with item response modeling for scientists to use in the future. Copyright © 2016 Elsevier Ltd. All rights reserved.

The Influence of Item Calibration Error on Variable-Length Computerized Adaptive Testing

ERIC Educational Resources Information Center

Patton, Jeffrey M.; Cheng, Ying; Yuan, Ke-Hai; Diao, Qi

2013-01-01

Variable-length computerized adaptive testing (VL-CAT) allows both items and test length to be "tailored" to examinees, thereby achieving the measurement goal (e.g., scoring precision or classification) with as few items as possible. Several popular test termination rules depend on the standard error of the ability estimate, which in turn depends…

Modeling the Discrimination Power of Physics Items

ERIC Educational Resources Information Center

Mesic, Vanes

2011-01-01

For the purposes of tailoring physics instruction in accordance with the needs and abilities of the students it is useful to explore the knowledge structure of students of different ability levels. In order to precisely differentiate the successive, characteristic states of student achievement it is necessary to use test items that possess…

Wisconsin Title I Migrant Education. Section 143 Project: Development of an Item Bank. Summary Report.

ERIC Educational Resources Information Center

Brown, Frank N.; And Others

The successful Wisconsin Title 1 project item bank offers a valid, flexible, and efficient means of providing migrant student tests in reading and mathematics tailored to instructor curricula. The item bank system consists of nine PASCAL computer programs which maintain, search, and select from approximately 1,000 test items stored on floppy disks…

Intelligence Assessment Instruments in Adult Prison Populations: A Systematic Review.

PubMed

van Esch, A Y M; Denzel, A D; Scherder, E J A; Masthoff, E D M

2017-10-01

Detection of intellectual disability (ID) in the penitentiary system is important for the following reasons: (a) to provide assistance to people with ID in understanding their legal rights and court proceedings; (b) to facilitate rehabilitation programs tailored to ID patients, which improves the enhancement of their quality of life and reduces their risk of reoffending; and (c) to provide a reliable estimate of the risk of offence recidivism. It requires a short assessment instrument that provides a reliable estimation of a person's intellectual functioning at the earliest possible stage of this process. The aim of this systematic review is (a) to provide an overview of recent short assessment instruments that provide a full-scale IQ score in adult prison populations and (b) to achieve a quality measurement of the validation studies regarding these instruments to determine which tests are most feasible in this target population. The Preferred Reporting Items for Systematic reviews and Meta-Analyses Statement is used to ensure reliability. The Satz-Mögel, an item-reduction short form of the Wechsler Adult Intelligence Scale, shows the highest correlation with the golden standard and is described to be most reliable. Nevertheless, when it comes to applicability in prison populations, the shorter and less verbal Quick Test can be preferred over others. Without affecting these conclusions, major limitations emerge from the present systematic review, which give rise to several important recommendations for further research.

Validation of self-directed learning instrument and establishment of normative data for nursing students in taiwan: using polytomous item response theory.

PubMed

Cheng, Su-Fen; Lee-Hsieh, Jane; Turton, Michael A; Lin, Kuan-Chia

2014-06-01

Little research has investigated the establishment of norms for nursing students' self-directed learning (SDL) ability, recognized as an important capability for professional nurses. An item response theory (IRT) approach was used to establish norms for SDL abilities valid for the different nursing programs in Taiwan. The purposes of this study were (a) to use IRT with a graded response model to reexamine the SDL instrument, or the SDLI, originally developed by this research team using confirmatory factor analysis and (b) to establish SDL ability norms for the four different nursing education programs in Taiwan. Stratified random sampling with probability proportional to size was used. A minimum of 15% of students from the four different nursing education degree programs across Taiwan was selected. A total of 7,879 nursing students from 13 schools were recruited. The research instrument was the 20-item SDLI developed by Cheng, Kuo, Lin, and Lee-Hsieh (2010). IRT with the graded response model was used with a two-parameter logistic model (discrimination and difficulty) for the data analysis, calculated using MULTILOG. Norms were established using percentile rank. Analysis of item information and test information functions revealed that 18 items exhibited very high discrimination and two items had high discrimination. The test information function was higher in this range of scores, indicating greater precision in the estimate of nursing student SDL. Reliability fell between .80 and .94 for each domain and the SDLI as a whole. The total information function shows that the SDLI is appropriate for all nursing students, except for the top 2.5%. SDL ability norms were established for each nursing education program and for the nation as a whole. IRT is shown to be a potent and useful methodology for scale evaluation. The norms for SDL established in this research will provide practical standards for nursing educators and students in Taiwan.

48 CFR 2912.302 - Tailoring of provisions and clauses for the acquisition of commercial items.

Code of Federal Regulations, 2010 CFR

2010-10-01

... tailor terms inconsistent with customary commercial practice must be documented in a written justification by the contracting officer, and may be approved by the HCA on an individual or class basis. ...

Market Analysis for Nondevelopmental Items

DTIC Science & Technology

1992-02-01

A252 287 S-muININu nIn Defense Standardization Program MARKET ANALYSIS FOR NONDEVELOPMENTAL ITEMS February 1992 This do-umcont has bee-n CiPPn*x.,d... market analysis, that task would be much more difficult. This bro- chure proposes a generic approach to market analysis that can be tailored to a wide...Statement A per telecon Greg Saunders OASD(P&L)PR/MM Washington, DC 20301-8000 NWW 6/30/92 Market Analysis for NDI WHY DO MARKET ANALYSIS? The

Linking Existing Instruments to Develop an Activity of Daily Living Item Bank.

PubMed

Li, Chih-Ying; Romero, Sergio; Bonilha, Heather S; Simpson, Kit N; Simpson, Annie N; Hong, Ickpyo; Velozo, Craig A

2018-03-01

This study examined dimensionality and item-level psychometric properties of an item bank measuring activities of daily living (ADL) across inpatient rehabilitation facilities and community living centers. Common person equating method was used in the retrospective veterans data set. This study examined dimensionality, model fit, local independence, and monotonicity using factor analyses and fit statistics, principal component analysis (PCA), and differential item functioning (DIF) using Rasch analysis. Following the elimination of invalid data, 371 veterans who completed both the Functional Independence Measure (FIM) and minimum data set (MDS) within 6 days were retained. The FIM-MDS item bank demonstrated good internal consistency (Cronbach's α = .98) and met three rating scale diagnostic criteria and three of the four model fit statistics (comparative fit index/Tucker-Lewis index = 0.98, root mean square error of approximation = 0.14, and standardized root mean residual = 0.07). PCA of Rasch residuals showed the item bank explained 94.2% variance. The item bank covered the range of θ from -1.50 to 1.26 (item), -3.57 to 4.21 (person) with person strata of 6.3. The findings indicated the ADL physical function item bank constructed from FIM and MDS measured a single latent trait with overall acceptable item-level psychometric properties, suggesting that it is an appropriate source for developing efficient test forms such as short forms and computerized adaptive tests.

Conservatism implications of shock test tailoring for multiple design environments

NASA Technical Reports Server (NTRS)

Baca, Thomas J.; Bell, R. Glenn; Robbins, Susan A.

1987-01-01

A method for analyzing shock conservation in test specifications that have been tailored to qualify a structure for multiple design environments is discussed. Shock test conservation is qualified for shock response spectra, shock intensity spectra and ranked peak acceleration data in terms of an Index of Conservation (IOC) and an Overtest Factor (OTF). The multi-environment conservation analysis addresses the issue of both absolute and average conservation. The method is demonstrated in a case where four laboratory tests have been specified to qualify a component which must survive seven different field environments. Final judgment of the tailored test specification is shown to require an understanding of the predominant failure modes of the test item.

48 CFR 12.302 - Tailoring of provisions and clauses for the acquisition of commercial items.

Code of Federal Regulations, 2010 CFR

2010-10-01

... relative volume of the Government's acquisitions in the specific market, contracting officers may, within the limitations of this subpart, and after conducting appropriate market research, tailor the... established in this subpart are intended to address, to the maximum extent practicable, commercial market...

48 CFR 12.302 - Tailoring of provisions and clauses for the acquisition of commercial items.

Code of Federal Regulations, 2011 CFR

2011-10-01

... relative volume of the Government's acquisitions in the specific market, contracting officers may, within the limitations of this subpart, and after conducting appropriate market research, tailor the... established in this subpart are intended to address, to the maximum extent practicable, commercial market...

Space applications instrumentation systems

NASA Technical Reports Server (NTRS)

Minzner, R. A.; Oberholtzer, J. D.

1972-01-01

A compendium of resumes of 158 instrument systems or experiments, of particular interest to space applications, is presented. Each resume exists in a standardized format, permitting entries for 26 administrative items and 39 scientific or engineering items. The resumes are organized into forty groups determined by the forty spacecraft with which the instruments are associated. The resumes are followed by six different cross indexes, each organized alphabetically according to one of the following catagories: instrument name, acronym, name of principal investigator, name of organization employing the principal investigator, assigned experiment number, and spacecraft name. The resumes are associated with a computerized instrument resume search and retrieval system.

Brief Sensation Seeking Scale: Latent structure of 8-item and 4-item versions in Peruvian adolescents.

PubMed

Merino-Soto, Cesar; Salas Blas, Edwin

2018-01-01

This research intended to validate two brief scales of sensations seeking with Peruvian adolescents: the eight item scale (BSSS8; Hoyle, Stephenson, Palmgreen, Lorch, y Donohew, 2002) and the four item scale (BSSS4; Stephenson, Hoyle, Slater, y Palmgreen, 2003). Questionnaires were administered to 618 voluntary participants, with an average age of 13.6 years, from different levels of high school, state and private school in a district in the south of Lima. It analyzed the internal structure of both short versions using three models: a) unidimensional (M1), b) oblique or related dimensions (M2), and c) the bifactor model (M3). Results show that both instruments have a single dimension which best represents the variability of the items; a fact that can be explained both by the complexity of the concept and by the small number of items representing each factor, which is more noticeable in the BSSS4. Reliability is within levels found by previous studies: alpha: .745 = BSSS8 and BSSS4 =. 643; omega coefficient: .747 in BSSS8 and .651 in BSSS4. These are considered suitable for the type of instruments studied. Based on the correlation between the two instruments, it was found that there are satisfactory levels of equivalence between the BSSS8 and BSSS4. However, it is recommended that the BSSS4 is mainly used for research and for the purpose of describing populations.

Identifying content for the glaucoma-specific item bank to measure quality-of-life parameters.

PubMed

Khadka, Jyoti; McAlinden, Colm; Craig, Jamie E; Fenwick, Eva K; Lamoureux, Ecosse L; Pesudovs, Konrad

2015-01-01

Patient-reported outcomes (PROs) have become essential clinical trial end points. However, a comprehensive, multidimensional, patient-relevant, and precise glaucoma-specific PRO instrument is not available. Therefore, the purpose of this study was to identify content for a new, glaucoma-specific, quality-of-life (QOL) item bank. Content identification was undertaken in 5 phases: (1) identification of extant items in glaucoma-specific instruments and the qualitative literature; (2) focus groups and interviews with glaucoma patients; (3) item classification and selection; (4) expert review and revision of items; and (5) cognitive interviews with patients. A total of 737 unique items (extant items from PRO instruments, 247; qualitative articles, 14 items; focus groups and semistructured interviews, 476 items) were identified. These items were classified into 10 QOL domains. Four criteria (item redundancy, item inconsistent with domain definition, item content too narrow to have wider applicability, and item clarity) were used to remove and refine the items. After the cognitive interviews, the final minimally representative item set had a total of 342 unique items belonging to 10 domains: activity limitation (88), mobility (20), visual symptoms (19), ocular surface symptoms (22), general symptoms (15), convenience (39), health concerns (45), emotional well-being (49), social issues (23), and economic issues (22). The systematic content identification process identified 10 QOL domains, which were important to patients with glaucoma. The majority of the items were identified from the patient-specific focus groups and semistructured interviews suggesting that the existing PRO instruments do not adequately address QOL issues relevant to individuals with glaucoma.

Development of an instrument for the evaluation of advanced life support performance.

PubMed

Peltonen, L-M; Peltonen, V; Salanterä, S; Tommila, M

2017-10-01

Assessing advanced life support (ALS) competence requires validated instruments. Existing instruments include aspects of technical skills (TS), non-technical skills (NTS) or both, but one instrument for detailed assessment that suits all resuscitation situations is lacking. This study aimed to develop an instrument for the evaluation of the overall ALS performance of the whole team. This instrument development study had four phases. First, we reviewed literature and resuscitation guidelines to explore items to include in the instrument. Thereafter, we interviewed resuscitation team professionals (n = 66), using the critical incident technique, to determine possible additional aspects associated with the performance of ALS. Second, we developed an instrument based on the findings. Third, we used an expert panel (n = 20) to assess the validity of the developed instrument. Finally, we revised the instrument based on the experts' comments and tested it with six experts who evaluated 22 video recorded resuscitations. The final version of the developed instrument had 69 items divided into adherence to guidelines (28 items), clinical decision-making (5 items), workload management (12 items), team behaviour (8 items), information management (6 items), patient integrity and consideration of laymen (4 items) and work routines (6 items). The Cronbach's α values were good, and strong correlations between the overall performance and the instrument were observed. The instrument may be useful for detailed assessment of the team's overall performance, but the numerous items make the use demanding. The instrument is still under development, and more research is needed to determine its psychometric properties. © 2017 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

A tailored multicomponent program to reduce discomfort in critically ill patients: a cluster-randomized controlled trial.

PubMed

Kalfon, Pierre; Baumstarck, Karine; Estagnasie, Philippe; Geantot, Marie-Agnès; Berric, Audrey; Simon, Georges; Floccard, Bernard; Signouret, Thomas; Boucekine, Mohamed; Fromentin, Mélanie; Nyunga, Martine; Sossou, Achille; Venot, Marion; Robert, René; Follin, Arnaud; Audibert, Juliette; Renault, Anne; Garrouste-Orgeas, Maïté; Collange, Olivier; Levrat, Quentin; Villard, Isabelle; Thevenin, Didier; Pottecher, Julien; Patrigeon, René-Gilles; Revel, Nathalie; Vigne, Coralie; Azoulay, Elie; Mimoz, Olivier; Auquier, Pascal

2017-12-01

Critically ill patients are exposed to stressful conditions and experience several discomforts. The primary objective was to assess whether a tailored multicomponent program is effective for reducing self-perceived discomfort. In a cluster-randomized two-arm parallel trial, 34 French adult intensive care units (ICUs) without planned interventions to reduce discomfort were randomized, 17 to the arm including a 6-month period of program implementation followed by a 6-month period without the program (experimental group), and 17 to the arm with an inversed sequence (control group). The tailored multicomponent program consisted of assessment of ICU-related self-perceived discomforts, immediate and monthly feedback to healthcare teams, and site-specific tailored interventions. The primary outcome was the overall discomfort score derived from the 16-item IPREA questionnaire (0, minimal, 100, maximal overall discomfort) and the secondary outcomes were the discomfort scores of each IPREA item. IPREA was administered on the day of ICU discharge with a considered timeframe from the ICU admission until ICU discharge. During a 1-month assessment period, 398 and 360 patients were included in the experimental group and the control group, respectively. The difference (experimental minus control) of the overall discomfort score between groups was - 7.00 (95% CI - 9.89 to - 4.11, p < 0.001). After adjustment (age, gender, ICU duration, mechanical ventilation duration, and type of admission), the program effect was still positive for the overall discomfort score (difference - 6.35, SE 1.23, p < 0.001) and for 12 out of 16 items. This tailored multicomponent program decreased self-perceived discomfort in adult critically ill patients. Clinicaltrials.gov Identifier NCT02442934.

Using tailored methodical approaches to achieve optimal science outcomes

NASA Astrophysics Data System (ADS)

Wingate, Lory M.

2016-08-01

The science community is actively engaged in research, development, and construction of instrumentation projects that they anticipate will lead to new science discoveries. There appears to be very strong link between the quality of the activities used to complete these projects, and having a fully functioning science instrument that will facilitate these investigations.[2] The combination of using internationally recognized standards within the disciplines of project management (PM) and systems engineering (SE) has been demonstrated to lead to achievement of positive net effects and optimal project outcomes. Conversely, unstructured, poorly managed projects will lead to unpredictable, suboptimal project outcomes ultimately affecting the quality of the science that can be done with the new instruments. The proposed application of these two specific methodical approaches, implemented as a tailorable suite of processes, are presented in this paper. Project management (PM) is accepted worldwide as an effective methodology used to control project cost, schedule, and scope. Systems engineering (SE) is an accepted method that is used to ensure that the outcomes of a project match the intent of the stakeholders, or if they diverge, that the changes are understood, captured, and controlled. An appropriate application, or tailoring, of these disciplines can be the foundation upon which success in projects that support science can be optimized.

Development of the PROMIS nicotine dependence item banks.

PubMed

Shadel, William G; Edelen, Maria Orlando; Tucker, Joan S; Stucky, Brian D; Hansen, Mark; Cai, Li

2014-09-01

Nicotine dependence is a core construct important for understanding cigarette smoking and smoking cessation behavior. This article describes analyses conducted to develop and evaluate item banks for assessing nicotine dependence among daily and nondaily smokers. Using data from a sample of daily (N = 4,201) and nondaily (N =1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning analyses (according to gender, age, and race/ethnicity) to arrive at a unidimensional set of nicotine dependence items for daily and nondaily smokers. We also evaluated performance of short forms (SFs) and computer adaptive tests (CATs) to efficiently assess dependence. A total of 32 items were included in the Nicotine Dependence item banks; 22 items are common across daily and nondaily smokers, 5 are unique to daily smokers, and 5 are unique to nondaily smokers. For both daily and nondaily smokers, the Nicotine Dependence item banks are strongly unidimensional, highly reliable (reliability = 0.97 and 0.97, respectively), and perform similarly across gender, age, and race/ethnicity groups. SFs common to daily and nondaily smokers consist of 8 and 4 items (reliability = 0.91 and 0.81, respectively). Results from simulated CATs showed that dependence can be assessed with very good precision for most respondents using fewer than 6 items adaptively selected from the item banks. Nicotine dependence on cigarettes can be assessed on the basis of these item banks via one of the SFs, by using CATs, or through a tailored set of items selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Evaluating psychosocial and behavioral mechanisms of change in a tailored communication intervention.

PubMed

Elder, John P; Ayala, Guadalupe X; Slymen, Donald J; Arredondo, Elva M; Campbell, Nadia R

2009-04-01

This study examined the impact of a tailored nutrition intervention at 3 and 6 months postintervention. In all, 357 Latinas were randomly assigned to one of three conditions: (1) a control condition comprised of previously developed Spanish language targeted materials, (2) tailored print materials, or (3) tailored print materials accompanied by personalized dietary counseling via lay heath advisors (promotoras). At 6 months postintervention, significant group by time interactions were observed on the dietary behavioral strategies scales. The promotora condition resulted in significant behavior change initially; however, receipt of tailored and control materials was instrumental in continued behavior change after intervention activities had ceased. Group main effects suggested that the promotora condition was superior at reducing barriers and improving family interactions supporting healthy behaviors. The promotora model is an effective method for changing important dietary behaviors and psychosocial determinants, but longer term behavior change is achievable with less expensive intervention methods.

Development and evaluation of the Korean Health Literacy Instrument.

PubMed

Kang, Soo Jin; Lee, Tae Wha; Paasche-Orlow, Michael K; Kim, Gwang Suk; Won, Hee Kwan

2014-01-01

The purpose of this study is to develop and validate the Korean Health Literacy Instrument, which measures the capacity to understand and use health-related information and make informed health decisions in Korean adults. In Phase 1, 33 initial items were generated to measure functional, interactive, and critical health literacy with prose, document, and numeracy tasks. These items included content from health promotion, disease management, and health navigation contexts. Content validity assessment was conducted by an expert panel, and 11 items were excluded. In Phase 2, the 22 remaining items were administered to a convenience sample of 292 adults from community and clinical settings. Exploratory factor and item difficulty and discrimination analyses were conducted and four items with low discrimination were deleted. In Phase 3, the remaining 18 items were administered to a convenience sample of 315 adults 40-64 years of age from community and clinical settings. A confirmatory factor analysis was performed to test the construct validity of the instrument. The Korean Health Literacy Instrument has a range of 0 to 18. The mean score in our validation study was 11.98. The instrument exhibited an internal consistency reliability coefficient of 0.82, and a test-retest reliability of 0.89. The instrument is suitable for screening individuals who have limited health literacy skills. Future studies are needed to further define the psychometric properties and predictive validity of the Korean Health Literacy Instrument.

Factor Analysis and Item Reduction of the Banff Patella Instability Instrument (BPII): Introduction of BPII 2.0.

PubMed

Lafave, Mark R; Hiemstra, Laurie; Kerslake, Sarah

2016-08-01

Clinical management of patellofemoral (PF) instability is a challenge, particularly considering the number of variables that should be taken into consideration for treatment. Quality of life is an important measure to consider with this patient population. To factor analyze and reduce the total number of items in the Banff Patella Instability Instrument (BPII). Subsequent to the factor analysis, the new, item-reduced BPII 2.0 was tested for validity, reliability, and responsiveness. Cohort study (diagnosis); Level of evidence, 2. Quality of life was measured for PF instability patients (N = 223) through use of the original BPII at their initial consultation. Data from the BPII scores were used in a principal components analysis (PCA) to factor analyze and reduce the total number of items in the original BPII, to create a revised BPII 2.0. The BPII 2.0 underwent content validation (Cronbach alpha, patient interviews, and grade-level checking), construct validation (analysis of variance comparing the initial visit and the 6-, 12-, and 24-month postoperative visits, eta-square), convergent validation (Pearson r correlation to the original BPII), responsiveness testing (eta-square, anchor-based distribution testing), and reliability testing (intraclass correlation coefficient [ICC]). The BPII was successfully reduced from 32 to 23 items with excellent Cronbach alpha values in the new BPII 2.0: initial visit = 0.91; 6-month postoperative visit = 0.96; 12-month postoperative visit = 0.97; and 24-month postoperative visit = 0.76. Grade-level reading for all items was assessed as below grade 12. The BPII 2.0 was able to discriminate between all time periods with significant differences between groups (P < .05). Eta-square was 0.40, demonstrating a medium to large effect size. The BPII significantly correlated with the BPII 2.0 (0.82, 0.90, 0.90, and 0.94 at the initial visit and 6-, 12-, and 24-month postoperative visits, respectively), providing evidence of convergent

Enhancing self-report assessment of PTSD: development of an item bank.

PubMed

Del Vecchio, Nicole; Elwy, A Rani; Smith, Eric; Bottonari, Kathryn A; Eisen, Susan V

2011-04-01

The authors report results of work to enhance self-report posttraumatic stress disorder (PTSD) assessment by developing an item bank for use in a computer-adapted test. Computer-adapted tests have great potential to decrease the burden of PTSD assessment and outcomes monitoring. The authors conducted a systematic literature review of PTSD instruments, created a database of items, performed qualitative review and readability analysis, and conducted cognitive interviews with veterans diagnosed with PTSD. The systematic review yielded 480 studies in which 41 PTSD instruments comprising 993 items met inclusion criteria. The final PTSD item bank includes 104 items representing each of the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV; American Psychiatric Association [APA], 1994), PTSD symptom clusters (reexperiencing, avoidance, and hyperarousal), and 3 additional subdomains (depersonalization, guilt, and sexual problems) that expanded the assessment item pool. Copyright © 2011 International Society for Traumatic Stress Studies.

Overview of classical test theory and item response theory for the quantitative assessment of items in developing patient-reported outcomes measures.

PubMed

Cappelleri, Joseph C; Jason Lundy, J; Hays, Ron D

2014-05-01

The US Food and Drug Administration's guidance for industry document on patient-reported outcomes (PRO) defines content validity as "the extent to which the instrument measures the concept of interest" (FDA, 2009, p. 12). According to Strauss and Smith (2009), construct validity "is now generally viewed as a unifying form of validity for psychological measurements, subsuming both content and criterion validity" (p. 7). Hence, both qualitative and quantitative information are essential in evaluating the validity of measures. We review classical test theory and item response theory (IRT) approaches to evaluating PRO measures, including frequency of responses to each category of the items in a multi-item scale, the distribution of scale scores, floor and ceiling effects, the relationship between item response options and the total score, and the extent to which hypothesized "difficulty" (severity) order of items is represented by observed responses. If a researcher has few qualitative data and wants to get preliminary information about the content validity of the instrument, then descriptive assessments using classical test theory should be the first step. As the sample size grows during subsequent stages of instrument development, confidence in the numerical estimates from Rasch and other IRT models (as well as those of classical test theory) would also grow. Classical test theory and IRT can be useful in providing a quantitative assessment of items and scales during the content-validity phase of PRO-measure development. Depending on the particular type of measure and the specific circumstances, the classical test theory and/or the IRT should be considered to help maximize the content validity of PRO measures. Copyright © 2014 Elsevier HS Journals, Inc. All rights reserved.

Subjective health literacy: Development of a brief instrument for school-aged children.

PubMed

Paakkari, Olli; Torppa, Minna; Kannas, Lasse; Paakkari, Leena

2016-12-01

The present paper focuses on the measurement of health literacy (HL), which is an important determinant of health and health behaviours. HL starts to develop in childhood and adolescence; hence, there is a need for instruments to monitor HL among younger age groups. These instruments are still rare. The aim of the project reported here was, therefore, to develop a brief, multidimensional, theory-based instrument to measure subjective HL among school-aged children. The development of the instrument covered four phases: item generation based on a conceptual framework; a pilot study ( n = 405); test-retest ( n = 117); and construction of the instrument ( n = 3853). All the samples were taken from Finnish 7th and 9th graders. Initially, 65 items were generated, of which 32 items were selected for the pilot study. After item reduction, the instrument contained 16 items. The test-retest phase produced estimates of stability. In the final phase a 10-item instrument was constructed, referred to as Health Literacy for School-Aged Children (HLSAC). The instrument exhibited a high Cronbach alpha (0.93), and included two items from each of the five predetermined theoretical components (theoretical knowledge, practical knowledge, critical thinking, self-awareness, citizenship). The iterative and validity-driven development process made it possible to construct a brief multidimensional HLSAC instrument. Such instruments are suitable for large-scale studies, and for use with children and adolescents. Validation will require further testing for use in other countries.

Fairness in Computerized Testing: Detecting Item Bias Using CATSIB with Impact Present

ERIC Educational Resources Information Center

Chu, Man-Wai; Lai, Hollis

2013-01-01

In educational assessment, there is an increasing demand for tailoring assessments to individual examinees through computer adaptive tests (CAT). As such, it is particularly important to investigate the fairness of these adaptive testing processes, which require the investigation of differential item function (DIF) to yield information about item…

Using item response theory to address vulnerabilities in FFQ.

PubMed

Kazman, Josh B; Scott, Jonathan M; Deuster, Patricia A

2017-09-01

The limitations for self-reporting of dietary patterns are widely recognised as a major vulnerability of FFQ and the dietary screeners/scales derived from FFQ. Such instruments can yield inconsistent results to produce questionable interpretations. The present article discusses the value of psychometric approaches and standards in addressing these drawbacks for instruments used to estimate dietary habits and nutrient intake. We argue that a FFQ or screener that treats diet as a 'latent construct' can be optimised for both internal consistency and the value of the research results. Latent constructs, a foundation for item response theory (IRT)-based scales (e.g. Patient Reported Outcomes Measurement Information System) are typically introduced in the design stage of an instrument to elicit critical factors that cannot be observed or measured directly. We propose an iterative approach that uses such modelling to refine FFQ and similar instruments. To that end, we illustrate the benefits of psychometric modelling by using items and data from a sample of 12 370 Soldiers who completed the 2012 US Army Global Assessment Tool (GAT). We used factor analysis to build the scale incorporating five out of eleven survey items. An IRT-driven assessment of response category properties indicates likely problems in the ordering or wording of several response categories. Group comparisons, examined with differential item functioning (DIF), provided evidence of scale validity across each Army sub-population (sex, service component and officer status). Such an approach holds promise for future FFQ.

Present status of aircraft instruments

NASA Technical Reports Server (NTRS)

1932-01-01

This report gives a brief description of the present state of development and of the performance characteristics of instruments included in the following group: speed instruments, altitude instruments, navigation instruments, power-plant instruments, oxygen instruments, instruments for aerial photography, fog-flying instruments, general problems, summary of instrument and research problems. The items considered under performance include sensitivity, scale errors, effects of temperature and pressure, effects of acceleration and vibration, time lag, damping, leaks, elastic defects, and friction.

Addressing medication nonadherence by mobile phone: development and delivery of tailored messages.

PubMed

Gatwood, Justin; Balkrishnan, Rajesh; Erickson, Steven R; An, Lawrence C; Piette, John D; Farris, Karen B

2014-01-01

Medication nonadherence remains a significant public health problem, and efforts to improve adherence have shown only limited impact. The tailoring of messages has become a popular method of developing communication to influence specific health-related behaviors but the development and impact of tailored text messages on medication use is poorly understood. The aim of this paper is to describe an approach to developing theory-based tailored messages for delivery via mobile phone to improve medication adherence among patients with diabetes. Kreuter's five-step tailoring process was followed to create tailored messages for mobile phone delivery. Two focus group sessions, using input from 11 people, and expert review of message content were used to adapt the survey instrument on which the messages were tailored and edit the developed messages for the target population. Following established tailoring methods a library of 168 theory-driven and 128 medication-specific tailored messages were developed and formatted for automated delivery to mobile phones. Concepts from the Health Belief Model and Self-Determination Theory were used to craft the messages and an algorithm was applied to determine the order and timing of messages with the aim of progressively influencing disease and treatment-related beliefs driving adherence to diabetes medication. The process described may be applied to future investigations aiming to improve medication adherence in patients with diabetes and the effectiveness of the current messages will be tested in a planned analysis. Copyright © 2014 Elsevier Inc. All rights reserved.

Development of a 12-item short version of the HIV stigma scale.

PubMed

Reinius, Maria; Wettergren, Lena; Wiklander, Maria; Svedhem, Veronica; Ekström, Anna Mia; Eriksson, Lars E

2017-05-30

Valid and reliable instruments for the measurement of enacted, anticipated and internalised stigma in people living with HIV are crucial for mapping trends in the prevalence of HIV-related stigma and tracking the effectiveness of stigma-reducing interventions. Although longer instruments exist, e.g., the commonly used 40-item HIV Stigma Scale by Berger et al., a shorter instrument would be preferable to facilitate the inclusion of HIV stigma in more and broader surveys. Therefore, the aim of this work was to develop a substantially shorter, but still valid, version of the HIV Stigma Scale. Data from a psychometric evaluation of the Swedish 40-item HIV Stigma Scale were reanalysed to create a short version with 12 items (three from each of the four stigma subscales: personalised stigma, disclosure concerns, concerns with public attitudes and negative self-image). The short version of the HIV stigma scale was then psychometrically tested using data from a national survey investigating stigma and quality of life among people living with HIV in Sweden (n = 880, mean age 47.9 years, 26% female). The hypothesized factor structure of the proposed short version was replicated in exploratory factor analysis without cross loadings and confirmatory factor analysis supported construct validity with high standardised effects (>0.7) of items on the intended scales. The χ 2 test was statistically significant (χ 2  = 154.2, df = 48, p < 0.001), but alternate fit measures indicated acceptable fit (comparative fit index: 0.963, Tucker-Lewis index: 0.950 and root mean square error of approximation: 0.071). Corrected item-total correlation coefficients were >0.4 for all items, with a variation indicating that the broadness of the concept of stigma had been captured. All but two aspects of HIV-related stigma that the instrument is intended to cover were captured by the selected items in the short version. The aspects that did not lose any items were judged to have acceptable

Factoring handedness data: I. Item analysis.

PubMed

Messinger, H B; Messinger, M I

1995-12-01

Recently in this journal Peters and Murphy challenged the validity of factor analyses done on bimodal handedness data, suggesting instead that right- and left-handers be studied separately. But bimodality may be avoidable if attention is paid to Oldfield's questionnaire format and instructions for the subjects. Two characteristics appear crucial: a two-column LEFT-RIGHT format for the body of the instrument and what we call Oldfield's Admonition: not to indicate strong preference for handedness item, such as write, unless "... the preference is so strong that you would never try to use the other hand unless absolutely forced to...". Attaining unimodality of an item distribution would seem to overcome the objections of Peters and Murphy. In a 1984 survey in Boston we used Oldfield's ten-item questionnaire exactly as published. This produced unimodal item distributions. With reflection of the five-point item scale and a logarithmic transformation, we achieved a degree of normalization for the items. Two surveys elsewhere based on Oldfield's 20-item list but with changes in the questionnaire format and the instructions, yielded markedly different item distributions with peaks at each extreme and sometimes in the middle as well.

An Attitude Scale on Individual Instrument and Individual Instrument Course: Validity-Reliability Research

ERIC Educational Resources Information Center

Kuçukosmanoglu, Hayrettin Onur

2015-01-01

The main purpose of this study is to develop a scale to determine students' attitude levels on individual instruments and individual instrument courses in instrument training, which is an important dimension of music education, and to conduct a validity-reliability research of the scale that has been developed. The scale consists of 16 items. The…

Tailor-made finance versus tailor-made care. Can the state strengthen consumer choice in healthcare by reforming the financial structure of long-term care?

PubMed

Grit, K; de Bont, A

2010-02-01

Policy instruments based on the working of markets have been introduced to empower consumers of healthcare. However, it is still not easy to become a critical consumer of healthcare. The aim of this study is to analyse the possibilities of the state to strengthen the position of patients with the aid of a new financial regime, such as personal health budgets. Data were collected through in-depth interviews with executives, managers, professionals and client representatives of six long-term care institutions. With the introduction of individual budgets the responsibility for budgetary control has shifted from the organisational level to the individual level in the caregiver-client relationship. Having more luxurious care on offer necessitates a stronger demarcation of regular care because organisations cannot simultaneously offer extra care as part of the standard care package. New financial instruments have an impact on the culture of receiving and giving care. Distributive justice takes on new meaning with the introduction of financial market mechanisms in healthcare; the distributing principle of 'need' is transformed into the principle of 'economic demand'. Financial instruments not only act as a countervailing power against providers insufficiently client-oriented, but are also used by providers to reinforce their own positions vis-à-vis demanding clients. Tailor-made finance is not the same as tailor-made care.

ITEM SELECTION TECHNIQUES AND EVALUATION OF INSTRUCTIONAL OBJECTIVES.

ERIC Educational Resources Information Center

COX, RICHARD C.

THE VALIDITY OF AN EDUCATIONAL ACHIEVEMENT TEST DEPENDS UPON THE CORRESPONDENCE BETWEEN SPECIFIED EDUCATIONAL OBJECTIVES AND THE EXTENT TO WHICH THESE OBJECTIVES ARE MEASURED BY THE EVALUATION INSTRUMENT. THIS STUDY IS DESIGNED TO EVALUATE THE EFFECT OF STATISTICAL ITEM SELECTION ON THE STRUCTURE OF THE FINAL EVALUATION INSTRUMENT AS COMPARED WITH…

From theory to 'measurement' in complex interventions: methodological lessons from the development of an e-health normalisation instrument.

PubMed

Finch, Tracy L; Mair, Frances S; O'Donnell, Catherine; Murray, Elizabeth; May, Carl R

2012-05-17

Although empirical and theoretical understanding of processes of implementation in health care is advancing, translation of theory into structured measures that capture the complex interplay between interventions, individuals and context remain limited. This paper aimed to (1) describe the process and outcome of a project to develop a theory-based instrument for measuring implementation processes relating to e-health interventions; and (2) identify key issues and methodological challenges for advancing work in this field. A 30-item instrument (Technology Adoption Readiness Scale (TARS)) for measuring normalisation processes in the context of e-health service interventions was developed on the basis on Normalization Process Theory (NPT). NPT focuses on how new practices become routinely embedded within social contexts. The instrument was pre-tested in two health care settings in which e-health (electronic facilitation of healthcare decision-making and practice) was used by health care professionals. The developed instrument was pre-tested in two professional samples (N=46; N=231). Ratings of items representing normalisation 'processes' were significantly related to staff members' perceptions of whether or not e-health had become 'routine'. Key methodological challenges are discussed in relation to: translating multi-component theoretical constructs into simple questions; developing and choosing appropriate outcome measures; conducting multiple-stakeholder assessments; instrument and question framing; and more general issues for instrument development in practice contexts. To develop theory-derived measures of implementation process for progressing research in this field, four key recommendations are made relating to (1) greater attention to underlying theoretical assumptions and extent of translation work required; (2) the need for appropriate but flexible approaches to outcomes measurement; (3) representation of multiple perspectives and collaborative nature of

Item generation and design testing of a questionnaire to assess degenerative joint disease-associated pain in cats.

PubMed

Zamprogno, Helia; Hansen, Bernie D; Bondell, Howard D; Sumrell, Andrea Thomson; Simpson, Wendy; Robertson, Ian D; Brown, James; Pease, Anthony P; Roe, Simon C; Hardie, Elizabeth M; Wheeler, Simon J; Lascelles, B Duncan X

2010-12-01

To determine the items (question topics) for a subjective instrument to assess degenerative joint disease (DJD)-associated chronic pain in cats and determine the instrument design most appropriate for use by cat owners. 100 randomly selected client-owned cats from 6 months to 20 years old. Cats were evaluated to determine degree of radiographic DJD and signs of pain throughout the skeletal system. Two groups were identified: high DJD pain and low DJD pain. Owner-answered questions about activity and signs of pain were compared between the 2 groups to define items relating to chronic DJD pain. Interviews with 45 cat owners were performed to generate items. Fifty-three cat owners who had not been involved in any other part of the study, 19 veterinarians, and 2 statisticians assessed 6 preliminary instrument designs. 22 cats were selected for each group; 19 important items were identified, resulting in 12 potential items for the instrument; and 3 additional items were identified from owner interviews. Owners and veterinarians selected a 5-point descriptive instrument design over 11-point or visual analogue scale formats. Behaviors relating to activity were substantially different between healthy cats and cats with signs of DJD-associated pain. Fifteen items were identified as being potentially useful, and the preferred instrument design was identified. This information could be used to construct an owner-based questionnaire to assess feline DJD-associated pain. Once validated, such a questionnaire would assist in evaluating potential analgesic treatments for these patients.

Developing self-concept instrument for pre-service mathematics teachers

NASA Astrophysics Data System (ADS)

Afgani, M. W.; Suryadi, D.; Dahlan, J. A.

2018-01-01

This study aimed to develop self-concept instrument for undergraduate students of mathematics education in Palembang, Indonesia. Type of this study was development research of non-test instrument in questionnaire form. A Validity test of the instrument was performed with construct validity test by using Pearson product moment and factor analysis, while reliability test used Cronbach’s alpha. The instrument was tested by 65 undergraduate students of mathematics education in one of the universities at Palembang, Indonesia. The instrument consisted of 43 items with 7 aspects of self-concept, that were the individual concern, social identity, individual personality, view of the future, the influence of others who become role models, the influence of the environment inside or outside the classroom, and view of the mathematics. The result of validity test showed there was one invalid item because the value of Pearson’s r was 0.107 less than the critical value (0.244; α = 0.05). The item was included in social identity aspect. After the invalid item was removed, Construct validity test with factor analysis generated only one factor. The Kaiser-Meyer-Olkin (KMO) coefficient was 0.846 and reliability coefficient was 0.91. From that result, we concluded that the self-concept instrument for undergraduate students of mathematics education in Palembang, Indonesia was valid and reliable with 42 items.

Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication

PubMed Central

Zamanzadeh, Vahid; Ghahramanian, Akram; Rassouli, Maryam; Abbaszadeh, Abbas; Alavi-Majd, Hamid; Nikanfar, Ali-Reza

2015-01-01

Introduction: The importance of content validity in the instrument psychometric and its relevance with reliability, have made it an essential step in the instrument development. This article attempts to give an overview of the content validity process and to explain the complexity of this process by introducing an example. Methods: We carried out a methodological study conducted to examine the content validity of the patient-centered communication instrument through a two-step process (development and judgment). At the first step, domain determination, sampling (item generation) and instrument formation and at the second step, content validity ratio, content validity index and modified kappa statistic was performed. Suggestions of expert panel and item impact scores are used to examine the instrument face validity. Results: From a set of 188 items, content validity process identified seven dimensions includes trust building (eight items), informational support (seven items), emotional support (five items), problem solving (seven items), patient activation (10 items), intimacy/friendship (six items) and spirituality strengthening (14 items). Content validity study revealed that this instrument enjoys an appropriate level of content validity. The overall content validity index of the instrument using universal agreement approach was low; however, it can be advocated with respect to the high number of content experts that makes consensus difficult and high value of the S-CVI with the average approach, which was equal to 0.93. Conclusion: This article illustrates acceptable quantities indices for content validity a new instrument and outlines them during design and psychometrics of patient-centered communication measuring instrument. PMID:26161370

CTTITEM: SAS macro and SPSS syntax for classical item analysis.

PubMed

Lei, Pui-Wa; Wu, Qiong

2007-08-01

This article describes the functions of a SAS macro and an SPSS syntax that produce common statistics for conventional item analysis including Cronbach's alpha, item difficulty index (p-value or item mean), and item discrimination indices (D-index, point biserial and biserial correlations for dichotomous items and item-total correlation for polytomous items). These programs represent an improvement over the existing SAS and SPSS item analysis routines in terms of completeness and user-friendliness. To promote routine evaluations of item qualities in instrument development of any scale, the programs are available at no charge for interested users. The program codes along with a brief user's manual that contains instructions and examples are downloadable from suen.ed.psu.edu/-pwlei/plei.htm.

Standard NIM Instrumentation System

DOE Office of Scientific and Technical Information (OSTI.GOV)

Costrell, Louis; Lenkszus, Frank R.; Rudnick, Stanley J.

NIM is a standard modular instrumentation system that is in wide use throughout the world. As the NIM system developed and accommodations were made to a dynamic instrumentation field and a rapidly advancing technology, additions, revisions and clarifications were made. These were incorporated into the standard in the form of addenda and errata. This standard is a revision of the NIM document, AEC Report TID-20893 (Rev 4) dated July 1974. It includes all the addenda and errata items that were previously issued as well as numerous additional items to make the standard current with modern technology and manufacturing practice.

Item-Level Psychometrics of the Glasgow Outcome Scale: Extended Structured Interviews.

PubMed

Hong, Ickpyo; Li, Chih-Ying; Velozo, Craig A

2016-04-01

The Glasgow Outcome Scale-Extended (GOSE) structured interview captures critical components of activities and participation, including home, shopping, work, leisure, and family/friend relationships. Eighty-nine community dwelling adults with mild-moderate traumatic brain injury (TBI) were recruited (average = 2.7 year post injury). Nine items of the 19 items were used for the psychometrics analysis purpose. Factor analysis and item-level psychometrics were investigated using the Rasch partial-credit model. Although the principal components analysis of residuals suggests that a single measurement factor dominates the measure, the instrument did not meet the factor analysis criteria. Five items met the rating scale criteria. Eight items fit the Rasch model. The instrument demonstrated low person reliability (0.63), low person strata (2.07), and a slight ceiling effect. The GOSE demonstrated limitations in precisely measuring activities/participation for individuals after TBI. Future studies should examine the impact of the low precision of the GOSE on effect size. © The Author(s) 2016.

Developing an Initial Physical Function Item Bank from Existing Sources.

ERIC Educational Resources Information Center

Bode, Rita K.; Cella, David; Lai, Jin-shei; Heinemann, Allen W.

2003-01-01

Illustrates incremental item banking using health-related quality of life data collected from two samples of patients receiving cancer treatment (n=1,755 and n=1,544). Results support findings from previous studies that have equated separate instruments by co-calibrating their items. (SLD)

Development of six PROMIS pediatrics proxy-report item banks

PubMed Central

2012-01-01

Background Pediatric self-report should be considered the standard for measuring patient reported outcomes (PRO) among children. However, circumstances exist when the child is too young, cognitively impaired, or too ill to complete a PRO instrument and a proxy-report is needed. This paper describes the development process including the proxy cognitive interviews and large-field-test survey methods and sample characteristics employed to produce item parameters for the Patient Reported Outcomes Measurement Information System (PROMIS) pediatric proxy-report item banks. Methods The PROMIS pediatric self-report items were converted into proxy-report items before undergoing cognitive interviews. These items covered six domains (physical function, emotional distress, social peer relationships, fatigue, pain interference, and asthma impact). Caregivers (n = 25) of children ages of 5 and 17 years provided qualitative feedback on proxy-report items to assess any major issues with these items. From May 2008 to March 2009, the large-scale survey enrolled children ages 8-17 years to complete the self-report version and caregivers to complete the proxy-report version of the survey (n = 1548 dyads). Caregivers of children ages 5 to 7 years completed the proxy report survey (n = 432). In addition, caregivers completed other proxy instruments, PedsQL™ 4.0 Generic Core Scales Parent Proxy-Report version, PedsQL™ Asthma Module Parent Proxy-Report version, and KIDSCREEN Parent-Proxy-52. Results Item content was well understood by proxies and did not require item revisions but some proxies clearly noted that determining an answer on behalf of their child was difficult for some items. Dyads and caregivers of children ages 5-17 years old were enrolled in the large-scale testing. The majority were female (85%), married (70%), Caucasian (64%) and had at least a high school education (94%). Approximately 50% had children with a chronic health condition, primarily asthma, which was

Development of the PROMIS coping expectancies of smoking item banks.

PubMed

Shadel, William G; Edelen, Maria Orlando; Tucker, Joan S; Stucky, Brian D; Hansen, Mark; Cai, Li

2014-09-01

Smoking is a coping strategy for many smokers who then have difficulty finding new ways to cope with negative affect when they quit. This paper describes analyses conducted to develop and evaluate item banks for assessing the coping expectancies of smoking for daily and nondaily smokers. Using data from a large sample of daily (N = 4,201) and nondaily (N = 1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning (DIF) analyses (according to gender, age, and ethnicity) to arrive at a unidimensional set of items for daily and nondaily smokers. We also evaluated performance of short forms (SFs) and computer adaptive tests (CATs) for assessing coping expectancies of smoking. For both daily and nondaily smokers, the unidimensional Coping Expectancies item banks (21 items) are relatively DIF free and are highly reliable (0.96 and 0.97, respectively). A common 4-item SF for daily and nondaily smokers also showed good reliability (0.85). Adaptive tests required an average of 4.3 and 3.7 items for simulated daily and nondaily respondents, respectively, and achieved reliabilities of 0.91 for both when the maximum test length was 10 items. This research provides a new set of items that can be used to reliably assess coping expectancies of smoking, through a SF, CAT, or a tailored set selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Factor- and Item-Level Analyses of the 38-Item Activities Scale for Kids-Performance

ERIC Educational Resources Information Center

Bagley, Anita M.; Gorton, George E.; Bjornson, Kristie; Bevans, Katherine; Stout, Jean L.; Narayanan, Unni; Tucker, Carole A.

2011-01-01

Aim: Children and adolescents highly value their ability to participate in relevant daily life and recreational activities. The Activities Scale for Kids-performance (ASKp) instrument measures the frequency of performance of 30 common childhood activities, and has been shown to be valid and reliable. A revised and expanded 38-item ASKp (ASKp38)…

Assessing items on the SF-8 Japanese version for health-related quality of life: a psychometric analysis based on the nominal categories model of item response theory.

PubMed

Tokuda, Yasuharu; Okubo, Tomoya; Ohde, Sachiko; Jacobs, Joshua; Takahashi, Osamu; Omata, Fumio; Yanai, Haruo; Hinohara, Shigeaki; Fukui, Tsuguya

2009-06-01

The Short Form-8 (SF-8) questionnaire is a commonly used 8-item instrument of health-related quality of life (QOL) and provides a health profile of eight subdimensions. Our aim was to examine the psychometric properties of the Japanese version of the SF-8 instrument using methodology based on nominal categories model. Using data from an adjusted random sample from a nationally representative panel, the nominal categories modeling was applied to SF-8 items to characterize coverage of the latent trait (theta). Probabilities for response choices were described as functions on the latent trait. Information functions were generated based on the estimated item parameters. A total of 3344 participants (53%, women; median age, 35 years) provided responses. One factor was retained (eigenvalue, 4.65; variance proportion of 0.58) and used as theta. All item response category characteristic curves satisfied the monotonicity assumption in accurate order with corresponding ordinal responses. Four items (general health, bodily pain, vitality, and mental health) cover most of the spectrum of theta, while the other four items (physical function, role physical [role limitations because of physical health], social functioning, and role emotional [role limitations because of emotional problems] ) cover most of the negative range of theta. Information function for all items combined peaked at -0.7 of theta (information = 18.5) and decreased with increasing theta. The SF-8 instrument performs well among those with poor QOL across the continuum of the latent trait and thus can recognize more effectively persons with relatively poorer QOL than those with relatively better QOL.

Assessment of Differential Item Functioning in the Experiences of Discrimination Index

PubMed Central

Cunningham, Timothy J.; Berkman, Lisa F.; Gortmaker, Steven L.; Kiefe, Catarina I.; Jacobs, David R.; Seeman, Teresa E.; Kawachi, Ichiro

2011-01-01

The psychometric properties of instruments used to measure self-reported experiences of discrimination in epidemiologic studies are rarely assessed, especially regarding construct validity. The authors used 2000–2001 data from the Coronary Artery Risk Development in Young Adults (CARDIA) Study to examine differential item functioning (DIF) in 2 versions of the Experiences of Discrimination (EOD) Index, an index measuring self-reported experiences of racial/ethnic and gender discrimination. DIF may confound interpretation of subgroup differences. Large DIF was observed for 2 of 7 racial/ethnic discrimination items: White participants reported more racial/ethnic discrimination for the “at school” item, and black participants reported more racial/ethnic discrimination for the “getting housing” item. The large DIF by race/ethnicity in the index for racial/ethnic discrimination probably reflects item impact and is the result of valid group differences between blacks and whites regarding their respective experiences of discrimination. The authors also observed large DIF by race/ethnicity for 3 of 7 gender discrimination items. This is more likely to have been due to item bias. Users of the EOD Index must consider the advantages and disadvantages of DIF adjustment (omitting items, constructing separate measures, and retaining items). The EOD Index has substantial usefulness as an instrument that can assess self-reported experiences of discrimination. PMID:22038104

Development, validity and reliability of the short multidimensional positive mental health instrument.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Abdin, Edimansyah; Picco, Louisa; Chua, Boon Yiang; Eng, Goi Khia; Sambasivam, Rajeswari; Shafie, Saleha; Zhang, Yunjue; Chong, Siow Ann

2014-06-01

The 47-item positive mental health (PMH) instrument measures the level of PMH in multiethnic adult Asian populations. This study aimed to (1) develop a short PMH instrument and (2) establish its validity and reliability among the adult Singapore population. Two separate studies were conducted among adult community-dwelling Singapore residents of Chinese, Malay or Indian ethnicity where participants completed self-administered questionnaires. In the first study, secondary data analysis was conducted using confirmatory factor analysis (CFA) to shorten the PMH instrument. In the second study, the newly developed short PMH instrument and other scales were administered to 201 residents to establish its factor structure, validity and reliability. A 20-item short PMH instrument fulfilling a higher-order six-factor structure was developed following secondary analysis. The mean age of the participants in the second study was 41 years and about 53% were women. One item with poor factor loading was further removed to generate a 19-item version of the PMH instrument. CFA demonstrated a first-order six-factor model of the short PMH instrument. The PMH-19 instrument and its subscales fulfilled criterion validity hypotheses. Internal consistency and test-retest reliability of the PMH-19 instrument were high (Cronbach's α coefficient = 0.87; intraclass correlation coefficient = 0.93, respectively). The 19-item PMH instrument is multidimensional, valid and reliable, and most importantly, with its reduced administration time, the short PMH instrument can be used to measure and evaluate PMH in Asian communities.

The five item Barthel index

PubMed Central

Hobart, J; Thompson, A

2001-01-01

OBJECTIVES—Routine data collection is now considered mandatory. Therefore, staff rated clinical scales that consist of multiple items should have the minimum number of items necessary for rigorous measurement. This study explores the possibility of developing a short form Barthel index, suitable for use in clinical trials, epidemiological studies, and audit, that satisfies criteria for rigorous measurement and is psychometrically equivalent to the 10 item instrument.
METHODS—Data were analysed from 844 consecutive admissions to a neurological rehabilitation unit in London. Random half samples were generated. Short forms were developed in one sample (n=419), by selecting items with the best measurement properties, and tested in the other (n=418). For each of the 10 items of the BI, item total correlations and effect sizes were computed and rank ordered. The best items were defined as those with the lowest cross product of these rank orderings. The acceptability, reliability, validity, and responsiveness of three short form BIs (five, four, and three item) were determined and compared with the 10 item BI. Agreement between scores generated by short forms and 10 item BI was determined using intraclass correlation coefficients and the method of Bland and Altman.
RESULTS—The five best items in this sample were transfers, bathing, toilet use, stairs, and mobility. Of the three short forms examined, the five item BI had the best measurement properties and was psychometrically equivalent to the 10 item BI. Agreement between scores generated by the two measures for individual patients was excellent (ICC=0.90) but not identical (limits of agreement=1.84±3.84).
CONCLUSIONS—The five item short form BI may be a suitable outcome measure for group comparison studies in comparable samples. Further evaluations are needed. Results demonstrate a fundamental difference between assessment and measurement and the importance of incorporating psychometric methods in the

Development of the PROMIS health expectancies of smoking item banks.

PubMed

Edelen, Maria Orlando; Tucker, Joan S; Shadel, William G; Stucky, Brian D; Cerully, Jennifer; Li, Zhen; Hansen, Mark; Cai, Li

2014-09-01

Smokers' health-related outcome expectancies are associated with a number of important constructs in smoking research, yet there are no measures currently available that focus exclusively on this domain. This paper describes the development and evaluation of item banks for assessing the health expectancies of smoking. Using data from a sample of daily (N = 4,201) and nondaily (N = 1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning analyses (according to gender, age, and race/ethnicity) to arrive at a unidimensional set of health expectancies items for daily and nondaily smokers. We also evaluated the performance of short forms (SFs) and computer adaptive tests (CATs) to efficiently assess health expectancies. A total of 24 items were included in the Health Expectancies item banks; 13 items are common across daily and nondaily smokers, 6 are unique to daily, and 5 are unique to nondaily. For both daily and nondaily smokers, the Health Expectancies item banks are unidimensional, reliable (reliability = 0.95 and 0.96, respectively), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.87). Results from simulated CATs showed that health expectancies can be assessed with good precision with an average of 5-6 items adaptively selected from the item banks. Health expectancies of smoking can be assessed on the basis of these item banks via SFs, CATs, or through a tailored set of items selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Screening for problem gambling within mental health services: a comparison of the classification accuracy of brief instruments.

PubMed

Dowling, Nicki A; Merkouris, Stephanie S; Manning, Victorian; Volberg, Rachel; Lee, Stuart J; Rodda, Simone N; Lubman, Dan I

2018-06-01

Despite the over-representation of people with gambling problems in mental health populations, there is limited information available to guide the selection of brief screening instruments within mental health services. The primary aim was to compare the classification accuracy of nine brief problem gambling screening instruments (two to five items) with a reference standard among patients accessing mental health services. The classification accuracy of nine brief screening instruments was compared with multiple cut-off scores on a reference standard. Eight mental health services in Victoria, Australia. A total of 837 patients were recruited consecutively between June 2015 and January 2016. The brief screening instruments were the Lie/Bet Questionnaire, Brief Problem Gambling Screen (BPGS) (two- to five-item versions), NODS-CLiP, NODS-CLiP2, Brief Biosocial Gambling Screen (BBGS) and NODS-PERC. The Problem Gambling Severity Index (PGSI) was the reference standard. The five-item BPGS was the only instrument displaying satisfactory classification accuracy in detecting any level of gambling problem (low-risk, moderate-risk or problem gambling) (sensitivity = 0.803, specificity = 0.982, diagnostic efficiency = 0.943). Several shorter instruments adequately detected both problem and moderate-risk, but not low-risk, gambling: two three-item instruments (NODS-CLiP, three-item BPGS) and two four-item instruments (NODS-PERC, four-item BPGS) (sensitivity = 0.854-0.966, specificity = 0.901-0.954, diagnostic efficiency = 0.908-0.941). The four-item instruments, however, did not provide any considerable advantage over the three-item instruments. Similarly, the very brief (two-item) instruments (Lie/Bet and two-item BPGS) adequately detected problem gambling (sensitivity = 0.811-0.868, specificity = 0.938-0.943, diagnostic efficiency = 0.933-0.934), but not moderate-risk or low-risk gambling. The optimal brief screening instrument for mental health services

An Evaluation of One- and Three-Parameter Logistic Tailored Testing Procedures for Use with Small Item Pools.

ERIC Educational Resources Information Center

McKinley, Robert L.; Reckase, Mark D.

A two-stage study was conducted to compare the ability estimates yielded by tailored testing procedures based on the one-parameter logistic (1PL) and three-parameter logistic (3PL) models. The first stage of the study employed real data, while the second stage employed simulated data. In the first stage, response data for 3,000 examinees were…

Development and validation of a ten-item questionnaire with explanatory illustrations to assess upper extremity disorders: favorable effect of illustrations in the item reduction process.

PubMed

Kurimoto, Shigeru; Suzuki, Mikako; Yamamoto, Michiro; Okui, Nobuyuki; Imaeda, Toshihiko; Hirata, Hitoshi

2011-11-01

The purpose of this study is to develop a short and valid measure for upper extremity disorders and to assess the effect of attached illustrations in item reduction of a self-administered disability questionnaire while retaining psychometric properties. A validated questionnaire used to assess upper extremity disorders, the Hand20, was reduced to ten items using two item-reduction techniques. The psychometric properties of the abbreviated form, the Hand10, were evaluated on an independent sample that was used for the shortening process. Validity, reliability, and responsiveness of the Hand10 were retained in the item reduction process. It was possible that the use of explanatory illustrations attached to the Hand10 helped with its reproducibility. The illustrations for the Hand10 promoted text comprehension and motivation to answer the items. These changes resulted in high acceptability; more than 99.3% of patients, including 98.5% of elderly patients, could complete the Hand10 properly. The illustrations had favorable effects on the item reduction process and made it possible to retain precision of the instrument. The Hand10 is a reliable and valid instrument for individual-level applications with the advantage of being compact and broadly applicable, even in elderly individuals.

Development of the PROMIS negative psychosocial expectancies of smoking item banks.

PubMed

Stucky, Brian D; Edelen, Maria Orlando; Tucker, Joan S; Shadel, William G; Cerully, Jennifer; Kuhfeld, Megan; Hansen, Mark; Cai, Li

2014-09-01

Negative psychosocial expectancies of smoking include aspects of social disapproval and disappointment in oneself. This paper describes analyses conducted to develop and evaluate item banks for assessing psychosocial expectancies among daily and nondaily smokers. Using data from a sample of daily (N = 4,201) and nondaily (N =1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning analyses (according to gender, age, and race/ethnicity) to arrive at a unidimensional set of psychosocial expectancies items for daily and nondaily smokers. We also evaluated performance of short forms (SFs) and computer adaptive tests (CATs) to efficiently assess psychosocial expectancies. A total of 21 items were included in the Psychosocial Expectancies item banks: 14 items are common across daily and nondaily smokers, 6 are unique to daily, and 1 is unique to nondaily. For both daily and nondaily smokers, the Psychosocial Expectancies item banks are strongly unidimensional, highly reliable (reliability = 0.95 and 0.93, respectively), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.85). Results from simulated CATs showed that, on average, fewer than 8 items are needed to assess psychosocial expectancies with adequate precision when using the item banks. Psychosocial expectancies of smoking can be assessed on the basis of these item banks via the SF, by using CAT, or through a tailored set of items selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

FIM-Minimum Data Set Motor Item Bank: Short Forms Development and Precision Comparison in Veterans.

PubMed

Li, Chih-Ying; Romero, Sergio; Simpson, Annie N; Bonilha, Heather S; Simpson, Kit N; Hong, Ickpyo; Velozo, Craig A

2018-03-01

To improve the practical use of the short forms (SFs) developed from the item bank, we compared the measurement precision of the 4- and 8-item SFs generated from a motor item bank composed of the FIM and the Minimum Data Set (MDS). The FIM-MDS motor item bank allowed scores generated from different instruments to be co-calibrated. The 4- and 8-item SFs were developed based on Rasch analysis procedures. This article compared person strata, ceiling/floor effects, and test SE plots for each administration form and examined 95% confidence interval error bands of anchored person measures with the corresponding SFs. We used 0.3 SE as a criterion to reflect a reliability level of .90. Veterans' inpatient rehabilitation facilities and community living centers. Veterans (N=2500) who had both FIM and the MDS data within 6 days during 2008 through 2010. Not applicable. Four- and 8-item SFs of FIM, MDS, and FIM-MDS motor item bank. Six SFs were generated with 4 and 8 items across a range of difficulty levels from the FIM-MDS motor item bank. The three 8-item SFs all had higher correlations with the item bank (r=.82-.95), higher person strata, and less test error than the corresponding 4-item SFs (r=.80-.90). The three 4-item SFs did not meet the criteria of SE <0.3 for any theta values. Eight-item SFs could improve clinical use of the item bank composed of existing instruments across the continuum of care in veterans. We also found that the number of items, not test specificity, determines the precision of the instrument. Copyright © 2017 American Congress of Rehabilitation Medicine. All rights reserved.

Improving Measurement Efficiency of the Inner EAR Scale with Item Response Theory.

PubMed

Jessen, Annika; Ho, Andrew D; Corrales, C Eduardo; Yueh, Bevan; Shin, Jennifer J

2018-02-01

Objectives (1) To assess the 11-item Inner Effectiveness of Auditory Rehabilitation (Inner EAR) instrument with item response theory (IRT). (2) To determine whether the underlying latent ability could also be accurately represented by a subset of the items for use in high-volume clinical scenarios. (3) To determine whether the Inner EAR instrument correlates with pure tone thresholds and word recognition scores. Design IRT evaluation of prospective cohort data. Setting Tertiary care academic ambulatory otolaryngology clinic. Subjects and Methods Modern psychometric methods, including factor analysis and IRT, were used to assess unidimensionality and item properties. Regression methods were used to assess prediction of word recognition and pure tone audiometry scores. Results The Inner EAR scale is unidimensional, and items varied in their location and information. Information parameter estimates ranged from 1.63 to 4.52, with higher values indicating more useful items. The IRT model provided a basis for identifying 2 sets of items with relatively lower information parameters. Item information functions demonstrated which items added insubstantial value over and above other items and were removed in stages, creating a 8- and 3-item Inner EAR scale for more efficient assessment. The 8-item version accurately reflected the underlying construct. All versions correlated moderately with word recognition scores and pure tone averages. Conclusion The 11-, 8-, and 3-item versions of the Inner EAR scale have strong psychometric properties, and there is correlational validity evidence for the observed scores. Modern psychometric methods can help streamline care delivery by maximizing relevant information per item administered.

Qualitative Development of the PROMIS® Pediatric Stress Response Item Banks

PubMed Central

Gardner, William; Pajer, Kathleen; Riley, Anne W.; Forrest, Christopher B.

2013-01-01

Objective To describe the qualitative development of the Patient-Reported Outcome Measurement Information System (PROMIS®) Pediatric Stress Response item banks. Methods Stress response concepts were specified through a literature review and interviews with content experts, children, and parents. A library comprising 2,677 items derived from 71 instruments was developed. Items were classified into conceptual categories; new items were written and redundant items were removed. Items were then revised based on cognitive interviews (n = 39 children), readability analyses, and translatability reviews. Results 2 pediatric Stress Response sub-domains were identified: somatic experiences (43 items) and psychological experiences (64 items). Final item pools cover the full range of children’s stress experiences. Items are comprehensible among children aged ≥8 years and ready for translation. Conclusions Child- and parent-report versions of the item banks assess children’s somatic and psychological states when demands tax their adaptive capabilities. PMID:23124904

Core Items for a Standardized Resource Use Measure: Expert Delphi Consensus Survey.

PubMed

Thorn, Joanna C; Brookes, Sara T; Ridyard, Colin; Riley, Ruth; Hughes, Dyfrig A; Wordsworth, Sarah; Noble, Sian M; Thornton, Gail; Hollingworth, William

2018-06-01

Resource use measurement by patient recall is characterized by inconsistent methods and a lack of validation. A validated standardized resource use measure could increase data quality, improve comparability between studies, and reduce research burden. To identify a minimum set of core resource use items that should be included in a standardized adult instrument for UK health economic evaluation from a provider perspective. Health economists with experience of UK-based economic evaluations were recruited to participate in an electronic Delphi survey. Respondents were asked to rate 60 resource use items (e.g., medication names) on a scale of 1 to 9 according to the importance of the item in a generic context. Items considered less important according to predefined consensus criteria were dropped and a second survey was developed. In the second round, respondents received the median score and their own score from round 1 for each item alongside summarized comments and were asked to rerate items. A final project team meeting was held to determine the recommended core set. Forty-five participants completed round 1. Twenty-six items were considered less important and were dropped, 34 items were retained for the second round, and no new items were added. Forty-two respondents (93.3%) completed round 2, and greater consensus was observed. After the final meeting, 10 core items were selected, with further items identified as suitable for "bolt-on" questionnaire modules. The consensus on 10 items considered important in a generic context suggests that a standardized instrument for core resource use items is feasible. Copyright © 2018. Published by Elsevier Inc.

Validation of an instrument to evaluate health promotion at schools

PubMed Central

Pinto, Raquel Oliveira; Pattussi, Marcos Pascoal; Fontoura, Larissa do Prado; Poletto, Simone; Grapiglia, Valenca Lemes; Balbinot, Alexandre Didó; Teixeira, Vanessa Andina; Horta, Rogério Lessa

2016-01-01

ABSTRACT OBJECTIVE To validate an instrument designed to assess health promotion in the school environment. METHODS A questionnaire, based on guidelines from the World Health Organization and in line with the Brazilian school health context, was developed to validate the research instrument. There were 60 items in the instrument that included 40 questions for the school manager and 20 items with direct observations made by the interviewer. The items’ content validation was performed using the Delphi technique, with the instrument being applied in 53 schools from two medium-sized cities in the South region of Brazil. Reliability (Cronbach’s alpha and split-half) and validity (principal component analysis) analyses were performed. RESULTS The final instrument remained composed of 28 items, distributed into three dimensions: pedagogical, structural and relational. The resulting components showed good factorial loads (> 0.4) and acceptable reliability (> 0.6) for most items. The pedagogical dimension identifies educational activities regarding drugs and sexuality, violence and prejudice, auto care and peace and quality of life. The structural dimension is comprised of access, sanitary structure, and conservation and equipment. The relational dimension includes relationships within the school and with the community. CONCLUSIONS The proposed instrument presents satisfactory validity and reliability values, which include aspects relevant to promote health in schools. Its use allows the description of the health promotion conditions to which students from each educational institution are exposed. Because this instrument includes items directly observed by the investigator, it should only be used during periods when there are full and regular activities at the school in question. PMID:26982958

Development and assessment of floor and ceiling items for the PROMIS physical function item bank

PubMed Central

2013-01-01

Introduction Disability and Physical Function (PF) outcome assessment has had limited ability to measure functional status at the floor (very poor functional abilities) or the ceiling (very high functional abilities). We sought to identify, develop and evaluate new floor and ceiling items to enable broader and more precise assessment of PF outcomes for the NIH Patient-Reported-Outcomes Measurement Information System (PROMIS). Methods We conducted two cross-sectional studies using NIH PROMIS item improvement protocols with expert review, participant survey and focus group methods. In Study 1, respondents with low PF abilities evaluated new floor items, and those with high PF abilities evaluated new ceiling items for clarity, importance and relevance. In Study 2, we compared difficulty ratings of new floor items by low functioning respondents and ceiling items by high functioning respondents to reference PROMIS PF-10 items. We used frequencies, percentages, means and standard deviations to analyze the data. Results In Study 1, low (n = 84) and high (n = 90) functioning respondents were mostly White, women, 70 years old, with some college, and disability scores of 0.62 and 0.30. More than 90% of the 31 new floor and 31 new ceiling items were rated as clear, important and relevant, leaving 26 ceiling and 30 floor items for Study 2. Low (n = 246) and high (n = 637) functioning Study 2 respondents were mostly White, women, 70 years old, with some college, and Health Assessment Questionnaire (HAQ) scores of 1.62 and 0.003. Compared to difficulty ratings of reference items, ceiling items were rated to be 10% more to greater than 40% more difficult to do, and floor items were rated to be about 12% to nearly 90% less difficult to do. Conclusions These new floor and ceiling items considerably extend the measurable range of physical function at either extreme. They will help improve instrument performance in populations with broad functional ranges and those concentrated at

Effectiveness of culturally tailored diabetes interventions for Asian immigrants to the United States: a systematic review.

PubMed

Joo, Jee Young

2014-01-01

The purpose of this systematic review is to evaluate the effectiveness of tailoring community-based diabetes intervention to Asian immigrant cultures. The Cochrane processes and Preferred Reporting Items for Systematic Reviews and Meta-Analyses recommendations guided this systematic review. PubMed, the Cumulative Index to Nursing and Allied Health Literature, Ovid, and PsycINFO were searched for analyses and syntheses of primary research published since 2000 that described interventions tailored for the cultures of Asian immigrants with diabetes. This search yielded a total of 9 articles published from 2005 to 2013. The Amsterdam-Maastricht Consensus List for Quality Assessment was used to assess the quality of the studies. Retrieved studies' populations were foreign-born adults >50 years of age with type 2 diabetes. The review revealed that culturally tailored diabetes programs are effective at improving patients' objectively measured clinical outcomes, in particular A1C levels, and psychobehavioral outcomes. Patients were also highly satisfied with bilingual health care providers and bilingual educational programs. There is strong evidence of the effectiveness of tailoring diabetes interventions to Asian immigrant populations' cultures. Further studies, including longitudinal studies and studies with rigorous research designs that subclassify Asian immigrants, are needed to encourage the implementation of culturally tailored diabetes intervention for this ethnic minority. © 2014 The Author(s).

Introduction to Multilevel Item Response Theory Analysis: Descriptive and Explanatory Models

ERIC Educational Resources Information Center

Sulis, Isabella; Toland, Michael D.

2017-01-01

Item response theory (IRT) models are the main psychometric approach for the development, evaluation, and refinement of multi-item instruments and scaling of latent traits, whereas multilevel models are the primary statistical method when considering the dependence between person responses when primary units (e.g., students) are nested within…

Validation of the HIV/AIDS Stigma Instrument - PLWA (HASI-P).

PubMed

Holzemer, William L; Uys, Leana R; Chirwa, Maureen L; Greeff, Minrie; Makoae, Lucia N; Kohi, Thecla W; Dlamini, Priscilla S; Stewart, Anita L; Mullan, Joseph; Phetlhu, René D; Wantland, Dean; Durrheim, Kevin

2007-09-01

This article describes the development and testing of a quantitative measure of HIV/AIDS stigma as experienced by people living with HIV/AIDS. This instrument is designed to measure perceived stigma, create a baseline from which to measure changes in stigma over time, and track potential progress towards reducing stigma. It was developed in three phases from 2003-2006: generating items based on results of focus group discussions; pilot testing and reducing the original list of items; and validating the instrument. Data for all phases were collected from five African countries: Lesotho, Malawi, South Africa, Swaziland and Tanzania. The instrument was validated with a sample of 1,477 persons living with HIV/AIDS from all of the five countries. The sample had a mean age of 36.1 years and 74.1% was female. The participants reported they knew they were HIV positive for an average of 3.4 years and 46% of the sample was taking antiretroviral medications. A six factor solution with 33 items explained 60.72% of the variance. Scale alpha reliabilities were examined and items that did not contribute to scale reliability were dropped. The factors included: Verbal Abuse (8 items, alpha=0.886); Negative Self-Perception (5 items, alpha=0.906); Health Care Neglect (7 items, alpha=0.832); Social Isolation (5 items, alpha=0.890); Fear of Contagion (6 items, alpha=0.795); and Workplace Stigma (2 items, alpha=0.758). This article reports on the development and validation of a new measure of stigma, HIV/AIDS Stigma Instrument - PLWA (HASI-P) providing evidence that supports adequate content and construct validity, modest concurrent validity, and acceptable internal consistency reliability for each of the six subscales and total score. The scale is available is several African languages.

Developing a short version of the Toronto Structured Interview for Alexithymia using item response theory.

PubMed

Sekely, Angela; Taylor, Graeme J; Bagby, R Michael

2018-03-17

The Toronto Structured Interview for Alexithymia (TSIA) was developed to provide a structured interview method for assessing alexithymia. One drawback of this instrument is the amount of time it takes to administer and score. The current study used item response theory (IRT) methods to analyze data from a large heterogeneous multi-language sample (N = 842) to investigate whether a subset of items could be selected to create a short version of the instrument. Samejima's (1969) graded response model was used to fit the item responses. Items providing maximum information were retained in the short model, resulting in the elimination of 12-items from the original 24-items. Despite the 50% reduction in the number of items, 65.22% of the information was retained. Further studies are needed to validate the short version. A short version of the TSIA is potentially of practical value to clinicians and researchers with time constraints. Copyright © 2018. Published by Elsevier B.V.

Disability Measurement for Korean Community-Dwelling Adults With Stroke: Item-Level Psychometric Analysis of the Korean Longitudinal Study of Ageing

PubMed Central

2018-01-01

Objective To investigate the psychometric properties of the activities of daily living (ADL) instrument used in the analysis of Korean Longitudinal Study of Ageing (KLoSA) dataset. Methods A retrospective study was carried out involving 2006 KLoSA records of community-dwelling adults diagnosed with stroke. The ADL instrument used for the analysis of KLoSA included 17 items, which were analyzed using Rasch modeling to develop a robust outcome measure. The unidimensionality of the ADL instrument was examined based on confirmatory factor analysis with a one-factor model. Item-level psychometric analysis of the ADL instrument included fit statistics, internal consistency, precision, and the item difficulty hierarchy. Results The study sample included a total of 201 community-dwelling adults (1.5% of the Korean population with an age over 45 years; mean age=70.0 years, SD=9.7) having a history of stroke. The ADL instrument demonstrated unidimensional construct. Two misfit items, money management (mean square [MnSq]=1.56, standardized Z-statistics [ZSTD]=2.3) and phone use (MnSq=1.78, ZSTD=2.3) were removed from the analysis. The remaining 15 items demonstrated good item fit, high internal consistency (person reliability=0.91), and good precision (person strata=3.48). The instrument precisely estimated person measures within a wide range of theta (−4.75 logits < θ < 3.97 logits) and a reliability of 0.9, with a conceptual hierarchy of item difficulty. Conclusion The findings indicate that the 15 ADL items met Rasch expectations of unidimensionality and demonstrated good psychometric properties. It is proposed that the validated ADL instrument can be used as a primary outcome measure for assessing longitudinal disability trajectories in the Korean adult population and can be employed for comparative analysis of international disability across national aging studies. PMID:29765888

Evaluation of motivationally tailored vs. standard self-help physical activity interventions at the workplace.

PubMed

Marcus, B H; Emmons, K M; Simkin-Silverman, L R; Linnan, L A; Taylor, E R; Bock, B C; Roberts, M B; Rossi, J S; Abrams, D B

1998-01-01

This study compares the efficacy of a self-help intervention tailored to the individual's stage of motivational readiness for exercise adoption with a standard self-help exercise promotion intervention. Interventions were delivered at baseline and 1 month; assessments were collected at baseline and 3 months. Eleven worksites participating in the Working Healthy Research Trial. Participants (n = 1559) were a subsample of employees at participating worksites, individually randomized to one of two treatment conditions. Printed self-help exercise promotion materials either (1) matched to the individual's stage of motivational readiness for exercise adoption (motivationally tailored), or (2) standard materials (standard). Measures of stage of motivational readiness for exercise and items from the 7-Day Physical Activity Recall. Among intervention completers (n = 903), chi-square analyses showed that, compared to the standard intervention, those receiving the motivationally tailored intervention were significantly more likely to show increases (37% vs. 27%) and less likely to show either no change (52% vs. 58%) or regression (11% vs. 15%) in stage of motivational readiness. Multivariate analyses of variance showed that changes in stage of motivational readiness were significantly associated with changes in self-reported time spent in exercise. This is the first prospective, randomized, controlled trial demonstrating the efficacy of a brief motivationally tailored intervention compared to a standard self-help intervention for exercise adoption. These findings appear to support treatment approaches that tailor interventions to the individual's stage of motivational readiness for exercise adoption.

Evaluating the Effectiveness of a Non-Cognitive Assessment Instrument

ERIC Educational Resources Information Center

Di Tommaso, Kathrynn

2016-01-01

This paper presents a pilot study aiming to evaluate the effects of a non-cognitive assessment instrument which was developed and tailored for a community college in the New York City area. The instrument was pilot tested on a group of developmental students and asked a series of questions to determine the campus support services that might best…

The Comparative Effectiveness of Different Item Analysis Techniques in Increasing Change Score Reliability.

ERIC Educational Resources Information Center

Crocker, Linda M.; Mehrens, William A.

Four new methods of item analysis were used to select subsets of items which would yield measures of attitude change. The sample consisted of 263 students at Michigan State University who were tested on the Inventory of Beliefs as freshmen and retested on the same instrument as juniors. Item change scores and total change scores were computed for…

Item Selection, Evaluation, and Simple Structure in Personality Data

PubMed Central

Pettersson, Erik; Turkheimer, Eric

2010-01-01

We report an investigation of the genesis and interpretation of simple structure in personality data using two very different self-reported data sets. The first consists of a set of relatively unselected lexical descriptors, whereas the second is based on responses to a carefully constructed instrument. In both data sets, we explore the degree of simple structure by comparing factor solutions to solutions from simulated data constructed to have either strong or weak simple structure. The analysis demonstrates that there is little evidence of simple structure in the unselected items, and a moderate degree among the selected items. In both instruments, however, much of the simple structure that could be observed originated in a strong dimension of positive vs. negative evaluation. PMID:20694168

Using qualitative methods to develop a contextually tailored instrument: Lessons learned.

PubMed

Lee, Haeok; Kiang, Peter; Kim, Minjin; Semino-Asaro, Semira; Colten, Mary Ellen; Tang, Shirley S; Chea, Phala; Peou, Sonith; Grigg-Saito, Dorcas C

2015-01-01

To develop a population-specific instrument to inform hepatitis B virus (HBV) and human papilloma virus (HPV) prevention education and intervention based on data and evidence obtained from the targeted population of Khmer mothers reflecting their socio-cultural and health behaviors. The principles of community-based participatory research (CBPR) guided the development of a standardized survey interview. Four stages of development and testing of the survey instrument took place in order to inform the quantitative health survey used to collect data in stage five of the project. This article reports only on Stages 1-4. This process created a new quantitative measure of HBV and HPV prevention behavior based on the revised Network Episode Model and informed by the targeted population. The CBPR method facilitated the application and translation of abstract theoretical ideas of HBV and HPV prevention behavior into culturally-relevant words and expressions of Cambodian Americans (CAs). The design of an instrument development process that accounts for distinctive socio-cultural backgrounds of CA refugee/immigrant women provides a model for use in developing future health surveys that are intended to aid minority-serving health care professionals and researchers as well as targeted minority populations.

Modification and Evaluation of a Velopharyngeal Insufficiency Quality of Life Instrument

PubMed Central

Skirko, Jonathan R.; Weaver, Edward M; Perkins, Jonathan; Kinter, Sara; Sie, Kathleen C.Y.

2018-01-01

Objective Modify the existing 45-item velopharyngeal insufficiency (VPI) quality of life (QOL) instrument (VPIQL), assess the modified instrument for reliability and provide further validation. There are patient and parent versions of the instrument. Design Validation convenience sample from a previously conducted pilot study. Setting Two academic tertiary referral medical centers. Participants De-identified data were used from 29 subjects with VPI and 29 control subjects age 5–17 years, and parents. Outcome measures Subjects and parents completed VPIQL and a generic pediatric QOL instrument (PedsQL4-0). Data Analysis Twenty-two items were removed from the VPIQL for ceiling effects, floor effects, and redundancy, to produce the modified instrument, VPI Effects on Life Outcomes (VELO) instrument. VELO was tested for internal consistency (Chronbach’s alpha), discriminant validity (paired t-test with control subjects), and concurrent validity (Pearson correlation with the PedsQL4-0). These analyses were also completed for parents. Results The 45-item VPIQL instrument was reduced to the 23-item VELO instrument. The VELO had excellent internal consistency (Chronbach’s alpha 0.96 for parents and 0.95 for VPI subjects). The VELO discriminated well between VPI and control subjects, with mean score (SD) was significantly lower (worse) for VPI subjects (67.6 [23.9]) than for control subjects (97.0 [5.2]) (p<0.0001). The VELO total score was significantly correlated with the PedsQL4.0 (r=0.73) among subjects with VPI. Similar results were seen in parent responses. Conclusions The VELO is a 23-item QOL instrument that was designed to measure and follow QOL in subjects with VPI, with less burden than the original VPIQL. VELO demonstrates internal consistency, disciminant validty, and concurrent validity with the PedsQL4-0. PMID:23069823

Computer-generated tailored feedback letters for smoking cessation: theoretical and empirical variability of tailoring.

PubMed

Schumann, Anja; John, Ulrich; Ulbricht, Sabina; Rüge, Jeannette; Bischof, Gallus; Meyer, Christian

2008-11-01

This study examines tailored feedback letters of a smoking cessation intervention that is conceptually based on the transtheoretical model, from a content-based perspective. Data of 2 population-based intervention studies, both randomized controlled trials, with total N=1044 were used. The procedure of the intervention, the tailoring principle for the feedback letters, and the content of the intervention materials are described in detail. Theoretical and empirical frequencies of unique feedback letters are presented. The intervention system was able to generate a total of 1040 unique letters with normative feedback only, and almost half a million unique letters with normative and ipsative feedback. Almost every single smoker in contemplation, preparation, action, and maintenance had an empirically unique combination of tailoring variables and received a unique letter. In contrast, many smokers in precontemplation shared a combination of tailoring variables and received identical letters. The transtheoretical model provides an enormous theoretical and empirical variability of tailoring. However, tailoring for a major subgroup of smokers, i.e. those who do not intend to quit, needs improvement. Conceptual ideas for additional tailoring variables are discussed.

Development of the Online Assessment of Athletic Training Education (OAATE) Instrument

ERIC Educational Resources Information Center

Carr, W. David; Frey, Bruce B.; Swann, Elizabeth

2009-01-01

Objective: To establish the validity and reliability of an online assessment instrument's items developed to track educational outcomes over time. Design and Setting: A descriptive study of the validation arguments and reliability testing of the assessment items. The instrument is available to graduating students enrolled in entry-level Athletic…

Implementing AORN recommended practices for prevention of retained surgical items.

PubMed

Goldberg, Judith L; Feldman, David L

2012-02-01

Retention of a surgical item is a preventable event that can result in patient injury. AORN's "Recommended practices for prevention of retained surgical items" emphasizes the importance of using a multidisciplinary approach for prevention. Procedures should include counts of soft goods, needles, miscellaneous items, and instruments, and efforts should be made to prevent retention of fragments of broken devices. If a count discrepancy occurs, the perioperative team should follow procedures to locate the missing item. Perioperative leaders may consider the use of adjunct technologies such as bar-code scanning, radio-frequency detection, and radio-frequency identification. Ambulatory and hospital patient scenarios are included to exemplify appropriate strategies for preventing retained surgical items. Copyright © 2012 AORN, Inc. Published by Elsevier Inc. All rights reserved.

The development of an instrument to assess chemistry perceptions

NASA Astrophysics Data System (ADS)

Wells, Raymond R.

The instrument, developed in this study, attempted to correct the deficiencies of previous instruments. Statements of belief and opinion can be validly included under the construct of chemistry perceptions. Further, statements that might be better characterized as science attitudes, math attitudes, or attitudes toward a specific course or program were not included. Eliminating statements of math anxiety and test anxiety insured that responses to statements of anxiety were perceptions of anxiety solely related to chemistry. The results of the expert judges' responses to the Validation of Proposed Perception Statements forms were detailed to establish construct and content validity. The nature of Likert scale construction and calculation of internal consistency also supported the validity of the instrument. A pilot Chemistry Perception Questionnaire (CPQ) was then constructed based on agreement of the appropriate subscale and mean importance of the perception statements. The pilot CPQ results were subjected to an item analysis based on three sets of statistics: the frequency of each response and the percentage of respondents making each response for each perception statement, the mean and standard deviations for each item, and the item discrimination index which correlated the item scores with the subscale scores. With no zero or negative correlations to the subscale scores, it was not necessary to replace any of the perception statements contained in the pilot instrument. Therefore, the piloted Chemistry Perception Questionnaire became the final instrument. Factor analysis confirmed the multidimensionality of the instrument. The instrument was administered twice with a separation interval of approximately one month in order to perform a test-retest reliability analysis. One hundred and forty-one pairs were matched and results detailed. The correlation between forms, for the total instrument, was 0.9342. The mean coefficient alpha, for the total instrument, was 0

14 CFR 121.303 - Airplane instruments and equipment.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 14 Aeronautics and Space 3 2010-01-01 2010-01-01 false Airplane instruments and equipment. 121.303... Airplane instruments and equipment. (a) Unless otherwise specified, the instrument and equipment... airspeed limitation and item of related information in the Airplane Flight Manual and pertinent placards...

14 CFR 121.303 - Airplane instruments and equipment.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 14 Aeronautics and Space 3 2012-01-01 2012-01-01 false Airplane instruments and equipment. 121.303... Airplane instruments and equipment. (a) Unless otherwise specified, the instrument and equipment... airspeed limitation and item of related information in the Airplane Flight Manual and pertinent placards...

14 CFR 121.303 - Airplane instruments and equipment.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 14 Aeronautics and Space 3 2013-01-01 2013-01-01 false Airplane instruments and equipment. 121.303... Airplane instruments and equipment. (a) Unless otherwise specified, the instrument and equipment... airspeed limitation and item of related information in the Airplane Flight Manual and pertinent placards...

14 CFR 121.303 - Airplane instruments and equipment.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 14 Aeronautics and Space 3 2011-01-01 2011-01-01 false Airplane instruments and equipment. 121.303... Airplane instruments and equipment. (a) Unless otherwise specified, the instrument and equipment... airspeed limitation and item of related information in the Airplane Flight Manual and pertinent placards...

14 CFR 121.303 - Airplane instruments and equipment.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 14 Aeronautics and Space 3 2014-01-01 2014-01-01 false Airplane instruments and equipment. 121.303... Airplane instruments and equipment. (a) Unless otherwise specified, the instrument and equipment... airspeed limitation and item of related information in the Airplane Flight Manual and pertinent placards...

Independent Orbiter Assessment (IOA): Assessment of instrumental subsystem FMEA/CIL

NASA Technical Reports Server (NTRS)

Gardner, J. R.; Addis, A. W.

1988-01-01

The McDonnell Douglas Astronautics Company (MDAC) was selected in June 1986 to perform an Independent Orbiter Assessment (IOA) of the Failure Modes and Effects Analysis (FMEA) and Critical Items List (CIL). The IOA effort first completed an analysis of the Instrumentation hardware, generating draft failure modes and potential critical items. To preserve independence, this analysis was accomplished without reliance upon the results contained within the NASA FMEA/CIL documentation. The IOA results were then compared to the NASA FMEA/CIL baseline. A resolution of each discrepancy from the comparison is provided through additional analysis as required. The results of that comparison for the Orbiter Instrumentation hardware are documented. The IOA product for Instrumentation analysis consisted of 107 failure mode worksheets that resulted in 22 critical items being identified. Comparison was made to the Pre 51-L NASA baseline with 14 Post 51-L FMEAs added, which consists of 96 FMEAs and 18 CIL items. This comparison produced agreement on all but 25 FMEAs which caused differences in 5 CIL items.

Using qualitative methods to develop a contextually tailored instrument: Lessons learned

PubMed Central

Lee, Haeok; Kiang, Peter; Kim, Minjin; Semino-Asaro, Semira; Colten, Mary Ellen; Tang, Shirley S.; Chea, Phala; Peou, Sonith; Grigg-Saito, Dorcas C.

2015-01-01

Objective: To develop a population-specific instrument to inform hepatitis B virus (HBV) and human papilloma virus (HPV) prevention education and intervention based on data and evidence obtained from the targeted population of Khmer mothers reflecting their socio-cultural and health behaviors. Methods: The principles of community-based participatory research (CBPR) guided the development of a standardized survey interview. Four stages of development and testing of the survey instrument took place in order to inform the quantitative health survey used to collect data in stage five of the project. This article reports only on Stages 1-4. Results: This process created a new quantitative measure of HBV and HPV prevention behavior based on the revised Network Episode Model and informed by the targeted population. The CBPR method facilitated the application and translation of abstract theoretical ideas of HBV and HPV prevention behavior into culturally-relevant words and expressions of Cambodian Americans (CAs). Conclusions: The design of an instrument development process that accounts for distinctive socio-cultural backgrounds of CA refugee/immigrant women provides a model for use in developing future health surveys that are intended to aid minority-serving health care professionals and researchers as well as targeted minority populations. PMID:27981114

Developing a workplace resilience instrument.

PubMed

Mallak, Larry A; Yildiz, Mustafa

2016-05-27

Resilience benefits from the use of protective factors, as opposed to risk factors, which are associated with vulnerability. Considerable research and instrument development has been conducted in clinical settings for patients. The need existed for an instrument to be developed in a workplace setting to measure resilience of employees. This study developed and tested a resilience instrument for employees in the workplace. The research instrument was distributed to executives and nurses working in the United States in hospital settings. Five-hundred-forty completed and usable responses were obtained. The instrument contained an inventory of workplace resilience, a job stress questionnaire, and relevant demographics. The resilience items were written based on previous work by the lead author and inspired by Weick's [1] sense-making theory. A four-factor model yielded an instrument having psychometric properties showing good model fit. Twenty items were retained for the resulting Workplace Resilience Instrument (WRI). Parallel analysis was conducted with successive iterations of exploratory and confirmatory factor analyses. Respondents were classified based on their employment with either a rural or an urban hospital. Executives had significantly higher WRI scores than nurses, controlling for gender. WRI scores were positively and significantly correlated with years of experience and the Brief Job Stress Questionnaire. An instrument to measure individual resilience in the workplace (WRI) was developed. The WRI's four factors identify dimensions of workplace resilience for use in subsequent investigations: Active Problem-Solving, Team Efficacy, Confident Sense-Making, and Bricolage.

Forty-two systematic reviews generated 23 items for assessing the risk of bias in values and preferences' studies.

PubMed

Yepes-Nuñez, Juan Jose; Zhang, Yuan; Xie, Feng; Alonso-Coello, Pablo; Selva, Anna; Schünemann, Holger; Guyatt, Gordon

2017-05-01

In systematic reviews of studies of patients' values and preferences, the objective of the study was to summarize items and domains authors have identified when considering the risk of bias (RoB) associated with primary studies. We conducted a systematic survey of systematic reviews of patients' values and preference studies. Our search included three databases (MEDLINE, EMBASE, and PsycINFO) from their inception to August 2015. We conducted duplicate data extraction, focusing on items that authors used to address RoB in the primary studies included in their reviews and the associated underlying domains, and summarized criteria in descriptive tables. We identified 42 eligible systematic reviews that addressed 23 items relevant to RoB and grouped the items into 7 domains: appropriate administration of instrument; instrument choice; instrument-described health state presentation; choice of participants group; description, analysis, and presentation of methods and results; patient understanding; and subgroup analysis. The items and domains identified provide insight into issues of RoB in patients' values and preference studies and establish the basis for an instrument to assess RoB in such studies. Copyright © 2017 Elsevier Inc. All rights reserved.

Applying mixed methods to pretest the Pressure Ulcer Quality of Life (PU-QOL) instrument.

PubMed

Gorecki, C; Lamping, D L; Nixon, J; Brown, J M; Cano, S

2012-04-01

Pretesting is key in the development of patient-reported outcome (PRO) instruments. We describe a mixed-methods approach based on interviews and Rasch measurement methods in the pretesting of the Pressure Ulcer Quality of Life (PU-QOL) instrument. We used cognitive interviews to pretest the PU-QOL in 35 patients with pressure ulcers with the view to identifying problematic items, followed by Rasch analysis to examine response options, appropriateness of the item series and biases due to question ordering (item fit). We then compared findings in an interactive and iterative process to identify potential strengths and weaknesses of PU-QOL items, and guide decision-making about further revisions to items and design/layout. Although cognitive interviews largely supported items, they highlighted problems with layout, response options and comprehension. Findings from the Rasch analysis identified problems with response options through reversed thresholds. The use of a mixed-methods approach in pretesting the PU-QOL instrument proved beneficial for identifying problems with scale layout, response options and framing/wording of items. Rasch measurement methods are a useful addition to standard qualitative pretesting for evaluating strengths and weaknesses of early stage PRO instruments.

Validity and measurement precision of the PROMIS physical function item bank and a content validity-driven 20-item short form in rheumatoid arthritis compared with traditional measures.

PubMed

Oude Voshaar, Martijn A H; Ten Klooster, Peter M; Glas, Cees A W; Vonkeman, Harald E; Taal, Erik; Krishnan, Eswar; Bernelot Moens, Hein J; Boers, Maarten; Terwee, Caroline B; van Riel, Piet L C M; van de Laar, Mart A F J

2015-12-01

To evaluate the content validity and measurement properties of the Patient-Reported Outcome Measurement Information System (PROMIS) physical function item bank and a 20-item short form in patients with RA in comparison with the HAQ disability index (HAQ-DI) and 36-item Short Form Health Survey (SF-36) physical functioning scale (PF-10). The content validity of the instruments was evaluated by linking their items to the International Classification of Functioning, Disability and Health (ICF) core set for RA. The measures were administered to 690 RA patients enrolled in the Dutch Rheumatoid Arthritis Monitoring registry. Measurement precision was evaluated using item response theory methods and construct validity was evaluated by correlating physical function scores with other clinical and patient-reported outcome measures. All 207 health concepts identified in the physical function measures referred to activities that are featured in the ICF. Twenty-three of 26 ICF RA core set domains are featured in the full PROMIS physical function item bank compared with 13 and 8 for the HAQ-DI and PF-10, respectively. As hypothesized, all three physical function instruments were highly intercorrelated (r 0.74-0.84), moderately correlated with disease activity measures (r 0.44-0.63) and weakly correlated with age (rs 0.07-0.14). Item response theory-based analysis revealed that a 20-item PROMIS physical function short form covered a wider range of physical function levels than the HAQ-DI or PF-10. The PROMIS physical function item bank demonstrated excellent measurement properties in RA. A content-driven 20-item short form may be a useful tool for assessing physical function in RA. © The Author 2015. Published by Oxford University Press on behalf of the British Society for Rheumatology. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Overview of Classical Test Theory and Item Response Theory for Quantitative Assessment of Items in Developing Patient-Reported Outcome Measures

PubMed Central

Cappelleri, Joseph C.; Lundy, J. Jason; Hays, Ron D.

2014-01-01

Introduction The U.S. Food and Drug Administration’s patient-reported outcome (PRO) guidance document defines content validity as “the extent to which the instrument measures the concept of interest” (FDA, 2009, p. 12). “Construct validity is now generally viewed as a unifying form of validity for psychological measurements, subsuming both content and criterion validity” (Strauss & Smith, 2009, p. 7). Hence both qualitative and quantitative information are essential in evaluating the validity of measures. Methods We review classical test theory and item response theory approaches to evaluating PRO measures including frequency of responses to each category of the items in a multi-item scale, the distribution of scale scores, floor and ceiling effects, the relationship between item response options and the total score, and the extent to which hypothesized “difficulty” (severity) order of items is represented by observed responses. Conclusion Classical test theory and item response theory can be useful in providing a quantitative assessment of items and scales during the content validity phase of patient-reported outcome measures. Depending on the particular type of measure and the specific circumstances, either one or both approaches should be considered to help maximize the content validity of PRO measures. PMID:24811753

New resilience instrument for patients with cancer.

PubMed

Ye, Zeng Jie; Liang, Mu Zi; Li, Peng Fei; Sun, Zhe; Chen, Peng; Hu, Guang Yun; Yu, Yuan Liang; Wang, Shu Ni; Qiu, Hong Zhong

2018-02-01

Resilience is an important concept in the cancer literature and is a salient indicator of cancer survivorship. The aim of this study is to develop and validate a new resilience instrument that is specific to patients with cancer diagnosis (RS-SC) in Mainland China. First, a resilience framework was constructed for patients with cancer diagnosis. Second, items were formulated based on the framework to reflect different aspects of resilience. Third, two rounds of expert panel discussion were performed to select important and relevant items. Finally, two cross-sectional studies were conducted to evaluate the psychometric properties of this instrument. Fifty-one items were generated based on the resilience framework and the final 25-item RS-SC resulted in a five-factor solution including Generic Elements, Benefit Finding, Support and Coping, Hope for the Future and Meaning for Existence, accounting for 64.72% of the variance. The Cronbach's α of the RS-SC was 0.825 and the test-retest reliability was 0.874. The RS-SC is a brief and specific self-report resilience instrument for Chinese patients with cancer and shows sound psychometric properties in this study. The RS-SC has potential applications in both clinical practice and research with strength-based resiliency interventions.

Towards Tailored Patient's Management Approach: Integrating the Modified 2010 ACR Criteria for Fibromyalgia in Multidimensional Patient Reported Outcome Measures Questionnaire

PubMed Central

El Miedany, Yasser; El Gaafary, Maha; Youssef, Sally; Ahmed, Ihab

2016-01-01

Objectives. To assess the validity, reliability, and responsiveness to change of a patient self-reported questionnaire combining the Widespread Pain Index and the Symptom Severity Score as well as construct outcome measures and comorbidities assessment in fibromyalgia patients. Methods. The PROMs-FM was conceptualized based on frameworks used by the WHO Quality of Life tool and the PROMIS. Initially, cognitive interviews were conducted to identify item pool of questions. Item selection and reduction were achieved based on patients as well as an interdisciplinary group of specialists. Rasch and internal consistency reliability analyses were implemented. The questionnaire included the modified ACR criteria main items (Symptom Severity Score and Widespread Pain Index), in addition to assessment of functional disability, quality of life (QoL), review of the systems, and comorbidities. Every patient completed HAQ and EQ-5D questionnaires. Results. A total of 146 fibromyalgia patients completed the questionnaire. The PROMs-FM questionnaire was reliable as demonstrated by a high standardized alpha (0.886–0.982). Content construct assessment of the functional disability and QoL revealed significant correlation (p < 0.01) with both HAQ and EQ-5D. Changes in functional disability and QoL showed significant (p < 0.01) variation with diseases activity status in response to therapy. There was higher prevalence of autonomic symptoms, CVS risk, sexual dysfunction, and falling. Conclusions. The developed PROMs-FM questionnaire is a reliable and valid instrument for assessment of fibromyalgia patients. A phased treatment regimen depending on the severity of FMS as well as preferences and comorbidities of the patient is the best approach to tailored patient management. PMID:27190648

[Development of an Instrument to Assess the Quality of Childbirth Care from the Mother's Perspective].

PubMed

Jeong, Geum Hee; Kim, Hyun Kyoung; Kim, Young Hee; Kim, Sun Hee; Lee, Sun Hee; Kim, Kyung Won

2018-02-01

This study aimed to develop an instrument to assess the quality of childbirth care from the perspective of a mother after delivery. The instrument was developed from a literature review, interviews, and item validation. Thirty-eight items were compiled for the instrument. The data for validity and reliability testing were collected using a questionnaire survey conducted on 270 women who had undergone normal vaginal delivery in Korea and analyzed with descriptive statistics, exploratory factor analysis, and reliability coefficients. The exploratory factor analysis reduced the number of items in the instrument to 28 items that were factored into four subscales: family-centered care, personal care, emotional empowerment, and information provision. With respect to convergence validation, there was positive correlation between this instrument and birth satisfaction scale (r=.34, p<.001). The internal consistency reliability was acceptable (Cronbach's alpha =.96). This instrument could be used as a measure of the quality of nursing care for women who have a normal vaginal delivery. © 2018 Korean Society of Nursing Science.

Evaluating Instrument Quality in Science Education: Rasch-based analyses of a Nature of Science test

NASA Astrophysics Data System (ADS)

Neumann, Irene; Neumann, Knut; Nehm, Ross

2011-07-01

Given the central importance of the Nature of Science (NOS) and Scientific Inquiry (SI) in national and international science standards and science learning, empirical support for the theoretical delineation of these constructs is of considerable significance. Furthermore, tests of the effects of varying magnitudes of NOS knowledge on domain-specific science understanding and belief require the application of instruments validated in accordance with AERA, APA, and NCME assessment standards. Our study explores three interrelated aspects of a recently developed NOS instrument: (1) validity and reliability; (2) instrument dimensionality; and (3) item scales, properties, and qualities within the context of Classical Test Theory and Item Response Theory (Rasch modeling). A construct analysis revealed that the instrument did not match published operationalizations of NOS concepts. Rasch analysis of the original instrument-as well as a reduced item set-indicated that a two-dimensional Rasch model fit significantly better than a one-dimensional model in both cases. Thus, our study revealed that NOS and SI are supported as two separate dimensions, corroborating theoretical distinctions in the literature. To identify items with unacceptable fit values, item quality analyses were used. A Wright Map revealed that few items sufficiently distinguished high performers in the sample and excessive numbers of items were present at the low end of the performance scale. Overall, our study outlines an approach for how Rasch modeling may be used to evaluate and improve Likert-type instruments in science education.

Development of the Oxford Participation and Activities Questionnaire: constructing an item pool

PubMed Central

Kelly, Laura; Jenkinson, Crispin; Dummett, Sarah; Dawson, Jill; Fitzpatrick, Ray; Morley, David

2015-01-01

Purpose The Oxford Participation and Activities Questionnaire is a patient-reported outcome measure in development that is grounded on the World Health Organization International Classification of Functioning, Disability, and Health (ICF). The study reported here aimed to inform and generate an item pool for the new measure, which is specifically designed for the assessment of participation and activity in patients experiencing a range of health conditions. Methods Items were informed through in-depth interviews conducted with 37 participants spanning a range of conditions. Interviews aimed to identify how their condition impacted their ability to participate in meaningful activities. Conditions included arthritis, cancer, chronic back pain, diabetes, motor neuron disease, multiple sclerosis, Parkinson’s disease, and spinal cord injury. Transcripts were analyzed using the framework method. Statements relating to ICF themes were recast as questionnaire items and shown for review to an expert panel. Cognitive debrief interviews (n=13) were used to assess items for face and content validity. Results ICF themes relevant to activities and participation in everyday life were explored, and a total of 222 items formed the initial item pool. This item pool was refined by the research team and 28 generic items were mapped onto all nine chapters of the ICF construct, detailing activity and participation. Cognitive interviewing confirmed the questionnaire instructions, items, and response options were acceptable to participants. Conclusion Using a clear conceptual basis to inform item generation, 28 items have been identified as suitable to undergo further psychometric testing. A large-scale postal survey will follow in order to refine the instrument further and to assess its psychometric properties. The final instrument is intended for use in clinical trials and interventions targeted at maintaining or improving activity and participation. PMID:26056503

Development of the Oxford Participation and Activities Questionnaire: constructing an item pool.

PubMed

Kelly, Laura; Jenkinson, Crispin; Dummett, Sarah; Dawson, Jill; Fitzpatrick, Ray; Morley, David

2015-01-01

The Oxford Participation and Activities Questionnaire is a patient-reported outcome measure in development that is grounded on the World Health Organization International Classification of Functioning, Disability, and Health (ICF). The study reported here aimed to inform and generate an item pool for the new measure, which is specifically designed for the assessment of participation and activity in patients experiencing a range of health conditions. Items were informed through in-depth interviews conducted with 37 participants spanning a range of conditions. Interviews aimed to identify how their condition impacted their ability to participate in meaningful activities. Conditions included arthritis, cancer, chronic back pain, diabetes, motor neuron disease, multiple sclerosis, Parkinson's disease, and spinal cord injury. Transcripts were analyzed using the framework method. Statements relating to ICF themes were recast as questionnaire items and shown for review to an expert panel. Cognitive debrief interviews (n=13) were used to assess items for face and content validity. ICF themes relevant to activities and participation in everyday life were explored, and a total of 222 items formed the initial item pool. This item pool was refined by the research team and 28 generic items were mapped onto all nine chapters of the ICF construct, detailing activity and participation. Cognitive interviewing confirmed the questionnaire instructions, items, and response options were acceptable to participants. Using a clear conceptual basis to inform item generation, 28 items have been identified as suitable to undergo further psychometric testing. A large-scale postal survey will follow in order to refine the instrument further and to assess its psychometric properties. The final instrument is intended for use in clinical trials and interventions targeted at maintaining or improving activity and participation.

Tailored Testing Theory and Practice: A Basic Model, Normal Ogive Submodels, and Tailored Testing Algorithms

DTIC Science & Technology

1983-08-01

ACCESSION NO «• TITLE (and Sublltle) TAILORED TESTING THEORY AND PRACTICE: A BASIC MODEL , NORMAL OGIVE SUBMODELS, AND TAILORED TESTING ALGORITHMS 7...single common-factor model , the author derives the two- and three-parametir normal ogfve il’^irTr^ functions as submodels. For both of these...PAOEfWiwi Dmia Bnfnd) NPRDC TR 83-32 AUGUST 1983 TAILORED TESTING THEORY AND PRACTICE: A BASIC MODEL , NORMAL OGIVE SUBMODELS, AND TAILORED TESTING

Development and validation of an instrument to assess job satisfaction in eye-care personnel.

PubMed

Paudel, Prakash; Cronjé, Sonja; O'Connor, Patricia M; Khadka, Jyoti; Rao, Gullapalli N; Holden, Brien A

2017-11-01

The aim was to develop and validate an instrument to measure job satisfaction in eye-care personnel and assess the job satisfaction of one-year trained vision technicians in India. A pilot instrument for assessing job satisfaction was developed, based on a literature review and input from a public health expert panel. Rasch analysis was used to assess psychometric properties and to undertake an iterative item reduction. The instrument was then administered to vision technicians in vision centres of Andhra Pradesh in India. Associations between vision technicians' job satisfaction and factors such as age, gender and experience were analysed using t-test and one-way analysis of variance. Rasch analysis confirmed that the 15-item job satisfaction in eye-care personnel (JSEP) was a unidimensional instrument with good fit statistics, measurement precisions and absence of differential item functioning. Overall, vision technicians reported high rates of job satisfaction (0.46 logits). Age, gender and experience were not associated with high job satisfaction score. Item score analysis showed non-financial incentives, salary and workload were the most important determinants of job satisfaction. The 15-item JSEP instrument is a valid instrument for assessing job satisfaction among eye-care personnel. Overall, vision technicians in India demonstrated high rates of job satisfaction. © 2016 Optometry Australia.

Development of the PROMIS positive emotional and sensory expectancies of smoking item banks.

PubMed

Tucker, Joan S; Shadel, William G; Edelen, Maria Orlando; Stucky, Brian D; Li, Zhen; Hansen, Mark; Cai, Li

2014-09-01

The positive emotional and sensory expectancies of cigarette smoking include improved cognitive abilities, positive affective states, and pleasurable sensorimotor sensations. This paper describes development of Positive Emotional and Sensory Expectancies of Smoking item banks that will serve to standardize the assessment of this construct among daily and nondaily cigarette smokers. Data came from daily (N = 4,201) and nondaily (N =1,183) smokers who completed an online survey. To identify a unidimensional set of items, we conducted item factor analyses, item response theory analyses, and differential item functioning analyses. Additionally, we evaluated the performance of fixed-item short forms (SFs) and computer adaptive tests (CATs) to efficiently assess the construct. Eighteen items were included in the item banks (15 common across daily and nondaily smokers, 1 unique to daily, 2 unique to nondaily). The item banks are strongly unidimensional, highly reliable (reliability = 0.95 for both), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.86). Results from simulated CATs indicated that, on average, less than 8 items are needed to assess the construct with adequate precision using the item banks. These analyses identified a new set of items that can assess the positive emotional and sensory expectancies of smoking in a reliable and standardized manner. Considerable efficiency in assessing this construct can be achieved by using the item bank SF, employing computer adaptive tests, or selecting subsets of items tailored to specific research or clinical purposes. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Factor analyses of an Adult Epilepsy Self-Management Measurement Instrument (AESMMI).

PubMed

Escoffery, Cam; Bamps, Yvan; LaFrance, W Curt; Stoll, Shelley; Shegog, Ross; Buelow, Janice; Shafer, Patricia; Thompson, Nancy J; McGee, Robin E; Hatfield, Katherine

2015-09-01

The purpose of this study was to test the psychometric properties of an enhanced Adult Epilepsy Self-Management Measurement Instrument (AESMMI). An instrument of 113 items, covering 10 a priori self-management domains, was generated through a multiphase process, based on a review of the literature, validated epilepsy and other chronic condition self-management scales and expert input. Reliability and exploratory factor analyses were conducted on data collected from 422 adults with epilepsy. The instrument was reduced to 65 items, converging on 11 factors: Health-care Communication, Coping, Treatment Management, Seizure Tracking, Social Support, Seizure Response, Wellness, Medication Adherence, Safety, Stress Management, and Proactivity. Exploratory factors supported the construct validity for 6 a priori domains, albeit with significant changes in the retained items or in their scope and 3 new factors. One a priori domain was split in 2 subscales pertaining to treatment. The configuration of the 11 factors provides additional insight into epilepsy self-management behaviors. Internal consistency reliability of the 65-item instrument was high (α=.935). Correlations with independent measures of health status, quality of life, depression, seizure severity, and life impact of epilepsy further validated the instrument. This instrument shows potential for use in research and clinical settings and for assessing intervention outcomes and self-management behaviors in adults with epilepsy. Copyright © 2015 Elsevier Inc. All rights reserved.

Development and validation of 26-item dysfunctional attitude scale.

PubMed

Ebrahimi, Amrollah; Samouei, Rahele; Mousavii, Sayyed Ghafour; Bornamanesh, Ali Reza

2013-06-01

Dysfunctional Attitude Scale is one of the most common instruments used to assess cognitive vulnerability. This study aimed to develop and validate a short form of Dysfunctional Attitude Scale appropriate for an Iranian clinical population. Participants were 160 psychiatric patients from medical centers affiliated with Isfahan Medical University, as well as 160 non-patients. Research instruments were clinical interviews based on the Diagnostic and Statistical Manual-IV-TR, Dysfunctional Attitude Scale and General Heath Questionnaire (GHQ-28). Data was analyzed using multicorrelation calculations and factor analysis. Based on the results of factor analysis and item-total correlation, 14 items were judged candidates for omission. Analysis of the 26-item Dysfunctional Attitude Scale (DAS-26) revealed a Cronbach's alpha of 0.92. Evidence for the concurrent criterion validity was obtained through calculating the correlation between the Dysfunctional Attitude Scale and psychiatric diagnosis (r = 0.55), GHQ -28 (r = 0.56) and somatization, anxiety, social dysfunction, and depression subscales (0.45,0.53,0.48, and 0.57, respectively). Factor analysis deemed a four-factor structure the best. The factors were labeled as success-perfectionism, need for approval, need for satisfying others, and vulnerability-performance evaluation. The results showed that the Iranian version of the Dysfunctional Attitude Scale (DAS-26) bears satisfactory psychometric properties suggesting that this cognitive instrument is appropriate for use in an Iranian cultural context. Copyright © 2012 Wiley Publishing Asia Pty Ltd.

Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1--eliciting concepts for a new PRO instrument.

PubMed

Patrick, Donald L; Burke, Laurie B; Gwaltney, Chad J; Leidy, Nancy Kline; Martin, Mona L; Molsen, Elizabeth; Ring, Lena

2011-12-01

The importance of content validity in developing patient reported outcomes (PRO) instruments is stressed by both the US Food and Drug Administration and the European Medicines Agency. Content validity is the extent to which an instrument measures the important aspects of concepts that developers or users purport it to assess. A PRO instrument measures the concepts most significant and relevant to a patient's condition and its treatment. For PRO instruments, items and domains as reflected in the scores of an instrument should be important to the target population and comprehensive with respect to patient concerns. Documentation of target population input in item generation, as well as evaluation of patient understanding through cognitive interviewing, can provide the evidence for content validity. Developing content for, and assessing respondent understanding of, newly developed PRO instruments for medical product evaluation will be discussed in this two-part ISPOR PRO Good Research Practices Task Force Report. Topics include the methods for generating items, documenting item development, coding of qualitative data from item generation, cognitive interviewing, and tracking item development through the various stages of research and preparing this tracking for submission to regulatory agencies. Part 1 covers elicitation of key concepts using qualitative focus groups and/or interviews to inform content and structure of a new PRO instrument. Part 2 covers the instrument development process, the assessment of patient understanding of the draft instrument using cognitive interviews and steps for instrument revision. The two parts are meant to be read together. They are intended to offer suggestions for good practices in planning, executing, and documenting qualitative studies that are used to support the content validity of PRO instruments to be used in medical product evaluation. Copyright © 2011 International Society for Pharmacoeconomics and Outcomes Research (ISPOR

Instruments and Taxonomy of Workplace Bullying in Health Care Organizations.

PubMed

Park, Eun-Jun; Lee, Mikyoung; Park, Myungsook

2017-12-01

This study was aimed to evaluate the methodological issues and comprehensiveness of workplace bullying instruments and to suggest a taxonomy of psychological abuse. Nineteen instruments applied in health care organizations and 469 questionnaire items mainly regarding psychological abuse were collected through a literature review. Three researchers classified the questionnaire items according to a "taxonomy of psychological abuse in the workplace." Many instruments of workplace bullying were developed in the 2000s using a reflective measurement model, but their psychometric property was not sufficient and the measurement model is questioned. Based on the questionnaire items, the "taxonomy of psychological abuse in the workplace" was modified by adding two new subcategories (unachievable work and unfair treatment) and clarifying some operational definitions. According to the modified taxonomy of 11 (sub)categories, the reviewed instruments assessed 6.5 (sub)categories on average. No instrument measured all (sub)categories. Category 4.2 (disrespect, humiliation, and rejection of the person) was measured in all instruments, followed by Categories 5 (professional discredit and denigration) and 1.2 (social isolation) behaviors. The current instruments are not comprehensive enough. It is suggested that the modified taxonomy is verified and guide more reliable and inclusive instruments in the future. Furthermore, a formative measurement model, which defines a bullying as an inventory of different types of behaviors, should be used. Copyright © 2017. Published by Elsevier B.V.

The Caregiver Contribution to Heart Failure Self-Care (CACHS): Further Psychometric Testing of a Novel Instrument.

PubMed

Buck, Harleah G; Harkness, Karen; Ali, Muhammad Usman; Carroll, Sandra L; Kryworuchko, Jennifer; McGillion, Michael

2017-04-01

Caregivers (CGs) contribute important assistance with heart failure (HF) self-care, including daily maintenance, symptom monitoring, and management. Until CGs' contributions to self-care can be quantified, it is impossible to characterize it, account for its impact on patient outcomes, or perform meaningful cost analyses. The purpose of this study was to conduct psychometric testing and item reduction on the recently developed 34-item Caregiver Contribution to Heart Failure Self-care (CACHS) instrument using classical and item response theory methods. Fifty CGs (mean age 63 years ±12.84; 70% female) recruited from a HF clinic completed the CACHS in 2014 and results evaluated using classical test theory and item response theory. Items would be deleted for low (<.05) or high (>.95) endorsement, low (<.3) or high (>.7) corrected item-total correlations, significant pairwise correlation coefficients, floor or ceiling effects, relatively low latent trait and item information function levels (<1.5 and p > .5), and differential item functioning. After analysis, 14 items were excluded, resulting in a 20-item instrument (self-care maintenance eight items; monitoring seven items; and management five items). Most items demonstrated moderate to high discrimination (median 2.13, minimum .77, maximum 5.05), and appropriate item difficulty (-2.7 to 1.4). Internal consistency reliability was excellent (Cronbach α = .94, average inter-item correlation = .41) with no ceiling effects. The newly developed 20-item version of the CACHS is supported by rigorous instrument development and represents a novel instrument to measure CGs' contribution to HF self-care. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

The Impact of Missing Data on the Detection of Nonuniform Differential Item Functioning

ERIC Educational Resources Information Center

Finch, W. Holmes

2011-01-01

Missing information is a ubiquitous aspect of data analysis, including responses to items on cognitive and affective instruments. Although the broader statistical literature describes missing data methods, relatively little work has focused on this issue in the context of differential item functioning (DIF) detection. Such prior research has…

Measuring the quality of life in hypertension according to Item Response Theory

PubMed Central

Borges, José Wicto Pereira; Moreira, Thereza Maria Magalhães; Schmitt, Jeovani; de Andrade, Dalton Francisco; Barbetta, Pedro Alberto; de Souza, Ana Célia Caetano; Lima, Daniele Braz da Silva; Carvalho, Irialda Saboia

2017-01-01

ABSTRACT OBJECTIVE To analyze the Miniquestionário de Qualidade de Vida em Hipertensão Arterial (MINICHAL – Mini-questionnaire of Quality of Life in Hypertension) using the Item Response Theory. METHODS This is an analytical study conducted with 712 persons with hypertension treated in thirteen primary health care units of Fortaleza, State of Ceará, Brazil, in 2015. The steps of the analysis by the Item Response Theory were: evaluation of dimensionality, estimation of parameters of items, and construction of scale. The study of dimensionality was carried out on the polychoric correlation matrix and confirmatory factor analysis. To estimate the item parameters, we used the Gradual Response Model of Samejima. The analyses were conducted using the free software R with the aid of psych and mirt. RESULTS The analysis has allowed the visualization of item parameters and their individual contributions in the measurement of the latent trait, generating more information and allowing the construction of a scale with an interpretative model that demonstrates the evolution of the worsening of the quality of life in five levels. Regarding the item parameters, the items related to the somatic state have had a good performance, as they have presented better power to discriminate individuals with worse quality of life. The items related to mental state have been those which contributed with less psychometric data in the MINICHAL. CONCLUSIONS We conclude that the instrument is suitable for the identification of the worsening of the quality of life in hypertension. The analysis of the MINICHAL using the Item Response Theory has allowed us to identify new sides of this instrument that have not yet been addressed in previous studies. PMID:28492764

Developing an item bank to measure the coping strategies of people with hereditary retinal diseases.

PubMed

Prem Senthil, Mallika; Khadka, Jyoti; De Roach, John; Lamey, Tina; McLaren, Terri; Campbell, Isabella; Fenwick, Eva K; Lamoureux, Ecosse L; Pesudovs, Konrad

2018-05-05

Our understanding of the coping strategies used by people with visual impairment to manage stress related to visual loss is limited. This study aims to develop a sophisticated coping instrument in the form of an item bank implemented via Computerised adaptive testing (CAT) for hereditary retinal diseases. Items on coping were extracted from qualitative interviews with patients which were supplemented by items from a literature review. A systematic multi-stage process of item refinement was carried out followed by expert panel discussion and cognitive interviews. The final coping item bank had 30 items. Rasch analysis was used to assess the psychometric properties. A CAT simulation was carried out to estimate an average number of items required to gain precise measurement of hereditary retinal disease-related coping. One hundred eighty-nine participants answered the coping item bank (median age = 58 years). The coping scale demonstrated good precision and targeting. The standardised residual loadings for items revealed six items grouped together. Removal of the six items reduced the precision of the main coping scale and worsened the variance explained by the measure. Therefore, the six items were retained within the main scale. Our CAT simulation indicated that, on average, less than 10 items are required to gain a precise measurement of coping. This is the first study to develop a psychometrically robust coping instrument for hereditary retinal diseases. CAT simulation indicated that on an average, only four and nine items were required to gain measurement at moderate and high precision, respectively.

Quality of prenatal care questionnaire: instrument development and testing.

PubMed

Heaman, Maureen I; Sword, Wendy A; Akhtar-Danesh, Noori; Bradford, Amanda; Tough, Suzanne; Janssen, Patricia A; Young, David C; Kingston, Dawn A; Hutton, Eileen K; Helewa, Michael E

2014-06-03

Utilization indices exist to measure quantity of prenatal care, but currently there is no published instrument to assess quality of prenatal care. The purpose of this study was to develop and test a new instrument, the Quality of Prenatal Care Questionnaire (QPCQ). Data for this instrument development study were collected in five Canadian cities. Items for the QPCQ were generated through interviews with 40 pregnant women and 40 health care providers and a review of prenatal care guidelines, followed by assessment of content validity and rating of importance of items. The preliminary 100-item QPCQ was administered to 422 postpartum women to conduct item reduction using exploratory factor analysis. The final 46-item version of the QPCQ was then administered to another 422 postpartum women to establish its construct validity, and internal consistency and test-retest reliability. Exploratory factor analysis reduced the QPCQ to 46 items, factored into 6 subscales, which subsequently were validated by confirmatory factor analysis. Construct validity was also demonstrated using a hypothesis testing approach; there was a significant positive association between women's ratings of the quality of prenatal care and their satisfaction with care (r = 0.81). Convergent validity was demonstrated by a significant positive correlation (r = 0.63) between the "Support and Respect" subscale of the QPCQ and the "Respectfulness/Emotional Support" subscale of the Prenatal Interpersonal Processes of Care instrument. The overall QPCQ had acceptable internal consistency reliability (Cronbach's alpha = 0.96), as did each of the subscales. The test-retest reliability result (Intra-class correlation coefficient = 0.88) indicated stability of the instrument on repeat administration approximately one week later. Temporal stability testing confirmed that women's ratings of their quality of prenatal care did not change as a result of giving birth or between the early postpartum

Identifying instruments to quantify financial management skills in adults with acquired cognitive impairments.

PubMed

Engel, Lisa; Bar, Yael; Beaton, Dorcas E; Green, Robin E; Dawson, Deirdre R

2016-01-01

Financial management skills-that is, the skills needed to handle personal finances such as banking and paying bills-are essential to a person's autonomy, independence, and community living. To date, no comprehensive review of financial management skills instruments exists, making it difficult for clinicians and researchers to choose relevant instruments. The objectives of this review are to: (a) identify all available instruments containing financial management skill items that have been used with adults with acquired cognitive impairments; (b) categorize the instruments by source (i.e., observation based, self-report, proxy report); and (c) describe observation-based performance instruments by populations, overarching concepts measured, and comprehensiveness of financial management items. Objective (c) focuses on observation-based performance instruments as these measures can aid in situations where the person with cognitive impairment has poor self-awareness or where the proxy has poor knowledge of the person's current abilities. Two reviewers completed two systematic searches of five databases. Instruments were categorized by reviewing published literature, copies of the instruments, and/or communication with instrument authors. Comprehensiveness of items was based on nine key domains of financial management skills developed by the authors. A total of 88 discrete instruments were identified. Of these, 44 were categorized as observation-based performance and 44 as self- and/or proxy-reports. Of the 44 observation-based performance instruments, 8 had been developed for acquired brain injury populations and 24 for aging and dementia populations. Only 7 of the observation-based performance instruments had items spanning 6 or more of the 9 financial management skills domains. The majority of instruments were developed for aging and dementia populations, and few were comprehensive. This review provides foundation for future instrument psychometric and clinimetric

The impact of sub-skills and item content on students' skills with regard to the control-of-variables strategy

NASA Astrophysics Data System (ADS)

Schwichow, Martin; Christoph, Simon; Boone, William J.; Härtig, Hendrik

2016-01-01

The so-called control-of-variables strategy (CVS) incorporates the important scientific reasoning skills of designing controlled experiments and interpreting experimental outcomes. As CVS is a prominent component of science standards appropriate assessment instruments are required to measure these scientific reasoning skills and to evaluate the impact of instruction on CVS development. A detailed review of existing CVS instruments suggests that they utilize different, and only a few of the four, critical CVS sub-skills in the item development. This study presents a new CVS assessment instrument (CVS Inventory, CVSI) and investigates the validity of student measures derived from this instrument utilizing Rasch analyses. The results indicate that the CVSI produces reliable and valid student measures with regard to CVS. Furthermore, the results show that the item difficulty depends on the CVS sub-skills utilized in item development, but not on the item content. Accordingly, previous instruments that are restricted to a few CVS sub-skills tend to over- or underestimate students' CVS skills. In addition, these results indicate that students are able to use CVS as a domain general strategy in multiple content areas. Consequences for science instruction and assessment are discussed.

The development of an instrument for evaluating clinical teachers: involving stakeholders to determine content validity.

PubMed

Stalmeijer, Renée E; Dolmans, Diana H J M; Wolfhagen, Ineke H A P; Muijtjens, Arno M M; Scherpbier, Albert J J A

2008-01-01

Research indicates that the quality of supervision strongly influences the learning of medical students in clinical practice. Clinical teachers need feedback to improve their supervisory skills. The available instruments either lack a clear theoretical framework or are not suitable for providing feedback to individual teachers. We developed an evaluation instrument based on the 'cognitive apprenticeship model'. The aim was to estimate the content validity of the developed instrument. Item relevance was rated on a five-point scale (1 = highly irrelevant, 5 = highly relevant) by three groups of stakeholders in undergraduate clinical teaching: educationalists (N = 12), doctors (N = 16) and students (N = 12). Additionally, stakeholders commented on content, wording and omission of items. The items were generally rated as very relevant (Mean = 4.3, SD = 0.38, response = 95%) and any differences between the stakeholder groups were small. The results led to elimination of 4 items, rewording of 13 items and addition of 1 item. The cognitive apprenticeship model appears to offer a useful framework for the development of an evaluation instrument aimed at providing feedback to individual clinical teachers on the quality of student supervision. Further studies in larger populations will have to establish the instrument's statistical validity and generalizability.

Acceptability and feasibility of a culturally tailored Internet-delivered intervention to promote blood donation in Blacks.

PubMed

Robbins, Mark L; Paiva, Andrea L; Amoyal, Nicole R; Brick, Leslie; Kessler, Debra A; Burditt, Caitlin; Caltabiano, Melinda; Shaz, Beth H

2015-03-01

A pilot test of a computer-tailored intervention designed to promote blood donation among Blacks was conducted. Intervention content, based on the transtheoretical model, offered participants individually and culturally tailored information on blood donation with emphasis on need specific to race (e.g., sickle-cell disease). Black adults (N = 150) with a diversity of blood donation experience were recruited from a blood center and a survey recruitment website. Posttest assessment included a 14-item evaluation and transtheoretical model questions. Participants rated the program positively (81.3% to 98.7% of participants agreeing or strongly agreeing with evaluation items). For example, 98.7% of respondents reported that the program gave sound advice and that personal feedback was easily understood, and 87.3% felt the program was designed for people like themselves. Ninety-five percent of participants reported that they would recommend the program to others. There were no significant differences in ratings based on demographics. Qualitative responses support program acceptability. Furthermore, pre- and postprogram assessments indicated an increase in intention to donate, t(149) = 3.56, p = .001, d = .29. With acceptability and feasibility confirmed, the next steps are to test efficacy and cost-effectiveness for use to increase blood donation, particularly in priority populations. © 2014 Society for Public Health Education.

Modern Psychometric Methodology: Applications of Item Response Theory

ERIC Educational Resources Information Center

Reid, Christine A.; Kolakowsky-Hayner, Stephanie A.; Lewis, Allen N.; Armstrong, Amy J.

2007-01-01

Item response theory (IRT) methodology is introduced as a tool for improving assessment instruments used with people who have disabilities. Need for this approach in rehabilitation is emphasized; differences between IRT and classical test theory are clarified. Concepts essential to understanding IRT are defined, necessary data assumptions are…

Tailor-welded blanks and their production

NASA Astrophysics Data System (ADS)

Yan, Qi

2005-01-01

Tailor welded blanks had been widely used in the automobile industry. A tailor welded blank consists of several flat sheets that were laser welded together before stamping. A combination of different materials, thickness, and coatings could be welded together to form a blank for stamping car body panels. As for the material for automobile industry, this technology was one of the development trend for automobile industry because of its weight reduction, safety improvement and economical use of materials. In this paper, the characters and production of tailor welded blanks in the market were discussed in detail. There had two major methods to produce tailor welded blanks. Laser welding would replace mesh seam welding for the production of tailor welded blanks in the future. The requirements on the edge preparation of unwelded blanks for tailor welded blanks were higher than the other steel processing technology. In order to produce the laser welded blank, there had the other process before the laser welding in the factory. In the world, there had three kinds of patterns for the large volume production of tailor welded blanks. In China, steel factory played the important role in the promotion of the application of tailor welded blanks. The competition for the supply of tailor welded blanks to the automobile industry would become fierce in the near future. As a result, the demand for the quality control on the production of tailor welded blanks would be the first priority concern for the factory.

Gender Invariance of the Gambling Behavior Scale for Adolescents (GBS-A): An Analysis of Differential Item Functioning Using Item Response Theory.

PubMed

Donati, Maria Anna; Chiesi, Francesca; Izzo, Viola A; Primi, Caterina

2017-01-01

As there is a lack of evidence attesting the equivalent item functioning across genders for the most employed instruments used to measure pathological gambling in adolescence, the present study was aimed to test the gender invariance of the Gambling Behavior Scale for Adolescents (GBS-A), a new measurement tool to assess the severity of Gambling Disorder (GD) in adolescents. The equivalence of the items across genders was assessed by analyzing Differential Item Functioning within an Item Response Theory framework. The GBS-A was administered to 1,723 adolescents, and the graded response model was employed. The results attested the measurement equivalence of the GBS-A when administered to male and female adolescent gamblers. Overall, findings provided evidence that the GBS-A is an effective measurement tool of the severity of GD in male and female adolescents and that the scale was unbiased and able to relieve truly gender differences. As such, the GBS-A can be profitably used in educational interventions and clinical treatments with young people.

Psychometric properties of WHOQOL-BREF in clinical and health Greek populations: incorporating new culture-relevant items.

PubMed

Ginieri-Coccossis, M; Triantafillou, E; Tomaras, V; Soldatos, C; Mavreas, V; Christodoulou, G

2012-01-01

Τhe present study examines main psychometric properties of the World Health Organisation (WHO) quality of life (QoL) instrument, the WHOQOL-BREF with the inclusion of four national items. Participants were 425 adult native Greek speaking, grouped into patients with physical disorders, psychiatric disorders and healthy individuals. Participants were administered WHOQOL-BREF and 23 national items, the General Health Questionnaire (GHQ-28) and the Life Satisfaction Index (LSI). Confirmatory factor analysis produced acceptable fit values for the original model of 26 items within the four WHOQOL domains: physical health, psychological health, social relationships and environment. Testing for the fit of national items within this model, the results indicated four new items with the most satisfactory fit indices and were thus included forming a 30-items version. The national items refer to: (a) nutrition, (b) satisfaction with work (both loaded in the physical health domain), (c) home life and (d) social life (both loaded in the social relationships domain). Statistical tests were applied to the 26- and 30-items versions producing satisfactory results, with the 30-items version showing slightly better values. Furthermore, results on the 30-items version included: (a) internal consistency, which was found satisfactory, with alpha values ranging from α=0.67-0.81, while the inclusion of new items produced higher alpha values in physical health and social relationships domains, (b) construct validity with good item-domain correlations, as well as strong correlations between domain scores, (c) convergent validity, which was very satisfactory, showing good correlations with GHQ-28 and LSI, (d) discriminant validity, showing instrument's ability to detect QoL differences between healthy and unhealthy participants, and between physically ill and psychiatric patients, and (e) test-retest reliability, with ICC scores in excess of 0.80 obtaining for all domains. The WHOQOL

Pressure ulcers: development and psychometric evaluation of the attitude towards pressure ulcer prevention instrument (APuP).

PubMed

Beeckman, D; Defloor, T; Demarré, L; Van Hecke, A; Vanderwee, K

2010-11-01

Pressure ulcers continue to be a significant problem in hospitals, nursing homes and community care settings. Pressure ulcer incidence is widely accepted as an indicator for the quality of care. Negative attitudes towards pressure ulcer prevention may result in suboptimal preventive care. A reliable and valid instrument to assess attitudes towards pressure ulcer prevention is lacking. Development and psychometric evaluation of the Attitude towards Pressure ulcer Prevention instrument (APuP). Prospective psychometric instrument validation study. A literature review was performed to design the instrument. Content validity was evaluated by nine European pressure ulcer experts and five experts in psychometric instrument validation in a double Delphi procedure. A convenience sample of 258 nurses and 291 nursing students from Belgium and The Netherlands participated in order to evaluate construct validity and stability reliability of the instrument. The data were collected between February and May 2008. A factor analysis indicated the construct of a 13 item instrument in a five factor solution: (1) attitude towards personal competency to prevent pressure ulcers (three items); (2) attitude towards the priority of pressure ulcer prevention (three items); (3) attitude towards the impact of pressure ulcers (three items); (4) attitude towards personal responsibility in pressure ulcer prevention (two items); and (5) attitude towards confidence in the effectiveness of prevention (two items). This five factor solution accounted for 61.4% of the variance in responses related to attitudes towards pressure ulcer prevention. All items demonstrated factor loadings over 0.60. The instrument produced similar results during stability testing [ICC=0.88 (95% CI=0.84-0.91, P<0.001)]. For the total instrument, the internal consistency (Cronbachs alpha) was 0.79. The APuP is a psychometrically sound instrument that can be used to effectively assess attitudes towards pressure ulcer prevention

Development of Elderly Quality of Life Index – Eqoli: Item Reduction and Distribution into Dimensions

PubMed Central

Paschoal, Sérgio Márcio Pacheco; Filho, Wilson Jacob; Litvoc, Júlio

2008-01-01

OBJECTIVE To describe item reduction and its distribution into dimensions in the construction process of a quality of life evaluation instrument for the elderly. METHODS The sampling method was chosen by convenience through quotas, with selection of elderly subjects from four programs to achieve heterogeneity in the “health status”, “functional capacity”, “gender”, and “age” variables. The Clinical Impact Method was used, consisting of the spontaneous and elicited selection by the respondents of relevant items to the construct Quality of Life in Old Age from a previously elaborated item pool. The respondents rated each item’s importance using a 5-point Likert scale. The product of the proportion of elderly selecting the item as relevant (frequency) and the mean importance score they attributed to it (importance) represented the overall impact of that item in their quality of life (impact). The items were ordered according to their impact scores and the top 46 scoring items were grouped in dimensions by three experts. A review of the negative items was performed. RESULTS One hundred and ninety three people (122 women and 71 men) were interviewed. Experts distributed the 46 items into eight dimensions. Closely related items were grouped and dimensions not reaching the minimum expected number of items received additional items resulting in eight dimensions and 43 items. DISCUSSION The sample was heterogeneous and similar to what was expected. The dimensions and items demonstrated the multidimensionality of the construct. The Clinical Impact Method was appropriate to construct the instrument, which was named Elderly Quality of Life Index - EQoLI. An accuracy process will be examined in the future. PMID:18438571

Shortening of an existing generic online health-related quality of life instrument for dogs.

PubMed

Reid, J; Wiseman-Orr, L; Scott, M

2017-10-11

Development, initial validation and reliability testing of a shortened version of a web-based questionnaire instrument to measure generic health-related quality of life in companion dogs, to facilitate smartphone and online use. The original 46 items were reduced using expert judgment and factor analysis. Items were removed on the basis of item loadings and communalities on factors identified through factor analysis of responses from owners of healthy and unwell dogs, intrafactor item correlations, readability of items in the UK, USA and Australia and ability of individual items to discriminate between healthy and unwell dogs. Validity was assessed through factor analysis and a field trial using a "known groups" approach. Test-retest reliability was assessed using intraclass correlation coefficients. The new instrument comprises 22 items, each of which was rated by dog owners using a 7-point Likert scale. Factor analysis revealed a structure with four health-related quality of life domains (energetic/enthusiastic, happy/content, active/comfortable, and calm/relaxed) accounting for 72% of the variability in the data compared with 64% for the original instrument. The field test involving 153 healthy and unwell dogs demonstrated good discriminative properties and high intraclass correlation coefficients. The 22-item shortened form is superior to the original instrument and can be accessed via a mobile phone app. This is likely to increase the acceptability to dog owners as a routine wellness measure in health care packages and as a therapeutic monitoring tool. © 2017 British Small Animal Veterinary Association.

Item-focussed Trees for the Identification of Items in Differential Item Functioning.

PubMed

Tutz, Gerhard; Berger, Moritz

2016-09-01

A novel method for the identification of differential item functioning (DIF) by means of recursive partitioning techniques is proposed. We assume an extension of the Rasch model that allows for DIF being induced by an arbitrary number of covariates for each item. Recursive partitioning on the item level results in one tree for each item and leads to simultaneous selection of items and variables that induce DIF. For each item, it is possible to detect groups of subjects with different item difficulties, defined by combinations of characteristics that are not pre-specified. The way a DIF item is determined by covariates is visualized in a small tree and therefore easily accessible. An algorithm is proposed that is based on permutation tests. Various simulation studies, including the comparison with traditional approaches to identify items with DIF, show the applicability and the competitive performance of the method. Two applications illustrate the usefulness and the advantages of the new method.

Content validity of the Geriatric Health Assessment Instrument

PubMed Central

Pedreira, Rhaine Borges Santos; Rocha, Saulo Vasconcelos; dos Santos, Clarice Alves; Vasconcelos, Lélia Renata Carneiro; Reis, Martha Cerqueira

2016-01-01

ABSTRACT Objective Assess the content validity of the Elderly Health Assessment Tool with low education. Methods The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as “not valid”, “somewhat valid” or “valid”, using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. Results The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. Conclusion The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly. PMID:27462889

Content validity of governing in Building Information Modelling (BIM) implementation assessment instrument

NASA Astrophysics Data System (ADS)

Hadzaman, N. A. H.; Takim, R.; Nawawi, A. H.; Mohamad Yusuwan, N.

2018-04-01

BIM governance assessment instrument is a process of analysing the importance in developing BIM governance solution to tackle the existing problems during team collaboration in BIM-based projects. Despite the deployment of integrative technologies in construction industry particularly BIM, it is still insufficient compare to other sectors. Several studies have been established the requirements of BIM implementation concerning all technical and non-technical BIM adoption issues. However, the data are regarded as inadequate to develop a BIM governance framework. Hence, the objective of the paper is to evaluate the content validity of the BIM governance instrument prior to the main data collection. Two methods were employed in the form of literature review and questionnaire survey. Based on the literature review, 273 items with six main constructs are suggested to be incorporated in the BIM governance instrument. The Content Validity Ratio (CVR) scores revealed that 202 out of 273 items are considered as the utmost critical by the content experts. The findings for Item Level Content Validity Index (I-CVI) and Modified Kappa Coefficient however revealed that 257 items in BIM governance instrument are appropriate and excellent. The instrument is highly reliable for future strategies and the development of BIM projects in Malaysia.

The development of an instrument to measure factors that influence self-perceived dignity.

PubMed

Vlug, Mariska G; de Vet, Henrica C W; Pasman, H Roeline W; Rurup, Mette L; Onwuteaka-Philipsen, Bregje D

2011-05-01

Preserving dignity can be considered as a goal of palliative care. To provide dignity-conserving care, it is relevant to identify the factors that influence a patient's self-perceived dignity. This study aims to develop an instrument to measure factors affecting self-perceived dignity that has good content validity and is appropriate for use in practice. Data were collected in the Advance Directives Cohort Study. In 2008, the cohort received a questionnaire with 31 items that might influence one's self-perceived dignity. For a subsample of people with poor health (n = 292), we analyzed which items could be removed because of the mean scores for presence of the item and its influence on dignity. The 31 items fell into four domains: evaluation of self in relation to others, functional status, mental state, and care and situational aspects. Mean scores for presence and influence on dignity showed large differences and were not correlated. Six items were scarcely present and did not substantially affect self-perceived dignity. Because three of these were expected to influence dignity in other settings, only three items could be removed and two items could be combined into one. After calculating correlations between conceptually similar items, one extra item could be removed. Reducing the instrument to 26 items and dichotomizing the answer option for presence increases its feasibility for use in practice. The instrument offers an important step to better understanding the phenomenon of self-perceived dignity by gaining information directly from patients.

Disparities in Sense of Community: True race differences or differential item functioning?

PubMed Central

Coffman, Donna L.; BeLue, Rhonda

2009-01-01

The sense of community index (SCI) has been widely used to measure psychological sense of community (SOC). Furthermore, SOC has been found to differ among racial groups. Since different ethnic groups have different cultural and historical experiences that may lead to different interpretations of measurement items, it is important to know whether the instrument used to measure the construct of interest has equivalency in measurement across groups or if the instrument exhibits differential item functioning (DIF). Examining DIF in the SCI helps assure that subgroup comparisons identify true differences in SOC between Blacks and Whites. We did not find DIF between races but we did find that that the SCI question ‘I feel at home in my neighborhood’ was a more reliable measure of SOC for Whites than for Blacks. In other words, this item has less measurement error for Whites than for Blacks. Therefore, differences on the SCI may be attributable to true differences in SOC between races rather than DIF. PMID:19890462

A Computer-Based Instrument That Identifies Common Science Misconceptions

ERIC Educational Resources Information Center

Larrabee, Timothy G.; Stein, Mary; Barman, Charles

2006-01-01

This article describes the rationale for and development of a computer-based instrument that helps identify commonly held science misconceptions. The instrument, known as the Science Beliefs Test, is a 47-item instrument that targets topics in chemistry, physics, biology, earth science, and astronomy. The use of an online data collection system…

Developing the Communicative Participation Item Bank: Rasch Analysis Results from a Spasmodic Dysphonia Sample

ERIC Educational Resources Information Center

Baylor, Carolyn R.; Yorkston, Kathryn M.; Eadie, Tanya L.; Miller, Robert M.; Amtmann, Dagmar

2009-01-01

Purpose: The purpose of this study was to conduct the initial psychometric analyses of the Communicative Participation Item Bank--a new self-report instrument designed to measure the extent to which communication disorders interfere with communicative participation. This item bank is intended for community-dwelling adults across a range of…

Sterilization of endoscopic instruments.

PubMed

Sabnis, Ravindra B; Bhattu, Amit; Vijaykumar, Mohankumar

2014-03-01

Sterilization of endoscopic instruments is an important but often ignored topic. The purpose of this article is to review the current literature on the sterilization of endoscopic instruments and elaborate on the appropriate sterilization practices. Autoclaving is an economic and excellent method of sterilizing the instruments that are not heat sensitive. Heat sensitive instruments may get damaged with hot sterilization methods. Several new endoscopic instruments such as flexible ureteroscopes, chip on tip endoscopes, are added in urologists armamentarium. Many of these instruments are heat sensitive and hence alternative efficacious methods of sterilization are necessary. Although ethylene oxide and hydrogen peroxide are excellent methods of sterilization, they have some drawbacks. Gamma irradiation is mainly for disposable items. Various chemical agents are widely used even though they achieve high-level disinfection rather than sterilization. This article reviews various methods of endoscopic instrument sterilization with their advantages and drawbacks. If appropriate sterilization methods are adopted, then it not only will protect patients from procedure-related infections but prevent hypersensitive allergic reactions. It will also protect instruments from damage and increase its longevity.

Measurement equivalence and differential item functioning in family psychology.

PubMed

Bingenheimer, Jeffrey B; Raudenbush, Stephen W; Leventhal, Tama; Brooks-Gunn, Jeanne

2005-09-01

Several hypotheses in family psychology involve comparisons of sociocultural groups. Yet the potential for cross-cultural inequivalence in widely used psychological measurement instruments threatens the validity of inferences about group differences. Methods for dealing with these issues have been developed via the framework of item response theory. These methods deal with an important type of measurement inequivalence, called differential item functioning (DIF). The authors introduce DIF analytic methods, linking them to a well-established framework for conceptualizing cross-cultural measurement equivalence in psychology (C.H. Hui and H.C. Triandis, 1985). They illustrate the use of DIF methods using data from the Project on Human Development in Chicago Neighborhoods (PHDCN). Focusing on the Caregiver Warmth and Environmental Organization scales from the PHDCN's adaptation of the Home Observation for Measurement of the Environment Inventory, the authors obtain results that exemplify the range of outcomes that may result when these methods are applied to psychological measurement instruments. (c) 2005 APA, all rights reserved

Individually Tailored Dietary Counseling among Old Home Care Clients - Effects on Nutritional Status.

PubMed

Pölönen, S; Tiihonen, M; Hartikainen, S; Nykänen, I

2017-01-01

To evaluate the effect of individually tailored dietary counseling on nutritional status among home care clients aged 75 years or older. Non-randomised controlled study. The study sample consisted of 224 home care clients (≥ 75 years) (intervention group, n = 127; control group, n = 100) who were at protein-energy malnutrition (PEM) or risk of PEM (MNA score <24 and plasma albumin <35 g/L). Individually tailored dietary counseling; the persons were instructed to increase their food intake with energy-dense food items, the number of meals they ate and their consumption of energy-, protein- and nutrient-rich snacks for six months. The Mini Nutritional Assessment (MNA), Body Mass Index (BMI) and plasma albumin were used to determine nutritional status at the baseline and after the six-month intervention. The mean age of the home care clients was 84.3 (SD 5.5) in the intervention group and 84.4 (SD 5.3) in the control group, and 70 percent were women in both groups. After the six-month nutritional intervention, the MNA score increased 2.3 points and plasma albumin 1.6 g/L in the intervention group, against MNA score decreased -0.2 points and plasma albumin -0.1 g/L in the control group. Individually tailored dietary counseling may improve nutritional status among older home care clients.

Item Writer Judgments of Item Difficulty versus Actual Item Difficulty: A Case Study

ERIC Educational Resources Information Center

Sydorenko, Tetyana

2011-01-01

This study investigates how accurate one item writer can be on item difficulty estimates and whether factors affecting item writer judgments correspond to predictors of actual item difficulty. The items were based on conversational dialogs (presented as videos online) that focus on pragmatic functions. Thirty-five 2nd-, 3rd-, and 4th-year learners…

Cost effectiveness of computer tailored and non-tailored smoking cessation letters in general practice: randomised controlled trial

PubMed Central

Lennox, A Scott; Osman, Liesl M; Reiter, Ehud; Robertson, Roma; Friend, James; McCann, Ian; Skatun, Diane; Donnan, Peter T

2001-01-01

Objectives To develop and evaluate, in a primary care setting, a computerised system for generating tailored letters about smoking cessation. Design Randomised controlled trial. Setting Six general practices in Aberdeen, Scotland. Participants 2553 smokers aged 17 to 65. Interventions All participants received a questionnaire asking about their smoking. Participants subsequently received either a computer tailored or a non-tailored, standard letter on smoking cessation, or no letter. Main outcome measures Prevalence of validated abstinence at six months; change in intention to stop smoking in the next six months. Results The validated cessation rate at six months was 3.5% (30/857) (95% confidence interval 2.3% to 4.7%) for the tailored letter group, 4.4% (37/846) (3.0% to 5.8%) for the non-tailored letter group, and 2.6% (22/850) (1.5% to 3.7%) for the control (no letter) group. After adjustment for significant covariates, the cessation rate was 66% greater (−4% to 186%; P=0.07) in the non-tailored letter group than that in the no letter group. Among participants who smoked <20 cigarettes per day, the cessation rate in the non-tailored letter group was 87% greater (0% to 246%; P=0.05) than that in the no letter group. Among heavy smokers who did not quit, a 76% higher rate of positive shift in “stage of change” (intention to quit within a particular period of time) was seen compared with those who received no letter (11% to 180%; P=0.02). The increase in cost for each additional quitter in the non-tailored letter group compared with the no letter group was £89. Conclusions In a large general practice, a brief non-tailored letter effectively increased cessation rates among smokers. A tailored letter was not effective in increasing cessation rates but promoted shift in movement towards cessation (“stage of change”) in heavy smokers. As a pragmatic tool to encourage cessation of smoking, a mass mailing of non-tailored letters from general practices is more

Calibrating well-being, quality of life and common mental disorder items: psychometric epidemiology in public mental health research.

PubMed

Böhnke, Jan R; Croudace, Tim J

2016-08-01

The assessment of 'general health and well-being' in public mental health research stimulates debates around relative merits of questionnaire instruments and their items. Little evidence regarding alignment or differential advantages of instruments or items has appeared to date. Population-based psychometric study of items employed in public mental health narratives. Multidimensional item response theory was applied to General Health Questionnaire (GHQ-12), Warwick-Edinburgh Mental Well-being Scale (WEMWBS) and EQ-5D items (Health Survey for England, 2010-2012; n = 19 290). A bifactor model provided the best account of the data and showed that the GHQ-12 and WEMWBS items assess mainly the same construct. Only one item of the EQ-5D showed relevant overlap with this dimension (anxiety/depression). Findings were corroborated by comparisons with alternative models and cross-validation analyses. The consequences of this lack of differentiation (GHQ-12 v. WEMWBS) for mental health and well-being narratives deserves discussion to enrich debates on priorities in public mental health and its assessment. © The Royal College of Psychiatrists 2015.

The Dysexecutive Questionnaire advanced: item and test score characteristics, 4-factor solution, and severity classification.

PubMed

Bodenburg, Sebastian; Dopslaff, Nina

2008-01-01

The Dysexecutive Questionnaire (DEX, , Behavioral assessment of the dysexecutive syndrome, 1996) is a standardized instrument to measure possible behavioral changes as a result of the dysexecutive syndrome. Although initially intended only as a qualitative instrument, the DEX has also been used increasingly to address quantitative problems. Until now there have not been more fundamental statistical analyses of the questionnaire's testing quality. The present study is based on an unselected sample of 191 patients with acquired brain injury and reports on the data relating to the quality of the items, the reliability and the factorial structure of the DEX. Item 3 displayed too great an item difficulty, whereas item 11 was not sufficiently discriminating. The DEX's reliability in self-rating is r = 0.85. In addition to presenting the statistical values of the tests, a clinical severity classification of the overall scores of the 4 found factors and of the questionnaire as a whole is carried out on the basis of quartile standards.

Pancreatitis Quality of Life Instrument: A Psychometric Evaluation.

PubMed

Wassef, Wahid; DeWitt, John; McGreevy, Kathleen; Wilcox, Mel; Whitcomb, David; Yadav, Dhiraj; Amann, Stephen; Mishra, Girish; Alkaade, Samer; Romagnuolo, Joseph; Stevens, Tyler; Vargo, John; Gardner, Timothy; Singh, Vikesh; Park, Walter; Hartigan, Celia; Barton, Bruce; Bova, Carol

2016-08-01

Chronic pancreatitis is a significant medical problem that impacts a large number of patients worldwide. In 2014, we developed a disease-specific instrument for the evaluation of quality of life in this group of patients: pancreatitis quality of life instrument (PANQOLI). The goal of this study was to evaluate its psychometric properties: its reliability and its construct validity. This is a cross-sectional multi-center study that involved 12 pancreatic disease centers. Patients who met the inclusion/exclusion criteria for chronic pancreatitis were invited to participate. Those who accepted were asked to complete seven questionnaires/instruments. Only patients who completed the PANQOLI were included in the study. Its reliability and its construct validity were tested. A total of 159 patients completed the PANQOLI and were included in the study. They had a mean age of 49.03, 49% were male, and 84% were Caucasian. Six of the 24 items on the scale were removed because of lack of inter-item correlation, redundancy, or lack of correlation to quality of life issues. The final 18-item scale had excellent reliability (Cronbach's alpha coefficient: 0.914) and excellent construct validity with good correlation to generic quality of life instruments (SF-12 and EORTC QLQ-C30/QLQ-PAN26) and lack of correlation to non-quality of life instruments (MAST and DAST). Through exploratory factor analysis, the PANQOLI was found to consist of four subscales: emotional function scale, role function scale, physical function scale, and "self-worth" scale. PANQOLI is the first disease-specific instrument to be developed and validated for the evaluation of quality of life in chronic pancreatitis patients. It has a unique subscale for "self-worth" that differentiates it from other generic instruments. Studies are currently under way to evaluate its use in other populations not included in this study.

The knowledge, efficacy, and practices instrument for oral health providers: a validity study with dental students.

PubMed

Behar-Horenstein, Linda S; Garvan, Cyndi W; Moore, Thomas E; Catalanotto, Frank A

2013-08-01

Valid and reliable instruments to measure and assess cultural competence for oral health care providers are scarce in the literature, and most published scales have been contested due to a lack of item analysis and internal estimates of reliability. The purposes of this study were, first, to develop a standardized instrument to measure dental students' knowledge of diversity, skills in culturally competent patient-centered communication, and use of culture-centered practices in patient care and, second, to provide preliminary validity support for this instrument. The initial instrument used in this study was a thirty-six-item Likert-scale survey entitled the Knowledge, Efficacy, and Practices Instrument for Oral Health Providers (KEPI-OHP). This instrument is an adaption of an initially thirty-three-item version of the Multicultural Awareness, Knowledge, and Skills Scale-Counselor Edition (MAKSS-CE), a scale that assesses factors related to social justice, cultural differences among clients, and cross-cultural client management. After the authors conducted cognitive and expert interviews, focus groups, pilot testing, and item analysis, their initial instrument was reduced to twenty-eight items. The KEPI-OHP was then distributed to 916 dental students (response rate=48.6 percent) across the United States to measure its reliability and assess its validity. Both exploratory and confirmatory factor analyses were conducted to test the scale's validity. The modification of the survey into a sensible instrument with a relatively clear factor structure using factor analysis resulted in twenty items. A scree test suggested three expressive factors, which were retained for rotation. Bentler's comparative fit and Bentler and Bonnett's non-normed indices were 0.95 and 0.92, respectively. A three-factor solution, including efficacy of assessment, knowledge of diversity, and culture-centered practice subscales, comprised of twenty-items was identified. The KEPI-OHP was found to

Comparative analysis of three screening instruments for autism spectrum disorder in toddlers at high risk.

PubMed

Oosterling, Iris J; Swinkels, Sophie H; van der Gaag, Rutger Jan; Visser, Janne C; Dietz, Claudine; Buitelaar, Jan K

2009-06-01

Several instruments have been developed to screen for autism spectrum disorders (ASD) in high-risk populations. However, few studies compare different instruments in one sample. Data were gathered from the Early Screening of Autistic Traits Questionnaire, Social Communication Questionnaire, Communication and Symbolic Behavior Scales-Developmental Profile, Infant-Toddler Checklist and key items of the Checklist for Autism in Toddlers in 238 children (mean age = 29.6 months, SD = 6.4) at risk for ASD. Discriminative properties are compared in the whole sample and in two age groups separately (8-24 months and 25-44 months). No instrument or individual item shows satisfying power in discriminating ASD from non-ASD, but pros and cons of instruments and items are discussed and directions for future research are proposed.

A hospital-based child protection programme evaluation instrument: a modified Delphi study.

PubMed

Wilson, Denise; Koziol-McLain, Jane; Garrett, Nick; Sharma, Pritika

2010-08-01

Refine instrument for auditing hospital-based child abuse and neglect violence intervention programmes prior to field-testing. A modified Delphi study to identify and rate items and domains indicative of an effective and quality child abuse and neglect intervention programme. Experts participated in four Delphi rounds: two surveys, a one-day workshop and the opportunity to comment on the penultimate instrument. New Zealand. Twenty-four experts in the field of care and protection of children. Items with panel agreement >or=85% and mean importance rating >or=4.0 (scale from 1 (not important) to 5 (very important)). There was high-level consensus on items across Rounds 1 and 2 (89% and 85%, respectively). In Round 3 an additional domain (safety and security) was agreed upon and cultural issues, alert systems for children at risk, and collaboration among primary care, community, non-government and government agencies were discussed. The final instrument included nine domains ('policies and procedures', 'safety and security', 'collaboration', 'cultural environment', 'training of providers', 'intervention services', 'documentation' 'evaluation' and 'physical environment') and 64 items. The refined instrument represents the hallmarks of an ideal child abuse and neglect programme given current knowledge and experience. The instrument enables rigorous evaluations of hospital-based child abuse and neglect intervention programmes for quality improvement and benchmarking with other programmes.

Psychometric validation of the Persian nine-item Internet Gaming Disorder Scale - Short Form: Does gender and hours spent online gaming affect the interpretations of item descriptions?

PubMed

Wu, Tzu-Yi; Lin, Chung-Ying; Årestedt, Kristofer; Griffiths, Mark D; Broström, Anders; Pakpour, Amir H

2017-06-01

Background and aims The nine-item Internet Gaming Disorder Scale - Short Form (IGDS-SF9) is brief and effective to evaluate Internet Gaming Disorder (IGD) severity. Although its scores show promising psychometric properties, less is known about whether different groups of gamers interpret the items similarly. This study aimed to verify the construct validity of the Persian IGDS-SF9 and examine the scores in relation to gender and hours spent online gaming among 2,363 Iranian adolescents. Methods Confirmatory factor analysis (CFA) and Rasch analysis were used to examine the construct validity of the IGDS-SF9. The effects of gender and time spent online gaming per week were investigated by multigroup CFA and Rasch differential item functioning (DIF). Results The unidimensionality of the IGDS-SF9 was supported in both CFA and Rasch. However, Item 4 (fail to control or cease gaming activities) displayed DIF (DIF contrast = 0.55) slightly over the recommended cutoff in Rasch but was invariant in multigroup CFA across gender. Items 4 (DIF contrast = -0.67) and 9 (jeopardize or lose an important thing because of gaming activity; DIF contrast = 0.61) displayed DIF in Rasch and were non-invariant in multigroup CFA across time spent online gaming. Conclusions Given the Persian IGDS-SF9 was unidimensional, it is concluded that the instrument can be used to assess IGD severity. However, users of the instrument are cautioned concerning the comparisons of the sum scores of the IGDS-SF9 across gender and across adolescents spending different amounts of time online gaming.

Development and testing of item response theory-based item banks and short forms for eye, skin and lung problems in sarcoidosis.

PubMed

Victorson, David E; Choi, Seung; Judson, Marc A; Cella, David

2014-05-01

Sarcoidosis is a multisystem disease that can negatively impact health-related quality of life (HRQL) across generic (e.g., physical, social and emotional wellbeing) and disease-specific (e.g., pulmonary, ocular, dermatologic) domains. Measurement of HRQL in sarcoidosis has largely relied on generic patient-reported outcome tools, with little disease-specific measures available. The purpose of this paper is to present the development and testing of disease-specific item banks and short forms of lung, skin and eye problems, which are a part of a new patient-reported outcome (PRO) instrument called the sarcoidosis assessment tool. After prioritizing and selecting the most important disease-specific domains, we wrote new items to reflect disease-specific problems by drawing from patient focus group and clinician expert survey data that were used to create our conceptual model of HRQL in sarcoidosis. Item pools underwent cognitive interviews by sarcoidosis patients (n = 13), and minor modifications were made. These items were administered in a multi-site study (n = 300) to obtain item calibrations and create calibrated short forms using item response theory (IRT) approaches. From the available item pools, we created four new item banks and short forms: (1) skin problems, (2) skin stigma, (3) lung problems, and (4) eye Problems. We also created and tested supplemental forms of the most common constitutional symptoms and negative effects of corticosteroids. Several new sarcoidosis-specific PROs were developed and tested using IRT approaches. These new measures can advance more precise and targeted HRQL assessment in sarcoidosis clinical trials and clinical practice.

The Student Actions Coding Sheet (SACS): An instrument for illuminating the shifts toward student-centered science classrooms

NASA Astrophysics Data System (ADS)

Erdogan, Ibrahim; Campbell, Todd; Hashidah Abd-Hamid, Nor

2011-07-01

This study describes the development of an instrument to investigate the extent to which student-centered actions are occurring in science classrooms. The instrument was developed through the following five stages: (1) student action identification, (2) use of both national and international content experts to establish content validity, (3) refinement of the item pool based on reviewer comments, (4) pilot testing of the instrument, and (5) statistical reliability and item analysis leading to additional refinement and finalization of the instrument. In the field test, the instrument consisted of 26 items separated into four categories originally derived from student-centered instruction literature and used by the authors to sort student actions in previous research. The SACS was administered across 22 Grade 6-8 classrooms by 22 groups of observers, with a total of 67 SACS ratings completed. The finalized instrument was found to be internally consistent, with acceptable estimates from inter-rater intraclass correlation reliability coefficients at the p < 0.01 level. After the final stage of development, the SACS instrument consisted of 24 items separated into three categories, which aligned with the factor analysis clustering of the items. Additionally, concurrent validity of the SACS was established with the Reformed Teaching Observation Protocol. Based on the analyses completed, the SACS appears to be a useful instrument for inclusion in comprehensive assessment packages for illuminating the extent to which student-centered actions are occurring in science classrooms.

Development of an instrument to measure medical students' perceptions of the assessment environment: initial validation.

PubMed

Sim, Joong Hiong; Tong, Wen Ting; Hong, Wei-Han; Vadivelu, Jamuna; Hassan, Hamimah

2015-01-01

Assessment environment, synonymous with climate or atmosphere, is multifaceted. Although there are valid and reliable instruments for measuring the educational environment, there is no validated instrument for measuring the assessment environment in medical programs. This study aimed to develop an instrument for measuring students' perceptions of the assessment environment in an undergraduate medical program and to examine the psychometric properties of the new instrument. The Assessment Environment Questionnaire (AEQ), a 40-item, four-point (1=Strongly Disagree to 4=Strongly Agree) Likert scale instrument designed by the authors, was administered to medical undergraduates from the authors' institution. The response rate was 626/794 (78.84%). To establish construct validity, exploratory factor analysis (EFA) with principal component analysis and varimax rotation was conducted. To examine the internal consistency reliability of the instrument, Cronbach's α was computed. Mean scores for the entire AEQ and for each factor/subscale were calculated. Mean AEQ scores of students from different academic years and sex were examined. Six hundred and eleven completed questionnaires were analysed. EFA extracted four factors: feedback mechanism (seven items), learning and performance (five items), information on assessment (five items), and assessment system/procedure (three items), which together explained 56.72% of the variance. Based on the four extracted factors/subscales, the AEQ was reduced to 20 items. Cronbach's α for the 20-item AEQ was 0.89, whereas Cronbach's α for the four factors/subscales ranged from 0.71 to 0.87. Mean score for the AEQ was 2.68/4.00. The factor/subscale of 'feedback mechanism' recorded the lowest mean (2.39/4.00), whereas the factor/subscale of 'assessment system/procedure' scored the highest mean (2.92/4.00). Significant differences were found among the AEQ scores of students from different academic years. The AEQ is a valid and reliable

An Item Gains and Losses Analysis of False Memories Suggests Critical Items Receive More Item-Specific Processing than List Items

ERIC Educational Resources Information Center

Burns, Daniel J.; Martens, Nicholas J.; Bertoni, Alicia A.; Sweeney, Emily J.; Lividini, Michelle D.

2006-01-01

In a repeated testing paradigm, list items receiving item-specific processing are more likely to be recovered across successive tests (item gains), whereas items receiving relational processing are likely to be forgotten progressively less on successive tests. Moreover, analysis of cumulative-recall curves has shown that item-specific processing…

NBC Contamination Survivability, Large Item Exteriors

DTIC Science & Technology

1998-04-17

environment. Ability to control temperature , relative humidity (RH), and wind speed is required. The facility must be designed to ensure safe and...2.2 Instrumentation. Measuring Devices Permissible Error of Measurement Air temperature ±0.5°C Relative humidity (RH) ±5 % Wind speed ±0.1 rm/sec Still...process, excluding monitoring, should last no longer than 75 minutes. (3) The item surface temperature is 30’C and exterior wind speed is no greater

An instrument for broadened risk assessment in antenatal health care including non-medical issues

PubMed Central

Vos, Amber A.; van Veen, Mieke J.; Birnie, Erwin; Denktaş, Semiha; Steegers, Eric A.P.; Bonsel, Gouke J.

2015-01-01

Introduction Growing evidence on the risk contributing role of non-medical factors on pregnancy outcomes urged for a new approach in early antenatal risk selection. The evidence invites to more integration, in particular between the clinical working area and the public health domain. We developed a non-invasive, standardized instrument for comprehensive antenatal risk assessment. The current study presents the application-oriented development of a risk screening instrument for early antenatal detection of risk factors and tailored prevention in an integrated care setting. Methods A review of published instruments complemented with evidence from cohort studies. Selection and standardization of risk factors associated with small for gestational age, preterm birth, congenital anomalies and perinatal mortality. Risk factors were weighted to obtain a cumulative risk score. Responses were then connected to corresponding care pathways. A cumulative risk threshold was defined, which can be adapted to the population and the availability of preventive facilities. A score above the threshold implies multidisciplinary consultation between caregivers. Results The resulting digital score card consisted of 70 items, subdivided into four non-medical and two medical domains. Weighing of risk factors was based on existing evidence. Pilot-evidence from a cohort of 218 pregnancies in a multi-practice urban setting showed a cut-off of 16 points would imply 20% of all pregnant women to be assessed in a multidisciplinary setting. A total of 28 care pathways were defined. Conclusion The resulting score card is a universal risk screening instrument which incorporates recent evidence on non-medical risk factors for adverse pregnancy outcomes and enables systematic risk management in an integrated antenatal health care setting. PMID:25780351

An evaluation of computerized adaptive testing for general psychological distress: combining GHQ-12 and Affectometer-2 in an item bank for public mental health research.

PubMed

Stochl, Jan; Böhnke, Jan R; Pickett, Kate E; Croudace, Tim J

2016-05-20

Recent developments in psychometric modeling and technology allow pooling well-validated items from existing instruments into larger item banks and their deployment through methods of computerized adaptive testing (CAT). Use of item response theory-based bifactor methods and integrative data analysis overcomes barriers in cross-instrument comparison. This paper presents the joint calibration of an item bank for researchers keen to investigate population variations in general psychological distress (GPD). Multidimensional item response theory was used on existing health survey data from the Scottish Health Education Population Survey (n = 766) to calibrate an item bank consisting of pooled items from the short common mental disorder screen (GHQ-12) and the Affectometer-2 (a measure of "general happiness"). Computer simulation was used to evaluate usefulness and efficacy of its adaptive administration. A bifactor model capturing variation across a continuum of population distress (while controlling for artefacts due to item wording) was supported. The numbers of items for different required reliabilities in adaptive administration demonstrated promising efficacy of the proposed item bank. Psychometric modeling of the common dimension captured by more than one instrument offers the potential of adaptive testing for GPD using individually sequenced combinations of existing survey items. The potential for linking other item sets with alternative candidate measures of positive mental health is discussed since an optimal item bank may require even more items than these.

Item Difficulty Modeling of Paragraph Comprehension Items

ERIC Educational Resources Information Center

Gorin, Joanna S.; Embretson, Susan E.

2006-01-01

Recent assessment research joining cognitive psychology and psychometric theory has introduced a new technology, item generation. In algorithmic item generation, items are systematically created based on specific combinations of features that underlie the processing required to correctly solve a problem. Reading comprehension items have been more…

The PROMIS Physical Function item bank was calibrated to a standardized metric and shown to improve measurement efficiency.

PubMed

Rose, Matthias; Bjorner, Jakob B; Gandek, Barbara; Bruce, Bonnie; Fries, James F; Ware, John E

2014-05-01

To document the development and psychometric evaluation of the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) item bank and static instruments. The items were evaluated using qualitative and quantitative methods. A total of 16,065 adults answered item subsets (n>2,200/item) on the Internet, with oversampling of the chronically ill. Classical test and item response theory methods were used to evaluate 149 PROMIS PF items plus 10 Short Form-36 and 20 Health Assessment Questionnaire-Disability Index items. A graded response model was used to estimate item parameters, which were normed to a mean of 50 (standard deviation [SD]=10) in a US general population sample. The final bank consists of 124 PROMIS items covering upper, central, and lower extremity functions and instrumental activities of daily living. In simulations, a 10-item computerized adaptive test (CAT) eliminated floor and decreased ceiling effects, achieving higher measurement precision than any comparable length static tool across four SDs of the measurement range. Improved psychometric properties were transferred to the CAT's superior ability to identify differences between age and disease groups. The item bank provides a common metric and can improve the measurement of PF by facilitating the standardization of patient-reported outcome measures and implementation of CATs for more efficient PF assessments over a larger range. Copyright © 2014. Published by Elsevier Inc.

Developing an item bank and short forms that assess the impact of asthma on quality of life.

PubMed

Stucky, Brian D; Edelen, Maria Orlando; Sherbourne, Cathy D; Eberhart, Nicole K; Lara, Marielena

2014-02-01

The present work describes the process of developing an item bank and short forms that measure the impact of asthma on quality of life (QoL) that avoids confounding QoL with asthma symptomatology and functional impairment. Using a diverse national sample of adults with asthma (N = 2032) we conducted exploratory and confirmatory factor analyses, and item response theory and differential item functioning analyses to develop a 65-item unidimensional item bank and separate short form assessments. A psychometric evaluation of the RAND Impact of Asthma on QoL item bank (RAND-IAQL) suggests that though the concept of asthma impact on QoL is multi-faceted, it may be measured as a single underlying construct. The performance of the bank was then evaluated with a real-data simulated computer adaptive test. From the RAND-IAQL item bank we then developed two short forms consisting of 4 and 12 items (reliability = 0.86 and 0.93, respectively). A real-data simulated computer adaptive test suggests that as few as 4-5 items from the bank are needed to obtain highly precise scores. Preliminary validity results indicate that the RAND-IAQL measures distinguish between levels of asthma control. To measure the impact of asthma on QoL, users of these items may choose from two highly reliable short forms, computer adaptive test administration, or content-specific subsets of items from the bank tailored to their specific needs. Copyright © 2013 Elsevier Ltd. All rights reserved.

Employee Perceptions of Workplace Health Promotion Programs: Comparison of a Tailored, Semi-Tailored, and Standardized Approach.

PubMed

Street, Tamara D; Lacey, Sarah J

2018-04-28

In the design of workplace health promotion programs (WHPPs), employee perceptions represent an integral variable which is predicted to translate into rate of user engagement (i.e., participation) and program loyalty. This study evaluated employee perceptions of three workplace health programs promoting nutritional consumption and physical activity. Programs included: (1) an individually tailored consultation with an exercise physiologist and dietitian; (2) a semi-tailored 12-week SMS health message program; and (3) a standardized group workshop delivered by an expert. Participating employees from a transport company completed program evaluation surveys rating the overall program, affect, and utility of: consultations ( n = 19); SMS program ( n = 234); and workshops ( n = 86). Overall, participants’ affect and utility evaluations were positive for all programs, with the greatest satisfaction being reported in the tailored individual consultation and standardized group workshop conditions. Furthermore, mode of delivery and the physical presence of an expert health practitioner was more influential than the degree to which the information was tailored to the individual. Thus, the synergy in ratings between individually tailored consultations and standardized group workshops indicates that low-cost delivery health programs may be as appealing to employees as tailored, and comparatively high-cost, program options.

Evaluation of Item Candidates: The PROMIS Qualitative Item Review

PubMed Central

DeWalt, Darren A.; Rothrock, Nan; Yount, Susan; Stone, Arthur A.

2009-01-01

One of the PROMIS (Patient-Reported Outcome Measurement Information System) network's primary goals is the development of a comprehensive item bank for patient-reported outcomes of chronic diseases. For its first set of item banks, PROMIS chose to focus on pain, fatigue, emotional distress, physical function, and social function. An essential step for the development of an item pool is the identification, evaluation, and revision of extant questionnaire items for the core item pool. In this work, we also describe the systematic process wherein items are classified for subsequent statistical processing by the PROMIS investigators. Six phases of item development are documented: identification of extant items, item classification and selection, item review and revision, focus group input on domain coverage, cognitive interviews with individual items, and final revision before field testing. Identification of items refers to the systematic search for existing items in currently available scales. Expert item review and revision was conducted by trained professionals who reviewed the wording of each item and revised as appropriate for conventions adopted by the PROMIS network. Focus groups were used to confirm domain definitions and to identify new areas of item development for future PROMIS item banks. Cognitive interviews were used to examine individual items. Items successfully screened through this process were sent to field testing and will be subjected to innovative scale construction procedures. PMID:17443114

The Spanish version of the Self-Determination Inventory Student Report: application of item response theory to self-determination measurement.

PubMed

Mumbardó-Adam, C; Guàrdia-Olmos, J; Giné, C; Raley, S K; Shogren, K A

2018-04-01

A new measure of self-determination, the Self-Determination Inventory: Student Report (Spanish version), has recently been adapted and empirically validated in Spanish language. As it is the first instrument intended to measure self-determination in youth with and without disabilities, there is a need to further explore and strengthen its psychometric analysis based on item response patterns. Through item response theory approach, this study examined item observed distributions across the essential characteristics of self-determination. The results demonstrated satisfactory to excellent item functioning patterns across characteristics, particularly within agentic action domains. Increased variability across items was also found within action-control beliefs dimensions, specifically within the self-realisation subdomain. These findings further support the instrument's psychometric properties and outline future research directions. © 2017 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Validation of 5-item and 2-item questionnaires in Chinese version of Dizziness Handicap Inventory for screening objective benign paroxysmal positional vertigo.

PubMed

Chen, Wei; Shu, Liang; Wang, Qian; Pan, Hui; Wu, Jing; Fang, Jie; Sun, Xu-Hong; Zhai, Yu; Dong, You-Rong; Liu, Jian-Ren

2016-08-01

As possible candidate screening instruments for benign paroxysmal positional vertigo (BPPV), studies to validate the Dizziness Handicap Inventory (DHI) sub-scale (5-item and 2-item) and total scores are rare in China. From May 2014 to December 2014, 108(55 with and 53 without BPPV) patients complaining of episodic vertigo in the past week from a vertigo outpatient clinic were enrolled for DHI evaluation, as well as demographic and other clinical data. Objective BPPV was subsequently determined by positional evoking maneuvers under the record of optical Frenzel glasses. Cronbach's coefficient α was used to evaluate the reliability of psychometric scales. The validity of DHI total, 5-item and 2-item questionnaires to screen for BPPV was assessed by receiver operating characteristic (ROC) curves. It revealed that the DHI 5-item questionnaire had good internal consistency (Cronbach's coefficient α = 0.72). Area under the curve of total DHI, 5-item and 2-item scores for discriminating BPPV from those without was 0.678 (95 % CI 0.578-0.778), 0.873(95 % CI 0.807-0.940) and 0.895(95 % CI 0.836-0.953), respectively. It revealed 74.5 % sensitivity and 88.7 % specificity in separating BPPV and those without, with a cutoff value of 12 in the 5-item questionnaire. The corresponding rate of sensitivity and specificity was 78.2 and 88.7 %, respectively, with a cutoff value of 6 in 2-item questionnaire. The present study indicated that both 5-item and 2-item questionnaires in the Chinese version of DHI may be more valid than DHI total score for screening objective BPPV and merit further application in clinical practice in China.

Measuring everyday functional competence using the Rasch assessment of everyday activity limitations (REAL) item bank.

PubMed

Oude Voshaar, Martijn A H; Ten Klooster, Peter M; Vonkeman, Harald E; van de Laar, Mart A F J

2017-11-01

Traditional patient-reported physical function instruments often poorly differentiate patients with mild-to-moderate disability. We describe the development and psychometric evaluation of a generic item bank for measuring everyday activity limitations in outpatient populations. Seventy-two items generated from patient interviews and mapped to the International Classification of Functioning, Disability and Health (ICF) domestic life chapter were administered to 1128 adults representative of the Dutch population. The partial credit model was fitted to the item responses and evaluated with respect to its assumptions, model fit, and differential item functioning (DIF). Measurement performance of a computerized adaptive testing (CAT) algorithm was compared with the SF-36 physical functioning scale (PF-10). A final bank of 41 items was developed. All items demonstrated acceptable fit to the partial credit model and measurement invariance across age, sex, and educational level. Five- and ten-item CAT simulations were shown to have high measurement precision, which exceeded that of SF-36 physical functioning scale across the physical function continuum. Floor effects were absent for a 10-item empirical CAT simulation, and ceiling effects were low (13.5%) compared with SF-36 physical functioning (38.1%). CAT also discriminated better than SF-36 physical functioning between age groups, number of chronic conditions, and respondents with or without rheumatic conditions. The Rasch assessment of everyday activity limitations (REAL) item bank will hopefully prove a useful instrument for assessing everyday activity limitations. T-scores obtained using derived measures can be used to benchmark physical function outcomes against the general Dutch adult population.

An instrument to assess the statistical intensity of medical research papers.

PubMed

Nieminen, Pentti; Virtanen, Jorma I; Vähänikkilä, Hannu

2017-01-01

There is widespread evidence that statistical methods play an important role in original research articles, especially in medical research. The evaluation of statistical methods and reporting in journals suffers from a lack of standardized methods for assessing the use of statistics. The objective of this study was to develop and evaluate an instrument to assess the statistical intensity in research articles in a standardized way. A checklist-type measure scale was developed by selecting and refining items from previous reports about the statistical contents of medical journal articles and from published guidelines for statistical reporting. A total of 840 original medical research articles that were published between 2007-2015 in 16 journals were evaluated to test the scoring instrument. The total sum of all items was used to assess the intensity between sub-fields and journals. Inter-rater agreement was examined using a random sample of 40 articles. Four raters read and evaluated the selected articles using the developed instrument. The scale consisted of 66 items. The total summary score adequately discriminated between research articles according to their study design characteristics. The new instrument could also discriminate between journals according to their statistical intensity. The inter-observer agreement measured by the ICC was 0.88 between all four raters. Individual item analysis showed very high agreement between the rater pairs, the percentage agreement ranged from 91.7% to 95.2%. A reliable and applicable instrument for evaluating the statistical intensity in research papers was developed. It is a helpful tool for comparing the statistical intensity between sub-fields and journals. The novel instrument may be applied in manuscript peer review to identify papers in need of additional statistical review.

Development of an instrument designed to measure employees' perceptions of workplace breastfeeding support.

PubMed

Greene, Sally W; Olson, Beth H

2008-09-01

Breastfeeding rates remain low in the United States, especially among working women. Unfortunately, no quantitative instrument exists to facilitate the examination of why women who return to work discontinue breastfeeding sooner than the general population. The objective of this study was to develop an instrument to measure female employees' perceptions of breastfeeding support in the workplace, which would be suitable for piloting with the target population. Examination of the literature, reviews with experts, and one-on-one interviews with women who had experience combining breastfeeding and work were used to create the instrument subscales and items. Examination of the literature was used to develop four subscales: company policies/work culture, manager support, co-worker support, and workflow. Expert review resulted in the addition of a fifth subscale, the physical environment of the breastfeeding space. One-on-one interviews were used to ensure that the item wording was appropriate for the target population. Eighteen items were added, and 15 were reworded based on comments from the expert review and from the interviews. The resulting survey contained 54 items that required either categorical yes/no or Likert scale responses. Results from this process indicate the survey subscales and items adequately reflect women's perceptions of breastfeeding support in the workplace and the instrument is appropriate for piloting with new mother employees.

Development of a PROMIS item bank to measure pain interference.

PubMed

Amtmann, Dagmar; Cook, Karon F; Jensen, Mark P; Chen, Wen-Hung; Choi, Seung; Revicki, Dennis; Cella, David; Rothrock, Nan; Keefe, Francis; Callahan, Leigh; Lai, Jin-Shei

2010-07-01

This paper describes the psychometric properties of the PROMIS-pain interference (PROMIS-PI) bank. An initial candidate item pool (n=644) was developed and evaluated based on the review of existing instruments, interviews with patients, and consultation with pain experts. From this pool, a candidate item bank of 56 items was selected and responses to the items were collected from large community and clinical samples. A total of 14,848 participants responded to all or a subset of candidate items. The responses were calibrated using an item response theory (IRT) model. A final 41-item bank was evaluated with respect to IRT assumptions, model fit, differential item function (DIF), precision, and construct and concurrent validity. Items of the revised bank had good fit to the IRT model (CFI and NNFI/TLI ranged from 0.974 to 0.997), and the data were strongly unidimensional (e.g., ratio of first and second eigenvalue=35). Nine items exhibited statistically significant DIF. However, adjusting for DIF had little practical impact on score estimates and the items were retained without modifying scoring. Scores provided substantial information across levels of pain; for scores in the T-score range 50-80, the reliability was equivalent to 0.96-0.99. Patterns of correlations with other health outcomes supported the construct validity of the item bank. The scores discriminated among persons with different numbers of chronic conditions, disabling conditions, levels of self-reported health, and pain intensity (p<0.0001). The results indicated that the PROMIS-PI items constitute a psychometrically sound bank. Computerized adaptive testing and short forms are available. Copyright 2010 International Association for the Study of Pain. All rights reserved.

Tailored program evaluation: Past, present, future.

PubMed

Suggs, L Suzanne; Cowdery, Joan E; Carroll, Jennifer B

2006-11-01

This paper discusses measurement issues related to the evaluation of computer-tailored health behavior change programs. As the first generation of commercially available tailored products is utilized in health promotion programming, programmers and researchers are becoming aware of the unique challenges that the evaluation of these programs presents. A project is presented that used an online tailored health behavior assessment (HBA) in a worksite setting. Process and outcome evaluation methods are described and include the challenges faced, and strategies proposed and implemented, for meeting them. Implications for future research in tailored program development, implementation, and evaluation are also discussed.

Assessing whether parents and children perceive the meaning of the items in the PedsQLTM 4.0 quality of life instrument consistently: a differential item functioning analysis.

PubMed

Jafari, Peyman; Bagheri, Zahra; Hashemi, Seyyedeh Zahra; Shalileh, Keivan

2013-06-06

Limited studies have examined the effect of differential item functioning (DIF) on comparing health related quality of life (HRQoL) scores across child self-reports and parent proxy-reports. This study aims to determine whether parents and children respond differently to the items in the Persian version of the PedsQoLTM 4.0 measure. The PedsQLTM 4.0 Generic Core Scales was completed by 938 child-parent dyads. The graded response model (GRM) was used to detect DIF between parents and children. The IRT analyses were conducted using IRTPRO 2.1.On the whole, our findings showed that 50% (4 out of 8) of the items in the physical subscale and 40% (2 out of 5) in both emotional and school subscales were flagged with DIF. Among the DIF items, 62.5% (5 out of 8) were uniform and the remaining 37.5% (3 out of 8) were non-uniform. Parents and children interpret certain items of the PedsQLTM 4.0 in a different ways, except for the social subscale. Hence, we should be cautious about using parent proxy-report as a substitute for a child's ratings.

Item Structural Properties as Predictors of Item Difficulty and Item Association.

ERIC Educational Resources Information Center

Solano-Flores, Guillermo

1993-01-01

Studied the ability of logical test design (LTD) to predict student performance in reading Roman numerals for 211 sixth graders in Mexico City tested on Roman numeral items varying on LTD-related and non-LTD-related variables. The LTD-related variable item iterativity was found to be the best predictor of item difficulty. (SLD)

On Using Simulations to Inform Decision Making during Instrument Development

ERIC Educational Resources Information Center

Morgan, Grant B.; Moore, Courtney A.; Floyd, Harlee S.

2018-01-01

Although content validity--how well each item of an instrument represents the construct being measured--is foundational in the development of an instrument, statistical validity is also important to the decisions that are made based on the instrument. The primary purpose of this study is to demonstrate how simulation studies can be used to assist…

Content Validity of Patient-Reported Outcome Instruments used with Pediatric Patients with Facial Differences: A Systematic Review.

PubMed

Wickert, Natasha M; Wong Riff, Karen W Y; Mansour, Mark; Forrest, Christopher R; Goodacre, Timothy E E; Pusic, Andrea L; Klassen, Anne F

2018-01-01

Objective The aim of this systematic review was to identify patient-reported outcome (PRO) instruments used in research with children/youth with conditions associated with facial differences to identify the health concepts measured. Design MEDLINE, EMBASE, CINAHL, and PsycINFO were searched from 2004 to 2016 to identify PRO instruments used in acne vulgaris, birthmarks, burns, ear anomalies, facial asymmetries, and facial paralysis patients. We performed a content analysis whereby the items were coded to identify concepts and categorized as positive or negative content or phrasing. Results A total of 7,835 articles were screened; 6 generic and 11 condition-specific PRO instruments were used in 96 publications. Condition-specific instruments were for acne (four), oral health (two), dermatology (one), facial asymmetries (two), microtia (one), and burns (one). The PRO instruments provided 554 items (295 generic; 259 condition specific) that were sorted into 4 domains, 11 subdomains, and 91 health concepts. The most common domain was psychological (n = 224 items). Of the identified items, 76% had negative content or phrasing (e.g., "Because of the way my face looks I wish I had never been born"). Given the small number of items measuring facial appearance (n = 19) and function (n = 22), the PRO instruments reviewed lacked content validity for patients whose condition impacted facial function and/or appearance. Conclusions Treatments can change facial appearance and function. This review draws attention to a problem with content validity in existing PRO instruments. Our team is now developing a new PRO instrument called FACE-Q Kids to address this problem.

Psychometric evaluation of a new instrument in Spanish to measure the wellness of university nursing faculty.

PubMed

Hurtado-Pardos, Barbara; Casas, Irma; Lluch-Canut, Teresa; Moreno-Arroyo, Carmen; Nebot-Bergua, Carlos; Roldán-Merino, Juan

2018-01-02

The aim of this study was to design and validate an instrument to measure the wellness among university nursing faculty. The study was performed in two phases. Phase I consisted of the development of the instrument with discussion groups and participant consensus. We designed an instrument including the 21 items or psychosocial risk factors identified and estimated an index by evaluating the frequency and intensity of each item. The items were grouped into 3 dimensions: teaching work demands, curricular demands, and organizational difficulties. Phase II, we evaluated the psychometric properties of the tool in a sample of 263 participants. Exploratory factor analysis showed a 3-factor structure that explained 53% of the total variance. The internal consistency of the instrument was 0.91 for the whole instrument. The results indicate that the tool developed is valid and reliable and may be a good instrument to monitor the wellness of university nursing faculty.

Employee Perceptions of Workplace Health Promotion Programs: Comparison of a Tailored, Semi-Tailored, and Standardized Approach

PubMed Central

Street, Tamara D.; Lacey, Sarah J.

2018-01-01

In the design of workplace health promotion programs (WHPPs), employee perceptions represent an integral variable which is predicted to translate into rate of user engagement (i.e., participation) and program loyalty. This study evaluated employee perceptions of three workplace health programs promoting nutritional consumption and physical activity. Programs included: (1) an individually tailored consultation with an exercise physiologist and dietitian; (2) a semi-tailored 12-week SMS health message program; and (3) a standardized group workshop delivered by an expert. Participating employees from a transport company completed program evaluation surveys rating the overall program, affect, and utility of: consultations (n = 19); SMS program (n = 234); and workshops (n = 86). Overall, participants’ affect and utility evaluations were positive for all programs, with the greatest satisfaction being reported in the tailored individual consultation and standardized group workshop conditions. Furthermore, mode of delivery and the physical presence of an expert health practitioner was more influential than the degree to which the information was tailored to the individual. Thus, the synergy in ratings between individually tailored consultations and standardized group workshops indicates that low-cost delivery health programs may be as appealing to employees as tailored, and comparatively high-cost, program options. PMID:29710785

Instrument Psychometrics: Parental Satisfaction and Quality Indicators of Perinatal Palliative Care.

PubMed

Wool, Charlotte

2015-10-01

Despite a life-limiting fetal diagnosis, prenatal attachment often occurs in varying degrees resulting in role identification by an individual as a parent. Parents recognize quality care and report their satisfaction when interfacing with health care providers. The aim was to test an instrument measuring parental satisfaction and quality indicators with parents electing to continue a pregnancy after learning of a life-limiting fetal diagnosis. A cross sectional survey design gathered data using a computer-mediated platform. Subjects were parents (n=405) who opted to continue a pregnancy affected by a life-limiting diagnosis. Factor analysis using principal component analysis with Varimax rotation was used to validate the instrument, evaluate components, and summarize the explained variance achieved among quality indicator items. The Prenatal Scale was reduced to 37 items with a three-component solution explaining 66.19% of the variance and internal consistency reliability of 0.98. The Intrapartum Scale included 37 items with a four-component solution explaining 66.93% of the variance and a Cronbach α of 0.977. The Postnatal Scale was reduced to 44 items with a six-component solution explaining 67.48% of the variance. Internal consistency reliability was 0.975. The Parental Satisfaction and Quality Indicators of Perinatal Palliative Care Instrument is a valid and reliable measure for parent-reported quality care and satisfaction. Use of this instrument will enable clinicians and researchers to measure quality indicators and parental satisfaction. The instrument is useful for assessing, analyzing, and reporting data on quality for care delivered during the prenatal, intrapartum, and postnatal periods.

Toward Establishing the Validity of the Resource Interpreter's Self-Efficacy Instrument

NASA Astrophysics Data System (ADS)

Smith, Grant D.

Interpretive rangers serve as one of the major educational resources that visitors may encounter during their visit to a park or other natural area, yet our understanding of their professional growth remains limited. This study helps address this issue by developing an instrument that evaluates the beliefs of resource interpreters regarding their capabilities of communicating with the public. The resulting 11-item instrument was built around the construct of Albert Bandura's self-efficacy theory (Bandura, 1977, 1986, 1997), used guidelines and principles developed over the course of 30 years of teacher efficacy studies (Bandura, 2006; Gibson & Dembo, 1984; Riggs & Enochs, 1990; Tschannen-Moran & Hoy, 2001; Tschannen-Moran, Hoy, & Hoy, 1998), and probed areas of challenge that are unique to the demands of resource interpretation (Brochu & Merriman, 2002; Ham, 1992; Knudson, Cable, & Beck, 2003; Larsen, 2003; Tilden, 1977). A voluntary convenience sample of 364 National Park Service rangers was collected in order to conduct the statistical analyses needed to winnow the draft instrument down from 47 items in its original form to 11 items in its final state. Statistical analyses used in this process included item-total correlation, index of discrimination, exploratory factor analysis, and confirmatory factor analysis.

Development of the Tailored Rett Intervention and Assessment Longitudinal (TRIAL) database and the Rett Evaluation of Symptoms and Treatments (REST) Questionnaire.

PubMed

Santosh, Paramala; Lievesley, Kate; Fiori, Federico; Singh, Jatinder

2017-06-21

Rett syndrome (RTT) is a pervasive neurodevelopmental disorder that presents with deficits in brain functioning leading to language and learning regression, characteristic hand stereotypies and developmental delay. Different mutations in the gene implicated in RTT- methyl-CpG-binding protein 2 ( MECP2 ) establishes RTT as a disorder with divergent symptomatology ranging from individuals with severe to milder phenotypes. A reliable and single multidimensional questionnaire is needed that can embrace all symptoms, and the relationships between them, and can map clinically meaningful data to symptomatology across the lifespan in patients with RTT. As part of the HealthTracker-based Tailored Rett Intervention and Assessment Longitudinal (TRIAL) database, the Rett Evaluation of Symptoms and Treatments (REST) Questionnaire will be able to marry with the physiological aspects of the disease obtained using wearable sensor technology, along with genetic and psychosocial data to stratify patients. Taken together, the web-based TRIAL database will empower clinicians and researchers with the confidence to delineate between different aspects of disorder symptomatology to streamline care pathways for individuals or for those patients entering clinical trials. This protocol describes the anticipated development of the REST questionnaire and the TRIAL database which links with the outcomes of the wearable sensor technology, and will serve as a barometer for longitudinal patient monitoring in patients with RTT. The US Food and Drug Administration Guidance for Patient-Reported Outcome Measures will be used as a template to inform the methodology of the study. It will follow an iterative framework that will include item/concept identification, item/concept elicitation in parent/carer-mediated focus groups, expert clinician feedback, web-based presentation of questionnaires, initial scale development, instrument refinement and instrument validation. The study has received favourable

Diagnostics of transparent polymer coatings of metal items

NASA Astrophysics Data System (ADS)

Varepo, L. G.; Ermakova, I. N.; Nagornova, I. V.; Kondratov, A. P.

2017-08-01

The methods of visual and instrumental express diagnostics of safety critical defects and non-uniform thickness of transparent mono- and multilayer polyolefin surface coating of metal items are analyzed in the paper. The instrumental diagnostics method relates to colorimetric measuring based on effects, which appear in the polarized light for extrusion polymer coatings. A color coordinates dependence (in the color system CIE La*b*) on both HDPE / PVC coating thickness fluctuation values (from average ones) and coating interlayer or adhesion layer delaminating is shown. A variation of color characteristics in the polarized light at a liquid penetration into delaminated polymer layers is found. Measuring parameters and critical uncertainties are defined.

Item Response Models for Examinee-Selected Items

ERIC Educational Resources Information Center

Wang, Wen-Chung; Jin, Kuan-Yu; Qiu, Xue-Lan; Wang, Lei

2012-01-01

In some tests, examinees are required to choose a fixed number of items from a set of given items to answer. This practice creates a challenge to standard item response models, because more capable examinees may have an advantage by making wiser choices. In this study, we developed a new class of item response models to account for the choice…

Spectral tailoring device

DOEpatents

Brager, H.R.; Schenter, R.E.; Carter, L.L.; Karnesky, R.A.

1987-08-05

A spectral tailoring device for altering the neutron energy spectra and flux of neutrons in a fast reactor thereby selectively to enhance or inhibit the transmutation rate of a target metrical to form a product isotope. Neutron moderators, neutron filters, neutron absorbers and neutron reflectors may be used as spectral tailoring devices. Depending on the intended use for the device, a member from each of these four classes of materials could be used singularly, or in combination, to provide a preferred neutron energy spectra and flux of the neutrons in the region of the target material. In one embodiment of the invention, an assembly is provided for enhancing the production of isotopes, such as cobalt 60 and gadolinium 153. In another embodiment of the invention, a spectral tailoring device is disposed adjacent a target material which comprises long lived or volatile fission products and the device is used to shift the neutron energy spectra and flux of neutrons in the region of the fission products to preferentially transmute them to produce a less volatile fission product inventory. 6 figs.

Measuring Alexithymia via Trait Approach-I: A Alexithymia Scale Item Selection and Formation of Factor Structure

PubMed Central

TATAR, Arkun; SALTUKOĞLU, Gaye; ALİOĞLU, Seda; ÇİMEN, Sümeyye; GÜVEN, Hülya; AY, Çağla Ebru

2017-01-01

Introduction It is not clear in the literature whether available instruments are sufficient to measure alexithymia because of its theoretical structure. Moreover, it has been reported that several measuring instruments are needed to measure this construct, and all the instruments have different error sources. The old and the new forms of Toronto Alexithymia Scale are the only instruments available in Turkish. Thus, the purpose of this study was to develop a new scale to measure alexithymia, selecting items and constructing the factor structure. Methods A total of 1117 patients aged from 19 to 82 years (mean = 35.05 years) were included. A 100-item pool was prepared and applied to 628 women and 489 men. Data were analyzed using Explanatory Factor Analysis, Confirmatory Factor Analysis, and Item Response Theory and 28 items were selected. The new form of 28 items was applied to 415 university students, including 271 women and 144 men aged from 18 to 30 (mean=21.44). Results The results of Explanatory Factor Analysis revealed a five-factor construct of “Solving and Expressing Affective Experiences,” “External Locused Cognitive Style,” “Tendency to Somatize Affections,” “Imaginary Life and Visualization,” and “Acting Impulsively,” along with a two-factor construct representing the “Affective” and “Cognitive” components. All the components of the construct showed good model fit and high internal consistency. The new form was tested in terms of internal consistency, test-retest reliability, and concurrent validity using Toronto Alexithymia Scale as criteria and discriminative validity using Five-Factor Personality Inventory Short Form. Conclusion The results showed that the new scale met the basic psychometric requirements. Results have been discussed in line with related studies. PMID:29033633

A Practitioner's Instrument for Measuring Secondary Mathematics Teachers' Beliefs Surrounding Learner-Centered Classroom Practice.

PubMed

Lischka, Alyson E; Garner, Mary

In this paper we present the development and validation of a Mathematics Teaching Pedagogical and Discourse Beliefs Instrument (MTPDBI), a 20 item partial-credit survey designed and analyzed using Rasch measurement theory. Items on the MTPDBI address beliefs about the nature of mathematics, teaching and learning mathematics, and classroom discourse practices. A Rasch partial credit model (Masters, 1982) was estimated from the pilot study data. Results show that item separation reliability is .96 and person separation reliability is .71. Other analyses indicate the instrument is a viable measure of secondary teachers' beliefs about reform-oriented mathematics teaching and learning. This instrument is proposed as a useful measure of teacher beliefs for those working with pre-service and in-service teacher development.

Developing an Iranian ELT Context-Specific Grit Instrument.

PubMed

Ebadi, Saman; Weisi, Hiwa; Khaksar, Zahra

2018-03-06

Grit as an interesting and significant topic in psychology has been associated with better study habits and higher grades through perseverance and passion for long term goals. The only available measurement instrument of grit (Duckworth et al. in J Personal Soc Psychol 92:1087-1101, 2007) is general both in terms of its subject matter and context. Thus, this study aims to develop and validate an English as a foreign language (EFL) grit instrument whose items are specific to EFL context to obtain a more detailed view of its components for Iranian EFL learners, and to tap on other grit related factors in the EFL context. A four component model of EFL grit was developed through reviewing the existing literature and exploring EFL experts' perspectives. This tentative theoretical model of EFL grit encompasses overarching construct of effort including the following main components: Trying hard to learn English (THLE) having interest in learning English (ILE) practicing a lot in order to learn English (PLE) and having goal for learning English (HGLE). The model was then cross checked against the results of the interviews, and evolved into a scenario-based, 5 point Likert-scale EFL grit instrument. It was later operationalized by an instrument consisting of 26 items, i.e. 6 items for each component plus 2 items for themes 1 and 3. The piloting and testing of the tentative model through exploratory and confirmatory data analyses on a sample of 306 EFL learners indicated the reliability of 0.833 and an acceptable validity. The findings called for a more meaningful interpretation of the concept of grit in relation to Iranian EFL context and offered new insights for higher education administrators considering student academic performance.

Item response theory in personality assessment: a demonstration using the MMPI-2 depression scale.

PubMed

Childs, R A; Dahlstrom, W G; Kemp, S M; Panter, A T

2000-03-01

Item response theory (IRT) analyses have, over the past 3 decades, added much to our understanding of the relationships among and characteristics of test items, as revealed in examinees response patterns. Assessment instruments used outside the educational context have only infrequently been analyzed using IRT, however. This study demonstrates the relevance of IRT to personality data through analyses of Scale 2 (the Depression Scale) on the revised Minnesota Multiphasic Personality Inventory (MMPI-2). A rich set of hypotheses regarding the items on this scale, including contrasts among the Harris-Lingoes and Wiener-Harmon subscales and differences in the items measurement characteristics for men and women, are investigated through the IRT analyses.

Design and Development of the Aircraft Instrument Comprehension Program.

ERIC Educational Resources Information Center

Higgins, Norman C.

The Aircraft Instrument Comprehension (AIC) Program is a self-instructional program designed to teach undergraduate student pilots to read instruments that indicate the position of the aircraft in flight, based on sequential instructional stages of information, prompted practice, and unprompted practice. The program includes a 36-item multiple…

Ordinal-To-Interval Scale Conversion Tables and National Items for the New Zealand Version of the WHOQOL-BREF

PubMed Central

Billington, D. Rex; Hsu, Patricia Hsien-Chuan; Feng, Xuan Joanna; Medvedev, Oleg N.; Kersten, Paula; Landon, Jason; Siegert, Richard J.

2016-01-01

The World Health Organisation Quality of Life (WHOQOL) questionnaires are widely used around the world and can claim strong cross-cultural validity due to their development in collaboration with international field centres. To enhance conceptual equivalence of quality of life across cultures, optional national items are often developed for use alongside the core instrument. The present study outlines the development of national items for the New Zealand WHOQOL-BREF. Focus groups with members of the community as well as health experts discussed what constitutes quality of life in their opinion. Based on themes extracted of aspects not contained in the existing WHOQOL instrument, 46 candidate items were generated and subsequently rated for their importance by a random sample of 585 individuals from the general population. Applying importance criteria reduced these items to 24, which were then sent to another large random sample (n = 808) to be rated alongside the existing WHOQOL-BREF. A final set of five items met the criteria for national items. Confirmatory factor analysis identified four national items as belonging to the psychological domain of quality of life, and one item to the social domain. Rasch analysis validated these results and generated ordinal-to-interval conversion algorithms to allow use of parametric statistics for domain scores with and without national items. PMID:27812203

Measurement of activity limitations and participation restrictions: examination of ICF-linked content and scale properties of the FIM and PC-PART instruments.

PubMed

Darzins, Susan W; Imms, Christine; Di Stefano, Marilyn

2017-05-01

To explore the operationalization of activity and participation-related measurement constructs through comparison of item phrasing, item response categories and scoring (scale properties) for two separate instruments targeting activities of daily living. Personal Care Participation Assessment and Resource Tool (PC-PART) item content was linked to ICF categories using established linking rules. Previously reported ICF-linked FIM content categories and ICF-linked PC-PART content categories were compared to identify common ICF categories between the instruments. Scale properties of both instruments were compared using a patient scenario to explore the instruments' separate measurement constructs. The PC-PART and FIM shared 15 of the 53 level two ICF-linked categories identified across both instruments. Examination of the instruments' scale properties for items with overlapping ICF content, and exploration through a patient scenario, provided supportive evidence that the instruments measure different constructs. While the PC-PART and FIM share common ICF-linked content, they measure separate constructs. Measurement construct was influenced by the instruments' scale properties. The FIM was observed to measure activity limitations and the PC-PART measured participation restrictions. Scrutiny of instruments' scale properties in addition to item content is critical in the operationalization of activity and participation-related measurement constructs. Implications for Rehabilitation When selecting outcome measures for use in rehabilitation it is necessary to examine both the content of the instruments' items and item phrasing, response categories and scoring, to clarify the construct being measured. Measurement of activity limitations as well as participation restrictions in activities of daily living required for community life provides a more comprehensive measurement of rehabilitation outcomes than measurement of either construct alone. To measure the effects of

Construct Validity of Science Motivation and Beliefs Instrument (SLA-MB): A Case study in Sumedang, Indonesia

NASA Astrophysics Data System (ADS)

Rachmatullah, A.; Octavianda, R. P.; Ha, M.; Rustaman, N. Y.; Diana, S.

2017-02-01

Along with numerous instruments developed and used in science education researches, some of those instruments have been translated to local language in the country where the instruments were used. Most of researchers that used those translated instruments did not report the quality of those translated instruments. One of the instruments is the Scientific Literacy Assessment (SLA) including the Science Motivation and Beliefs (SLA-MB) as part of the SLA. In this study, the SLA-MB has been translated into Indonesian Language (Bahasa). The purpose of this study is to investigate the SLA-MB instrument that has been translated to Indonesian language from the view of dimensionality, reliability, item quality and differential item functioning (DIF) based on IRT-Rasch analysis. We used Conquest and Winstep as the program for IRT-Rasch analysis. We employed quantitative research method with school-survey on this study. Research subjects are 223 Indonesian Middle school students (age 13-16), with 64 boys and 159 girls. IRT-Rasch analysis of the SLA-MB Indonesian version indicated that a three-dimensional model fit significantly better than one-dimension model, and the reliability of each dimensions are about 0.60 to 0.82. As well as those findings, fit values of all items are acceptable, moreover we found no DIF for all of the SLA-MB items. Overall, our study suggests that Indonesian version of SLA-MB is acceptable to be implemented as research instrument conducted in Indonesia.

Partnering with patients using social media to develop a hypertension management instrument.

PubMed

Kear, Tamara; Harrington, Magdalena; Bhattacharya, Anand

2015-09-01

Hypertension is a lifelong condition; thus, long-term adherence to lifestyle modification, self-monitoring, and medication regimens remains a challenge for patients. The aim of this study was to develop a patient-reported hypertension instrument that measured attitudes, lifestyle behaviors, adherence, and barriers to hypertension management using patient-reported outcome data. The study was conducted using the Open Research Exchange software platform created by PatientsLikeMe. A total of 360 participants completed the psychometric phase of the study; incomplete responses were obtained from 147 patients, and 150 patients opted out. Principal component analysis with orthogonal (varimax) rotation was executed on a data set with all completed responses (N = 249) and applied to 43 items. Based on the review of the factor solution, eigenvalues, and item loadings, 16 items were eliminated and model with 29 items was tested. The process was repeated two more times until final model with 14 items was established. In interpreting the rotated factor pattern, an item was said to load on any given component if the factor loading was ≥0.40 for that component and was <0.40 for the other. In addition to the newly generated instrument, demographic and self-reported clinical characteristics of the study participants such as the type of prescribed hypertension medications, frequency of blood pressure monitoring, and comorbid conditions were examined. The Open Research Exchange platform allowed for ongoing input from patients through each stage of the 14-item instrument development. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

SEQUenCE: a service user-centred quality of care instrument for mental health services.

PubMed

Hester, Lorraine; O'Doherty, Lorna Jane; Schnittger, Rebecca; Skelly, Niamh; O'Donnell, Muireann; Butterly, Lisa; Browne, Robert; Frorath, Charlotte; Morgan, Craig; McLoughlin, Declan M; Fearon, Paul

2015-08-01

To develop a quality of care instrument that is grounded in the service user perspective and validate it in a mental health service. The instrument (SEQUenCE (SErvice user QUality of CarE)) was developed through analysis of focus group data and clinical practice guidelines, and refined through field-testing and psychometric analyses. All participants were attending an independent mental health service in Ireland. Participants had a diagnosis of bipolar affective disorder (BPAD) or a psychotic disorder. Twenty-nine service users participated in six focus group interviews. Seventy-one service users participated in field-testing: 10 judged the face validity of an initial 61-item instrument; 28 completed a revised 52-item instrument from which 12 items were removed following test-retest and convergent validity analyses; 33 completed the resulting 40-item instrument. Test-retest reliability, internal consistency and convergent validity of the instrument. The final instrument showed acceptable test-retest reliability at 5-7 days (r = 0.65; P < 0.001), good convergent validity with the Verona Service Satisfaction Scale (r = 0.84, P < 0.001) and good internal consistency (Cronbach's alpha = 0.87). SEQUenCE is a valid, reliable scale that is grounded in the service user perspective and suitable for routine use. It may serve as a useful tool in individual care planning, service evaluation and research. The instrument was developed and validated with service users with a diagnosis of either BPAD or a psychotic disorder; it does not yet have established external validity for other diagnostic groups. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Generalizability and Dependability of a Multi-Item Direct Behavior Rating Scale in a Kindergarten Classroom Setting

ERIC Educational Resources Information Center

Wickerd, Garry; Hulac, David

2017-01-01

Accurate and rapid identification of students displaying behavioral problems requires instrumentation that is user friendly and reliable. The purpose of the study was to evaluate a multi-item direct behavior rating scale called the Direct Behavior Rating-Multiple Item Scale (DBR-MIS) for disruptive behavior to determine the number of…

[Development and validation of an instrument for initial nursing assessment].

PubMed

Fernández-Sola, Cayetano; Granero-Molina, José; Mollinedo-Mallea, Judith; de Gonzales, María Hilda Peredo; Aguilera-Manrique, Gabriel; Ponce, Mara Luna

2012-12-01

The objective of this study, conducted in Bolivia from April to July of 2008, is the design and validation of an initial nursing assessment instrument to be used in clinical and educational environments in Santa Cruz (Bolivia). Twelve Bolivian nurses participated; both document analysis as well as consensus techniques were used to determine the categories and criteria to be assessed. Categories included in the nursing assessment instrument are a physical assessment and the eleven Gordon's Functional Health Patterns. The nursing assessment instrument stands out as being concise, easy to complete and utilizing a nursing approach. It does not include items for advanced nursing assessment. However, it incorporates items regarding lifestyle and the patient's autonomy. The nursing assessment instrument contributes to improving the quality of clinical records, supports the nursing diagnosis and implementation of the nursing process, promotes the nurse's role and helps to standardize practice.

Using qualitative and quantitative formative research to develop tailored nutrition intervention materials for a diverse low-income audience.

PubMed

Strolla, Leslie O; Gans, Kim M; Risica, Patricia M

2006-08-01

More effective nutrition education to reach low-income and ethnic minority populations is needed. As part of a project to develop a tailored nutrition education intervention to meet the needs of low-income Hispanics and non-Hispanics, complementary, mixed methods of formative research were used to determine specific characteristics of the target population. The aim was to ensure that the full array of nutrition messages would be comprehensive enough to effectively tailor to the level of the individual. Barriers to healthy eating were delineated for three main dietary behaviors (number of items delineated in parentheses): lowering fat (11), increasing fruit (8) and increasing vegetables (6). Information was also collected regarding motivators for healthy eating (5), situational barriers to making healthy choices (4), other nutrition-related interests (8) and typical eating habits and food-related choices of the target audience.

Background instrumental music and serial recall.

PubMed

Nittono, H

1997-06-01

Although speech and vocal music are consistently shown to impair serial recall for visually presented items, instrumental music does not always produce a significant disruption. This study investigated the features of instrumental music that would modulate the disruption in serial recall. 24 students were presented sequences of nine digits and required to recall the digits in order of presentation. Instrumental music as played either forward or backward during the task. Forward music caused significantly more disruption than did silence, whereas the reversed music did not. Some higher-order factor may be at work in the effect of background music on serial recall.

The positive mental health instrument: development and validation of a culturally relevant scale in a multi-ethnic Asian population.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Chong, Siow Ann; Abdin, Edimansyah; Orlando Edelen, Maria; Picco, Louisa; Lim, Yee Wei; Phua, Mei Yen; Chua, Boon Yiang; Tee, Joseph Y S; Sherbourne, Cathy

2011-10-31

Instruments to measure mental health and well-being are largely developed and often used within Western populations and this compromises their validity in other cultures. A previous qualitative study in Singapore demonstrated the relevance of spiritual and religious practices to mental health, a dimension currently not included in exiting multi-dimensional measures. The objective of this study was to develop a self-administered measure that covers all key and culturally appropriate domains of mental health, which can be applied to compare levels of mental health across different age, gender and ethnic groups. We present the item reduction and validation of the Positive Mental Health (PMH) instrument in a community-based adult sample in Singapore. Surveys were conducted among adult (21-65 years) residents belonging to Chinese, Malay and Indian ethnicities. Exploratory and confirmatory factor analysis (EFA, CFA) were conducted and items were reduced using item response theory tests (IRT). The final version of the PMH instrument was tested for internal consistency and criterion validity. Items were tested for differential item functioning (DIF) to check if items functioned in the same way across all subgroups. EFA and CFA identified six first-order factor structure (General coping, Personal growth and autonomy, Spirituality, Interpersonal skills, Emotional support, and Global affect) under one higher-order dimension of Positive Mental Health (RMSEA=0.05, CFI=0.96, TLI=0.96). A 47-item self-administered multi-dimensional instrument with a six-point Likert response scale was constructed. The slope estimates and strength of the relation to the theta for all items in each six PMH subscales were high (range:1.39 to 5.69), suggesting good discrimination properties. The threshold estimates for the instrument ranged from -3.45 to 1.61 indicating that the instrument covers entire spectrums for the six dimensions. The instrument demonstrated high internal consistency and had

Nurses' Attitudes Regarding the Safe Handling of Patients Who Are Morbidly Obese: Instrument Development and Psychometric Analysis.

PubMed

Bejciy-Spring, Susan; Vermillion, Brenda; Morgan, Sally; Newton, Cheryl; Chucta, Sheila; Gatens, Cindy; Zadvinskis, Inga; Holloman, Christopher; Chipps, Esther

2016-12-01

Nurses' attitudes play an important role in the consistent practice of safe patient handling behaviors. The purposes of this study were to develop and assess the psychometric properties of a newly developed instrument measuring attitudes of nurses related to the care and safe handling of patients who are obese. Phases of instrument development included (a) item generation, (b) content validity assessment, (c) reliability assessment, (d) cognitive interviewing, and (e) construct validity assessment through factor analysis. The final data from the exploratory factor analysis produced a 26-item multidimensional instrument that contains 9 subscales. Based on the factor analysis, a 26-item instrument can be used to examine nurses' attitudes regarding patients who are morbidly obese and related safe handling practices.

Development and evaluation of an instrument to measure parental satisfaction with quality of care in neonatal follow-up.

PubMed

Butt, Michelle L; Pinelli, Janet; Boyle, Michael H; Thomas, Helen; Hunsberger, Mabel; Saigal, Saroj; Lee, David S; Fanning, Jamie K; Austin, Patricia

2009-02-01

The goal of this study was to develop and subsequently evaluate the psychometric properties of a new discriminative instrument to measure parental satisfaction with the quality of care provided in neonatal follow-up (NFU) programs. The methodological framework for developing and evaluating measurement scales described by Streiner and Norman (Health Measurement Scales: A Practical Guide to Their Development and Use. 3rd ed. New York: Oxford University Press; 2003) was used for the study. Informing the phases of the research was a sample of 24 health care professionals and 381 parents who use NFU services. A comprehensive list of items representing the construct, parental satisfaction with quality of care, was generated from published reliable and valid instruments, research studies, focus groups with health care experts, and focus groups with parents. Using a clinimetric approach, the 62 items generated were reduced to 39 items based on parents' ratings of importance and refinement of the items by the research team. After content validation and pretesting, the instrument was tested with parents and underwent item-analysis. The resulting 16-item instrument was composed of 2 subscales, Process and Outcomes. Evaluation of the instrument's psychometric properties indicated adequate test-retest reliability (intraclass correlation coefficient = 0.72) and internal consistency (Process subscale, alpha = 0.77; Outcomes subscale, alpha = 0.90; overall instrument, alpha = 0.90), as well as good content and construct validity. A confirmatory factor analysis supported the multidimensionality of the construct. This new instrument provides clinicians and policy-makers with a tool to assess parental satisfaction with the quality of care in NFU, so areas of dissatisfaction can be identified and changes implemented to optimize service provision.

A comparison of Rasch item-fit and Cronbach's alpha item reduction analysis for the development of a Quality of Life scale for children and adolescents.

PubMed

Erhart, M; Hagquist, C; Auquier, P; Rajmil, L; Power, M; Ravens-Sieberer, U

2010-07-01

This study compares item reduction analysis based on classical test theory (maximizing Cronbach's alpha - approach A), with analysis based on the Rasch Partial Credit Model item-fit (approach B), as applied to children and adolescents' health-related quality of life (HRQoL) items. The reliability and structural, cross-cultural and known-group validity of the measures were examined. Within the European KIDSCREEN project, 3019 children and adolescents (8-18 years) from seven European countries answered 19 HRQoL items of the Physical Well-being dimension of a preliminary KIDSCREEN instrument. The Cronbach's alpha and corrected item total correlation (approach A) were compared with infit mean squares and the Q-index item-fit derived according to a partial credit model (approach B). Cross-cultural differential item functioning (DIF ordinal logistic regression approach), structural validity (confirmatory factor analysis and residual correlation) and relative validity (RV) for socio-demographic and health-related factors were calculated for approaches (A) and (B). Approach (A) led to the retention of 13 items, compared with 11 items with approach (B). The item overlap was 69% for (A) and 78% for (B). The correlation coefficient of the summated ratings was 0.93. The Cronbach's alpha was similar for both versions [0.86 (A); 0.85 (B)]. Both approaches selected some items that are not strictly unidimensional and items displaying DIF. RV ratios favoured (A) with regard to socio-demographic aspects. Approach (B) was superior in RV with regard to health-related aspects. Both types of item reduction analysis should be accompanied by additional analyses. Neither of the two approaches was universally superior with regard to cultural, structural and known-group validity. However, the results support the usability of the Rasch method for developing new HRQoL measures for children and adolescents.

Development of the Computer-Adaptive Version of the Late-Life Function and Disability Instrument

PubMed Central

Tian, Feng; Kopits, Ilona M.; Moed, Richard; Pardasaney, Poonam K.; Jette, Alan M.

2012-01-01

Background. Having psychometrically strong disability measures that minimize response burden is important in assessing of older adults. Methods. Using the original 48 items from the Late-Life Function and Disability Instrument and newly developed items, a 158-item Activity Limitation and a 62-item Participation Restriction item pool were developed. The item pools were administered to a convenience sample of 520 community-dwelling adults 60 years or older. Confirmatory factor analysis and item response theory were employed to identify content structure, calibrate items, and build the computer-adaptive testings (CATs). We evaluated real-data simulations of 10-item CAT subscales. We collected data from 102 older adults to validate the 10-item CATs against the Veteran’s Short Form-36 and assessed test–retest reliability in a subsample of 57 subjects. Results. Confirmatory factor analysis revealed a bifactor structure, and multi-dimensional item response theory was used to calibrate an overall Activity Limitation Scale (141 items) and an overall Participation Restriction Scale (55 items). Fit statistics were acceptable (Activity Limitation: comparative fit index = 0.95, Tucker Lewis Index = 0.95, root mean square error approximation = 0.03; Participation Restriction: comparative fit index = 0.95, Tucker Lewis Index = 0.95, root mean square error approximation = 0.05). Correlation of 10-item CATs with full item banks were substantial (Activity Limitation: r = .90; Participation Restriction: r = .95). Test–retest reliability estimates were high (Activity Limitation: r = .85; Participation Restriction r = .80). Strength and pattern of correlations with Veteran’s Short Form-36 subscales were as hypothesized. Each CAT, on average, took 3.56 minutes to administer. Conclusions. The Late-Life Function and Disability Instrument CATs demonstrated strong reliability, validity, accuracy, and precision. The Late-Life Function and Disability Instrument CAT can achieve

Validation of the knowledge, attitude and perceived practice of asthma instrument among community pharmacists using Rasch analysis.

PubMed

Akram, Waqas; Hussein, Maryam S E; Ahmad, Sohail; Mamat, Mohd N; Ismail, Nahlah E

2015-10-01

There is no instrument which collectively assesses the knowledge, attitude and perceived practice of asthma among community pharmacists. Therefore, this study aimed to validate the instrument which measured the knowledge, attitude and perceived practice of asthma among community pharmacists by producing empirical evidence of validity and reliability of the items using Rasch model (Bond & Fox software®) for dichotomous and polytomous data. This baseline study recruited 33 community pharmacists from Penang, Malaysia. The results showed that all PTMEA Corr were in positive values, where an item was able to distinguish between the ability of respondents. Based on the MNSQ infit and outfit range (0.60-1.40), out of 55 items, 2 items from the instrument were suggested to be removed. The findings indicated that the instrument fitted with Rasch measurement model and showed the acceptable reliability values of 0.88 and 0.83 and 0.79 for knowledge, attitude and perceived practice respectively.

Does item overlap render measured relationships between pain and challenging behaviour trivial? Results from a multicentre cross-sectional study in 13 German nursing homes.

PubMed

Kutschar, Patrick; Bauer, Zsuzsa; Gnass, Irmela; Osterbrink, Jürgen

2017-07-01

Several studies suggest that pain is a trigger for challenging behaviour in older adults with cognitive impairment. However, such measured relationships might be confounded due to item overlap as instruments share similar or identical items. The purpose of this study was to examine whether the frequently observed association between pain and challenging behaviour might be traced back to item overlap. This multicentre cross-sectional study was conducted in 13 nursing homes and examined pain (measure: Pain Assessment in Advanced Dementia Scale) and challenging behaviour (measure: Cohen-Mansfield Agitation Inventory) in 150 residents with severe cognitive impairment. The extent of item overlap was determined by juxtaposition of both measures' original items. As expected, comparison between these instruments revealed an extensive item overlap. The statistical relationship between the two phenomena can be traced back mainly to the contribution of the overlapping items, which renders the frequently stated relationship between pain and challenging behaviour trivial. The status quo of measuring such associations must be contested: constructs' discrimination and instruments' discrimination have to be discussed critically as item overlap may lead to biased conclusions and assumptions in research as well as to inadequate care measures in nursing practice. © 2017 John Wiley & Sons Ltd.

Measuring Environmental Factors: Unique and Overlapping International Classification of Functioning, Disability and Health Coverage of 5 Instruments.

PubMed

Heinemann, Allen W; Miskovic, Ana; Semik, Patrick; Wong, Alex; Dashner, Jessica; Baum, Carolyn; Magasi, Susan; Hammel, Joy; Tulsky, David S; Garcia, Sofia F; Jerousek, Sara; Lai, Jin-Shei; Carlozzi, Noelle E; Gray, David B

2016-12-01

To describe the unique and overlapping content of the newly developed Environmental Factors Item Banks (EFIB) and 7 legacy environmental factor instruments, and to evaluate the EFIB's construct validity by examining associations with legacy instruments. Cross-sectional, observational cohort. Community. A sample of community-dwelling adults with stroke, spinal cord injury, and traumatic brain injury (N=568). None. EFIB covering domains of the built and natural environment; systems, services, and policies; social environment; and access to information and technology; the Craig Hospital Inventory of Environmental Factors (CHIEF) short form; the Facilitators and Barriers Survey/Mobility (FABS/M) short form; the Home and Community Environment Instrument (HACE); the Measure of the Quality of the Environment (MQE) short form; and 3 of the Patient Reported Outcomes Measurement Information System's (PROMIS) Quality of Social Support measures. The EFIB and legacy instruments assess most of the International Classification of Functioning, Disability and Health (ICF) environmental factors chapters, including chapter 1 (products and technology; 75 items corresponding to 11 codes), chapter 2 (natural environment and human-made changes; 31 items corresponding to 7 codes), chapter 3 (support and relationships; 74 items corresponding to 7 codes), chapter 4 (attitudes; 83 items corresponding to 8 codes), and chapter 5 (services, systems, and policies; 72 items corresponding to 16 codes). Construct validity is provided by moderate correlations between EFIB measures and the CHIEF, MQE barriers, HACE technology mobility, FABS/M community built features, and PROMIS item banks and by small correlations with other legacy instruments. Only 5 of the 66 legacy instrument correlation coefficients are moderate, suggesting they measure unique aspects of the environment, whereas all intra-EFIB correlations were at least moderate. The EFIB measures provide a brief and focused assessment of ICF

Psychometric validation of the Persian nine-item Internet Gaming Disorder Scale – Short Form: Does gender and hours spent online gaming affect the interpretations of item descriptions?

PubMed Central

Wu, Tzu-Yi; Lin, Chung-Ying; Årestedt, Kristofer; Griffiths, Mark D.; Broström, Anders; Pakpour, Amir H.

2017-01-01

Background and aims The nine-item Internet Gaming Disorder Scale – Short Form (IGDS-SF9) is brief and effective to evaluate Internet Gaming Disorder (IGD) severity. Although its scores show promising psychometric properties, less is known about whether different groups of gamers interpret the items similarly. This study aimed to verify the construct validity of the Persian IGDS-SF9 and examine the scores in relation to gender and hours spent online gaming among 2,363 Iranian adolescents. Methods Confirmatory factor analysis (CFA) and Rasch analysis were used to examine the construct validity of the IGDS-SF9. The effects of gender and time spent online gaming per week were investigated by multigroup CFA and Rasch differential item functioning (DIF). Results The unidimensionality of the IGDS-SF9 was supported in both CFA and Rasch. However, Item 4 (fail to control or cease gaming activities) displayed DIF (DIF contrast = 0.55) slightly over the recommended cutoff in Rasch but was invariant in multigroup CFA across gender. Items 4 (DIF contrast = −0.67) and 9 (jeopardize or lose an important thing because of gaming activity; DIF contrast = 0.61) displayed DIF in Rasch and were non-invariant in multigroup CFA across time spent online gaming. Conclusions Given the Persian IGDS-SF9 was unidimensional, it is concluded that the instrument can be used to assess IGD severity. However, users of the instrument are cautioned concerning the comparisons of the sum scores of the IGDS-SF9 across gender and across adolescents spending different amounts of time online gaming. PMID:28571474

Development of a computer-adaptive physical function instrument for Social Security Administration disability determination.

PubMed

Ni, Pengsheng; McDonough, Christine M; Jette, Alan M; Bogusz, Kara; Marfeo, Elizabeth E; Rasch, Elizabeth K; Brandt, Diane E; Meterko, Mark; Haley, Stephen M; Chan, Leighton

2013-09-01

To develop and test an instrument to assess physical function for Social Security Administration (SSA) disability programs, the SSA-Physical Function (SSA-PF) instrument. Item response theory (IRT) analyses were used to (1) create a calibrated item bank for each of the factors identified in prior factor analyses, (2) assess the fit of the items within each scale, (3) develop separate computer-adaptive testing (CAT) instruments for each scale, and (4) conduct initial psychometric testing. Cross-sectional data collection; IRT analyses; CAT simulation. Telephone and Internet survey. Two samples: SSA claimants (n=1017) and adults from the U.S. general population (n=999). None. Model fit statistics, correlation, and reliability coefficients. IRT analyses resulted in 5 unidimensional SSA-PF scales: Changing & Maintaining Body Position, Whole Body Mobility, Upper Body Function, Upper Extremity Fine Motor, and Wheelchair Mobility for a total of 102 items. High CAT accuracy was demonstrated by strong correlations between simulated CAT scores and those from the full item banks. On comparing the simulated CATs with the full item banks, very little loss of reliability or precision was noted, except at the lower and upper ranges of each scale. No difference in response patterns by age or sex was noted. The distributions of claimant scores were shifted to the lower end of each scale compared with those of a sample of U.S. adults. The SSA-PF instrument contributes important new methodology for measuring the physical function of adults applying to the SSA disability programs. Initial evaluation revealed that the SSA-PF instrument achieved considerable breadth of coverage in each content domain and demonstrated noteworthy psychometric properties. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Item Banks for Measuring Emotional Distress from the Patient-Reported Outcomes Measurement Information System (PROMIS[R]): Depression, Anxiety, and Anger

ERIC Educational Resources Information Center

Pilkonis, Paul A.; Choi, Seung W.; Reise, Steven P.; Stover, Angela M.; Riley, William T.; Cella, David

2011-01-01

The authors report on the development and calibration of item banks for depression, anxiety, and anger as part of the Patient-Reported Outcomes Measurement Information System (PROMIS[R]). Comprehensive literature searches yielded an initial bank of 1,404 items from 305 instruments. After qualitative item analysis (including focus groups and…

The PROactive instruments to measure physical activity in patients with chronic obstructive pulmonary disease

PubMed Central

Gimeno-Santos, Elena; Raste, Yogini; Demeyer, Heleen; Louvaris, Zafeiris; de Jong, Corina; Rabinovich, Roberto A.; Hopkinson, Nicholas S.; Polkey, Michael I.; Vogiatzis, Ioannis; Tabberer, Maggie; Dobbels, Fabienne; Ivanoff, Nathalie; de Boer, Willem I.; van der Molen, Thys; Kulich, Karoly; Serra, Ignasi; Basagaña, Xavier; Troosters, Thierry; Puhan, Milo A.; Karlsson, Niklas

2015-01-01

No current patient-centred instrument captures all dimensions of physical activity in chronic obstructive pulmonary disease (COPD). Our objective was item reduction and initial validation of two instruments to measure physical activity in COPD. Physical activity was assessed in a 6-week, randomised, two-way cross-over, multicentre study using PROactive draft questionnaires (daily and clinical visit versions) and two activity monitors. Item reduction followed an iterative process including classical and Rasch model analyses, and input from patients and clinical experts. 236 COPD patients from five European centres were included. Results indicated the concept of physical activity in COPD had two domains, labelled “amount” and “difficulty”. After item reduction, the daily PROactive instrument comprised nine items and the clinical visit contained 14. Both demonstrated good model fit (person separation index >0.7). Confirmatory factor analysis supported the bidimensional structure. Both instruments had good internal consistency (Cronbach's α>0.8), test–retest reliability (intraclass correlation coefficient ≥0.9) and exhibited moderate-to-high correlations (r>0.6) with related constructs and very low correlations (r<0.3) with unrelated constructs, providing evidence for construct validity. Daily and clinical visit “PROactive physical activity in COPD” instruments are hybrid tools combining a short patient-reported outcome questionnaire and two activity monitor variables which provide simple, valid and reliable measures of physical activity in COPD patients. PMID:26022965

The PROactive instruments to measure physical activity in patients with chronic obstructive pulmonary disease.

PubMed

Gimeno-Santos, Elena; Raste, Yogini; Demeyer, Heleen; Louvaris, Zafeiris; de Jong, Corina; Rabinovich, Roberto A; Hopkinson, Nicholas S; Polkey, Michael I; Vogiatzis, Ioannis; Tabberer, Maggie; Dobbels, Fabienne; Ivanoff, Nathalie; de Boer, Willem I; van der Molen, Thys; Kulich, Karoly; Serra, Ignasi; Basagaña, Xavier; Troosters, Thierry; Puhan, Milo A; Karlsson, Niklas; Garcia-Aymerich, Judith

2015-10-01

No current patient-centred instrument captures all dimensions of physical activity in chronic obstructive pulmonary disease (COPD). Our objective was item reduction and initial validation of two instruments to measure physical activity in COPD.Physical activity was assessed in a 6-week, randomised, two-way cross-over, multicentre study using PROactive draft questionnaires (daily and clinical visit versions) and two activity monitors. Item reduction followed an iterative process including classical and Rasch model analyses, and input from patients and clinical experts.236 COPD patients from five European centres were included. Results indicated the concept of physical activity in COPD had two domains, labelled "amount" and "difficulty". After item reduction, the daily PROactive instrument comprised nine items and the clinical visit contained 14. Both demonstrated good model fit (person separation index >0.7). Confirmatory factor analysis supported the bidimensional structure. Both instruments had good internal consistency (Cronbach's α>0.8), test-retest reliability (intraclass correlation coefficient ≥0.9) and exhibited moderate-to-high correlations (r>0.6) with related constructs and very low correlations (r<0.3) with unrelated constructs, providing evidence for construct validity.Daily and clinical visit "PROactive physical activity in COPD" instruments are hybrid tools combining a short patient-reported outcome questionnaire and two activity monitor variables which provide simple, valid and reliable measures of physical activity in COPD patients. Copyright ©ERS 2015.

Aeroelastic Tailoring via Tow Steered Composites

NASA Technical Reports Server (NTRS)

Stanford, Bret K.; Jutte, Christine V.

2014-01-01

The use of tow steered composites, where fibers follow prescribed curvilinear paths within a laminate, can improve upon existing capabilities related to aeroelastic tailoring of wing structures, though this tailoring method has received relatively little attention in the literature. This paper demonstrates the technique for both a simple cantilevered plate in low-speed flow, as well as the wing box of a full-scale high aspect ratio transport configuration. Static aeroelastic stresses and dynamic flutter boundaries are obtained for both cases. The impact of various tailoring choices upon the aeroelastic performance is quantified: curvilinear fiber steering versus straight fiber steering, certifiable versus noncertifiable stacking sequences, a single uniform laminate per wing skin versus multiple laminates, and identical upper and lower wing skins structures versus individual tailoring.

Trainees' Perceptions of Feedback: Validity Evidence for Two FEEDME (Feedback in Medical Education) Instruments.

PubMed

Bing-You, Robert; Ramesh, Saradha; Hayes, Victoria; Varaklis, Kalli; Ward, Denham; Blanco, Maria

2018-01-01

Construct: Medical educators consider feedback a core component of the educational process. Effective feedback allows learners to acquire new skills, knowledge, and attitudes. Learners' perceptions of feedback are an important aspect to assess with valid methods in order to improve the feedback skills of educators and the feedback culture. Although guidelines for delivering effective feedback have existed for several decades, medical students and residents often indicate that they receive little feedback. A recent scoping review on feedback in medical education did not reveal any validity evidence on instruments to assess learner's perceptions of feedback. The purpose of our study was to gather validity evidence on two novel FEEDME (Feedback in Medical Education) instruments to assess medical students' and residents' perceptions of the feedback that they receive. After the authors developed an initial instrument with 54 items, cognitive interviews with medical students and residents suggested that 2 separate instruments were needed, one focused on the feedback culture (FEEDME-Culture) and the other on the provider of feedback (FEEDME-Provider). A Delphi study with 17 medical education experts and faculty members assessed content validity. The response process was explored involving 31 medical students and residents at 2 academic institutions. Exploratory factor analysis and reliability analyses were performed on completed instruments. Two Delphi consultation rounds refined the wording of items and eliminated several items. Learners found both instruments easy and quick to answer; it took them less than 5 minutes to complete. Learners preferred an electronic format of the instruments over paper. Factor analysis revealed a two- and three-factor solution for the FEEDME-Culture and FEEDME-Provider instruments, respectively. Cronbach's alpha was greater than 0.80 for all factors. Items on both instruments were moderately to highly correlated (range, r = .3-.7). Our

Modified Scoring, Traditional Item Analysis, and Sato's Caution Index Used To Investigate the Reading Recall Protocol.

ERIC Educational Resources Information Center

Deville, Craig W.; Chalhoub-Deville, Micheline

A study demonstrated the utility of item analyses to investigate which items function well or poorly in a second language reading recall protocol instrument. Data were drawn from a larger study of 56 learners of German as a second language at various proficiency levels. Pausal units of scored recall protocols were analyzed using both classical…

The matter in extreme conditions instrument at the Linac Coherent Light Source

DOE PAGES

Nagler, Bob; Arnold, Brice; Bouchard, Gary; ...

2015-04-21

The LCLS beam provides revolutionary capabilities for studying the transient behavior of matter in extreme conditions. The particular strength of the Matter in Extreme Conditions instrument is that it combines the unique LCLS beam with high-power optical laser beams, and a suite of dedicated diagnostics tailored for this field of science. In this paper an overview of the beamline, the capabilities of the instrumentation, and selected highlights of experiments and commissioning results are presented.

Neonates need tailored drug formulations.

PubMed

Allegaert, Karel

2013-02-08

Drugs are very strong tools used to improve outcome in neonates. Despite this fact and in contrast to tailored perfusion equipment, incubators or ventilators for neonates, we still commonly use drug formulations initially developed for adults. We would like to make the point that drug formulations given to neonates need to be tailored for this age group. Besides the obvious need to search for active compounds that take the pathophysiology of the newborn into account, this includes the dosage and formulation. The dosage or concentration should facilitate the administration of low amounts and be flexible since clearance is lower in neonates with additional extensive between-individual variability. Formulations need to be tailored for dosage variability in the low ranges and also to the clinical characteristics of neonates. A specific focus of interest during neonatal drug development therefore is a need to quantify and limit excipient exposure based on the available knowledge of their safety or toxicity. Until such tailored vials and formulations become available, compounding practices for drug formulations in neonates should be evaluated to guarantee the correct dosing, product stability and safety.

Developing a reliable and valid instrument to assess health-affecting aspects of neighborhoods in Tehran

PubMed Central

Ghalichi, Leila; Mohammad, Kazem; Majdzadeh, Reza; Hoseini, Mostafa; Pournik, Omid; Nedjat, Saharnaz

2012-01-01

Background: Residence characteristics can affect health of residents. This paper reports the development of an instrument assessing these aspects of neighborhoods. Materials and Methods: Literature search and focus group discussions with residents were carried out and relevant items were extracted. Five experts reviewed and commented on the items. An observation instrument with 54 items was composed and completed by two independent observers in 20 randomly selected locations. Due to lack of acceptable reliability in some items, the checklist was revised. The new 22-items checklist in four categories (general characteristics, public green area characteristics, access to services and undesirable features) was completed by two independent trained observers in 28 randomly selected locations. Results: The items in the final checklist had kappa statistics ranging from 0.63 to 1, with an exception of the item assessing “presence of beggars, homeless or working/street children”, with kappa as low as 0.27 due to variability of their presence in different times. Average Kappa statistics was 0.78 for general characteristics, 0.79 for public green area characteristics, 0.84 for access to services, and 0.54 for undesirable features. Conclusion: Neighborhood and health observation instrument seems to have good reliability in city of Tehran. It can probably be used in other large cities of Iran and similar cities elsewhere. PMID:23626633

Development and validation of an objective instrument to measure surgical performance at tonsillectomy.

PubMed

Roberson, David W; Kentala, Erna; Forbes, Peter

2005-12-01

The goals of this project were 1) to develop and validate an objective instrument to measure surgical performance at tonsillectomy, 2) to assess its interobserver and interobservation reliability and construct validity, and 3) to select those items with best reliability and most independent information to design a simplified form suitable for routine use in otolaryngology surgical evaluation. Prospective, observational data collection for an educational quality improvement project. The evaluation instrument was based on previous instruments developed in general surgery with input from attending otolaryngologic surgeons and experts in medical education. It was pilot tested and subjected to iterative improvements. After the instrument was finalized, a total of 55 tonsillectomies were observed and scored during academic year 2002 to 2003: 45 cases by residents at different points during their rotation, 5 by fellows, and 5 by faculty. Results were assessed for interobserver reliability, interobservation reliability, and construct validity. Factor analysis was used to identify items with independent information. Interobserver and interobservation reliability was high. On technical items, faculty substantially outperformed fellows, who in turn outperformed residents (P < .0001 for both comparisons). On the "global" scale (overall assessment), residents improved an average of 1 full point (on a 5 point scale) during a 3 month rotation (P = .01). In the subscale of "patient care," results were less clear cut: fellows outperformed residents, who in turn outperformed faculty, but only the fellows to faculty comparison was statistically significant (P = .04), and residents did not clearly improve over time (P = .36). Factor analysis demonstrated that technical items and patient care items factor separately and thus represent separate skill domains in surgery. It is possible to objectively measure surgical skill at tonsillectomy with high reliability and good construct

An Application of Reverse Engineering to Automatic Item Generation: A Proof of Concept Using Automatically Generated Figures

ERIC Educational Resources Information Center

Lorié, William A.

2013-01-01

A reverse engineering approach to automatic item generation (AIG) was applied to a figure-based publicly released test item from the Organisation for Economic Cooperation and Development (OECD) Programme for International Student Assessment (PISA) mathematical literacy cognitive instrument as part of a proof of concept. The author created an item…

Reliability and validity of a Tutorial Group Effectiveness Instrument.

PubMed

Singaram, Veena S; Van Der Vleuten, Cees P M; Van Berkel, Henk; Dolmans, Diana H J M

2010-01-01

Tutorial group effectiveness is essential for the success of learning in problem-based learning (PBL). Less effective and dysfunctional groups compromise the quality of students learning in PBL. This article aims to report on the reliability and validity of an instrument aimed at measuring tutorial group effectiveness in PBL. The items within the instrument are clustered around motivational and cognitive factors based on Slavin's theoretical framework. A confirmatory factor analysis (CFA) was carried out to estimate the validity of the instrument. Furthermore, generalizability studies were conducted and alpha coefficients were computed to determine the reliability and homogeneity of each factor. The CFA indicated that a three-factor model comprising 19 items showed a good fit with the data. Alpha coefficients per factor were high. The findings of the generalizability studies indicated that at least 9-10 student responses are needed in order to obtain reliable data at the tutorial group level. The instrument validated in this study has the potential to provide faculty and students with diagnostic information and feedback about student behaviors that enhance and hinder tutorial group effectiveness.

An Instrument to Measure Anomia.

ERIC Educational Resources Information Center

Moore, Allen B.

1980-01-01

Four hundred and eighty-six disadvantaged adults from North Carolina were the subjects in a study that factor-analyzed three instruments designed to measure anomia, yielding a 12-item unidimensional scale. (The refined combination scale is presented as of potential usefulness for research on the effects of educational intervention on anomia.) (LRA)

Development of quality of life instrument for urban poor in the northeast of Thailand.

PubMed

Surit, Phrutthinun; Laohasiriwong, Wongsa; Sanchaisuriya, Pattara; Schelp, Frank Perter

2008-09-01

Measuring the quality of life is important for evaluation and prediction of life and social care needs. To evaluate Quality of Life (QOL) in an urban poor population in northeast of Thailand, the Urban Poor Quality of Life (UPQOL) instrument was developed To develop an initial instrument to measure urban poor QOL. The development was started with literature review and investigated in urban poor communities. The results were transformed into the items required to build a structured questionnaire. Five hundred twenty three subjects, representatives of urban poor, were selected to test this instrument. Descriptive statistics described feature of items and the samples, exploratory factor analysis conducted the items score, and confirmatory factor analysis conducted the construct validity. The result found that the UPQOL instrument consisted of nine domains (education, income and employment, environment, health, infrastructure, security and safety, shelter and housing, civil society and political, and human rights domains) with egien value rank from 1.5 to 4.2 and 61 items with the factor loading rank from 0.41 to 0.82. The internal consistency was 0.92. The correlation between items to domain ranged from 0.30 to 0.72 and domains to overall QOL ranged from 0.27 to 0.84. Confirmatory factor analysis showed that the structure fit all domains well. Domains and overall structure were good with CFI (> 0.95). The internal consistency value ranged from 0.73-0.93. UPQOL scores were able to discriminate groups of subjects with differences levels of QOL. The UPQOL instrument is conceptually valid. The results support good validity and reliability. It forms the basis for future testing and application in other settings.

Building the BIKE: Development and Testing of the Biotechnology Instrument for Knowledge Elicitation (BIKE)

NASA Astrophysics Data System (ADS)

Witzig, Stephen B.; Rebello, Carina M.; Siegel, Marcelle A.; Freyermuth, Sharyn K.; Izci, Kemal; McClure, Bruce

2014-10-01

Identifying students' conceptual scientific understanding is difficult if the appropriate tools are not available for educators. Concept inventories have become a popular tool to assess student understanding; however, traditionally, they are multiple choice tests. International science education standard documents advocate that assessments should be reform based, contain diverse question types, and should align with instructional approaches. To date, no instrument of this type targeting student conceptions in biotechnology has been developed. We report here the development, testing, and validation of a 35-item Biotechnology Instrument for Knowledge Elicitation (BIKE) that includes a mix of question types. The BIKE was designed to elicit student thinking and a variety of conceptual understandings, as opposed to testing closed-ended responses. The design phase contained nine steps including a literature search for content, student interviews, a pilot test, as well as expert review. Data from 175 students over two semesters, including 16 student interviews and six expert reviewers (professors from six different institutions), were used to validate the instrument. Cronbach's alpha on the pre/posttest was 0.664 and 0.668, respectively, indicating the BIKE has internal consistency. Cohen's kappa for inter-rater reliability among the 6,525 total items was 0.684 indicating substantial agreement among scorers. Item analysis demonstrated that the items were challenging, there was discrimination among the individual items, and there was alignment with research-based design principles for construct validity. This study provides a reliable and valid conceptual understanding instrument in the understudied area of biotechnology.

Independent Orbiter Assessment (IOA): Analysis of the instrumentation subsystem

NASA Technical Reports Server (NTRS)

Howard, B. S.

1986-01-01

The results of the Independent Orbiter Assessment (IOA) of the Failure Modes and Effects Analysis (FMEA) and Critical Items List (CIL) are presented. The IOA approach features a top-down analysis of the hardware to determine failure modes, criticality, and potential critical items. To preserve independence, this analysis was accomplished without reliance upon the results contained within the NASA FMEA/CIL documentation. The independent analysis results for the Instrumentation Subsystem are documented. The Instrumentation Subsystem (SS) consists of transducers, signal conditioning equipment, pulse code modulation (PCM) encoding equipment, tape recorders, frequency division multiplexers, and timing equipment. For this analysis, the SS is broken into two major groupings: Operational Instrumentation (OI) equipment and Modular Auxiliary Data System (MADS) equipment. The OI equipment is required to acquire, condition, scale, digitize, interleave/multiplex, format, and distribute operational Orbiter and payload data and voice for display, recording, telemetry, and checkout. It also must provide accurate timing for time critical functions for crew and payload specialist use. The MADS provides additional instrumentation to measure and record selected pressure, temperature, strain, vibration, and event data for post-flight playback and analysis. MADS data is used to assess vehicle responses to the flight environment and to permit correlation of such data from flight to flight. The IOA analysis utilized available SS hardware drawings and schematics for identifying hardware assemblies and components and their interfaces. Criticality for each item was assigned on the basis of the worst-case effect of the failure modes identified.

Examining Differential Item Functions of Different Item Ordered Test Forms According to Item Difficulty Levels

ERIC Educational Resources Information Center

Çokluk, Ömay; Gül, Emrah; Dogan-Gül, Çilem

2016-01-01

The study aims to examine whether differential item function is displayed in three different test forms that have item orders of random and sequential versions (easy-to-hard and hard-to-easy), based on Classical Test Theory (CTT) and Item Response Theory (IRT) methods and bearing item difficulty levels in mind. In the correlational research, the…

Validation of an instrument for assessing teacher knowledge of basic language constructs of literacy.

PubMed

Binks-Cantrell, Emily; Joshi, R Malatesha; Washburn, Erin K

2012-10-01

Recent national reports have stressed the importance of teacher knowledge in teaching reading. However, in the past, teachers' knowledge of language and literacy constructs has typically been assessed with instruments that are not fully tested for validity. In the present study, an instrument was developed; and its reliability, item difficulty, and item discrimination were computed and examined to identify model fit by applying exploratory factor analysis. Such analyses showed that the instrument demonstrated adequate estimates of reliability in assessing teachers' knowledge of language constructs. The implications for professional development of in-service teachers as well as preservice teacher education are also discussed.

Gender-Related Differential Item Functioning on a Middle-School Mathematics Performance Assessment.

ERIC Educational Resources Information Center

Lane, Suzanne; And Others

This study examined gender-related differential item functioning (DIF) using a mathematics performance assessment, the QUASAR Cognitive Assessment Instrument (QCAI), administered to middle school students. The QCAI was developed for the Quantitative Understanding: Amplifying Student Achievement and Reading (QUASAR) project, which focuses on…

Instruments measuring spirituality in clinical research: a systematic review.

PubMed

Monod, Stéfanie; Brennan, Mark; Rochat, Etienne; Martin, Estelle; Rochat, Stéphane; Büla, Christophe J

2011-11-01

Numerous instruments have been developed to assess spirituality and measure its association with health outcomes. This study's aims were to identify instruments used in clinical research that measure spirituality; to propose a classification of these instruments; and to identify those instruments that could provide information on the need for spiritual intervention. A systematic literature search in MEDLINE, CINHAL, PsycINFO, ATLA, and EMBASE databases, using the terms "spirituality" and "adult$," and limited to journal articles was performed to identify clinical studies that used a spiritual assessment instrument. For each instrument identified, measured constructs, intended goals, and data on psychometric properties were retrieved. A conceptual and a functional classification of instruments were developed. Thirty-five instruments were retrieved and classified into measures of general spirituality (N = 22), spiritual well-being (N = 5), spiritual coping (N = 4), and spiritual needs (N = 4) according to the conceptual classification. Instruments most frequently used in clinical research were the FACIT-Sp and the Spiritual Well-Being Scale. Data on psychometric properties were mostly limited to content validity and inter-item reliability. According to the functional classification, 16 instruments were identified that included at least one item measuring a current spiritual state, but only three of those appeared suitable to address the need for spiritual intervention. Instruments identified in this systematic review assess multiple dimensions of spirituality, and the proposed classifications should help clinical researchers interested in investigating the complex relationship between spirituality and health. Findings underscore the scarcity of instruments specifically designed to measure a patient's current spiritual state. Moreover, the relatively limited data available on psychometric properties of these instruments highlight the need for additional research to

Development of a Computer-Adaptive Physical Function Instrument for Social Security Administration Disability Determination

PubMed Central

Ni, Pengsheng; McDonough, Christine M.; Jette, Alan M.; Bogusz, Kara; Marfeo, Elizabeth E.; Rasch, Elizabeth K.; Brandt, Diane E.; Meterko, Mark; Chan, Leighton

2014-01-01

Objectives To develop and test an instrument to assess physical function (PF) for Social Security Administration (SSA) disability programs, the SSA-PF. Item Response Theory (IRT) analyses were used to 1) create a calibrated item bank for each of the factors identified in prior factor analyses, 2) assess the fit of the items within each scale, 3) develop separate Computer-Adaptive Test (CAT) instruments for each scale, and 4) conduct initial psychometric testing. Design Cross-sectional data collection; IRT analyses; CAT simulation. Setting Telephone and internet survey. Participants Two samples: 1,017 SSA claimants, and 999 adults from the US general population. Interventions None. Main Outcome Measure Model fit statistics, correlation and reliability coefficients, Results IRT analyses resulted in five unidimensional SSA-PF scales: Changing & Maintaining Body Position, Whole Body Mobility, Upper Body Function, Upper Extremity Fine Motor, and Wheelchair Mobility for a total of 102 items. High CAT accuracy was demonstrated by strong correlations between simulated CAT scores and those from the full item banks. Comparing the simulated CATs to the full item banks, very little loss of reliability or precision was noted, except at the lower and upper ranges of each scale. No difference in response patterns by age or sex was noted. The distributions of claimant scores were shifted to the lower end of each scale compared to those of a sample of US adults. Conclusions The SSA-PF instrument contributes important new methodology for measuring the physical function of adults applying to the SSA disability programs. Initial evaluation revealed that the SSA-PF instrument achieved considerable breadth of coverage in each content domain and demonstrated noteworthy psychometric properties. PMID:23578594

Development and analysis of an instrument to assess student understanding of GOB chemistry knowledge relevant to clinical nursing practice.

PubMed

Brown, Corina E; Hyslop, Richard M; Barbera, Jack

2015-01-01

The General, Organic, and Biological Chemistry Knowledge Assessment (GOB-CKA) is a multiple-choice instrument designed to assess students' understanding of the chemistry topics deemed important to clinical nursing practice. This manuscript describes the development process of the individual items along with a psychometric evaluation of the final version of the items and instrument. In developing items for the GOB-CKA, essential topics were identified through a series of expert interviews (with practicing nurses, nurse educators, and GOB chemistry instructors) and confirmed through a national survey. Individual items were tested in qualitative studies with students from the target population for clarity and wording. Data from pilot and beta studies were used to evaluate each item and narrow the total item count to 45. A psychometric analysis performed on data from the 45-item final version was used to provide evidence of validity and reliability. The final version of the instrument has a Cronbach's alpha value of 0.76. Feedback from an expert panel provided evidence of face and content validity. Convergent validity was estimated by comparing the results from the GOB-CKA with the General-Organic-Biochemistry Exam (Form 2007) of the American Chemical Society. Instructors who wish to use the GOB-CKA for teaching and research may contact the corresponding author for a copy of the instrument. © 2014 Wiley Periodicals, Inc.

Measuring Medical Housestaff Teamwork Performance Using Multiple Direct Observation Instruments: Comparing Apples and Apples.

PubMed

Weingart, Saul N; Yaghi, Omar; Wetherell, Matthew; Sweeney, Megan

2018-04-10

To examine the composition and concordance of existing instruments used to assess medical teams' performance. A trained observer joined 20 internal medicine housestaff teams for morning work rounds at Tufts Medical Center, a 415-bed Boston teaching hospital, from October through December 2015. The observer rated each team's performance using 9 teamwork observation instruments that examined domains including team structure, leadership, situation monitoring, mutual support, and communication. Observations recorded on paper forms were stored electronically. Scores were normalized from 1 (low) to 5 (high) to account for different rating scales. Overall mean scores were calculated and graphed; weighted scores adjusted for the number of items in each teamwork domain. Teamwork scores were analyzed using t-tests, pair-wise correlations, and the Kruskal-Wallis statistic, and team performance was compared across instruments by domain. The 9 tools incorporated 5 major domains, with 5-35 items per instrument for a total of 161 items per observation session. In weighted and unweighted analyses, the overall teamwork performance score for a given team on a given day varied by instrument. While all of the tools identified the same low outlier, high performers on some instruments were low performers on others. Inconsistent scores for a given team across instruments persisted in domain-level analyses. There was substantial variation in the rating of individual teams assessed concurrently by a single observer using multiple instruments. Since existing teamwork observation tools do not yield concordant assessments, researchers should create better tools for measuring teamwork performance.

Development and validation of instrument for ergonomic evaluation of tablet arm chairs

PubMed Central

Tirloni, Adriana Seára; dos Reis, Diogo Cunha; Bornia, Antonio Cezar; de Andrade, Dalton Francisco; Borgatto, Adriano Ferreti; Moro, Antônio Renato Pereira

2016-01-01

The purpose of this study was to develop and validate an evaluation instrument for tablet arm chairs based on ergonomic requirements, focused on user perceptions and using Item Response Theory (IRT). This exploratory study involved 1,633 participants (university students and professors) in four steps: a pilot study (n=26), semantic validation (n=430), content validation (n=11) and construct validation (n=1,166). Samejima's graded response model was applied to validate the instrument. The results showed that all the steps (theoretical and practical) of the instrument's development and validation processes were successful and that the group of remaining items (n=45) had a high consistency (0.95). This instrument can be used in the furniture industry by engineers and product designers and in the purchasing process of tablet arm chairs for schools, universities and auditoriums. PMID:28337099

The Role of Item Models in Automatic Item Generation

ERIC Educational Resources Information Center

Gierl, Mark J.; Lai, Hollis

2012-01-01

Automatic item generation represents a relatively new but rapidly evolving research area where cognitive and psychometric theories are used to produce tests that include items generated using computer technology. Automatic item generation requires two steps. First, test development specialists create item models, which are comparable to templates…

Automatically producing tailored web materials for public administration

NASA Astrophysics Data System (ADS)

Colineau, Nathalie; Paris, Cécile; Vander Linden, Keith

2013-06-01

Public administration organizations commonly produce citizen-focused, informational materials describing public programs and the conditions under which citizens or citizen groups are eligible for these programs. The organizations write these materials for generic audiences because of the excessive human resource costs that would be required to produce personalized materials for everyone. Unfortunately, generic materials tend to be longer and harder to understand than materials tailored for particular citizens. Our work explores the feasibility and effectiveness of automatically producing tailored materials. We have developed an adaptive hypermedia application system that automatically produces tailored informational materials and have evaluated it in a series of studies. The studies demonstrate that: (1) subjects prefer tailored materials over generic materials, even if the tailoring requires answering a set of demographic questions first; (2) tailored materials are more effective at supporting subjects in their task of learning about public programs; and (3) the time required to specify the demographic information on which the tailoring is based does not significantly slow down the subjects in their information seeking task.

Development of an Instrument to Measure Medical Students' Attitudes toward People with Disabilities

ERIC Educational Resources Information Center

Symons, Andrew B.; Fish, Reva; McGuigan, Denise; Fox, Jeffery; Akl, Elie A.

2012-01-01

As curricula to improve medical students' attitudes toward people with disabilities are developed, instruments are needed to guide the process and evaluate effectiveness. The authors developed an instrument to measure medical students' attitudes toward people with disabilities. A pilot instrument with 30 items in four sections was administered to…

The Matter in Extreme Conditions instrument at the Linac Coherent Light Source

PubMed Central

Nagler, Bob; Arnold, Brice; Bouchard, Gary; Boyce, Richard F.; Boyce, Richard M.; Callen, Alice; Campell, Marc; Curiel, Ruben; Galtier, Eric; Garofoli, Justin; Granados, Eduardo; Hastings, Jerry; Hays, Greg; Heimann, Philip; Lee, Richard W.; Milathianaki, Despina; Plummer, Lori; Schropp, Andreas; Wallace, Alex; Welch, Marc; White, William; Xing, Zhou; Yin, Jing; Young, James; Zastrau, Ulf; Lee, Hae Ja

2015-01-01

The LCLS beam provides revolutionary capabilities for studying the transient behavior of matter in extreme conditions. The particular strength of the Matter in Extreme Conditions instrument is that it combines the unique LCLS beam with high-power optical laser beams, and a suite of dedicated diagnostics tailored for this field of science. In this paper an overview of the beamline, the capabilities of the instrumentation, and selected highlights of experiments and commissioning results are presented. PMID:25931063

Assessing item fit for unidimensional item response theory models using residuals from estimated item response functions.

PubMed

Haberman, Shelby J; Sinharay, Sandip; Chon, Kyong Hee

2013-07-01

Residual analysis (e.g. Hambleton & Swaminathan, Item response theory: principles and applications, Kluwer Academic, Boston, 1985; Hambleton, Swaminathan, & Rogers, Fundamentals of item response theory, Sage, Newbury Park, 1991) is a popular method to assess fit of item response theory (IRT) models. We suggest a form of residual analysis that may be applied to assess item fit for unidimensional IRT models. The residual analysis consists of a comparison of the maximum-likelihood estimate of the item characteristic curve with an alternative ratio estimate of the item characteristic curve. The large sample distribution of the residual is proved to be standardized normal when the IRT model fits the data. We compare the performance of our suggested residual to the standardized residual of Hambleton et al. (Fundamentals of item response theory, Sage, Newbury Park, 1991) in a detailed simulation study. We then calculate our suggested residuals using data from an operational test. The residuals appear to be useful in assessing the item fit for unidimensional IRT models.

The development of an integrated assessment instrument for measuring analytical thinking and science process skills

NASA Astrophysics Data System (ADS)

Irwanto, Rohaeti, Eli; LFX, Endang Widjajanti; Suyanta

2017-05-01

This research aims to develop instrument and determine the characteristics of an integrated assessment instrument. This research uses 4-D model, which includes define, design, develop, and disseminate. The primary product is validated by expert judgment, tested it's readability by students, and assessed it's feasibility by chemistry teachers. This research involved 246 students of grade XI of four senior high schools in Yogyakarta, Indonesia. Data collection techniques include interview, questionnaire, and test. Data collection instruments include interview guideline, item validation sheet, users' response questionnaire, instrument readability questionnaire, and essay test. The results show that the integrated assessment instrument has Aiken validity value of 0.95. Item reliability was 0.99 and person reliability was 0.69. Teachers' response to the integrated assessment instrument is very good. Therefore, the integrated assessment instrument is feasible to be applied to measure the students' analytical thinking and science process skills.

Development of ACLEEM questionnaire, an instrument measuring residents' educational environment in postgraduate ambulatory setting.

PubMed

Riquelme, Arnoldo; Padilla, Oslando; Herrera, Cristian; Olivos, Trinidad; Román, José Antonio; Sarfatis, Alberto; Solís, Nancy; Pizarro, Margarita; Torres, Patricio; Roff, Sue

2013-01-01

Students' perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. Postgraduate EE has been measured in hospital settings. However, there are no instruments available to measure the EE in postgraduate ambulatory settings. The aim of this study was to develop the "ambulatory care learning education environment measure" (ACLEEM). A mixed methodology was used including three stages: (1) Grounded theory (focus groups); (2) Delphi technique to identify consensus; and (3) Pilot study. Three quota samples of approximately 60 stakeholders were formed, one as focus groups and two as Delphi panels. Eight focus groups were carried out including 58 residents (Latin-American Spanish speakers). The results were analysed and 173 items were offered to a National Delphi panel (61 residents and teachers). They reduced in two rounds the number of important items to 54. The 54-item questionnaire was then piloted with 63 residents and refined to the final version of the ACLEEM with 50 items and three domains. The 50-item inventory is a valid instrument to measure the EE in postgraduate ambulatory setting in Chile. Large-scale administration of the ACLEEM questionnaire to evaluate its construct validity and reliability are the next steps to test the psychometric properties of the instrument.

Development and initial evaluation of an instrument to assess physiotherapists' clinical reasoning focused on clients' behavior change.

PubMed

Elvén, Maria; Hochwälder, Jacek; Dean, Elizabeth; Söderlund, Anne

2018-05-01

A systematically developed and evaluated instrument is needed to support investigations of physiotherapists' clinical reasoning integrated with the process of clients' behavior change. This study's aim was to develop an instrument to assess physiotherapy students' and physiotherapists' clinical reasoning focused on clients' activity-related behavior and behavior change, and initiate its evaluation, including feasibility and content validity. The study was conducted in three phases: 1) determination of instrument structure and item generation, based on a model, guidelines for assessing clinical reasoning, and existing measures; 2) cognitive interviews with five physiotherapy students to evaluate item understanding and feasibility; and 3) a Delphi process with 18 experts to evaluate content relevance. Phase 1 resulted in an instrument with four domains: Physiotherapist; Input from client; Functional behavioral analysis; and Strategies for behavior change. The instrument consists of case scenarios followed by items in which key features are identified, prioritized, or interpreted. Phase 2 resulted in revisions of problems and approval of feasibility. Phase 3 demonstrated high level of consensus regarding the instrument's content relevance. This feasible and content-validated instrument shows potential for use in investigations of physiotherapy students' and physiotherapists' clinical reasoning, however continued development and testing are needed.

Item Information and Discrimination Functions for Trinary PCM Items.

ERIC Educational Resources Information Center

Akkermans, Wies; Muraki, Eiji

1997-01-01

For trinary partial credit items, the shape of the item information and item discrimination functions is examined in relation to the item parameters. Conditions under which these functions are unimodal and bimodal are discussed, and the locations and values of maxima are derived. Practical relevance of the results is discussed. (SLD)

Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP)

PubMed Central

Bernhard, Gerda; Knibbe, Ronald A.; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

2015-01-01

Background Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs’ cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. Methods The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Results Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs’ cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension’s Cronbach’s α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. Conclusions The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs’ cultural competence. The CCCHP with its five dimensions offers a comprehensive

Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP).

PubMed

Bernhard, Gerda; Knibbe, Ronald A; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

2015-01-01

Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs' cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs' cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension's Cronbach's α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs' cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs' cultural competence, and has the

Analysis instrument test on mathematical power the material geometry of space flat side for grade 8

NASA Astrophysics Data System (ADS)

Kusmaryono, Imam; Suyitno, Hardi; Dwijanto, Karomah, Nur

2017-08-01

The main problem of research to determine the quality of test items on the material side of flat geometry to assess students' mathematical power. The method used is quantitative descriptive. The subjects were students of class 8 as many as 20 students. The object of research is the quality of test items in terms of the power of mathematics: validity, reliability, level of difficulty and power differentiator. Instrument mathematical power ratings are tested include: written tests and questionnaires about the disposition of mathematical power. Data were obtained from the field, in the form of test data on the material geometry of space flat side and questionnaires. The results of the test instrument to the reliability of the test item is influenced by many factors. Factors affecting the reliability of the instrument is the number of items, homogeneity test questions, the time required, the uniformity of conditions of the test taker, the homogeneity of the group, the variability problem, and motivation of the individual (person taking the test). Overall, the evaluation results of this study stated that the test instrument can be used as a tool to measure students' mathematical power.

Aerolastic tailoring and integrated wing design

NASA Technical Reports Server (NTRS)

Love, Mike H.; Bohlmann, Jon

1989-01-01

Much has been learned from the TSO optimization code over the years in determining aeroelastic tailoring's place in the integrated design process. Indeed, it has become apparent that aeroelastic tailoring is and should be deeply embedded in design. Aeroelastic tailoring can have tremendous effects on the design loads, and design loads affect every aspect of the design process. While optimization enables the evaluation of design sensitivities, valid computational simulations are required to make these sensitivities valid. Aircraft maneuvers simulated must adequately cover the plane's intended flight envelope, realistic design criteria must be included, and models among the various disciplines must be calibrated among themselves and with any hard-core (e.g., wind tunnel) data available. The information gained and benefits derived from aeroelastic tailoring provide a focal point for the various disciplines to become involved and communicate with one another to reach the best design possible.

Health-Related Resource-Use Measurement Instruments for Intersectoral Costs and Benefits in the Education and Criminal Justice Sectors.

PubMed

Mayer, Susanne; Paulus, Aggie T G; Łaszewska, Agata; Simon, Judit; Drost, Ruben M W A; Ruwaard, Dirk; Evers, Silvia M A A

2017-09-01

Intersectoral costs and benefits (ICBs), i.e. costs and benefits of healthcare interventions outside the healthcare sector, can be a crucial component in economic evaluations from the societal perspective. Pivotal to their estimation is the existence of sound resource-use measurement (RUM) instruments; however, RUM instruments for ICBs in the education or criminal justice sectors have not yet been systematically collated or their psychometric quality assessed. This review aims to fill this gap. To identify relevant instruments, the Database of Instruments for Resource Use Measurement (DIRUM) was searched. Additionally, a systematic literature review was conducted in seven electronic databases to detect instruments containing ICB items used in economic evaluations. Finally, studies evaluating the psychometric quality of these instruments were searched. Twenty-six unique instruments were included. Most frequently, ICB items measured school absenteeism, tutoring, classroom assistance or contacts with legal representatives, police custody/prison detainment and court appearances, with the highest number of items listed in the Client Service Receipt Inventory/Client Sociodemographic and Service Receipt Inventory/Client Service Receipt Inventory-Children's Version (CSRI/CSSRI/CSRI-C), Studying the Scope of Parental Expenditures (SCOPE) and Self-Harm Intervention, Family Therapy (SHIFT) instruments. ICBs in the education sector were especially relevant for age-related developmental disorders and chronic diseases, while criminal justice resource use seems more important in mental health, including alcohol-related disorders or substance abuse. Evidence on the validity or reliability of ICB items was published for two instruments only. With a heterogeneous variety of ICBs found to be relevant for several disease areas but many ICB instruments applied in one study only (21/26 instruments), setting-up an international task force to, for example, develop an internationally

Developing and testing an instrument to measure the presence of conditions for successful implementation of quality improvement collaboratives.

PubMed

Dückers, Michel L A; Wagner, Cordula; Groenewegen, Peter P

2008-08-11

In quality improvement collaboratives (QICs) teams of practitioners from different health care organizations are brought together to systematically improve an aspect of patient care. Teams take part in a series of meetings to learn about relevant best practices, quality methods and change ideas, and share experiences in making changes in their own local setting. The purpose of this study was to develop an instrument for measuring team organization, external change agent support and support from the team's home institution in a Dutch national improvement and dissemination programme for hospitals based on several QICs. The exploratory methodological design included two phases: a) content development and assessment, resulting in an instrument with 15 items, and b) field testing (N = 165). Internal consistency reliability was tested via Cronbach's alpha coefficient. Principal component analyses were used to identify underlying constructs. Tests of scaling assumptions according to the multi trait/multi-item matrix, were used to confirm the component structure. Three components were revealed, explaining 65% of the variability. The components were labelled 'organizational support', 'team organization' and 'external change agent support'. One item not meeting item-scale criteria was removed. This resulted in a 14 item instrument. Scale reliability ranged from 0.77 to 0.91. Internal item consistency and divergent validity were satisfactory. On the whole, the instrument appears to be a promising tool for assessing team organization and internal and external support during QIC implementation. The psychometric properties were good and warrant application of the instrument for the evaluation of the national programme and similar improvement programmes.

Item response theory analysis of the Pain Self-Efficacy Questionnaire.

PubMed

Costa, Daniel S J; Asghari, Ali; Nicholas, Michael K

2017-01-01

The Pain Self-Efficacy Questionnaire (PSEQ) is a 10-item instrument designed to assess the extent to which a person in pain believes s/he is able to accomplish various activities despite their pain. There is strong evidence for the validity and reliability of both the full-length PSEQ and a 2-item version. The purpose of this study is to further examine the properties of the PSEQ using an item response theory (IRT) approach. We used the two-parameter graded response model to examine the category probability curves, and location and discrimination parameters of the 10 PSEQ items. In item response theory, responses to a set of items are assumed to be probabilistically determined by a latent (unobserved) variable. In the graded-response model specifically, item response threshold (the value of the latent variable for which adjacent response categories are equally likely) and discrimination parameters are estimated for each item. Participants were 1511 mixed, chronic pain patients attending for initial assessment at a tertiary pain management centre. All items except item 7 ('I can cope with my pain without medication') performed well in IRT analysis, and the category probability curves suggested that participants used the 7-point response scale consistently. Items 6 ('I can still do many of the things I enjoy doing, such as hobbies or leisure activity, despite pain'), 8 ('I can still accomplish most of my goals in life, despite the pain') and 9 ('I can live a normal lifestyle, despite the pain') captured higher levels of the latent variable with greater precision. The results from this IRT analysis add to the body of evidence based on classical test theory illustrating the strong psychometric properties of the PSEQ. Despite the relatively poor performance of Item 7, its clinical utility warrants its retention in the questionnaire. The strong psychometric properties of the PSEQ support its use as an effective tool for assessing self-efficacy in people with pain

Environmental management performance for Brazilian industrials: measuring with the item response theory.

PubMed

Trierweiller, Andréa Cristina; Peixe, Blênio César Severo; Tezza, Rafael; Bornia, Antonio Cezar; de Andrade, Dalton Francisco; Campos, Lucila Maria de Souza

2012-01-01

Growing challenges with respect to preserving the environment have forced changes in company operational structures. Thus, the objective of this article is to measure the evidence of Environmental Management using the Item Response Theory, based on website analysis from Brazilian industrial companies from sectors defined through the scope of the research. This is a qualitative, exploratory, and descriptive study related to an information collection and analysis instrument. The general view of the research problem with respect to the phenomenon under study in based on multi-case studies, with the methodological outline based on the theoretical reference used. Primary data was gathered from 270 company websites from 7 different Brazilian sectors and led to the creation of 26 items approved by environmental specialists. The results were attained with the measuring of Environmental Management evidence via the Item Response Theory, providing a clear order of the items involved based on each item's level of difficulty, quality, and propriety. This permitted the measurement of each item's quality and propriety, as well as that of the respondents, placing them on the same analysis scale. Increasing the number of items and companies involved is suggested fEor future research in order to permit broader sector analysis.

Diagnostic accuracy of a two-item Drug Abuse Screening Test (DAST-2).

PubMed

Tiet, Quyen Q; Leyva, Yani E; Moos, Rudolf H; Smith, Brandy

2017-11-01

Drug use is prevalent and costly to society, but individuals with drug use disorders (DUDs) are under-diagnosed and under-treated, particularly in primary care (PC) settings. Drug screening instruments have been developed to identify patients with DUDs and facilitate treatment. The Drug Abuse Screening Test (DAST) is one of the most well-known drug screening instruments. However, similar to many such instruments, it is too long for routine use in busy PC settings. This study developed and validated a briefer and more practical DAST for busy PC settings. We recruited 1300 PC patients in two Department of Veterans Affairs (VA) clinics. Participants responded to a structured diagnostic interview. We randomly selected half of the sample to develop and the other half to validate the new instrument. We employed signal detection techniques to select the best DAST items to identify DUDs (based on the MINI) and negative consequences of drug use (measured by the Inventory of Drug Use Consequences). Performance indicators were calculated. The two-item DAST (DAST-2) was 97% sensitive and 91% specific for DUDs in the development sample and 95% sensitive and 89% specific in the validation sample. It was highly sensitive and specific for DUD and negative consequences of drug use in subgroups of patients, including gender, age, race/ethnicity, marital status, educational level, and posttraumatic stress disorder status. The DAST-2 is an appropriate drug screening instrument for routine use in PC settings in the VA and may be applicable in broader range of PC clinics. Published by Elsevier Ltd.

Validation of an instrument to assess visual ability in children with visual impairment in China.

PubMed

Huang, Jinhai; Khadka, Jyoti; Gao, Rongrong; Zhang, Sifang; Dong, Wenpeng; Bao, Fangjun; Chen, Haisi; Wang, Qinmei; Chen, Hao; Pesudovs, Konrad

2017-04-01

To validate a visual ability instrument for school-aged children with visual impairment in China by translating, culturally adopting and Rasch scaling the Cardiff Visual Ability Questionnaire for Children (CVAQC). The 25-item CVAQC was translated into Mandarin using a standard protocol. The translated version (CVAQC-CN) was subjected to cognitive testing to ensure a proper cultural adaptation of its content. Then, the CVAQC-CN was interviewer-administered to 114 school-aged children and young people with visual impairment. Rasch analysis was carried out to assess its psychometric properties. The correlation between the CVAQC-CN visual ability scores and clinical measure of vision (visual acuity; VA and contrast sensitivity, CS) were assessed using Spearman's r. Based on cultural adaptation exercise, cognitive testing, missing data and Rasch metrics-based iterative item removal, three items were removed from the original 25. The 22-item CVAQC-CN demonstrated excellent measurement precision (person separation index, 3.08), content validity (item separation, 10.09) and item reliability (0.99). Moreover, the CVAQC-CN was unidimensional and had no item bias. The person-item map indicated good targeting of item difficulty to person ability. The CVAQC-CN had moderate correlations between CS (-0.53, p<0.00001) and VA (0.726, p<0.00001), respectively, indicating its validity. The 22-item CVAQC-CN is a psychometrically robust and valid instrument to measure visual ability in children with visual impairment in China. The instrument can be used as a clinical and research outcome measure to assess the change in visual ability after low vision rehabilitation intervention. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Effects of Ignoring Item Interaction on Item Parameter Estimation and Detection of Interacting Items

ERIC Educational Resources Information Center

Chen, Cheng-Te; Wang, Wen-Chung

2007-01-01

This study explores the effects of ignoring item interaction on item parameter estimation and the efficiency of using the local dependence index Q[subscript 3] and the SAS NLMIXED procedure to detect item interaction under the three-parameter logistic model and the generalized partial credit model. Through simulations, it was found that ignoring…

[Instruments for evaluating oral health knowledge, attitudes and practice for parents /caregivers of small children].

PubMed

Martignon, Stefania; Bautista-Mendoza, Gloria; González-Carrera, María; Lafaurie-Villamil, Gloria; Morales, Veicy; Santamaría, Ruth

2008-01-01

Designing three instruments for evaluating oral health knowledge, attitudes and practice in parents/caregivers of low social-economic status 0-5 year-olds. Evaluating the instruments' reliability in terms of internal consistency and analysing items. Three instruments were constructed for evaluating low social-economic status 0-5 year-olds' parents/caregivers' oral health knowledge, attitudes and practice in the municipality of Usaquén , Bogotá , Colombia . 47 parents/caregivers were given a test establishing the instrument's reliability in terms of internal consistency and the adults' level of knowledge, attitudes and practice. A sub-sample was qualitatively analysed (content verification and understanding). Reliability was evaluated using Cronbach's alpha coefficient. Items were analysed for improving constructing and understanding the questions, taking four criteria into account: corrected homogeneity index (CHI), response trend, correlation between items and qualitative analysis. Cronbach's alpha coefficient for knowledge, attitudes and practice was 0,82, 0,80 and 0,62, respectively. Participants' level of knowledge, attitudes and practice was acceptable (60 %, 55 % and 91 %, respectively). This study found two out of the three evaluated instruments to be reliable (knowledge and attitudes); all three of them were then redesigned. The resulting instruments represent a valuable tool which can be used in future studies for describing and evaluating preventative programmes.

Climate of Respect Evaluation in ICUs: Development of an Instrument (ICU-CORE).

PubMed

Beach, Mary Catherine; Topazian, Rachel; Chan, Kitty S; Sugarman, Jeremy; Geller, Gail

2018-06-01

To develop a valid, reliable measure that reflected the environment of respectfulness within the ICU setting. We developed a preliminary survey instrument based on conceptual domains of respect identified through prior qualitative analyses of ICU patient, family member, and clinician perspectives. The initial instrument consisted of 21 items. After five cognitive interviews and 16 pilot surveys, we revised the instrument to include 23 items. We used standard psychometric methods to analyze the instrument. Eight ICUs serving adult patients affiliated with a large university health system. ICU clinicians. None. Based on 249 responses, we identified three factors and created subscales: General Respect, Respectful Behaviors, and Disrespectful Behaviors. The General Respect subscale had seven items (α = 0.932) and reflected how often patients in the ICU are treated with respect, in a dignified manner, as an individual, equally to all other patients, on the "same level" as the ICU team, as a person, and as you yourself would want to be treated. The Respectful Behaviors subscale had 10 items (α = 0.926) and reflected how often the ICU team responds to patient and/or family anxiety, makes an effort to get to know the patient and family as people, listens carefully, explains things thoroughly, gives the opportunity to provide input into care, protects patient modesty, greets when entering room, and talks to sedated patients. The subscale measuring disrespect has four items (α = 0.702) and reflects how often the ICU team dismisses family concerns, talks down to patients and families, speaks disrespectfully behind their backs, and gets frustrated with patients and families. We created a reliable set of scales to measure the climate of respectfulness in intensive care settings. These measures can be used for ongoing quality improvement that aim to enhance the experience of ICU patients and their families.

The Need, Development, and Validation of the Innovation Test Instrument

ERIC Educational Resources Information Center

Wheadon, Jacob; Wright, Geoff A.; West, Richard E.; Skaggs, Paul

2017-01-01

This study discusses the need, development, and validation of the Innovation Test Instrument (ITI). This article outlines how the researchers identified the content domain of the assessment and created test items. Then, it describes initial validation testing of the instrument. The findings suggest that the ITI is a good first step in creating an…

Concurrent validation of CHIRP, a new instrument for measuring healthcare student attitudes towards interdisciplinary teamwork.

PubMed

Hollar, David; Hobgood, Cherri; Foster, Beverly; Aleman, Marco; Sawning, Susan

2012-01-01

Positive attitudes towards teamwork among health care professionals are critical to patient safety. The purpose of this study is to describe the development and concurrent validation of a new instrument to measure attitudes towards healthcare teamwork that is generalizable across various populations of healthcare students. The Collaborative Healthcare Interdisciplinary Planning (CHIRP) scale was validated against the Readiness for Inter-Professional Learning Scale (RIPLS). Analyses included student (n = 266) demographics, ANOVA, internal consistency, factor analysis, and Rasch analysis. The two instruments correlated at r = .582. The CHIRP showed a multifactorial structure having excellent internal consistency (alpha = .850), with 25 of the 36 scale items loading onto a single Teamwork Attitudes factor. The RIPLS likewise had strong internal consistency (alpha = .796) and a three-factor structure, supporting previous studies of the instrument. However, Rasch analyses showed 14 (38.9%) of the 36 CHIRP items, but only four (21.1%) of the 19 RIPLS items remaining within the satisfactory standardized OUTFIT zone of 2.0 standard deviation units. We propose the 14 fitting items as a new, validated teamwork attitudes scale.

Initial development and psychometric testing of an instrument to measure the quality of children's end-of-life care.

PubMed

Widger, Kimberley; Tourangeau, Ann E; Steele, Rose; Streiner, David L

2015-01-01

The field of pediatric palliative care is hindered by the lack of a well-defined, reliable, and valid method for measuring the quality of end-of-life care. The study purpose was to develop and test an instrument to measure mothers' perspectives on the quality of care received before, at the time of, and following a child's death. In Phase 1, key components of quality end-of-life care for children were synthesized through a comprehensive review of research literature. These key components were validated in Phase 2 and then extended through focus groups with bereaved parents. In Phase 3, items were developed to assess structures, processes, and outcomes of quality end-of-life care then tested for content and face validity with health professionals. Cognitive testing was conducted through interviews with bereaved parents. In Phase 4, bereaved mothers were recruited through 10 children's hospitals/hospices in Canada to complete the instrument, and psychometric testing was conducted. Following review of 67 manuscripts and 3 focus groups with 10 parents, 141 items were initially developed. The overall content validity index for these items was 0.84 as rated by 7 health professionals. Based on feedback from health professionals and cognitive testing with 6 parents, a 144-item instrument was finalized for further testing. In Phase 4, 128 mothers completed the instrument, 31 of whom completed it twice. Test-retest reliability, internal consistency, and construct validity were demonstrated for six subscales: Connect With Families, Involve Parents, Share Information With Parents, Share Information Among Health Professionals, Support Parents, and Provide Care at Death. Additional items with content validity were grouped in four domains: Support the Child, Support Siblings, Provide Bereavement Follow-up, and Structures of Care. Forty-eight items were deleted through psychometric testing, leaving a 95-item instrument. There is good initial evidence for the reliability and

Patient Evaluation of Emotional Comfort Experienced (PEECE): developing and testing a measurement instrument

PubMed Central

Lester, L; Bulsara, C; Petterson, A; Bennett, K; Allen, E; Joske, D

2017-01-01

Objectives The Patient Evaluation of Emotional Comfort Experienced (PEECE) is a 12-item questionnaire which measures the mental well-being state of emotional comfort in patients. The instrument was developed using previous qualitative work and published literature. Design Instrument development. Setting Acute Care Public Hospital, Western Australia. Participants Sample of 374 patients. Interventions A multidisciplinary expert panel assessed the face and content validity of the instrument and following a pilot study, the psychometric properties of the instrument were explored. Main outcome measures Exploratory and confirmatory factor analysis assessed the underlying dimensions of the PEECE instrument; Cronbach's α was used to determine the reliability; κ was used for test–retest reliability of the ordinal items. Results 2 factors were identified in the instrument and named ‘positive emotions’ and ‘perceived meaning’. A greater proportion of male patients were found to report positive emotions compared with female patients. The instrument was found to be feasible, reliable and valid for use with inpatients and outpatients. Conclusions PEECE was found to be a feasible instrument for use with inpatient and outpatients, being easily understood and completed. Further psychometric testing is recommended. PMID:28122833

Item bank development, calibration and validation for patient-reported outcomes in female urinary incontinence

PubMed Central

Sung, Vivian W.; Griffith, James W.; Rogers, Rebecca G.; Raker, Christina A.; Clark, Melissa A.

2016-01-01

Purpose Current patient-reported outcomes for female urinary incontinence (UI) are limited by their inability to be tailored. Our objective is to describe the development and field-testing of 7 item banks designed to measure domains identified as important UI in females (UIf). We also describe the calibration and validation properties of the UIf-item banks, which allow for more efficient computerized-adaptive testing (CAT) in the future. METHODS The UIf-measures included 168 items covering 7 domains: Stress UI (SUI), Overactive Bladder (OAB), Urinary Frequency, Physical, Social and Emotional Health Impact, and Adaptation. Items underwent rigorous qualitative development and psychometric testing across 2 sites. Items were calibrated using item response theory and evaluated for internal consistency, construct validity and responsiveness. RESULTS 750 women (249 SUI, 249 OAB, and 252 mixed UI) participated. Mean age was 55±14 years ,23% were Hispanic, 80% white. In addition to face and content validity, the measures demonstrated good internal consistency (coefficient alpha 0.92-0.98) and unidimensionality. There was evidence for construct validity with moderate to strong correlations with the UDI (r’s ≥ 0.6) and IIQ (r’s = ≥ 0.6) scales. The measures were responsive to change for SUI treatment (paired t-test p <.001, ES range=1.3 to 2.9; SRM range=1.3 to 2.5) and OAB treatment (paired t-test p <.05 for all domains except Social Health Impact and Adaptation, ES range=.3 to 1.5, SRM range=0.4 to 1.0). The measures were responsive based on concurrent changes with the UDI and IIQ (p < 0.05). CAT versions were developed and pilot tested. CONCLUSIONS The UIf-item banks demonstrate good psychometric characteristics and are a sufficiently valid set of customizable tools for measuring UI symptoms and life impact. PMID:26732514

Climbing therapy under PK-tailored prophylaxis.

PubMed

Stemberger, M; Schmit, E; Czepa, D; Kurnik, K; Spannagl, M

2014-01-01

Climbing has a low risk of injury and strengthens the entire musculature. Due to its benefits in physical and mental health as well as its high fun factor climbing is an established way of therapy. So far, the usefulness of climbing therapy has not been shown for people with haemophilia (PWH). A crucial requirement for physical activity in PWH is regular prophylaxis. As the patient's individual pharmacokinetic (PK) response varies significantly, PK-tailored prophylaxis may decrease bleeding frequency. We describe a man (age 25 years) with severe haemophilia A who took part in an 8.5-month weekly climbing program under PK-tailored prophylaxis. Bleeding frequency, factor consumption, joint health (Haemophilia Joint Health Score, HJHS), quality of life (Haemo-QoL-A) and climbing performance (UIAA scale) were assessed before and after the training. Prior to the study, the patient was on demand treatment. The patient was started on standard prophylaxis for a 2 months period and then observed for 6.5 months under PK-tailored prophylaxis. PK-tailored prophylaxis was targeted to a trough level of 1-3%. For high-impact activities a factor activity >15%, for low-impact activities a factor activity >5% was suggested. Climbing therapy was safe. The bleeding rate decreased from 14 (2012) to 1 (during the study period of 8.5 months). The one bleeding event was due to a missed infusion and was not triggered by physical activity. The elimination half-life using Bayesian statistics was determined to be 16h. Using this half-life for PK-tailored prophylaxis reduced the factor VIII consumption in comparison to standard prophylaxis. Joint health was particularly improved in the categories range of motion and swelling. Quality of life scores stayed at a high level. Climbing performance improved by 1 grade. The combination of PK-tailored prophylaxis with therapeutic climbing improved clinical outcome in this young adult with severe haemophilia. The tailored concept for high- and low

Psychometric properties of the PROMIS Physical Function item bank in patients receiving physical therapy.

PubMed

Crins, Martine H P; van der Wees, Philip J; Klausch, Thomas; van Dulmen, Simone A; Roorda, Leo D; Terwee, Caroline B

2018-01-01

The Patient-Reported Outcomes Measurement Information System (PROMIS) is a universally applicable set of instruments, including item banks, short forms and computer adaptive tests (CATs), measuring patient-reported health across different patient populations. PROMIS CATs are highly efficient and the use in practice is considered feasible with little administration time, offering standardized and routine patient monitoring. Before an item bank can be used as CAT, the psychometric properties of the item bank have to be examined. Therefore, the objective was to assess the psychometric properties of the Dutch-Flemish PROMIS Physical Function item bank (DF-PROMIS-PF) in Dutch patients receiving physical therapy. Cross-sectional study. 805 patients >18 years, who received any kind of physical therapy in primary care in the past year, completed the full DF-PROMIS-PF (121 items). Unidimensionality was examined by Confirmatory Factor Analysis and local dependence and monotonicity were evaluated. A Graded Response Model was fitted. Construct validity was examined with correlations between DF-PROMIS-PF T-scores and scores on two legacy instruments (SF-36 Health Survey Physical Functioning scale [SF36-PF10] and the Health Assessment Questionnaire Disability-Index [HAQ-DI]). Reliability (standard errors of theta) was assessed. The results for unidimensionality were mixed (scaled CFI = 0.924, TLI = 0.923, RMSEA = 0.045, 1th factor explained 61.5% of variance). Some local dependence was found (8.2% of item pairs). The item bank showed a broad coverage of the physical function construct (threshold-parameters range: -4.28-2.33) and good construct validity (correlation with SF36-PF10 = 0.84 and HAQ-DI = -0.85). Furthermore, the DF-PROMIS-PF showed greater reliability over a broader score-range than the SF36-PF10 and HAQ-DI. The psychometric properties of the DF-PROMIS-PF item bank are sufficient. The DF-PROMIS-PF can now be used as short forms or CAT to measure the level of physical

Development of an item bank and computer adaptive test for role functioning.

PubMed

Anatchkova, Milena D; Rose, Matthias; Ware, John E; Bjorner, Jakob B

2012-11-01

Role functioning (RF) is a key component of health and well-being and an important outcome in health research. The aim of this study was to develop an item bank to measure impact of health on role functioning. A set of different instruments including 75 newly developed items asking about the impact of health on role functioning was completed by 2,500 participants. Established item response theory methods were used to develop an item bank based on the generalized partial credit model. Comparison of group mean bank scores of participants with different self-reported general health status and chronic conditions was used to test the external validity of the bank. After excluding items that did not meet established requirements, the final item bank consisted of a total of 64 items covering three areas of role functioning (family, social, and occupational). Slopes in the bank ranged between .93 and 4.37; the mean threshold range was -1.09 to -2.25. Item bank-based scores were significantly different for participants with and without chronic conditions and with different levels of self-reported general health. An item bank assessing health impact on RF across three content areas has been successfully developed. The bank can be used for development of short forms or computerized adaptive tests to be applied in the assessment of role functioning as one of the common denominators across applications of generic health assessment.

Creating a Computer Adaptive Test Version of the Late-Life Function & Disability Instrument

PubMed Central

Jette, Alan M.; Haley, Stephen M.; Ni, Pengsheng; Olarsch, Sippy; Moed, Richard

2009-01-01

Background This study applied Item Response Theory (IRT) and Computer Adaptive Test (CAT) methodologies to develop a prototype function and disability assessment instrument for use in aging research. Herein, we report on the development of the CAT version of the Late-Life Function & Disability instrument (Late-Life FDI) and evaluate its psychometric properties. Methods We employed confirmatory factor analysis, IRT methods, validation, and computer simulation analyses of data collected from 671 older adults residing in residential care facilities. We compared accuracy, precision, and sensitivity to change of scores from CAT versions of two Late-Life FDI scales with scores from the fixed-form instrument. Score estimates from the prototype CAT versus the original instrument were compared in a sample of 40 older adults. Results Distinct function and disability domains were identified within the Late-Life FDI item bank and used to construct two prototype CAT scales. Using retrospective data, scores from computer simulations of the prototype CAT scales were highly correlated with scores from the original instrument. The results of computer simulation, accuracy, precision, and sensitivity to change of the CATs closely approximated those of the fixed-form scales, especially for the 10- or 15-item CAT versions. In the prospective study each CAT was administered in less than 3 minutes and CAT scores were highly correlated with scores generated from the original instrument. Conclusions CAT scores of the Late-Life FDI were highly comparable to those obtained from the full-length instrument with a small loss in accuracy, precision, and sensitivity to change. PMID:19038841

Development of an instrument to measure the quality of documented nursing diagnoses, interventions and outcomes: the Q-DIO.

PubMed

Müller-Staub, Maria; Lunney, Margaret; Odenbreit, Matthias; Needham, Ian; Lavin, Mary Ann; van Achterberg, Theo

2009-04-01

This paper aims to report the development stages of an audit instrument to assess standardised nursing language. Because research-based instruments were not available, the instrument Quality of documentation of nursing Diagnoses, Interventions and Outcomes (Q-DIO) was developed. Standardised nursing language such as nursing diagnoses, interventions and outcomes are being implemented worldwide and will be crucial for the electronic health record. The literature showed a lack of audit instruments to assess the quality of standardised nursing language in nursing documentation. A qualitative design was used for instrument development. Criteria were first derived from a theoretical framework and literature reviews. Second, the criteria were operationalized into items and eight experts assessed face and content validity of the Q-DIO. Criteria were developed and operationalized into 29 items. For each item, a three or five point scale was applied. The experts supported content validity and showed 88.25% agreement for the scores assigned to the 29 items of the Q-DIO. The Q-DIO provides a literature-based audit instrument for nursing documentation. The strength of Q-DIO is its ability to measure the quality of nursing diagnoses and related interventions and nursing-sensitive patient outcomes. Further testing of Q-DIO is recommended. Based on the results of this study, the Q-DIO provides an audit instrument to be used in clinical practice. Its criteria can set the stage for the electronic nursing documentation in electronic health records.

The Sound Access Parent Outcomes Instrument (SAPOI): Construction of a new instrument for children with severe multiple disabilities who use cochlear implants or hearing aids.

PubMed

Hayward, Denyse V; Ritter, Kathryn; Mousavi, Amin; Vatanapour, Shabnam

2016-01-01

To report on the Phase 2 development of the Sound Access Parent Outcomes Instrument (SAPOI), a new instrument focused on formalizing outcomes that parents of children with severe multiple disabilities (SMD) who use amplification prioritize as important. Phase 2 of this project involved item selection and refinement of the SAPOI based on (a) Phase 1 study participant input, (b) clinical specialist feedback, and (c) test-retest instrument reliability. Phase 1 participant responses were utilized to construct a draft version of the SAPOI. Next, clinical specialists examined the instrument for content validity and utility and instrument reliability was examined through a test-retest process with parents of children with SMD. The draft SAPOI was constructed based on Phase 1 participant input. Clinical specialists supported content validity and utility of the instrument and the inclusion of 19 additional items across four categories, namely Child Affect, Child Interaction, Parent Well-being, and Child's Device Use. The SAPOI was completed twice at one-month intervals by parents of children with SMD to examine instrument reliability across the four categories (Child Affect, Child Interaction, Parent Well-being, and Child's Device Use). Instrument reliability was strong-to-excellent across all four sections. The SAPOI shows promise as a much-needed addition to the assessment battery currently used for children with SMD who use cochlear implants and hearing aids. It provides valuable information regarding outcomes resulting from access to sound in this population that currently used assessments do not identify.

The Perinatal Palliative Care Perceptions and Barriers Scale Instrument©: development and validation.

PubMed

Wool, Charlotte; Northam, Sally

2011-12-01

To devise and test an instrument measuring clinician perceptions of perinatal palliative care (PPC) and barriers to care delivery. PPC was theorized to involve the care of pregnant women and their families after prenatal testing resulted in a life-limiting fetal diagnosis. Both giving birth to a child with a life-limiting condition or termination of pregnancy for fetal anomaly can be emotionally traumatic life events. Clinicians were thought to face ethical dilemmas that involved approaches to care for this population. The ethical dilemmas were measured on a perceptions scale using items about informed consent, justice, beneficence, and autonomy. Barriers were theorized as obstacles to delivering quality PPC and included insufficient education, personal discomfort, and difficulty garnering team or administrative support for care. Licensed clinicians practicing in the perinatal field. Stage 1 entailed instrument development and validation, which was achieved through a Delphi study involving 11 expert panelists. The devised instrument included 64 six-point Likert items. In stage 2, a computer survey gathered data from a multidisciplinary, clinician group. A total of 264 clinicians completed the survey. Exploratory factor analysis with varimax rotation was used to validate the instrument, evaluate the factors, and summarize the explained variance achieved by sum scores of the perceptions and barriers scales. The perceptions scale was reduced to 23 items with a 6-factor solution explaining 67% of the variance with a good internal consistency reliability of 0.77 (Cronbach α). The 22-item barriers scale had a 6-factor solution explaining 71% of the variance with an alpha reliability of 0.83. The Perinatal Palliative Care Perceptions and Practice Barriers Scale instrument is a valid and reliable measure of PPC perceptions and barriers for measuring the attitudes of physicians and nurses. Use of this instrument can foster educational programs and hospital planning for PPC

Expectations for Visual Function: An Initial Evaluation of a New Clinical Instrument.

ERIC Educational Resources Information Center

Corn, Anne L.; Webne, Steve L.

2001-01-01

A study explored the internal consistency of items in a visual screening instrument developed by Project PAVE: Expectations for Visual Functioning (EVF). The test includes 20 items that evaluate a child's functional use of vision. A pilot test involving 129 teachers indicates the EFV is internally consistent. (Contains three references.) (CR)

Psychometric instrumentation: reliability and validity of instruments used for clinical practice, evidence-based practice projects and research studies.

PubMed

Mayo, Ann M

2015-01-01

It is important for CNSs and other APNs to consider the reliability and validity of instruments chosen for clinical practice, evidence-based practice projects, or research studies. Psychometric testing uses specific research methods to evaluate the amount of error associated with any particular instrument. Reliability estimates explain more about how well the instrument is designed, whereas validity estimates explain more about scores that are produced by the instrument. An instrument may be architecturally sound overall (reliable), but the same instrument may not be valid. For example, if a specific group does not understand certain well-constructed items, then the instrument does not produce valid scores when used with that group. Many instrument developers may conduct reliability testing only once, yet continue validity testing in different populations over many years. All CNSs should be advocating for the use of reliable instruments that produce valid results. Clinical nurse specialists may find themselves in situations where reliability and validity estimates for some instruments that are being utilized are unknown. In such cases, CNSs should engage key stakeholders to sponsor nursing researchers to pursue this most important work.

MOEMs devices designed and tested for future astronomical instrumentation in space

NASA Astrophysics Data System (ADS)

Zamkotsian, Frédéric; Lanzoni, Patrick; Waldis, Severin; Noell, Wilfried; Conedera, Veronique; Fabre, Norbert; Viard, Thierry; Buisset, Christophe

2017-11-01

Next generation of astronomical instrumentation for space telescopes requires Micro-Opto-Electro- Mechanical Systems (MOEMS) with remote control capability and cryogenic operation. MOEMS devices have the capability to tailor the incoming light in terms of intensity and object selection with programmable slit masks, in terms of phase and wavefront control with micro-deformable mirrors, and finally in terms of spectrum with programmable diffraction gratings. Applications are multi-object spectroscopy (MOS), wavefront correction and programmable spectrographs. We are engaged since several years in the design, realization and characterization of MOEMS devices suited for astronomical instrumentation.

Development and Validation of the Scan of Postgraduate Educational Environment Domains (SPEED): A Brief Instrument to Assess the Educational Environment in Postgraduate Medical Education

PubMed Central

Schönrock-Adema, Johanna; Visscher, Maartje; Raat, A. N. Janet; Brand, Paul L. P.

2015-01-01

Introduction Current instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality. Methods Stepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected. Results Two hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ≥80% by the items representing the domains in the final SPEED. Conclusions The SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity

EASY-An Instrument for Surveillance of Physical Activity in Youth.

PubMed

Pate, Russell R; McIver, Kerry; Dowda, Marsha; Schenkelberg, Michaela A; Beets, Michael; DiStefano, Christine

2018-01-23

Physical activity (PA) promotion among youth is a public health priority and there is a need for robust surveillance systems to help support such initiatives. Existing youth PA self-report instruments that are used for surveillance lack information regarding the types and contexts of activity. Further, these instruments have limited validity with accelerometry. The purpose of the present study was to develop a self-report instrument, with sound psychometric properties, for monitoring compliance with PA guidelines in youth. In focus groups, 162 middle school students identified 30 forms of PA that are highly prevalent in that age group. We incorporated these activities into three preliminary forms of a self-report instrument. An independent sample of middle school students (n = 537) was randomly assigned to complete one of the three preliminary versions of the instrument. Rasch analysis was applied to the responses to the three formats, and a yes/no plus frequency format emerged as the preferred method. A third sample of 342 middle school students then completed the yes/no plus frequency instrument twice following a seven-day period during which they wore an accelerometer. Using both Rasch analysis and traditional correlational methods, validity and reliability of a 14-item instrument were established. Data were collected during 2012 - 2015. Spearman correlation coefficient for the association between the cumulative score for the 14 items and minutes per day of accelerometry-derived moderate-to-vigorous physical activity (MVPA) was 0.33 (95% CI 0.22, 0.43; p<.001). Sensitivity and specificity of the 14-item instrument was 0.90 and 0.44, respectively. The study produced a PA self-report instrument for youth that was found to be reliable (r=0.91), valid versus accelerometry (r=0.33), and acceptably specific and sensitive in detecting compliance with PA guidelines.This is an open-access article distributed under the terms of the Creative Commons Attribution

A model of tailoring effects: A randomized controlled trial examining the mechanisms of tailoring in a web-based STD screening intervention.

PubMed

Lustria, Mia Liza A; Cortese, Juliann; Gerend, Mary A; Schmitt, Karla; Kung, Ying Mai; McLaughlin, Casey

2016-11-01

This study explores the mechanisms of tailoring within the context of RU@Risk a brief Web-based intervention designed to promote sexually transmitted disease (STD) testing among young adults. This is one of a few studies to empirically examine theorized message processing mechanisms of tailoring and persuasion outcomes in a single model. Sexually active college students (N = 1065) completed a pretest, were randomly assigned to explore a tailored or nontailored website, completed a posttest, and were offered the opportunity to order a free at-home STD test kit. As intervention effects were hypothesized to work via increases in perceived risk, change in perceived risk from pretest to posttest by condition was examined. Hypothesized mechanisms of tailoring (perceived personal relevance, attention, and elaboration) were examined using structural equation modeling (SEM). All analyses controlled for demographic variables and sexual history. As predicted, perceived risk of STDs increased from pretest to posttest, but only in the tailored condition. Results revealed that exposure to the tailored (vs. nontailored) website increased perceived personal relevance, attention to, and elaboration of the message. These effects in turn were associated with greater perceived risk of STDs and intentions to get tested. Additionally, participants in the tailored condition were more likely to order a test kit. Findings provide insight into the mechanisms of tailoring with important implications for optimizing message design. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Methodology for the development and calibration of the SCI-QOL item banks.

PubMed

Tulsky, David S; Kisala, Pamela A; Victorson, David; Choi, Seung W; Gershon, Richard; Heinemann, Allen W; Cella, David

2015-05-01

To develop a comprehensive, psychometrically sound, and conceptually grounded patient reported outcomes (PRO) measurement system for individuals with spinal cord injury (SCI). Individual interviews (n=44) and focus groups (n=65 individuals with SCI and n=42 SCI clinicians) were used to select key domains for inclusion and to develop PRO items. Verbatim items from other cutting-edge measurement systems (i.e. PROMIS, Neuro-QOL) were included to facilitate linkage and cross-population comparison. Items were field tested in a large sample of individuals with traumatic SCI (n=877). Dimensionality was assessed with confirmatory factor analysis. Local item dependence and differential item functioning were assessed, and items were calibrated using the item response theory (IRT) graded response model. Finally, computer adaptive tests (CATs) and short forms were administered in a new sample (n=245) to assess test-retest reliability and stability. A calibration sample of 877 individuals with traumatic SCI across five SCI Model Systems sites and one Department of Veterans Affairs medical center completed SCI-QOL items in interview format. We developed 14 unidimensional calibrated item banks and 3 calibrated scales across physical, emotional, and social health domains. When combined with the five Spinal Cord Injury--Functional Index physical function banks, the final SCI-QOL system consists of 22 IRT-calibrated item banks/scales. Item banks may be administered as CATs or short forms. Scales may be administered in a fixed-length format only. The SCI-QOL measurement system provides SCI researchers and clinicians with a comprehensive, relevant and psychometrically robust system for measurement of physical-medical, physical-functional, emotional, and social outcomes. All SCI-QOL instruments are freely available on Assessment CenterSM.

A preliminary psychometric evaluation of the eight-item cognitive load scale.

PubMed

Pignatiello, Grant A; Tsivitse, Emily; Hickman, Ronald L

2018-04-01

The aim of this article is to report the psychometric properties of the eight-item cognitive load scale. According to cognitive load theory, the formatting and delivery of healthcare education influences the degree to which patients and/or family members can engage their working memory systems for learning. However, despite its relevance, cognitive load has not yet been evaluated among surrogate decision makers exposed to electronic decision support for healthcare decisions. To date, no psychometric analyses of instruments evaluating cognitive load have been reported within healthcare settings. A convenience sample of 62 surrogate decision makers for critically ill patients were exposed to one of two healthcare decision support interventions were recruited from four intensive care units at a tertiary medical center in Northeast Ohio. Participants were administered a battery of psychosocial instruments and the eight-item cognitive load scale (CLS). The CLS demonstrated a bidimensional factor structure with acceptable discriminant validity and internal consistency reliability (Cronbach's α = 0.75 and 0.89). The CLS is a psychometrically sound instrument that may be used in the evaluation of decision support among surrogate decision makers of the critically ill. The authors recommend application of the cognitive load scale in the evaluation and development of healthcare education and interventions. Copyright © 2018 Elsevier Inc. All rights reserved.

Development of an instrument to measure self-efficacy in caregivers of people with advanced cancer.

PubMed

Ugalde, Anna; Krishnasamy, Meinir; Schofield, Penelope

2013-06-01

Informal caregivers of people with advanced cancer experience many negative impacts as a result of their role. There is a lack of suitable measures specifically designed to assess their experience. This study aimed to develop a new measure to assess self-efficacy in caregivers of people with advanced cancer. The development and testing of the new measure consisted of four separate, sequential phases: generation of issues, development of issues into items, pilot testing and field testing. In the generation of issues, 17 caregivers were interviewed to generate data. These data were analysed to generate codes, which were then systematically developed into items to construct the instrument. The instrument was pilot tested with 14 health professionals and five caregivers. It was then administered to a large sample for field testing to establish the psychometric properties, with established measures including the Brief Cope and the Family Appraisals for Caregiving Questionnaire for Palliative Care. Ninety-four caregivers completed the questionnaire booklet to establish the factor structure, reliability and validity. The factor analysis resulted in a 21-item, four-factor instrument, with the subscales being termed Resilience, Self-Maintenance, Emotional Connectivity and Instrumental Caregiving. The test-retest reliability and internal consistency were both excellent, ranging from 0.73 to 0.85 and 0.81 to 0.94, respectively. Six convergent and divergent hypotheses were made, and five were supported. This study has developed a new instrument to assess self-efficacy in caregivers of people with advanced cancer. The result is a four-factor, 21-item instrument with demonstrated reliability and validity. Copyright © 2012 John Wiley & Sons, Ltd.

[Development and reliability evaluation of an instrument to measure health-related quality of life in independent elderly].

PubMed

Lima, Maria José Barbosa de; Portela, Margareth Crisóstomo

2010-08-01

This study presents an instrument, the health-related quality of life (HRQOL) profile for independent elderly, to measure the health-related quality of life of the functionally independent elderly assisted in the outpatient setting, based on the adaptation of four validated scales: Short-Form Health Survey (SF-36), Duke-UNC Health Profile (DUHP), Sickness Impact Profile (SIP), and Nottingham Health Profile (NHP). The study also evaluates the instrument's reliability based on its use by two different observers with a 15-day interval. The instrument includes five dimensions (health perception, symptoms, physical function, psychological function, and social function) and 45 items. Reliability evaluation of the QUASI instrument was based on interviews with 142 elderly outpatients in the city of Rio de Janeiro, Brazil. Prevalence-adjusted kappa statistic was used to assess all 45 items. Correlation was also calculated between overall scores and scores on individual dimensions. In the reliability evaluation, 39 of the 45 items showed prevalence-adjusted kappa greater than 0.60.

Multidisciplinary tailoring of hot composite structures

NASA Technical Reports Server (NTRS)

Singhal, Surendra N.; Chamis, Christos C.

1993-01-01

A computational simulation procedure is described for multidisciplinary analysis and tailoring of layered multi-material hot composite engine structural components subjected to simultaneous multiple discipline-specific thermal, structural, vibration, and acoustic loads. The effect of aggressive environments is also simulated. The simulation is based on a three-dimensional finite element analysis technique in conjunction with structural mechanics codes, thermal/acoustic analysis methods, and tailoring procedures. The integrated multidisciplinary simulation procedure is general-purpose including the coupled effects of nonlinearities in structure geometry, material, loading, and environmental complexities. The composite material behavior is assessed at all composite scales, i.e., laminate/ply/constituents (fiber/matrix), via a nonlinear material characterization hygro-thermo-mechanical model. Sample tailoring cases exhibiting nonlinear material/loading/environmental behavior of aircraft engine fan blades, are presented. The various multidisciplinary loads lead to different tailored designs, even those competing with each other, as in the case of minimum material cost versus minimum structure weight and in the case of minimum vibration frequency versus minimum acoustic noise.

Patient-reported outcome measure for neuromyelitis optica: pretesting of preliminary instrument and protocol for further development in accordance with international guidelines.

PubMed

Moore, P; Jackson, C; Mutch, K; Methley, A; Pollard, C; Hamid, S; Jacob, A

2016-09-30

This study outlines the development of a patient-reported outcome measure (PROM), an instrument to obtain self-reported health status for neuromyeltis optica (NMO), a disabling neurological condition. Development was conducted in accordance with international guidance for PROMs including systematic review of existing literature, item generation guided by qualitative interviews, health-related quality of life conceptual framework and clinical expert panel and cognitive interviews with NMO patients. Participants were identified through a national NMO clinic in a tertiary NHS neurosciences service. 15 individuals with NMO participated in cognitive interviews requiring review and ranking of proposed PROM items and qualitative feedback on content, layout and response options. Participants endorsed the draft instrument as reflecting their experience of the condition and as being easy to understand. Rating and ranking of item relevance and importance reduced the draft instrument from 106 to 48 items. Participant feedback on overlapping items eliminated a further 2 items and resulted in a preliminary instrument of 46 items. As a direct result of participant feedback ordering of the 10 domains was revised, a 4 option Likert scale was employed and a 4-week recall period for impact of symptoms was selected. A 46-item instrument developed in accordance with international PROM development guidelines through literature review, developed by subject matter experts and refined through pretesting examining content validity provides a preliminary measure for assessing patient-report of health status in NMO. Further evaluation is proposed including sensitivity to clinical change, and international contributions to evaluating the measure are encouraged. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Psychometric Evaluation of a Cultural Competency Assessment Instrument for Health Professionals

PubMed Central

Haywood, Sonja H.; Goode, Tawara; Gao, Yong; Smith, Kristyn; Bronheim, Suzanne; Flocke, Susan A; Zyzanski, Steve

2012-01-01

Background Few valid and reliable measures exist for health care professionals interested in determining their levels of cultural and linguistic competence. Objective To evaluate the measurement properties of the Cultural Competence Health Practitioner Assessment (CCHPA-129). Methods The CCHPA-129 is a 129-item web-based instrument, developed by the National Center for Cultural Competence (NCCC). Responses on the CCHPA -129 were examined using factor analysis; Rasch modeling; and Differential Item Functioning (DIF) across race, ethnicity, gender, and profession. Subjects 2504 practitioners, including 1864 nurses (RN/LPN,/BSN); 341 clinicians (PA/NP); and 299 physicians (MD/DO), who completed the CCHPA-129 online between 2005 and 2008. Results Three factors representing domains of knowledge, adapting practice, and promoting health for culturally and linguistically diverse populations accounted for 46% of the variance. Among Knowledge factor items, 53% (23/43) fit the Rasch model, item difficulties ranged from −1.01 logits (least difficult) to +1.11 logits (most difficult), separation index (SI) 13.82, and Cronbach’s α 0.92. Forty-seven percent (21/44) Adapting Practice factor items fit the model, item difficulties −0.07 to +1.11 logits, SI 11.59, Cronbach’s α 0.88; and 58% (23/39). Promoting Health factor items fit the model, item difficulties −1.01 to +1.38 logits, SI 22.64, Cronbach’s α 0.92. Early evidence of validity was established by known groups having statistically different scores. Conclusion The 67-item CCHPA-67 is psychometrically sound. This shorted instrument can be used to establish associations between practitioners’ cultural and linguistic competence and health outcomes as well as to evaluate interventions to increase practitioners’ cultural and linguistic competence. PMID:22437625

Validation of a psychometric instrument to assess motivation in veterinary bachelor students.

PubMed

Vandeweerd, Jean-Michel; Dugdale, Alexandra; Romainville, Marc

2014-01-01

There are indications that motivation correlates with better performance for those studying veterinary medicine. To assess objectively whether motivation profiles influence both veterinary students' attitudes towards educational interventions and their academic success and whether changes in curriculum can affect students' motivation, there is need for an instrument that can provide a valid measurement of the strength of motivation for the study of veterinary medicine. Our objectives were to design and validate a questionnaire that can be used as a psychometric scale to capture the motivation profiles of veterinary students. Question items were obtained from semi-structured interviews with students and from a review of the relevant literature. Each item was scored on a 5-point scale. The preliminary instrument was trialed on a cohort of 450 students. Responses were subjected to reliability and principal component analysis. A 14-item scale was designed, within which two factors explained 53.4% of the variance among the items. The scale had good face, content, and construct validities as well as a good internal consistency (Cronbach's alpha=.88).

Evaluation of Instructional Materials for Exceptional Children and Youth: A Preliminary Instrument.

ERIC Educational Resources Information Center

Eash, Maurice

An instrument for the evaluation of instructional materials is presented. Evaluative items are arranged under four constructs: objectives, organization of material (both scope and sequence), methodology, and evaluation. A section is also provided for summary quantitative judgment. A glossary of terms used in the instrument is included. A training…

Development of tailorable advanced blanket insulation for advanced space transportation systems

NASA Technical Reports Server (NTRS)

Calamito, Dominic P.

1987-01-01

Two items of Tailorable Advanced Blanket Insulation (TABI) for Advanced Space Transportation Systems were produced. The first consisted of flat panels made from integrally woven, 3-D fluted core having parallel fabric faces and connecting ribs of Nicalon silicon carbide yarns. The triangular cross section of the flutes were filled with mandrels of processed Q-Fiber Felt. Forty panels were prepared with only minimal problems, mostly resulting from the unavailability of insulation with the proper density. Rigidizing the fluted fabric prior to inserting the insulation reduced the production time. The procedures for producing the fabric, insulation mandrels, and TABI panels are described. The second item was an effort to determine the feasibility of producing contoured TABI shapes from gores cut from flat, insulated fluted core panels. Two gores of integrally woven fluted core and single ply fabric (ICAS) were insulated and joined into a large spherical shape employing a tadpole insulator at the mating edges. The fluted core segment of each ICAS consisted of an Astroquartz face fabric and Nicalon face and rib fabrics, while the single ply fabric segment was Nicalon. Further development will be required. The success of fabricating this assembly indicates that this concept may be feasible for certain types of space insulation requirements. The procedures developed for weaving the ICAS, joining the gores, and coating certain areas of the fabrics are presented.

Nurses' Empowerment Scale for ICU patients' families: an instrument development study.

PubMed

Li, Hong; Liu, Ya-Lan; Qiu, Li; Chen, Qiao-Ling; Wu, Jing-Bing; Chen, Li-Li; Li, Na

2016-09-01

Family members provide essential support for ICU patients, contributing to their mental and physical recovery. Empowering ICU patients' families may help them overcome inadequacies and meet their own and patients' acknowledged needs. Nursing should understand and address patients' families' empowerment status. To develop a tool, the Nurses' Empowerment Scale for Intensive Care Unit (ICU) Patients' Families (NESIPF), to help ICU nursing staff assess the empowerment status of patients' families. Four-phase instrument development study. A 19-item instrument was initially generated based on literature review and interviews with family members of ICU patients. The Delphi research method was applied to gain expert opinion and consensus via rounds of questionnaires. A panel of 27 experts experienced in critical care medicine, nursing and psychology participated in two Delphi rounds and their input helped formulate an 18-item pretest instrument. Families of 20 patients were recruited to examine instrument readability. After a 2-week interval, another 20 patients' families were recruited to examine test-retest reliability. Two hundred questionnaires were then administered and analysed to examine the instrument's construct validity, criterion-related validity and internal consistency. Expert authority coefficients of two Delphi rounds reached 0·89 and 0·91. Kendall' W coefficients of 0·113 (P < 0·001) in round 1 and 0·220 (P < 0·001) in round 2 indicated slight to fair agreement among experts. Content validity index (CVI) reached 1·0 for 12 items; the CVI for item 13 was <0·7 so it was excluded. Cronbach's α coefficient was 0·92, indicating acceptable internal consistency reliability. The coefficient of internal consistency of each dimension was 0·717-0·921. The Pearson correlation coefficient >0·9 (P < 0·05) showed an acceptable test-retest reliability. The instrument has acceptable reliability and validity and can assess the empowerment status of families of

Assessing food selection in a health promotion program: validation of a brief instrument for American Indian children in the southwest United States.

PubMed

Koehler, K M; Cunningham-Sabo, L; Lambert, L C; McCalman, R; Skipper, B J; Davis, S M

2000-02-01

Brief dietary assessment instruments are needed to evaluate behavior changes of participants in dietary intervention programs. The purpose of this project was to design and validate an instrument for children participating in Pathways to Health, a culturally appropriate, cancer prevention curriculum. Validation of a brief food selection instrument, Yesterday's Food Choices (YFC), which contained 33 questions about foods eaten the previous day with response choices of yes, no, or not sure. Reference data for validation were 24-hour dietary recalls administered individually to 120 students selected randomly. The YFC and 24-hour dietary recalls were administered to American Indian children in fifth- and seventh-grade classes in the Southwest United States. Dietary recalls were coded for food items in the YFC and results were compared for each item using percentage agreement and the kappa statistic. Percentage agreement for all items was greater than 60%; for most items it was greater than 70%, and for several items it was greater than 80%. The amount of agreement beyond that explained by chance (kappa statistic) was generally small. Three items showed substantial agreement beyond chance (kappa > or = 0.6); 2 items showed moderate agreement (kappa = 0.40 to 0.59) most items showed fair agreement (kappa = 0.20 to 0.39). The food items showing substantial agreement were hot or cold cereal, low-fat milk, and mutton or chile stew. Fried or scrambled eggs and deep-fried foods showed moderate agreement beyond chances. Previous development and validation of brief food selection instruments for children participating in health promotion programs has had limited success. In this study, instrument-related factors that apparently contributed to poor agreement between data from the YFC and 24-hour dietary recall were inclusion of categories of foods vs specific foods; food knowledge, preparation, and vocabulary, item length, and overreporting of attractive foods. Collecting and

Developing an instrument to measure emotional behaviour abilities of meaningful learning through the Delphi technique.

PubMed

Cadorin, Lucia; Bagnasco, Annamaria; Tolotti, Angela; Pagnucci, Nicola; Sasso, Loredana

2017-09-01

To identify items for a new instrument that measures emotional behaviour abilities of meaningful learning, according to Fink's Taxonomy. Meaningful learning is an active process that promotes a wider and deeper understanding of concepts. It is the result of an interaction between new and previous knowledge and produces a long-term change of knowledge and skills. To measure meaningful learning capability, it is very important in the education of health professionals to identify problems or special learning needs. For this reason, it is necessary to create valid instruments. A Delphi Study technique was implemented in four phases by means of e-mail. The study was conducted from April-September 2015. An expert panel consisting of ten researchers with experience in Fink's Taxonomy was established to identify the items of the instrument. Data were analysed for conceptual description and item characteristics and attributes were rated. Expert consensus was sought in each of these phases. An 87·5% consensus cut-off was established. After four rounds, consensus was obtained for validation of the content of the instrument 'Assessment of Meaningful learning Behavioural and Emotional Abilities'. This instrument consists of 56 items evaluated on a 6-point Likert-type scale. Foundational Knowledge, Application, Integration, Human Dimension, Caring and Learning How to Learn were the six major categories explored. This content validated tool can help educators (teachers, trainers and tutors) to identify and improve the strategies to support students' learning capability, which could increase their awareness of and/or responsibility in the learning process. © 2017 John Wiley & Sons Ltd.

Developing the Communicative Participation Item Bank: Rasch Analysis Results From a Spasmodic Dysphonia Sample

PubMed Central

Baylor, Carolyn R.; Yorkston, Kathryn M.; Eadie, Tanya L.; Miller, Robert M.; Amtmann, Dagmar

2011-01-01

Purpose The purpose of this study was to conduct the initial psychometric analyses of the Communicative Participation Item Bank—a new self-report instrument designed to measure the extent to which communication disorders interfere with communicative participation. This item bank is intended for community-dwelling adults across a range of communication disorders. Method A set of 141 candidate items was administered to 208 adults with spasmodic dysphonia. Participants rated the extent to which their condition interfered with participation in various speaking communication situations. Questionnaires were administered online or in a paper version per participant preference. Participants also completed the Voice Handicap Index (B. H. Jacobson et al., 1997) and a demographic questionnaire. Rasch analyses were conducted using Winsteps software (J. M. Linacre, 1991). Results The results show that items functioned better when the 5-category response format was recoded to a 4-category format. After removing 8 items that did not fit the Rasch model, the remaining 133 items demonstrated strong evidence of sufficient unidimensionality, with the model accounting for 89.3% of variance. Item location values ranged from −2.73 to 2.20 logits. Conclusions Preliminary Rasch analyses of the Communicative Participation Item Bank show strong psychometric properties. Further testing in populations with other communication disorders is needed. PMID:19717652

Development and Validation of a Quality-of-Life Instrument for Infantile Hemangiomas.

PubMed

Chamlin, Sarah L; Mancini, Anthony J; Lai, Jin-Shei; Beaumont, Jennifer L; Cella, David; Adams, Denise; Drolet, Beth; Baselga, Eulalia; Frieden, Ilona J; Garzon, Maria; Holland, Kristin; Horii, Kimberly A; Lucky, Anne W; McCuaig, Catherine; Metry, Denise; Morel, Kimberly D; Newell, Brandon D; Nopper, Amy J; Powell, Julie; Siegel, Dawn; Haggstrom, Anita N

2015-06-01

Infantile hemangiomas (IH) are common tumors for which there is no validated disease-specific instrument to measure the quality of life in infants and their parents/caregivers during the critical first months of life. This study prospectively developed and validated a quality-of-life instrument for patients with IH and their parents/caregivers and correlated demographic and clinical features to the effects on the quality of life. A total of 220 parents/caregivers completed the 35-item Infantile Hemangioma Quality-of-Life (IH-QoL) instrument and provided demographic information. The dimensionality of the items was evaluated using factor analysis, with results suggesting four factors: child physical symptoms, child social interactions, parent emotional functioning, and parent psychosocial functioning. Each factor fit the Rasch measurement model with acceptable fit index (mean square <1.4) and demonstrated excellent internal consistency, with alpha ranging from 0.76 to 0.88. The final instrument consists of four scales with a total of 29 items. Content validity was verified by analyzing parents' responses to an open-ended question. Test-retest reliability at a 48-hour interval was supported by a total IH-QoL intraclass correlation coefficient of 0.84. Certain clinical characteristics of hemangioma, including those located on the head and neck, in the proliferative stage, and requiring treatment, are associated with a greater impact on QoL.

Development and Validation of the Numeracy Understanding in Medicine Instrument Short Form

PubMed Central

Schapira, Marilyn M.; Walker, Cindy M.; Miller, Tamara; Fletcher, Kathlyn A; Ganschow, Pamela G.; Jacobs, Elizabeth A; Imbert, Diana; O'Connell, Maria; Neuner, Joan M.

2014-01-01

Background Health numeracy can be defined as the ability to understand and use numeric information and quantitative concepts in the context of health. We previously reported the development of the Numeracy Understanding in Medicine Instrument (NUMi); a 20-item test developed using item response theory. We now report the development and validation of a short form of the NUMi. Methods Item statistics were used to identify a subset of 8-items representing a range of difficulty and content areas. Internal reliability was evaluated with Cronbach's alpha. Divergent and convergent validity was assessed by comparing scores of the S-NUMI with existing measures of education, print and numeric health literacy, mathematic achievement, cognitive reasoning, and the original NUMi. Results The 8-item scale had adequate reliability (Cronbach's alpha: 0.72) and was strongly correlated to the 20-item NUMi (0.92). The S-NUMi scores were strongly correlated with the Lipkus numeracy test (0.62), Wide Range of Achievement Test-Mathematics (WRAT-M) (0.72), and Wonderlic cognitive reasoning test (0.76). Moderate correlation was found with education level (0.58) and print literacy as measured by the TOFHLA (0.49). Conclusion The short Numeracy Understanding in Medicine Instrument is a reliable and valid measure of health numeracy feasible for use in clinical and research settings. PMID:25315596

Validation of the Malay Version of the Parental Bonding Instrument among Malaysian Youths Using Exploratory Factor Analysis.

PubMed

Muhammad, Noor Azimah; Shamsuddin, Khadijah; Omar, Khairani; Shah, Shamsul Azhar; Mohd Amin, Rahmah

2014-01-01

Parenting behaviour is culturally sensitive. The aims of this study were (1) to translate the Parental Bonding Instrument into Malay (PBI-M) and (2) to determine its factorial structure and validity among the Malaysian population. The PBI-M was generated from a standard translation process and comprehension testing. The validation study of the PBI-M was administered to 248 college students aged 18 to 22 years. Participants in the comprehension testing had difficulty understanding negative items. Five translated double negative items were replaced with five positive items with similar meanings. Exploratory factor analysis showed a three-factor model for the PBI-M with acceptable reliability. Four negative items (items 3, 4, 8, and 16) and item 19 were omitted from the final PBI-M list because of incorrect placement or low factor loading (< 0.32). Out of the final 20 items of the PBI-M, there were 10 items for the care factor, five items for the autonomy factor and five items for the overprotection factor. All the items loaded positively on their respective factors. The Malaysian population favoured positive items in answering questions. The PBI-M confirmed the three-factor model that consisted of care, autonomy and overprotection. The PBI-M is a valid and reliable instrument to assess the Malaysian parenting style. Confirmatory factor analysis may further support this finding. Malaysia, parenting, questionnaire, validity.

IRT Item Parameter Scaling for Developing New Item Pools

ERIC Educational Resources Information Center

Kang, Hyeon-Ah; Lu, Ying; Chang, Hua-Hua

2017-01-01

Increasing use of item pools in large-scale educational assessments calls for an appropriate scaling procedure to achieve a common metric among field-tested items. The present study examines scaling procedures for developing a new item pool under a spiraled block linking design. The three scaling procedures are considered: (a) concurrent…

PACIC Instrument: disentangling dimensions using published validation models.

PubMed

Iglesias, K; Burnand, B; Peytremann-Bridevaux, I

2014-06-01

To better understand the structure of the Patient Assessment of Chronic Illness Care (PACIC) instrument. More specifically to test all published validation models, using one single data set and appropriate statistical tools. Validation study using data from cross-sectional survey. A population-based sample of non-institutionalized adults with diabetes residing in Switzerland (canton of Vaud). French version of the 20-items PACIC instrument (5-point response scale). We conducted validation analyses using confirmatory factor analysis (CFA). The original five-dimension model and other published models were tested with three types of CFA: based on (i) a Pearson estimator of variance-covariance matrix, (ii) a polychoric correlation matrix and (iii) a likelihood estimation with a multinomial distribution for the manifest variables. All models were assessed using loadings and goodness-of-fit measures. The analytical sample included 406 patients. Mean age was 64.4 years and 59% were men. Median of item responses varied between 1 and 4 (range 1-5), and range of missing values was between 5.7 and 12.3%. Strong floor and ceiling effects were present. Even though loadings of the tested models were relatively high, the only model showing acceptable fit was the 11-item single-dimension model. PACIC was associated with the expected variables of the field. Our results showed that the model considering 11 items in a single dimension exhibited the best fit for our data. A single score, in complement to the consideration of single-item results, might be used instead of the five dimensions usually described. © The Author 2014. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Can tailored interventions increase mammography use among HMO women?

PubMed

Lipkus, I M; Rimer, B K; Halabi, S; Strigo, T S

2000-01-01

Telephone counseling and tailored print communications have emerged as promising methods for promoting mammography screening. However, there has been little research testing, within the same randomized field trial, of the efficacy of these two methods compared to a high-quality usual care system for enhancing screening. This study addressed the question: Compared to usual care, is tailored telephone counseling more effective than tailored print materials for promoting mammography screening? Three-year randomized field trial. One thousand ninety-nine women aged 50 and older recruited from a health maintenance organization in North Carolina. Women were randomized to 1 of 3 groups: (1) usual care, (2) tailored print communications, and (3) tailored telephone counseling. Adherence to mammography screening based on self-reports obtained during 1995, 1996, and 1997. Compared to usual care alone, telephone counseling promoted a significantly higher proportion of women having mammograms on schedule (71% vs 61%) than did tailored print (67% vs 61%) but only after the first year of intervention (during 1996). Furthermore, compared to usual care, telephone counseling was more effective than tailored print materials at promoting being on schedule with screening during 1996 and 1997 among women who were off-schedule during the previous year. The effects of the intervention were most pronounced after the first intervention. Compared to usual care, telephone counseling seemed particularly effective at promoting change among nonadherent women, the group for whom the intervention was developed. These results suggest that telephone counseling, rather than tailored print, might be the preferred first-line intervention for getting nonadherent women on schedule for mammography screening. Many questions would have to be answered about why the tailored print intervention was not more powerful. Nevertheless, it is clear that additional interventions will be needed to maintain women

Methodology for the development and calibration of the SCI-QOL item banks

PubMed Central

Tulsky, David S.; Kisala, Pamela A.; Victorson, David; Choi, Seung W.; Gershon, Richard; Heinemann, Allen W.; Cella, David

2015-01-01

Objective To develop a comprehensive, psychometrically sound, and conceptually grounded patient reported outcomes (PRO) measurement system for individuals with spinal cord injury (SCI). Methods Individual interviews (n = 44) and focus groups (n = 65 individuals with SCI and n = 42 SCI clinicians) were used to select key domains for inclusion and to develop PRO items. Verbatim items from other cutting-edge measurement systems (i.e. PROMIS, Neuro-QOL) were included to facilitate linkage and cross-population comparison. Items were field tested in a large sample of individuals with traumatic SCI (n = 877). Dimensionality was assessed with confirmatory factor analysis. Local item dependence and differential item functioning were assessed, and items were calibrated using the item response theory (IRT) graded response model. Finally, computer adaptive tests (CATs) and short forms were administered in a new sample (n = 245) to assess test-retest reliability and stability. Participants and Procedures A calibration sample of 877 individuals with traumatic SCI across five SCI Model Systems sites and one Department of Veterans Affairs medical center completed SCI-QOL items in interview format. Results We developed 14 unidimensional calibrated item banks and 3 calibrated scales across physical, emotional, and social health domains. When combined with the five Spinal Cord Injury – Functional Index physical function banks, the final SCI-QOL system consists of 22 IRT-calibrated item banks/scales. Item banks may be administered as CATs or short forms. Scales may be administered in a fixed-length format only. Conclusions The SCI-QOL measurement system provides SCI researchers and clinicians with a comprehensive, relevant and psychometrically robust system for measurement of physical-medical, physical-functional, emotional, and social outcomes. All SCI-QOL instruments are freely available on Assessment CenterSM. PMID:26010963

A Bifactor Multidimensional Item Response Theory Model for Differential Item Functioning Analysis on Testlet-Based Items

ERIC Educational Resources Information Center

Fukuhara, Hirotaka; Kamata, Akihito

2011-01-01

A differential item functioning (DIF) detection method for testlet-based data was proposed and evaluated in this study. The proposed DIF model is an extension of a bifactor multidimensional item response theory (MIRT) model for testlets. Unlike traditional item response theory (IRT) DIF models, the proposed model takes testlet effects into…

[Examination of calibrated item banks for the assessment of work capacity in an outpatient sample of cardiological patients].

PubMed

Haschke, A; Abberger, B; Schröder, K; Wirtz, M; Bengel, J; Baumeister, H

2013-12-01

Work capacity is a major outcome variable in cardiological rehabilitation. However, there is a lacks of capacious and economic assessment instruments for work capacity. By developing item response theory based item banks a first step to close this gap is done. The present study aims to validate the work capacity item banks for cardiovascular rehabilitation inpatients (WCIB-Cardio) in a sample of cardiovascular rehabilitation outpatients. Additionally, we examined differences between in- and outpatients with regard to their work capacity. Data of 283 cardiovascular rehabilitation inpatients and 77 cardiovascular rehabilitation outpatients were collected in 15 rehabilitation centres. The WCIB-Cardio contains the 2 domains of "cognitive work capacity"(20 items) and "physical work capacity"(18 items). Validation of the item bank for cardiological outpatients was conducted with separate Rasch analysis for each domain. For the domain of cognitive work capacity 10 items showed satisfying quality criteria (Rasch reliability=0.71; overall model fit=0.07). For the domain of physical work capacity good values for Rasch-reliability (0.83) and overall -model fit (0.65) could be proven after exclusion of 3 items. Unidimensionality and a broad ability spectrum could be covered for both domains. With regard to content, outpatients evaluate themselves less burdened than inpatients for the domain of cognitive work capacity (‾X outpatient =-2.06 vs. ‾X inpatient =-2.49; p<0.07) similarly for the domain of physical work capacity (‾X outpatient =-3.68 vs. ‾X inpatient =-2.88; p<0.01). With the WCIB-Cardio II there is a precondition to develop self-report instruments of work capacity in cardiological in- and outpatients. © Georg Thieme Verlag KG Stuttgart · New York.

Gender-Based Differential Item Performance in Mathematics Achievement Items.

ERIC Educational Resources Information Center

Doolittle, Allen E.; Cleary, T. Anne

1987-01-01

Eight randomly equivalent samples of high school seniors were each given a unique form of the ACT Assessment Mathematics Usage Test (ACTM). Signed measures of differential item performance (DIP) were obtained for each item in the eight ACTM forms. DIP estimates were analyzed and a significant item category effect was found. (Author/LMO)

Development and Validation of a Six-Item Version of the Interpersonal Dependency Inventory.

PubMed

McClintock, Andrew S; McCarrick, Shannon M; Anderson, Timothy; Himawan, Lina; Hirschfeld, Robert

2017-04-01

The Interpersonal Dependency Inventory (IDI) is a frequently used, 48-item measure of maladaptive dependency. Our goal was to develop and psychometrically evaluate a very brief version of the IDI. An exploratory factor analysis of the IDI in Study 1 ( N = 838) yielded a six-item IDI (IDI-6), with three items loading on an emotional dependency factor (IDI-6-ED), and the other three items loading on a functional dependency factor (IDI-6-FD). This factor solution was validated by confirmatory factor analysis in Study 2 ( N = 916). The IDI-6-ED and IDI-6-FD demonstrated good convergent and divergent validity in Study 3 ( N = 100). In Study 4 ( N = 22-43), the IDI-6-ED and IDI-6-FD were generally stable over 4-week and 8-week intervals and were found to be responsive to the effects of psychological treatment. These results have implications for dependency conceptualizations and support the IDI-6 as a brief, psychometrically sound instrument.

Student mathematical imagination instruments: construction, cultural adaptation and validity

NASA Astrophysics Data System (ADS)

Dwijayanti, I.; Budayasa, I. K.; Siswono, T. Y. E.

2018-03-01

Imagination has an important role as the center of sensorimotor activity of the students. The purpose of this research is to construct the instrument of students’ mathematical imagination in understanding concept of algebraic expression. The researcher performs validity using questionnaire and test technique and data analysis using descriptive method. Stages performed include: 1) the construction of the embodiment of the imagination; 2) determine the learning style questionnaire; 3) construct instruments; 4) translate to Indonesian as well as adaptation of learning style questionnaire content to student culture; 5) perform content validation. The results stated that the constructed instrument is valid by content validation and empirical validation so that it can be used with revisions. Content validation involves Indonesian linguists, english linguists and mathematics material experts. Empirical validation is done through a legibility test (10 students) and shows that in general the language used can be understood. In addition, a questionnaire test (86 students) was analyzed using a biserial point correlation technique resulting in 16 valid items with a reliability test using KR 20 with medium reability criteria. While the test instrument test (32 students) to find all items are valid and reliability test using KR 21 with reability is 0,62.

Short version of the "instrument for assessment of stress in nursing students" in the Brazilian reality.

PubMed

Costa, Ana Lúcia Siqueira; Silva, Rodrigo Marques da; Mussi, Fernanda Carneiro; Serrano, Patrícia Maria; Graziano, Eliane da Silva; Batista, Karla de Melo

2018-01-08

validate a short version of the Instrument for assessment of stress in nursing students in the Brazilian reality. Methodological study conducted with 1047 nursing students from five Brazilian institutions, who answered the 30 items initially distributed in eight domains. Data were analyzed in the R Statistical Package and in the latent variable analysis, using exploratory and confirmatory factor analyses, Cronbach's alpha and item-total correlation. The short version of the instrument had 19 items distributed into four domains: Environment, Professional Training, Theoretical Activities and Performance of Practical Activities. The confirmatory analysis showed absolute and parsimony fit to the proposed model with satisfactory residual levels. Alpha values ​​per factor ranged from 0.736 (Environment) to 0.842 (Performance of Practical Activities). The short version of the instrument has construct validity and reliability for application to Brazilian nursing undergraduates at any stage of the course.

Measuring quality of life in opioid-dependent people: a systematic review of assessment instruments.

PubMed

Strada, Lisa; Vanderplasschen, Wouter; Buchholz, Angela; Schulte, Bernd; Muller, Ashley E; Verthein, Uwe; Reimer, Jens

2017-12-01

Opioid dependence is a chronic relapsing disorder. Despite increasing research on quality of life (QOL) in people with opioid dependence, little attention has been paid to the instruments used. This systematic review examines the suitability of QOL instruments for use in opioid-dependent populations and the instruments' quality. A systematic search was performed in the databases Medline, PsycInfo, The Cochrane Library, and CINAHL. Articles were eligible if they assessed QOL of opioid-dependent populations using a validated QOL instrument. Item content relevance to opioid-dependent people was evaluated by means of content analysis, and instrument properties were assessed using minimum standards for patient-reported outcome measures. Eighty-nine articles were retrieved, yielding sixteen QOL instruments, of which ten were assessed in this review. Of the ten instruments, six were disease specific, but none for opioid dependence. Two instruments had good item content relevance. The conceptual and measurement model were described in seven instruments. Four instruments were developed with input from the respective target population. Eight instruments had low respondent and administrator burden. Psychometric properties were either not assessed in opioid-dependent populations or were inconclusive or moderate. No instrument scored perfectly on both the content and properties. The limited suitability of instruments for opioid-dependent people hinders accurate and sensitive measurement of QOL in this population. Future research is in need of an opioid dependence-specific QOL instrument to measure the true impact of the disease on people's lives and to evaluate treatment-related services.

Real and Artificial Differential Item Functioning in Polytomous Items

ERIC Educational Resources Information Center

Andrich, David; Hagquist, Curt

2015-01-01

Differential item functioning (DIF) for an item between two groups is present if, for the same person location on a variable, persons from different groups have different expected values for their responses. Applying only to dichotomously scored items in the popular Mantel-Haenszel (MH) method for detecting DIF in which persons are classified by…

Assessment for Learning Instrumentation in Higher Education

ERIC Educational Resources Information Center

Akib, Erwin; Ghafar, Mohamad Najib Abdul

2015-01-01

This study explains assessment for learning instrumentation, especially in higher education. The population of this study was 100 lecturers of the Muhammadiyah Makassar University, Indonesia. A total of 50 items from six construct were analyzed and used to determine the reliability and validity of the questionnaire. The result shows that the…

Development and validation of a 6-item working alliance questionnaire for repeated administrations during psychotherapy.

PubMed

Falkenström, Fredrik; Hatcher, Robert L; Skjulsvik, Tommy; Larsson, Mattias Holmqvist; Holmqvist, Rolf

2015-03-01

Recently, researchers have started to measure the working alliance repeatedly across sessions of psychotherapy, relating the working alliance to symptom change session by session. Responding to questionnaires after each session can become tedious, leading to careless responses and/or increasing levels of missing data. Therefore, assessment with the briefest possible instrument is desirable. Because previous research on the Working Alliance Inventory has found the separation of the Goal and Task factors problematic, the present study examined the psychometric properties of a 2-factor, 6-item working alliance measure, adapted from the Working Alliance Inventory, in 3 patient samples (ns = 1,095, 235, and 234). Results showed that a bifactor model fit the data well across the 3 samples, and the factor structure was stable across 10 sessions of primary care counseling/psychotherapy. Although the bifactor model with 1 general and 2 specific factors outperformed the 1-factor model in terms of model fit, dimensionality analyses based on the bifactor model results indicated that in practice the instrument is best treated as unidimensional. Results support the use of composite scores of all 6 items. The instrument was validated by replicating previous findings of session-by-session prediction of symptom reduction using the Autoregressive Latent Trajectory model. The 6-item working alliance scale, called the Session Alliance Inventory, is a promising alternative for researchers in search for a brief alliance measure to administer after every session. 2015 APA, all rights reserved

Confirmatory factor analysis of teaching and learning guiding principles instrument among teacher educators in higher education institutions

NASA Astrophysics Data System (ADS)

Masuwai, Azwani; Tajudin, Nor'ain Mohd; Saad, Noor Shah

2017-05-01

The purpose of this study is to develop and establish the validity and reliability of an instrument to generate teaching and learning guiding principles using Teaching and Learning Guiding Principles Instrument (TLGPI). Participants consisted of 171 Malaysian teacher educators. It is an essential instrument to reflect in generating the teaching and learning guiding principles in higher education level in Malaysia. Confirmatory Factor Analysis has validated all 19 items of TLGPI whereby all items indicated high reliability and internal consistency. A Confirmatory Factor Analysis also confirmed that a single factor model was used to generate teaching and learning guiding principles.

[An instrument for assessing clinical aptitude in cervicovaginitis in the family medicine practice].

PubMed

Arrieta-Pérez, Raúl Tomás; Lona-Calixto, Beatriz

2011-01-01

the cervicovaginitis is one of the first twelve causes on demand at primary care medicine thus the family physician must be able to identify and treat it. The objective was to validate a constructed instrument for measuring the clinical aptitude on cervicovaginitis. cross-sectional, descriptive, prolective study was carried out. An instrument with five clinical cases was done. It has seven indicators, whose answers were true, false and I do not know. The validity content was done by three family physicians and a Gynecologist, with experience in education. The trustworthiness was determined by means of the test of Kuder-Richardson formula 20 with the results obtained in a pilot test in 50 family medicine residents. the instrument was constituted by five clinical cases with 140 Items distributed in seven indicators with 20 items for each indicator and a total of 70 true answers and 70 false answers; seven categories for the degree of clinical aptitude settled down. The trustworthiness of the instrument was 0.81. the instrument is valid and reliable to identify the clinical aptitude of the family physician on cervicovaginitis.

The Revised Two-Factor Study Process Questionnaire (R-SPQ-2F): Exploratory and Confirmatory Factor Analyses at Item Level

ERIC Educational Resources Information Center

Justicia, Fernando; Pichardo, M. Carmen; Cano, Francisco; Berben, A. B. G.; De la Fuente, Jesus

2008-01-01

The underlying structure of the Revised Two Factor version of the Study Process Questionnaire (R-SPQ-2F), a 20-item instrument for the evaluation of students' approaches to learning (SAL), was examined at item level using two independent groups of undergraduate students enrolled in the first (n = 314) and last (n = 522) years of their studies. The…

Development of the PRE-HIT instrument: patient readiness to engage in health information technology.

PubMed

Koopman, Richelle J; Petroski, Gregory F; Canfield, Shannon M; Stuppy, Julie A; Mehr, David R

2014-01-28

Technology-based aids for lifestyle change are becoming more prevalent for chronic conditions. Important "digital divides" remain, as well as concerns about privacy, data security, and lack of motivation. Researchers need a way to characterize participants' readiness to use health technologies. To address this need, we created an instrument to measure patient readiness to engage with health technologies among adult patients with chronic conditions. Initial focus groups to determine domains, followed by item development and refinement, and exploratory factor analysis to determine final items and factor structure. The development sample included 200 patients with chronic conditions from 6 family medicine clinics. From 98 potential items, 53 best candidate items were examined using exploratory factor analysis. Pearson's Correlation for Test/Retest reliability at 3 months. The final instrument had 28 items that sorted into 8 factors with associated Cronbach's alpha: 1) Health Information Need (0.84), 2) Computer/Internet Experience (0.87), 3) Computer Anxiety (0.82), 4) Preferred Mode of Interaction (0.73), 5) Relationship with Doctor (0.65), 6) Cell Phone Expertise (0.75), 7) Internet Privacy (0.71), and 8) No News is Good News (0.57). Test-retest reliability for the 8 subscales ranged from (0.60 to 0.85). The Patient Readiness to Engage in Health Internet Technology (PRE-HIT) instrument has good psychometric properties and will be an aid to researchers investigating technology-based health interventions. Future work will examine predictive validity.

Development of the PRE-HIT instrument: patient readiness to engage in health information technology

PubMed Central

2014-01-01

Background Technology-based aids for lifestyle change are becoming more prevalent for chronic conditions. Important “digital divides” remain, as well as concerns about privacy, data security, and lack of motivation. Researchers need a way to characterize participants’ readiness to use health technologies. To address this need, we created an instrument to measure patient readiness to engage with health technologies among adult patients with chronic conditions. Methods Initial focus groups to determine domains, followed by item development and refinement, and exploratory factor analysis to determine final items and factor structure. The development sample included 200 patients with chronic conditions from 6 family medicine clinics. From 98 potential items, 53 best candidate items were examined using exploratory factor analysis. Pearson’s Correlation for Test/Retest reliability at 3 months. Results The final instrument had 28 items that sorted into 8 factors with associated Cronbach’s alpha: 1) Health Information Need (0.84), 2) Computer/Internet Experience (0.87), 3) Computer Anxiety (0.82), 4) Preferred Mode of Interaction (0.73), 5) Relationship with Doctor (0.65), 6) Cell Phone Expertise (0.75), 7) Internet Privacy (0.71), and 8) No News is Good News (0.57). Test-retest reliability for the 8 subscales ranged from (0.60 to 0.85). Conclusion The Patient Readiness to Engage in Health Internet Technology (PRE-HIT) instrument has good psychometric properties and will be an aid to researchers investigating technology-based health interventions. Future work will examine predictive validity. PMID:24472182

The FASES instrument development and experiment preparation for the ISS

NASA Astrophysics Data System (ADS)

Picker, Gerold; Gollinger, Klaus; Greger, Ralf; Dettmann, Jan; Winter, Josef; Dewandre, Thierry; Castiglione, Luigi; Vincent-Bonnieu, Sebastien; Liggieri, Libero; Clausse, Daniele; Antoni, Mickael

The FASES experiments target the investigation of the stability of emulsions. The main objec-tives are the study of the surfactant adsorption at the liquid / liquid interfaces, the interaction of the droplets as well as the behaviour of the liquid film between nearby drops. Particular focus is given to the dynamic droplet evolution during emulsion destabilisation. The results of the experiments shall support development of methods for the modelling of droplet size distri-butions, which are important to many industries using stable emulsions like food production, cosmetics and pharmaceutics or unstable emulsions as required for applications in waste water treatment or crude oil recovery. The development of the experimental instrumentation was initiated in 2002. The flight instru-ment hardware development was started in 2004 and finally the flight unit was completed in 2009. Currently the final flight preparation is proceeding targeting a launch to the International Space Station (ISS) with Progress 39P in September 2010. The experiment setup of the instrument is accommodated in a box type insert called Experiment Container (EC), which will be installed in the Fluid Science Laboratory part of the European Columbus module of the ISS. The EC is composed of two diagnostics instruments for the investigation of transparent and opaque liquid emulsion. The transparent emulsions will be subject to the experiment called "Investigations on drop/drop interactions in Transparent Emulsions" (ITEM). The opaque emulsion samples will be studied in the experiment called "Investigations on concentrated or opaque Emulsions and on Phase Inversions" (EMPI). The thermal conditioning unit (TCU) allows performing homogeneous thermalization, tem-perature sweeps, emulsion preparation by stirrer, and optical diagnostics with a scanning mi-croscope. The objective of the instrument is the 3D reconstruction of the emulsion droplet distribution in the liquid matrix in terms of the droplet sizes

Component Identification and Item Difficulty of Raven's Matrices Items.

ERIC Educational Resources Information Center

Green, Kathy E.; Kluever, Raymond C.

Item components that might contribute to the difficulty of items on the Raven Colored Progressive Matrices (CPM) and the Standard Progressive Matrices (SPM) were studied. Subjects providing responses to CPM items were 269 children aged 2 years 9 months to 11 years 8 months, most of whom were referred for testing as potentially gifted. A second…

Missing content from health-related quality of life instruments: interviews with young adult survivors of childhood cancer.

PubMed

Quinn, Gwendolyn P; Huang, I-Chan; Murphy, Devin; Zidonik-Eddelton, Katie; Krull, Kevin R

2013-02-01

Young adult survivors of childhood cancer (YASCC) are an ever-growing cohort of survivors due to increasing advances in technology. Today, there is a shift of focus to not just ensuring survivorship but also the quality of survivorship, which can be assessed with standardized instruments. The majority of standardized health related quality of life (HRQoL) instruments, however, are non-specific to this age group and the unique late effects within YASCC populations. The purpose of this study was to investigate the relevance and accuracy of standardized HRQoL instruments used with YASCC. In a previous study, HRQoL items from several instruments (SF-36, QLACS, QLS-CS) were examined for relevance with a population of YASCC. Participants (n = 30) from this study were recruited for a follow-up qualitative interview to expand on their perceptions of missing content from existing instruments. Respondents reported missing, relevant content among all three of the HRQoL instruments. Results identified three content areas of missing information: (1) Perceived sense of self, (2) Relationships, and (3) Parenthood. Existing HRQoL instruments do not take into account the progression and interdependence of emotional development impacted by a cancer diagnosis. The themes derived from our qualitative interviews may serve as a foundation for the generation of new items in future HRQoL instruments for YASCC populations. Further testing is required to examine the prevalence, frequency, and breadth of these items in a larger sample.

Tailored Codes for Small Quantum Memories

NASA Astrophysics Data System (ADS)

Robertson, Alan; Granade, Christopher; Bartlett, Stephen D.; Flammia, Steven T.

2017-12-01

We demonstrate that small quantum memories, realized via quantum error correction in multiqubit devices, can benefit substantially by choosing a quantum code that is tailored to the relevant error model of the system. For a biased noise model, with independent bit and phase flips occurring at different rates, we show that a single code greatly outperforms the well-studied Steane code across the full range of parameters of the noise model, including for unbiased noise. In fact, this tailored code performs almost optimally when compared with 10 000 randomly selected stabilizer codes of comparable experimental complexity. Tailored codes can even outperform the Steane code with realistic experimental noise, and without any increase in the experimental complexity, as we demonstrate by comparison in the observed error model in a recent seven-qubit trapped ion experiment.

Item Banks for Measuring Emotional Distress From the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, Anxiety, and Anger

PubMed Central

Pilkonis, Paul A.; Choi, Seung W.; Reise, Steven P.; Stover, Angela M.; Riley, William T.; Cella, David

2011-01-01

The authors report on the development and calibration of item banks for depression, anxiety, and anger as part of the Patient-Reported Outcomes Measurement Information System (PROMIS®). Comprehensive literature searches yielded an initial bank of 1,404 items from 305 instruments. After qualitative item analysis (including focus groups and cognitive interviewing), 168 items (56 for each construct) were written in a first person, past tense format with a 7-day time frame and five response options reflecting frequency. The calibration sample included nearly 15,000 respondents. Final banks of 28, 29, and 29 items were calibrated for depression, anxiety, and anger, respectively, using item response theory. Test information curves showed that the PROMIS item banks provided more information than conventional measures in a range of severity from approximately −1 to +3 standard deviations (with higher scores indicating greater distress). Short forms consisting of seven to eight items provided information comparable to legacy measures containing more items. PMID:21697139

Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): depression, anxiety, and anger.

PubMed

Pilkonis, Paul A; Choi, Seung W; Reise, Steven P; Stover, Angela M; Riley, William T; Cella, David

2011-09-01

The authors report on the development and calibration of item banks for depression, anxiety, and anger as part of the Patient-Reported Outcomes Measurement Information System (PROMIS®). Comprehensive literature searches yielded an initial bank of 1,404 items from 305 instruments. After qualitative item analysis (including focus groups and cognitive interviewing), 168 items (56 for each construct) were written in a first person, past tense format with a 7-day time frame and five response options reflecting frequency. The calibration sample included nearly 15,000 respondents. Final banks of 28, 29, and 29 items were calibrated for depression, anxiety, and anger, respectively, using item response theory. Test information curves showed that the PROMIS item banks provided more information than conventional measures in a range of severity from approximately -1 to +3 standard deviations (with higher scores indicating greater distress). Short forms consisting of seven to eight items provided information comparable to legacy measures containing more items.

To Sum or Not to Sum: Taxometric Analysis with Ordered Categorical Assessment Items

ERIC Educational Resources Information Center

Walters, Glenn D.; Ruscio, John

2009-01-01

Meehl's taxometric method has been shown to differentiate between categorical and dimensional data, but there are many ways to implement taxometric procedures. When analyzing the ordered categorical data typically provided by assessment instruments, summing items to form input indicators has been a popular practice for more than 20 years. A Monte…

Rater reliability and concurrent validity of the Keyboard Personal Computer Style instrument (K-PeCS).

PubMed

Baker, Nancy A; Cook, James R; Redfern, Mark S

2009-01-01

This paper describes the inter-rater and intra-rater reliability, and the concurrent validity of an observational instrument, the Keyboard Personal Computer Style instrument (K-PeCS), which assesses stereotypical postures and movements associated with computer keyboard use. Three trained raters independently rated the video clips of 45 computer keyboard users to ascertain inter-rater reliability, and then re-rated a sub-sample of 15 video clips to ascertain intra-rater reliability. Concurrent validity was assessed by comparing the ratings obtained using the K-PeCS to scores developed from a 3D motion analysis system. The overall K-PeCS had excellent reliability [inter-rater: intra-class correlation coefficients (ICC)=.90; intra-rater: ICC=.92]. Most individual items on the K-PeCS had from good to excellent reliability, although six items fell below ICC=.75. Those K-PeCS items that were assessed for concurrent validity compared favorably to the motion analysis data for all but two items. These results suggest that most items on the K-PeCS can be used to reliably document computer keyboarding style.

Evaluation of an immunosuppressant side effect instrument.

PubMed

Winsett, Rebecca P; Arheart, Kris; Stratta, Robert J; Alloway, Rita; Wicks, Mona N; Gaber, A Osama; Hathaway, Donna K

2004-09-01

Clinicians continue to be compelled to evaluate the impact of immunosuppressive medication side effects on the quality of life of transplant recipients. We Were asked to develop an instrument to measure side effects in immunosuppressed transplant recipients. To construct an instrument that measures the impact and severity of side effects of immunosuppressive medications used in transplantation and to assess the reliability and validity of the newly developed instrument called the Memphis Survey. The instrument was constructed by a panel of physicians, nurses, and pharmacists with experience in treating transplant recipients. A small group of kidney transplant recipients (n= 13) provided pilot data for refining and testing the instrument. A national sample of kidney, liver, and heart transplant recipients (n = 505) provided data that were used to further develop the instrument. Factor analysis was used to determine the psychological dimensions underlying the instrument and to guide the construction of scales from the survey items. The instrument scales were then computed from the dataset of 505 transplant recipients to quantify the impact of immunosuppressant side effects on the quality of life of transplant recipients. Analyses showed the final instrument scales to be valid and reliable. Exploratory analysis suggests the need for further testing of the instrument to determine gender differences.

Evaluation of psychometric properties and differential item functioning of 8-item Child Perceptions Questionnaires using item response theory.

PubMed

Yau, David T W; Wong, May C M; Lam, K F; McGrath, Colman

2015-08-19

Four-factor structure of the two 8-item short forms of Child Perceptions Questionnaire CPQ11-14 (RSF:8 and ISF:8) has been confirmed. However, the sum scores are typically reported in practice as a proxy of Oral health-related Quality of Life (OHRQoL), which implied a unidimensional structure. This study first assessed the unidimensionality of 8-item short forms of CPQ11-14. Item response theory (IRT) was employed to offer an alternative and complementary approach of validation and to overcome the limitations of classical test theory assumptions. A random sample of 649 12-year-old school children in Hong Kong was analyzed. Unidimensionality of the scale was tested by confirmatory factor analysis (CFA), principle component analysis (PCA) and local dependency (LD) statistic. Graded response model was fitted to the data. Contribution of each item to the scale was assessed by item information function (IIF). Reliability of the scale was assessed by test information function (TIF). Differential item functioning (DIF) across gender was identified by Wald test and expected score functions. Both CPQ11-14 RSF:8 and ISF:8 did not deviate much from the unidimensionality assumption. Results from CFA indicated acceptable fit of the one-factor model. PCA indicated that the first principle component explained >30 % of the total variation with high factor loadings for both RSF:8 and ISF:8. Almost all LD statistic <10 indicated the absence of local dependency. Flat and low IIFs were observed in the oral symptoms items suggesting little contribution of information to the scale and item removal caused little practical impact. Comparing the TIFs, RSF:8 showed slightly better information than ISF:8. In addition to oral symptoms items, the item "Concerned with what other people think" demonstrated a uniform DIF (p < 0.001). The expected score functions were not much different between boys and girls. Items related to oral symptoms were not informative to OHRQoL and deletion of these

Development and validation of an instrument to assess imminent risk of homelessness among veterans.

PubMed

Montgomery, Ann Elizabeth; Fargo, Jamison D; Kane, Vincent; Culhane, Dennis P

2014-01-01

Veterans are overrepresented within the homeless population compared with their non-veteran counterparts, particularly when controlling for poverty. The U.S. Department of Veterans Affairs (VA) aims to prevent new episodes of homelessness by targeting households at greatest risk; however, there are no instruments that systematically assess veterans' risk of homelessness. We developed and tested a brief screening instrument to identify imminent risk of homelessness among veterans accessing VA health care. The study team developed initial assessment items, conducted cognitive interviews with veterans experiencing homelessness, refined pilot items based on veterans' and experts' feedback and results of psychometric analyses, and assigned weights to items in the final instrument to indicate a measure of homelessness risk. One-third of veterans who responded to the field instrument reported imminent risk of homelessness (i.e., housing instability in the previous 90 days or expected in the next 90 days). The reliability coefficient for the instrument was 0.85, indicating good internal consistency. Veterans who had a recent change in income, had unpaid housing expenses, were living temporarily with family and friends, needed help to get or keep housing, and had poor rental and credit histories were more likely to report a risk of homelessness than those who did not. This study provides the field with an instrument to identify individuals and households at risk of or experiencing homelessness, which is necessary to prevent and end homelessness. In addition, it supports VA's investment in homelessness prevention and rapid rehousing services for veterans who are experiencing or are at risk for homelessness.

Validation of the Malay Version of the Parental Bonding Instrument among Malaysian Youths Using Exploratory Factor Analysis

PubMed Central

MUHAMMAD, Noor Azimah; SHAMSUDDIN, Khadijah; OMAR, Khairani; SHAH, Shamsul Azhar; MOHD AMIN, Rahmah

2014-01-01

Background: Parenting behaviour is culturally sensitive. The aims of this study were (1) to translate the Parental Bonding Instrument into Malay (PBI-M) and (2) to determine its factorial structure and validity among the Malaysian population. Methods: The PBI-M was generated from a standard translation process and comprehension testing. The validation study of the PBI-M was administered to 248 college students aged 18 to 22 years. Results: Participants in the comprehension testing had difficulty understanding negative items. Five translated double negative items were replaced with five positive items with similar meanings. Exploratory factor analysis showed a three-factor model for the PBI-M with acceptable reliability. Four negative items (items 3, 4, 8, and 16) and item 19 were omitted from the final PBI-M list because of incorrect placement or low factor loading (< 0.32). Out of the final 20 items of the PBI-M, there were 10 items for the care factor, five items for the autonomy factor and five items for the overprotection factor. All the items loaded positively on their respective factors. Conclusion: The Malaysian population favoured positive items in answering questions. The PBI-M confirmed the three-factor model that consisted of care, autonomy and overprotection. The PBI-M is a valid and reliable instrument to assess the Malaysian parenting style. Confirmatory factor analysis may further support this finding. Keywords: Malaysia, parenting, questionnaire, validity PMID:25977634

The Toronto outcome measure for craniofacial prosthetics: reliability and validity of a condition-specific quality-of-life instrument.

PubMed

Anderson, James D; Johnston, Dennis A; Haugh, Gil S; Kiat-Amnuay, Sudarat; Gettleman, Lawrence

2013-01-01

The purpose of this study was to refine the Toronto Outcome Measure for Craniofacial Prosthetics (TOMCP), present evidence for its reliability and validity, and use the instrument to explore differences in quality of life between prostheses made with chlorinated polyethylene (CPE) (experimental) and silicone (control). As part of a multicenter prospective controlled randomized double-blind single-crossover clinical trial of the two materials, the TOMCP was administered at the start and end of two 4-month study arms, during which 42 patients wore prostheses made from one material then the other. Reliability was assessed at the crossover. To determine validity of the TOMCP, the Linear Analogue Self-Assessment (LASA-12) and the Short-Form 8 (SF-8) were also administered with the TOMCP. The TOMCP was reduced by removing items that were unreliable, had poorly distributed answers, showed increased internal consistency after their removal, or were too highly correlated with more than one other item. The tests of reliability and validity were then repeated. Finally, the reduced instrument was used to test for differences in quality of life between prostheses made of the two materials. The item reduction tactics pared the 52-item instrument down to 27 items. The correlations of both TOMCP versions with the LASA-12 and the SF-8 were found to be statistically significant, providing evidence of the validity of the TOMCP. The instrument revealed significantly better quality of life with silicone rather than CPE prostheses. Both versions of the TOMCP were found to be reliable and valid. The instrument was able to show differences in quality of life between two materials.

Lawton IADL scale in dementia: can item response theory make it more informative?

PubMed

McGrory, Sarah; Shenkin, Susan D; Austin, Elizabeth J; Starr, John M

2014-07-01

impairment of functional abilities represents a crucial component of dementia diagnosis. Current functional measures rely on the traditional aggregate method of summing raw scores. While this summary score provides a quick representation of a person's ability, it disregards useful information on the item level. to use item response theory (IRT) methods to increase the interpretive power of the Lawton Instrumental Activities of Daily Living (IADL) scale by establishing a hierarchy of item 'difficulty' and 'discrimination'. this cross-sectional study applied IRT methods to the analysis of IADL outcomes. Participants were 202 members of the Scottish Dementia Research Interest Register (mean age = 76.39, range = 56-93, SD = 7.89 years) with complete itemised data available. a Mokken scale with good reliability (Molenaar Sijtsama statistic 0.79) was obtained, satisfying the IRT assumption that the items comprise a single unidimensional scale. The eight items in the scale could be placed on a hierarchy of 'difficulty' (H coefficient = 0.55), with 'Shopping' being the most 'difficult' item and 'Telephone use' being the least 'difficult' item. 'Shopping' was the most discriminatory item differentiating well between patients of different levels of ability. IRT methods are capable of providing more information about functional impairment than a summed score. 'Shopping' and 'Telephone use' were identified as items that reveal key information about a patient's level of ability, and could be useful screening questions for clinicians. © The Author 2013. Published by Oxford University Press on behalf of the British Geriatrics Society. All rights reserved. For Permissions, please email: journals.permissions@ oup.com.

Content comparison of occupation-based instruments in adult rheumatology and musculoskeletal rehabilitation based on the International Classification of Functioning, Disability and Health.

PubMed

Stamm, Tanja A; Cieza, Alarcos; Machold, Klaus P; Smolen, Josef S; Stucki, Gerold

2004-12-15

To compare the content of clinical, occupation-based instruments that are used in adult rheumatology and musculoskeletal rehabilitation in occupational therapy based on the International Classification of Functioning, Disability and Health (ICF). Clinical instruments of occupational performance and occupation in adult rehabilitation and rheumatology were identified in a literature search. All items of these instruments were linked to the ICF categories according to 10 linking rules. On the basis of the linking, the content of these instruments was compared and the relationship between the capacity and performance component explored. The following 7 instruments were identified: the Canadian Occupational Performance Measure, the Assessment of Motor and Process Skills, the Sequential Occupational Dexterity Assessment, the Jebson Taylor Hand Function Test, the Moberg Picking Up Test, the Button Test, and the Functional Dexterity Test. The items of the 7 instruments were linked to 53 different ICF categories. Five items could not be linked to the ICF. The areas covered by the 7 occupation-based instruments differ importantly: The main focus of all 7 instruments is on the ICF component activities and participation. Body functions are covered by 2 instruments. Two instruments were linked to 1 single ICF category only. Clinicians and researchers who need to select an occupation-based instrument must be aware of the areas that are covered by this instrument and the potential areas that are not covered at all.

Promoting a Culture of Tailoring for Systems Engineering Policy Expectations

NASA Technical Reports Server (NTRS)

Blankenship, Van A.

2016-01-01

NASA's Marshall Space Flight Center (MSFC) has developed an integrated systems engineering approach to promote a culture of tailoring for program and project policy requirements. MSFC's culture encourages and supports tailoring, with an emphasis on risk-based decision making, for enhanced affordability and efficiency. MSFC's policy structure integrates the various Agency requirements into a single, streamlined implementation approach which serves as a "one-stop-shop" for our programs and projects to follow. The engineers gain an enhanced understanding of policy and technical expectations, as well as lesson's learned from MSFC's history of spaceflight and science missions, to enable them to make appropriate, risk-based tailoring recommendations. The tailoring approach utilizes a standard methodology to classify projects into predefined levels using selected mission and programmatic scaling factors related to risk tolerance. Policy requirements are then selectively applied and tailored, with appropriate rationale, and approved by the governing authorities, to support risk-informed decisions to achieve the desired cost and schedule efficiencies. The policy is further augmented by implementation tools and lifecycle planning aids which help promote and support the cultural shift toward more tailoring. The MSFC Customization Tool is an integrated spreadsheet that ties together everything that projects need to understand, navigate, and tailor the policy. It helps them classify their project, understand the intent of the requirements, determine their tailoring approach, and document the necessary governance approvals. It also helps them plan for and conduct technical reviews throughout the lifecycle. Policy tailoring is thus established as a normal part of project execution, with the tools provided to facilitate and enable the tailoring process. MSFC's approach to changing the culture emphasizes risk-based tailoring of policy to achieve increased flexibility, efficiency

An Instrument to Assess Self-Statements During Public Speaking: Scale Development and Preliminary Psychometric Properties

PubMed Central

Hofmann, Stefan G.; DiBartolo, Patricia Marten

2006-01-01

Public speaking is the most commonly reported fearful social situation. Although a number of contemporary theories emphasize the importance of cognitive processes in social anxiety, there is no instrument available to assess fearful thoughts experienced during public speaking. The Self-Statements During Public Speaking (SSPS) scale is a 10-item questionnaire consisting of two 5-item subscales, the “Positive Self-Statements” (SSPS-P) and the “Negative Self-Statements” subscale (SSPS-N). Four studies report on the development and the preliminary psychometric properties of this instrument. PMID:16763666

The development of PROQOL-HIV: an international instrument to assess the health-related quality of life of persons living with HIV/AIDS.

PubMed

Duracinsky, Martin; Herrmann, Susan; Berzins, Baiba; Armstrong, Andrew R; Kohli, Rewa; Le Coeur, Sophie; Diouf, Assane; Fournier, Isabelle; Schechter, Mauro; Chassany, Olivier

2012-04-15

Health-related quality of life (HRQL) is an important outcome in HIV/AIDS infection and treatment. However, most existing HIV-HRQL instruments miss important issues (eg, sleeping problems, lipodystrophy). They were developed before highly active antiretroviral therapy (pre-HAART), and in a single language. We sought to develop a contemporary HIV-HRQL instrument (PROQOL-HIV) in multiple languages that accounts for HAART treatment and side effects. This article details the 3-stage content validation phase of PROQOL-HIV. In stage 1, we developed a conceptual model of HIV-HRQL and questionnaire item bank from thematic analysis of 152 patient interviews conducted simultaneously across 9 countries. In stage 2, pilot items were selected by an expert panel to form the pilot instrument. Stage 3 involved linguistic validation and harmonization of selected items to form an equivalent instrument in 9 target languages. Analysis of 3375 pages of interview text revealed 11 underlying themes: general health perception, social relationships, emotions, energy/fatigue, sleep, cognitive functioning, physical and daily activity, coping, future, symptoms, and treatment. Seven issues new to HIV-HRQL measurement were subsumed by these themes: infection fears, future concerns, satisfaction with care, self-esteem problems, sleep problems, work disruption, and treatment issues. Of the 442 theme-related items banked, 70 items met the retention criteria and formed the pilot PROQOL-HIV instrument. HIV patients across 11 countries attributed a wide range of physical, mental, and social issues to their condition, many of which were not measured by existing HIV-HRQL instruments. The pilot PROQOL-HIV instrument captures these issues, is sensitive to sociocultural context, disease stage, and HAART.

Screening Test Items for Differential Item Functioning

ERIC Educational Resources Information Center

Longford, Nicholas T.

2014-01-01

A method for medical screening is adapted to differential item functioning (DIF). Its essential elements are explicit declarations of the level of DIF that is acceptable and of the loss function that quantifies the consequences of the two kinds of inappropriate classification of an item. Instead of a single level and a single function, sets of…

17 CFR 229.1114 - (Item 1114) Credit enhancement and other support, except for certain derivatives instruments.

Code of Federal Regulations, 2011 CFR

2011-04-01

... and other support, except for certain derivatives instruments. 229.1114 Section 229.1114 Commodity and... support, except for certain derivatives instruments. (a) Descriptive information. To the extent material..., guaranteed investment contracts and minimum principal payment agreements. (3) Any derivatives whose primary...

Nickel release from surgical instruments and operating room equipment.

PubMed

Boyd, Anne H; Hylwa, Sara A

2018-04-15

Background There has been no systematic study assessing nickel release from surgical instruments and equipment used within the operating suite. This equipment represents important potential sources of exposure for nickel-sensitive patients and hospital staff. To investigate nickel release from commonly used surgical instruments and operating room equipment. Using the dimethylglyoxime nickel spot test, a variety of surgical instruments and operating room equipment were tested for nickel release at our institution. Of the 128 surgical instruments tested, only 1 was positive for nickel release. Of the 43 operating room items tested, 19 were positive for nickel release, 7 of which have the potential for direct contact with patients and/or hospital staff. Hospital systems should be aware of surgical instruments and operating room equipment as potential sources of nickel exposure.

Effect of the Range of Response Options on Answers to Biographical Inventory Items

ERIC Educational Resources Information Center

Kirnan, Jean Powell; Edler, Erin; Carpenter, Allison

2007-01-01

The range of response options has been shown to influence the answers given in self-report instruments that measure behaviors ranging from television viewing to sexual partners. The current research extends this line of inquiry to 36 quantitative items extracted from a biographical inventory used in personnel selection. A total of 92…

An Introduction to Item Response Theory and Rasch Models for Speech-Language Pathologists

ERIC Educational Resources Information Center

Baylor, Carolyn; Hula, William; Donovan, Neila J.; Doyle, Patrick J.; Kendall, Diane; Yorkston, Kathryn

2011-01-01

Purpose: To present a primarily conceptual introduction to item response theory (IRT) and Rasch models for speech-language pathologists (SLPs). Method: This tutorial introduces SLPs to basic concepts and terminology related to IRT as well as the most common IRT models. The article then continues with an overview of how instruments are developed…

Are we there yet? An examination of online tailored health communication.

PubMed

Suggs, L Suzanne; McIntyre, Chris

2009-04-01

Increasingly, the Internet is playing an important role in consumer health and patient-provider communication. Seventy-three percent of American adults are now online, and 79% have searched for health information on the Internet. This study provides a baseline understanding of the extent to which health consumers are able to find tailored communication online. It describes the current behavioral focus, the channels being used to deliver the tailored content, and the level of tailoring in online-tailored communication. A content analysis of 497 health Web sites found few examples of personalized, targeted, or tailored health sites freely available online. Tailored content was provided in 13 Web sites, although 15 collected individual data. More health risk assessment (HRA) sites included tailored feedback than other topics. The patterns that emerged from the analysis demonstrate that online health users can access a number of Web sites with communication tailored to their needs.

Understanding tailoring in communicating about health

PubMed Central

Hawkins, Robert P.; Kreuter, Matthew; Resnicow, Kenneth; Fishbein, Martin; Dijkstra, Arie

2011-01-01

‘Tailoring’ refers to any of a number of methods for creating communications individualized for their receivers, with the expectation that this individualization will lead to larger intended effects of these communications. Results so far have been generally positive but not consistently so, and this paper seeks to explicate tailoring to help focus future research. Tailoring involves either or both of two classes of goals (enhancing cognitive preconditions for message processing and enhancing message impact through modifying behavioral determinants of goal outcomes) and employs strategies of personalization, feedback and content matching. These goals and strategies intersect in a 2 × 3 matrix in which some strategies and their component tactics match better to some goals than to others. The paper illustrates how this framework can be systematically applied in generating research questions and identifying appropriate study designs for tailoring research. PMID:18349033

A Stratified Study of Students' Understanding of Basic Optics Concepts in Different Contexts Using Two-Tier Multiple-Choice Items

ERIC Educational Resources Information Center

Chu, Hye-Eun; Treagust, David F.; Chandrasegaran, A. L.

2009-01-01

A large scale study involving 1786 year 7-10 Korean students from three school districts in Seoul was undertaken to evaluate their understanding of basic optics concepts using a two-tier multiple-choice diagnostic instrument consisting of four pairs of items, each of which evaluated the same concept in two different contexts. The instrument, which…

Tailored telephone counseling increases colorectal cancer screening.

PubMed

Rawl, Susan M; Christy, Shannon M; Monahan, Patrick O; Ding, Yan; Krier, Connie; Champion, Victoria L; Rex, Douglas

2015-08-01

To compare the efficacy of two interventions to promote colorectal cancer screening participation and forward stage movement of colorectal cancer screening adoption among first-degree relatives of individuals diagnosed with adenomatous polyps. One hundred fifty-eight first-degree relatives of individuals diagnosed with adenomatous polyps were randomly assigned to receive one of two interventions to promote colorectal cancer screening. Participants received either a tailored telephone counseling plus brochures intervention or a non-tailored print brochures intervention. Data were collected at baseline and 3 months post-baseline. Group differences and the effect of the interventions on adherence and stage movement for colorectal cancer screening were examined using t-tests, chi-square tests, and logistic regression. Individuals in the tailored telephone counseling plus brochures group were significantly more likely to complete colorectal cancer screening and to move forward on stage of change for fecal occult blood test, any colorectal cancer test stage and stage of the risk-appropriate test compared with individuals in the non-tailored brochure group at 3 months post-baseline. A tailored telephone counseling plus brochures intervention successfully promoted forward stage movement and colorectal cancer screening adherence among first-degree relatives of individuals diagnosed with adenomatous polyps. © The Author 2015. Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com.

An Instrument to Determine the Technological Literacy Levels of Upper Secondary School Students

ERIC Educational Resources Information Center

Luckay, Melanie B.; Collier-Reed, Brandon I.

2014-01-01

In this article, an instrument for assessing upper secondary school students' levels of technological literacy is presented. The items making up the instrument emerged from a previous study that employed a phenomenographic research approach to explore students' conceptions of technology in terms of their understanding of the "nature…

Development of an instrument to measure patient perception of the quality of nursing care and related hospital services at the national hospital of sri lanka.

PubMed

Senarat, Upul; Gunawardena, Nalika S

2011-06-01

This study aimed to develop and validate an instrument to measure patient perception of quality of nursing care and related hospital services in a tertiary care setting. We compiled an instrument with 72 items that patients may perceive as quality of nursing care and related hospital services, following an extensive literature search, discussions with patients and care pro-I viders and a brainstorming session with an expert panel. A cross-sectional study was conducted at the National Hospital of Sri Lanka. A sample (n = 120) of patients stayed in general surgical or medical units responded to the interviewer administered instrument upon discharge. Item analysis and principal component factor analysis were performed to assess validity, and internal consistency was calculated to measure reliability. Of the 72 items, 18 had greater than 20% of responses as 'not relevant'. A further 11 items were eliminated since item-total correlations were less than .2. Factor analysis was performed on remaining 43 items which resulted in 36 items classifying into eight factors accounting for 71% of the variation. Factor loadings in the final solution after Varimax rotation were interpersonal aspects (.68-.85), efficiency (.62-.79), competency (.66-.68), comfort (.60-.84), physical environment (.65-.82), cleanliness (.81-.85), personalized information (.76-.83), and general instructions (.61-.78). The instrument had high Internal consistency (Cronbach's alpha = .91). We developed a comprehensive, reliable and valid, 36-item instrument that may be used to measure patient perception of quality of nursing care in tertiary care settings. Copyright © 2011 Korean Society of Nursing Science. Published by Elsevier B.V. All rights reserved.

Reliability and validity of the 12-item WHODAS 2.0 in patients with Kashin-Beck disease.

PubMed

Younus, Mohammad Imran; Wang, Di-Miao; Yu, Fang-Fang; Fang, Hua; Guo, Xiong

2017-09-01

The purpose of this study was to check the reliability and validity of the 12-item Chinese version of the World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) for the assessment of disability in patients with Kashin-Beck disease (KBD). We recruited 219 patients with KBD from the high-risk KBD area in the Shaanxi province, using stratified multistage random sampling. We assessed each patient using the Chinese version of the 12-item WHODAS 2.0 and the Western Ontario and McMaster Universities Index of Osteoarthritis (WOMAC). Statistical evaluations of the instruments consisted of Cronbach's alpha, intraclass correlation coefficient (ICC), confirmatory factor analysis (CFA), and Pearson's correlation coefficient. Cronbach's alpha and ICC for the six domains ranged from 0.704 to 0.906 and 0.690 to 0.852, respectively. A six-factor structure fits the data well (CFI = 0.967, TLI = 0.944, RMSEA = 0.08). Regarding convergent validity, the four domains of the 12-item WHODAS 2.0 (getting around, self-care, life activity, and participation) showed moderate-to-strong correlation for all three domains of the WOMAC (0.428 < |r| < 0.804). Regarding divergent validity, the two domains of the 12-item WHODAS 2.0 (understanding and communication, and getting along with people) showed weak correlation for the three domains of WOMAC (0.182 < |r| < 0.295). The Chinese version of 12-item WHODAS 2.0 questionnaire is a reliable and valid instrument when administered to KBD patients.

Measuring the Quality of Life of Visually Impaired Children: First Stage Psychometric Evaluation of the Novel VQoL_CYP Instrument.

PubMed

Tadić, Valerija; Cooper, Andrew; Cumberland, Phillippa; Lewando-Hundt, Gillian; Rahi, Jugnoo S

2016-01-01

To report piloting and initial validation of the VQoL_CYP, a novel age-appropriate vision-related quality of life (VQoL) instrument for self-reporting by children with visual impairment (VI). Participants were a random patient sample of children with VI aged 10-15 years. 69 patients, drawn from patient databases at Great Ormond Street Hospital and Moorfields Eye Hospital, United Kingdom, participated in piloting of the draft 47-item VQoL instrument, which enabled preliminary item reduction. Subsequent administration of the instrument, alongside functional vision (FV) and generic health-related quality of life (HRQoL) self-report measures, to 101 children with VI comprising a nationally representative sample enabled further item reduction and evaluation of psychometric properties using Rasch analysis. Construct validity was assessed through Pearson correlation coefficients. Item reduction through piloting (8 items removed for skewness and individual item response pattern) and validation (1 item removed for skewness and 3 for misfit in Rasch) produced a 35-item scale, with fit values within acceptable limits, no notable differential item functioning, good measurement precision, ordered response categories and acceptable targeting in Rasch. The VQoL_CYP showed good construct validity, correlating strongly with HRQoL scores, moderately with FV scores but not with acuity. Robust child-appropriate self-report VQoL measures for children with VI are necessary for understanding the broader impacts of living with a visual disability, distinguishing these from limited functioning per se. Future planned use in larger patient samples will allow further psychometric development of the VQoL_CYP as an adjunct to objective outcomes assessment.

Evaluation applications of instrument calibration research findings in psychology for very small samples

NASA Astrophysics Data System (ADS)

Fisher, W. P., Jr.; Petry, P.

2016-11-01

Many published research studies document item calibration invariance across samples using Rasch's probabilistic models for measurement. A new approach to outcomes evaluation for very small samples was employed for two workshop series focused on stress reduction and joyful living conducted for health system employees and caregivers since 2012. Rasch-calibrated self-report instruments measuring depression, anxiety and stress, and the joyful living effects of mindfulness behaviors were identified in peer-reviewed journal articles. Items from one instrument were modified for use with a US population, other items were simplified, and some new items were written. Participants provided ratings of their depression, anxiety and stress, and the effects of their mindfulness behaviors before and after each workshop series. The numbers of participants providing both pre- and post-workshop data were low (16 and 14). Analysis of these small data sets produce results showing that, with some exceptions, the item hierarchies defining the constructs retained the same invariant profiles they had exhibited in the published research (correlations (not disattenuated) range from 0.85 to 0.96). In addition, comparisons of the pre- and post-workshop measures for the three constructs showed substantively and statistically significant changes. Implications for program evaluation comparisons, quality improvement efforts, and the organization of communications concerning outcomes in clinical fields are explored.

Tailored to Fit

ERIC Educational Resources Information Center

Milbradt, Allan; Klock, Ed

2006-01-01

Building a new school can be exciting and creative. The process enables parents, students, educators and the community to explore their dreams and priorities, and create a facility tailored to their unique needs. Unfortunately, the process also can leave education institutions and communities feeling like they've bought an "off-the-rack" facility…

Measuring Integration of Information and Communication Technology in Education: An Item Response Modeling Approach

ERIC Educational Resources Information Center

Peeraer, Jef; Van Petegem, Peter

2012-01-01

This research describes the development and validation of an instrument to measure integration of Information and Communication Technology (ICT) in education. After literature research on definitions of integration of ICT in education, a comparison is made between the classical test theory and the item response modeling approach for the…

Developing and testing an instrument for identifying performance incentives in the Greek health care sector.

PubMed

Paleologou, Victoria; Kontodimopoulos, Nick; Stamouli, Aggeliki; Aletras, Vassilis; Niakas, Dimitris

2006-09-13

In the era of cost containment, managers are constantly pursuing increased organizational performance and productivity by aiming at the obvious target, i.e. the workforce. The health care sector, in which production processes are more complicated compared to other industries, is not an exception. In light of recent legislation in Greece in which efficiency improvement and achievement of specific performance targets are identified as undisputable health system goals, the purpose of this study was to develop a reliable and valid instrument for investigating the attitudes of Greek physicians, nurses and administrative personnel towards job-related aspects, and the extent to which these motivate them to improve performance and increase productivity. A methodological exploratory design was employed in three phases: a) content development and assessment, which resulted in a 28-item instrument, b) pilot testing (N = 74) and c) field testing (N = 353). Internal consistency reliability was tested via Cronbach's alpha coefficient and factor analysis was used to identify the underlying constructs. Tests of scaling assumptions, according to the Multitrait-Multimethod Matrix, were used to confirm the hypothesized component structure. Four components, referring to intrinsic individual needs and external job-related aspects, were revealed and explain 59.61% of the variability. They were subsequently labeled: job attributes, remuneration, co-workers and achievement. Nine items not meeting item-scale criteria were removed, resulting in a 19-item instrument. Scale reliability ranged from 0.782 to 0.901 and internal item consistency and discriminant validity criteria were satisfied. Overall, the instrument appears to be a promising tool for hospital administrations in their attempt to identify job-related factors, which motivate their employees. The psychometric properties were good and warrant administration to a larger sample of employees in the Greek healthcare system.

Developing and testing an instrument for identifying performance incentives in the Greek health care sector

PubMed Central

Paleologou, Victoria; Kontodimopoulos, Nick; Stamouli, Aggeliki; Aletras, Vassilis; Niakas, Dimitris

2006-01-01

Background In the era of cost containment, managers are constantly pursuing increased organizational performance and productivity by aiming at the obvious target, i.e. the workforce. The health care sector, in which production processes are more complicated compared to other industries, is not an exception. In light of recent legislation in Greece in which efficiency improvement and achievement of specific performance targets are identified as undisputable health system goals, the purpose of this study was to develop a reliable and valid instrument for investigating the attitudes of Greek physicians, nurses and administrative personnel towards job-related aspects, and the extent to which these motivate them to improve performance and increase productivity. Methods A methodological exploratory design was employed in three phases: a) content development and assessment, which resulted in a 28-item instrument, b) pilot testing (N = 74) and c) field testing (N = 353). Internal consistency reliability was tested via Cronbach's alpha coefficient and factor analysis was used to identify the underlying constructs. Tests of scaling assumptions, according to the Multitrait-Multimethod Matrix, were used to confirm the hypothesized component structure. Results Four components, referring to intrinsic individual needs and external job-related aspects, were revealed and explain 59.61% of the variability. They were subsequently labeled: job attributes, remuneration, co-workers and achievement. Nine items not meeting item-scale criteria were removed, resulting in a 19-item instrument. Scale reliability ranged from 0.782 to 0.901 and internal item consistency and discriminant validity criteria were satisfied. Conclusion Overall, the instrument appears to be a promising tool for hospital administrations in their attempt to identify job-related factors, which motivate their employees. The psychometric properties were good and warrant administration to a larger sample of employees in

Calibration of the Dutch-Flemish PROMIS Pain Behavior item bank in patients with chronic pain.

PubMed

Crins, M H P; Roorda, L D; Smits, N; de Vet, H C W; Westhovens, R; Cella, D; Cook, K F; Revicki, D; van Leeuwen, J; Boers, M; Dekker, J; Terwee, C B

2016-02-01

The aims of the current study were to calibrate the item parameters of the Dutch-Flemish PROMIS Pain Behavior item bank using a sample of Dutch patients with chronic pain and to evaluate cross-cultural validity between the Dutch-Flemish and the US PROMIS Pain Behavior item banks. Furthermore, reliability and construct validity of the Dutch-Flemish PROMIS Pain Behavior item bank were evaluated. The 39 items in the bank were completed by 1042 Dutch patients with chronic pain. To evaluate unidimensionality, a one-factor confirmatory factor analysis (CFA) was performed. A graded response model (GRM) was used to calibrate the items. To evaluate cross-cultural validity, Differential item functioning (DIF) for language (Dutch vs. English) was evaluated. Reliability of the item bank was also examined and construct validity was studied using several legacy instruments, e.g. the Roland Morris Disability Questionnaire. CFA supported the unidimensionality of the Dutch-Flemish PROMIS Pain Behavior item bank (CFI = 0.960, TLI = 0.958), the data also fit the GRM, and demonstrated good coverage across the pain behavior construct (threshold parameters range: -3.42 to 3.54). Analysis showed good cross-cultural validity (only six DIF items), reliability (Cronbach's α = 0.95) and construct validity (all correlations ≥0.53). The Dutch-Flemish PROMIS Pain Behavior item bank was found to have good cross-cultural validity, reliability and construct validity. The development of the Dutch-Flemish PROMIS Pain Behavior item bank will serve as the basis for Dutch-Flemish PROMIS short forms and computer adaptive testing (CAT). © 2015 European Pain Federation - EFIC®

Validation of the Spanish versions of the long (26 items) and short (12 items) forms of the Self-Compassion Scale (SCS).

PubMed

Garcia-Campayo, Javier; Navarro-Gil, Mayte; Andrés, Eva; Montero-Marin, Jesús; López-Artal, Lorena; Demarzo, Marcelo Marcos Piva

2014-01-10

Self-compassion is a key psychological construct for assessing clinical outcomes in mindfulness-based interventions. The aim of this study was to validate the Spanish versions of the long (26 item) and short (12 item) forms of the Self-Compassion Scale (SCS). The translated Spanish versions of both subscales were administered to two independent samples: Sample 1 was comprised of university students (n = 268) who were recruited to validate the long form, and Sample 2 was comprised of Aragon Health Service workers (n = 271) who were recruited to validate the short form. In addition to SCS, the Mindful Attention Awareness Scale (MAAS), the State-Trait Anxiety Inventory-Trait (STAI-T), the Beck Depression Inventory (BDI) and the Perceived Stress Questionnaire (PSQ) were administered. Construct validity, internal consistency, test-retest reliability and convergent validity were tested. The Confirmatory Factor Analysis (CFA) of the long and short forms of the SCS confirmed the original six-factor model in both scales, showing goodness of fit. Cronbach's α for the 26 item SCS was 0.87 (95% CI = 0.85-0.90) and ranged between 0.72 and 0.79 for the 6 subscales. Cronbach's α for the 12-item SCS was 0.85 (95% CI = 0.81-0.88) and ranged between 0.71 and 0.77 for the 6 subscales. The long (26-item) form of the SCS showed a test-retest coefficient of 0.92 (95% CI = 0.89-0.94). The Intraclass Correlation (ICC) for the 6 subscales ranged from 0.84 to 0.93. The short (12-item) form of the SCS showed a test-retest coefficient of 0.89 (95% CI: 0.87-0.93). The ICC for the 6 subscales ranged from 0.79 to 0.91. The long and short forms of the SCS exhibited a significant negative correlation with the BDI, the STAI and the PSQ, and a significant positive correlation with the MAAS. The correlation between the total score of the long and short SCS form was r = 0.92. The Spanish versions of the long (26-item) and short (12-item) forms of the SCS are valid and

Validation of the Spanish versions of the long (26 items) and short (12 items) forms of the Self-Compassion Scale (SCS)

PubMed Central

2014-01-01

(12-item) forms of the SCS are valid and reliable instruments for the evaluation of self-compassion among the general population. These results substantiate the use of this scale in research and clinical practice. PMID:24410742

Evaluation of the psychometric properties of the Nighttime Symptoms of COPD Instrument.

PubMed

Mocarski, Michelle; Zaiser, Erica; Trundell, Dylan; Make, Barry J; Hareendran, Asha

2015-01-01

Nighttime symptoms can negatively impact the quality of life of patients with chronic obstructive pulmonary disease (COPD). The Nighttime Symptoms of COPD Instrument (NiSCI) was designed to measure the occurrence and severity of nighttime symptoms in patients with COPD, the impact of symptoms on nighttime awakenings, and rescue medication use. The objective of this study was to explore item reduction, inform scoring recommendations, and evaluate the psychometric properties of the NiSCI. COPD patients participating in a Phase III clinical trial completed the NiSCI daily. Item analyses were conducted using weekly mean and single day scores. Descriptive statistics (including percentage of respondents at floor/ceiling and inter-item correlations), factor analyses, and Rasch model analyses were conducted to examine item performance and scoring. Test-retest reliability was assessed for the final instrument using the intraclass correlation coefficient (ICC). Correlations with assessments conducted during study visits were used to evaluate convergent and known-groups validity. Data from 1,663 COPD patients aged 40-93 years were analyzed. Item analyses supported the generation of four scores. A one-factor structure was confirmed with factor analysis and Rasch analysis for the symptom severity score. Test-retest reliability was confirmed for the six-item symptom severity (ICC, 0.85), number of nighttime awakenings (ICC, 0.82), and rescue medication (ICC, 0.68) scores. Convergent validity was supported by significant correlations between the NiSCI, St George's Respiratory Questionnaire, and Exacerbations of Chronic Obstructive Pulmonary Disease Tool-Respiratory Symptoms scores. The results suggest that the NiSCI can be used to determine the severity of nighttime COPD symptoms, the number of nighttime awakenings due to COPD symptoms, and the nighttime use of rescue medication. The NiSCI is a reliable and valid instrument to evaluate these concepts in COPD patients in clinical

Development of the Primary Care Quality-Homeless (PCQ-H) Instrument: A Practical Survey of Patients' Experiences in Primary Care

PubMed Central

Kertesz, Stefan. G.; Pollio, David E.; Jones, Richard N.; Steward, Jocelyn; Stringfellow, Erin J.; Gordon, Adam J.; Johnson, Nancy K.; Kim, Theresa A.; Granstaff, Unita; Austin, Erika L.; Young, Alexander S.; Golden, Joya; Davis, Lori L.; Roth, David L.; Holt, Cheryl L.

2015-01-01

Background Homeless patients face unique challenges in obtaining primary care responsive to their needs and context. Patient experience questionnaires could permit assessment of patient-centered medical homes for this population, but standard instruments may not reflect homeless patients' priorities and concerns. Objectives This report describes (a) the content and psychometric properties of a new primary care questionnaire for homeless patients and (b) the methods utilized in its development. Methods Starting with quality-related constructs from the Institute of Medicine, we identified relevant themes by interviewing homeless patients and experts in their care. A multidisciplinary team drafted a preliminary set of 78 items. This was administered to homeless-experienced clients (n=563) across 3 VA facilities and 1 non-VA Health Care for the Homeless Program. Using Item Response Theory, we examined Test Information Function curves to eliminate less informative items and devise plausibly distinct subscales. Results The resulting 33-item instrument (Primary Care Quality-Homeless, PCQ-H) has four subscales: Patient-Clinician Relationship (15 items), Cooperation among Clinicians (3 items), Access/Coordination (11 items) and Homeless-Specific Needs (4 items). Evidence for divergent and convergent validity is provided. Test Information Function (TIF) graphs showed adequate informational value to permit inferences about groups for 3 subscales (Relationship, Cooperation and Access/Coordination). The 3-item Cooperation subscale had lower informational value (TIF<5) but had good internal consistency (alpha=0.75) and patients frequently reported problems in this aspect of care. Conclusions Systematic application of qualitative and quantitative methods supported the development of a brief patient-reported questionnaire focused on the primary care of homeless patients and offers guidance for future population-specific instrument development. PMID:25023918

Can Reliability of Multiple Component Measuring Instruments Depend on Response Option Presentation Mode?

ERIC Educational Resources Information Center

Menold, Natalja; Raykov, Tenko

2016-01-01

This article examines the possible dependency of composite reliability on presentation format of the elements of a multi-item measuring instrument. Using empirical data and a recent method for interval estimation of group differences in reliability, we demonstrate that the reliability of an instrument need not be the same when polarity of the…

A Monte Carlo Study Investigating the Influence of Item Discrimination, Category Intersection Parameters, and Differential Item Functioning Patterns on the Detection of Differential Item Functioning in Polytomous Items

ERIC Educational Resources Information Center

Thurman, Carol

2009-01-01

The increased use of polytomous item formats has led assessment developers to pay greater attention to the detection of differential item functioning (DIF) in these items. DIF occurs when an item performs differently for two contrasting groups of respondents (e.g., males versus females) after controlling for differences in the abilities of the…

Psychometrics of an internalized homophobia instrument for men.

PubMed

Theodore, John L; Shidlo, Ariel; Zemon, Vance; Foley, Frederick W; Dorfman, David; Dahlman, Karen L; Hamid, Sahira

2013-01-01

The Multi-Axial Gay Men's Inventory-Men's Short Version (MAGI-MSV) assesses internalized homophobia via 20 items and 3 dimensions. This study extended the psychometric examination of the MAGI-MSV. The instrument was administered to 228 ethnically diverse HIV-negative gay men seeking counseling in New York City (mean age = 35, age range = 16-70). Following principal axis factoring and parallel analyses, 4 factors emerged and 14 items were retained. The descriptive labels for factors included gay self-assurance and worth, public appearance of homosexuality, and impact of HIV/AIDS on homosexuality. The new, fourth factor was named maladaptive measures to eliminate homosexuality.

Instruments to measure cancer management knowledge of rural health care providers.

PubMed

Elliott, T E; Regal, R R; Renier, C M; Crouse, B J; Gangeness, D E; Pharmd; Elliott, B A; Witrak, M

2001-01-01

Instruments to measure cancer management knowledge of rural physicians, nurses, and pharmacists were needed to evaluate the effect of an educational intervention. Since such instruments did not exist, the authors designed and validated a new instrument for each discipline. The design and validation process for these instruments are described. These three instruments were shown to be practical and to have high content and construct validity. Content validation demonstrated that all items were rated as essential or useful by 90% or more of the respondents. Construct validation show highly significant differences in mean scores among several levels of learners and practitioners as expected. These instruments may be useful to other investigators for measuring cancer management knowledge of rural physicians, nurses, and pharmacists.

Assessment of Work Performance (AWP)--development of an instrument.

PubMed

Sandqvist, Jan L; Törnquist, Kristina B; Henriksson, Chris M

2006-01-01

Adequate work assessments are a matter of importance both for individuals and society [5,29,31,38,40,46,52]. However, there is a lack of adequate and reliable instruments for use in work rehabilitation [14,15,20,21,31,44]. The purpose of this study was to develop and evaluate an observation instrument for assessing work performance, the AWP (Assessment of Work Performance). The purpose of the 14-item instrument is to assess the individual's observable working skills in three different areas: motor skills, process skills, and communication and interaction skills. This article describes the development and results of preliminary testing of the AWP. The testing indicates a satisfactory face validity and utility for the AWP and supports further research and testing of the instrument.