Development and validation of a tool to assess the physical and social environment associated with physical activity among adults in Sri Lanka.

PubMed

De Silva Weliange, Shreenika H; Fernando, Dulitha; Gunatilake, Jagath

2014-05-03

Environmental characteristics are known to be associated with patterns of physical activity (PA). Although several validated tools exist, to measure the environment characteristics, these instruments are not necessarily suitable for application in all settings especially in a developing country. This study was carried out to develop and validate an instrument named the "Physical And Social Environment Scale--PASES" to assess the physical and social environmental factors associated with PA. This will enable identification of various physical and social environmental factors affecting PA in Sri Lanka, which will help in the development of more tailored intervention strategies for promoting higher PA levels in Sri Lanka. The PASES was developed using a scientific approach of defining the construct, item generation, analysis of content of items and item reduction. Both qualitative and quantitative methods of key informant interviews, in-depth interviews and rating of the items generated by experts were conducted. A cross sectional survey among 180 adults was carried out to assess the factor structure through principal component analysis. Another cross sectional survey among a different group of 180 adults was carried out to assess the construct validity through confirmatory factor analysis. Reliability was assessed with test re-test reliability and internal consistency using Spearman r and Cronbach's alpha respectively. Thirty six items were selected after the expert ratings and were developed into interviewer administered questions. Exploration of factor structure of the 34 items which were factorable through principal component analysis with Quartimax rotation extracted 8 factors. The 34 item instrument was assessed for construct validity with confirmatory factor analysis which confirmed an 8 factor model (x2 = 339.9, GFI = 0.90). The identified factors were infrastructure for walking, aesthetics and facilities for cycling, vehicular traffic safety, access and connectivity, recreational facilities for PA, safety, social cohesion and social acceptance of PA with the two non-factorable factors, residential density and land use mix. The PASES also showed good test re-test reliability and a moderate level of internal consistency. The PASES is a valid and reliable tool which could be used to assess the physical and social environment associated with PA in Sri Lanka.

Feasibility and Acceptability of a Colocated Homeless-Tailored Primary Care Clinic and Emergency Department.

PubMed

Gabrielian, Sonya; Chen, Jennifer C; Minhaj, Beena P; Manchanda, Rishi; Altman, Lisa; Koosis, Ella; Gelberg, Lillian

2017-10-01

Homeless adults have low primary care engagement and high emergency department (ED) utilization. Homeless-tailored, patient-centered medical homes (PCMH) decrease this population's acute care use. We studied the feasibility (focused on patient recruitment) and acceptability (conceptualized as clinicians' attitudes/beliefs) of a pilot initiative to colocate a homeless-tailored PCMH with an ED. After ED triage, low-acuity patients appropriate for outpatient care were screened for homelessness; homeless patients chose between a colocated PCMH or ED visit. To study feasibility, we captured (from May to September 2012) the number of patients screened for homelessness, positive screens, unique patients seen, and primary care visits. We focused on acceptability to ED clinicians (physicians, nurses, social workers); we sent a 32-item survey to ED clinicians (n = 57) who worked during clinic hours. Questions derived from an instrument measuring clinician attitudes toward homeless persons; acceptability of homelessness screening and the clinic itself were also explored. Over the 5 months of interest, 281 patients were screened; 172 (61.2%) screened positive for homelessness; 112 (65.1%) of these positive screens were seen over 215 visits. Acceptability data were obtained from 56% (n = 32) of surveyed clinicians. Attitudes toward homeless patients were similar to prior studies of primary care physicians. Most (54.6%) clinicians agreed with the homelessness screening procedures. Nearly all (90.3%) clinicians supported expansion of the homeless-tailored clinic; a minority (42.0%) agreed that ED colocation worked well. Our data suggest the feasibility of recruiting patients to a homeless-tailored primary care clinic colocated with the ED; however, the clinic's acceptability was mixed. Future quality improvement work should focus on tailoring the clinic to increase its acceptability among ED clinicians, while assessing its impact on health, housing, and costs.

Feasibility and Acceptability of a Colocated Homeless-Tailored Primary Care Clinic and Emergency Department

PubMed Central

Gabrielian, Sonya; Chen, Jennifer C.; Minhaj, Beena P.; Manchanda, Rishi; Altman, Lisa; Koosis, Ella; Gelberg, Lillian

2017-01-01

Objectives: Homeless adults have low primary care engagement and high emergency department (ED) utilization. Homeless-tailored, patient-centered medical homes (PCMH) decrease this population’s acute care use. We studied the feasibility (focused on patient recruitment) and acceptability (conceptualized as clinicians’ attitudes/beliefs) of a pilot initiative to colocate a homeless-tailored PCMH with an ED. After ED triage, low-acuity patients appropriate for outpatient care were screened for homelessness; homeless patients chose between a colocated PCMH or ED visit. Methods: To study feasibility, we captured (from May to September 2012) the number of patients screened for homelessness, positive screens, unique patients seen, and primary care visits. We focused on acceptability to ED clinicians (physicians, nurses, social workers); we sent a 32-item survey to ED clinicians (n = 57) who worked during clinic hours. Questions derived from an instrument measuring clinician attitudes toward homeless persons; acceptability of homelessness screening and the clinic itself were also explored. Results: Over the 5 months of interest, 281 patients were screened; 172 (61.2%) screened positive for homelessness; 112 (65.1%) of these positive screens were seen over 215 visits. Acceptability data were obtained from 56% (n = 32) of surveyed clinicians. Attitudes toward homeless patients were similar to prior studies of primary care physicians. Most (54.6%) clinicians agreed with the homelessness screening procedures. Nearly all (90.3%) clinicians supported expansion of the homeless-tailored clinic; a minority (42.0%) agreed that ED colocation worked well. Conclusion: Our data suggest the feasibility of recruiting patients to a homeless-tailored primary care clinic colocated with the ED; however, the clinic’s acceptability was mixed. Future quality improvement work should focus on tailoring the clinic to increase its acceptability among ED clinicians, while assessing its impact on health, housing, and costs. PMID:28367682

Towards Tailored Patient's Management Approach: Integrating the Modified 2010 ACR Criteria for Fibromyalgia in Multidimensional Patient Reported Outcome Measures Questionnaire

PubMed Central

El Miedany, Yasser; El Gaafary, Maha; Youssef, Sally; Ahmed, Ihab

2016-01-01

Objectives. To assess the validity, reliability, and responsiveness to change of a patient self-reported questionnaire combining the Widespread Pain Index and the Symptom Severity Score as well as construct outcome measures and comorbidities assessment in fibromyalgia patients. Methods. The PROMs-FM was conceptualized based on frameworks used by the WHO Quality of Life tool and the PROMIS. Initially, cognitive interviews were conducted to identify item pool of questions. Item selection and reduction were achieved based on patients as well as an interdisciplinary group of specialists. Rasch and internal consistency reliability analyses were implemented. The questionnaire included the modified ACR criteria main items (Symptom Severity Score and Widespread Pain Index), in addition to assessment of functional disability, quality of life (QoL), review of the systems, and comorbidities. Every patient completed HAQ and EQ-5D questionnaires. Results. A total of 146 fibromyalgia patients completed the questionnaire. The PROMs-FM questionnaire was reliable as demonstrated by a high standardized alpha (0.886–0.982). Content construct assessment of the functional disability and QoL revealed significant correlation (p < 0.01) with both HAQ and EQ-5D. Changes in functional disability and QoL showed significant (p < 0.01) variation with diseases activity status in response to therapy. There was higher prevalence of autonomic symptoms, CVS risk, sexual dysfunction, and falling. Conclusions. The developed PROMs-FM questionnaire is a reliable and valid instrument for assessment of fibromyalgia patients. A phased treatment regimen depending on the severity of FMS as well as preferences and comorbidities of the patient is the best approach to tailored patient management. PMID:27190648

The Rasch Model and Missing Data, with an Emphasis on Tailoring Test Items.

ERIC Educational Resources Information Center

de Gruijter, Dato N. M.

Many applications of educational testing have a missing data aspect (MDA). This MDA is perhaps most pronounced in item banking, where each examinee responds to a different subtest of items from a large item pool and where both person and item parameter estimates are needed. The Rasch model is emphasized, and its non-parametric counterpart (the…

Development of an instrument for the evaluation of advanced life support performance.

PubMed

Peltonen, L-M; Peltonen, V; Salanterä, S; Tommila, M

2017-10-01

Assessing advanced life support (ALS) competence requires validated instruments. Existing instruments include aspects of technical skills (TS), non-technical skills (NTS) or both, but one instrument for detailed assessment that suits all resuscitation situations is lacking. This study aimed to develop an instrument for the evaluation of the overall ALS performance of the whole team. This instrument development study had four phases. First, we reviewed literature and resuscitation guidelines to explore items to include in the instrument. Thereafter, we interviewed resuscitation team professionals (n = 66), using the critical incident technique, to determine possible additional aspects associated with the performance of ALS. Second, we developed an instrument based on the findings. Third, we used an expert panel (n = 20) to assess the validity of the developed instrument. Finally, we revised the instrument based on the experts' comments and tested it with six experts who evaluated 22 video recorded resuscitations. The final version of the developed instrument had 69 items divided into adherence to guidelines (28 items), clinical decision-making (5 items), workload management (12 items), team behaviour (8 items), information management (6 items), patient integrity and consideration of laymen (4 items) and work routines (6 items). The Cronbach's α values were good, and strong correlations between the overall performance and the instrument were observed. The instrument may be useful for detailed assessment of the team's overall performance, but the numerous items make the use demanding. The instrument is still under development, and more research is needed to determine its psychometric properties. © 2017 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

Adaptation and Refinement of the HIV Knowledge Questionnaire for Use With Adolescent Girls

PubMed Central

Volpe, Ellen M.; Nelson, LaRon E.; Kraus, Rachel A.; Morrison-Beedy, Dianne

2008-01-01

The number of adolescent girls becoming infected with HIV has dramatically escalated to the point where they now represent one of the groups most at risk for this infection. As a component of addressing this pandemic, there is a need for psychometrically sound, tailored measures to assess an adolescent girl's level of knowledge regarding transmission and prevention of HIV. The purpose of this research was to modify an existing HIV knowledge measure used in the general adult population (brief HIV Knowledge Questionnaire [HIV-KQ]) and increase its utility by making it developmentally- and gender-specific for adolescent girls. The revised version with additional items underwent item and scale analysis to confirm psychometric properties with a sample of 62 adolescent girls. HIV-related knowledge is assessed extensively in clinical practice and educational settings and is an important component for monitoring change in successful HIV risk-reduction interventions. The final HIV-KQ for adolescent girls is a practical, specific, and appropriate instrument for use with adolescent girls in these settings. PMID:17889326

48 CFR 2912.302 - Tailoring of provisions and clauses for the acquisition of commercial items.

Code of Federal Regulations, 2010 CFR

2010-10-01

... tailor terms inconsistent with customary commercial practice must be documented in a written justification by the contracting officer, and may be approved by the HCA on an individual or class basis. ...

Development of item bank to measure deliberate self-harm behaviours: facilitating tailored scales and computer adaptive testing for specific research and clinical purposes.

PubMed

Latimer, Shane; Meade, Tanya; Tennant, Alan

2014-07-30

The purpose of this study was to investigate the application of item banking to questionnaire items intended to measure Deliberate Self-Harm (DSH) behaviours. The Rasch measurement model was used to evaluate behavioural items extracted from seven published DSH scales administered to 568 Australians aged 18-30 years (62% university students, 21% mental health patients, and 17% community members). Ninety four items were calibrated in the item bank (including 12 items with differential item functioning for gender and age). Tailored scale construction was demonstrated by extracting scales covering different combinations of DSH methods but with the same raw score for each person location on the latent DSH construct. A simulated computer adaptive test (starting with common self-harm methods to minimise presentation of extreme behaviours) demonstrated that 11 items (on average) were needed to achieve a standard error of measurement of 0.387 (corresponding to a Cronbach׳s Alpha of 0.85). This study lays the groundwork for advancing DSH measurement to an item bank approach with the flexibility to measure a specific definitional orientation (e.g., non-suicidal self-injury) or a broad continuum of self-harmful acts, as appropriate to a particular research/clinical purpose. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Wisconsin Title I Migrant Education. Section 143 Project: Development of an Item Bank. Summary Report.

ERIC Educational Resources Information Center

Brown, Frank N.; And Others

The successful Wisconsin Title 1 project item bank offers a valid, flexible, and efficient means of providing migrant student tests in reading and mathematics tailored to instructor curricula. The item bank system consists of nine PASCAL computer programs which maintain, search, and select from approximately 1,000 test items stored on floppy disks…

Screening for problem gambling within mental health services: a comparison of the classification accuracy of brief instruments.

PubMed

Dowling, Nicki A; Merkouris, Stephanie S; Manning, Victorian; Volberg, Rachel; Lee, Stuart J; Rodda, Simone N; Lubman, Dan I

2018-06-01

Despite the over-representation of people with gambling problems in mental health populations, there is limited information available to guide the selection of brief screening instruments within mental health services. The primary aim was to compare the classification accuracy of nine brief problem gambling screening instruments (two to five items) with a reference standard among patients accessing mental health services. The classification accuracy of nine brief screening instruments was compared with multiple cut-off scores on a reference standard. Eight mental health services in Victoria, Australia. A total of 837 patients were recruited consecutively between June 2015 and January 2016. The brief screening instruments were the Lie/Bet Questionnaire, Brief Problem Gambling Screen (BPGS) (two- to five-item versions), NODS-CLiP, NODS-CLiP2, Brief Biosocial Gambling Screen (BBGS) and NODS-PERC. The Problem Gambling Severity Index (PGSI) was the reference standard. The five-item BPGS was the only instrument displaying satisfactory classification accuracy in detecting any level of gambling problem (low-risk, moderate-risk or problem gambling) (sensitivity = 0.803, specificity = 0.982, diagnostic efficiency = 0.943). Several shorter instruments adequately detected both problem and moderate-risk, but not low-risk, gambling: two three-item instruments (NODS-CLiP, three-item BPGS) and two four-item instruments (NODS-PERC, four-item BPGS) (sensitivity = 0.854-0.966, specificity = 0.901-0.954, diagnostic efficiency = 0.908-0.941). The four-item instruments, however, did not provide any considerable advantage over the three-item instruments. Similarly, the very brief (two-item) instruments (Lie/Bet and two-item BPGS) adequately detected problem gambling (sensitivity = 0.811-0.868, specificity = 0.938-0.943, diagnostic efficiency = 0.933-0.934), but not moderate-risk or low-risk gambling. The optimal brief screening instrument for mental health services wanting to screen for any level of gambling problem is the five-item Brief Problem Gambling Screen (BPGS). Services wanting to employ a shorter instrument or to screen only for more severe gambling problems (moderate-risk/problem gambling) can employ the NODS-CLiP or the three-item BPGS. Services that are only able to accommodate a very brief instrument can employ the Lie/Bet Questionnaire or the two-item BPGS. © 2017 Society for the Study of Addiction.

Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication

PubMed Central

Zamanzadeh, Vahid; Ghahramanian, Akram; Rassouli, Maryam; Abbaszadeh, Abbas; Alavi-Majd, Hamid; Nikanfar, Ali-Reza

2015-01-01

Introduction: The importance of content validity in the instrument psychometric and its relevance with reliability, have made it an essential step in the instrument development. This article attempts to give an overview of the content validity process and to explain the complexity of this process by introducing an example. Methods: We carried out a methodological study conducted to examine the content validity of the patient-centered communication instrument through a two-step process (development and judgment). At the first step, domain determination, sampling (item generation) and instrument formation and at the second step, content validity ratio, content validity index and modified kappa statistic was performed. Suggestions of expert panel and item impact scores are used to examine the instrument face validity. Results: From a set of 188 items, content validity process identified seven dimensions includes trust building (eight items), informational support (seven items), emotional support (five items), problem solving (seven items), patient activation (10 items), intimacy/friendship (six items) and spirituality strengthening (14 items). Content validity study revealed that this instrument enjoys an appropriate level of content validity. The overall content validity index of the instrument using universal agreement approach was low; however, it can be advocated with respect to the high number of content experts that makes consensus difficult and high value of the S-CVI with the average approach, which was equal to 0.93. Conclusion: This article illustrates acceptable quantities indices for content validity a new instrument and outlines them during design and psychometrics of patient-centered communication measuring instrument. PMID:26161370

Ethical decision-making climate in the ICU: theoretical framework and validation of a self-assessment tool.

PubMed

Van den Bulcke, Bo; Piers, Ruth; Jensen, Hanne Irene; Malmgren, Johan; Metaxa, Victoria; Reyners, Anna K; Darmon, Michael; Rusinova, Katerina; Talmor, Daniel; Meert, Anne-Pascale; Cancelliere, Laura; Zubek, Làszló; Maia, Paolo; Michalsen, Andrej; Decruyenaere, Johan; Kompanje, Erwin J O; Azoulay, Elie; Meganck, Reitske; Van de Sompel, Ariëlla; Vansteelandt, Stijn; Vlerick, Peter; Vanheule, Stijn; Benoit, Dominique D

2018-02-23

Literature depicts differences in ethical decision-making (EDM) between countries and intensive care units (ICU). To better conceptualise EDM climate in the ICU and to validate a tool to assess EDM climates. Using a modified Delphi method, we built a theoretical framework and a self-assessment instrument consisting of 35 statements. This Ethical Decision-Making Climate Questionnaire (EDMCQ) was developed to capture three EDM domains in healthcare: interdisciplinary collaboration and communication; leadership by physicians; and ethical environment. This instrument was subsequently validated among clinicians working in 68 adult ICUs in 13 European countries and the USA. Exploratory and confirmatory factor analysis was used to determine the structure of the EDM climate as perceived by clinicians. Measurement invariance was tested to make sure that variables used in the analysis were comparable constructs across different groups. Of 3610 nurses and 1137 physicians providing ICU bedside care, 2275 (63.1%) and 717 (62.9%) participated respectively. Statistical analyses revealed that a shortened 32-item version of the EDMCQ scale provides a factorial valid measurement of seven facets of the extent to which clinicians perceive an EDM climate: self-reflective and empowering leadership by physicians; practice and culture of open interdisciplinary reflection; culture of not avoiding end-of-life decisions; culture of mutual respect within the interdisciplinary team; active involvement of nurses in end-of-life care and decision-making; active decision-making by physicians; and practice and culture of ethical awareness. Measurement invariance of the EDMCQ across occupational groups was shown, reflecting that nurses and physicians interpret the EDMCQ items in a similar manner. The 32-item version of the EDMCQ might enrich the EDM climate measurement, clinicians' behaviour and the performance of healthcare organisations. This instrument offers opportunities to develop tailored ICU team interventions. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Rating catatonia in patients with chronic schizophrenia: Rasch analysis of the Bush-Francis Catatonia Rating Scale.

PubMed

Wong, Eric; Ungvari, Gabor S; Leung, Siu-Kau; Tang, Wai-Kwong

2007-01-01

Catatonic signs and symptoms are frequently observed in patients with chronic schizophrenia. Clinical surveys have suggested that the composition of catatonic syndrome occurring in chronic schizophrenia may be different from what is found in acute psychiatric disorders or medical conditions. Consequently, this patient population may need tailor-made rating instruments for catatonia. The aim of the present study was to examine the suitability and accuracy of using the Bush-Francis Catatonia Rating Scale (BFCRS) in chronic schizophrenia inpatients. The unidimensionality (optimal number of items; item fit), and the scoring scheme (the optimal number of scoring categories) of the BFCRS were determined in a random sample of 225 patients with chronic schizophrenia applying Rasch analysis. In addition, differential item functioning (DIF) analysis was also performed. The BFCRS proved to be unidimensional apart from three misfit and one marginally misfit items. The three misfit items were removed from the scale thereby constructing a revised version called BFCRS-R. Since the original BFCRS (BFCRS-O) showed no increase across items across steep gradients (poor endorsability of step calibrations), in BFCRS-R a binary scale ('absent' versus 'present' choices only) was constructed instead of the scoring scheme of 0-3. The 20-item BFCRS-R showed improved psychometric properties in that it had a higher item separation index than BFCRS-O. BFCRS-R mean logit was closer to zero indicating that the items on the scale and the subjects were better matched than in BFCRS-O. DIF analysis showed that certain items of both versions of BFCRS were influenced by the presence of negative symptoms. BFCRS-R is shorter and simpler than the original version and having better psychometric properties seems to be better suited for identifying and quantifying catatonia in chronic psychotic patients. Copyright (c) 2007 John Wiley & Sons, Ltd.

Measuring cancer patients' reasons for their information preference: construction of the Considerations Concerning Cancer Information (CCCI) questionnaire.

PubMed

ter Hoeven, Claartje L; Zandbelt, Linda C; Fransen, Sanne; de Haes, Hanneke; Oort, Frans; Geijsen, Debby; Koning, Caro; Smets, Ellen

2011-11-01

This paper describes the further development and psychometric properties of an instrument to measure cancer patients' reasons to want complete or limited information: the Considerations Concerning Cancer Information questionnaire (CCCI). Understanding cancer patients' reasons to want complete or limited information will provide the physician with information that enables him or her to tailor information giving. CCCI's content validity, internal structure, and convergent validity were investigated among 145 cancer patients, new to radiotherapy. Underlying reasons for information preference among cancer patients were derived from existing qualitative studies, narratives, and interviews. This resulted in the CCCI containing two parts: reasons to favor complete information disclosure and reasons to prefer only limited information about disease and treatment. The four identified dimensions to prefer information consist of: sense of control, expectations of others, anxiety, and autonomy. The four dimensions for reasons to give up on acquiring information consist of: avoidance, optimism, comprehension, and not wanting to be a burden. Confirmatory factor analysis indicated that the measurement model provided good fit to the data. Scales had good internal consistency, satisfactory item-total correlations corrected for overlap and satisfactory convergent validity. These findings confirm evidence of the reliability and validity of the CCCI for use in cancer care. Researchers and health-care providers can use the instrument to assess cancer patients' reasons to want complete or limited information and provide tailored care. Copyright © 2010 John Wiley & Sons, Ltd.

The Influence of Item Calibration Error on Variable-Length Computerized Adaptive Testing

ERIC Educational Resources Information Center

Patton, Jeffrey M.; Cheng, Ying; Yuan, Ke-Hai; Diao, Qi

2013-01-01

Variable-length computerized adaptive testing (VL-CAT) allows both items and test length to be "tailored" to examinees, thereby achieving the measurement goal (e.g., scoring precision or classification) with as few items as possible. Several popular test termination rules depend on the standard error of the ability estimate, which in turn depends…

Translation and adaption of the interRAI suite to local requirements in Belgian hospitals

PubMed Central

2012-01-01

Background The interRAI Suite contains comprehensive geriatric assessment tools designed for various healthcare settings. Although each instrument is developed for a particular population, together they form an integrated health evaluation system. The interRAI Acute Care Minimum Data Set (interRAI AC) is tailored for hospitalized older persons. Our aim in this study was to translate and adapt the interRAI AC to the Belgian hospital context, where it can be used together with the interRAI Home Care (HC) and the interRAI Long Term Care Facility (LTCF). Methods A systematic, comprehensive, and rigorous 10-step approach was used to adapt the interRAI AC to local requirements. After linguistic translation by an official translator, five researchers assessed the translation for appropriate hospital jargon. Three researchers double-checked for translation accuracy and proposed additional items. A provisional version was converted into the three official languages of Belgium—Flemish, French, and German. Next, a multidisciplinary panel of nine experts judged item relevance to the Belgian care context and advised which country-specific items should be added. After these suggestions were incorporated into the interRAI AC, hospital staff from nine Flemish hospitals field-tested the tool in their practice. After evaluating field-test results, we compared the interRAI AC with Belgian versions of the interRAI HC and interRAI LTCF. Next, the Flemish, French, and German versions of the Belgian interRAI portfolio were harmonized. Finally, we submitted the Belgian interRAI AC to the interRAI organization for ratification. Results Eighteen administrative items of the interRAI AC were adapted to the Belgian healthcare context (e.g., usual residence, formal community services prior to admission). Fourteen items assessing the ‘informal caregiver’, and 17 items, including country-specific items, were added (e.g., advanced directive for euthanasia). Conclusions The interRAI AC was adapted to local requirements using a meticulous and recursive 10-step approach. As use of the interRAI Suite continues to grow worldwide and as it continues to expand to other care settings and populations, this procedure can guide future translations. This procedure might also be used by others facing similar challenges of complex translation and adaptation situations, where multidimensional instruments are used across multiple care settings in multiple languages. PMID:22958520

48 CFR 12.302 - Tailoring of provisions and clauses for the acquisition of commercial items.

Code of Federal Regulations, 2010 CFR

2010-10-01

... relative volume of the Government's acquisitions in the specific market, contracting officers may, within the limitations of this subpart, and after conducting appropriate market research, tailor the... established in this subpart are intended to address, to the maximum extent practicable, commercial market...

48 CFR 12.302 - Tailoring of provisions and clauses for the acquisition of commercial items.

Code of Federal Regulations, 2011 CFR

2011-10-01

... relative volume of the Government's acquisitions in the specific market, contracting officers may, within the limitations of this subpart, and after conducting appropriate market research, tailor the... established in this subpart are intended to address, to the maximum extent practicable, commercial market...

Subjective health literacy: Development of a brief instrument for school-aged children.

PubMed

Paakkari, Olli; Torppa, Minna; Kannas, Lasse; Paakkari, Leena

2016-12-01

The present paper focuses on the measurement of health literacy (HL), which is an important determinant of health and health behaviours. HL starts to develop in childhood and adolescence; hence, there is a need for instruments to monitor HL among younger age groups. These instruments are still rare. The aim of the project reported here was, therefore, to develop a brief, multidimensional, theory-based instrument to measure subjective HL among school-aged children. The development of the instrument covered four phases: item generation based on a conceptual framework; a pilot study ( n = 405); test-retest ( n = 117); and construction of the instrument ( n = 3853). All the samples were taken from Finnish 7th and 9th graders. Initially, 65 items were generated, of which 32 items were selected for the pilot study. After item reduction, the instrument contained 16 items. The test-retest phase produced estimates of stability. In the final phase a 10-item instrument was constructed, referred to as Health Literacy for School-Aged Children (HLSAC). The instrument exhibited a high Cronbach alpha (0.93), and included two items from each of the five predetermined theoretical components (theoretical knowledge, practical knowledge, critical thinking, self-awareness, citizenship). The iterative and validity-driven development process made it possible to construct a brief multidimensional HLSAC instrument. Such instruments are suitable for large-scale studies, and for use with children and adolescents. Validation will require further testing for use in other countries.

Exploring autistic traits in anorexia: a clinical study.

PubMed

Tchanturia, Kate; Smith, Emma; Weineck, Felicitas; Fidanboylu, Eliz; Kern, Nikola; Treasure, Janet; Baron Cohen, Simon

2013-11-12

The objectives of this study were to explore associations between autistic traits and self-reported clinical symptoms in a population with anorexia nervosa (AN). Experimental and self-report evidence reveals similarities between AN and autism spectrum condition (ASC) populations in socio-emotional and cognitive domains; this includes difficulties with empathy, set-shifting and global processing. Focusing on these similarities may lead to better tailored interventions for both conditions. A cross-sectional independent-groups design was employed. Participants with AN (n = 66) and typical controls (n = 66) completed self-report questionnaires including the Short (10-Item) Version Autism Spectrum Quotient (AQ-10) questionnaire (the first time this has been implemented in this population), the Eating Disorder Examination Questionnaire, the Hospital Anxiety and Depression Scale and the Work and Social Adjustment Scale. Group differences and the relationship between autistic traits and other questionnaire measures were investigated. The AN group had a significantly higher AQ-10 total score and a greater proportion scored above the clinical cut-off than the control group. Seven out of ten AQ-10 items significantly discriminated between groups. In the AN group, levels of autistic traits correlated with a greater self-reported anxiety and depression and a lower ability to maintain close relationships; however, eating disorder symptoms were not associated with autistic traits. Women with anorexia possess a greater number of autistic traits than typical women. AQ-10 items that discriminated between groups related to 'bigger picture' (global) thinking, inflexibility of thinking and problems with social interactions, suggesting that autistic traits may exacerbate factors that maintain the eating disorder rather than cause the eating disorder directly. Using screening instruments may improve understanding of patients' problems, leading to better tailoring of intervention. We conclude that further investigation of autistic traits in AN could inform new intervention approaches based on joint working between ASC and eating disorder services.

"When I saw walking I just kind of took it as wheeling": interpretations of mobility-related items in generic, preference-based health state instruments in the context of spinal cord injury.

PubMed

Michel, Yvonne Anne; Engel, Lidia; Rand-Hendriksen, Kim; Augestad, Liv Ariane; Whitehurst, David Gt

2016-11-28

In health economic analyses, health states are typically valued using instruments with few items per dimension. Due to the generic (and often reductionist) nature of such instruments, certain groups of respondents may experience challenges in describing their health state. This study is concerned with generic, preference-based health state instruments that provide information for decisions about the allocation of resources in health care. Unlike physical measurement instruments, preference-based health state instruments provide health state values that are dependent on how respondents interpret the items. This study investigates how individuals with spinal cord injury (SCI) interpret mobility-related items contained within six preference-based health state instruments. Secondary analysis of focus group transcripts originally collected in Vancouver, Canada, explored individuals' perceptions and interpretations of mobility-related items contained within the 15D, Assessment of Quality of Life 8-dimension (AQoL-8D), EQ-5D-5L, Health Utilities Index (HUI), Quality of Well-Being Scale Self-Administered (QWB-SA), and the 36-item Short Form health survey version 2 (SF-36v2). Ritchie and Spencer's 'Framework Approach' was used to perform thematic analysis that focused on participants' comments concerning the mobility-related items only. Fifteen individuals participated in three focus groups (five per focus group). Four themes emerged: wording of mobility (e.g., 'getting around' vs 'walking'), reference to aids and appliances, lack of suitable response options, and reframing of items (e.g., replacing 'walking' with 'wheeling'). These themes reflected item features that respondents perceived as relevant in enabling them to describe their mobility, and response strategies that respondents could use when faced with inaccessible items. Investigating perceptions to mobility-related items within the context of SCI highlights substantial variation in item interpretation across six preference-based health state instruments. Studying respondents' interpretations of items can help to understand discrepancies in the health state descriptions and values obtained from different instruments. This line of research warrants closer attention in the health economics and quality of life literature.

A Valid and Reliable Instrument for Cognitive Complexity Rating Assignment of Chemistry Exam Items

ERIC Educational Resources Information Center

Knaus, Karen; Murphy, Kristen; Blecking, Anja; Holme, Thomas

2011-01-01

The design and use of a valid and reliable instrument for the assignment of cognitive complexity ratings to chemistry exam items is described in this paper. Use of such an instrument provides a simple method to quantify the cognitive demands of chemistry exam items. Instrument validity was established in two different ways: statistically…

Health- and vision-related quality of life in intellectually disabled children.

PubMed

Cui, Yu; Stapleton, Fiona; Suttle, Catherine; Bundy, Anita

2010-01-01

To investigate the psychometric properties of instruments for the assessment of self-reported functional vision performance and health-related quality of life in children with intellectual disabilities (IDs). Two instruments [Autoquestionnaire Enfant Image (AUQUEI), LV Prasad-Functional Vision Questionnaire (LVP-FVQ)] designed for the assessment of functional vision and health-related quality of life were adapted and administered to 168 school children with ID, aged 8 to 18 years. Rasch analysis was used to determine the appropriateness of the rating scales of these instruments and to identify any redundant items. Redundant items were excluded based on descriptive statistics and Rasch analysis, leaving 17 of 23 items in the revised AUQUEI and 16 of 22 in the LVP-FVQ. The AUQUEI items showed disordered thresholds on the rating scale. A modified step calibration (collapsed from four categories to three categories) resulted in ordered response thresholds for all items. The adjusted instrument produced an overall fit to the model (mean item infit = 1.06, SD = 0.32; mean item outfit = 1.11, SD = 0.35), indicating good construct validity. After Rasch analysis, the AUQUEI showed good content validity (person separation = 2.18; item reliability = 0.99; Cronbach alpha = 0.89). Increased similarity of person and item means and SDs on the logit scale after modification would indicate that the instrument was more applicable to the target population in its modified form. In contrast, the LVP-FVQ had a low person separation (1.35), suggesting that a more appropriate instrument is needed for assessment of vision-related quality of life in children with ID. The psychometric properties of two instruments were explored using Rasch analysis. By rescaling and reduction of items, the instruments were modified for use in a population of children with at least mild to moderate ID. However, an alternative instrument is needed for the assessment of vision-related quality of life in intellectually disabled children with normal vision or mild visual abnormalities.

A tailored multicomponent program to reduce discomfort in critically ill patients: a cluster-randomized controlled trial.

PubMed

Kalfon, Pierre; Baumstarck, Karine; Estagnasie, Philippe; Geantot, Marie-Agnès; Berric, Audrey; Simon, Georges; Floccard, Bernard; Signouret, Thomas; Boucekine, Mohamed; Fromentin, Mélanie; Nyunga, Martine; Sossou, Achille; Venot, Marion; Robert, René; Follin, Arnaud; Audibert, Juliette; Renault, Anne; Garrouste-Orgeas, Maïté; Collange, Olivier; Levrat, Quentin; Villard, Isabelle; Thevenin, Didier; Pottecher, Julien; Patrigeon, René-Gilles; Revel, Nathalie; Vigne, Coralie; Azoulay, Elie; Mimoz, Olivier; Auquier, Pascal

2017-12-01

Critically ill patients are exposed to stressful conditions and experience several discomforts. The primary objective was to assess whether a tailored multicomponent program is effective for reducing self-perceived discomfort. In a cluster-randomized two-arm parallel trial, 34 French adult intensive care units (ICUs) without planned interventions to reduce discomfort were randomized, 17 to the arm including a 6-month period of program implementation followed by a 6-month period without the program (experimental group), and 17 to the arm with an inversed sequence (control group). The tailored multicomponent program consisted of assessment of ICU-related self-perceived discomforts, immediate and monthly feedback to healthcare teams, and site-specific tailored interventions. The primary outcome was the overall discomfort score derived from the 16-item IPREA questionnaire (0, minimal, 100, maximal overall discomfort) and the secondary outcomes were the discomfort scores of each IPREA item. IPREA was administered on the day of ICU discharge with a considered timeframe from the ICU admission until ICU discharge. During a 1-month assessment period, 398 and 360 patients were included in the experimental group and the control group, respectively. The difference (experimental minus control) of the overall discomfort score between groups was - 7.00 (95% CI - 9.89 to - 4.11, p < 0.001). After adjustment (age, gender, ICU duration, mechanical ventilation duration, and type of admission), the program effect was still positive for the overall discomfort score (difference - 6.35, SE 1.23, p < 0.001) and for 12 out of 16 items. This tailored multicomponent program decreased self-perceived discomfort in adult critically ill patients. Clinicaltrials.gov Identifier NCT02442934.

Psychometric Principles in Measurement for Geoscience Education Research: A Climate Change Example

NASA Astrophysics Data System (ADS)

Libarkin, J. C.; Gold, A. U.; Harris, S. E.; McNeal, K.; Bowles, R.

2015-12-01

Understanding learning in geoscience classrooms requires that we use valid and reliable instruments aligned with intended learning outcomes. Nearly one hundred instruments assessing conceptual understanding in undergraduate science and engineering classrooms (often called concept inventories) have been published and are actively being used to investigate learning. The techniques used to develop these instruments vary widely, often with little attention to psychometric principles of measurement. This paper will discuss the importance of using psychometric principles to design, evaluate, and revise research instruments, with particular attention to the validity and reliability steps that must be undertaken to ensure that research instruments are providing meaningful measurement. An example from a climate change inventory developed by the authors will be used to exemplify the importance of validity and reliability, including the value of item response theory for instrument development. A 24-item instrument was developed based on published items, conceptions research, and instructor experience. Rasch analysis of over 1000 responses provided evidence for the removal of 5 items for misfit and one item for potential bias as measured via differential item functioning. The resulting 18-item instrument can be considered a valid and reliable measure based on pre- and post-implementation metrics. Consideration of the relationship between respondent demographics and concept inventory scores provides unique insight into the relationship between gender, religiosity, values and climate change understanding.

Development and psychometric validation of the 'Parent Perspective University of Rhode Island Change Assessment-Short' (PURICA-S) Questionnaire for the application in parents of children with overweight and obesity.

PubMed

Junne, Florian; Ziser, Katrin; Mander, Johannes; Martus, Peter; Denzer, Christian; Reinehr, Thomas; Wabitsch, Martin; Wiegand, Susanna; Renner, Tobias; Giel, Katrin E; Teufel, Martin; Zipfel, Stephan; Ehehalt, Stefan

2016-11-17

High prevalence rates of childhood obesity urgently call for improved effectiveness of intervention programmes for affected children and their families. One promising attempt can be seen in tailoring interventions according to the motivational stages of parents as 'agents of change' for their children. Evidence from other behavioural contexts (eg, addiction) clearly shows the superiority of motivational-stage dependent tailored (behavioural) interventions. For the time-efficient assessment of motivational stages of change, this study aims to develop and psychometrically validate a 'Parent Perspective Version' of the existing University of Rhode Island Change Assessment-Short, an instrument assessing the motivational stages based on the theoretical fundamentals of the Transtheoretical Model of Psychotherapy. In a multistep Delphi procedure, involving experts from the study context, the original items of the University of Rhode Island Change Assessment-Short Questionnaire will be transformed from the 'self-perspective' ('I am having a problem') to the parent perspective ('my child is having a problem'). Following item adaptation, the new version of the questionnaire will be psychometrically validated in a cohort of N=300 parents with overweight or obese children. Parents will be recruited within a multicentre and multisite approach involving private paediatric practices, specialised outpatient clinics as well as inpatient and rehabilitation sites. Analyses will include confirmatory factor analyses, internal consistencies (reliability) as well as convergent and criterion validity. Convergent validity will be analysed using subscales of the HAKEMP-90 Questionnaire, an instrument which has been shown to differentiate between 'state' and 'action' orientation of individuals. This study has been granted ethics committee approval by the University of Tuebingen (number 644/2014BO2). The results of this study will be released to the participating study centres and will be submitted to peer-reviewed journals and presented at international conferences. VfD_PURICA-S_15_003607. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Development of the Tailored Rett Intervention and Assessment Longitudinal (TRIAL) database and the Rett Evaluation of Symptoms and Treatments (REST) Questionnaire.

PubMed

Santosh, Paramala; Lievesley, Kate; Fiori, Federico; Singh, Jatinder

2017-06-21

Rett syndrome (RTT) is a pervasive neurodevelopmental disorder that presents with deficits in brain functioning leading to language and learning regression, characteristic hand stereotypies and developmental delay. Different mutations in the gene implicated in RTT- methyl-CpG-binding protein 2 ( MECP2 ) establishes RTT as a disorder with divergent symptomatology ranging from individuals with severe to milder phenotypes. A reliable and single multidimensional questionnaire is needed that can embrace all symptoms, and the relationships between them, and can map clinically meaningful data to symptomatology across the lifespan in patients with RTT. As part of the HealthTracker-based Tailored Rett Intervention and Assessment Longitudinal (TRIAL) database, the Rett Evaluation of Symptoms and Treatments (REST) Questionnaire will be able to marry with the physiological aspects of the disease obtained using wearable sensor technology, along with genetic and psychosocial data to stratify patients. Taken together, the web-based TRIAL database will empower clinicians and researchers with the confidence to delineate between different aspects of disorder symptomatology to streamline care pathways for individuals or for those patients entering clinical trials. This protocol describes the anticipated development of the REST questionnaire and the TRIAL database which links with the outcomes of the wearable sensor technology, and will serve as a barometer for longitudinal patient monitoring in patients with RTT. The US Food and Drug Administration Guidance for Patient-Reported Outcome Measures will be used as a template to inform the methodology of the study. It will follow an iterative framework that will include item/concept identification, item/concept elicitation in parent/carer-mediated focus groups, expert clinician feedback, web-based presentation of questionnaires, initial scale development, instrument refinement and instrument validation. The study has received favourable opinion from the National Health Service (NHS) Research Ethics Committee (REC): NHS Research Ethics Committee (REC)-London, Bromley Research Ethics Committee (reference: 15/LO/1772). © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Social Loafing Construct Validity in Higher Education: How Well Do Three Measures of Social Loafing Stand up to Scrutiny?

ERIC Educational Resources Information Center

de l'Eau, Jacquelyn

2017-01-01

The purpose of this study was to examine the construct validity of social loafing using convergent and discriminant validity principles. Three instruments that purport to measure social loafing were factor analyzed: A ten-item instrument by George (1992), a 13-item instrument by Mulvey and Klein (1998), and a 22-item instrument by Jassawalla,…

Caries Risk Assessment Item Importance

PubMed Central

Chaffee, B.W.; Featherstone, J.D.B.; Gansky, S.A.; Cheng, J.; Zhan, L.

2016-01-01

Caries risk assessment (CRA) is widely recommended for dental caries management. Little is known regarding how practitioners use individual CRA items to determine risk and which individual items independently predict clinical outcomes in children younger than 6 y. The objective of this study was to assess the relative importance of pediatric CRA items in dental providers’ decision making regarding patient risk and in association with clinically evident caries, cross-sectionally and longitudinally. CRA information was abstracted retrospectively from electronic patient records of children initially aged 6 to 72 mo at a university pediatric dentistry clinic (n = 3,810 baseline; n = 1,315 with follow-up). The 17-item CRA form included caries risk indicators, caries protective items, and clinical indicators. Conditional random forests classification trees were implemented to identify and assign variable importance to CRA items independently associated with baseline high-risk designation, baseline evident tooth decay, and follow-up evident decay. Thirteen individual CRA items, including all clinical indicators and all but 1 risk indicator, were independently and statistically significantly associated with student/resident providers’ caries risk designation. Provider-assigned baseline risk category was strongly associated with follow-up decay, which increased from low (20.4%) to moderate (30.6%) to high/extreme risk patients (68.7%). Of baseline CRA items, before adjustment, 12 were associated with baseline decay and 7 with decay at follow-up; however, in the conditional random forests models, only the clinical indicators (evident decay, dental plaque, and recent restoration placement) and 1 risk indicator (frequent snacking) were independently and statistically significantly associated with future disease, for which baseline evident decay was the strongest predictor. In this predominantly high-risk population under caries-preventive care, more individual CRA items were independently associated with providers’ risk determination than with future caries status. These university dental providers considered many items in decision making regarding patient risk, suggesting that, in turn, these comprehensive CRA forms could also aid individualized care, linking risk assessment to disease management. Knowledge Transfer Statement: Caries risk assessment (CRA) is widely recommended for patient-tailored, prevention-focused caries management. Studies show mixed predictive performance of pediatric CRA instruments, but little is known regarding how information captured in CRA forms guides clinical decision making. This study, in high-caries prevalence 6- to 72-mo-olds, demonstrates the following: 1) most items in a CRA instrument were independently associated with practitioners’ risk designations, 2) practitioners’ risk designations were significantly associated with future disease, and 3) of baseline measures associated with future caries, evident decay was the strongest independent indicator of future caries status. Although current disease (resulting from existing pathological and protective factor imbalance) may sufficiently predict future caries status in populations, other CRA items incorporated during risk categorization could aid practitioners to develop individualized intervention strategies against identified risk factors. PMID:27403458

The Caregiver Contribution to Heart Failure Self-Care (CACHS): Further Psychometric Testing of a Novel Instrument.

PubMed

Buck, Harleah G; Harkness, Karen; Ali, Muhammad Usman; Carroll, Sandra L; Kryworuchko, Jennifer; McGillion, Michael

2017-04-01

Caregivers (CGs) contribute important assistance with heart failure (HF) self-care, including daily maintenance, symptom monitoring, and management. Until CGs' contributions to self-care can be quantified, it is impossible to characterize it, account for its impact on patient outcomes, or perform meaningful cost analyses. The purpose of this study was to conduct psychometric testing and item reduction on the recently developed 34-item Caregiver Contribution to Heart Failure Self-care (CACHS) instrument using classical and item response theory methods. Fifty CGs (mean age 63 years ±12.84; 70% female) recruited from a HF clinic completed the CACHS in 2014 and results evaluated using classical test theory and item response theory. Items would be deleted for low (<.05) or high (>.95) endorsement, low (<.3) or high (>.7) corrected item-total correlations, significant pairwise correlation coefficients, floor or ceiling effects, relatively low latent trait and item information function levels (<1.5 and p > .5), and differential item functioning. After analysis, 14 items were excluded, resulting in a 20-item instrument (self-care maintenance eight items; monitoring seven items; and management five items). Most items demonstrated moderate to high discrimination (median 2.13, minimum .77, maximum 5.05), and appropriate item difficulty (-2.7 to 1.4). Internal consistency reliability was excellent (Cronbach α = .94, average inter-item correlation = .41) with no ceiling effects. The newly developed 20-item version of the CACHS is supported by rigorous instrument development and represents a novel instrument to measure CGs' contribution to HF self-care. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Modeling the Discrimination Power of Physics Items

ERIC Educational Resources Information Center

Mesic, Vanes

2011-01-01

For the purposes of tailoring physics instruction in accordance with the needs and abilities of the students it is useful to explore the knowledge structure of students of different ability levels. In order to precisely differentiate the successive, characteristic states of student achievement it is necessary to use test items that possess…

Pancreatitis Quality of Life Instrument: Development of a new instrument

PubMed Central

Bova, Carol; Barton, Bruce; Hartigan, Celia

2014-01-01

Objectives: The goal of this project was to develop the first disease-specific instrument for the evaluation of quality of life in chronic pancreatitis. Methods: Focus groups and interview sessions were conducted, with chronic pancreatitis patients, to identify items felt to impact quality of life which were subsequently formatted into a paper-and-pencil instrument. This instrument was used to conduct an online survey by an expert panel of pancreatologists to evaluate its content validity. Finally, the modified instrument was presented to patients during precognitive testing interviews to evaluate its clarity and appropriateness. Results: In total, 10 patients were enrolled in the focus groups and interview sessions where they identified 50 items. Once redundant items were removed, the 40 remaining items were made into a paper-and-pencil instrument referred to as the Pancreatitis Quality of Life Instrument. Through the processes of content validation and precognitive testing, the number of items in the instrument was reduced to 24. Conclusions: This marks the development of the first disease-specific instrument to evaluate quality of life in chronic pancreatitis. It includes unique features not found in generic instruments (economic factors, stigma, and spiritual factors). Although this marks a giant step forward, psychometric evaluation is still needed prior to its clinical use. PMID:26770703

METimage: an innovative multi-spectral imaging radiometer for the EUMETSAT polar system follow-on satellite mission

NASA Astrophysics Data System (ADS)

Alpers, Matthias; Brüns, Christian; Pillukat, Alexander

2017-11-01

The evolving needs of the meteorological community concerning the EUMETSAT Polar System follow-on satellite mission (Post-EPS) require the development of a high-performance multi-spectral imaging radiometer. Recognizing these needs, Jena Optronik GmbH proposed an innovative instrument concept, which comprises a high flexibility to adapt to user requirements as a very important feature. Core parameters like ground sampling distance (GSD), number and width of spectral channels, signal-to-noise ratio, polarization control and calibration facilities can be chosen in a wide range without changing the basic instrument configuration. Core item of the METimage instrument is a rotating telescope scanner to cover the large swath width of about 2800 km, which all polar platforms need for global coverage. The de-rotated image facilitates use of in-field spectral channel separation, which allows tailoring individual channel GSD (ground sampling distance) and features like TDI (time delay and integration). State-of-the-art detector arrays and readout electronics can easily be employed. Currently, the German DLR Space Agency, Jena- Optronik GmbH and AIM Infrarot Module GmbH work together implementing core assemblies of METimage: the rotating telescope scanner and the infrared detectors. The METimage instrument phase B study was kicked-off in September 2008. Germany intents to provide METimage as an in-kind contribution of the first METimage flight model to the EUMETSAT Post-EPS Programme.

[Instrument to measure adherence in hypertensive patients: contribution of Item Response Theory].

PubMed

Rodrigues, Malvina Thaís Pacheco; Moreira, Thereza Maria Magalhaes; Vasconcelos, Alexandre Meira de; Andrade, Dalton Francisco de; Silva, Daniele Braz da; Barbetta, Pedro Alberto

2013-06-01

To analyze, by means of "Item Response Theory", an instrument to measure adherence to t treatment for hypertension. Analytical study with 406 hypertensive patients with associated complications seen in primary care in Fortaleza, CE, Northeastern Brazil, 2011 using "Item Response Theory". The stages were: dimensionality test, calibrating the items, processing data and creating a scale, analyzed using the gradual response model. A study of the dimensionality of the instrument was conducted by analyzing the polychoric correlation matrix and factor analysis of complete information. Multilog software was used to calibrate items and estimate the scores. Items relating to drug therapy are the most directly related to adherence while those relating to drug-free therapy need to be reworked because they have less psychometric information and low discrimination. The independence of items, the small number of levels in the scale and low explained variance in the adjustment of the models show the main weaknesses of the instrument analyzed. The "Item Response Theory" proved to be a relevant analysis technique because it evaluated respondents for adherence to treatment for hypertension, the level of difficulty of the items and their ability to discriminate between individuals with different levels of adherence, which generates a greater amount of information. The instrument analyzed is limited in measuring adherence to hypertension treatment, by analyzing the "Item Response Theory" of the item, and needs adjustment. The proper formulation of the items is important in order to accurately measure the desired latent trait.

Development and evaluation of the Korean Health Literacy Instrument.

PubMed

Kang, Soo Jin; Lee, Tae Wha; Paasche-Orlow, Michael K; Kim, Gwang Suk; Won, Hee Kwan

2014-01-01

The purpose of this study is to develop and validate the Korean Health Literacy Instrument, which measures the capacity to understand and use health-related information and make informed health decisions in Korean adults. In Phase 1, 33 initial items were generated to measure functional, interactive, and critical health literacy with prose, document, and numeracy tasks. These items included content from health promotion, disease management, and health navigation contexts. Content validity assessment was conducted by an expert panel, and 11 items were excluded. In Phase 2, the 22 remaining items were administered to a convenience sample of 292 adults from community and clinical settings. Exploratory factor and item difficulty and discrimination analyses were conducted and four items with low discrimination were deleted. In Phase 3, the remaining 18 items were administered to a convenience sample of 315 adults 40-64 years of age from community and clinical settings. A confirmatory factor analysis was performed to test the construct validity of the instrument. The Korean Health Literacy Instrument has a range of 0 to 18. The mean score in our validation study was 11.98. The instrument exhibited an internal consistency reliability coefficient of 0.82, and a test-retest reliability of 0.89. The instrument is suitable for screening individuals who have limited health literacy skills. Future studies are needed to further define the psychometric properties and predictive validity of the Korean Health Literacy Instrument.

Development and psychometric evaluation of the psychological cigarette dependence scale for male smokers in taiwan.

PubMed

Huang, Chih-Ling; Cheng, Chung-Ping; Wang, Hsiu-Hung

2014-06-01

The influence of psychological factors on cigarette dependence often surpasses the direct effects of the nicotine itself. Researcher opinions on the nature and extent of psychological contributors to cigarette dependence vary widely. This study develops and psychometrically tests the Psychological Cigarette Dependence Scale (PCDS) for male smokers in Taiwan. The PCDS was developed using domain identification, individual interviews for item generation, expert reviews, and testing for construct validity and instrument stability. After initial item analysis, the PCDS was tested for concurrent and construct validity and reliability on 256 adult male smokers recruited from community centers, trade and business organizations, private companies, and factories in southern Taiwan. Participants were limited to adult men because female smokers are a small (4.1%) proportion of the female population in Taiwan and thus are difficult to recruit in statistically significant numbers. Exploratory factor analysis showed that lifelong binding and health concerns are the two predominating factors addressed by the 37-item PCDS. The PCDS correlated positively with the Fagerstrom questionnaire (r = .54, p < .01). Cronbach's alpha was .94, and test-retest reliability (intraclass coefficient) was .77 (N = 28). Preliminary evidence suggests that this scale is a valid measure of psychological cigarette dependence. Assessment results may help nursing professionals focus on smoking cessation interventions that are tailored to the patterns and severity of patients' psychological cigarette dependence.

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20).

PubMed

Jo, Min-Woo; Lee, Hyeon-Jeong; Kim, Soo Young; Kim, Seon-Ha; Chang, Hyejung; Ahn, Jeonghoon; Ock, Minsu

2017-01-01

Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability.

Fairness in Computerized Testing: Detecting Item Bias Using CATSIB with Impact Present

ERIC Educational Resources Information Center

Chu, Man-Wai; Lai, Hollis

2013-01-01

In educational assessment, there is an increasing demand for tailoring assessments to individual examinees through computer adaptive tests (CAT). As such, it is particularly important to investigate the fairness of these adaptive testing processes, which require the investigation of differential item function (DIF) to yield information about item…

Psychometric Aspects of Pupil Monitoring Systems

ERIC Educational Resources Information Center

Glas, Cees A. W.; Geerlings, Hanneke

2009-01-01

Pupil monitoring systems support the teacher in tailoring teaching to the individual level of a student and in comparing the progress and results of teaching with national standards. The systems are based on the availability of an item bank calibrated using item response theory. The assessment of the students' progress and results can be further…

Assessment Guide for Educators: Introduction

ERIC Educational Resources Information Center

GED Testing Service, 2016

2016-01-01

This guide is designed to help adult educators and administrators better understand the content of the GED® test. This guide is tailored to each test subject and highlights the test's item types, assessment targets, and guidelines for how items will be scored. This 2016 edition has been updated to include the most recent information about the…

Identifying content for the glaucoma-specific item bank to measure quality-of-life parameters.

PubMed

Khadka, Jyoti; McAlinden, Colm; Craig, Jamie E; Fenwick, Eva K; Lamoureux, Ecosse L; Pesudovs, Konrad

2015-01-01

Patient-reported outcomes (PROs) have become essential clinical trial end points. However, a comprehensive, multidimensional, patient-relevant, and precise glaucoma-specific PRO instrument is not available. Therefore, the purpose of this study was to identify content for a new, glaucoma-specific, quality-of-life (QOL) item bank. Content identification was undertaken in 5 phases: (1) identification of extant items in glaucoma-specific instruments and the qualitative literature; (2) focus groups and interviews with glaucoma patients; (3) item classification and selection; (4) expert review and revision of items; and (5) cognitive interviews with patients. A total of 737 unique items (extant items from PRO instruments, 247; qualitative articles, 14 items; focus groups and semistructured interviews, 476 items) were identified. These items were classified into 10 QOL domains. Four criteria (item redundancy, item inconsistent with domain definition, item content too narrow to have wider applicability, and item clarity) were used to remove and refine the items. After the cognitive interviews, the final minimally representative item set had a total of 342 unique items belonging to 10 domains: activity limitation (88), mobility (20), visual symptoms (19), ocular surface symptoms (22), general symptoms (15), convenience (39), health concerns (45), emotional well-being (49), social issues (23), and economic issues (22). The systematic content identification process identified 10 QOL domains, which were important to patients with glaucoma. The majority of the items were identified from the patient-specific focus groups and semistructured interviews suggesting that the existing PRO instruments do not adequately address QOL issues relevant to individuals with glaucoma.

Understanding Market Segments and Competition in the Private Military Industry

DTIC Science & Technology

2009-12-01

Likert scale, and importance scale) and “open-end” (unstructured) questions ( Kotler , 2009, p.137). We applied parts of the Tailored Design Method... Kotler , 2008, p. 249). Item 2 and Items 8-10 of the questionnaire attempted to capture the market niche/s that the respondents’ reportedly... Kotler , 2009, p. 137). These questions were designed using Likert-type items to assess the participant’s level of importance or level of

The development of an instrument for evaluating clinical teachers: involving stakeholders to determine content validity.

PubMed

Stalmeijer, Renée E; Dolmans, Diana H J M; Wolfhagen, Ineke H A P; Muijtjens, Arno M M; Scherpbier, Albert J J A

2008-01-01

Research indicates that the quality of supervision strongly influences the learning of medical students in clinical practice. Clinical teachers need feedback to improve their supervisory skills. The available instruments either lack a clear theoretical framework or are not suitable for providing feedback to individual teachers. We developed an evaluation instrument based on the 'cognitive apprenticeship model'. The aim was to estimate the content validity of the developed instrument. Item relevance was rated on a five-point scale (1 = highly irrelevant, 5 = highly relevant) by three groups of stakeholders in undergraduate clinical teaching: educationalists (N = 12), doctors (N = 16) and students (N = 12). Additionally, stakeholders commented on content, wording and omission of items. The items were generally rated as very relevant (Mean = 4.3, SD = 0.38, response = 95%) and any differences between the stakeholder groups were small. The results led to elimination of 4 items, rewording of 13 items and addition of 1 item. The cognitive apprenticeship model appears to offer a useful framework for the development of an evaluation instrument aimed at providing feedback to individual clinical teachers on the quality of student supervision. Further studies in larger populations will have to establish the instrument's statistical validity and generalizability.

Consumer Skills Items. A Collection of Consumer Skills Items for State and Local Education Agencies to Draw upon in Custom-Building Their Own Consumer Skills Instruments.

ERIC Educational Resources Information Center

Education Commission of the States, Denver, CO.

This is a collection of consumer skills items for state and local education agencies to draw upon in composing consumer skills instruments. It provides items to assess seventeen-year-olds' consumer skills. The booklet contains items classified under eight major topics: behavior, contracts, economics, energy, finances, mathematics, projection, and…

Development and psychometric evaluation of the Primary Health Care Engagement (PHCE) Scale: a pilot survey of rural and remote nurses.

PubMed

Kosteniuk, Julie G; Wilson, Erin C; Penz, Kelly L; MacLeod, Martha L P; Stewart, Norma J; Kulig, Judith C; Karunanayake, Chandima P; Kilpatrick, Kelley

2016-01-01

To report the development and psychometric evaluation of a scale to measure rural and remote (rural/remote) nurses' perceptions of the engagement of their workplaces in key dimensions of primary health care (PHC). Amidst ongoing PHC reforms, a comprehensive instrument is needed to evaluate the degree to which rural/remote health care settings are involved in the key dimensions that characterize PHC delivery, particularly from the perspective of professionals delivering care. This study followed a three-phase process of instrument development and psychometric evaluation. A literature review and expert consultation informed instrument development in the first phase, followed by an iterative process of content evaluation in the second phase. In the final phase, a pilot survey was undertaken and item discrimination analysis employed to evaluate the internal consistency reliability of each subscale in the preliminary 60-item Primary Health Care Engagement (PHCE) Scale. The 60-item scale was subsequently refined to a 40-item instrument. The pilot survey sample included 89 nurses in current practice who had experience in rural/remote practice settings. Participants completed either a web-based or paper survey from September to December, 2013. Following item discrimination analysis, the 60-item instrument was refined to a 40-item PHCE Scale consisting of 10 subscales, each including three to five items. Alpha estimates of the 10 refined subscales ranged from 0.61 to 0.83, with seven of the subscales demonstrating acceptable reliability (α ⩾ 0.70). The refined 40-item instrument exhibited good internal consistency reliability (α=0.91). The 40-item PHCE Scale may be considered for use in future studies regardless of locale, to measure the extent to which health care professionals perceive their workplaces to be engaged in key dimensions of PHC.

Applying mixed methods to pretest the Pressure Ulcer Quality of Life (PU-QOL) instrument.

PubMed

Gorecki, C; Lamping, D L; Nixon, J; Brown, J M; Cano, S

2012-04-01

Pretesting is key in the development of patient-reported outcome (PRO) instruments. We describe a mixed-methods approach based on interviews and Rasch measurement methods in the pretesting of the Pressure Ulcer Quality of Life (PU-QOL) instrument. We used cognitive interviews to pretest the PU-QOL in 35 patients with pressure ulcers with the view to identifying problematic items, followed by Rasch analysis to examine response options, appropriateness of the item series and biases due to question ordering (item fit). We then compared findings in an interactive and iterative process to identify potential strengths and weaknesses of PU-QOL items, and guide decision-making about further revisions to items and design/layout. Although cognitive interviews largely supported items, they highlighted problems with layout, response options and comprehension. Findings from the Rasch analysis identified problems with response options through reversed thresholds. The use of a mixed-methods approach in pretesting the PU-QOL instrument proved beneficial for identifying problems with scale layout, response options and framing/wording of items. Rasch measurement methods are a useful addition to standard qualitative pretesting for evaluating strengths and weaknesses of early stage PRO instruments.

Pressure ulcers: development and psychometric evaluation of the attitude towards pressure ulcer prevention instrument (APuP).

PubMed

Beeckman, D; Defloor, T; Demarré, L; Van Hecke, A; Vanderwee, K

2010-11-01

Pressure ulcers continue to be a significant problem in hospitals, nursing homes and community care settings. Pressure ulcer incidence is widely accepted as an indicator for the quality of care. Negative attitudes towards pressure ulcer prevention may result in suboptimal preventive care. A reliable and valid instrument to assess attitudes towards pressure ulcer prevention is lacking. Development and psychometric evaluation of the Attitude towards Pressure ulcer Prevention instrument (APuP). Prospective psychometric instrument validation study. A literature review was performed to design the instrument. Content validity was evaluated by nine European pressure ulcer experts and five experts in psychometric instrument validation in a double Delphi procedure. A convenience sample of 258 nurses and 291 nursing students from Belgium and The Netherlands participated in order to evaluate construct validity and stability reliability of the instrument. The data were collected between February and May 2008. A factor analysis indicated the construct of a 13 item instrument in a five factor solution: (1) attitude towards personal competency to prevent pressure ulcers (three items); (2) attitude towards the priority of pressure ulcer prevention (three items); (3) attitude towards the impact of pressure ulcers (three items); (4) attitude towards personal responsibility in pressure ulcer prevention (two items); and (5) attitude towards confidence in the effectiveness of prevention (two items). This five factor solution accounted for 61.4% of the variance in responses related to attitudes towards pressure ulcer prevention. All items demonstrated factor loadings over 0.60. The instrument produced similar results during stability testing [ICC=0.88 (95% CI=0.84-0.91, P<0.001)]. For the total instrument, the internal consistency (Cronbachs alpha) was 0.79. The APuP is a psychometrically sound instrument that can be used to effectively assess attitudes towards pressure ulcer prevention in patient care, education, and research. In further research, the association between attitude, knowledge and clinical performance should be explored. Copyright 2010 Elsevier Ltd. All rights reserved.

Measurement of activity limitations and participation restrictions: examination of ICF-linked content and scale properties of the FIM and PC-PART instruments.

PubMed

Darzins, Susan W; Imms, Christine; Di Stefano, Marilyn

2017-05-01

To explore the operationalization of activity and participation-related measurement constructs through comparison of item phrasing, item response categories and scoring (scale properties) for two separate instruments targeting activities of daily living. Personal Care Participation Assessment and Resource Tool (PC-PART) item content was linked to ICF categories using established linking rules. Previously reported ICF-linked FIM content categories and ICF-linked PC-PART content categories were compared to identify common ICF categories between the instruments. Scale properties of both instruments were compared using a patient scenario to explore the instruments' separate measurement constructs. The PC-PART and FIM shared 15 of the 53 level two ICF-linked categories identified across both instruments. Examination of the instruments' scale properties for items with overlapping ICF content, and exploration through a patient scenario, provided supportive evidence that the instruments measure different constructs. While the PC-PART and FIM share common ICF-linked content, they measure separate constructs. Measurement construct was influenced by the instruments' scale properties. The FIM was observed to measure activity limitations and the PC-PART measured participation restrictions. Scrutiny of instruments' scale properties in addition to item content is critical in the operationalization of activity and participation-related measurement constructs. Implications for Rehabilitation When selecting outcome measures for use in rehabilitation it is necessary to examine both the content of the instruments' items and item phrasing, response categories and scoring, to clarify the construct being measured. Measurement of activity limitations as well as participation restrictions in activities of daily living required for community life provides a more comprehensive measurement of rehabilitation outcomes than measurement of either construct alone. To measure the effects of interventions used in rehabilitation, it is necessary to select measures with relevant content and scale properties that enable evaluation of change in the constructs that are expected to change, as a result of the rehabilitation intervention.

Assessment of nasalance and nasality in patients with a repaired cleft palate.

PubMed

Sinko, Klaus; Gruber, Maike; Jagsch, Reinhold; Roesner, Imme; Baumann, Arnulf; Wutzl, Arno; Denk-Linnert, Doris-Maria

2017-07-01

In patients with a repaired cleft palate, nasality is typically diagnosed by speech language pathologists. In addition, there are various instruments to objectively diagnose nasalance. To explore the potential of nasalance measurements after cleft palate repair by NasalView ® , we correlated perceptual nasality and instrumentally measured nasalance of eight speech items and determined the relationship between sensitivity and specificity of the nasalance measures by receiver-operating characteristics (ROC) analyses and AUC (area under the curve) computation for each single test item and specific item groups. We recruited patients with a primarily repaired cleft palate receiving speech therapy during follow-up. During a single day visit, perceptive and instrumental assessments were obtained in 36 patients and analyzed. The individual perceptual nasality was assigned to one of four categories; the corresponding instrumental nasalance measures for the eight specific speech items were expressed on a metric scale (1-100). With reference to the perceptual diagnoses, we observed 3 nasal and one oral test item with high sensitivity. However, the specificity of the nasality indicating measures was rather low. The four best speech items with the highest sensitivity provided scores ranging from 96.43 to 100%, while the averaged sensitivity of all eight items was below 90%. We conclude that perceptive evaluation of nasality remains state of the art. For clinical follow-up, instrumental nasalance assessment can objectively document subtle changes by analysis of four speech items only. Further studies are warranted to determine the applicability of instrumental nasalance measures in the clinical routine, using discriminative items only.

Development, validity and reliability of the short multidimensional positive mental health instrument.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Abdin, Edimansyah; Picco, Louisa; Chua, Boon Yiang; Eng, Goi Khia; Sambasivam, Rajeswari; Shafie, Saleha; Zhang, Yunjue; Chong, Siow Ann

2014-06-01

The 47-item positive mental health (PMH) instrument measures the level of PMH in multiethnic adult Asian populations. This study aimed to (1) develop a short PMH instrument and (2) establish its validity and reliability among the adult Singapore population. Two separate studies were conducted among adult community-dwelling Singapore residents of Chinese, Malay or Indian ethnicity where participants completed self-administered questionnaires. In the first study, secondary data analysis was conducted using confirmatory factor analysis (CFA) to shorten the PMH instrument. In the second study, the newly developed short PMH instrument and other scales were administered to 201 residents to establish its factor structure, validity and reliability. A 20-item short PMH instrument fulfilling a higher-order six-factor structure was developed following secondary analysis. The mean age of the participants in the second study was 41 years and about 53% were women. One item with poor factor loading was further removed to generate a 19-item version of the PMH instrument. CFA demonstrated a first-order six-factor model of the short PMH instrument. The PMH-19 instrument and its subscales fulfilled criterion validity hypotheses. Internal consistency and test-retest reliability of the PMH-19 instrument were high (Cronbach's α coefficient = 0.87; intraclass correlation coefficient = 0.93, respectively). The 19-item PMH instrument is multidimensional, valid and reliable, and most importantly, with its reduced administration time, the short PMH instrument can be used to measure and evaluate PMH in Asian communities.

Evaluating Instrument Quality in Science Education: Rasch-based analyses of a Nature of Science test

NASA Astrophysics Data System (ADS)

Neumann, Irene; Neumann, Knut; Nehm, Ross

2011-07-01

Given the central importance of the Nature of Science (NOS) and Scientific Inquiry (SI) in national and international science standards and science learning, empirical support for the theoretical delineation of these constructs is of considerable significance. Furthermore, tests of the effects of varying magnitudes of NOS knowledge on domain-specific science understanding and belief require the application of instruments validated in accordance with AERA, APA, and NCME assessment standards. Our study explores three interrelated aspects of a recently developed NOS instrument: (1) validity and reliability; (2) instrument dimensionality; and (3) item scales, properties, and qualities within the context of Classical Test Theory and Item Response Theory (Rasch modeling). A construct analysis revealed that the instrument did not match published operationalizations of NOS concepts. Rasch analysis of the original instrument-as well as a reduced item set-indicated that a two-dimensional Rasch model fit significantly better than a one-dimensional model in both cases. Thus, our study revealed that NOS and SI are supported as two separate dimensions, corroborating theoretical distinctions in the literature. To identify items with unacceptable fit values, item quality analyses were used. A Wright Map revealed that few items sufficiently distinguished high performers in the sample and excessive numbers of items were present at the low end of the performance scale. Overall, our study outlines an approach for how Rasch modeling may be used to evaluate and improve Likert-type instruments in science education.

Development of a simple 12-item theory-based instrument to assess the impact of continuing professional development on clinical behavioral intentions.

PubMed

Légaré, France; Borduas, Francine; Freitas, Adriana; Jacques, André; Godin, Gaston; Luconi, Francesca; Grimshaw, Jeremy

2014-01-01

Decision-makers in organizations providing continuing professional development (CPD) have identified the need for routine assessment of its impact on practice. We sought to develop a theory-based instrument for evaluating the impact of CPD activities on health professionals' clinical behavioral intentions. Our multipronged study had four phases. 1) We systematically reviewed the literature for instruments that used socio-cognitive theories to assess healthcare professionals' clinically-oriented behavioral intentions and/or behaviors; we extracted items relating to the theoretical constructs of an integrated model of healthcare professionals' behaviors and removed duplicates. 2) A committee of researchers and CPD decision-makers selected a pool of items relevant to CPD. 3) An international group of experts (n = 70) reached consensus on the most relevant items using electronic Delphi surveys. 4) We created a preliminary instrument with the items found most relevant and assessed its factorial validity, internal consistency and reliability (weighted kappa) over a two-week period among 138 physicians attending a CPD activity. Out of 72 potentially relevant instruments, 47 were analyzed. Of the 1218 items extracted from these, 16% were discarded as improperly phrased and 70% discarded as duplicates. Mapping the remaining items onto the constructs of the integrated model of healthcare professionals' behaviors yielded a minimum of 18 and a maximum of 275 items per construct. The partnership committee retained 61 items covering all seven constructs. Two iterations of the Delphi process produced consensus on a provisional 40-item questionnaire. Exploratory factorial analysis following test-retest resulted in a 12-item questionnaire. Cronbach's coefficients for the constructs varied from 0.77 to 0.85. A 12-item theory-based instrument for assessing the impact of CPD activities on health professionals' clinical behavioral intentions showed adequate validity and reliability. Further studies could assess its responsiveness to behavior change following CPD activities and its capacity to predict health professionals' clinical performance.

Development of a Simple 12-Item Theory-Based Instrument to Assess the Impact of Continuing Professional Development on Clinical Behavioral Intentions

PubMed Central

Légaré, France; Borduas, Francine; Freitas, Adriana; Jacques, André; Godin, Gaston; Luconi, Francesca; Grimshaw, Jeremy

2014-01-01

Background Decision-makers in organizations providing continuing professional development (CPD) have identified the need for routine assessment of its impact on practice. We sought to develop a theory-based instrument for evaluating the impact of CPD activities on health professionals' clinical behavioral intentions. Methods and Findings Our multipronged study had four phases. 1) We systematically reviewed the literature for instruments that used socio-cognitive theories to assess healthcare professionals' clinically-oriented behavioral intentions and/or behaviors; we extracted items relating to the theoretical constructs of an integrated model of healthcare professionals' behaviors and removed duplicates. 2) A committee of researchers and CPD decision-makers selected a pool of items relevant to CPD. 3) An international group of experts (n = 70) reached consensus on the most relevant items using electronic Delphi surveys. 4) We created a preliminary instrument with the items found most relevant and assessed its factorial validity, internal consistency and reliability (weighted kappa) over a two-week period among 138 physicians attending a CPD activity. Out of 72 potentially relevant instruments, 47 were analyzed. Of the 1218 items extracted from these, 16% were discarded as improperly phrased and 70% discarded as duplicates. Mapping the remaining items onto the constructs of the integrated model of healthcare professionals' behaviors yielded a minimum of 18 and a maximum of 275 items per construct. The partnership committee retained 61 items covering all seven constructs. Two iterations of the Delphi process produced consensus on a provisional 40-item questionnaire. Exploratory factorial analysis following test-retest resulted in a 12-item questionnaire. Cronbach's coefficients for the constructs varied from 0.77 to 0.85. Conclusion A 12-item theory-based instrument for assessing the impact of CPD activities on health professionals' clinical behavioral intentions showed adequate validity and reliability. Further studies could assess its responsiveness to behavior change following CPD activities and its capacity to predict health professionals' clinical performance. PMID:24643173

Item generation and design testing of a questionnaire to assess degenerative joint disease-associated pain in cats.

PubMed

Zamprogno, Helia; Hansen, Bernie D; Bondell, Howard D; Sumrell, Andrea Thomson; Simpson, Wendy; Robertson, Ian D; Brown, James; Pease, Anthony P; Roe, Simon C; Hardie, Elizabeth M; Wheeler, Simon J; Lascelles, B Duncan X

2010-12-01

To determine the items (question topics) for a subjective instrument to assess degenerative joint disease (DJD)-associated chronic pain in cats and determine the instrument design most appropriate for use by cat owners. 100 randomly selected client-owned cats from 6 months to 20 years old. Cats were evaluated to determine degree of radiographic DJD and signs of pain throughout the skeletal system. Two groups were identified: high DJD pain and low DJD pain. Owner-answered questions about activity and signs of pain were compared between the 2 groups to define items relating to chronic DJD pain. Interviews with 45 cat owners were performed to generate items. Fifty-three cat owners who had not been involved in any other part of the study, 19 veterinarians, and 2 statisticians assessed 6 preliminary instrument designs. 22 cats were selected for each group; 19 important items were identified, resulting in 12 potential items for the instrument; and 3 additional items were identified from owner interviews. Owners and veterinarians selected a 5-point descriptive instrument design over 11-point or visual analogue scale formats. Behaviors relating to activity were substantially different between healthy cats and cats with signs of DJD-associated pain. Fifteen items were identified as being potentially useful, and the preferred instrument design was identified. This information could be used to construct an owner-based questionnaire to assess feline DJD-associated pain. Once validated, such a questionnaire would assist in evaluating potential analgesic treatments for these patients.

Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings

PubMed Central

2012-01-01

Background There is a great deal of variation in the existing capacity of primary prevention programs and policies addressing chronic disease to deliver evidence-based interventions (EBIs). In order to develop and evaluate implementation strategies that are tailored to the appropriate level of capacity, there is a need for an easy-to-administer tool to stage organizational readiness for EBIs. Methods Based on theoretical frameworks, including Rogers’ Diffusion of Innovations, we developed a survey instrument to measure four domains representing stages of readiness for EBI: awareness, adoption, implementation, and maintenance. A separate scale representing organizational climate as a potential mediator of readiness for EBIs was also included in the survey. Twenty-three questions comprised the four domains, with four to nine items each, using a seven-point response scale. Representatives from obesity, asthma, diabetes, and tobacco prevention programs serving diverse populations in the United States were surveyed (N = 243); test-retest reliability was assessed with 92 respondents. Results Confirmatory factor analysis (CFA) was used to test and refine readiness scales. Test-retest reliability of the readiness scales, as measured by intraclass correlation, ranged from 0.47–0.71. CFA found good fit for the five-item adoption and implementation scales and resulted in revisions of the awareness and maintenance scales. The awareness scale was split into two two-item scales, representing community and agency awareness. The maintenance scale was split into five- and four-item scales, representing infrastructural maintenance and evaluation maintenance, respectively. Internal reliability of scales (Cronbach’s α) ranged from 0.66–0.78. The model for the final revised scales approached good fit, with most factor loadings >0.6 and all >0.4. Conclusions The lack of adequate measurement tools hinders progress in dissemination and implementation research. These preliminary results help fill this gap by describing the reliability and measurement properties of a theory-based tool; the short, user-friendly instrument may be useful to researchers and practitioners seeking to assess organizational readiness for EBIs across a variety of chronic disease prevention programs and settings. PMID:22800294

Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings.

PubMed

Stamatakis, Katherine A; McQueen, Amy; Filler, Carl; Boland, Elizabeth; Dreisinger, Mariah; Brownson, Ross C; Luke, Douglas A

2012-07-16

There is a great deal of variation in the existing capacity of primary prevention programs and policies addressing chronic disease to deliver evidence-based interventions (EBIs). In order to develop and evaluate implementation strategies that are tailored to the appropriate level of capacity, there is a need for an easy-to-administer tool to stage organizational readiness for EBIs. Based on theoretical frameworks, including Rogers' Diffusion of Innovations, we developed a survey instrument to measure four domains representing stages of readiness for EBI: awareness, adoption, implementation, and maintenance. A separate scale representing organizational climate as a potential mediator of readiness for EBIs was also included in the survey. Twenty-three questions comprised the four domains, with four to nine items each, using a seven-point response scale. Representatives from obesity, asthma, diabetes, and tobacco prevention programs serving diverse populations in the United States were surveyed (N=243); test-retest reliability was assessed with 92 respondents. Confirmatory factor analysis (CFA) was used to test and refine readiness scales. Test-retest reliability of the readiness scales, as measured by intraclass correlation, ranged from 0.47-0.71. CFA found good fit for the five-item adoption and implementation scales and resulted in revisions of the awareness and maintenance scales. The awareness scale was split into two two-item scales, representing community and agency awareness. The maintenance scale was split into five- and four-item scales, representing infrastructural maintenance and evaluation maintenance, respectively. Internal reliability of scales (Cronbach's α) ranged from 0.66-0.78. The model for the final revised scales approached good fit, with most factor loadings >0.6 and all >0.4. The lack of adequate measurement tools hinders progress in dissemination and implementation research. These preliminary results help fill this gap by describing the reliability and measurement properties of a theory-based tool; the short, user-friendly instrument may be useful to researchers and practitioners seeking to assess organizational readiness for EBIs across a variety of chronic disease prevention programs and settings.

An Evaluation of One- and Three-Parameter Logistic Tailored Testing Procedures for Use with Small Item Pools.

ERIC Educational Resources Information Center

McKinley, Robert L.; Reckase, Mark D.

A two-stage study was conducted to compare the ability estimates yielded by tailored testing procedures based on the one-parameter logistic (1PL) and three-parameter logistic (3PL) models. The first stage of the study employed real data, while the second stage employed simulated data. In the first stage, response data for 3,000 examinees were…

[Development of an Instrument to Assess the Quality of Childbirth Care from the Mother's Perspective].

PubMed

Jeong, Geum Hee; Kim, Hyun Kyoung; Kim, Young Hee; Kim, Sun Hee; Lee, Sun Hee; Kim, Kyung Won

2018-02-01

This study aimed to develop an instrument to assess the quality of childbirth care from the perspective of a mother after delivery. The instrument was developed from a literature review, interviews, and item validation. Thirty-eight items were compiled for the instrument. The data for validity and reliability testing were collected using a questionnaire survey conducted on 270 women who had undergone normal vaginal delivery in Korea and analyzed with descriptive statistics, exploratory factor analysis, and reliability coefficients. The exploratory factor analysis reduced the number of items in the instrument to 28 items that were factored into four subscales: family-centered care, personal care, emotional empowerment, and information provision. With respect to convergence validation, there was positive correlation between this instrument and birth satisfaction scale (r=.34, p<.001). The internal consistency reliability was acceptable (Cronbach's alpha =.96). This instrument could be used as a measure of the quality of nursing care for women who have a normal vaginal delivery. © 2018 Korean Society of Nursing Science.

Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1--eliciting concepts for a new PRO instrument.

PubMed

Patrick, Donald L; Burke, Laurie B; Gwaltney, Chad J; Leidy, Nancy Kline; Martin, Mona L; Molsen, Elizabeth; Ring, Lena

2011-12-01

The importance of content validity in developing patient reported outcomes (PRO) instruments is stressed by both the US Food and Drug Administration and the European Medicines Agency. Content validity is the extent to which an instrument measures the important aspects of concepts that developers or users purport it to assess. A PRO instrument measures the concepts most significant and relevant to a patient's condition and its treatment. For PRO instruments, items and domains as reflected in the scores of an instrument should be important to the target population and comprehensive with respect to patient concerns. Documentation of target population input in item generation, as well as evaluation of patient understanding through cognitive interviewing, can provide the evidence for content validity. Developing content for, and assessing respondent understanding of, newly developed PRO instruments for medical product evaluation will be discussed in this two-part ISPOR PRO Good Research Practices Task Force Report. Topics include the methods for generating items, documenting item development, coding of qualitative data from item generation, cognitive interviewing, and tracking item development through the various stages of research and preparing this tracking for submission to regulatory agencies. Part 1 covers elicitation of key concepts using qualitative focus groups and/or interviews to inform content and structure of a new PRO instrument. Part 2 covers the instrument development process, the assessment of patient understanding of the draft instrument using cognitive interviews and steps for instrument revision. The two parts are meant to be read together. They are intended to offer suggestions for good practices in planning, executing, and documenting qualitative studies that are used to support the content validity of PRO instruments to be used in medical product evaluation. Copyright © 2011 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

The positive mental health instrument: development and validation of a culturally relevant scale in a multi-ethnic Asian population.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Chong, Siow Ann; Abdin, Edimansyah; Orlando Edelen, Maria; Picco, Louisa; Lim, Yee Wei; Phua, Mei Yen; Chua, Boon Yiang; Tee, Joseph Y S; Sherbourne, Cathy

2011-10-31

Instruments to measure mental health and well-being are largely developed and often used within Western populations and this compromises their validity in other cultures. A previous qualitative study in Singapore demonstrated the relevance of spiritual and religious practices to mental health, a dimension currently not included in exiting multi-dimensional measures. The objective of this study was to develop a self-administered measure that covers all key and culturally appropriate domains of mental health, which can be applied to compare levels of mental health across different age, gender and ethnic groups. We present the item reduction and validation of the Positive Mental Health (PMH) instrument in a community-based adult sample in Singapore. Surveys were conducted among adult (21-65 years) residents belonging to Chinese, Malay and Indian ethnicities. Exploratory and confirmatory factor analysis (EFA, CFA) were conducted and items were reduced using item response theory tests (IRT). The final version of the PMH instrument was tested for internal consistency and criterion validity. Items were tested for differential item functioning (DIF) to check if items functioned in the same way across all subgroups. EFA and CFA identified six first-order factor structure (General coping, Personal growth and autonomy, Spirituality, Interpersonal skills, Emotional support, and Global affect) under one higher-order dimension of Positive Mental Health (RMSEA=0.05, CFI=0.96, TLI=0.96). A 47-item self-administered multi-dimensional instrument with a six-point Likert response scale was constructed. The slope estimates and strength of the relation to the theta for all items in each six PMH subscales were high (range:1.39 to 5.69), suggesting good discrimination properties. The threshold estimates for the instrument ranged from -3.45 to 1.61 indicating that the instrument covers entire spectrums for the six dimensions. The instrument demonstrated high internal consistency and had significant and expected correlations with other well-being measures. Results confirmed absence of DIF. The PMH instrument is a reliable and valid instrument that can be used to measure and compare level of mental health across different age, gender and ethnic groups in Singapore.

To Assess Prerequisites Before an Implementation Strategy in an Orthopaedic Department in Sweden.

PubMed

Bahtsevani, Christel; Idvall, Ewa

2016-01-01

Promoting Action on Research Implementation in Health Services (PARiHS) asserts that the success of knowledge implementation relates to multiple factors in a complex and dynamic way, and therefore the effects of implementation strategies vary by method and context. An instrument based on the PARiHS framework was developed to help assess critical factors influencing implementation strategies so that strategies can be tailored to promote implementation.The purpose of this study was to use the Evaluation Before Implementation Questionnaire (EBIQ), to describe staff perceptions in one orthopaedic department, and to investigate differences between wards.Staff members in four different wards at one orthopaedic department at a university hospital in Sweden were invited to complete a questionnaire related to planning for the implementation of a clinical practice guideline. The 23 items in the EBIQ were expected to capture staff perceptions about the evidence, context, and facilitation factors that influence the implementation process. Descriptive statistics and differences between wards were analyzed. Although the overall response rate was low (n = 49), two of the four wards accounted for most of the completed questionnaires (n = 25 and n = 12, respectively), enabling a comparison of these wards. We found significant differences between respondents' perceptions at the two wards in six items regarding context and facilitation in terms of receptiveness to change, forms of leadership, and evaluation and presence of feedback and facilitators.The EBIQ instrument requires further testing, but there appears to be initial support for pre-implementation use of the EBIQ as a means to enhance planning for implementation.

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20)

PubMed Central

2017-01-01

Objectives Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. Methods After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Results Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). Conclusions A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability. PMID:28173686

Disability Measurement for Korean Community-Dwelling Adults With Stroke: Item-Level Psychometric Analysis of the Korean Longitudinal Study of Ageing

PubMed Central

2018-01-01

Objective To investigate the psychometric properties of the activities of daily living (ADL) instrument used in the analysis of Korean Longitudinal Study of Ageing (KLoSA) dataset. Methods A retrospective study was carried out involving 2006 KLoSA records of community-dwelling adults diagnosed with stroke. The ADL instrument used for the analysis of KLoSA included 17 items, which were analyzed using Rasch modeling to develop a robust outcome measure. The unidimensionality of the ADL instrument was examined based on confirmatory factor analysis with a one-factor model. Item-level psychometric analysis of the ADL instrument included fit statistics, internal consistency, precision, and the item difficulty hierarchy. Results The study sample included a total of 201 community-dwelling adults (1.5% of the Korean population with an age over 45 years; mean age=70.0 years, SD=9.7) having a history of stroke. The ADL instrument demonstrated unidimensional construct. Two misfit items, money management (mean square [MnSq]=1.56, standardized Z-statistics [ZSTD]=2.3) and phone use (MnSq=1.78, ZSTD=2.3) were removed from the analysis. The remaining 15 items demonstrated good item fit, high internal consistency (person reliability=0.91), and good precision (person strata=3.48). The instrument precisely estimated person measures within a wide range of theta (−4.75 logits < θ < 3.97 logits) and a reliability of 0.9, with a conceptual hierarchy of item difficulty. Conclusion The findings indicate that the 15 ADL items met Rasch expectations of unidimensionality and demonstrated good psychometric properties. It is proposed that the validated ADL instrument can be used as a primary outcome measure for assessing longitudinal disability trajectories in the Korean adult population and can be employed for comparative analysis of international disability across national aging studies. PMID:29765888

Development and Validation of the Scan of Postgraduate Educational Environment Domains (SPEED): A Brief Instrument to Assess the Educational Environment in Postgraduate Medical Education

PubMed Central

Schönrock-Adema, Johanna; Visscher, Maartje; Raat, A. N. Janet; Brand, Paul L. P.

2015-01-01

Introduction Current instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality. Methods Stepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected. Results Two hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ≥80% by the items representing the domains in the final SPEED. Conclusions The SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity and brevity, the SPEED is promising as useful and easily applicable tool to regularly screen educational environment quality in postgraduate medical education. PMID:26413836

Human Factors Engineering. Part 2. HEDGE (Human Factors Engineering Data Guide for Evaluation)

DTIC Science & Technology

1983-11-30

Use.Condit ions 0 7ý est Item ComoentsTask Categories EPurposes 2 ;c . INDEX TO THE INDEX MAN/ITEM TASK SHEET DETAILED DESIGN CONSIDERATION The purpose of...The use of these materials, in addition to standard Task and Design Checklists and Questionnaires, will enable you to tailor your FIFE subtest to a...specific Con item. The These materials have been prepared especially for you: I. They are intended to support test engineers not design engineers. 2

The knowledge, efficacy, and practices instrument for oral health providers: a validity study with dental students.

PubMed

Behar-Horenstein, Linda S; Garvan, Cyndi W; Moore, Thomas E; Catalanotto, Frank A

2013-08-01

Valid and reliable instruments to measure and assess cultural competence for oral health care providers are scarce in the literature, and most published scales have been contested due to a lack of item analysis and internal estimates of reliability. The purposes of this study were, first, to develop a standardized instrument to measure dental students' knowledge of diversity, skills in culturally competent patient-centered communication, and use of culture-centered practices in patient care and, second, to provide preliminary validity support for this instrument. The initial instrument used in this study was a thirty-six-item Likert-scale survey entitled the Knowledge, Efficacy, and Practices Instrument for Oral Health Providers (KEPI-OHP). This instrument is an adaption of an initially thirty-three-item version of the Multicultural Awareness, Knowledge, and Skills Scale-Counselor Edition (MAKSS-CE), a scale that assesses factors related to social justice, cultural differences among clients, and cross-cultural client management. After the authors conducted cognitive and expert interviews, focus groups, pilot testing, and item analysis, their initial instrument was reduced to twenty-eight items. The KEPI-OHP was then distributed to 916 dental students (response rate=48.6 percent) across the United States to measure its reliability and assess its validity. Both exploratory and confirmatory factor analyses were conducted to test the scale's validity. The modification of the survey into a sensible instrument with a relatively clear factor structure using factor analysis resulted in twenty items. A scree test suggested three expressive factors, which were retained for rotation. Bentler's comparative fit and Bentler and Bonnett's non-normed indices were 0.95 and 0.92, respectively. A three-factor solution, including efficacy of assessment, knowledge of diversity, and culture-centered practice subscales, comprised of twenty-items was identified. The KEPI-OHP was found to have reasonable internal consistency reliability to warrant its use for baseline and repeated measures in assessing changes in dental students' growth in cultural competence across four-year dental curricula.

Tailoring Multimedia Instruction to Soldier Needs

DTIC Science & Technology

2014-12-01

Pretest Score (Mean % Items Correct) 39% 34% 48% 51% 51% 45% Posttest (Mean % Items Correct) 47% 44% 66% 60% 63% 56...Stepwise regression was used to examine the relationship between Soldiers’ posttest scores (criterion) and their pretest scores, training time, type of...differences among IMI types had no effect.) Pretest scores predicted posttest scores for both Adjust Indirect Fire (βstandardized = .66, t = 6.36

Development and validation of an instrument to assess job satisfaction in eye-care personnel.

PubMed

Paudel, Prakash; Cronjé, Sonja; O'Connor, Patricia M; Khadka, Jyoti; Rao, Gullapalli N; Holden, Brien A

2017-11-01

The aim was to develop and validate an instrument to measure job satisfaction in eye-care personnel and assess the job satisfaction of one-year trained vision technicians in India. A pilot instrument for assessing job satisfaction was developed, based on a literature review and input from a public health expert panel. Rasch analysis was used to assess psychometric properties and to undertake an iterative item reduction. The instrument was then administered to vision technicians in vision centres of Andhra Pradesh in India. Associations between vision technicians' job satisfaction and factors such as age, gender and experience were analysed using t-test and one-way analysis of variance. Rasch analysis confirmed that the 15-item job satisfaction in eye-care personnel (JSEP) was a unidimensional instrument with good fit statistics, measurement precisions and absence of differential item functioning. Overall, vision technicians reported high rates of job satisfaction (0.46 logits). Age, gender and experience were not associated with high job satisfaction score. Item score analysis showed non-financial incentives, salary and workload were the most important determinants of job satisfaction. The 15-item JSEP instrument is a valid instrument for assessing job satisfaction among eye-care personnel. Overall, vision technicians in India demonstrated high rates of job satisfaction. © 2016 Optometry Australia.

Developing self-concept instrument for pre-service mathematics teachers

NASA Astrophysics Data System (ADS)

Afgani, M. W.; Suryadi, D.; Dahlan, J. A.

2018-01-01

This study aimed to develop self-concept instrument for undergraduate students of mathematics education in Palembang, Indonesia. Type of this study was development research of non-test instrument in questionnaire form. A Validity test of the instrument was performed with construct validity test by using Pearson product moment and factor analysis, while reliability test used Cronbach’s alpha. The instrument was tested by 65 undergraduate students of mathematics education in one of the universities at Palembang, Indonesia. The instrument consisted of 43 items with 7 aspects of self-concept, that were the individual concern, social identity, individual personality, view of the future, the influence of others who become role models, the influence of the environment inside or outside the classroom, and view of the mathematics. The result of validity test showed there was one invalid item because the value of Pearson’s r was 0.107 less than the critical value (0.244; α = 0.05). The item was included in social identity aspect. After the invalid item was removed, Construct validity test with factor analysis generated only one factor. The Kaiser-Meyer-Olkin (KMO) coefficient was 0.846 and reliability coefficient was 0.91. From that result, we concluded that the self-concept instrument for undergraduate students of mathematics education in Palembang, Indonesia was valid and reliable with 42 items.

Study of labor-negotiation productivity concerns in the petroleum-refining industry

DOE Office of Scientific and Technical Information (OSTI.GOV)

Smith, J.E.

The primary objective of this study was to identify productivity factors relative to negotiating future labor contracts with the Oil, Chemical and Atomic Workers International Union (OCAWIU). A Delphi research method was utilized to accomplish this purpose. The study utilized three rounds to obtain the stated objectives. Round one involved the use of an open instrument to solicit productivity factors that would be beneficial in future negotiations with the OCAWIU. In round two, two separate instruments were sent to the panel members who were asked to judge the value of each item on the first instrument, and to rank themore » ten most significant items on the second. The round three instruments were individualized for each panel member. The productivity items were rated by the panel members, and descriptive statistics were used to describe the combined order of listings and weights for determining the relative importance of each factor in the consensus model. The nonparametric statistics were used to examine the degree of consensus between the mean values on the first instrument with the ranked values for the second instrument. No significant differences were formed. Twenty-five productivity items were identified and prioritized as viable negotiable items with the OCAWIU.« less

Single-Item Screening for Agoraphobic Symptoms: Validation of a Web-Based Audiovisual Screening Instrument

PubMed Central

van Ballegooijen, Wouter; Riper, Heleen; Donker, Tara; Martin Abello, Katherina; Marks, Isaac; Cuijpers, Pim

2012-01-01

The advent of web-based treatments for anxiety disorders creates a need for quick and valid online screening instruments, suitable for a range of social groups. This study validates a single-item multimedia screening instrument for agoraphobia, part of the Visual Screener for Common Mental Disorders (VS-CMD), and compares it with the text-based agoraphobia items of the PDSS-SR. The study concerned 85 subjects in an RCT of the effects of web-based therapy for panic symptoms. The VS-CMD item and items 4 and 5 of the PDSS-SR were validated by comparing scores to the outcomes of the CIDI diagnostic interview. Screening for agoraphobia was found moderately valid for both the multimedia item (sensitivity.81, specificity.66, AUC.734) and the text-based items (AUC.607–.697). Single-item multimedia screening for anxiety disorders should be further developed and tested in the general population and in patient, illiterate and immigrant samples. PMID:22844391

The Student Actions Coding Sheet (SACS): An instrument for illuminating the shifts toward student-centered science classrooms

NASA Astrophysics Data System (ADS)

Erdogan, Ibrahim; Campbell, Todd; Hashidah Abd-Hamid, Nor

2011-07-01

This study describes the development of an instrument to investigate the extent to which student-centered actions are occurring in science classrooms. The instrument was developed through the following five stages: (1) student action identification, (2) use of both national and international content experts to establish content validity, (3) refinement of the item pool based on reviewer comments, (4) pilot testing of the instrument, and (5) statistical reliability and item analysis leading to additional refinement and finalization of the instrument. In the field test, the instrument consisted of 26 items separated into four categories originally derived from student-centered instruction literature and used by the authors to sort student actions in previous research. The SACS was administered across 22 Grade 6-8 classrooms by 22 groups of observers, with a total of 67 SACS ratings completed. The finalized instrument was found to be internally consistent, with acceptable estimates from inter-rater intraclass correlation reliability coefficients at the p < 0.01 level. After the final stage of development, the SACS instrument consisted of 24 items separated into three categories, which aligned with the factor analysis clustering of the items. Additionally, concurrent validity of the SACS was established with the Reformed Teaching Observation Protocol. Based on the analyses completed, the SACS appears to be a useful instrument for inclusion in comprehensive assessment packages for illuminating the extent to which student-centered actions are occurring in science classrooms.

Validation of the HIV/AIDS Stigma Instrument - PLWA (HASI-P).

PubMed

Holzemer, William L; Uys, Leana R; Chirwa, Maureen L; Greeff, Minrie; Makoae, Lucia N; Kohi, Thecla W; Dlamini, Priscilla S; Stewart, Anita L; Mullan, Joseph; Phetlhu, René D; Wantland, Dean; Durrheim, Kevin

2007-09-01

This article describes the development and testing of a quantitative measure of HIV/AIDS stigma as experienced by people living with HIV/AIDS. This instrument is designed to measure perceived stigma, create a baseline from which to measure changes in stigma over time, and track potential progress towards reducing stigma. It was developed in three phases from 2003-2006: generating items based on results of focus group discussions; pilot testing and reducing the original list of items; and validating the instrument. Data for all phases were collected from five African countries: Lesotho, Malawi, South Africa, Swaziland and Tanzania. The instrument was validated with a sample of 1,477 persons living with HIV/AIDS from all of the five countries. The sample had a mean age of 36.1 years and 74.1% was female. The participants reported they knew they were HIV positive for an average of 3.4 years and 46% of the sample was taking antiretroviral medications. A six factor solution with 33 items explained 60.72% of the variance. Scale alpha reliabilities were examined and items that did not contribute to scale reliability were dropped. The factors included: Verbal Abuse (8 items, alpha=0.886); Negative Self-Perception (5 items, alpha=0.906); Health Care Neglect (7 items, alpha=0.832); Social Isolation (5 items, alpha=0.890); Fear of Contagion (6 items, alpha=0.795); and Workplace Stigma (2 items, alpha=0.758). This article reports on the development and validation of a new measure of stigma, HIV/AIDS Stigma Instrument - PLWA (HASI-P) providing evidence that supports adequate content and construct validity, modest concurrent validity, and acceptable internal consistency reliability for each of the six subscales and total score. The scale is available is several African languages.

[Development of a questionnaire to measure family stress among married working women].

PubMed

Kim, Gwang Suk; Cho, Won Jung

2006-08-01

Even though a number of studies have suggested that appropriate measuring instruments of family stress for working women have to be developed, the validity and reliability of the instruments used have not been consistently examined. The purpose of the present study was to develop a sensitive instrument to measure family stress for married working women, and to test the validity and reliability of the instrument. The items generated for this instrument were drawn from a comprehensive literature review. Twenty four items were developed through evaluation by 10 experts and twenty one items were finally confirmed through item analysis. Psychometric testing was preformed and confirmed with a convenient sample of 240 women employed in the industrial sector. Four factors evolved by factor analysis, which explained 50.5% of the total variance. The first factor 'Cooperation' explained 28.1%, 2nd factor 'Satisfaction with relationships' 10.6%, 3rd factor 'Democratic and comfortable environment' 6.3%, and 4th factor 'Disturbance of own living' 5.5%. Cronbach's coefficient of this instrument was 0.86. The study supports the validity and reliability of the instrument.

Shortening of an existing generic online health-related quality of life instrument for dogs.

PubMed

Reid, J; Wiseman-Orr, L; Scott, M

2017-10-11

Development, initial validation and reliability testing of a shortened version of a web-based questionnaire instrument to measure generic health-related quality of life in companion dogs, to facilitate smartphone and online use. The original 46 items were reduced using expert judgment and factor analysis. Items were removed on the basis of item loadings and communalities on factors identified through factor analysis of responses from owners of healthy and unwell dogs, intrafactor item correlations, readability of items in the UK, USA and Australia and ability of individual items to discriminate between healthy and unwell dogs. Validity was assessed through factor analysis and a field trial using a "known groups" approach. Test-retest reliability was assessed using intraclass correlation coefficients. The new instrument comprises 22 items, each of which was rated by dog owners using a 7-point Likert scale. Factor analysis revealed a structure with four health-related quality of life domains (energetic/enthusiastic, happy/content, active/comfortable, and calm/relaxed) accounting for 72% of the variability in the data compared with 64% for the original instrument. The field test involving 153 healthy and unwell dogs demonstrated good discriminative properties and high intraclass correlation coefficients. The 22-item shortened form is superior to the original instrument and can be accessed via a mobile phone app. This is likely to increase the acceptability to dog owners as a routine wellness measure in health care packages and as a therapeutic monitoring tool. © 2017 British Small Animal Veterinary Association.

Development of an instrument to measure patient perception of the quality of nursing care and related hospital services at the national hospital of sri lanka.

PubMed

Senarat, Upul; Gunawardena, Nalika S

2011-06-01

This study aimed to develop and validate an instrument to measure patient perception of quality of nursing care and related hospital services in a tertiary care setting. We compiled an instrument with 72 items that patients may perceive as quality of nursing care and related hospital services, following an extensive literature search, discussions with patients and care pro-I viders and a brainstorming session with an expert panel. A cross-sectional study was conducted at the National Hospital of Sri Lanka. A sample (n = 120) of patients stayed in general surgical or medical units responded to the interviewer administered instrument upon discharge. Item analysis and principal component factor analysis were performed to assess validity, and internal consistency was calculated to measure reliability. Of the 72 items, 18 had greater than 20% of responses as 'not relevant'. A further 11 items were eliminated since item-total correlations were less than .2. Factor analysis was performed on remaining 43 items which resulted in 36 items classifying into eight factors accounting for 71% of the variation. Factor loadings in the final solution after Varimax rotation were interpersonal aspects (.68-.85), efficiency (.62-.79), competency (.66-.68), comfort (.60-.84), physical environment (.65-.82), cleanliness (.81-.85), personalized information (.76-.83), and general instructions (.61-.78). The instrument had high Internal consistency (Cronbach's alpha = .91). We developed a comprehensive, reliable and valid, 36-item instrument that may be used to measure patient perception of quality of nursing care in tertiary care settings. Copyright © 2011 Korean Society of Nursing Science. Published by Elsevier B.V. All rights reserved.

Patient-reported outcome measure for neuromyelitis optica: pretesting of preliminary instrument and protocol for further development in accordance with international guidelines.

PubMed

Moore, P; Jackson, C; Mutch, K; Methley, A; Pollard, C; Hamid, S; Jacob, A

2016-09-30

This study outlines the development of a patient-reported outcome measure (PROM), an instrument to obtain self-reported health status for neuromyeltis optica (NMO), a disabling neurological condition. Development was conducted in accordance with international guidance for PROMs including systematic review of existing literature, item generation guided by qualitative interviews, health-related quality of life conceptual framework and clinical expert panel and cognitive interviews with NMO patients. Participants were identified through a national NMO clinic in a tertiary NHS neurosciences service. 15 individuals with NMO participated in cognitive interviews requiring review and ranking of proposed PROM items and qualitative feedback on content, layout and response options. Participants endorsed the draft instrument as reflecting their experience of the condition and as being easy to understand. Rating and ranking of item relevance and importance reduced the draft instrument from 106 to 48 items. Participant feedback on overlapping items eliminated a further 2 items and resulted in a preliminary instrument of 46 items. As a direct result of participant feedback ordering of the 10 domains was revised, a 4 option Likert scale was employed and a 4-week recall period for impact of symptoms was selected. A 46-item instrument developed in accordance with international PROM development guidelines through literature review, developed by subject matter experts and refined through pretesting examining content validity provides a preliminary measure for assessing patient-report of health status in NMO. Further evaluation is proposed including sensitivity to clinical change, and international contributions to evaluating the measure are encouraged. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

17 CFR 229.1115 - (Item 1115) Certain derivatives instruments.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 17 Commodity and Securities Exchanges 2 2011-04-01 2011-04-01 false (Item 1115) Certain derivatives instruments. 229.1115 Section 229.1115 Commodity and Securities Exchanges SECURITIES AND EXCHANGE... instruments, such as interest rate and currency swap agreements, that are used to alter the payment...

17 CFR 229.1115 - (Item 1115) Certain derivatives instruments.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 17 Commodity and Securities Exchanges 2 2010-04-01 2010-04-01 false (Item 1115) Certain derivatives instruments. 229.1115 Section 229.1115 Commodity and Securities Exchanges SECURITIES AND EXCHANGE... instruments, such as interest rate and currency swap agreements, that are used to alter the payment...

The Communicative Participation Item Bank (CPIB): Item bank calibration and development of a disorder-generic short form

PubMed Central

Baylor, Carolyn; Yorkston, Kathryn; Eadie, Tanya; Kim, Jiseon; Chung, Hyewon; Amtmann, Dagmar

2015-01-01

Purpose The purpose of this study was to calibrate the items for the Communicative Participation Item Bank (CPIB) using Item Response Theory (IRT). One overriding objective was to examine if the IRT item parameters would be consistent across different diagnostic groups, thereby allowing creation of a disorder-generic instrument. The intended outcomes were the final item bank and a short form ready for clinical and research applications. Methods Self-report data were collected from 701 individuals representing four diagnoses: multiple sclerosis, Parkinson’s disease, amyotrophic lateral sclerosis and head and neck cancer. Participants completed the CPIB and additional self-report questionnaires. CPIB data were analyzed using the IRT Graded Response Model (GRM). Results The initial set of 94 candidate CPIB items were reduced to an item bank of 46 items demonstrating unidimensionality, local independence, good item fit, and good measurement precision. Differential item function (DIF) analyses detected no meaningful differences across diagnostic groups. A 10-item, disorder-generic short form was generated. Conclusions The CPIB provides speech-language pathologists with a unidimensional, self-report outcomes measurement instrument dedicated to the construct of communicative participation. This instrument may be useful to clinicians and researchers wanting to implement measures of communicative participation in their work. PMID:23816661

Development and analysis of an instrument to assess student understanding of GOB chemistry knowledge relevant to clinical nursing practice.

PubMed

Brown, Corina E; Hyslop, Richard M; Barbera, Jack

2015-01-01

The General, Organic, and Biological Chemistry Knowledge Assessment (GOB-CKA) is a multiple-choice instrument designed to assess students' understanding of the chemistry topics deemed important to clinical nursing practice. This manuscript describes the development process of the individual items along with a psychometric evaluation of the final version of the items and instrument. In developing items for the GOB-CKA, essential topics were identified through a series of expert interviews (with practicing nurses, nurse educators, and GOB chemistry instructors) and confirmed through a national survey. Individual items were tested in qualitative studies with students from the target population for clarity and wording. Data from pilot and beta studies were used to evaluate each item and narrow the total item count to 45. A psychometric analysis performed on data from the 45-item final version was used to provide evidence of validity and reliability. The final version of the instrument has a Cronbach's alpha value of 0.76. Feedback from an expert panel provided evidence of face and content validity. Convergent validity was estimated by comparing the results from the GOB-CKA with the General-Organic-Biochemistry Exam (Form 2007) of the American Chemical Society. Instructors who wish to use the GOB-CKA for teaching and research may contact the corresponding author for a copy of the instrument. © 2014 Wiley Periodicals, Inc.

Advising on Preferred Reporting Items for patient-reported outcome instrument development: the PRIPROID.

PubMed

Hou, Zheng-Kun; Liu, Feng-Bin; Fang, Ji-Qian; Li, Xiao-Ying; Li, Li-Juan; Lin, Chu-Hua

2013-03-01

The reporting of patient-reported outcomes (PRO) instrument development is vital for both researchers and clinicians to determine its validity, thus, we propose the Preferred Reporting Items for PRO Instrument Development (PRIPROID) to improve the quality of reports. Abiding by the guidance published by the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) Network, we had performed 6 steps for items development: identified the need for a guideline, performed a literature review, obtained funding for the guideline initiative, identified participants, conducted a Delphi exercise and generated a list of PRIPROID items for consideration at the face-to-face meeting. Twenty three items subheadings under 7 topics were included: title and structured abstract, rationale, objectives, intention, eligibility criteria, conceptual framework, items generation, response options, scoring, times, administrative modes, burden assessment, properties assessment, statistical methods, participants, main results, and additional analysis, summary of evidence, limitations, clinical attentions, and conclusions, item pools or final form, and funding. The PRIPROID contains many elements of the PRO research, and this assists researchers to report their results more accurately and to a certain degree use this instrument to evaluate the quality of the research methods.

A Multidimensional Scaling Approach to Dimensionality Assessment for Measurement Instruments Modeled by Multidimensional Item Response Theory

ERIC Educational Resources Information Center

Toro, Maritsa

2011-01-01

The statistical assessment of dimensionality provides evidence of the underlying constructs measured by a survey or test instrument. This study focuses on educational measurement, specifically tests comprised of items described as multidimensional. That is, items that require examinee proficiency in multiple content areas and/or multiple cognitive…

The development of an instrument to measure factors that influence self-perceived dignity.

PubMed

Vlug, Mariska G; de Vet, Henrica C W; Pasman, H Roeline W; Rurup, Mette L; Onwuteaka-Philipsen, Bregje D

2011-05-01

Preserving dignity can be considered as a goal of palliative care. To provide dignity-conserving care, it is relevant to identify the factors that influence a patient's self-perceived dignity. This study aims to develop an instrument to measure factors affecting self-perceived dignity that has good content validity and is appropriate for use in practice. Data were collected in the Advance Directives Cohort Study. In 2008, the cohort received a questionnaire with 31 items that might influence one's self-perceived dignity. For a subsample of people with poor health (n = 292), we analyzed which items could be removed because of the mean scores for presence of the item and its influence on dignity. The 31 items fell into four domains: evaluation of self in relation to others, functional status, mental state, and care and situational aspects. Mean scores for presence and influence on dignity showed large differences and were not correlated. Six items were scarcely present and did not substantially affect self-perceived dignity. Because three of these were expected to influence dignity in other settings, only three items could be removed and two items could be combined into one. After calculating correlations between conceptually similar items, one extra item could be removed. Reducing the instrument to 26 items and dichotomizing the answer option for presence increases its feasibility for use in practice. The instrument offers an important step to better understanding the phenomenon of self-perceived dignity by gaining information directly from patients.

Development and evaluation of an instrument to measure parental satisfaction with quality of care in neonatal follow-up.

PubMed

Butt, Michelle L; Pinelli, Janet; Boyle, Michael H; Thomas, Helen; Hunsberger, Mabel; Saigal, Saroj; Lee, David S; Fanning, Jamie K; Austin, Patricia

2009-02-01

The goal of this study was to develop and subsequently evaluate the psychometric properties of a new discriminative instrument to measure parental satisfaction with the quality of care provided in neonatal follow-up (NFU) programs. The methodological framework for developing and evaluating measurement scales described by Streiner and Norman (Health Measurement Scales: A Practical Guide to Their Development and Use. 3rd ed. New York: Oxford University Press; 2003) was used for the study. Informing the phases of the research was a sample of 24 health care professionals and 381 parents who use NFU services. A comprehensive list of items representing the construct, parental satisfaction with quality of care, was generated from published reliable and valid instruments, research studies, focus groups with health care experts, and focus groups with parents. Using a clinimetric approach, the 62 items generated were reduced to 39 items based on parents' ratings of importance and refinement of the items by the research team. After content validation and pretesting, the instrument was tested with parents and underwent item-analysis. The resulting 16-item instrument was composed of 2 subscales, Process and Outcomes. Evaluation of the instrument's psychometric properties indicated adequate test-retest reliability (intraclass correlation coefficient = 0.72) and internal consistency (Process subscale, alpha = 0.77; Outcomes subscale, alpha = 0.90; overall instrument, alpha = 0.90), as well as good content and construct validity. A confirmatory factor analysis supported the multidimensionality of the construct. This new instrument provides clinicians and policy-makers with a tool to assess parental satisfaction with the quality of care in NFU, so areas of dissatisfaction can be identified and changes implemented to optimize service provision.

Development of an instrument to measure medical students' perceptions of the assessment environment: initial validation.

PubMed

Sim, Joong Hiong; Tong, Wen Ting; Hong, Wei-Han; Vadivelu, Jamuna; Hassan, Hamimah

2015-01-01

Assessment environment, synonymous with climate or atmosphere, is multifaceted. Although there are valid and reliable instruments for measuring the educational environment, there is no validated instrument for measuring the assessment environment in medical programs. This study aimed to develop an instrument for measuring students' perceptions of the assessment environment in an undergraduate medical program and to examine the psychometric properties of the new instrument. The Assessment Environment Questionnaire (AEQ), a 40-item, four-point (1=Strongly Disagree to 4=Strongly Agree) Likert scale instrument designed by the authors, was administered to medical undergraduates from the authors' institution. The response rate was 626/794 (78.84%). To establish construct validity, exploratory factor analysis (EFA) with principal component analysis and varimax rotation was conducted. To examine the internal consistency reliability of the instrument, Cronbach's α was computed. Mean scores for the entire AEQ and for each factor/subscale were calculated. Mean AEQ scores of students from different academic years and sex were examined. Six hundred and eleven completed questionnaires were analysed. EFA extracted four factors: feedback mechanism (seven items), learning and performance (five items), information on assessment (five items), and assessment system/procedure (three items), which together explained 56.72% of the variance. Based on the four extracted factors/subscales, the AEQ was reduced to 20 items. Cronbach's α for the 20-item AEQ was 0.89, whereas Cronbach's α for the four factors/subscales ranged from 0.71 to 0.87. Mean score for the AEQ was 2.68/4.00. The factor/subscale of 'feedback mechanism' recorded the lowest mean (2.39/4.00), whereas the factor/subscale of 'assessment system/procedure' scored the highest mean (2.92/4.00). Significant differences were found among the AEQ scores of students from different academic years. The AEQ is a valid and reliable instrument. Initial validation supports its use to measure students' perceptions of the assessment environment in an undergraduate medical program.

Measuring Environmental Factors: Unique and Overlapping International Classification of Functioning, Disability and Health Coverage of 5 Instruments.

PubMed

Heinemann, Allen W; Miskovic, Ana; Semik, Patrick; Wong, Alex; Dashner, Jessica; Baum, Carolyn; Magasi, Susan; Hammel, Joy; Tulsky, David S; Garcia, Sofia F; Jerousek, Sara; Lai, Jin-Shei; Carlozzi, Noelle E; Gray, David B

2016-12-01

To describe the unique and overlapping content of the newly developed Environmental Factors Item Banks (EFIB) and 7 legacy environmental factor instruments, and to evaluate the EFIB's construct validity by examining associations with legacy instruments. Cross-sectional, observational cohort. Community. A sample of community-dwelling adults with stroke, spinal cord injury, and traumatic brain injury (N=568). None. EFIB covering domains of the built and natural environment; systems, services, and policies; social environment; and access to information and technology; the Craig Hospital Inventory of Environmental Factors (CHIEF) short form; the Facilitators and Barriers Survey/Mobility (FABS/M) short form; the Home and Community Environment Instrument (HACE); the Measure of the Quality of the Environment (MQE) short form; and 3 of the Patient Reported Outcomes Measurement Information System's (PROMIS) Quality of Social Support measures. The EFIB and legacy instruments assess most of the International Classification of Functioning, Disability and Health (ICF) environmental factors chapters, including chapter 1 (products and technology; 75 items corresponding to 11 codes), chapter 2 (natural environment and human-made changes; 31 items corresponding to 7 codes), chapter 3 (support and relationships; 74 items corresponding to 7 codes), chapter 4 (attitudes; 83 items corresponding to 8 codes), and chapter 5 (services, systems, and policies; 72 items corresponding to 16 codes). Construct validity is provided by moderate correlations between EFIB measures and the CHIEF, MQE barriers, HACE technology mobility, FABS/M community built features, and PROMIS item banks and by small correlations with other legacy instruments. Only 5 of the 66 legacy instrument correlation coefficients are moderate, suggesting they measure unique aspects of the environment, whereas all intra-EFIB correlations were at least moderate. The EFIB measures provide a brief and focused assessment of ICF environmental factor chapters. The pattern of correlations with legacy instruments provides initial evidence of construct validity. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Metric equivalence assessment in cross-cultural research: using an example of the Center for Epidemiological Studies--Depression Scale.

PubMed

Kim, Miyong; Han, Hae-Ra; Phillips, Linda

2003-01-01

Metric equivalence is a quantitative way to assess cross-cultural equivalences of translated instruments by examining the patterns of psychometric properties based on cross-cultural data derived from both versions of the instrument. Metric equivalence checks at item and instrument levels can be used as a valuable tool to refine cross-cultural instruments. Korean and English versions of the Center for Epidemiological Studies-Depression Scale (CES-D) were administered to 154 Korean Americans and 151 Anglo Americans to illustrate approaches to assessing their metric equivalence. Inter-item and item-total correlations, Cronbach's alpha coefficients, and factor analysis were used for metric equivalence checks. The alpha coefficient for the Korean-American sample was 0.85 and 0.92 for the Anglo American sample. Although all items of the CES-D surpassed the desirable minimum of 0.30 in the Anglo American sample, four items did not meet the standard in the Korean American sample. Differences in average inter-item correlations were also noted between the two groups (0.25 for Korean Americans and 0.37 for Anglo Americans). Factor analysis identified two factors for both groups, and factor loadings showed similar patterns and congruence coefficients. Results of the item analysis procedures suggest the possibility of bias in certain items that may influence the sensitivity of the Korean version of the CES-D. These item biases also provide a possible explanation for the alpha differences. Although factor loadings showed similar patterns for the Korean and English versions of the CES-D, factorial similarity alone is not sufficient for testing the universality of the structure underlying an instrument.

Content Validity of Patient-Reported Outcome Instruments used with Pediatric Patients with Facial Differences: A Systematic Review.

PubMed

Wickert, Natasha M; Wong Riff, Karen W Y; Mansour, Mark; Forrest, Christopher R; Goodacre, Timothy E E; Pusic, Andrea L; Klassen, Anne F

2018-01-01

Objective The aim of this systematic review was to identify patient-reported outcome (PRO) instruments used in research with children/youth with conditions associated with facial differences to identify the health concepts measured. Design MEDLINE, EMBASE, CINAHL, and PsycINFO were searched from 2004 to 2016 to identify PRO instruments used in acne vulgaris, birthmarks, burns, ear anomalies, facial asymmetries, and facial paralysis patients. We performed a content analysis whereby the items were coded to identify concepts and categorized as positive or negative content or phrasing. Results A total of 7,835 articles were screened; 6 generic and 11 condition-specific PRO instruments were used in 96 publications. Condition-specific instruments were for acne (four), oral health (two), dermatology (one), facial asymmetries (two), microtia (one), and burns (one). The PRO instruments provided 554 items (295 generic; 259 condition specific) that were sorted into 4 domains, 11 subdomains, and 91 health concepts. The most common domain was psychological (n = 224 items). Of the identified items, 76% had negative content or phrasing (e.g., "Because of the way my face looks I wish I had never been born"). Given the small number of items measuring facial appearance (n = 19) and function (n = 22), the PRO instruments reviewed lacked content validity for patients whose condition impacted facial function and/or appearance. Conclusions Treatments can change facial appearance and function. This review draws attention to a problem with content validity in existing PRO instruments. Our team is now developing a new PRO instrument called FACE-Q Kids to address this problem.

Independent Orbiter Assessment (IOA): Assessment of instrumental subsystem FMEA/CIL

NASA Technical Reports Server (NTRS)

Gardner, J. R.; Addis, A. W.

1988-01-01

The McDonnell Douglas Astronautics Company (MDAC) was selected in June 1986 to perform an Independent Orbiter Assessment (IOA) of the Failure Modes and Effects Analysis (FMEA) and Critical Items List (CIL). The IOA effort first completed an analysis of the Instrumentation hardware, generating draft failure modes and potential critical items. To preserve independence, this analysis was accomplished without reliance upon the results contained within the NASA FMEA/CIL documentation. The IOA results were then compared to the NASA FMEA/CIL baseline. A resolution of each discrepancy from the comparison is provided through additional analysis as required. The results of that comparison for the Orbiter Instrumentation hardware are documented. The IOA product for Instrumentation analysis consisted of 107 failure mode worksheets that resulted in 22 critical items being identified. Comparison was made to the Pre 51-L NASA baseline with 14 Post 51-L FMEAs added, which consists of 96 FMEAs and 18 CIL items. This comparison produced agreement on all but 25 FMEAs which caused differences in 5 CIL items.

Modification and Evaluation of a Velopharyngeal Insufficiency Quality of Life Instrument

PubMed Central

Skirko, Jonathan R.; Weaver, Edward M; Perkins, Jonathan; Kinter, Sara; Sie, Kathleen C.Y.

2018-01-01

Objective Modify the existing 45-item velopharyngeal insufficiency (VPI) quality of life (QOL) instrument (VPIQL), assess the modified instrument for reliability and provide further validation. There are patient and parent versions of the instrument. Design Validation convenience sample from a previously conducted pilot study. Setting Two academic tertiary referral medical centers. Participants De-identified data were used from 29 subjects with VPI and 29 control subjects age 5–17 years, and parents. Outcome measures Subjects and parents completed VPIQL and a generic pediatric QOL instrument (PedsQL4-0). Data Analysis Twenty-two items were removed from the VPIQL for ceiling effects, floor effects, and redundancy, to produce the modified instrument, VPI Effects on Life Outcomes (VELO) instrument. VELO was tested for internal consistency (Chronbach’s alpha), discriminant validity (paired t-test with control subjects), and concurrent validity (Pearson correlation with the PedsQL4-0). These analyses were also completed for parents. Results The 45-item VPIQL instrument was reduced to the 23-item VELO instrument. The VELO had excellent internal consistency (Chronbach’s alpha 0.96 for parents and 0.95 for VPI subjects). The VELO discriminated well between VPI and control subjects, with mean score (SD) was significantly lower (worse) for VPI subjects (67.6 [23.9]) than for control subjects (97.0 [5.2]) (p<0.0001). The VELO total score was significantly correlated with the PedsQL4.0 (r=0.73) among subjects with VPI. Similar results were seen in parent responses. Conclusions The VELO is a 23-item QOL instrument that was designed to measure and follow QOL in subjects with VPI, with less burden than the original VPIQL. VELO demonstrates internal consistency, disciminant validty, and concurrent validity with the PedsQL4-0. PMID:23069823

School Self-Evaluation Instruments and Cognitive Validity. Do Items Capture What They Intend to?

ERIC Educational Resources Information Center

Faddar, Jerich; Vanhoof, Jan; De Maeyer, Sven

2017-01-01

School self-evaluation (SSE) often makes use of questionnaires in order to sketch a picture of the school. How respondents cognitively process questionnaire items determines the validity of SSE results. Still, one readily assumes that respondents interpret and answer items as intended by the instrument developer (referred to as cognitive…

Linguistic validation of the Alberta Context Tool and two measures of research use, for German residential long term care.

PubMed

Hoben, Matthias; Bär, Marion; Mahler, Cornelia; Berger, Sarah; Squires, Janet E; Estabrooks, Carole A; Kruse, Andreas; Behrens, Johann

2014-01-31

To study the association between organizational context and research utilization in German residential long term care (LTC), we translated three Canadian assessment instruments: the Alberta Context Tool (ACT), Estabrooks' Kinds of Research Utilization (RU) items and the Conceptual Research Utilization Scale. Target groups for the tools were health care aides (HCAs), registered nurses (RNs), allied health professionals (AHPs), clinical specialists and care managers. Through a cognitive debriefing process, we assessed response processes validity-an initial stage of validity, necessary before more advanced validity assessment. We included 39 participants (16 HCAs, 5 RNs, 7 AHPs, 5 specialists and 6 managers) from five residential LTC facilities. We created lists of questionnaire items containing problematic items plus items randomly selected from the pool of remaining items. After participants completed the questionnaires, we conducted individual semi-structured cognitive interviews using verbal probing. We asked participants to reflect on their answers for list items in detail. Participants' answers were compared to concept maps defining the instrument concepts in detail. If at least two participants gave answers not matching concept map definitions, items were revised and re-tested with new target group participants. Cognitive debriefings started with HCAs. Based on the first round, we modified 4 of 58 ACT items, 1 ACT item stem and all 8 items of the RU tools. All items were understood by participants after another two rounds. We included revised HCA ACT items in the questionnaires for the other provider groups. In the RU tools for the other provider groups, we used different wording than the HCA version, as was done in the original English instruments. Only one cognitive debriefing round was needed with each of the other provider groups. Cognitive debriefing is essential to detect and respond to problematic instrument items, particularly when translating instruments for heterogeneous, less well educated provider groups such as HCAs. Cognitive debriefing is an important step in research tool development and a vital component of establishing response process validity evidence. Publishing cognitive debriefing results helps researchers to determine potentially critical elements of the translated tools and assists with interpreting scores.

Linguistic validation of the Alberta Context Tool and two measures of research use, for German residential long term care

PubMed Central

2014-01-01

Background To study the association between organizational context and research utilization in German residential long term care (LTC), we translated three Canadian assessment instruments: the Alberta Context Tool (ACT), Estabrooks’ Kinds of Research Utilization (RU) items and the Conceptual Research Utilization Scale. Target groups for the tools were health care aides (HCAs), registered nurses (RNs), allied health professionals (AHPs), clinical specialists and care managers. Through a cognitive debriefing process, we assessed response processes validity–an initial stage of validity, necessary before more advanced validity assessment. Methods We included 39 participants (16 HCAs, 5 RNs, 7 AHPs, 5 specialists and 6 managers) from five residential LTC facilities. We created lists of questionnaire items containing problematic items plus items randomly selected from the pool of remaining items. After participants completed the questionnaires, we conducted individual semi-structured cognitive interviews using verbal probing. We asked participants to reflect on their answers for list items in detail. Participants’ answers were compared to concept maps defining the instrument concepts in detail. If at least two participants gave answers not matching concept map definitions, items were revised and re-tested with new target group participants. Results Cognitive debriefings started with HCAs. Based on the first round, we modified 4 of 58 ACT items, 1 ACT item stem and all 8 items of the RU tools. All items were understood by participants after another two rounds. We included revised HCA ACT items in the questionnaires for the other provider groups. In the RU tools for the other provider groups, we used different wording than the HCA version, as was done in the original English instruments. Only one cognitive debriefing round was needed with each of the other provider groups. Conclusion Cognitive debriefing is essential to detect and respond to problematic instrument items, particularly when translating instruments for heterogeneous, less well educated provider groups such as HCAs. Cognitive debriefing is an important step in research tool development and a vital component of establishing response process validity evidence. Publishing cognitive debriefing results helps researchers to determine potentially critical elements of the translated tools and assists with interpreting scores. PMID:24479645

Development of the Online Assessment of Athletic Training Education (OAATE) Instrument

ERIC Educational Resources Information Center

Carr, W. David; Frey, Bruce B.; Swann, Elizabeth

2009-01-01

Objective: To establish the validity and reliability of an online assessment instrument's items developed to track educational outcomes over time. Design and Setting: A descriptive study of the validation arguments and reliability testing of the assessment items. The instrument is available to graduating students enrolled in entry-level Athletic…

Assessing food selection in a health promotion program: validation of a brief instrument for American Indian children in the southwest United States.

PubMed

Koehler, K M; Cunningham-Sabo, L; Lambert, L C; McCalman, R; Skipper, B J; Davis, S M

2000-02-01

Brief dietary assessment instruments are needed to evaluate behavior changes of participants in dietary intervention programs. The purpose of this project was to design and validate an instrument for children participating in Pathways to Health, a culturally appropriate, cancer prevention curriculum. Validation of a brief food selection instrument, Yesterday's Food Choices (YFC), which contained 33 questions about foods eaten the previous day with response choices of yes, no, or not sure. Reference data for validation were 24-hour dietary recalls administered individually to 120 students selected randomly. The YFC and 24-hour dietary recalls were administered to American Indian children in fifth- and seventh-grade classes in the Southwest United States. Dietary recalls were coded for food items in the YFC and results were compared for each item using percentage agreement and the kappa statistic. Percentage agreement for all items was greater than 60%; for most items it was greater than 70%, and for several items it was greater than 80%. The amount of agreement beyond that explained by chance (kappa statistic) was generally small. Three items showed substantial agreement beyond chance (kappa > or = 0.6); 2 items showed moderate agreement (kappa = 0.40 to 0.59) most items showed fair agreement (kappa = 0.20 to 0.39). The food items showing substantial agreement were hot or cold cereal, low-fat milk, and mutton or chile stew. Fried or scrambled eggs and deep-fried foods showed moderate agreement beyond chances. Previous development and validation of brief food selection instruments for children participating in health promotion programs has had limited success. In this study, instrument-related factors that apparently contributed to poor agreement between data from the YFC and 24-hour dietary recall were inclusion of categories of foods vs specific foods; food knowledge, preparation, and vocabulary, item length, and overreporting of attractive foods. Collecting and scoring the 24-hour recall data may also have contributed to poor agreement. Further development of brief instruments for evaluating changes in children's behavior in dietary programs is necessary. Factors related to the YFC that need further development may be issues that are also important in the development of effective, brief dietary assessments for children as individual clients or patients.

Development of the Computer-Adaptive Version of the Late-Life Function and Disability Instrument

PubMed Central

Tian, Feng; Kopits, Ilona M.; Moed, Richard; Pardasaney, Poonam K.; Jette, Alan M.

2012-01-01

Background. Having psychometrically strong disability measures that minimize response burden is important in assessing of older adults. Methods. Using the original 48 items from the Late-Life Function and Disability Instrument and newly developed items, a 158-item Activity Limitation and a 62-item Participation Restriction item pool were developed. The item pools were administered to a convenience sample of 520 community-dwelling adults 60 years or older. Confirmatory factor analysis and item response theory were employed to identify content structure, calibrate items, and build the computer-adaptive testings (CATs). We evaluated real-data simulations of 10-item CAT subscales. We collected data from 102 older adults to validate the 10-item CATs against the Veteran’s Short Form-36 and assessed test–retest reliability in a subsample of 57 subjects. Results. Confirmatory factor analysis revealed a bifactor structure, and multi-dimensional item response theory was used to calibrate an overall Activity Limitation Scale (141 items) and an overall Participation Restriction Scale (55 items). Fit statistics were acceptable (Activity Limitation: comparative fit index = 0.95, Tucker Lewis Index = 0.95, root mean square error approximation = 0.03; Participation Restriction: comparative fit index = 0.95, Tucker Lewis Index = 0.95, root mean square error approximation = 0.05). Correlation of 10-item CATs with full item banks were substantial (Activity Limitation: r = .90; Participation Restriction: r = .95). Test–retest reliability estimates were high (Activity Limitation: r = .85; Participation Restriction r = .80). Strength and pattern of correlations with Veteran’s Short Form-36 subscales were as hypothesized. Each CAT, on average, took 3.56 minutes to administer. Conclusions. The Late-Life Function and Disability Instrument CATs demonstrated strong reliability, validity, accuracy, and precision. The Late-Life Function and Disability Instrument CAT can achieve psychometrically sound disability assessment in older persons while reducing respondent burden. Further research is needed to assess their ability to measure change in older adults. PMID:22546960

Validation of the knowledge, attitude and perceived practice of asthma instrument among community pharmacists using Rasch analysis.

PubMed

Akram, Waqas; Hussein, Maryam S E; Ahmad, Sohail; Mamat, Mohd N; Ismail, Nahlah E

2015-10-01

There is no instrument which collectively assesses the knowledge, attitude and perceived practice of asthma among community pharmacists. Therefore, this study aimed to validate the instrument which measured the knowledge, attitude and perceived practice of asthma among community pharmacists by producing empirical evidence of validity and reliability of the items using Rasch model (Bond & Fox software®) for dichotomous and polytomous data. This baseline study recruited 33 community pharmacists from Penang, Malaysia. The results showed that all PTMEA Corr were in positive values, where an item was able to distinguish between the ability of respondents. Based on the MNSQ infit and outfit range (0.60-1.40), out of 55 items, 2 items from the instrument were suggested to be removed. The findings indicated that the instrument fitted with Rasch measurement model and showed the acceptable reliability values of 0.88 and 0.83 and 0.79 for knowledge, attitude and perceived practice respectively.

An evaluation of computerized adaptive testing for general psychological distress: combining GHQ-12 and Affectometer-2 in an item bank for public mental health research.

PubMed

Stochl, Jan; Böhnke, Jan R; Pickett, Kate E; Croudace, Tim J

2016-05-20

Recent developments in psychometric modeling and technology allow pooling well-validated items from existing instruments into larger item banks and their deployment through methods of computerized adaptive testing (CAT). Use of item response theory-based bifactor methods and integrative data analysis overcomes barriers in cross-instrument comparison. This paper presents the joint calibration of an item bank for researchers keen to investigate population variations in general psychological distress (GPD). Multidimensional item response theory was used on existing health survey data from the Scottish Health Education Population Survey (n = 766) to calibrate an item bank consisting of pooled items from the short common mental disorder screen (GHQ-12) and the Affectometer-2 (a measure of "general happiness"). Computer simulation was used to evaluate usefulness and efficacy of its adaptive administration. A bifactor model capturing variation across a continuum of population distress (while controlling for artefacts due to item wording) was supported. The numbers of items for different required reliabilities in adaptive administration demonstrated promising efficacy of the proposed item bank. Psychometric modeling of the common dimension captured by more than one instrument offers the potential of adaptive testing for GPD using individually sequenced combinations of existing survey items. The potential for linking other item sets with alternative candidate measures of positive mental health is discussed since an optimal item bank may require even more items than these.

The impact of sub-skills and item content on students' skills with regard to the control-of-variables strategy

NASA Astrophysics Data System (ADS)

Schwichow, Martin; Christoph, Simon; Boone, William J.; Härtig, Hendrik

2016-01-01

The so-called control-of-variables strategy (CVS) incorporates the important scientific reasoning skills of designing controlled experiments and interpreting experimental outcomes. As CVS is a prominent component of science standards appropriate assessment instruments are required to measure these scientific reasoning skills and to evaluate the impact of instruction on CVS development. A detailed review of existing CVS instruments suggests that they utilize different, and only a few of the four, critical CVS sub-skills in the item development. This study presents a new CVS assessment instrument (CVS Inventory, CVSI) and investigates the validity of student measures derived from this instrument utilizing Rasch analyses. The results indicate that the CVSI produces reliable and valid student measures with regard to CVS. Furthermore, the results show that the item difficulty depends on the CVS sub-skills utilized in item development, but not on the item content. Accordingly, previous instruments that are restricted to a few CVS sub-skills tend to over- or underestimate students' CVS skills. In addition, these results indicate that students are able to use CVS as a domain general strategy in multiple content areas. Consequences for science instruction and assessment are discussed.

Item-level psychometrics of the ADL instrument of the Korean National Survey on persons with physical disabilities.

PubMed

Hong, Ickpyo; Lee, Mi Jung; Kim, Moon Young; Park, Hae Yean

2017-10-01

The aim of this study is to investigate the psychometrics of the 12 items of an instrument assessing activities of daily living (ADL) using an item response theory model. A total of 648 adults with physical disabilities and having difficulties in ADLs were retrieved from the 2014 Korean National Survey on People with Disabilities. The psychometric testing included factor analysis, internal consistency, precision, and differential item functioning (DIF) across categories including sex, older age, marital status, and physical impairment area. The sample had a mean age of 69.7 years old (SD = 13.7). The majority of the sample had lower extremity impairments (62.0%) and had at least 2.1 chronic conditions. The instrument demonstrated unidimensional construct and good internal consistency (Cronbach's alpha = 0.95). The instrument precisely estimated person measures within a wide range of theta values (-2.22 logits < θ < 0.27 logits) with a reliability of 0.9. Only the changing position item demonstrated misfit (χ 2  = 36.6, df = 17, p = 0.0038), and the dressing item demonstrated DIF on the impairment type (upper extremity/others, McFadden's Pseudo R 2  > 5.0%). Our findings indicate that the dressing item would need to be modified to improve its psychometrics. Overall, the ADL instrument demonstrates good psychometrics, and thus, it may be used as a standardized instrument for measuring disability in rehabilitation contexts. However, the findings are limited to adults with physical disabilities. Future studies should replicate psychometric testing for survey respondents with other disorders and for children.

Patient perspectives on communication with the medical team: pilot study using the Communication Assessment Tool-Team (CAT-T).

PubMed

Mercer, Laura Min; Tanabe, Paula; Pang, Peter S; Gisondi, Michael A; Courtney, D Mark; Engel, Kirsten G; Donlan, Sarah M; Adams, James G; Makoul, Gregory

2008-11-01

Effective communication is an essential aspect of high-quality patient care and a core competency for physicians. To date, assessment of communication skills in team-based settings has not been well established. We sought to tailor a psychometrically validated instrument, the Communication Assessment Tool, for use in Team settings (CAT-T), and test the feasibility of collecting patient perspectives of communication with medical teams in the emergency department (ED). A prospective, cross-sectional study in an academic, tertiary, urban, Level 1 trauma center using the CAT-T, a 15-item instrument. Items were answered via a 5-point scale, with 5 = excellent. All adult ED patients (> or = 18 y/o) were eligible if the following exclusion criteria did not apply: primary psychiatric issues, critically ill, physiologically unstable, non-English speaking, or under arrest. 81 patients were enrolled (mean age: 44, S.D. = 17; 44% male). Highest ratings were for treating the patient with respect (69% excellent), paying attention to the patient (69% excellent), and showing care and concern (69% excellent). Lowest ratings were for greeting the patient appropriately (54%), encouraging the patient to ask questions (54%), showing interest in the patient's ideas about his or her health (53% excellent), and involving the patient in decisions as much as he or she wanted (53% excellent). Although this pilot study has several methodological limitations, it demonstrates a signal that patient assessment of communication with the medical team is feasible and offers important feedback. Results indicate the need to improve communication in the ED. In the ED, focusing on the medical team rather then individual caregivers may more accurately reflect patients' experience.

The weight management strategies inventory (WMSI). Development of a new measurement instrument, construct validation, and association with dieting success.

PubMed

Keller, Carmen; Siegrist, Michael

2015-09-01

In an obesogenic environment, people have to adopt effective weight management strategies to successfully gain or maintain normal body weight. Little is known about the strategies used by the general population in daily life. Due to the lack of a comprehensive measurement instrument to assess conceptually different strategies with various scales, we developed the weight management strategies inventory (WMSI). In study 1, we collected 19 weight management strategies from research on self-regulation of food intake and successful weight loss and maintenance, as well as from expert interviews. We classified them under the five main categories of health self-regulation strategies - goal setting and monitoring, prospection and planning, automating behavior, construal, and inhibition. We formulated 93 items. In study 2, we developed the WMSI in a random sample from the general population (N = 658), using reliability and exploratory factor analysis. This resulted in 19 factors with 63 items, representing the 19 strategies. In study 3, we tested the 19-factor structure in a quota (age, gender) sample from the general population (N = 616), using confirmatory factor analysis. A good model fit (CFI = .918; RMSEA = .043) was revealed. Reliabilities and construct validity were high. Positive correlations of most strategies with dieting success and negative correlations of some strategies with body mass index were found among dieters (N = 292). Study 4 (N = 162) revealed a good test-retest reliability. The WMSI assesses theoretically derived, evidence-based, and conceptually different weight management strategies with different scales that have good psychometric characteristics. The scales can also be used for pre- and post measures in intervention studies. The scales provide insights into the general population's weight management strategies and facilitate tailoring and evaluating health communication. Copyright © 2015 Elsevier Ltd. All rights reserved.

Empirically based assessment and taxonomy of psychopathology for ages 1½-90+ years: Developmental, multi-informant, and multicultural findings.

PubMed

Achenbach, Thomas M; Ivanova, Masha Y; Rescorla, Leslie A

2017-11-01

Originating in the 1960s, the Achenbach System of Empirically Based Assessment (ASEBA) comprises a family of instruments for assessing problems and strengths for ages 1½-90+ years. To provide an overview of the ASEBA, related research, and future directions for empirically based assessment and taxonomy. Standardized, multi-informant ratings of transdiagnostic dimensions of behavioral, emotional, social, and thought problems are hierarchically scored on narrow-spectrum syndrome scales, broad-spectrum internalizing and externalizing scales, and a total problems (general psychopathology) scale. DSM-oriented and strengths scales are also scored. The instruments and scales have been iteratively developed from assessments of clinical and population samples of hundreds of thousands of individuals. Items, instruments, scales, and norms are tailored to different kinds of informants for ages 1½-5, 6-18, 18-59, and 60-90+ years. To take account of differences between informants' ratings, parallel instruments are completed by parents, teachers, youths, adult probands, and adult collaterals. Syndromes and Internalizing/Externalizing scales derived from factor analyses of each instrument capture variations in patterns of problems that reflect different informants' perspectives. Confirmatory factor analyses have supported the syndrome structures in dozens of societies. Software displays scale scores in relation to user-selected multicultural norms for the age and gender of the person being assessed, according to ratings by each type of informant. Multicultural norms are derived from population samples in 57 societies on every inhabited continent. Ongoing and future research includes multicultural assessment of elders; advancing transdiagnostic progress and outcomes assessment; and testing higher order structures of psychopathology. Copyright © 2017 Elsevier Inc. All rights reserved.

An instrument for broadened risk assessment in antenatal health care including non-medical issues

PubMed Central

Vos, Amber A.; van Veen, Mieke J.; Birnie, Erwin; Denktaş, Semiha; Steegers, Eric A.P.; Bonsel, Gouke J.

2015-01-01

Introduction Growing evidence on the risk contributing role of non-medical factors on pregnancy outcomes urged for a new approach in early antenatal risk selection. The evidence invites to more integration, in particular between the clinical working area and the public health domain. We developed a non-invasive, standardized instrument for comprehensive antenatal risk assessment. The current study presents the application-oriented development of a risk screening instrument for early antenatal detection of risk factors and tailored prevention in an integrated care setting. Methods A review of published instruments complemented with evidence from cohort studies. Selection and standardization of risk factors associated with small for gestational age, preterm birth, congenital anomalies and perinatal mortality. Risk factors were weighted to obtain a cumulative risk score. Responses were then connected to corresponding care pathways. A cumulative risk threshold was defined, which can be adapted to the population and the availability of preventive facilities. A score above the threshold implies multidisciplinary consultation between caregivers. Results The resulting digital score card consisted of 70 items, subdivided into four non-medical and two medical domains. Weighing of risk factors was based on existing evidence. Pilot-evidence from a cohort of 218 pregnancies in a multi-practice urban setting showed a cut-off of 16 points would imply 20% of all pregnant women to be assessed in a multidisciplinary setting. A total of 28 care pathways were defined. Conclusion The resulting score card is a universal risk screening instrument which incorporates recent evidence on non-medical risk factors for adverse pregnancy outcomes and enables systematic risk management in an integrated antenatal health care setting. PMID:25780351

Assessment of mastication in healthy children and children with cerebral palsy: a validity and consistency study.

PubMed

Remijn, L; Speyer, R; Groen, B E; Holtus, P C M; van Limbeek, J; Nijhuis-van der Sanden, M W G

2013-05-01

The aim of this study was to develop the Mastication Observation and Evaluation instrument for observing and assessing the chewing ability of children eating solid and lumpy foods. This study describes the process of item definition and item selection and reports the content validity, reproducibility and consistency of the instrument. In the developmental phase, 15 experienced speech therapists assessed item relevance and descriptions over three Delphi rounds. Potential items were selected based on the results from a literature review. At the initial Delphi round, 17 potential items were included. After three Delphi rounds, 14 items that regarded as providing distinctive value in assessment of mastication (consensus >75%) were included in the Mastication Observation and Evaluation instrument. To test item reproducibility and consistency, two experts and five students evaluated video recordings of 20 children (10 children with cerebral palsy aged 29-65 months and 10 healthy children aged 11-42 months) eating bread and a biscuit. Reproducibility was estimated by means of the intraclass correlation coefficient (ICC). With the exception of one item concerning chewing duration, all items showed good to excellent intra-observer agreement (ICC students: 0.73-1.0). With the exception of chewing duration and number of swallows, inter-observer agreement was fair to excellent for all items (ICC experts: 0.68-1.0 and ICC students: 0.42-1.0). Results indicate that this tool is a feasible instrument and could be used in clinical practice after further research is completed on the reliability of the tool. © 2013 Blackwell Publishing Ltd.

Army Stock Positioning: How Can Distribution Performance Be Improved

DTIC Science & Technology

2017-01-01

Support RAND Make a tax -deductible charitable contribution at www.rand.org/giving/contribute www.rand.org Preface The...the source- preference logic that selects the warehouse for issuing an item to a cus- tomer. Below, we describe the LMP source-preference logic and...the AMC pilot to use it to tailor how warehouses are selected to issue items to customers. AMC Pilot Implementation of LMP Source-Preference

Microprocessor-based interface for oceanography

NASA Technical Reports Server (NTRS)

Hansen, G. R.

1979-01-01

Ocean floor imaging system incorporates five identical microprocessor-based interface units each assigned to specific sonar instrument to simplify system. Central control module based on same microprocessor eliminates need for custom tailoring hardware interfaces for each instrument.

Mapping the Content of the Patient Reported Outcomes Measurement Information System (PROMIS®) Using the International Classification of Functioning, Health and Disability

PubMed Central

Tucker, Carole A; Escorpizo, Reuben; Cieza, Alarcos; Lai, Jin Shei; Stucki, Gerold; Ustun, T. Bedirhan; Kostanjsek, Nenad; Cella, David; Forrest, Christopher B.

2014-01-01

Background The Patient Reported Outcomes Measurement Information System (PROMIS®) is a U.S. National Institutes of Health initiative that has produced self-reported item banks for physical, mental, and social health. Objective To describe the content of PROMIS at the item level using the World Health Organization’s International Classification of Functioning, Disability and Health (ICF). Methods All PROMIS adult items (publicly available as of 2012) were assigned to relevant ICF concepts. The content of the PROMIS adult item banks were then described using the mapped ICF code descriptors. Results The 1006 items in the PROMIS instruments could all be mapped to ICF concepts at the second level of classification, with the exception of 3 items of global or general health that mapped across the first-level classification of ICF activity and participation component (d categories). Individual PROMIS item banks mapped from 1 to 5 separate ICF codes indicating one-to-one, one-to-many and many-to-one mappings between PROMIS item banks and ICF second level classification codes. PROMIS supports measurement of the majority of major concepts in the ICF Body Functions (b) and Activity & Participation (d) components using PROMIS item banks or subsets of PROMIS items that could, with care, be used to develop customized instruments. Given the focus of PROMIS is on measurement of person health outcomes, concepts in body structures (s) and some body functions (b), as well as many ICF environmental factor have minimal coverage in PROMIS. Discussion The PROMIS-ICF mapped items provide a basis for users to evaluate the ICF related content of specific PROMIS instruments, and to select PROMIS instruments in ICF based measurement applications. PMID:24760532

More relevant, precise, and efficient items for assessment of physical function and disability: moving beyond the classic instruments

PubMed Central

Fries, J F; Bruce, B; Bjorner, J; Rose, M

2006-01-01

Objectives Patient reported outcomes (PROs) have become standard study endpoints. However, little attention has been given to using item improvement to advance PRO performance which could improve precision, clarity, patient relevance, and information content of “physical function/disability” items and thus the performance of resulting instruments. Methods The present study included1860 physical function/disability items from 165 instruments. Item formulations were assessed by frequency of use, modified Delphi consensus, respondent judgement of clarity and importance, and item response theory (IRT). Data from 1100 rheumatoid arthritis, osteoarthritis, and normal ageing subjects, using qualitative item review, focus groups, cognitive interviews, and patient survey were used to achieve a unique item pool that was clear, reliable, sensitive to change, readily translatable, devoid of floor and ceiling limitations, contained unidimensional subdomains, and had maximal information content. Results A “present tense” time frame was used most frequently, better understood, more readily translated, and more directly estimated the latent trait of disability. Items in the “past tense” had 80–90% false negatives (p<0.001). The best items were brief, clear, and contained a single construct. Responses with four to five options were preferred by both experts and respondents. The term physical function may be preferable to the term disability because of fewer floor effects. IRT analyses of “disability” suggest four independent subdomains (mobility, dexterity, axial, and compound) with factor loadings of 0.81–0.99. Conclusions Major improvement in performance of items and instruments is possible, and may have the effect of substantially reducing sample size requirements for clinical trials. PMID:17038464

Validation of the Malay Version of the Parental Bonding Instrument among Malaysian Youths Using Exploratory Factor Analysis.

PubMed

Muhammad, Noor Azimah; Shamsuddin, Khadijah; Omar, Khairani; Shah, Shamsul Azhar; Mohd Amin, Rahmah

2014-01-01

Parenting behaviour is culturally sensitive. The aims of this study were (1) to translate the Parental Bonding Instrument into Malay (PBI-M) and (2) to determine its factorial structure and validity among the Malaysian population. The PBI-M was generated from a standard translation process and comprehension testing. The validation study of the PBI-M was administered to 248 college students aged 18 to 22 years. Participants in the comprehension testing had difficulty understanding negative items. Five translated double negative items were replaced with five positive items with similar meanings. Exploratory factor analysis showed a three-factor model for the PBI-M with acceptable reliability. Four negative items (items 3, 4, 8, and 16) and item 19 were omitted from the final PBI-M list because of incorrect placement or low factor loading (< 0.32). Out of the final 20 items of the PBI-M, there were 10 items for the care factor, five items for the autonomy factor and five items for the overprotection factor. All the items loaded positively on their respective factors. The Malaysian population favoured positive items in answering questions. The PBI-M confirmed the three-factor model that consisted of care, autonomy and overprotection. The PBI-M is a valid and reliable instrument to assess the Malaysian parenting style. Confirmatory factor analysis may further support this finding. Malaysia, parenting, questionnaire, validity.

Evaluation of diagnostic tools that tertiary teachers can apply to profile their students' conceptions

NASA Astrophysics Data System (ADS)

Schultz, Madeleine; Lawrie, Gwendolyn A.; Bailey, Chantal H.; Bedford, Simon B.; Dargaville, Tim R.; O'Brien, Glennys; Tasker, Roy; Thompson, Christopher D.; Williams, Mark; Wright, Anthony H.

2017-03-01

A multi-institution collaborative team of Australian chemistry education researchers, teaching a total of over 3000 first year chemistry students annually, has explored a tool for diagnosing students' prior conceptions as they enter tertiary chemistry courses. Five core topics were selected and clusters of diagnostic items were assembled linking related concepts in each topic together. An ordered multiple choice assessment strategy was adopted to enable provision of formative feedback to students through combination of the specific distractors that they chose. Concept items were either sourced from existing research instruments or developed by the project team. The outcome is a diagnostic tool consisting of five topic clusters of five concept items that has been delivered in large introductory chemistry classes at five Australian institutions. Statistical analysis of data has enabled exploration of the composition and validity of the instrument including a comparison between delivery of the complete 25 item instrument with subsets of five items, clustered by topic. This analysis revealed that most items retained their validity when delivered in small clusters. Tensions between the assembly, validation and delivery of diagnostic instruments for the purposes of acquiring robust psychometric research data versus their pragmatic use are considered in this study.

Forty-two systematic reviews generated 23 items for assessing the risk of bias in values and preferences' studies.

PubMed

Yepes-Nuñez, Juan Jose; Zhang, Yuan; Xie, Feng; Alonso-Coello, Pablo; Selva, Anna; Schünemann, Holger; Guyatt, Gordon

2017-05-01

In systematic reviews of studies of patients' values and preferences, the objective of the study was to summarize items and domains authors have identified when considering the risk of bias (RoB) associated with primary studies. We conducted a systematic survey of systematic reviews of patients' values and preference studies. Our search included three databases (MEDLINE, EMBASE, and PsycINFO) from their inception to August 2015. We conducted duplicate data extraction, focusing on items that authors used to address RoB in the primary studies included in their reviews and the associated underlying domains, and summarized criteria in descriptive tables. We identified 42 eligible systematic reviews that addressed 23 items relevant to RoB and grouped the items into 7 domains: appropriate administration of instrument; instrument choice; instrument-described health state presentation; choice of participants group; description, analysis, and presentation of methods and results; patient understanding; and subgroup analysis. The items and domains identified provide insight into issues of RoB in patients' values and preference studies and establish the basis for an instrument to assess RoB in such studies. Copyright © 2017 Elsevier Inc. All rights reserved.

Validation of an instrument to evaluate health promotion at schools

PubMed Central

Pinto, Raquel Oliveira; Pattussi, Marcos Pascoal; Fontoura, Larissa do Prado; Poletto, Simone; Grapiglia, Valenca Lemes; Balbinot, Alexandre Didó; Teixeira, Vanessa Andina; Horta, Rogério Lessa

2016-01-01

ABSTRACT OBJECTIVE To validate an instrument designed to assess health promotion in the school environment. METHODS A questionnaire, based on guidelines from the World Health Organization and in line with the Brazilian school health context, was developed to validate the research instrument. There were 60 items in the instrument that included 40 questions for the school manager and 20 items with direct observations made by the interviewer. The items’ content validation was performed using the Delphi technique, with the instrument being applied in 53 schools from two medium-sized cities in the South region of Brazil. Reliability (Cronbach’s alpha and split-half) and validity (principal component analysis) analyses were performed. RESULTS The final instrument remained composed of 28 items, distributed into three dimensions: pedagogical, structural and relational. The resulting components showed good factorial loads (> 0.4) and acceptable reliability (> 0.6) for most items. The pedagogical dimension identifies educational activities regarding drugs and sexuality, violence and prejudice, auto care and peace and quality of life. The structural dimension is comprised of access, sanitary structure, and conservation and equipment. The relational dimension includes relationships within the school and with the community. CONCLUSIONS The proposed instrument presents satisfactory validity and reliability values, which include aspects relevant to promote health in schools. Its use allows the description of the health promotion conditions to which students from each educational institution are exposed. Because this instrument includes items directly observed by the investigator, it should only be used during periods when there are full and regular activities at the school in question. PMID:26982958

Nurses' Attitudes Regarding the Safe Handling of Patients Who Are Morbidly Obese: Instrument Development and Psychometric Analysis.

PubMed

Bejciy-Spring, Susan; Vermillion, Brenda; Morgan, Sally; Newton, Cheryl; Chucta, Sheila; Gatens, Cindy; Zadvinskis, Inga; Holloman, Christopher; Chipps, Esther

2016-12-01

Nurses' attitudes play an important role in the consistent practice of safe patient handling behaviors. The purposes of this study were to develop and assess the psychometric properties of a newly developed instrument measuring attitudes of nurses related to the care and safe handling of patients who are obese. Phases of instrument development included (a) item generation, (b) content validity assessment, (c) reliability assessment, (d) cognitive interviewing, and (e) construct validity assessment through factor analysis. The final data from the exploratory factor analysis produced a 26-item multidimensional instrument that contains 9 subscales. Based on the factor analysis, a 26-item instrument can be used to examine nurses' attitudes regarding patients who are morbidly obese and related safe handling practices.

Comparative analysis of three screening instruments for autism spectrum disorder in toddlers at high risk.

PubMed

Oosterling, Iris J; Swinkels, Sophie H; van der Gaag, Rutger Jan; Visser, Janne C; Dietz, Claudine; Buitelaar, Jan K

2009-06-01

Several instruments have been developed to screen for autism spectrum disorders (ASD) in high-risk populations. However, few studies compare different instruments in one sample. Data were gathered from the Early Screening of Autistic Traits Questionnaire, Social Communication Questionnaire, Communication and Symbolic Behavior Scales-Developmental Profile, Infant-Toddler Checklist and key items of the Checklist for Autism in Toddlers in 238 children (mean age = 29.6 months, SD = 6.4) at risk for ASD. Discriminative properties are compared in the whole sample and in two age groups separately (8-24 months and 25-44 months). No instrument or individual item shows satisfying power in discriminating ASD from non-ASD, but pros and cons of instruments and items are discussed and directions for future research are proposed.

Developing and testing an instrument to measure the presence of conditions for successful implementation of quality improvement collaboratives.

PubMed

Dückers, Michel L A; Wagner, Cordula; Groenewegen, Peter P

2008-08-11

In quality improvement collaboratives (QICs) teams of practitioners from different health care organizations are brought together to systematically improve an aspect of patient care. Teams take part in a series of meetings to learn about relevant best practices, quality methods and change ideas, and share experiences in making changes in their own local setting. The purpose of this study was to develop an instrument for measuring team organization, external change agent support and support from the team's home institution in a Dutch national improvement and dissemination programme for hospitals based on several QICs. The exploratory methodological design included two phases: a) content development and assessment, resulting in an instrument with 15 items, and b) field testing (N = 165). Internal consistency reliability was tested via Cronbach's alpha coefficient. Principal component analyses were used to identify underlying constructs. Tests of scaling assumptions according to the multi trait/multi-item matrix, were used to confirm the component structure. Three components were revealed, explaining 65% of the variability. The components were labelled 'organizational support', 'team organization' and 'external change agent support'. One item not meeting item-scale criteria was removed. This resulted in a 14 item instrument. Scale reliability ranged from 0.77 to 0.91. Internal item consistency and divergent validity were satisfactory. On the whole, the instrument appears to be a promising tool for assessing team organization and internal and external support during QIC implementation. The psychometric properties were good and warrant application of the instrument for the evaluation of the national programme and similar improvement programmes.

Conservatism implications of shock test tailoring for multiple design environments

NASA Technical Reports Server (NTRS)

Baca, Thomas J.; Bell, R. Glenn; Robbins, Susan A.

1987-01-01

A method for analyzing shock conservation in test specifications that have been tailored to qualify a structure for multiple design environments is discussed. Shock test conservation is qualified for shock response spectra, shock intensity spectra and ranked peak acceleration data in terms of an Index of Conservation (IOC) and an Overtest Factor (OTF). The multi-environment conservation analysis addresses the issue of both absolute and average conservation. The method is demonstrated in a case where four laboratory tests have been specified to qualify a component which must survive seven different field environments. Final judgment of the tailored test specification is shown to require an understanding of the predominant failure modes of the test item.

Change in Care Dependency of Stroke Patients: A Longitudinal and Multicenter Study.

PubMed

Nursiswati, Nursiswati; Halfens, Ruud J G; Lohrmann, Christa

2017-06-01

The study was conducted to investigate the change of care dependency in stroke patients from inpatient wards and outpatient units in Indonesia. This study is longitudinal and multicentered. One hundred and nine patients were included from four hospitals on the island of Java. Care dependency was assessed using the Indonesian version of the 15-item Care Dependency Scale (CDS) at five points in time: at inpatient wards for admission and discharge and at outpatient units after discharge in the 1st week, the 5th week, and the 13th week. Most of the patients were male (65.1%), and diagnosed with ischemic stroke (71.5%). The results showed that care dependency in stroke patients decreased significantly from admission to discharge, as well as from the 5th to the 13th week as measured by the CDS. At admission, 23.0% of the patients were completely dependent on care, and at the 13th week about 1.0% were. Patients' care dependency decreased significantly in all care dependency items of the CDS in the inpatient ward, but five care dependency items of the CDS did not significantly decrease in the outpatient unit. Based on the findings of this study, we recommend that hospital-based and community-based services should include continual care dependence monitoring using this comprehensive instrument. Care dependency is subject to change over time, therefore nurses have to plan and tailor adequate nursing care measures to patient needs in the different stages, especially with respect to the aspect of mobility. Copyright © 2017. Published by Elsevier B.V.

Psychometric evaluation of a new instrument in Spanish to measure the wellness of university nursing faculty.

PubMed

Hurtado-Pardos, Barbara; Casas, Irma; Lluch-Canut, Teresa; Moreno-Arroyo, Carmen; Nebot-Bergua, Carlos; Roldán-Merino, Juan

2018-01-02

The aim of this study was to design and validate an instrument to measure the wellness among university nursing faculty. The study was performed in two phases. Phase I consisted of the development of the instrument with discussion groups and participant consensus. We designed an instrument including the 21 items or psychosocial risk factors identified and estimated an index by evaluating the frequency and intensity of each item. The items were grouped into 3 dimensions: teaching work demands, curricular demands, and organizational difficulties. Phase II, we evaluated the psychometric properties of the tool in a sample of 263 participants. Exploratory factor analysis showed a 3-factor structure that explained 53% of the total variance. The internal consistency of the instrument was 0.91 for the whole instrument. The results indicate that the tool developed is valid and reliable and may be a good instrument to monitor the wellness of university nursing faculty.

Scale Refinement and Initial Evaluation of a Behavioral Health Function Measurement Tool for Work Disability Evaluation

PubMed Central

Marfeo, Elizabeth E.; Ni, Pengsheng; Bogusz, Kara; Meterko, Mark; McDonough, Christine M.; Chan, Leighton; Rasch, Elizabeth K.; Brandt, Diane E.; Jette, Alan M.

2014-01-01

Objectives To use item response theory (IRT) data simulations to construct and perform initial psychometric testing of a newly developed instrument, the Social Security Administration Behavioral Health Function (SSA-BH) instrument, that aims to assess behavioral health functioning relevant to the context of work. Design Cross-sectional survey followed by item response theory (IRT) calibration data simulations Setting Community Participants A sample of individuals applying for SSA disability benefits, claimants (N=1015), and a normative comparative sample of US adults (N=1000) Interventions None. Main Outcome Measure Social Security Administration Behavioral Health Function (SSA-BH) measurement instrument Results Item response theory analyses supported the unidimensionality of four SSA-BH scales: Mood and Emotions (35 items), Self-Efficacy (23 items), Social Interactions (6 items), and Behavioral Control (15 items). All SSA-BH scales demonstrated strong psychometric properties including reliability, accuracy, and breadth of coverage. High correlations of the simulated 5- or 10- item CATs with the full item bank indicated robust ability of the CAT approach to comprehensively characterize behavioral health function along four distinct dimensions. Conclusions Initial testing and evaluation of the SSA-BH instrument demonstrated good accuracy, reliability, and content coverage along all four scales. Behavioral function profiles of SSA claimants were generated and compared to age and sex matched norms along four scales: Mood and Emotions, Behavioral Control, Social Interactions, and Self-Efficacy. Utilizing the CAT based approach offers the ability to collect standardized, comprehensive functional information about claimants in an efficient way, which may prove useful in the context of the SSA’s work disability programs. PMID:23542404

Tailor-made finance versus tailor-made care. Can the state strengthen consumer choice in healthcare by reforming the financial structure of long-term care?

PubMed

Grit, K; de Bont, A

2010-02-01

Policy instruments based on the working of markets have been introduced to empower consumers of healthcare. However, it is still not easy to become a critical consumer of healthcare. The aim of this study is to analyse the possibilities of the state to strengthen the position of patients with the aid of a new financial regime, such as personal health budgets. Data were collected through in-depth interviews with executives, managers, professionals and client representatives of six long-term care institutions. With the introduction of individual budgets the responsibility for budgetary control has shifted from the organisational level to the individual level in the caregiver-client relationship. Having more luxurious care on offer necessitates a stronger demarcation of regular care because organisations cannot simultaneously offer extra care as part of the standard care package. New financial instruments have an impact on the culture of receiving and giving care. Distributive justice takes on new meaning with the introduction of financial market mechanisms in healthcare; the distributing principle of 'need' is transformed into the principle of 'economic demand'. Financial instruments not only act as a countervailing power against providers insufficiently client-oriented, but are also used by providers to reinforce their own positions vis-à-vis demanding clients. Tailor-made finance is not the same as tailor-made care.

Construction and validation of a psychometric scale to measure awareness on consumption of irradiated foods.

PubMed

Rusin, Tiago; Araújo, Wilma Maria Coelho; Faiad, Cristiane; Vital, Helio de Carvalho

2017-01-01

Although food irradiation has been used to ensure food safety, most consumers are unaware of the basic concepts of irradiation, misinterpreting information and demonstrating a negative attitude toward food items treated with ionizing radiation. This research is aimed at developing a tool to assess the awareness on the consumption of irradiated food. The sample was composed by employees from different social classes and school levels of Brazilian universities, who reflect the end-users of the irradiated foods, representative of the views of lay consumers. The total number of respondents was 614. In order to assess the Awareness Scale on Consumption of Irradiated Foods (ASCIF), an instrument has been developed and submitted to semantic tests and judge's validation. The instrument, that included 32 items, contemplated four construct factors: concepts (6 items), awareness (10 items), labeling (7 items) and safety of Irradiated foods (9 items). The data were collected by electronic means, through the site . By using exploratory factorial analysis (EFA) 4 factors have been found. They summarize the 31 items included. These factors account for 64.32% of the variance of the items and the internal consistency of the factors has been deemed good. An Exploratory Structural Equation Modeling (ESEM) was conducted to evaluate the factor structure of the instrument. The proposed instrument has been found to meet consistency criteria as an efficient tool for indicating assessing potential challenges and opportunities for the irradiated food markets.

Construction and validation of a psychometric scale to measure awareness on consumption of irradiated foods

PubMed Central

2017-01-01

Although food irradiation has been used to ensure food safety, most consumers are unaware of the basic concepts of irradiation, misinterpreting information and demonstrating a negative attitude toward food items treated with ionizing radiation. This research is aimed at developing a tool to assess the awareness on the consumption of irradiated food. The sample was composed by employees from different social classes and school levels of Brazilian universities, who reflect the end-users of the irradiated foods, representative of the views of lay consumers. The total number of respondents was 614. In order to assess the Awareness Scale on Consumption of Irradiated Foods (ASCIF), an instrument has been developed and submitted to semantic tests and judge’s validation. The instrument, that included 32 items, contemplated four construct factors: concepts (6 items), awareness (10 items), labeling (7 items) and safety of Irradiated foods (9 items). The data were collected by electronic means, through the site . By using exploratory factorial analysis (EFA) 4 factors have been found. They summarize the 31 items included. These factors account for 64.32% of the variance of the items and the internal consistency of the factors has been deemed good. An Exploratory Structural Equation Modeling (ESEM) was conducted to evaluate the factor structure of the instrument. The proposed instrument has been found to meet consistency criteria as an efficient tool for indicating assessing potential challenges and opportunities for the irradiated food markets. PMID:29220375

Health-Related Resource-Use Measurement Instruments for Intersectoral Costs and Benefits in the Education and Criminal Justice Sectors.

PubMed

Mayer, Susanne; Paulus, Aggie T G; Łaszewska, Agata; Simon, Judit; Drost, Ruben M W A; Ruwaard, Dirk; Evers, Silvia M A A

2017-09-01

Intersectoral costs and benefits (ICBs), i.e. costs and benefits of healthcare interventions outside the healthcare sector, can be a crucial component in economic evaluations from the societal perspective. Pivotal to their estimation is the existence of sound resource-use measurement (RUM) instruments; however, RUM instruments for ICBs in the education or criminal justice sectors have not yet been systematically collated or their psychometric quality assessed. This review aims to fill this gap. To identify relevant instruments, the Database of Instruments for Resource Use Measurement (DIRUM) was searched. Additionally, a systematic literature review was conducted in seven electronic databases to detect instruments containing ICB items used in economic evaluations. Finally, studies evaluating the psychometric quality of these instruments were searched. Twenty-six unique instruments were included. Most frequently, ICB items measured school absenteeism, tutoring, classroom assistance or contacts with legal representatives, police custody/prison detainment and court appearances, with the highest number of items listed in the Client Service Receipt Inventory/Client Sociodemographic and Service Receipt Inventory/Client Service Receipt Inventory-Children's Version (CSRI/CSSRI/CSRI-C), Studying the Scope of Parental Expenditures (SCOPE) and Self-Harm Intervention, Family Therapy (SHIFT) instruments. ICBs in the education sector were especially relevant for age-related developmental disorders and chronic diseases, while criminal justice resource use seems more important in mental health, including alcohol-related disorders or substance abuse. Evidence on the validity or reliability of ICB items was published for two instruments only. With a heterogeneous variety of ICBs found to be relevant for several disease areas but many ICB instruments applied in one study only (21/26 instruments), setting-up an international task force to, for example, develop an internationally adaptable instrument is recommended.

Content validity of governing in Building Information Modelling (BIM) implementation assessment instrument

NASA Astrophysics Data System (ADS)

Hadzaman, N. A. H.; Takim, R.; Nawawi, A. H.; Mohamad Yusuwan, N.

2018-04-01

BIM governance assessment instrument is a process of analysing the importance in developing BIM governance solution to tackle the existing problems during team collaboration in BIM-based projects. Despite the deployment of integrative technologies in construction industry particularly BIM, it is still insufficient compare to other sectors. Several studies have been established the requirements of BIM implementation concerning all technical and non-technical BIM adoption issues. However, the data are regarded as inadequate to develop a BIM governance framework. Hence, the objective of the paper is to evaluate the content validity of the BIM governance instrument prior to the main data collection. Two methods were employed in the form of literature review and questionnaire survey. Based on the literature review, 273 items with six main constructs are suggested to be incorporated in the BIM governance instrument. The Content Validity Ratio (CVR) scores revealed that 202 out of 273 items are considered as the utmost critical by the content experts. The findings for Item Level Content Validity Index (I-CVI) and Modified Kappa Coefficient however revealed that 257 items in BIM governance instrument are appropriate and excellent. The instrument is highly reliable for future strategies and the development of BIM projects in Malaysia.

Validation of an instrument to assess visual ability in children with visual impairment in China.

PubMed

Huang, Jinhai; Khadka, Jyoti; Gao, Rongrong; Zhang, Sifang; Dong, Wenpeng; Bao, Fangjun; Chen, Haisi; Wang, Qinmei; Chen, Hao; Pesudovs, Konrad

2017-04-01

To validate a visual ability instrument for school-aged children with visual impairment in China by translating, culturally adopting and Rasch scaling the Cardiff Visual Ability Questionnaire for Children (CVAQC). The 25-item CVAQC was translated into Mandarin using a standard protocol. The translated version (CVAQC-CN) was subjected to cognitive testing to ensure a proper cultural adaptation of its content. Then, the CVAQC-CN was interviewer-administered to 114 school-aged children and young people with visual impairment. Rasch analysis was carried out to assess its psychometric properties. The correlation between the CVAQC-CN visual ability scores and clinical measure of vision (visual acuity; VA and contrast sensitivity, CS) were assessed using Spearman's r. Based on cultural adaptation exercise, cognitive testing, missing data and Rasch metrics-based iterative item removal, three items were removed from the original 25. The 22-item CVAQC-CN demonstrated excellent measurement precision (person separation index, 3.08), content validity (item separation, 10.09) and item reliability (0.99). Moreover, the CVAQC-CN was unidimensional and had no item bias. The person-item map indicated good targeting of item difficulty to person ability. The CVAQC-CN had moderate correlations between CS (-0.53, p<0.00001) and VA (0.726, p<0.00001), respectively, indicating its validity. The 22-item CVAQC-CN is a psychometrically robust and valid instrument to measure visual ability in children with visual impairment in China. The instrument can be used as a clinical and research outcome measure to assess the change in visual ability after low vision rehabilitation intervention. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

FIM-Minimum Data Set Motor Item Bank: Short Forms Development and Precision Comparison in Veterans.

PubMed

Li, Chih-Ying; Romero, Sergio; Simpson, Annie N; Bonilha, Heather S; Simpson, Kit N; Hong, Ickpyo; Velozo, Craig A

2018-03-01

To improve the practical use of the short forms (SFs) developed from the item bank, we compared the measurement precision of the 4- and 8-item SFs generated from a motor item bank composed of the FIM and the Minimum Data Set (MDS). The FIM-MDS motor item bank allowed scores generated from different instruments to be co-calibrated. The 4- and 8-item SFs were developed based on Rasch analysis procedures. This article compared person strata, ceiling/floor effects, and test SE plots for each administration form and examined 95% confidence interval error bands of anchored person measures with the corresponding SFs. We used 0.3 SE as a criterion to reflect a reliability level of .90. Veterans' inpatient rehabilitation facilities and community living centers. Veterans (N=2500) who had both FIM and the MDS data within 6 days during 2008 through 2010. Not applicable. Four- and 8-item SFs of FIM, MDS, and FIM-MDS motor item bank. Six SFs were generated with 4 and 8 items across a range of difficulty levels from the FIM-MDS motor item bank. The three 8-item SFs all had higher correlations with the item bank (r=.82-.95), higher person strata, and less test error than the corresponding 4-item SFs (r=.80-.90). The three 4-item SFs did not meet the criteria of SE <0.3 for any theta values. Eight-item SFs could improve clinical use of the item bank composed of existing instruments across the continuum of care in veterans. We also found that the number of items, not test specificity, determines the precision of the instrument. Copyright © 2017 American Congress of Rehabilitation Medicine. All rights reserved.

Developing a reliable and valid instrument to assess health-affecting aspects of neighborhoods in Tehran

PubMed Central

Ghalichi, Leila; Mohammad, Kazem; Majdzadeh, Reza; Hoseini, Mostafa; Pournik, Omid; Nedjat, Saharnaz

2012-01-01

Background: Residence characteristics can affect health of residents. This paper reports the development of an instrument assessing these aspects of neighborhoods. Materials and Methods: Literature search and focus group discussions with residents were carried out and relevant items were extracted. Five experts reviewed and commented on the items. An observation instrument with 54 items was composed and completed by two independent observers in 20 randomly selected locations. Due to lack of acceptable reliability in some items, the checklist was revised. The new 22-items checklist in four categories (general characteristics, public green area characteristics, access to services and undesirable features) was completed by two independent trained observers in 28 randomly selected locations. Results: The items in the final checklist had kappa statistics ranging from 0.63 to 1, with an exception of the item assessing “presence of beggars, homeless or working/street children”, with kappa as low as 0.27 due to variability of their presence in different times. Average Kappa statistics was 0.78 for general characteristics, 0.79 for public green area characteristics, 0.84 for access to services, and 0.54 for undesirable features. Conclusion: Neighborhood and health observation instrument seems to have good reliability in city of Tehran. It can probably be used in other large cities of Iran and similar cities elsewhere. PMID:23626633

Adaptation and Validation of the Arabic Version of the Infant Breastfeeding Knowledge Questionnaire among Lebanese Women.

PubMed

Tamim, Hani; Ghandour, Lilian A; Shamsedine, Lama; Charafeddine, Lama; Nasser, Fatima; Khalil, Yvette; Nabulsi, Mona

2016-11-01

Valid instruments that can reliably assess maternal breastfeeding knowledge in Arabic-speaking populations are nonexistent. The availability of such an instrument is essential for investigators working in this field. This study aimed to describe the adaptation and validation of the Arabic Breastfeeding Knowledge Questionnaire (BFK-A) from the original 20-item English version. A translated version of the 20-item BFK was validated among 417 Lebanese women after pilot testing for clarity, comprehension, length, and cultural appropriateness. Exploratory factor analysis was run to examine dimensionality of the instrument and Kuder-Richardson-20 (KR-20) was used to assess its internal consistency. The BFK-A is a unidimensional scale with acceptable internal consistency reliability (KR-20 = 0.652) after the exclusion of 4 items. Higher breastfeeding knowledge levels were strongly and statistically significantly associated with higher mean scores for the validated Arabic Iowa Infant Feeding Attitude Scale ( P < .001), thus confirming its construct validity. The Arabic 16-item BFK-A has an acceptable reliability, similar to the original instrument. Further studies are encouraged to confirm the validity of the 16-item BFK-A among other Arab populations. There is also a need to develop more reliable instruments to use in lactation research in this context.

Development of an instrument designed to measure employees' perceptions of workplace breastfeeding support.

PubMed

Greene, Sally W; Olson, Beth H

2008-09-01

Breastfeeding rates remain low in the United States, especially among working women. Unfortunately, no quantitative instrument exists to facilitate the examination of why women who return to work discontinue breastfeeding sooner than the general population. The objective of this study was to develop an instrument to measure female employees' perceptions of breastfeeding support in the workplace, which would be suitable for piloting with the target population. Examination of the literature, reviews with experts, and one-on-one interviews with women who had experience combining breastfeeding and work were used to create the instrument subscales and items. Examination of the literature was used to develop four subscales: company policies/work culture, manager support, co-worker support, and workflow. Expert review resulted in the addition of a fifth subscale, the physical environment of the breastfeeding space. One-on-one interviews were used to ensure that the item wording was appropriate for the target population. Eighteen items were added, and 15 were reworded based on comments from the expert review and from the interviews. The resulting survey contained 54 items that required either categorical yes/no or Likert scale responses. Results from this process indicate the survey subscales and items adequately reflect women's perceptions of breastfeeding support in the workplace and the instrument is appropriate for piloting with new mother employees.

Does item overlap render measured relationships between pain and challenging behaviour trivial? Results from a multicentre cross-sectional study in 13 German nursing homes.

PubMed

Kutschar, Patrick; Bauer, Zsuzsa; Gnass, Irmela; Osterbrink, Jürgen

2017-07-01

Several studies suggest that pain is a trigger for challenging behaviour in older adults with cognitive impairment. However, such measured relationships might be confounded due to item overlap as instruments share similar or identical items. The purpose of this study was to examine whether the frequently observed association between pain and challenging behaviour might be traced back to item overlap. This multicentre cross-sectional study was conducted in 13 nursing homes and examined pain (measure: Pain Assessment in Advanced Dementia Scale) and challenging behaviour (measure: Cohen-Mansfield Agitation Inventory) in 150 residents with severe cognitive impairment. The extent of item overlap was determined by juxtaposition of both measures' original items. As expected, comparison between these instruments revealed an extensive item overlap. The statistical relationship between the two phenomena can be traced back mainly to the contribution of the overlapping items, which renders the frequently stated relationship between pain and challenging behaviour trivial. The status quo of measuring such associations must be contested: constructs' discrimination and instruments' discrimination have to be discussed critically as item overlap may lead to biased conclusions and assumptions in research as well as to inadequate care measures in nursing practice. © 2017 John Wiley & Sons Ltd.

Validation of the Malay Version of the Parental Bonding Instrument among Malaysian Youths Using Exploratory Factor Analysis

PubMed Central

MUHAMMAD, Noor Azimah; SHAMSUDDIN, Khadijah; OMAR, Khairani; SHAH, Shamsul Azhar; MOHD AMIN, Rahmah

2014-01-01

Background: Parenting behaviour is culturally sensitive. The aims of this study were (1) to translate the Parental Bonding Instrument into Malay (PBI-M) and (2) to determine its factorial structure and validity among the Malaysian population. Methods: The PBI-M was generated from a standard translation process and comprehension testing. The validation study of the PBI-M was administered to 248 college students aged 18 to 22 years. Results: Participants in the comprehension testing had difficulty understanding negative items. Five translated double negative items were replaced with five positive items with similar meanings. Exploratory factor analysis showed a three-factor model for the PBI-M with acceptable reliability. Four negative items (items 3, 4, 8, and 16) and item 19 were omitted from the final PBI-M list because of incorrect placement or low factor loading (< 0.32). Out of the final 20 items of the PBI-M, there were 10 items for the care factor, five items for the autonomy factor and five items for the overprotection factor. All the items loaded positively on their respective factors. Conclusion: The Malaysian population favoured positive items in answering questions. The PBI-M confirmed the three-factor model that consisted of care, autonomy and overprotection. The PBI-M is a valid and reliable instrument to assess the Malaysian parenting style. Confirmatory factor analysis may further support this finding. Keywords: Malaysia, parenting, questionnaire, validity PMID:25977634

The development of PROQOL-HIV: an international instrument to assess the health-related quality of life of persons living with HIV/AIDS.

PubMed

Duracinsky, Martin; Herrmann, Susan; Berzins, Baiba; Armstrong, Andrew R; Kohli, Rewa; Le Coeur, Sophie; Diouf, Assane; Fournier, Isabelle; Schechter, Mauro; Chassany, Olivier

2012-04-15

Health-related quality of life (HRQL) is an important outcome in HIV/AIDS infection and treatment. However, most existing HIV-HRQL instruments miss important issues (eg, sleeping problems, lipodystrophy). They were developed before highly active antiretroviral therapy (pre-HAART), and in a single language. We sought to develop a contemporary HIV-HRQL instrument (PROQOL-HIV) in multiple languages that accounts for HAART treatment and side effects. This article details the 3-stage content validation phase of PROQOL-HIV. In stage 1, we developed a conceptual model of HIV-HRQL and questionnaire item bank from thematic analysis of 152 patient interviews conducted simultaneously across 9 countries. In stage 2, pilot items were selected by an expert panel to form the pilot instrument. Stage 3 involved linguistic validation and harmonization of selected items to form an equivalent instrument in 9 target languages. Analysis of 3375 pages of interview text revealed 11 underlying themes: general health perception, social relationships, emotions, energy/fatigue, sleep, cognitive functioning, physical and daily activity, coping, future, symptoms, and treatment. Seven issues new to HIV-HRQL measurement were subsumed by these themes: infection fears, future concerns, satisfaction with care, self-esteem problems, sleep problems, work disruption, and treatment issues. Of the 442 theme-related items banked, 70 items met the retention criteria and formed the pilot PROQOL-HIV instrument. HIV patients across 11 countries attributed a wide range of physical, mental, and social issues to their condition, many of which were not measured by existing HIV-HRQL instruments. The pilot PROQOL-HIV instrument captures these issues, is sensitive to sociocultural context, disease stage, and HAART.

A Practitioner's Instrument for Measuring Secondary Mathematics Teachers' Beliefs Surrounding Learner-Centered Classroom Practice.

PubMed

Lischka, Alyson E; Garner, Mary

In this paper we present the development and validation of a Mathematics Teaching Pedagogical and Discourse Beliefs Instrument (MTPDBI), a 20 item partial-credit survey designed and analyzed using Rasch measurement theory. Items on the MTPDBI address beliefs about the nature of mathematics, teaching and learning mathematics, and classroom discourse practices. A Rasch partial credit model (Masters, 1982) was estimated from the pilot study data. Results show that item separation reliability is .96 and person separation reliability is .71. Other analyses indicate the instrument is a viable measure of secondary teachers' beliefs about reform-oriented mathematics teaching and learning. This instrument is proposed as a useful measure of teacher beliefs for those working with pre-service and in-service teacher development.

Construct Validity of Science Motivation and Beliefs Instrument (SLA-MB): A Case study in Sumedang, Indonesia

NASA Astrophysics Data System (ADS)

Rachmatullah, A.; Octavianda, R. P.; Ha, M.; Rustaman, N. Y.; Diana, S.

2017-02-01

Along with numerous instruments developed and used in science education researches, some of those instruments have been translated to local language in the country where the instruments were used. Most of researchers that used those translated instruments did not report the quality of those translated instruments. One of the instruments is the Scientific Literacy Assessment (SLA) including the Science Motivation and Beliefs (SLA-MB) as part of the SLA. In this study, the SLA-MB has been translated into Indonesian Language (Bahasa). The purpose of this study is to investigate the SLA-MB instrument that has been translated to Indonesian language from the view of dimensionality, reliability, item quality and differential item functioning (DIF) based on IRT-Rasch analysis. We used Conquest and Winstep as the program for IRT-Rasch analysis. We employed quantitative research method with school-survey on this study. Research subjects are 223 Indonesian Middle school students (age 13-16), with 64 boys and 159 girls. IRT-Rasch analysis of the SLA-MB Indonesian version indicated that a three-dimensional model fit significantly better than one-dimension model, and the reliability of each dimensions are about 0.60 to 0.82. As well as those findings, fit values of all items are acceptable, moreover we found no DIF for all of the SLA-MB items. Overall, our study suggests that Indonesian version of SLA-MB is acceptable to be implemented as research instrument conducted in Indonesia.

Development and content validation of performance assessments for endoscopic third ventriculostomy.

PubMed

Breimer, Gerben E; Haji, Faizal A; Hoving, Eelco W; Drake, James M

2015-08-01

This study aims to develop and establish the content validity of multiple expert rating instruments to assess performance in endoscopic third ventriculostomy (ETV), collectively called the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). The important aspects of ETV were identified through a review of current literature, ETV videos, and discussion with neurosurgeons, fellows, and residents. Three assessment measures were subsequently developed: a procedure-specific checklist (CL), a CL of surgical errors, and a global rating scale (GRS). Neurosurgeons from various countries, all identified as experts in ETV, were then invited to participate in a modified Delphi survey to establish the content validity of these instruments. In each Delphi round, experts rated their agreement including each procedural step, error, and GRS item in the respective instruments on a 5-point Likert scale. Seventeen experts agreed to participate in the study and completed all Delphi rounds. After item generation, a total of 27 procedural CL items, 26 error CL items, and 9 GRS items were posed to Delphi panelists for rating. An additional 17 procedural CL items, 12 error CL items, and 1 GRS item were added by panelists. After three rounds, strong consensus (>80% agreement) was achieved on 35 procedural CL items, 29 error CL items, and 10 GRS items. Moderate consensus (50-80% agreement) was achieved on an additional 7 procedural CL items and 1 error CL item. The final procedural and error checklist contained 42 and 30 items, respectively (divided into setup, exposure, navigation, ventriculostomy, and closure). The final GRS contained 10 items. We have established the content validity of three ETV assessment measures by iterative consensus of an international expert panel. Each measure provides unique assessment information and thus can be used individually or in combination, depending on the characteristics of the learner and the purpose of the assessment. These instruments must now be evaluated in both the simulated and operative settings, to determine their construct validity and reliability. Ultimately, the measures contained in the NEVAT may prove suitable for formative assessment during ETV training and potentially as summative assessment measures during certification.

Reliability and validity evidence of the Assessment of Language Use in Social Contexts for Adults (ALUSCA).

PubMed

Valente, Ana Rita S; Hall, Andreia; Alvelos, Helena; Leahy, Margaret; Jesus, Luis M T

2018-04-12

The appropriate use of language in context depends on the speaker's pragmatic language competencies. A coding system was used to develop a specific and adult-focused self-administered questionnaire to adults who stutter and adults who do not stutter, The Assessment of Language Use in Social Contexts for Adults, with three categories: precursors, basic exchanges, and extended literal/non-literal discourse. This paper presents the content validity, item analysis, reliability coefficients and evidences of construct validity of the instrument. Content validity analysis was based on a two-stage process: first, 11 pragmatic questionnaires were assessed to identify items that probe each pragmatic competency and to create the first version of the instrument; second, items were assessed qualitatively by an expert panel composed by adults who stutter and controls, and quantitatively and qualitatively by an expert panel composed by clinicians. A pilot study was conducted with five adults who stutter and five controls to analyse items and calculate reliability. Construct validity evidences were obtained using the hypothesized relationships method and factor analysis with 28 adults who stutter and 28 controls. Concerning content validity, the questionnaires assessed up to 13 pragmatic competencies. Qualitative and quantitative analysis revealed ambiguities in items construction. Disagreement between experts was solved through item modification. The pilot study showed that the instrument presented internal consistency and temporal stability. Significant differences between adults who stutter and controls and different response profiles revealed the instrument's underlying construct. The instrument is reliable and presented evidences of construct validity.

Technology Use in Science Instruction (TUSI): Aligning the Integration of Technology in Science Instruction in Ways Supportive of Science Education Reform

NASA Astrophysics Data System (ADS)

Campbell, Todd; Abd-Hamid, Nor Hashidah

2013-08-01

This study describes the development of an instrument to investigate the extent to which technology is integrated in science instruction in ways aligned to science reform outlined in standards documents. The instrument was developed by: (a) creating items consistent with the five dimensions identified in science education literature, (b) establishing content validity with both national and international content experts, (c) refining the item pool based on content expert feedback, (d) piloting testing of the instrument, (e) checking statistical reliability and item analysis, and (f) subsequently refining and finalization of the instrument. The TUSI was administered in a field test across eleven classrooms by three observers, with a total of 33 TUSI ratings completed. The finalized instrument was found to have acceptable inter-rater intraclass correlation reliability estimates. After the final stage of development, the TUSI instrument consisted of 26-items separated into the original five categories, which aligned with the exploratory factor analysis clustering of the items. Additionally, concurrent validity of the TUSI was established with the Reformed Teaching Observation Protocol. Finally, a subsequent set of 17 different classrooms were observed during the spring of 2011, and for the 9 classrooms where technology integration was observed, an overall Cronbach alpha reliability coefficient of 0.913 was found. Based on the analyses completed, the TUSI appears to be a useful instrument for measuring how technology is integrated into science classrooms and is seen as one mechanism for measuring the intersection of technological, pedagogical, and content knowledge in science classrooms.

A Rasch Differential Item Functioning Analysis of the Massachusetts Youth Screening Instrument: Identifying Race and Gender Differential Item Functioning among Juvenile Offenders

ERIC Educational Resources Information Center

Cauffman, Elizabeth; MacIntosh, Randall

2006-01-01

The juvenile justice system needs a tool that can identify and assess mental health problems among youths quickly with validity and reliability. The goal of this article is to evaluate the racial/ethnic and gender differential item functioning (DIF) of the Massachusetts Youth Screening Instrument-Second Version (MAYSI-2) using the Rasch Model.…

Ion Monitoring

DOEpatents

Orr, Christopher Henry; Luff, Craig Janson; Dockray, Thomas; Macarthur, Duncan Whittemore

2003-11-18

The apparatus and method provide a technique for significantly reducing capacitance effects in detector electrodes arising due to movement of the instrument relative to the item/location being monitored in ion detection based techniques. The capacitance variations are rendered less significant by placing an electrically conducting element between the detector electrodes and the monitored location/item. Improved sensitivity and reduced noise signals arise as a result. The technique also provides apparatus and method suitable for monitoring elongate items which are unsuited to complete enclosure in one go within a chamber. The items are monitored part by part as the pass through the instrument, so increasing the range of items or locations which can be successfully monitored.

Nine Constructs of Cultural Competence for Curriculum Development

PubMed Central

Brookover, Cecile; Kennedy, Kathleen

2010-01-01

Objective To examine the self-administered Clinical Cultural Competency Questionnaire (CCCQ) and assess the perceived level of cultural competence of students in Xavier University of Louisiana College of Pharmacy to guide curriculum development within the 4-year academic program. Methods The CCCQ was administrated to each class of pharmacy students during spring 2009. Exploratory factor analysis with principal components and varimax rotation was conducted to build the constructs explaining the factors measuring students' self-assessment of cultural competence. Results Nine factors, including 46 items extracted from the CCCQ and explaining 79% of the total variance, were found as the best fit to measure students' self-assessment of cultural competence. Conclusions The CCCQ was found to be a practical, valid, and reliable self-assessment instrument to measure the perceived level of pharmacy students' knowledge, skills, attitudes, and encounters in cross-cultural environments. The questionnaire allowed the identification of students' needs for training in cultural competence and the development of a curriculum tailored to satisfy those needs. PMID:21436922

Identifying instruments to quantify financial management skills in adults with acquired cognitive impairments.

PubMed

Engel, Lisa; Bar, Yael; Beaton, Dorcas E; Green, Robin E; Dawson, Deirdre R

2016-01-01

Financial management skills-that is, the skills needed to handle personal finances such as banking and paying bills-are essential to a person's autonomy, independence, and community living. To date, no comprehensive review of financial management skills instruments exists, making it difficult for clinicians and researchers to choose relevant instruments. The objectives of this review are to: (a) identify all available instruments containing financial management skill items that have been used with adults with acquired cognitive impairments; (b) categorize the instruments by source (i.e., observation based, self-report, proxy report); and (c) describe observation-based performance instruments by populations, overarching concepts measured, and comprehensiveness of financial management items. Objective (c) focuses on observation-based performance instruments as these measures can aid in situations where the person with cognitive impairment has poor self-awareness or where the proxy has poor knowledge of the person's current abilities. Two reviewers completed two systematic searches of five databases. Instruments were categorized by reviewing published literature, copies of the instruments, and/or communication with instrument authors. Comprehensiveness of items was based on nine key domains of financial management skills developed by the authors. A total of 88 discrete instruments were identified. Of these, 44 were categorized as observation-based performance and 44 as self- and/or proxy-reports. Of the 44 observation-based performance instruments, 8 had been developed for acquired brain injury populations and 24 for aging and dementia populations. Only 7 of the observation-based performance instruments had items spanning 6 or more of the 9 financial management skills domains. The majority of instruments were developed for aging and dementia populations, and few were comprehensive. This review provides foundation for future instrument psychometric and clinimetric reviews. It a necessary first step in providing information to support decision making for clinicians and researchers selecting financial management skills instruments.

Development of a computer-adaptive physical function instrument for Social Security Administration disability determination.

PubMed

Ni, Pengsheng; McDonough, Christine M; Jette, Alan M; Bogusz, Kara; Marfeo, Elizabeth E; Rasch, Elizabeth K; Brandt, Diane E; Meterko, Mark; Haley, Stephen M; Chan, Leighton

2013-09-01

To develop and test an instrument to assess physical function for Social Security Administration (SSA) disability programs, the SSA-Physical Function (SSA-PF) instrument. Item response theory (IRT) analyses were used to (1) create a calibrated item bank for each of the factors identified in prior factor analyses, (2) assess the fit of the items within each scale, (3) develop separate computer-adaptive testing (CAT) instruments for each scale, and (4) conduct initial psychometric testing. Cross-sectional data collection; IRT analyses; CAT simulation. Telephone and Internet survey. Two samples: SSA claimants (n=1017) and adults from the U.S. general population (n=999). None. Model fit statistics, correlation, and reliability coefficients. IRT analyses resulted in 5 unidimensional SSA-PF scales: Changing & Maintaining Body Position, Whole Body Mobility, Upper Body Function, Upper Extremity Fine Motor, and Wheelchair Mobility for a total of 102 items. High CAT accuracy was demonstrated by strong correlations between simulated CAT scores and those from the full item banks. On comparing the simulated CATs with the full item banks, very little loss of reliability or precision was noted, except at the lower and upper ranges of each scale. No difference in response patterns by age or sex was noted. The distributions of claimant scores were shifted to the lower end of each scale compared with those of a sample of U.S. adults. The SSA-PF instrument contributes important new methodology for measuring the physical function of adults applying to the SSA disability programs. Initial evaluation revealed that the SSA-PF instrument achieved considerable breadth of coverage in each content domain and demonstrated noteworthy psychometric properties. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

The DUNDRUM Quartet: validation of structured professional judgement instruments DUNDRUM-3 assessment of programme completion and DUNDRUM-4 assessment of recovery in forensic mental health services

PubMed Central

2011-01-01

Background Moving a forensic mental health patient from one level of therapeutic security to a lower level or to the community is influenced by more than risk assessment and risk management. We set out to construct and validate structured professional judgement instruments for consistency and transparency in decision making Methods Two instruments were developed, the seven-item DUNDRUM-3 programme completion instrument and the six item DUNDRUM-4 recovery instrument. These were assessed for all 95 forensic patients at Ireland's only forensic mental health hospital. Results The two instruments had good internal consistency (Cronbach's alpha 0.911 and 0.887). Scores distinguished those allowed no leave or accompanied leave from those with unaccompanied leave (ANOVA F = 38.1 and 50.3 respectively, p < 0.001). Scores also distinguished those in acute/high security units from those in medium or in low secure/pre-discharge units. Each individual item distinguished these levels of need significantly. The DUNDRUM-3 and DUNDRUM-4 correlated moderately with measures of dynamic risk and with the CANFOR staff rated unmet need (Spearman r = 0.5, p < 0.001). Conclusions The DUNDRUM-3 programme completion items distinguished significantly between levels of therapeutic security while the DUNDRUM-4 recovery items consistently distinguished those given unaccompanied leave outside the hospital and those in the lowest levels of therapeutic security. This data forms the basis for a prospective study of outcomes now underway. PMID:21722396

Assessing the capacity of ministries of health to use research in decision-making: conceptual framework and tool.

PubMed

Rodríguez, Daniela C; Hoe, Connie; Dale, Elina M; Rahman, M Hafizur; Akhter, Sadika; Hafeez, Assad; Irava, Wayne; Rajbangshi, Preety; Roman, Tamlyn; Ţîrdea, Marcela; Yamout, Rouham; Peters, David H

2017-08-01

The capacity to demand and use research is critical for governments if they are to develop policies that are informed by evidence. Existing tools designed to assess how government officials use evidence in decision-making have significant limitations for low- and middle-income countries (LMICs); they are rarely tested in LMICs and focus only on individual capacity. This paper introduces an instrument that was developed to assess Ministry of Health (MoH) capacity to demand and use research evidence for decision-making, which was tested for reliability and validity in eight LMICs (Bangladesh, Fiji, India, Lebanon, Moldova, Pakistan, South Africa, Zambia). Instrument development was based on a new conceptual framework that addresses individual, organisational and systems capacities, and items were drawn from existing instruments and a literature review. After initial item development and pre-testing to address face validity and item phrasing, the instrument was reduced to 54 items for further validation and item reduction. In-country study teams interviewed a systematic sample of 203 MoH officials. Exploratory factor analysis was used in addition to standard reliability and validity measures to further assess the items. Thirty items divided between two factors representing organisational and individual capacity constructs were identified. South Africa and Zambia demonstrated the highest level of organisational capacity to use research, whereas Pakistan and Bangladesh were the lowest two. In contrast, individual capacity was highest in Pakistan, followed by South Africa, whereas Bangladesh and Lebanon were the lowest. The framework and related instrument represent a new opportunity for MoHs to identify ways to understand and improve capacities to incorporate research evidence in decision-making, as well as to provide a basis for tracking change.

Measuring the Quality of Life of Visually Impaired Children: First Stage Psychometric Evaluation of the Novel VQoL_CYP Instrument.

PubMed

Tadić, Valerija; Cooper, Andrew; Cumberland, Phillippa; Lewando-Hundt, Gillian; Rahi, Jugnoo S

2016-01-01

To report piloting and initial validation of the VQoL_CYP, a novel age-appropriate vision-related quality of life (VQoL) instrument for self-reporting by children with visual impairment (VI). Participants were a random patient sample of children with VI aged 10-15 years. 69 patients, drawn from patient databases at Great Ormond Street Hospital and Moorfields Eye Hospital, United Kingdom, participated in piloting of the draft 47-item VQoL instrument, which enabled preliminary item reduction. Subsequent administration of the instrument, alongside functional vision (FV) and generic health-related quality of life (HRQoL) self-report measures, to 101 children with VI comprising a nationally representative sample enabled further item reduction and evaluation of psychometric properties using Rasch analysis. Construct validity was assessed through Pearson correlation coefficients. Item reduction through piloting (8 items removed for skewness and individual item response pattern) and validation (1 item removed for skewness and 3 for misfit in Rasch) produced a 35-item scale, with fit values within acceptable limits, no notable differential item functioning, good measurement precision, ordered response categories and acceptable targeting in Rasch. The VQoL_CYP showed good construct validity, correlating strongly with HRQoL scores, moderately with FV scores but not with acuity. Robust child-appropriate self-report VQoL measures for children with VI are necessary for understanding the broader impacts of living with a visual disability, distinguishing these from limited functioning per se. Future planned use in larger patient samples will allow further psychometric development of the VQoL_CYP as an adjunct to objective outcomes assessment.

Development of the Primary Care Quality-Homeless (PCQ-H) Instrument: A Practical Survey of Patients' Experiences in Primary Care

PubMed Central

Kertesz, Stefan. G.; Pollio, David E.; Jones, Richard N.; Steward, Jocelyn; Stringfellow, Erin J.; Gordon, Adam J.; Johnson, Nancy K.; Kim, Theresa A.; Granstaff, Unita; Austin, Erika L.; Young, Alexander S.; Golden, Joya; Davis, Lori L.; Roth, David L.; Holt, Cheryl L.

2015-01-01

Background Homeless patients face unique challenges in obtaining primary care responsive to their needs and context. Patient experience questionnaires could permit assessment of patient-centered medical homes for this population, but standard instruments may not reflect homeless patients' priorities and concerns. Objectives This report describes (a) the content and psychometric properties of a new primary care questionnaire for homeless patients and (b) the methods utilized in its development. Methods Starting with quality-related constructs from the Institute of Medicine, we identified relevant themes by interviewing homeless patients and experts in their care. A multidisciplinary team drafted a preliminary set of 78 items. This was administered to homeless-experienced clients (n=563) across 3 VA facilities and 1 non-VA Health Care for the Homeless Program. Using Item Response Theory, we examined Test Information Function curves to eliminate less informative items and devise plausibly distinct subscales. Results The resulting 33-item instrument (Primary Care Quality-Homeless, PCQ-H) has four subscales: Patient-Clinician Relationship (15 items), Cooperation among Clinicians (3 items), Access/Coordination (11 items) and Homeless-Specific Needs (4 items). Evidence for divergent and convergent validity is provided. Test Information Function (TIF) graphs showed adequate informational value to permit inferences about groups for 3 subscales (Relationship, Cooperation and Access/Coordination). The 3-item Cooperation subscale had lower informational value (TIF<5) but had good internal consistency (alpha=0.75) and patients frequently reported problems in this aspect of care. Conclusions Systematic application of qualitative and quantitative methods supported the development of a brief patient-reported questionnaire focused on the primary care of homeless patients and offers guidance for future population-specific instrument development. PMID:25023918

Evaluating the Effectiveness of a Non-Cognitive Assessment Instrument

ERIC Educational Resources Information Center

Di Tommaso, Kathrynn

2016-01-01

This paper presents a pilot study aiming to evaluate the effects of a non-cognitive assessment instrument which was developed and tailored for a community college in the New York City area. The instrument was pilot tested on a group of developmental students and asked a series of questions to determine the campus support services that might best…

Market Analysis for Nondevelopmental Items

DTIC Science & Technology

1992-02-01

A252 287 S-muININu nIn Defense Standardization Program MARKET ANALYSIS FOR NONDEVELOPMENTAL ITEMS February 1992 This do-umcont has bee-n CiPPn*x.,d... market analysis, that task would be much more difficult. This bro- chure proposes a generic approach to market analysis that can be tailored to a wide...Statement A per telecon Greg Saunders OASD(P&L)PR/MM Washington, DC 20301-8000 NWW 6/30/92 Market Analysis for NDI WHY DO MARKET ANALYSIS? The

What do Demand-Control and Effort-Reward work stress questionnaires really measure? A discriminant content validity study of relevance and representativeness of measures.

PubMed

Bell, Cheryl; Johnston, Derek; Allan, Julia; Pollard, Beth; Johnston, Marie

2017-05-01

The Demand-Control (DC) and Effort-Reward Imbalance (ERI) models predict health in a work context. Self-report measures of the four key constructs (demand, control, effort, and reward) have been developed and it is important that these measures have good content validity uncontaminated by content from other constructs. We assessed relevance (whether items reflect the constructs) and representativeness (whether all aspects of the construct are assessed, and all items contribute to that assessment) across the instruments and items. Two studies examined fourteen demand/control items from the Job Content Questionnaire and seventeen effort/reward items from the Effort-Reward Imbalance measure using discriminant content validation and a third study developed new methods to assess instrument representativeness. Both methods use judges' ratings and construct definitions to get transparent quantitative estimates of construct validity. Study 1 used dictionary definitions while studies 2 and 3 used published phrases to define constructs. Overall, 3/5 demand items, 4/9 control items, 1/6 effort items, and 7/11 reward items were uniquely classified to the appropriate theoretical construct and were therefore 'pure' items with discriminant content validity (DCV). All pure items measured a defining phrase. However, both the DC and ERI assessment instruments failed to assess all defining aspects. Finding good discriminant content validity for demand and reward measures means these measures are usable and our quantitative results can guide item selection. By contrast, effort and control measures had limitations (in relevance and representativeness) presenting a challenge to the implementation of the theories. Statement of contribution What is already known on this subject? While the reliability and construct validity of Demand-Control and Effort-Reward-Imbalance (DC and ERI) work stress measures are routinely reported, there has not been adequate investigation of their content validity. This paper investigates their content validity in terms of both relevance and representativeness and provides a model for the investigation of content validity of measures in health psychology more generally. What does this study add? A new application of an existing method, discriminant content validity, and a new method of assessing instrument representativeness. 'Pure' DC and ERI items are identified, as are constructs that are not fully represented by their assessment instruments. The findings are important for studies attempting to distinguish between the main DC and ERI work stress constructs. The quantitative results can be used to guide item selection for future studies. © 2017 The British Psychological Society.

Initial development and psychometric testing of an instrument to measure the quality of children's end-of-life care.

PubMed

Widger, Kimberley; Tourangeau, Ann E; Steele, Rose; Streiner, David L

2015-01-01

The field of pediatric palliative care is hindered by the lack of a well-defined, reliable, and valid method for measuring the quality of end-of-life care. The study purpose was to develop and test an instrument to measure mothers' perspectives on the quality of care received before, at the time of, and following a child's death. In Phase 1, key components of quality end-of-life care for children were synthesized through a comprehensive review of research literature. These key components were validated in Phase 2 and then extended through focus groups with bereaved parents. In Phase 3, items were developed to assess structures, processes, and outcomes of quality end-of-life care then tested for content and face validity with health professionals. Cognitive testing was conducted through interviews with bereaved parents. In Phase 4, bereaved mothers were recruited through 10 children's hospitals/hospices in Canada to complete the instrument, and psychometric testing was conducted. Following review of 67 manuscripts and 3 focus groups with 10 parents, 141 items were initially developed. The overall content validity index for these items was 0.84 as rated by 7 health professionals. Based on feedback from health professionals and cognitive testing with 6 parents, a 144-item instrument was finalized for further testing. In Phase 4, 128 mothers completed the instrument, 31 of whom completed it twice. Test-retest reliability, internal consistency, and construct validity were demonstrated for six subscales: Connect With Families, Involve Parents, Share Information With Parents, Share Information Among Health Professionals, Support Parents, and Provide Care at Death. Additional items with content validity were grouped in four domains: Support the Child, Support Siblings, Provide Bereavement Follow-up, and Structures of Care. Forty-eight items were deleted through psychometric testing, leaving a 95-item instrument. There is good initial evidence for the reliability and validity of this new quality of end-of-life care instrument as a mechanism for evaluative feedback to health professionals, health systems, and policy makers to improve children's end-of-life care.

Tracking functional status across the spinal cord injury lifespan: linking pediatric and adult patient-reported outcome scores.

PubMed

Tian, Feng; Ni, Pengsheng; Mulcahey, M J; Hambleton, Ronald K; Tulsky, David; Haley, Stephen M; Jette, Alan M

2014-11-01

To use item response theory (IRT) methods to link scores from 2 recently developed contemporary functional outcome measures, the adult Spinal Cord Injury-Functional Index (SCI-FI) and the Pedi SCI (both the parent version and the child version). Secondary data analysis of the physical functioning items of the adult SCI-FI and the Pedi SCI instruments. We used a nonequivalent group design with items common to both instruments and the Stocking-Lord method for the linking. Linking was conducted so that the adult SCI-FI and Pedi SCI scaled scores could be compared. Community. This study included a total sample of 1558 participants. Pedi SCI items were administered to a sample of children (n=381) with SCI aged 8 to 21 years, and of parents/caregivers (n=322) of children with SCI aged 4 to 21 years. Adult SCI-FI items were administered to a sample of adults (n=855) with SCI aged 18 to 92 years. Not applicable. Five scales common to both instruments were included in the analysis: Wheelchair, Daily Routine/Self-care, Daily Routine/Fine Motor, Ambulation, and General Mobility functioning. Confirmatory factor analysis and exploratory factor analysis results indicated that the 5 scales are unidimensional. A graded response model was used to calibrate the items. Misfitting items were identified and removed from the item banks. Items that function differently between the adult and child samples (ie, exhibit differential item functioning) were identified and removed from the common items used for linking. Domain scores from the Pedi SCI instruments were transformed onto the adult SCI-FI metric. This IRT linking allowed estimation of adult SCI-FI scale scores based on Pedi SCI scale scores and vice versa; therefore, it provides clinicians with a means of tracking long-term functional data for children with an SCI across their entire lifespan. Copyright © 2014 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Selecting Soldiers and Civilians into the U.S. Army Officer Candidate School : Developing Empirical Selection Composites

DTIC Science & Technology

2014-07-01

a biographical instrument measuring personality ; (b) a Work Values instrument representing work preferences investigated in prior officer and...items used in SelectOCS Phase 2 (see Table 2.5). TAPAS uses multidimensional pairwise preference (MDPP) personality items scored using item response...presented respondents with a list of 30 traits and 30 skills (derived from leadership and personality literature) and instructed them to rate the

Factor analyses of an Adult Epilepsy Self-Management Measurement Instrument (AESMMI).

PubMed

Escoffery, Cam; Bamps, Yvan; LaFrance, W Curt; Stoll, Shelley; Shegog, Ross; Buelow, Janice; Shafer, Patricia; Thompson, Nancy J; McGee, Robin E; Hatfield, Katherine

2015-09-01

The purpose of this study was to test the psychometric properties of an enhanced Adult Epilepsy Self-Management Measurement Instrument (AESMMI). An instrument of 113 items, covering 10 a priori self-management domains, was generated through a multiphase process, based on a review of the literature, validated epilepsy and other chronic condition self-management scales and expert input. Reliability and exploratory factor analyses were conducted on data collected from 422 adults with epilepsy. The instrument was reduced to 65 items, converging on 11 factors: Health-care Communication, Coping, Treatment Management, Seizure Tracking, Social Support, Seizure Response, Wellness, Medication Adherence, Safety, Stress Management, and Proactivity. Exploratory factors supported the construct validity for 6 a priori domains, albeit with significant changes in the retained items or in their scope and 3 new factors. One a priori domain was split in 2 subscales pertaining to treatment. The configuration of the 11 factors provides additional insight into epilepsy self-management behaviors. Internal consistency reliability of the 65-item instrument was high (α=.935). Correlations with independent measures of health status, quality of life, depression, seizure severity, and life impact of epilepsy further validated the instrument. This instrument shows potential for use in research and clinical settings and for assessing intervention outcomes and self-management behaviors in adults with epilepsy. Copyright © 2015 Elsevier Inc. All rights reserved.

Space applications instrumentation systems

NASA Technical Reports Server (NTRS)

Minzner, R. A.; Oberholtzer, J. D.

1972-01-01

A compendium of resumes of 158 instrument systems or experiments, of particular interest to space applications, is presented. Each resume exists in a standardized format, permitting entries for 26 administrative items and 39 scientific or engineering items. The resumes are organized into forty groups determined by the forty spacecraft with which the instruments are associated. The resumes are followed by six different cross indexes, each organized alphabetically according to one of the following catagories: instrument name, acronym, name of principal investigator, name of organization employing the principal investigator, assigned experiment number, and spacecraft name. The resumes are associated with a computerized instrument resume search and retrieval system.

PRINTQUAL - a measure for assessing the quality of newspaper reporting of suicide.

PubMed

John, Ann; Hawton, Keith; Lloyd, Keith; Luce, Ann; Platt, Stephen; Scourfield, Jonathan; Marchant, Amanda L; Jones, Phil A; Dennis, Mick S

2014-01-01

Many studies have demonstrated a relationship between newspaper reporting of actual or fictional suicides and subsequent suicidal behaviors. Previous measures of the quality of reporting lack consistency concerning which specific elements should be included and how they should be weighted. To develop an instrument, PRINTQUAL, comprising two scales of the quality (poor and good) of newspaper reporting of suicide that can be used in future studies of reporting. A first draft of the PRINTQUAL instrument was compiled, comprising items indicative of poor- and good-quality newspaper reporting based on guidelines and key sources of evidence. This was refined by team members and then circulated to a group of international experts in the field for further opinion and weighting of individual items. The final instrument comprised 19 items in the poor-quality scale and four in the good-quality scale. Following training, agreement between raters was acceptably high for most items (κ ≥ .75) except for three items for which agreement was still acceptable (κ ≥ .60). The PRINTQUAL instrument for assessing the quality of newspaper reporting of suicide appears appropriate for use in research and monitoring in future studies.

Assessing cross-cultural validity of scales: a methodological review and illustrative example.

PubMed

Beckstead, Jason W; Yang, Chiu-Yueh; Lengacher, Cecile A

2008-01-01

In this article, we assessed the cross-cultural validity of the Women's Role Strain Inventory (WRSI), a multi-item instrument that assesses the degree of strain experienced by women who juggle the roles of working professional, student, wife and mother. Cross-cultural validity is evinced by demonstrating the measurement invariance of the WRSI. Measurement invariance is the extent to which items of multi-item scales function in the same way across different samples of respondents. We assessed measurement invariance by comparing a sample of working women in Taiwan with a similar sample from the United States. Structural equation models (SEMs) were employed to determine the invariance of the WRSI and to estimate the unique validity variance of its items. This article also provides nurse-researchers with the necessary underlying measurement theory and illustrates how SEMs may be applied to assess cross-cultural validity of instruments used in nursing research. Overall performance of the WRSI was acceptable but our analysis showed that some items did not display invariance properties across samples. Item analysis is presented and recommendations for improving the instrument are discussed.

Review of Measures of Worksite Environmental and Policy Supports for Physical Activity and Healthy Eating

PubMed Central

Reeds, Dominic N.; van Bakergem, Margaret A.; Marx, Christine M.; Brownson, Ross C.; Pamulapati, Surya C.; Hoehner, Christine M.

2015-01-01

Introduction Obesity prevention strategies are needed that target multiple settings, including the worksite. The objective of this study was to assess the state of science concerning available measures of worksite environmental and policy supports for physical activity (PA) and healthy eating (HE). Methods We searched multiple databases for instruments used to assess worksite environments and policies. Two commonly cited instruments developed by state public health departments were also included. Studies that were published from 1991 through 2013 in peer-reviewed publications and gray literature that discussed the development or use of these instruments were analyzed. Instrument administration mode and measurement properties were documented. Items were classified by general health topic, 5 domains of general worksite strategy, and 19 subdomains of worksite strategy specific to PA or HE. Characteristics of worksite measures were described including measurement properties, length, and administration mode, as well as frequencies of items by domain and subdomain. Results Seventeen instruments met inclusion criteria (9 employee surveys, 5 manager surveys, 1 observational assessment, and 2 studies that used multiple administration modes). Fourteen instruments included reliability testing. More items were related to PA than HE. Most instruments (n = 10) lacked items in the internal social environment domain. The most common PA subdomains were exercise facilities and lockers/showers; the most common HE subdomain was healthy options/vending. Conclusion This review highlights gaps in measurement of the worksite social environment. The findings provide a useful resource for researchers and practitioners and should inform future instrument development. PMID:25950572

Review of measures of worksite environmental and policy supports for physical activity and healthy eating.

PubMed

Hipp, J Aaron; Reeds, Dominic N; van Bakergem, Margaret A; Marx, Christine M; Brownson, Ross C; Pamulapati, Surya C; Hoehner, Christine M

2015-05-07

Obesity prevention strategies are needed that target multiple settings, including the worksite. The objective of this study was to assess the state of science concerning available measures of worksite environmental and policy supports for physical activity (PA) and healthy eating (HE). We searched multiple databases for instruments used to assess worksite environments and policies. Two commonly cited instruments developed by state public health departments were also included. Studies that were published from 1991 through 2013 in peer-reviewed publications and gray literature that discussed the development or use of these instruments were analyzed. Instrument administration mode and measurement properties were documented. Items were classified by general health topic, 5 domains of general worksite strategy, and 19 subdomains of worksite strategy specific to PA or HE. Characteristics of worksite measures were described including measurement properties, length, and administration mode, as well as frequencies of items by domain and subdomain. Seventeen instruments met inclusion criteria (9 employee surveys, 5 manager surveys, 1 observational assessment, and 2 studies that used multiple administration modes). Fourteen instruments included reliability testing. More items were related to PA than HE. Most instruments (n = 10) lacked items in the internal social environment domain. The most common PA subdomains were exercise facilities and lockers/showers; the most common HE subdomain was healthy options/vending. This review highlights gaps in measurement of the worksite social environment. The findings provide a useful resource for researchers and practitioners and should inform future instrument development.

Development of an instrument to measure the quality of documented nursing diagnoses, interventions and outcomes: the Q-DIO.

PubMed

Müller-Staub, Maria; Lunney, Margaret; Odenbreit, Matthias; Needham, Ian; Lavin, Mary Ann; van Achterberg, Theo

2009-04-01

This paper aims to report the development stages of an audit instrument to assess standardised nursing language. Because research-based instruments were not available, the instrument Quality of documentation of nursing Diagnoses, Interventions and Outcomes (Q-DIO) was developed. Standardised nursing language such as nursing diagnoses, interventions and outcomes are being implemented worldwide and will be crucial for the electronic health record. The literature showed a lack of audit instruments to assess the quality of standardised nursing language in nursing documentation. A qualitative design was used for instrument development. Criteria were first derived from a theoretical framework and literature reviews. Second, the criteria were operationalized into items and eight experts assessed face and content validity of the Q-DIO. Criteria were developed and operationalized into 29 items. For each item, a three or five point scale was applied. The experts supported content validity and showed 88.25% agreement for the scores assigned to the 29 items of the Q-DIO. The Q-DIO provides a literature-based audit instrument for nursing documentation. The strength of Q-DIO is its ability to measure the quality of nursing diagnoses and related interventions and nursing-sensitive patient outcomes. Further testing of Q-DIO is recommended. Based on the results of this study, the Q-DIO provides an audit instrument to be used in clinical practice. Its criteria can set the stage for the electronic nursing documentation in electronic health records.

A hospital-based child protection programme evaluation instrument: a modified Delphi study.

PubMed

Wilson, Denise; Koziol-McLain, Jane; Garrett, Nick; Sharma, Pritika

2010-08-01

Refine instrument for auditing hospital-based child abuse and neglect violence intervention programmes prior to field-testing. A modified Delphi study to identify and rate items and domains indicative of an effective and quality child abuse and neglect intervention programme. Experts participated in four Delphi rounds: two surveys, a one-day workshop and the opportunity to comment on the penultimate instrument. New Zealand. Twenty-four experts in the field of care and protection of children. Items with panel agreement >or=85% and mean importance rating >or=4.0 (scale from 1 (not important) to 5 (very important)). There was high-level consensus on items across Rounds 1 and 2 (89% and 85%, respectively). In Round 3 an additional domain (safety and security) was agreed upon and cultural issues, alert systems for children at risk, and collaboration among primary care, community, non-government and government agencies were discussed. The final instrument included nine domains ('policies and procedures', 'safety and security', 'collaboration', 'cultural environment', 'training of providers', 'intervention services', 'documentation' 'evaluation' and 'physical environment') and 64 items. The refined instrument represents the hallmarks of an ideal child abuse and neglect programme given current knowledge and experience. The instrument enables rigorous evaluations of hospital-based child abuse and neglect intervention programmes for quality improvement and benchmarking with other programmes.

Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP)

PubMed Central

Bernhard, Gerda; Knibbe, Ronald A.; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

2015-01-01

Background Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs’ cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. Methods The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Results Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs’ cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension’s Cronbach’s α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. Conclusions The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs’ cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs’ cultural competence, and has the ability to distinguish between groups that are expected to differ in cultural competence. This instrument can foster professional development through systematic self-assessment and thus contributes to improve the quality of patient care. PMID:26641876

Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP).

PubMed

Bernhard, Gerda; Knibbe, Ronald A; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

2015-01-01

Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs' cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs' cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension's Cronbach's α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs' cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs' cultural competence, and has the ability to distinguish between groups that are expected to differ in cultural competence. This instrument can foster professional development through systematic self-assessment and thus contributes to improve the quality of patient care.

QUOTEchemo: a patient-centred instrument to measure quality of communication preceding chemotherapy treatment through the patient's eyes.

PubMed

van Weert, Julia C M; Jansen, Jesse; de Bruijn, Gert-Jan; Noordman, Janneke; van Dulmen, Sandra; Bensing, Jozien M

2009-11-01

Knowing patients' needs is a prerequisite to ensure high quality cancer care. This study describes the development and psychometric properties of a patient-centred instrument to measure needs and actual experiences with communication preceding chemotherapy treatment: QUOTE(chemo). QUOTE-questionnaires (Quality Of care Through the patients' Eyes) are widely used to gain insight into unmet needs, but no validated, standardised questionnaire combining patients' needs and experiences surrounding chemotherapy treatment is available yet. To evaluate the psychometric properties of the QUOTE(chemo), content validity, internal structure and convergent validity were investigated amongst 345 cancer patients, new to chemotherapy, from 10 different hospitals. Literature study, focus group discussions and a categorisation procedure of 67 relevant topics revealed seven main themes: Treatment-related information, Prognosis information, Rehabilitation information, Coping information, Interpersonal communication, Tailored communication and Affective communication. Confirmatory factor analysis using structural equation modelling indicated that the measurement model provided good fit to the data with factor loadings ranging from .43 to .77. The seven QUOTE(chemo) dimensions captured relevant issues of concern with good internal consistency (alpha .72-.92), satisfactory item-total correlations (.35-.79) and satisfactory convergent validity. Affective communication, Treatment-related information and Rehabilitation information were perceived most important by patients. The instrument also appeared to be able to determine which aspects need improvement to ensure high quality care. The highest need for improvement was found for communicating Prognosis information and Rehabilitation information and for Interpersonal communication. These findings provide preliminary evidence of the reliability and validity of the QUOTE(chemo) for use in cancer care surrounding chemotherapy treatment. Researchers and health care providers can use the instrument to measure patients' needs and experiences with communication to identify aspects that need improvement.

Analysis instrument test on mathematical power the material geometry of space flat side for grade 8

NASA Astrophysics Data System (ADS)

Kusmaryono, Imam; Suyitno, Hardi; Dwijanto, Karomah, Nur

2017-08-01

The main problem of research to determine the quality of test items on the material side of flat geometry to assess students' mathematical power. The method used is quantitative descriptive. The subjects were students of class 8 as many as 20 students. The object of research is the quality of test items in terms of the power of mathematics: validity, reliability, level of difficulty and power differentiator. Instrument mathematical power ratings are tested include: written tests and questionnaires about the disposition of mathematical power. Data were obtained from the field, in the form of test data on the material geometry of space flat side and questionnaires. The results of the test instrument to the reliability of the test item is influenced by many factors. Factors affecting the reliability of the instrument is the number of items, homogeneity test questions, the time required, the uniformity of conditions of the test taker, the homogeneity of the group, the variability problem, and motivation of the individual (person taking the test). Overall, the evaluation results of this study stated that the test instrument can be used as a tool to measure students' mathematical power.

ITEM SELECTION TECHNIQUES AND EVALUATION OF INSTRUCTIONAL OBJECTIVES.

ERIC Educational Resources Information Center

COX, RICHARD C.

THE VALIDITY OF AN EDUCATIONAL ACHIEVEMENT TEST DEPENDS UPON THE CORRESPONDENCE BETWEEN SPECIFIED EDUCATIONAL OBJECTIVES AND THE EXTENT TO WHICH THESE OBJECTIVES ARE MEASURED BY THE EVALUATION INSTRUMENT. THIS STUDY IS DESIGNED TO EVALUATE THE EFFECT OF STATISTICAL ITEM SELECTION ON THE STRUCTURE OF THE FINAL EVALUATION INSTRUMENT AS COMPARED WITH…

Evaluation of the Clinical LOINC (Logical Observation Identifiers, Names, and Codes) Semantic Structure as a Terminology Model for Standardized Assessment Measures

PubMed Central

Bakken, Suzanne; Cimino, James J.; Haskell, Robert; Kukafka, Rita; Matsumoto, Cindi; Chan, Garrett K.; Huff, Stanley M.

2000-01-01

Objective: The purpose of this study was to test the adequacy of the Clinical LOINC (Logical Observation Identifiers, Names, and Codes) semantic structure as a terminology model for standardized assessment measures. Methods: After extension of the definitions, 1,096 items from 35 standardized assessment instruments were dissected into the elements of the Clinical LOINC semantic structure. An additional coder dissected at least one randomly selected item from each instrument. When multiple scale types occurred in a single instrument, a second coder dissected one randomly selected item representative of each scale type. Results: The results support the adequacy of the Clinical LOINC semantic structure as a terminology model for standardized assessments. Using the revised definitions, the coders were able to dissect into the elements of Clinical LOINC all the standardized assessment items in the sample instruments. Percentage agreement for each element was as follows: component, 100 percent; property, 87.8 percent; timing, 82.9 percent; system/sample, 100 percent; scale, 92.6 percent; and method, 97.6 percent. Discussion: This evaluation was an initial step toward the representation of standardized assessment items in a manner that facilitates data sharing and re-use. Further clarification of the definitions, especially those related to time and property, is required to improve inter-rater reliability and to harmonize the representations with similar items already in LOINC. PMID:11062226

Development and initial evaluation of an instrument to assess physiotherapists' clinical reasoning focused on clients' behavior change.

PubMed

Elvén, Maria; Hochwälder, Jacek; Dean, Elizabeth; Söderlund, Anne

2018-05-01

A systematically developed and evaluated instrument is needed to support investigations of physiotherapists' clinical reasoning integrated with the process of clients' behavior change. This study's aim was to develop an instrument to assess physiotherapy students' and physiotherapists' clinical reasoning focused on clients' activity-related behavior and behavior change, and initiate its evaluation, including feasibility and content validity. The study was conducted in three phases: 1) determination of instrument structure and item generation, based on a model, guidelines for assessing clinical reasoning, and existing measures; 2) cognitive interviews with five physiotherapy students to evaluate item understanding and feasibility; and 3) a Delphi process with 18 experts to evaluate content relevance. Phase 1 resulted in an instrument with four domains: Physiotherapist; Input from client; Functional behavioral analysis; and Strategies for behavior change. The instrument consists of case scenarios followed by items in which key features are identified, prioritized, or interpreted. Phase 2 resulted in revisions of problems and approval of feasibility. Phase 3 demonstrated high level of consensus regarding the instrument's content relevance. This feasible and content-validated instrument shows potential for use in investigations of physiotherapy students' and physiotherapists' clinical reasoning, however continued development and testing are needed.

Moderators of the Tailored Adaptive Personality Assessment System Validity

DTIC Science & Technology

2017-07-01

unmotivated responding. It is possible that some individuals do not honestly “do their best” as they answer TAPAS items or attempt to “ game ” TAPAS and employ...they answer TAPAS items or attempt to “ game ” TAPAS and employ a response strategy that leads to invalid and misleading scores. As a result of such...that some individuals do not "do their best." Unmotivated responding or other attempts to “ game the system” could produce misleading scores and have

Acceptability and feasibility of a culturally tailored Internet-delivered intervention to promote blood donation in Blacks.

PubMed

Robbins, Mark L; Paiva, Andrea L; Amoyal, Nicole R; Brick, Leslie; Kessler, Debra A; Burditt, Caitlin; Caltabiano, Melinda; Shaz, Beth H

2015-03-01

A pilot test of a computer-tailored intervention designed to promote blood donation among Blacks was conducted. Intervention content, based on the transtheoretical model, offered participants individually and culturally tailored information on blood donation with emphasis on need specific to race (e.g., sickle-cell disease). Black adults (N = 150) with a diversity of blood donation experience were recruited from a blood center and a survey recruitment website. Posttest assessment included a 14-item evaluation and transtheoretical model questions. Participants rated the program positively (81.3% to 98.7% of participants agreeing or strongly agreeing with evaluation items). For example, 98.7% of respondents reported that the program gave sound advice and that personal feedback was easily understood, and 87.3% felt the program was designed for people like themselves. Ninety-five percent of participants reported that they would recommend the program to others. There were no significant differences in ratings based on demographics. Qualitative responses support program acceptability. Furthermore, pre- and postprogram assessments indicated an increase in intention to donate, t(149) = 3.56, p = .001, d = .29. With acceptability and feasibility confirmed, the next steps are to test efficacy and cost-effectiveness for use to increase blood donation, particularly in priority populations. © 2014 Society for Public Health Education.

Development of a 12-item short version of the HIV stigma scale.

PubMed

Reinius, Maria; Wettergren, Lena; Wiklander, Maria; Svedhem, Veronica; Ekström, Anna Mia; Eriksson, Lars E

2017-05-30

Valid and reliable instruments for the measurement of enacted, anticipated and internalised stigma in people living with HIV are crucial for mapping trends in the prevalence of HIV-related stigma and tracking the effectiveness of stigma-reducing interventions. Although longer instruments exist, e.g., the commonly used 40-item HIV Stigma Scale by Berger et al., a shorter instrument would be preferable to facilitate the inclusion of HIV stigma in more and broader surveys. Therefore, the aim of this work was to develop a substantially shorter, but still valid, version of the HIV Stigma Scale. Data from a psychometric evaluation of the Swedish 40-item HIV Stigma Scale were reanalysed to create a short version with 12 items (three from each of the four stigma subscales: personalised stigma, disclosure concerns, concerns with public attitudes and negative self-image). The short version of the HIV stigma scale was then psychometrically tested using data from a national survey investigating stigma and quality of life among people living with HIV in Sweden (n = 880, mean age 47.9 years, 26% female). The hypothesized factor structure of the proposed short version was replicated in exploratory factor analysis without cross loadings and confirmatory factor analysis supported construct validity with high standardised effects (>0.7) of items on the intended scales. The χ 2 test was statistically significant (χ 2  = 154.2, df = 48, p < 0.001), but alternate fit measures indicated acceptable fit (comparative fit index: 0.963, Tucker-Lewis index: 0.950 and root mean square error of approximation: 0.071). Corrected item-total correlation coefficients were >0.4 for all items, with a variation indicating that the broadness of the concept of stigma had been captured. All but two aspects of HIV-related stigma that the instrument is intended to cover were captured by the selected items in the short version. The aspects that did not lose any items were judged to have acceptable psychometric properties. The short version of the instrument showed higher floor and ceiling effects than the full-length scale, indicating a loss of sensitivity in the short version. Cronbach's α for the subscales were all >0.7. Although being less sensitive in measurement, the proposed 12-item short version of the HIV Stigma Scale has comparable psychometric properties to the full-length scale and may be used when a shorter instrument is needed.

Enhancing self-report assessment of PTSD: development of an item bank.

PubMed

Del Vecchio, Nicole; Elwy, A Rani; Smith, Eric; Bottonari, Kathryn A; Eisen, Susan V

2011-04-01

The authors report results of work to enhance self-report posttraumatic stress disorder (PTSD) assessment by developing an item bank for use in a computer-adapted test. Computer-adapted tests have great potential to decrease the burden of PTSD assessment and outcomes monitoring. The authors conducted a systematic literature review of PTSD instruments, created a database of items, performed qualitative review and readability analysis, and conducted cognitive interviews with veterans diagnosed with PTSD. The systematic review yielded 480 studies in which 41 PTSD instruments comprising 993 items met inclusion criteria. The final PTSD item bank includes 104 items representing each of the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV; American Psychiatric Association [APA], 1994), PTSD symptom clusters (reexperiencing, avoidance, and hyperarousal), and 3 additional subdomains (depersonalization, guilt, and sexual problems) that expanded the assessment item pool. Copyright © 2011 International Society for Traumatic Stress Studies.

Content comparison of occupation-based instruments in adult rheumatology and musculoskeletal rehabilitation based on the International Classification of Functioning, Disability and Health.

PubMed

Stamm, Tanja A; Cieza, Alarcos; Machold, Klaus P; Smolen, Josef S; Stucki, Gerold

2004-12-15

To compare the content of clinical, occupation-based instruments that are used in adult rheumatology and musculoskeletal rehabilitation in occupational therapy based on the International Classification of Functioning, Disability and Health (ICF). Clinical instruments of occupational performance and occupation in adult rehabilitation and rheumatology were identified in a literature search. All items of these instruments were linked to the ICF categories according to 10 linking rules. On the basis of the linking, the content of these instruments was compared and the relationship between the capacity and performance component explored. The following 7 instruments were identified: the Canadian Occupational Performance Measure, the Assessment of Motor and Process Skills, the Sequential Occupational Dexterity Assessment, the Jebson Taylor Hand Function Test, the Moberg Picking Up Test, the Button Test, and the Functional Dexterity Test. The items of the 7 instruments were linked to 53 different ICF categories. Five items could not be linked to the ICF. The areas covered by the 7 occupation-based instruments differ importantly: The main focus of all 7 instruments is on the ICF component activities and participation. Body functions are covered by 2 instruments. Two instruments were linked to 1 single ICF category only. Clinicians and researchers who need to select an occupation-based instrument must be aware of the areas that are covered by this instrument and the potential areas that are not covered at all.

Methods to Develop the Eye-tem Bank to Measure Ophthalmic Quality of Life.

PubMed

Khadka, Jyoti; Fenwick, Eva; Lamoureux, Ecosse; Pesudovs, Konrad

2016-12-01

There is an increasing demand for high-standard, comprehensive, and reliable patient-reported outcome (PRO) instruments in all the disciplines of health care including in ophthalmology and optometry. Over the past two decades, a plethora of PRO instruments have been developed to assess the impact of eye diseases and their treatments. Despite this large number of instruments, significant shortcomings exist for the measurement of ophthalmic quality of life (QoL). Most PRO instruments are short-form instruments designed for clinical use, but this limits their content coverage often poorly targeting any study population other than that which they were developed for. Also, existing instruments are static paper and pencil based and unable to be updated easily leading to outdated and irrelevant item content. Scores obtained from different PRO instruments may not be directly comparable. These shortcomings can be addressed using item banking implemented with computer-adaptive testing (CAT). Therefore, we designed a multicenter project (The Eye-tem Bank project) to develop and validate such PROs to enable comprehensive measurement of ophthalmic QoL in eye diseases. Development of the Eye-tem Bank follows four phases: Phase I, Content Development; Phase II, Pilot Testing and Item Calibration; Phase III, Validation; and Phase IV, Evaluation. This project will deliver technologically advanced comprehensive QoL PROs in the form of item banking implemented via a CAT system in eye diseases. Here, we present a detailed methodological framework of this project.

Instrument Formatting with Computer Data Entry in Mind.

ERIC Educational Resources Information Center

Boser, Judith A.; And Others

Different formats for four types of research items were studied for ease of computer data entry. The types were: (1) numeric response items; (2) individual multiple choice items; (3) multiple choice items with the same response items; and (4) card column indicator placement. Each of the 13 experienced staff members of a major university's Data…

The development of an instrument to assess chemistry perceptions

NASA Astrophysics Data System (ADS)

Wells, Raymond R.

The instrument, developed in this study, attempted to correct the deficiencies of previous instruments. Statements of belief and opinion can be validly included under the construct of chemistry perceptions. Further, statements that might be better characterized as science attitudes, math attitudes, or attitudes toward a specific course or program were not included. Eliminating statements of math anxiety and test anxiety insured that responses to statements of anxiety were perceptions of anxiety solely related to chemistry. The results of the expert judges' responses to the Validation of Proposed Perception Statements forms were detailed to establish construct and content validity. The nature of Likert scale construction and calculation of internal consistency also supported the validity of the instrument. A pilot Chemistry Perception Questionnaire (CPQ) was then constructed based on agreement of the appropriate subscale and mean importance of the perception statements. The pilot CPQ results were subjected to an item analysis based on three sets of statistics: the frequency of each response and the percentage of respondents making each response for each perception statement, the mean and standard deviations for each item, and the item discrimination index which correlated the item scores with the subscale scores. With no zero or negative correlations to the subscale scores, it was not necessary to replace any of the perception statements contained in the pilot instrument. Therefore, the piloted Chemistry Perception Questionnaire became the final instrument. Factor analysis confirmed the multidimensionality of the instrument. The instrument was administered twice with a separation interval of approximately one month in order to perform a test-retest reliability analysis. One hundred and forty-one pairs were matched and results detailed. The correlation between forms, for the total instrument, was 0.9342. The mean coefficient alpha, for the total instrument, was 0.9495. With test-retest correlations and alphas exceeding 0.70 for all seven subscales and the total instrument, it was determined that the Chemistry Perception Questionnaire instrument achieved reasonably high reliability estimations.

Partnering with patients using social media to develop a hypertension management instrument.

PubMed

Kear, Tamara; Harrington, Magdalena; Bhattacharya, Anand

2015-09-01

Hypertension is a lifelong condition; thus, long-term adherence to lifestyle modification, self-monitoring, and medication regimens remains a challenge for patients. The aim of this study was to develop a patient-reported hypertension instrument that measured attitudes, lifestyle behaviors, adherence, and barriers to hypertension management using patient-reported outcome data. The study was conducted using the Open Research Exchange software platform created by PatientsLikeMe. A total of 360 participants completed the psychometric phase of the study; incomplete responses were obtained from 147 patients, and 150 patients opted out. Principal component analysis with orthogonal (varimax) rotation was executed on a data set with all completed responses (N = 249) and applied to 43 items. Based on the review of the factor solution, eigenvalues, and item loadings, 16 items were eliminated and model with 29 items was tested. The process was repeated two more times until final model with 14 items was established. In interpreting the rotated factor pattern, an item was said to load on any given component if the factor loading was ≥0.40 for that component and was <0.40 for the other. In addition to the newly generated instrument, demographic and self-reported clinical characteristics of the study participants such as the type of prescribed hypertension medications, frequency of blood pressure monitoring, and comorbid conditions were examined. The Open Research Exchange platform allowed for ongoing input from patients through each stage of the 14-item instrument development. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

Expectations for Visual Function: An Initial Evaluation of a New Clinical Instrument.

ERIC Educational Resources Information Center

Corn, Anne L.; Webne, Steve L.

2001-01-01

A study explored the internal consistency of items in a visual screening instrument developed by Project PAVE: Expectations for Visual Functioning (EVF). The test includes 20 items that evaluate a child's functional use of vision. A pilot test involving 129 teachers indicates the EFV is internally consistent. (Contains three references.) (CR)

Identifying Promising Items: The Use of Crowdsourcing in the Development of Assessment Instruments

ERIC Educational Resources Information Center

Sadler, Philip M.; Sonnert, Gerhard; Coyle, Harold P.; Miller, Kelly A.

2016-01-01

The psychometrically sound development of assessment instruments requires pilot testing of candidate items as a first step in gauging their quality, typically a time-consuming and costly effort. Crowdsourcing offers the opportunity for gathering data much more quickly and inexpensively than from most targeted populations. In a simulation of a…

Concurrent validation of CHIRP, a new instrument for measuring healthcare student attitudes towards interdisciplinary teamwork.

PubMed

Hollar, David; Hobgood, Cherri; Foster, Beverly; Aleman, Marco; Sawning, Susan

2012-01-01

Positive attitudes towards teamwork among health care professionals are critical to patient safety. The purpose of this study is to describe the development and concurrent validation of a new instrument to measure attitudes towards healthcare teamwork that is generalizable across various populations of healthcare students. The Collaborative Healthcare Interdisciplinary Planning (CHIRP) scale was validated against the Readiness for Inter-Professional Learning Scale (RIPLS). Analyses included student (n = 266) demographics, ANOVA, internal consistency, factor analysis, and Rasch analysis. The two instruments correlated at r = .582. The CHIRP showed a multifactorial structure having excellent internal consistency (alpha = .850), with 25 of the 36 scale items loading onto a single Teamwork Attitudes factor. The RIPLS likewise had strong internal consistency (alpha = .796) and a three-factor structure, supporting previous studies of the instrument. However, Rasch analyses showed 14 (38.9%) of the 36 CHIRP items, but only four (21.1%) of the 19 RIPLS items remaining within the satisfactory standardized OUTFIT zone of 2.0 standard deviation units. We propose the 14 fitting items as a new, validated teamwork attitudes scale.

SEQUenCE: a service user-centred quality of care instrument for mental health services.

PubMed

Hester, Lorraine; O'Doherty, Lorna Jane; Schnittger, Rebecca; Skelly, Niamh; O'Donnell, Muireann; Butterly, Lisa; Browne, Robert; Frorath, Charlotte; Morgan, Craig; McLoughlin, Declan M; Fearon, Paul

2015-08-01

To develop a quality of care instrument that is grounded in the service user perspective and validate it in a mental health service. The instrument (SEQUenCE (SErvice user QUality of CarE)) was developed through analysis of focus group data and clinical practice guidelines, and refined through field-testing and psychometric analyses. All participants were attending an independent mental health service in Ireland. Participants had a diagnosis of bipolar affective disorder (BPAD) or a psychotic disorder. Twenty-nine service users participated in six focus group interviews. Seventy-one service users participated in field-testing: 10 judged the face validity of an initial 61-item instrument; 28 completed a revised 52-item instrument from which 12 items were removed following test-retest and convergent validity analyses; 33 completed the resulting 40-item instrument. Test-retest reliability, internal consistency and convergent validity of the instrument. The final instrument showed acceptable test-retest reliability at 5-7 days (r = 0.65; P < 0.001), good convergent validity with the Verona Service Satisfaction Scale (r = 0.84, P < 0.001) and good internal consistency (Cronbach's alpha = 0.87). SEQUenCE is a valid, reliable scale that is grounded in the service user perspective and suitable for routine use. It may serve as a useful tool in individual care planning, service evaluation and research. The instrument was developed and validated with service users with a diagnosis of either BPAD or a psychotic disorder; it does not yet have established external validity for other diagnostic groups. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Construct Validation of the Self-Efficacy Teaching and Knowledge Instrument for Science Teachers-Revised (SETAKIST-R): Lessons Learned

NASA Astrophysics Data System (ADS)

Pruski, Linda A.; Blanco, Sharon L.; Riggs, Rosemary A.; Grimes, Kandi K.; Fordtran, Chase W.; Barbola, Gina M.; Cornell, John E.; Lichtenstein, Michael J.

2013-11-01

Described herein is the academic lineage and independent validation of the Self-Efficacy Teaching and Knowledge Instrument for Science Teachers-Revised (SETAKIST-R). Data from 334 K-12 science teachers were analyzed using Partial Credit Rasch models. Principal components analysis on the person-item residuals suggest two latent dimensions: Knowledge and Teaching Self-Efficacies. Item-fit statistics were used to select items for each subscale. Person and item separation (reliability) indices were quite low, and we noted disordered response patterns on the person-item maps that revealed problems with item content and/or scaling for both subscales. These issues include the presence of: verbal negatives, ambiguous modifiers, counter-intuitive scaling, and an "undecided/uncertain" option. The SETAKIST-R, in its current form, cannot be recommended as a measure of science teacher self-efficacy.

The PROactive instruments to measure physical activity in patients with chronic obstructive pulmonary disease

PubMed Central

Gimeno-Santos, Elena; Raste, Yogini; Demeyer, Heleen; Louvaris, Zafeiris; de Jong, Corina; Rabinovich, Roberto A.; Hopkinson, Nicholas S.; Polkey, Michael I.; Vogiatzis, Ioannis; Tabberer, Maggie; Dobbels, Fabienne; Ivanoff, Nathalie; de Boer, Willem I.; van der Molen, Thys; Kulich, Karoly; Serra, Ignasi; Basagaña, Xavier; Troosters, Thierry; Puhan, Milo A.; Karlsson, Niklas

2015-01-01

No current patient-centred instrument captures all dimensions of physical activity in chronic obstructive pulmonary disease (COPD). Our objective was item reduction and initial validation of two instruments to measure physical activity in COPD. Physical activity was assessed in a 6-week, randomised, two-way cross-over, multicentre study using PROactive draft questionnaires (daily and clinical visit versions) and two activity monitors. Item reduction followed an iterative process including classical and Rasch model analyses, and input from patients and clinical experts. 236 COPD patients from five European centres were included. Results indicated the concept of physical activity in COPD had two domains, labelled “amount” and “difficulty”. After item reduction, the daily PROactive instrument comprised nine items and the clinical visit contained 14. Both demonstrated good model fit (person separation index >0.7). Confirmatory factor analysis supported the bidimensional structure. Both instruments had good internal consistency (Cronbach's α>0.8), test–retest reliability (intraclass correlation coefficient ≥0.9) and exhibited moderate-to-high correlations (r>0.6) with related constructs and very low correlations (r<0.3) with unrelated constructs, providing evidence for construct validity. Daily and clinical visit “PROactive physical activity in COPD” instruments are hybrid tools combining a short patient-reported outcome questionnaire and two activity monitor variables which provide simple, valid and reliable measures of physical activity in COPD patients. PMID:26022965

The PROactive instruments to measure physical activity in patients with chronic obstructive pulmonary disease.

PubMed

Gimeno-Santos, Elena; Raste, Yogini; Demeyer, Heleen; Louvaris, Zafeiris; de Jong, Corina; Rabinovich, Roberto A; Hopkinson, Nicholas S; Polkey, Michael I; Vogiatzis, Ioannis; Tabberer, Maggie; Dobbels, Fabienne; Ivanoff, Nathalie; de Boer, Willem I; van der Molen, Thys; Kulich, Karoly; Serra, Ignasi; Basagaña, Xavier; Troosters, Thierry; Puhan, Milo A; Karlsson, Niklas; Garcia-Aymerich, Judith

2015-10-01

No current patient-centred instrument captures all dimensions of physical activity in chronic obstructive pulmonary disease (COPD). Our objective was item reduction and initial validation of two instruments to measure physical activity in COPD.Physical activity was assessed in a 6-week, randomised, two-way cross-over, multicentre study using PROactive draft questionnaires (daily and clinical visit versions) and two activity monitors. Item reduction followed an iterative process including classical and Rasch model analyses, and input from patients and clinical experts.236 COPD patients from five European centres were included. Results indicated the concept of physical activity in COPD had two domains, labelled "amount" and "difficulty". After item reduction, the daily PROactive instrument comprised nine items and the clinical visit contained 14. Both demonstrated good model fit (person separation index >0.7). Confirmatory factor analysis supported the bidimensional structure. Both instruments had good internal consistency (Cronbach's α>0.8), test-retest reliability (intraclass correlation coefficient ≥0.9) and exhibited moderate-to-high correlations (r>0.6) with related constructs and very low correlations (r<0.3) with unrelated constructs, providing evidence for construct validity.Daily and clinical visit "PROactive physical activity in COPD" instruments are hybrid tools combining a short patient-reported outcome questionnaire and two activity monitor variables which provide simple, valid and reliable measures of physical activity in COPD patients. Copyright ©ERS 2015.

Development of the multiple sclerosis (MS) early mobility impairment questionnaire (EMIQ).

PubMed

Ziemssen, Tjalf; Phillips, Glenn; Shah, Ruchit; Mathias, Adam; Foley, Catherine; Coon, Cheryl; Sen, Rohini; Lee, Andrew; Agarwal, Sonalee

2016-10-01

The Early Mobility Impairment Questionnaire (EMIQ) was developed to facilitate early identification of mobility impairments in multiple sclerosis (MS) patients. We describe the initial development of the EMIQ with a focus on the psychometric evaluation of the questionnaire using classical and item response theory methods. The initial 20-item EMIQ was constructed by clinical specialists and qualitatively tested among people with MS and physicians via cognitive interviews. Data from an observational study was used to make additional updates to the instrument based on exploratory factor analysis (EFA) and item response theory (IRT) analysis, and psychometric analyses were performed to evaluate the reliability and validity of the final instrument's scores and screening properties (i.e., sensitivity and specificity). Based on qualitative interview analyses, a revised 15-item EMIQ was included in the observational study. EFA, IRT and item-to-item correlation analyses revealed redundant items which were removed leading to the final nine-item EMIQ. The nine-item EMIQ performed well with respect to: test-retest reliability (ICC = 0.858); internal consistency (α = 0.893); convergent validity; and known-groups methods for construct validity. A cut-point of 41 on the 0-to-100 scale resulted in sufficient sensitivity and specificity statistics for viably identifying patients with mobility impairment. The EMIQ is a content valid and psychometrically sound instrument for capturing MS patients' experience with mobility impairments in a clinical practice setting. Additional research is suggested to further confirm the EMIQ's screening properties over time.

Development of ACLEEM questionnaire, an instrument measuring residents' educational environment in postgraduate ambulatory setting.

PubMed

Riquelme, Arnoldo; Padilla, Oslando; Herrera, Cristian; Olivos, Trinidad; Román, José Antonio; Sarfatis, Alberto; Solís, Nancy; Pizarro, Margarita; Torres, Patricio; Roff, Sue

2013-01-01

Students' perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. Postgraduate EE has been measured in hospital settings. However, there are no instruments available to measure the EE in postgraduate ambulatory settings. The aim of this study was to develop the "ambulatory care learning education environment measure" (ACLEEM). A mixed methodology was used including three stages: (1) Grounded theory (focus groups); (2) Delphi technique to identify consensus; and (3) Pilot study. Three quota samples of approximately 60 stakeholders were formed, one as focus groups and two as Delphi panels. Eight focus groups were carried out including 58 residents (Latin-American Spanish speakers). The results were analysed and 173 items were offered to a National Delphi panel (61 residents and teachers). They reduced in two rounds the number of important items to 54. The 54-item questionnaire was then piloted with 63 residents and refined to the final version of the ACLEEM with 50 items and three domains. The 50-item inventory is a valid instrument to measure the EE in postgraduate ambulatory setting in Chile. Large-scale administration of the ACLEEM questionnaire to evaluate its construct validity and reliability are the next steps to test the psychometric properties of the instrument.

Reliability and One-Year Stability of the PIN3 Neighborhood Environmental Audit in Urban and Rural Neighborhoods.

PubMed

Porter, Anna K; Wen, Fang; Herring, Amy H; Rodríguez, Daniel A; Messer, Lynne C; Laraia, Barbara A; Evenson, Kelly R

2018-06-01

Reliable and stable environmental audit instruments are needed to successfully identify the physical and social attributes that may influence physical activity. This study described the reliability and stability of the PIN3 environmental audit instrument in both urban and rural neighborhoods. Four randomly sampled road segments in and around a one-quarter mile buffer of participants' residences from the Pregnancy, Infection, and Nutrition (PIN3) study were rated twice, approximately 2 weeks apart. One year later, 253 of the year 1 sampled roads were re-audited. The instrument included 43 measures that resulted in 73 item scores for calculation of percent overall agreement, kappa statistics, and log-linear models. For same-day reliability, 81% of items had moderate to outstanding kappa statistics (kappas ≥ 0.4). Two-week reliability was slightly lower, with 77% of items having moderate to outstanding agreement using kappa statistics. One-year stability had 68% of items showing moderate to outstanding agreement using kappa statistics. The reliability of the audit measures was largely consistent when comparing urban to rural locations, with only 8% of items exhibiting significant differences (α < 0.05) by urbanicity. The PIN3 instrument is a reliable and stable audit tool for studies assessing neighborhood attributes in urban and rural environments.

Developing a short version of the Toronto Structured Interview for Alexithymia using item response theory.

PubMed

Sekely, Angela; Taylor, Graeme J; Bagby, R Michael

2018-03-17

The Toronto Structured Interview for Alexithymia (TSIA) was developed to provide a structured interview method for assessing alexithymia. One drawback of this instrument is the amount of time it takes to administer and score. The current study used item response theory (IRT) methods to analyze data from a large heterogeneous multi-language sample (N = 842) to investigate whether a subset of items could be selected to create a short version of the instrument. Samejima's (1969) graded response model was used to fit the item responses. Items providing maximum information were retained in the short model, resulting in the elimination of 12-items from the original 24-items. Despite the 50% reduction in the number of items, 65.22% of the information was retained. Further studies are needed to validate the short version. A short version of the TSIA is potentially of practical value to clinicians and researchers with time constraints. Copyright © 2018. Published by Elsevier B.V.

[Development and reliability evaluation of an instrument to measure health-related quality of life in independent elderly].

PubMed

Lima, Maria José Barbosa de; Portela, Margareth Crisóstomo

2010-08-01

This study presents an instrument, the health-related quality of life (HRQOL) profile for independent elderly, to measure the health-related quality of life of the functionally independent elderly assisted in the outpatient setting, based on the adaptation of four validated scales: Short-Form Health Survey (SF-36), Duke-UNC Health Profile (DUHP), Sickness Impact Profile (SIP), and Nottingham Health Profile (NHP). The study also evaluates the instrument's reliability based on its use by two different observers with a 15-day interval. The instrument includes five dimensions (health perception, symptoms, physical function, psychological function, and social function) and 45 items. Reliability evaluation of the QUASI instrument was based on interviews with 142 elderly outpatients in the city of Rio de Janeiro, Brazil. Prevalence-adjusted kappa statistic was used to assess all 45 items. Correlation was also calculated between overall scores and scores on individual dimensions. In the reliability evaluation, 39 of the 45 items showed prevalence-adjusted kappa greater than 0.60.

Reliability and Validity of the Alcohol Short Index of Problems and a Newly Constructed Drug Short Index of Problems*

PubMed Central

Alterman, Arthur I.; Cacciola, John S.; Ivey, Megan A.; Lynch, Kevin G.

2009-01-01

Objective: This study evaluated the psychometric properties of the 15-item alcohol Short Index of Problems (SIP) instrument and those of a newly constructed 15-item drug Short Index of Problems (SIP-D) instrument in 277 newly entered substance-abuse patients. Method: The SIP is derived from the longer, 50-item Drinker Inventory of Consequences (DrInC), which was designed to assess adverse consequences of alcohol use. The SIP-D was constructed by substituting the term “drug use” for the term “drinking” in each SIP item. A 3-month recall interval was employed. Results: Factor analyses of each of the instruments revealed similar solutions, with only one main factor accounting for the majority of variance. Nonparametric item response theory methods produced the same finding. Internal consistency reliability estimates for the SIP and SIP-D total scores were .98 and .97, respectively. Concurrent validity was demonstrated by examining the correlations of the total scores for each of the instruments with the recent summary indexes of the newly revised Addiction Severity Index (ASI-Version 6): alcohol, drug, medical, economic, legal, family/social, and psychiatric problems. Conclusions: This study is the first to confirm the psychometric validity of the SIP when used as an independent instrument unembedded within the DrInC. The study also supports the use of the SIP-D as a brief measure of adverse consequences of drug use. The findings strongly support the unidimensional structure of both measures. PMID:19261243

Reliability and validity of the alcohol short index of problems and a newly constructed drug short index of problems.

PubMed

Alterman, Arthur I; Cacciola, John S; Ivey, Megan A; Habing, Brian; Lynch, Kevin G

2009-03-01

This study evaluated the psychometric properties of the 15-item alcohol Short Index of Problems (SIP) instrument and those of a newly constructed 15-item drug Short Index of Problems (SIP-D) instrument in 277 newly entered substance-abuse patients. The SIP is derived from the longer, 50-item Drinker Inventory of Consequences (DrInC), which was designed to assess adverse consequences of alcohol use. The SIP-D was constructed by substituting the term "drug use" for the term "drinking" in each SIP item. A 3-month recall interval was employed. Factor analyses of each of the instruments revealed similar solutions, with only one main factor accounting for the majority of variance. Nonparametric item response theory methods produced the same finding. Internal consistency reliability estimates for the SIP and SIP-D total scores were .98 and .97, respectively. Concurrent validity was demonstrated by examining the correlations of the total scores for each of the instruments with the recent summary indexes of the newly revised Addiction Severity Index (ASI-Version 6): alcohol, drug, medical, economic, legal, family/social, and psychiatric problems. This study is the first to confirm the psychometric validity of the SIP when used as an independent instrument unembedded within the DrInC. The study also supports the use of the SIP-D as a brief measure of adverse consequences of drug use. The findings strongly support the unidimensional structure of both measures.

Building the BIKE: Development and Testing of the Biotechnology Instrument for Knowledge Elicitation (BIKE)

NASA Astrophysics Data System (ADS)

Witzig, Stephen B.; Rebello, Carina M.; Siegel, Marcelle A.; Freyermuth, Sharyn K.; Izci, Kemal; McClure, Bruce

2014-10-01

Identifying students' conceptual scientific understanding is difficult if the appropriate tools are not available for educators. Concept inventories have become a popular tool to assess student understanding; however, traditionally, they are multiple choice tests. International science education standard documents advocate that assessments should be reform based, contain diverse question types, and should align with instructional approaches. To date, no instrument of this type targeting student conceptions in biotechnology has been developed. We report here the development, testing, and validation of a 35-item Biotechnology Instrument for Knowledge Elicitation (BIKE) that includes a mix of question types. The BIKE was designed to elicit student thinking and a variety of conceptual understandings, as opposed to testing closed-ended responses. The design phase contained nine steps including a literature search for content, student interviews, a pilot test, as well as expert review. Data from 175 students over two semesters, including 16 student interviews and six expert reviewers (professors from six different institutions), were used to validate the instrument. Cronbach's alpha on the pre/posttest was 0.664 and 0.668, respectively, indicating the BIKE has internal consistency. Cohen's kappa for inter-rater reliability among the 6,525 total items was 0.684 indicating substantial agreement among scorers. Item analysis demonstrated that the items were challenging, there was discrimination among the individual items, and there was alignment with research-based design principles for construct validity. This study provides a reliable and valid conceptual understanding instrument in the understudied area of biotechnology.

The development and validation of a questionnaire to measure the clinical learning environment for undergraduate dental students (DECLEI).

PubMed

Kossioni, A E; Lyrakos, G; Ntinalexi, I; Varela, R; Economu, I

2014-05-01

The aim of this study was to develop and validate according to psychometric standards a self-administered instrument to measure the students' self-perceptions of the undergraduate clinical dental environment (DECLEI). The initial questionnaire was developed using feedback from dental students, experts' opinion and an extensive literature review. Critical incident technique (CIT) analysis was used to generate items and identify domains. Thirty clinical dental students participated in a pilot validation that generated a 67-item questionnaire. To develop a shorter and more practical version of the instrument, DECLEI-67 was distributed to 153 clinical students at the University of Athens and its English version to 51 students from various dental schools, attending the 2012 European Dental Students Association meeting. This final procedure aimed to select items, identify subscales and measure internal consistency and discriminant validity. A total of 202 students returned the questionnaires (response rate 99%). The final instrument included 24 items divided into three subscales: (i) organisation and learning opportunities, (ii) professionalism and communication and (iii) satisfaction and commitment to the dental studies. Cronbach's α for the total questionnaire was 0.89. The interscale correlations ranged from 0.39 to 0.48. The instrument identified differences related to school of origin, age and duration of clinical experience. An interpretation of the scores (range 0–100) has been proposed. The 24-item DECLEI seemed to be a practical and valid instrument to measure a dental school's undergraduate clinical learning environment.

Development of a Computer-Adaptive Physical Function Instrument for Social Security Administration Disability Determination

PubMed Central

Ni, Pengsheng; McDonough, Christine M.; Jette, Alan M.; Bogusz, Kara; Marfeo, Elizabeth E.; Rasch, Elizabeth K.; Brandt, Diane E.; Meterko, Mark; Chan, Leighton

2014-01-01

Objectives To develop and test an instrument to assess physical function (PF) for Social Security Administration (SSA) disability programs, the SSA-PF. Item Response Theory (IRT) analyses were used to 1) create a calibrated item bank for each of the factors identified in prior factor analyses, 2) assess the fit of the items within each scale, 3) develop separate Computer-Adaptive Test (CAT) instruments for each scale, and 4) conduct initial psychometric testing. Design Cross-sectional data collection; IRT analyses; CAT simulation. Setting Telephone and internet survey. Participants Two samples: 1,017 SSA claimants, and 999 adults from the US general population. Interventions None. Main Outcome Measure Model fit statistics, correlation and reliability coefficients, Results IRT analyses resulted in five unidimensional SSA-PF scales: Changing & Maintaining Body Position, Whole Body Mobility, Upper Body Function, Upper Extremity Fine Motor, and Wheelchair Mobility for a total of 102 items. High CAT accuracy was demonstrated by strong correlations between simulated CAT scores and those from the full item banks. Comparing the simulated CATs to the full item banks, very little loss of reliability or precision was noted, except at the lower and upper ranges of each scale. No difference in response patterns by age or sex was noted. The distributions of claimant scores were shifted to the lower end of each scale compared to those of a sample of US adults. Conclusions The SSA-PF instrument contributes important new methodology for measuring the physical function of adults applying to the SSA disability programs. Initial evaluation revealed that the SSA-PF instrument achieved considerable breadth of coverage in each content domain and demonstrated noteworthy psychometric properties. PMID:23578594

A disease-specific quality of life instrument for non-alcoholic fatty liver disease and non-alcoholic steatohepatitis: CLDQ-NAFLD.

PubMed

Younossi, Zobair M; Stepanova, Maria; Henry, Linda; Racila, Andrei; Lam, Brian; Pham, Huong T; Hunt, Sharon

2017-08-01

Non-alcoholic fatty liver disease and non-alcoholic steatohepatitis are the most common causes of chronic liver disease with known negative impact on patients' health-related quality of life. Our aim was to validate a disease-specific health-related quality of life instrument useful for efficacy trials involving patients with non-alcoholic fatty liver disease and non-alcoholic steatohepatitis. From a long item selection questionnaire, we selected relevant items which, by factor analysis, were grouped into domains constituting Chronic Liver Disease Questionnaire-Non-Alcoholic Fatty Liver Disease version. The developed instrument was subjected to internal validity, test-retest reliability and construct validity assessment using standard methods. For development of the Chronic Liver Disease Questionnaire-Non-Alcoholic Fatty Liver Disease version instrument, a 75-item-long item selection questionnaire was administered to 25 patients with non-alcoholic fatty liver disease. After item reduction, factor analysis found that 98.7% of variance in the remaining items would be explained by six factors. Thus, the resulting Chronic Liver Disease Questionnaire-Non-Alcoholic Fatty Liver Disease version instrument had 36 items grouped into six domains: Abdominal Symptoms, Activity, Emotional, Fatigue, Systemic Symptoms, and Worry. The independent validation group included another 104 patients with non-alcoholic fatty liver disease. The Cronbach's alphas of 0.74-0.90 suggested good to excellent internal consistency of the domains. Furthermore, the presence of obesity and history of depression were discriminated best by Chronic Liver Disease Questionnaire-Non-Alcoholic Fatty Liver Disease version scores (P<.05). The domains' correlations with the most relevant domains of Short Form-36 exceeded 0.70. Test-retest reliability in a subgroup of patients (N=27) demonstrated no significant within-patient variability with multiple administrations (all median differences were zero, all P>.15, intraclass correlations .76-.88). The Chronic Liver Disease Questionnaire-Non-Alcoholic Fatty Liver Disease version is a disease-specific health-related quality of life instrument developed and validated using an established methodology and useful for clinical trials of non-alcoholic fatty liver disease. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

What Is Being Measured? A Comparison of Two Depressive Symptom Severity Instruments with a Depression Diagnosis in Low-Income High-Risk Mothers.

PubMed

Yang, Jenny; Martinez, Maria; Schwartz, Todd A; Beeber, Linda

2017-06-01

Adequate assessment of depressive symptomatology is a necessary step toward decreasing income-related mental health treatment inequity. No studies have focused on comparing instruments used to detect depression in women from low-income backgrounds who are mothers of young children-a period of increased risk for depressive symptoms. To address this gap, two commonly used instruments (Center for Epidemiologic Studies Depression Scale [CES-D] and Hamilton Rating Scale for Depression [Hamilton]) were compared with a depression diagnosis (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition [DSM-V]) in a sample (n = 251) of mothers from low-income backgrounds with children ranging from 1 to 54 months old. Diagnostic utility was examined in light of contextual factors associated with maternal depressive symptoms. In this sample, CES-D had better screening sensitivity and specificity than Hamilton. Our results suggest that Hamilton may underdiagnose cases of major depressive episodes (MDE) as defined by DSM-V among black and low-income mothers compared with CES-D. In addition, we identify items in CES-D, which do not contribute to alignment with DSM-V and are appropriate targets for future improvements. Our analysis identifies interpersonal relationships and mother's age as the primary risk factors, which differentiate between CES-D and Hamilton determinations versus MDE diagnosis. In addition, we find regional differences in CES-D and Hamilton. It is important to tailor the measure to the context, and a calibration sample should be considered for studies of sufficient size.

The development of a knowledge test of depression and its treatment for patients suffering from non-psychotic depression: a psychometric assessment

PubMed Central

Gabriel, Adel; Violato, Claudio

2009-01-01

Background To develop and psychometrically assess a multiple choice question (MCQ) instrument to test knowledge of depression and its treatments in patients suffering from depression. Methods A total of 63 depressed patients and twelve psychiatric experts participated. Based on empirical evidence from an extensive review, theoretical knowledge and in consultations with experts, 27-item MCQ knowledge of depression and its treatment test was constructed. Data collected from the psychiatry experts were used to assess evidence of content validity for the instrument. Results Cronbach's alpha of the instrument was 0.68, and there was an overall 87.8% agreement (items are highly relevant) between experts about the relevance of the MCQs to test patient knowledge on depression and its treatments. There was an overall satisfactory patients' performance on the MCQs with 78.7% correct answers. Results of an item analysis indicated that most items had adequate difficulties and discriminations. Conclusion There was adequate reliability and evidence for content and convergent validity for the instrument. Future research should employ a lager and more heterogeneous sample from both psychiatrist and community samples, than did the present study. Meanwhile, the present study has resulted in psychometrically tested instruments for measuring knowledge of depression and its treatment of depressed patients. PMID:19754944

Development of an instrument to measure the use of behaviors taught in the American Physical Therapy Association Clinical Instructor Education and Credentialing Program (APTA CIECP): a pilot study.

PubMed

Bridges, Patricia H; Carter, Vincent; Rehm, Stephanie; Tintl, Sara Bowers; Halperin, Rebecca; Kniesly, Elizabeth; Pelino, Soni

2013-01-01

Conduct a pilot study to establish the reliability and validity of a survey instrument that directly measures the objectives and content of the APTA CIECP; and measure the self-reported frequency of use of the behaviors taught in the APTA CIECP. Eighteen (18) APTA credentialed CIs. Develop a web-based survey consisting of 58 items representative of the behaviors taught in the APTA CIECP and 8 demographic characteristics. Establish the content validity and reliability of the survey instrument. Conduct a descriptive analysis of the frequency of self-reported use of the behaviors. The APTA Clinical Instructor Education Board (CIEB) reviewed the items and determined that the items matched the objectives and content of the APTA CIECP, thereby establishing content validity. Cronbach's alpha coefficients ranging from 0.79-0.90 confirmed the reliability. The overall mean for all items on a 1-6 scale was 4.81. The content validity and reliability of the survey instrument were established. The outcomes of this pilot study suggest that when measured by a valid and reliable instrument that is representative of the objectives and content of the CIECP, the behaviors taught in the CIECP are being applied in the clinical setting by APTA credentialed clinical instructors.

The Toronto outcome measure for craniofacial prosthetics: reliability and validity of a condition-specific quality-of-life instrument.

PubMed

Anderson, James D; Johnston, Dennis A; Haugh, Gil S; Kiat-Amnuay, Sudarat; Gettleman, Lawrence

2013-01-01

The purpose of this study was to refine the Toronto Outcome Measure for Craniofacial Prosthetics (TOMCP), present evidence for its reliability and validity, and use the instrument to explore differences in quality of life between prostheses made with chlorinated polyethylene (CPE) (experimental) and silicone (control). As part of a multicenter prospective controlled randomized double-blind single-crossover clinical trial of the two materials, the TOMCP was administered at the start and end of two 4-month study arms, during which 42 patients wore prostheses made from one material then the other. Reliability was assessed at the crossover. To determine validity of the TOMCP, the Linear Analogue Self-Assessment (LASA-12) and the Short-Form 8 (SF-8) were also administered with the TOMCP. The TOMCP was reduced by removing items that were unreliable, had poorly distributed answers, showed increased internal consistency after their removal, or were too highly correlated with more than one other item. The tests of reliability and validity were then repeated. Finally, the reduced instrument was used to test for differences in quality of life between prostheses made of the two materials. The item reduction tactics pared the 52-item instrument down to 27 items. The correlations of both TOMCP versions with the LASA-12 and the SF-8 were found to be statistically significant, providing evidence of the validity of the TOMCP. The instrument revealed significantly better quality of life with silicone rather than CPE prostheses. Both versions of the TOMCP were found to be reliable and valid. The instrument was able to show differences in quality of life between two materials.

Development of quality of life instrument for urban poor in the northeast of Thailand.

PubMed

Surit, Phrutthinun; Laohasiriwong, Wongsa; Sanchaisuriya, Pattara; Schelp, Frank Perter

2008-09-01

Measuring the quality of life is important for evaluation and prediction of life and social care needs. To evaluate Quality of Life (QOL) in an urban poor population in northeast of Thailand, the Urban Poor Quality of Life (UPQOL) instrument was developed To develop an initial instrument to measure urban poor QOL. The development was started with literature review and investigated in urban poor communities. The results were transformed into the items required to build a structured questionnaire. Five hundred twenty three subjects, representatives of urban poor, were selected to test this instrument. Descriptive statistics described feature of items and the samples, exploratory factor analysis conducted the items score, and confirmatory factor analysis conducted the construct validity. The result found that the UPQOL instrument consisted of nine domains (education, income and employment, environment, health, infrastructure, security and safety, shelter and housing, civil society and political, and human rights domains) with egien value rank from 1.5 to 4.2 and 61 items with the factor loading rank from 0.41 to 0.82. The internal consistency was 0.92. The correlation between items to domain ranged from 0.30 to 0.72 and domains to overall QOL ranged from 0.27 to 0.84. Confirmatory factor analysis showed that the structure fit all domains well. Domains and overall structure were good with CFI (> 0.95). The internal consistency value ranged from 0.73-0.93. UPQOL scores were able to discriminate groups of subjects with differences levels of QOL. The UPQOL instrument is conceptually valid. The results support good validity and reliability. It forms the basis for future testing and application in other settings.

Short version of the "instrument for assessment of stress in nursing students" in the Brazilian reality.

PubMed

Costa, Ana Lúcia Siqueira; Silva, Rodrigo Marques da; Mussi, Fernanda Carneiro; Serrano, Patrícia Maria; Graziano, Eliane da Silva; Batista, Karla de Melo

2018-01-08

validate a short version of the Instrument for assessment of stress in nursing students in the Brazilian reality. Methodological study conducted with 1047 nursing students from five Brazilian institutions, who answered the 30 items initially distributed in eight domains. Data were analyzed in the R Statistical Package and in the latent variable analysis, using exploratory and confirmatory factor analyses, Cronbach's alpha and item-total correlation. The short version of the instrument had 19 items distributed into four domains: Environment, Professional Training, Theoretical Activities and Performance of Practical Activities. The confirmatory analysis showed absolute and parsimony fit to the proposed model with satisfactory residual levels. Alpha values ​​per factor ranged from 0.736 (Environment) to 0.842 (Performance of Practical Activities). The short version of the instrument has construct validity and reliability for application to Brazilian nursing undergraduates at any stage of the course.

Quality of prenatal care questionnaire: instrument development and testing.

PubMed

Heaman, Maureen I; Sword, Wendy A; Akhtar-Danesh, Noori; Bradford, Amanda; Tough, Suzanne; Janssen, Patricia A; Young, David C; Kingston, Dawn A; Hutton, Eileen K; Helewa, Michael E

2014-06-03

Utilization indices exist to measure quantity of prenatal care, but currently there is no published instrument to assess quality of prenatal care. The purpose of this study was to develop and test a new instrument, the Quality of Prenatal Care Questionnaire (QPCQ). Data for this instrument development study were collected in five Canadian cities. Items for the QPCQ were generated through interviews with 40 pregnant women and 40 health care providers and a review of prenatal care guidelines, followed by assessment of content validity and rating of importance of items. The preliminary 100-item QPCQ was administered to 422 postpartum women to conduct item reduction using exploratory factor analysis. The final 46-item version of the QPCQ was then administered to another 422 postpartum women to establish its construct validity, and internal consistency and test-retest reliability. Exploratory factor analysis reduced the QPCQ to 46 items, factored into 6 subscales, which subsequently were validated by confirmatory factor analysis. Construct validity was also demonstrated using a hypothesis testing approach; there was a significant positive association between women's ratings of the quality of prenatal care and their satisfaction with care (r = 0.81). Convergent validity was demonstrated by a significant positive correlation (r = 0.63) between the "Support and Respect" subscale of the QPCQ and the "Respectfulness/Emotional Support" subscale of the Prenatal Interpersonal Processes of Care instrument. The overall QPCQ had acceptable internal consistency reliability (Cronbach's alpha = 0.96), as did each of the subscales. The test-retest reliability result (Intra-class correlation coefficient = 0.88) indicated stability of the instrument on repeat administration approximately one week later. Temporal stability testing confirmed that women's ratings of their quality of prenatal care did not change as a result of giving birth or between the early postpartum period and 4 to 6 weeks postpartum. The QPCQ is a valid and reliable instrument that will be useful in future research as an outcome measure to compare quality of care across geographic regions, populations, and service delivery models, and to assess the relationship between quality of care and maternal and infant health outcomes.

Conceptualizing Interprofessional Teams as Multi-Team Systems-Implications for Assessment and Training.

PubMed

West, Courtney; Landry, Karen; Graham, Anna; Graham, Lori; Cianciolo, Anna T; Kalet, Adina; Rosen, Michael; Sherman, Deborah Witt

2015-01-01

SGEA 2015 CONFERENCE ABSTRACT (EDITED). Evaluating Interprofessional Teamwork During a Large-Scale Simulation. Courtney West, Karen Landry, Anna Graham, and Lori Graham. CONSTRUCT: This study investigated the multidimensional measurement of interprofessional (IPE) teamwork as part of large-scale simulation training. Healthcare team function has a direct impact on patient safety and quality of care. However, IPE team training has not been the norm. Recognizing the importance of developing team-based collaborative care, our College of Nursing implemented an IPE simulation activity called Disaster Day and invited other professions to participate. The exercise consists of two sessions: one in the morning and another in the afternoon. The disaster scenario is announced just prior to each session, which consists of team building, a 90-minute simulation, and debriefing. Approximately 300 Nursing, Medicine, Pharmacy, Emergency Medical Technicians, and Radiology students and over 500 standardized and volunteer patients participated in the Disaster Day event. To improve student learning outcomes, we created 3 competency-based instruments to evaluate collaborative practice in multidimensional fashion during this exercise. A 20-item IPE Team Observation Instrument designed to assess interprofessional team's attainment of Interprofessional Education Collaborative (IPEC) competencies was completed by 20 faculty and staff observing the Disaster Day simulation. One hundred sixty-six standardized patients completed a 10-item Standardized Patient IPE Team Evaluation Instrument developed from the IPEC competencies and adapted items from the 2014 Henry et al. PIVOT Questionnaire. This instrument assessed the standardized or volunteer patient's perception of the team's collaborative performance. A 29-item IPE Team's Perception of Collaborative Care Questionnaire, also created from the IPEC competencies and divided into 5 categories of Values/Ethics, Roles and Responsibilities, Communication, Teamwork, and Self-Evaluation, was completed by 188 students including 99 from Nursing, 43 from Medicine, 6 from Pharmacy, and 40 participants who belonged to more than one component, were students at another institution, or did not indicate their institution. The team instrument was designed to assess each team member's perception of how well the team and him- or herself met the competencies. Five of the items on the team perceptions questionnaire mirrored items on the standardized patient evaluation: demonstrated leadership practices that led to effective teamwork, discussed care and decisions about that care with patient, described roles and responsibilities clearly, worked well together to coordinate care, and good/effective communication. Internal consistency reliability of the IPE Team Observation Instrument was 0.80. In 18 of the 20 items, more than 50% of observers indicated the item was demonstrated. Of those, 6 of the items were observed by 50% to 75% of the observers, and the remaining 12 were observed by more than 80% of the observers. Internal consistency reliability of the IPE Team's Perception of Collaborative Care Instrument was 0.95. The mean response score-1 (strongly disagree) to 4 (strongly agree)-was calculated for each section of the instrument. The overall mean score was 3.57 (SD = .11). Internal consistency reliability of the Standardized Patient IPE Team Evaluation Instrument was 0.87. The overall mean score was 3.28 (SD = .17). The ratings for the 5 items shared by the standardized patient and team perception instruments were compared using independent sample t tests. Statistically significant differences (p < .05) were present in each case, with the students rating themselves higher on average than the standardized patients did (mean differences between 0.2 and 0.6 on a scale of 1-4). Multidimensional, competency-based instruments appear to provide a robust view of IPE teamwork; however, challenges remain. Due to the large scale of the simulation exercise, observation-based assessment did not function as well as self- and standardized patient-based assessment. To promote greater variation in observer assessments during future Disaster Day simulations, we plan to adjust the rating scale from "not observed," "observed," and "not applicable" to a 4-point scale and reexamine interrater reliability.

Nursing Care Interpersonal Relationship Questionnaire: elaboration and validation.

PubMed

Borges, José Wicto Pereira; Moreira, Thereza Maria Magalhães; Andrade, Dalton Franscisco de

2018-01-08

to elaborate an instrument for the measurement of the interpersonal relationship in nursing care through the Item Response Theory, and the validation thereof. methodological study, which followed the three poles of psychometry: theoretical, empirical and analytical. The Nursing Care Interpersonal Relationship Questionnaire was developed in light of the Imogene King's Interpersonal Conceptual Model and the psychometric properties were studied through the Item Response Theory in a sample of 950 patients attended in Primary, Secondary and Tertiary Health Care. the final instrument consisted of 31 items, with Cronbach's alpha of 0.90 and McDonald's Omega of 0.92. The parameters of the Item Response Theory demonstrated high discrimination in 28 items, being developed a five-level interpretive scale. At the first level, the communication process begins, gaining a wealth of interaction. Subsequent levels demonstrate qualitatively the points of effectiveness of the interpersonal relationship with the involvement of behaviors related to the concepts of transaction and interaction, followed by the concept of role. the instrument was created and proved to be consistent to measure interpersonal relationship in nursing care, as it presented adequate reliability and validity parameters.

Rater reliability and concurrent validity of the Keyboard Personal Computer Style instrument (K-PeCS).

PubMed

Baker, Nancy A; Cook, James R; Redfern, Mark S

2009-01-01

This paper describes the inter-rater and intra-rater reliability, and the concurrent validity of an observational instrument, the Keyboard Personal Computer Style instrument (K-PeCS), which assesses stereotypical postures and movements associated with computer keyboard use. Three trained raters independently rated the video clips of 45 computer keyboard users to ascertain inter-rater reliability, and then re-rated a sub-sample of 15 video clips to ascertain intra-rater reliability. Concurrent validity was assessed by comparing the ratings obtained using the K-PeCS to scores developed from a 3D motion analysis system. The overall K-PeCS had excellent reliability [inter-rater: intra-class correlation coefficients (ICC)=.90; intra-rater: ICC=.92]. Most individual items on the K-PeCS had from good to excellent reliability, although six items fell below ICC=.75. Those K-PeCS items that were assessed for concurrent validity compared favorably to the motion analysis data for all but two items. These results suggest that most items on the K-PeCS can be used to reliably document computer keyboarding style.

Development of a survey instrument to measure connectivity to evaluate national public health preparedness and response performance.

PubMed

Dorn, Barry C; Savoia, Elena; Testa, Marcia A; Stoto, Michael A; Marcus, Leonard J

2007-01-01

Survey instruments for evaluating public health preparedness have focused on measuring the structure and capacity of local, state, and federal agencies, rather than linkages among structure, process, and outcomes. To focus evaluation on the latter, we evaluated the linkages among individuals, organizations, and systems using the construct of "connectivity" and developed a measurement instrument. Results from focus groups of emergency preparedness first responders generated 62 items used in the development sample of 187 respondents. Item reduction and factors analyses were conducted to confirm the scale's components. The 62 items were reduced to 28. Five scales explained 70% of the total variance (number of items, percent variance explained, Cronbach's alpha) including connectivity with the system (8, 45%, 0.94), coworkers (7, 7%, 0.91), organization (7, 12%, 0.93), and perceptions (6, 6%, 0.90). Discriminant validity was found to be consistent with the factor structure. We developed a Connectivity Measurement Tool for the public health workforce consisting of a 34-item questionnaire found to be a reliable measure of connectivity with preliminary evidence of construct validity.

On Studying Common Factor Dominance and Approximate Unidimensionality in Multicomponent Measuring Instruments with Discrete Items

ERIC Educational Resources Information Center

Raykov, Tenko; Marcoulides, George A.

2018-01-01

This article outlines a procedure for examining the degree to which a common factor may be dominating additional factors in a multicomponent measuring instrument consisting of binary items. The procedure rests on an application of the latent variable modeling methodology and accounts for the discrete nature of the manifest indicators. The method…

A SEM Model in Assessing the Effect of Convergent, Divergent and Logical Thinking on Students' Understanding of Chemical Phenomena

ERIC Educational Resources Information Center

Stamovlasis, D.; Kypraios, N.; Papageorgiou, G.

2015-01-01

In this study, structural equation modeling (SEM) is applied to an instrument assessing students' understanding of chemical change. The instrument comprised items on understanding the structure of substances, chemical changes and their interpretation. The structural relationships among particular groups of items are investigated and analyzed using…

Providing mental health first aid in the workplace: a Delphi consensus study.

PubMed

Bovopoulos, Nataly; Jorm, Anthony F; Bond, Kathy S; LaMontagne, Anthony D; Reavley, Nicola J; Kelly, Claire M; Kitchener, Betty A; Martin, Angela

2016-08-02

Mental health problems are common in the workplace, but workers affected by such problems are not always well supported by managers and co-workers. Guidelines exist for the public on how to provide mental health first aid, but not specifically on how to tailor one's approach if the person of concern is a co-worker or employee. A Delphi consensus study was carried out to develop guidelines on additional considerations required when offering mental health first aid in a workplace context. A systematic search of websites, books and journal articles was conducted to develop a questionnaire with 246 items containing actions that someone may use to offer mental health first aid to a co-worker or employee. Three panels of experts from English-speaking countries were recruited (23 consumers, 26 managers and 38 workplace mental health professionals), who independently rated the items over three rounds for inclusion in the guidelines. The retention rate of the expert panellists across the three rounds was 61.7 %. Of the 246 items, 201 items were agreed to be important or very important by at least 80 % of panellists. These 201 endorsed items included actions on how to approach and offer support to a co-worker, and additional considerations where the person assisting is a supervisor or manager, or is assisting in crisis situations such as acute distress. The guidelines outline strategies for a worker to use when they are concerned about the mental health of a co-worker or employee. They will be used to inform future tailoring of Mental Health First Aid training when it is delivered in workplace settings and could influence organisational policies and procedures.

Using tailored methodical approaches to achieve optimal science outcomes

NASA Astrophysics Data System (ADS)

Wingate, Lory M.

2016-08-01

The science community is actively engaged in research, development, and construction of instrumentation projects that they anticipate will lead to new science discoveries. There appears to be very strong link between the quality of the activities used to complete these projects, and having a fully functioning science instrument that will facilitate these investigations.[2] The combination of using internationally recognized standards within the disciplines of project management (PM) and systems engineering (SE) has been demonstrated to lead to achievement of positive net effects and optimal project outcomes. Conversely, unstructured, poorly managed projects will lead to unpredictable, suboptimal project outcomes ultimately affecting the quality of the science that can be done with the new instruments. The proposed application of these two specific methodical approaches, implemented as a tailorable suite of processes, are presented in this paper. Project management (PM) is accepted worldwide as an effective methodology used to control project cost, schedule, and scope. Systems engineering (SE) is an accepted method that is used to ensure that the outcomes of a project match the intent of the stakeholders, or if they diverge, that the changes are understood, captured, and controlled. An appropriate application, or tailoring, of these disciplines can be the foundation upon which success in projects that support science can be optimized.

Efforts Toward the Development of Unbiased Selection and Assessment Instruments.

ERIC Educational Resources Information Center

Rudner, Lawrence M.

Investigations into item bias provide an empirical basis for the identification and elimination of test items which appear to measure different traits across populations or cultural groups. The Psychometric rationales for six approaches to the identification of biased test items are reviewed: (1) Transformed item difficulties: within-group…

12 CFR 210.2 - Definitions.

Code of Federal Regulations, 2014 CFR

2014-01-01

... OTHER ITEMS BY FEDERAL RESERVE BANKS AND FUNDS TRANSFERS THROUGH FEDWIRE (REGULATION J) Collection of... which the instrument is payable; and (ii) An electronic image of an item described in paragraph (i)(1)(i... this part. (j) Nonbank payor means a payor of an item, other than a bank. (k) Noncash item means an...

12 CFR 210.2 - Definitions.

Code of Federal Regulations, 2013 CFR

2013-01-01

... OTHER ITEMS BY FEDERAL RESERVE BANKS AND FUNDS TRANSFERS THROUGH FEDWIRE (REGULATION J) Collection of... which the instrument is payable; and (ii) An electronic image of an item described in paragraph (i)(1)(i... this part. (j) Nonbank payor means a payor of an item, other than a bank. (k) Noncash item means an...

The Spanish version of the Self-Determination Inventory Student Report: application of item response theory to self-determination measurement.

PubMed

Mumbardó-Adam, C; Guàrdia-Olmos, J; Giné, C; Raley, S K; Shogren, K A

2018-04-01

A new measure of self-determination, the Self-Determination Inventory: Student Report (Spanish version), has recently been adapted and empirically validated in Spanish language. As it is the first instrument intended to measure self-determination in youth with and without disabilities, there is a need to further explore and strengthen its psychometric analysis based on item response patterns. Through item response theory approach, this study examined item observed distributions across the essential characteristics of self-determination. The results demonstrated satisfactory to excellent item functioning patterns across characteristics, particularly within agentic action domains. Increased variability across items was also found within action-control beliefs dimensions, specifically within the self-realisation subdomain. These findings further support the instrument's psychometric properties and outline future research directions. © 2017 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Meta-analytic guidelines for evaluating single-item reliabilities of personality instruments.

PubMed

Spörrle, Matthias; Bekk, Magdalena

2014-06-01

Personality is an important predictor of various outcomes in many social science disciplines. However, when personality traits are not the principal focus of research, for example, in global comparative surveys, it is often not possible to assess them extensively. In this article, we first provide an overview of the advantages and challenges of single-item measures of personality, a rationale for their construction, and a summary of alternative ways of assessing their reliability. Second, using seven diverse samples (Ntotal = 4,263) we develop the SIMP-G, the German adaptation of the Single-Item Measures of Personality, an instrument assessing the Big Five with one item per trait, and evaluate its validity and reliability. Third, we integrate previous research and our data into a first meta-analysis of single-item reliabilities of personality measures, and provide researchers with guidelines and recommendations for the evaluation of single-item reliabilities. © The Author(s) 2013.

Instruments and Taxonomy of Workplace Bullying in Health Care Organizations.

PubMed

Park, Eun-Jun; Lee, Mikyoung; Park, Myungsook

2017-12-01

This study was aimed to evaluate the methodological issues and comprehensiveness of workplace bullying instruments and to suggest a taxonomy of psychological abuse. Nineteen instruments applied in health care organizations and 469 questionnaire items mainly regarding psychological abuse were collected through a literature review. Three researchers classified the questionnaire items according to a "taxonomy of psychological abuse in the workplace." Many instruments of workplace bullying were developed in the 2000s using a reflective measurement model, but their psychometric property was not sufficient and the measurement model is questioned. Based on the questionnaire items, the "taxonomy of psychological abuse in the workplace" was modified by adding two new subcategories (unachievable work and unfair treatment) and clarifying some operational definitions. According to the modified taxonomy of 11 (sub)categories, the reviewed instruments assessed 6.5 (sub)categories on average. No instrument measured all (sub)categories. Category 4.2 (disrespect, humiliation, and rejection of the person) was measured in all instruments, followed by Categories 5 (professional discredit and denigration) and 1.2 (social isolation) behaviors. The current instruments are not comprehensive enough. It is suggested that the modified taxonomy is verified and guide more reliable and inclusive instruments in the future. Furthermore, a formative measurement model, which defines a bullying as an inventory of different types of behaviors, should be used. Copyright © 2017. Published by Elsevier B.V.

The use of instrumented gait analysis for individually tailored interdisciplinary interventions in children with cerebral palsy: a randomised controlled trial protocol.

PubMed

Rasmussen, Helle Mätzke; Pedersen, Niels Wisbech; Overgaard, Søren; Hansen, Lars Kjaersgaard; Dunkhase-Heinl, Ulrike; Petkov, Yanko; Engell, Vilhelm; Baker, Richard; Holsgaard-Larsen, Anders

2015-12-07

Children with cerebral palsy (CP) often have an altered gait. Orthopaedic surgery, spasticity management, physical therapy and orthotics are used to improve the gait. Interventions are individually tailored and are planned on the basis of clinical examinations and standardised measurements to assess walking ('care as usual'). However, these measurements do not describe features in the gait that reflect underlying neuro-musculoskeletal impairments. This can be done with 3-dimensional instrumented gait analysis (IGA). The aim of this study is to test the hypothesis that improvements in gait following individually tailored interventions when IGA is used are superior to those following 'care as usual'. A prospective, single blind, randomised, parallel group study will be conducted. Children aged 5 to 8 years with spastic CP, classified at Gross Motor Function Classification System levels I or II, will be included. The interventions under investigation are: 1) individually tailored interdisciplinary interventions based on the use of IGA, and 2) 'care as usual'. The primary outcome is gait measured by the Gait Deviation Index. Secondary outcome measures are: walking performance (1-min walk test) and patient-reported outcomes of functional mobility (Pediatric Evaluation of Disability Inventory), health-related quality of life (The Pediatric Quality of Life Inventory Cerebral Palsy Module) and overall health, pain and participation (The Pediatric Outcome Data Collection Instrument). The primary endpoint for assessing the outcome of the two interventions will be 52 weeks after start of intervention. A follow up will also be performed at 26 weeks; however, exclusively for the patient-reported outcomes. To our knowledge, this is the first randomised controlled trial comparing the effects of an individually tailored interdisciplinary intervention based on the use of IGA versus 'care as usual' in children with CP. Consequently, the study will provide novel evidence for the use of IGA. ClinicalTrials.gov NCT02160457 . Registered June 2, 2014.

Development and initial validation of the Pharmacist Frequency of Interprofessional Collaboration Instrument (FICI-P) in primary care.

PubMed

Van, Connie; Costa, Daniel; Mitchell, Bernadette; Abbott, Penny; Krass, Ines

2012-01-01

Existing validated measures of pharmacist-physician collaboration focus on measuring attitudes toward collaboration and do not measure frequency of collaborative interactions. To develop and validate an instrument to measure the frequency of collaboration between pharmacists and general practitioners (GPs) from the pharmacist's perspective. An 11-item Pharmacist Frequency of Interprofessional Collaboration Instrument (FICI-P) was developed and administered to 586 pharmacists in 8 divisions of general practice in New South Wales, Australia. The initial items were informed by a review of the literature in addition to interviews of pharmacists and GPs. Items were subjected to principal component and Rasch analyses to determine each item's and the overall measure's psychometric properties and for any needed refinements. Two hundred and twenty four (38%) of pharmacist surveys were completed and returned. Principal component analysis suggested removal of 1 item for a final 1-factor solution. The refined 10-item FICI-P demonstrated internal consistency reliability at Cronbach's alpha=0.90. After collapsing the original 5-point response scale to a 4-point response scale, the refined FICI-P demonstrated fit to the Rasch model. Criterion validity of the FICI-P was supported by the correlation of FICI-P scores with scores on a previously validated Physician-Pharmacist Collaboration Instrument. Validity was also supported by predicted differences in FICI-P scores between subgroups of respondents stratified on age, colocation with GPs, and interactions during the intern-training period. The refined 10-item FICI-P was shown to have good internal consistency, criterion validity, and fit to the Rasch model. The creation of such a tool may allow for the measure of impact in the evaluation of interventions designed to improve interprofessional collaboration between GPs and pharmacists. Copyright © 2012 Elsevier Inc. All rights reserved.

Scale refinement and initial evaluation of a behavioral health function measurement tool for work disability evaluation.

PubMed

Marfeo, Elizabeth E; Ni, Pengsheng; Haley, Stephen M; Bogusz, Kara; Meterko, Mark; McDonough, Christine M; Chan, Leighton; Rasch, Elizabeth K; Brandt, Diane E; Jette, Alan M

2013-09-01

To use item response theory (IRT) data simulations to construct and perform initial psychometric testing of a newly developed instrument, the Social Security Administration Behavioral Health Function (SSA-BH) instrument, that aims to assess behavioral health functioning relevant to the context of work. Cross-sectional survey followed by IRT calibration data simulations. Community. Sample of individuals applying for Social Security Administration disability benefits: claimants (n=1015) and a normative comparative sample of U.S. adults (n=1000). None. SSA-BH measurement instrument. IRT analyses supported the unidimensionality of 4 SSA-BH scales: mood and emotions (35 items), self-efficacy (23 items), social interactions (6 items), and behavioral control (15 items). All SSA-BH scales demonstrated strong psychometric properties including reliability, accuracy, and breadth of coverage. High correlations of the simulated 5- or 10-item computer adaptive tests with the full item bank indicated robust ability of the computer adaptive testing approach to comprehensively characterize behavioral health function along 4 distinct dimensions. Initial testing and evaluation of the SSA-BH instrument demonstrated good accuracy, reliability, and content coverage along all 4 scales. Behavioral function profiles of Social Security Administration claimants were generated and compared with age- and sex-matched norms along 4 scales: mood and emotions, behavioral control, social interactions, and self-efficacy. Using the computer adaptive test-based approach offers the ability to collect standardized, comprehensive functional information about claimants in an efficient way, which may prove useful in the context of the Social Security Administration's work disability programs. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Development and evaluation of the EOL-ICDQ as a measure of experiences, attitudes and knowledge in end-of-life in patients living with an implantable cardioverter defibrillator.

PubMed

Thylén, Ingela; Wenemark, Marika; Fluur, Christina; Strömberg, Anna; Bolse, Kärstin; Årestedt, Kristofer

2014-04-01

Due to extended indications and resynchronization therapy, many implantable cardioverter defibrillator (ICD) recipients will experience progressive co-morbid conditions and will be more likely to die of causes other than cardiac death. It is therefore important to elucidate the ICD patients' preferences when nearing end-of-life. Instead of avoiding the subject of end-of-life, a validated questionnaire may be helpful to explore patients' experiences and attitudes about end-of-life concerns and to assess knowledge of the function of the ICD in end-of-life. Validated instruments assessing patients' perspective concerning end-of-life issues are scarce. The purpose of this study was to develop and evaluate respondent satisfaction and measurement properties of the 'Experiences, Attitudes and Knowledge of End-of-Life Issues in Implantable Cardioverter Defibrillator Patients' Questionnaire' (EOL-ICDQ). The instrument was tested for validity, respondent satisfaction, and for homogeneity and stability in the Swedish language. An English version of the EOL-ICDQ was validated, but has not yet been pilot tested. The final instrument contained three domains, which were clustered into 39 items measuring: experiences (10 items), attitudes (18 items), and knowledge (11 items) of end-of-life concerns in ICD patients. In addition, the questionnaire also contained items on socio-demographic background (six items) and ICD-specific background (eight items). The validity and reliability properties were considered sufficient. The EOL-ICDQ has the potential to be used in clinical practice and future research. Further studies are needed using this instrument in an Anglo-Saxon context with a sample of English-speaking ICD recipients.

Development of an instrument to measure self-efficacy in caregivers of people with advanced cancer.

PubMed

Ugalde, Anna; Krishnasamy, Meinir; Schofield, Penelope

2013-06-01

Informal caregivers of people with advanced cancer experience many negative impacts as a result of their role. There is a lack of suitable measures specifically designed to assess their experience. This study aimed to develop a new measure to assess self-efficacy in caregivers of people with advanced cancer. The development and testing of the new measure consisted of four separate, sequential phases: generation of issues, development of issues into items, pilot testing and field testing. In the generation of issues, 17 caregivers were interviewed to generate data. These data were analysed to generate codes, which were then systematically developed into items to construct the instrument. The instrument was pilot tested with 14 health professionals and five caregivers. It was then administered to a large sample for field testing to establish the psychometric properties, with established measures including the Brief Cope and the Family Appraisals for Caregiving Questionnaire for Palliative Care. Ninety-four caregivers completed the questionnaire booklet to establish the factor structure, reliability and validity. The factor analysis resulted in a 21-item, four-factor instrument, with the subscales being termed Resilience, Self-Maintenance, Emotional Connectivity and Instrumental Caregiving. The test-retest reliability and internal consistency were both excellent, ranging from 0.73 to 0.85 and 0.81 to 0.94, respectively. Six convergent and divergent hypotheses were made, and five were supported. This study has developed a new instrument to assess self-efficacy in caregivers of people with advanced cancer. The result is a four-factor, 21-item instrument with demonstrated reliability and validity. Copyright © 2012 John Wiley & Sons, Ltd.

Considering quality of life for children with cancer: a systematic review of patient-reported outcome measures and the development of a conceptual model.

PubMed

Anthony, Samantha J; Selkirk, Enid; Sung, Lillian; Klaassen, Robert J; Dix, David; Scheinemann, Katrin; Klassen, Anne F

2014-04-01

An appraisal of pediatric cancer-specific quality-of-life (QOL) instruments revealed a lack of clarity about what constitutes QOL in this population. This study addresses this concern by identifying the concepts that underpin the construct of QOL as determined by a content analysis of all patient-reported outcome (PRO) instruments used in childhood cancer research. A systematic review was performed of key databases (i.e., MEDLINE, CINAHL, PsychINFO) to identify studies of QOL in children with cancer. A content analysis process was used to code and categorize all items from generic and cancer-specified PRO instruments. Our objective was to provide clarification regarding the conceptual underpinnings of these instruments, as well as to help inform the development of theory and contribute to building a conceptual framework of QOL for children with cancer. A total of 6,013 English language articles were screened, identifying 148 studies. Ten generic and ten cancer-specific PRO instruments provided 957 items. Content analysis led to the identification of four major domains of QOL (physical, psychological, social, and general health), with 11 subdomains covering 98 different concepts. While all instruments reflected items relating to the broader domains of QOL, there was substantial heterogeneity in terms of the content and variability in the distribution of items. This systematic review and the proposed model represent a useful starting point in the critical appraisal of the conceptual underpinnings of PRO instruments used in pediatric oncology and contribute to the need to place such tools under a critical, yet reflective and analytical lens.

Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems—I-MeDeSA

PubMed Central

Zachariah, Marianne; Seidling, Hanna M; Neri, Pamela M; Cresswell, Kathrin M; Duke, Jon; Bloomrosen, Meryl; Volk, Lynn A; Bates, David W

2011-01-01

Background Medication-related decision support can reduce the frequency of preventable adverse drug events. However, the design of current medication alerts often results in alert fatigue and high over-ride rates, thus reducing any potential benefits. Methods The authors previously reviewed human-factors principles for relevance to medication-related decision support alerts. In this study, instrument items were developed for assessing the appropriate implementation of these human-factors principles in drug–drug interaction (DDI) alerts. User feedback regarding nine electronic medical records was considered during the development process. Content validity, construct validity through correlation analysis, and inter-rater reliability were assessed. Results The final version of the instrument included 26 items associated with nine human-factors principles. Content validation on three systems resulted in the addition of one principle (Corrective Actions) to the instrument and the elimination of eight items. Additionally, the wording of eight items was altered. Correlation analysis suggests a direct relationship between system age and performance of DDI alerts (p=0.0016). Inter-rater reliability indicated substantial agreement between raters (κ=0.764). Conclusion The authors developed and gathered preliminary evidence for the validity of an instrument that measures the appropriate use of human-factors principles in the design and display of DDI alerts. Designers of DDI alerts may use the instrument to improve usability and increase user acceptance of medication alerts, and organizations selecting an electronic medical record may find the instrument helpful in meeting their clinicians' usability needs. PMID:21946241

Monitoring

DOEpatents

Orr, Christopher Henry; Luff, Craig Janson; Dockray, Thomas; Macarthur, Duncan Whittemore

2004-11-23

The invention provides apparatus and methods which facilitate movement of an instrument relative to an item or location being monitored and/or the item or location relative to the instrument, whilst successfully excluding extraneous ions from the detection location. Thus, ions generated by emissions from the item or location can successfully be monitored during movement. The technique employs sealing to exclude such ions, for instance, through an electro-field which attracts and discharges the ions prior to their entering the detecting location and/or using a magnetic field configured to repel the ions away from the detecting location.

Advanced quantitative measurement methodology in physics education research

NASA Astrophysics Data System (ADS)

Wang, Jing

The ultimate goal of physics education research (PER) is to develop a theoretical framework to understand and improve the learning process. In this journey of discovery, assessment serves as our headlamp and alpenstock. It sometimes detects signals in student mental structures, and sometimes presents the difference between expert understanding and novice understanding. Quantitative assessment is an important area in PER. Developing research-based effective assessment instruments and making meaningful inferences based on these instruments have always been important goals of the PER community. Quantitative studies are often conducted to provide bases for test development and result interpretation. Statistics are frequently used in quantitative studies. The selection of statistical methods and interpretation of the results obtained by these methods shall be connected to the education background. In this connecting process, the issues of educational models are often raised. Many widely used statistical methods do not make assumptions on the mental structure of subjects, nor do they provide explanations tailored to the educational audience. There are also other methods that consider the mental structure and are tailored to provide strong connections between statistics and education. These methods often involve model assumption and parameter estimation, and are complicated mathematically. The dissertation provides a practical view of some advanced quantitative assessment methods. The common feature of these methods is that they all make educational/psychological model assumptions beyond the minimum mathematical model. The purpose of the study is to provide a comparison between these advanced methods and the pure mathematical methods. The comparison is based on the performance of the two types of methods under physics education settings. In particular, the comparison uses both physics content assessments and scientific ability assessments. The dissertation includes three parts. The first part involves the comparison between item response theory (IRT) and classical test theory (CTT). The two theories both provide test item statistics for educational inferences and decisions. The two theories are both applied to Force Concept Inventory data obtained from students enrolled in The Ohio State University. Effort was made to examine the similarity and difference between the two theories, and the possible explanation to the difference. The study suggests that item response theory is more sensitive to the context and conceptual features of the test items than classical test theory. The IRT parameters provide a better measure than CTT parameters for the educational audience to investigate item features. The second part of the dissertation is on the measure of association for binary data. In quantitative assessment, binary data is often encountered because of its simplicity. The current popular measures of association fail under some extremely unbalanced conditions. However, the occurrence of these conditions is not rare in educational data. Two popular association measures, the Pearson's correlation and the tetrachoric correlation are examined. A new method, model based association is introduced, and an educational testing constraint is discussed. The existing popular methods are compared with the model based association measure with and without the constraint. Connections between the value of association and the context and conceptual features of questions are discussed in detail. Results show that all the methods have their advantages and disadvantages. Special attention to the test and data conditions is necessary. The last part of the dissertation is focused on exploratory factor analysis (EFA). The theoretical advantages of EFA are discussed. Typical misunderstanding and misusage of EFA are explored. The EFA is performed on Lawson's Classroom Test of Scientific Reasoning (LCTSR), a widely used assessment on scientific reasoning skills. The reasoning ability structures for U.S. and Chinese students at different educational levels are given by the analysis. A final discussion on the advanced quantitative assessment methodology and the pure mathematical methodology is presented at the end.

Effectiveness of culturally tailored diabetes interventions for Asian immigrants to the United States: a systematic review.

PubMed

Joo, Jee Young

2014-01-01

The purpose of this systematic review is to evaluate the effectiveness of tailoring community-based diabetes intervention to Asian immigrant cultures. The Cochrane processes and Preferred Reporting Items for Systematic Reviews and Meta-Analyses recommendations guided this systematic review. PubMed, the Cumulative Index to Nursing and Allied Health Literature, Ovid, and PsycINFO were searched for analyses and syntheses of primary research published since 2000 that described interventions tailored for the cultures of Asian immigrants with diabetes. This search yielded a total of 9 articles published from 2005 to 2013. The Amsterdam-Maastricht Consensus List for Quality Assessment was used to assess the quality of the studies. Retrieved studies' populations were foreign-born adults >50 years of age with type 2 diabetes. The review revealed that culturally tailored diabetes programs are effective at improving patients' objectively measured clinical outcomes, in particular A1C levels, and psychobehavioral outcomes. Patients were also highly satisfied with bilingual health care providers and bilingual educational programs. There is strong evidence of the effectiveness of tailoring diabetes interventions to Asian immigrant populations' cultures. Further studies, including longitudinal studies and studies with rigorous research designs that subclassify Asian immigrants, are needed to encourage the implementation of culturally tailored diabetes intervention for this ethnic minority. © 2014 The Author(s).

An item response theory evaluation of three depression assessment instruments in a clinical sample.

PubMed

Adler, Mats; Hetta, Jerker; Isacsson, Göran; Brodin, Ulf

2012-06-21

This study investigates whether an analysis, based on Item Response Theory (IRT), can be used for initial evaluations of depression assessment instruments in a limited patient sample from an affective disorder outpatient clinic, with the aim to finding major advantages and deficiencies of the instruments. Three depression assessment instruments, the depression module from the Patient Health Questionnaire (PHQ9), the depression subscale of Affective Self Rating Scale (AS-18-D) and the Montgomery-Åsberg Depression Rating Scale (MADRS) were evaluated in a sample of 61 patients with affective disorder diagnoses, mainly bipolar disorder. A '3- step IRT strategy' was used. In a first step, the Mokken non-parametric analysis showed that PHQ9 and AS-18-D had strong overall scalabilities of 0.510 [C.I. 0.42, 0.61] and 0,513 [C.I. 0.41, 0.63] respectively, while MADRS had a weak scalability of 0.339 [C.I. 0.25, 0.43]. In a second step, a Rasch model analysis indicated large differences concerning the item discriminating capacity and was therefore considered not suitable for the data. In third step, applying a more flexible two parameter model, all three instruments showed large differences in item information and items had a low capacity to reliably measure respondents at low levels of depression severity. We conclude that a stepwise IRT-approach, as performed in this study, is a suitable tool for studying assessment instruments at early stages of development. Such an analysis can give useful information, even in small samples, in order to construct more precise measurements or to evaluate existing assessment instruments. The study suggests that the PHQ9 and AS-18-D can be useful for measurement of depression severity in an outpatient clinic for affective disorder, while the MADRS shows weak measurement properties for this type of patients.

The development of an integrated assessment instrument for measuring analytical thinking and science process skills

NASA Astrophysics Data System (ADS)

Irwanto, Rohaeti, Eli; LFX, Endang Widjajanti; Suyanta

2017-05-01

This research aims to develop instrument and determine the characteristics of an integrated assessment instrument. This research uses 4-D model, which includes define, design, develop, and disseminate. The primary product is validated by expert judgment, tested it's readability by students, and assessed it's feasibility by chemistry teachers. This research involved 246 students of grade XI of four senior high schools in Yogyakarta, Indonesia. Data collection techniques include interview, questionnaire, and test. Data collection instruments include interview guideline, item validation sheet, users' response questionnaire, instrument readability questionnaire, and essay test. The results show that the integrated assessment instrument has Aiken validity value of 0.95. Item reliability was 0.99 and person reliability was 0.69. Teachers' response to the integrated assessment instrument is very good. Therefore, the integrated assessment instrument is feasible to be applied to measure the students' analytical thinking and science process skills.

Evaluating psychosocial and behavioral mechanisms of change in a tailored communication intervention.

PubMed

Elder, John P; Ayala, Guadalupe X; Slymen, Donald J; Arredondo, Elva M; Campbell, Nadia R

2009-04-01

This study examined the impact of a tailored nutrition intervention at 3 and 6 months postintervention. In all, 357 Latinas were randomly assigned to one of three conditions: (1) a control condition comprised of previously developed Spanish language targeted materials, (2) tailored print materials, or (3) tailored print materials accompanied by personalized dietary counseling via lay heath advisors (promotoras). At 6 months postintervention, significant group by time interactions were observed on the dietary behavioral strategies scales. The promotora condition resulted in significant behavior change initially; however, receipt of tailored and control materials was instrumental in continued behavior change after intervention activities had ceased. Group main effects suggested that the promotora condition was superior at reducing barriers and improving family interactions supporting healthy behaviors. The promotora model is an effective method for changing important dietary behaviors and psychosocial determinants, but longer term behavior change is achievable with less expensive intervention methods.

An in-depth psychometric analysis of the Connor-Davidson Resilience Scale: calibration with Rasch-Andrich model.

PubMed

Arias González, Víctor B; Crespo Sierra, María Teresa; Arias Martínez, Benito; Martínez-Molina, Agustín; Ponce, Fernando P

2015-09-23

The Connor-Davidson Resilience Scale (CD-RISC) is inarguably one of the best-known instruments in the field of resilience assessment. However, the criteria for the psychometric quality of the instrument were based only on classical test theory. The aim of this paper has focused on the calibration of the CD-RISC with a nonclinical sample of 444 adults using the Rasch-Andrich Rating Scale Model, in order to clarify its structure and analyze its psychometric properties at the level of item. Two items showed misfit to the model and were eliminated. The remaining 22 items form basically a unidimensional scale. The CD-RISC has good psychometric properties. The fit of both the items and the persons to the Rasch model was good, and the response categories were functioning properly. Two of the items showed differential item functioning. The CD-RISC has an obvious ceiling effect, which suggests to include more difficult items in future versions of the scale.

The psychometric properties of the Chinese version of the Conditions of Work Effectiveness Questionnaire-II.

PubMed

Sun, Ning; Li, Qiu-Jie; Lv, Dong-Mei; Lu, Gui-Zhi; Lin, Ping; An, Xue-Mei

2014-10-01

The present study was conducted to evaluate the psychometric properties of a newly adapted Chinese version of an instrument designed to measure structural empowerment among staff nurses. Structural empowerment has been shown to be important to nurses in Western cultures, but its importance in China is unknown. A convenience sample of 650 staff nurses was selected from six hospitals in Harbin, China. After linguistic adaptation using the forward-backward translation method, the 19-item Conditions of Work Effectiveness Questionnaire-II (CWEQ-II-CV) was answered by participants. Content validity, Cronbach's alpha, item-to-total correlation and exploratory factor analysis were used to assess the reliability and validity of the translated instrument. In the factor analysis, a six-factor solution was found to be reasonable with the sub-dimensions of structural empowerment that included support (three items), resources (three items), information (three items), opportunity (three items), formal power (three items) and informal power (four items). Cronbach's alpha coefficient for the total instrument was 0.92 and ranged from 0.68 to 0.86 in the six subscales. The item-to-total correlation coefficients ranged from 0.48 to 0.80. The findings also gave support for content validity. Evidence was found to support the reliability and validity of the CWEQ-II-CV scale that measures the quality of the work environment for nurses from a structural empowerment perspective. The translated version of CWEQ-II-CV can provide an effective evaluation tool for structural empowerment in the Chinese nursing workplace. © 2013 John Wiley & Sons Ltd.

Instrument development and validation of a quality scale for historical research papers (QSHRP): a pilot study.

PubMed

Kelly, Jacinta; Watson, Roger

2014-12-01

To report a pilot study for the development and validation of an instrument to measure quality in historical research papers. There are no set criteria to assess historical papers published in nursing journals. A three phase mixed method sequential confirmatory design. In 2012, we used a three-phase approach to item generation and content evaluation. In phase 1, we consulted nursing historians using an online survey comprising three open-ended questions and revised the items. In phase 2, we evaluated the revised items for relevance with expert historians using a 4-point Likert scale and Content Validity Index calculation. In phase 3, we conducted reliability testing of the instrument using a 3-point Likert scale. In phase 1, 121 responses were generated via the online survey and revised to 40 interrogatively phrased items. In phase 2, five items with an Item Content Validity Index score of ≥0·7 remained. In phase 3, responses from historians resulted in 100% agreement to questions 1, 2 and 4 and 89% and 78%, respectively, to questions 3 and 5. Items for the QSHRP have been identified, content validated and reliability tested. This scale improves on previous scales, which over-emphasized source criticism. However, a full-scale study is needed with nursing historians to increase its robustness. © 2014 John Wiley & Sons Ltd.

The Therapeutic Environment Screening Survey for Nursing Homes (TESS-NH): an observational instrument for assessing the physical environment of institutional settings for persons with dementia.

PubMed

Sloane, Philip D; Mitchell, C Madeline; Weisman, Gerald; Zimmerman, Sheryl; Foley, Kristie M Long; Lynn, Mary; Calkins, Margaret; Lawton, M Powell; Teresi, Jeanne; Grant, Leslie; Lindeman, David; Montgomery, Rhonda

2002-03-01

To develop an observational instrument that describes the ability of physical environments of institutional settings to address therapeutic goals for persons with dementia. A National Institute on Aging workgroup identified and subsequently revised items that evaluated exit control, maintenance, cleanliness, safety, orientation/cueing, privacy, unit autonomy, outdoor access, lighting, noise, visual/tactile stimulation, space/seating, and familiarity/homelikeness. The final instrument contains 84 discrete items and one global rating. A summary scale, the Special Care Unit Environmental Quality Scale (SCUEQS), consists of 18 items. Lighting items were validated using portable light meters. Concurrent criterion validation compared SCUEQS scores with the Professional Environmental Assessment Protocol (PEAP). Interrater kappa statistics for 74% of items were above.60. For another 10% of items, kappas could not be calculated due to empty cells, but interrater agreement was above 80%. The SCUEQS demonstrated an interrater reliability of.93, a test--retest reliability of.88, and an internal consistency of.81--.83. Light meter ratings correlated significantly with the Therapeutic Environment Screening Survey for Nursing Homes (TESS-NH) lighting items (r =.29--.38, p =.01--.04), and the SCUEQS correlated significantly with global PEAP ratings (r =.52, p <.01). The TESS-NH efficiently assesses discrete elements of the physical environment and has strong reliability and validity. The SCUEQS provides a quantitative measure of environmental quality in institutional settings.

FOD Prevention at NASA-Marshall Space Flight Center

NASA Technical Reports Server (NTRS)

Lowrey, Nikki M.

2010-01-01

NASA-MSFC directive MID 5340.1 requires FOD prevention for all flight hardware projects, and requires all support organizations to comply. MSFC-STD-3598 implements a standard approach for FOD prevention, tailored from NAS 412. Three levels of FOD Sensitive Area are identified, adopting existing practices at other NASA facilities. Additional emphasis is given to prevention of impact damage and mitigation of facility FOD sources, especially leaks and spills. Impact Damage Susceptible (IDS) items are identified as FOD-sensitive as well as hardware vulnerable to entrapment of small items.

Development of the functional vision questionnaire for children and young people with visual impairment: the FVQ_CYP.

PubMed

Tadić, Valerija; Cooper, Andrew; Cumberland, Phillippa; Lewando-Hundt, Gillian; Rahi, Jugnoo S

2013-12-01

To develop a novel age-appropriate measure of functional vision (FV) for self-reporting by visually impaired (VI) children and young people. Questionnaire development. A representative patient sample of VI children and young people aged 10 to 15 years, visual acuity of the logarithm of the minimum angle of resolution (logMAR) worse than 0.48, and a school-based (nonrandom) expert group sample of VI students aged 12 to 17 years. A total of 32 qualitative semistructured interviews supplemented by narrative feedback from 15 eligible VI children and young people were used to generate draft instrument items. Seventeen VI students were consulted individually on item relevance and comprehensibility, instrument instructions, format, and administration methods. The resulting draft instrument was piloted with 101 VI children and young people comprising a nationally representative sample, drawn from 21 hospitals in the United Kingdom. Initial item reduction was informed by presence of missing data and individual item response pattern. Exploratory factor analysis (FA) and parallel analysis (PA), and Rasch analysis (RA) were applied to test the instrument's psychometric properties. Psychometric indices and validity assessment of the Functional Vision Questionnaire for Children and Young People (FVQ_CYP). A total of 712 qualitative statements became a 56-item draft scale, capturing the level of difficulty in performing vision-dependent activities. After piloting, items were removed iteratively as follows: 11 for high percentage of missing data, 4 for skewness, and 1 for inadequate item infit and outfit values in RA, 3 having shown differential item functioning across age groups and 1 across gender in RA. The remaining 36 items showed item fit values within acceptable limits, good measurement precision and targeting, and ordered response categories. The reduced scale has a clear unidimensional structure, with all items having a high factor loading on the single factor in FA and PA. The summary scores correlated significantly with visual acuity. We have developed a novel, psychometrically robust self-report questionnaire for children and young people-the FVQ_CYP-that captures the functional impact of visual disability from their perspective. The 36-item, 4-point unidimensional scale has potential as a complementary adjunct to objective clinical assessments in routine pediatric ophthalmology practice and in research. Copyright © 2013 American Academy of Ophthalmology. Published by Elsevier Inc. All rights reserved.

NEWS for Africa: adaptation and reliability of a built environment questionnaire for physical activity in seven African countries.

PubMed

Oyeyemi, Adewale L; Kasoma, Sandra S; Onywera, Vincent O; Assah, Felix; Adedoyin, Rufus A; Conway, Terry L; Moss, Sarah J; Ocansey, Reginald; Kolbe-Alexander, Tracy L; Akinroye, Kingsley K; Prista, Antonio; Larouche, Richard; Gavand, Kavita A; Cain, Kelli L; Lambert, Estelle V; Aryeetey, Richmond; Bartels, Clare; Tremblay, Mark S; Sallis, James F

2016-03-08

Built environment and policy interventions are effective strategies for controlling the growing worldwide deaths from physical inactivity-related non-communicable diseases. To improve built environment research and develop African specific evidence, it is important to first tailor built environment measures to African contexts and assess their psychometric properties across African countries. This study reports on the adaptation and test-retest reliability of the Neighborhood Environment Walkability Scale in seven sub-Saharan African countries (NEWS-Africa). The original NEWS comprising 8 subscales measuring reported physical and social attributes of neighborhood environments was systematically adapted for Africa through extensive input from physical activity and public health researchers, built environment professionals, and residents in seven African countries: Cameroon, Ghana, Kenya, Mozambique, Nigeria, South Africa and Uganda. Cognitive testing of NEWS-Africa was conducted among diverse residents (N = 109, 50 youth [12 - 17 years] and 59 adults [22 - 67 years], 69 % from low socioeconomic status [SES] neighborhoods). NEWS-Africa was translated into local languages and evaluated for 2-week test-retest reliability in adult participants (N = 301; female = 50.2 %; age = 32.3 ± 12.9 years) purposively recruited from neighborhoods varying in walkability (high and low walkable) and SES (high and low income) and from villages in six of seven participating countries. The original 67 NEWS items was expanded to 89 scores (76 individual NEWS items and 13 computed scales). Several modifications were made to individual items, and some new items were added to capture important attributes in the African environment. A new scale on personal safety was created, and the aesthetics scale was enlarged to reflect African specific characteristics. Over 95 % of all NEWS-Africa scores (items plus computed scales) demonstrated evidence of "excellent" (ICCs > .75 %) or "good" (ICCs = 0.60 to 0.74) reliability. Seven (53.8 %) of the 13 computed NEWS scales demonstrated "excellent" agreement and the other six had "good" agreement. No items or scales demonstrated "poor" reliability (ICCs < .40). The systematic adaptation and initial psychometric evaluation of NEWS-Africa indicates the instrument is feasible and reliable for use with adults of diverse demographic characteristics in Africa. The measure is likely to be useful for research, surveillance of built environment conditions for planning purposes, and to evaluate physical activity and policy interventions in Africa.

Instrumentation for Nano-porous, Nano-particulate Geopolymeric Materials Research

DTIC Science & Technology

2008-11-04

working on tailoring the nano- and meso-porosity, and the microstructure of geopolymers and their composites . This grant was used to procure equipment...and tailor the nano and meso-porosity and microstructure of geopolymers and their composites is part of an ongoing research project in the Pis...purchased to improve the synthesis and processing of geopolymers and geopolymer composites . The attritor mill enables synthesis Technical Report of

Contextual Differential Item Functioning: Examining the Validity of Teaching Self-Efficacy Instruments Using Hierarchical Generalized Linear Modeling

ERIC Educational Resources Information Center

Zhao, Jing

2012-01-01

The purpose of the study is to further investigate the validity of instruments used for collecting preservice teachers' perceptions of self-efficacy adapting the three-level IRT model described in Cheong's study (2006). The focus of the present study is to investigate whether the polytomously-scored items on the preservice teachers' self-efficacy…

Adapting a Developmental Screening Measure: Exploring the Effects of Language and Culture on a Parent-Completed SocialEmotional Screening Test

ERIC Educational Resources Information Center

Chen, Chieh-Yu; Chen, Ching-I; Squires, Jane; Bian, Xiaoyan; Heo, Kay H.; Filgueiras, Alberto; Kalinina, Svetlana; Samarina, Larissa; Ermolaeva, Evgeniya; Xie, Huichao; Yu, Ting-Ying; Wu, Pei-Fang; Landeira-Fernandez, Jesus

2017-01-01

Ages & Stages Questionnaires: Social-Emotional (ASQ:SE) is a widely used screening instrument for detecting social-emotional difficulties in infants and young children. To use a screening instrument across cultures and countries, it is necessary to identify potential item-level biases and ensure item equivalence. This study investigated the…

New resilience instrument for patients with cancer.

PubMed

Ye, Zeng Jie; Liang, Mu Zi; Li, Peng Fei; Sun, Zhe; Chen, Peng; Hu, Guang Yun; Yu, Yuan Liang; Wang, Shu Ni; Qiu, Hong Zhong

2018-02-01

Resilience is an important concept in the cancer literature and is a salient indicator of cancer survivorship. The aim of this study is to develop and validate a new resilience instrument that is specific to patients with cancer diagnosis (RS-SC) in Mainland China. First, a resilience framework was constructed for patients with cancer diagnosis. Second, items were formulated based on the framework to reflect different aspects of resilience. Third, two rounds of expert panel discussion were performed to select important and relevant items. Finally, two cross-sectional studies were conducted to evaluate the psychometric properties of this instrument. Fifty-one items were generated based on the resilience framework and the final 25-item RS-SC resulted in a five-factor solution including Generic Elements, Benefit Finding, Support and Coping, Hope for the Future and Meaning for Existence, accounting for 64.72% of the variance. The Cronbach's α of the RS-SC was 0.825 and the test-retest reliability was 0.874. The RS-SC is a brief and specific self-report resilience instrument for Chinese patients with cancer and shows sound psychometric properties in this study. The RS-SC has potential applications in both clinical practice and research with strength-based resiliency interventions.

Toward Establishing the Validity of the Resource Interpreter's Self-Efficacy Instrument

NASA Astrophysics Data System (ADS)

Smith, Grant D.

Interpretive rangers serve as one of the major educational resources that visitors may encounter during their visit to a park or other natural area, yet our understanding of their professional growth remains limited. This study helps address this issue by developing an instrument that evaluates the beliefs of resource interpreters regarding their capabilities of communicating with the public. The resulting 11-item instrument was built around the construct of Albert Bandura's self-efficacy theory (Bandura, 1977, 1986, 1997), used guidelines and principles developed over the course of 30 years of teacher efficacy studies (Bandura, 2006; Gibson & Dembo, 1984; Riggs & Enochs, 1990; Tschannen-Moran & Hoy, 2001; Tschannen-Moran, Hoy, & Hoy, 1998), and probed areas of challenge that are unique to the demands of resource interpretation (Brochu & Merriman, 2002; Ham, 1992; Knudson, Cable, & Beck, 2003; Larsen, 2003; Tilden, 1977). A voluntary convenience sample of 364 National Park Service rangers was collected in order to conduct the statistical analyses needed to winnow the draft instrument down from 47 items in its original form to 11 items in its final state. Statistical analyses used in this process included item-total correlation, index of discrimination, exploratory factor analysis, and confirmatory factor analysis.

Measuring quality of life in patients with stress urinary incontinence: is the ICIQ-UI-SF adequate?

PubMed

Kurzawa, Zuzanna; Sutherland, Jason M; Crump, Trafford; Liu, Guiping

2018-05-08

The International Consultation on Incontinence Questionnaire Short Form (ICIQ-UI-SF) is a widely used four-item patient-reported outcome (PRO) measure. Evaluations of this instrument are limited, restraining user's confidence in the instrument. This study conducts a comprehensive evaluation of the ICIQ-UI-SF on a sample of urological surgery patients in Canada. One hundred and seventy-seven surgical patients with stress urinary incontinence completed the ICIQ-UI-SF pre-operatively. Methods drawing from confirmatory factor analysis (CFA), measures of reliability, item response theory (IRT), and differential item functioning were applied. Ceiling effects were examined. Ceiling effects were identified. In the CFA, the factor loadings of items one and two differed significantly (p < 0.001) from item three indicating possible multidimensionality. The first two items reflect symptom severity not quality of life. Reliability was moderate as measured by Cronbach's alpha (0.63) and McDonald's coefficient (0.65). The IRT found the instrument does not discriminate between individuals with low incontinence-related quality of life. Due to low/moderate reliability, the ICIQ-UI-SF can be used as a complement to other data or used to report aggregated surgical outcomes among surgical patients. If the primary objective is to measure quality of life, other PROs should be considered.

Development and Validation of a Questionnaire on Breastfeeding Intentions, Attitudes and Knowledge of a Sample of Croatian Secondary-School Students.

PubMed

Čatipović, Marija; Marković, Martina; Grgurić, Josip

2018-04-27

Validating a questionnaire/instrument before proceeding to the field for data collection is important. An 18-item breastfeeding intention, 39-item attitude and 44-item knowledge questionnaire was validated in a Croatian sample of secondary-school students ( N = 277). For the intentions, principal component analysis (PCA) yielded a four-factor solution with 8 items explaining 68.3% of the total variance. Cronbach’s alpha (0.71) indicated satisfactory internal consistency. For the attitudes, PCA showed a seven-factor structure with 33 items explaining 58.41% of total variance. Cronbach’s alpha (0.87) indicated good internal consistency. There were 13 knowledge questions that were retained after item analysis, showing good internal consistency (KR20 = 0.83). In terms of criterion validity, the questionnaire differentiated between students who received breastfeeding education compared to students who were not educated in breastfeeding. Correlations between intentions and attitudes (r = 0.49), intentions and knowledge (r = 0.29), and attitudes and knowledge (r = 0.38) confirmed concurrent validity. The final instrument is reliable and valid for data collection on breastfeeding. Therefore, the instrument is recommended for evaluation of breastfeeding education programs aimed at upper-grade elementary and secondary school students.

Development and Validation of a Questionnaire on Breastfeeding Intentions, Attitudes and Knowledge of a Sample of Croatian Secondary-School Students

PubMed Central

Marković, Martina; Grgurić, Josip

2018-01-01

Background: Validating a questionnaire/instrument before proceeding to the field for data collection is important. Methods: An 18-item breastfeeding intention, 39-item attitude and 44-item knowledge questionnaire was validated in a Croatian sample of secondary-school students (N = 277). Results: For the intentions, principal component analysis (PCA) yielded a four-factor solution with 8 items explaining 68.3% of the total variance. Cronbach’s alpha (0.71) indicated satisfactory internal consistency. For the attitudes, PCA showed a seven-factor structure with 33 items explaining 58.41% of total variance. Cronbach’s alpha (0.87) indicated good internal consistency. There were 13 knowledge questions that were retained after item analysis, showing good internal consistency (KR20 = 0.83). In terms of criterion validity, the questionnaire differentiated between students who received breastfeeding education compared to students who were not educated in breastfeeding. Correlations between intentions and attitudes (r = 0.49), intentions and knowledge (r = 0.29), and attitudes and knowledge (r = 0.38) confirmed concurrent validity. Conclusions: The final instrument is reliable and valid for data collection on breastfeeding. Therefore, the instrument is recommended for evaluation of breastfeeding education programs aimed at upper-grade elementary and secondary school students. PMID:29702616

Development and Validation of the Numeracy Understanding in Medicine Instrument Short Form

PubMed Central

Schapira, Marilyn M.; Walker, Cindy M.; Miller, Tamara; Fletcher, Kathlyn A; Ganschow, Pamela G.; Jacobs, Elizabeth A; Imbert, Diana; O'Connell, Maria; Neuner, Joan M.

2014-01-01

Background Health numeracy can be defined as the ability to understand and use numeric information and quantitative concepts in the context of health. We previously reported the development of the Numeracy Understanding in Medicine Instrument (NUMi); a 20-item test developed using item response theory. We now report the development and validation of a short form of the NUMi. Methods Item statistics were used to identify a subset of 8-items representing a range of difficulty and content areas. Internal reliability was evaluated with Cronbach's alpha. Divergent and convergent validity was assessed by comparing scores of the S-NUMI with existing measures of education, print and numeric health literacy, mathematic achievement, cognitive reasoning, and the original NUMi. Results The 8-item scale had adequate reliability (Cronbach's alpha: 0.72) and was strongly correlated to the 20-item NUMi (0.92). The S-NUMi scores were strongly correlated with the Lipkus numeracy test (0.62), Wide Range of Achievement Test-Mathematics (WRAT-M) (0.72), and Wonderlic cognitive reasoning test (0.76). Moderate correlation was found with education level (0.58) and print literacy as measured by the TOFHLA (0.49). Conclusion The short Numeracy Understanding in Medicine Instrument is a reliable and valid measure of health numeracy feasible for use in clinical and research settings. PMID:25315596

Confirmatory factor analysis of teaching and learning guiding principles instrument among teacher educators in higher education institutions

NASA Astrophysics Data System (ADS)

Masuwai, Azwani; Tajudin, Nor'ain Mohd; Saad, Noor Shah

2017-05-01

The purpose of this study is to develop and establish the validity and reliability of an instrument to generate teaching and learning guiding principles using Teaching and Learning Guiding Principles Instrument (TLGPI). Participants consisted of 171 Malaysian teacher educators. It is an essential instrument to reflect in generating the teaching and learning guiding principles in higher education level in Malaysia. Confirmatory Factor Analysis has validated all 19 items of TLGPI whereby all items indicated high reliability and internal consistency. A Confirmatory Factor Analysis also confirmed that a single factor model was used to generate teaching and learning guiding principles.

Validation of an instrument for assessing teacher knowledge of basic language constructs of literacy.

PubMed

Binks-Cantrell, Emily; Joshi, R Malatesha; Washburn, Erin K

2012-10-01

Recent national reports have stressed the importance of teacher knowledge in teaching reading. However, in the past, teachers' knowledge of language and literacy constructs has typically been assessed with instruments that are not fully tested for validity. In the present study, an instrument was developed; and its reliability, item difficulty, and item discrimination were computed and examined to identify model fit by applying exploratory factor analysis. Such analyses showed that the instrument demonstrated adequate estimates of reliability in assessing teachers' knowledge of language constructs. The implications for professional development of in-service teachers as well as preservice teacher education are also discussed.

A Study of Developing an Environmental Attitude Scale for Primary School Students

ERIC Educational Resources Information Center

Artvinli, Eyup; Demir, Zulfiye Melis

2018-01-01

The aim of this research is to develop an instrument that measures environmental attitudes of third grade students. The study was completed in six stages: creating scale items, content validity study, item total and remaining item correlation study, determining item discrimination, determining construct validity study and examining the internal…

Calibrating well-being, quality of life and common mental disorder items: psychometric epidemiology in public mental health research.

PubMed

Böhnke, Jan R; Croudace, Tim J

2016-08-01

The assessment of 'general health and well-being' in public mental health research stimulates debates around relative merits of questionnaire instruments and their items. Little evidence regarding alignment or differential advantages of instruments or items has appeared to date. Population-based psychometric study of items employed in public mental health narratives. Multidimensional item response theory was applied to General Health Questionnaire (GHQ-12), Warwick-Edinburgh Mental Well-being Scale (WEMWBS) and EQ-5D items (Health Survey for England, 2010-2012; n = 19 290). A bifactor model provided the best account of the data and showed that the GHQ-12 and WEMWBS items assess mainly the same construct. Only one item of the EQ-5D showed relevant overlap with this dimension (anxiety/depression). Findings were corroborated by comparisons with alternative models and cross-validation analyses. The consequences of this lack of differentiation (GHQ-12 v. WEMWBS) for mental health and well-being narratives deserves discussion to enrich debates on priorities in public mental health and its assessment. © The Royal College of Psychiatrists 2015.

[Instruments for evaluating oral health knowledge, attitudes and practice for parents /caregivers of small children].

PubMed

Martignon, Stefania; Bautista-Mendoza, Gloria; González-Carrera, María; Lafaurie-Villamil, Gloria; Morales, Veicy; Santamaría, Ruth

2008-01-01

Designing three instruments for evaluating oral health knowledge, attitudes and practice in parents/caregivers of low social-economic status 0-5 year-olds. Evaluating the instruments' reliability in terms of internal consistency and analysing items. Three instruments were constructed for evaluating low social-economic status 0-5 year-olds' parents/caregivers' oral health knowledge, attitudes and practice in the municipality of Usaquén , Bogotá , Colombia . 47 parents/caregivers were given a test establishing the instrument's reliability in terms of internal consistency and the adults' level of knowledge, attitudes and practice. A sub-sample was qualitatively analysed (content verification and understanding). Reliability was evaluated using Cronbach's alpha coefficient. Items were analysed for improving constructing and understanding the questions, taking four criteria into account: corrected homogeneity index (CHI), response trend, correlation between items and qualitative analysis. Cronbach's alpha coefficient for knowledge, attitudes and practice was 0,82, 0,80 and 0,62, respectively. Participants' level of knowledge, attitudes and practice was acceptable (60 %, 55 % and 91 %, respectively). This study found two out of the three evaluated instruments to be reliable (knowledge and attitudes); all three of them were then redesigned. The resulting instruments represent a valuable tool which can be used in future studies for describing and evaluating preventative programmes.

Computerized Adaptive Testing: An Overview and an Example.

ERIC Educational Resources Information Center

McBride, James R.

The advantages of computerized adaptive testing are discussed, and an example illustrates its use in sixth grade mathematics. These tests are administered at a computer terminal, and the test items to be administered are selected according to the difficulty level appropriate to the individual's ability. Tailoring increases the psychometric…

The Development and Preliminary Testing of an Instrument for Assessing Fatigue Self-management Outcomes in Patients With Advanced Cancer.

PubMed

Chan, Raymond Javan; Yates, Patsy; McCarthy, Alexandra L

Fatigue is one of the most distressing and commonly experienced symptoms in patients with advanced cancer. Although the self-management (SM) of cancer-related symptoms has received increasing attention, no research instrument assessing fatigue SM outcomes for patients with advanced cancer is available. The aim of this study was to describe the development and preliminary testing of an interviewer-administered instrument for assessing the frequency and perceived levels of effectiveness and self-efficacy associated with fatigue SM behaviors in patients with advanced cancer. The development and testing of the Self-efficacy in Managing Symptoms Scale-Fatigue Subscale for Patients With Advanced Cancer (SMSFS-A) involved a number of procedures: item generation using a comprehensive literature review and semistructured interviews, content validity evaluation using expert panel reviews, and face validity and test-retest reliability evaluation using pilot testing. Initially, 23 items (22 specific behaviors with 1 global item) were generated from the literature review and semistructured interviews. After 2 rounds of expert panel review, the final scale was reduced to 17 items (16 behaviors with 1 global item). Participants in the pilot test (n = 10) confirmed that the questions in this scale were clear and easy to understand. Bland-Altman analysis showed agreement of results over a 1-week interval. The SMSFS-A items were generated using multiple sources. This tool demonstrated preliminary validity and reliability. The SMSFS-A has the potential to be used for clinical and research purposes. Nurses can use this instrument for collecting data to inform the initiation of appropriate fatigue SM support for this population.

Adaptation of the Practice Environment Scale for military nurses: a psychometric analysis.

PubMed

Swiger, Pauline A; Raju, Dheeraj; Breckenridge-Sproat, Sara; Patrician, Patricia A

2017-09-01

The aim of this study was to confirm the psychometric properties of Practice Environment Scale of the Nursing Work Index in a military population. This study also demonstrates association rule analysis, a contemporary exploratory technique. One of the instruments most commonly used to evaluate the nursing practice environment is the Practice Environment Scale of the Nursing Work Index. Although the instrument has been widely used, the reliability, validity and individual item function are not commonly evaluated. Gaps exist with regard to confirmatory evaluation of the subscale factors, individual item analysis and evaluation in the outpatient setting and with non-registered nursing staff. This was a secondary data analysis of existing survey data. Multiple psychometric methods were used for this analysis using survey data collected in 2014. First, descriptive analyses were conducted, including exploration using association rules. Next, internal consistency was tested and confirmatory factor analysis was performed to test the factor structure. The specified factor structure did not hold; therefore, exploratory factor analysis was performed. Finally, item analysis was executed using item response theory. The differential item functioning technique allowed the comparison of responses by care setting and nurse type. The results of this study indicate that responses differ between groups and that several individual items could be removed without altering the psychometric properties of the instrument. The instrument functions moderately well in a military population; however, researchers may want to consider nurse type and care setting during analysis to identify any meaningful variation in responses. © 2017 John Wiley & Sons Ltd.

Development and study of self-efficacy scale in medication adherence among Iranian patients with hypertension

PubMed Central

Najimi, Arash; Mostafavi, Firoozeh; Sharifirad, Gholamreza; Golshiri, Parastoo

2017-01-01

BACKGROUND: This study was aimed at developing and studying the scale of self-efficacy in adherence to treatment in Iranian patients with hypertension. METHODS: A mix-method study was conducted on the two stages: in the first phase, a qualitative study was done using content analysis through deep and semi-structured interviews. After data analysis, the draft of tool was prepared. Items in the draft were selected based on the extracted concepts. In the second phase, validity and reliability of the instrument were implemented using a quantitative study. The prepared instrument in the first phase was studied among 612 participants. To test the construct validity and internal consistency, exploratory factor analysis and Cronbach's alpha were used, respectively. To study the validity of the final scale, the average score of self-efficacy in patients with controlled hypertension were compared with patients with uncontrolled hypertension. RESULTS: In overall, 16 patients were interviewed. Twenty-six items were developed to assess different concepts of self-efficacy. Concept-related items were extracted from interviews to study the face validity of the tool from patient's point of view. Four items were deleted because scored 0.79 in content validity. The mean of questionnaire content validity was 0.85. Items were collected in two factors with an eigenvalue >1. Four items were deleted with load factor <0.4. Reliability was 0.84 for the entire instrument. CONCLUSION: Self-efficacy scale in patients with hypertension is a valid and reliable instrument that can effectively evaluate the self-efficacy in medication adherence in the management of hypertension. PMID:29114551

A Comprehensive Observational Coding Scheme for Analyzing Instrumental, Affective, and Relational Communication in Health Care Contexts

PubMed Central

SIMINOFF, LAURA A.; STEP, MARY M.

2011-01-01

Many observational coding schemes have been offered to measure communication in health care settings. These schemes fall short of capturing multiple functions of communication among providers, patients, and other participants. After a brief review of observational communication coding, the authors present a comprehensive scheme for coding communication that is (a) grounded in communication theory, (b) accounts for instrumental and relational communication, and (c) captures important contextual features with tailored coding templates: the Siminoff Communication Content & Affect Program (SCCAP). To test SCCAP reliability and validity, the authors coded data from two communication studies. The SCCAP provided reliable measurement of communication variables including tailored content areas and observer ratings of speaker immediacy, affiliation, confirmation, and disconfirmation behaviors. PMID:21213170

Undergraduate chemistry students' conceptions of atomic structure, molecular structure and chemical bonding

NASA Astrophysics Data System (ADS)

Campbell, Erin Roberts

The process of chemical education should facilitate students' construction of meaningful conceptual structures about the concepts and processes of chemistry. It is evident, however, that students at all levels possess concepts that are inconsistent with currently accepted scientific views. The purpose of this study was to examine undergraduate chemistry students' conceptions of atomic structure, chemical bonding and molecular structure. A diagnostic instrument to evaluate students' conceptions of atomic and molecular structure was developed by the researcher. The instrument incorporated multiple-choice items and reasoned explanations based upon relevant literature and a categorical summarization of student responses (Treagust, 1988, 1995). A covalent bonding and molecular structure diagnostic instrument developed by Peterson and Treagust (1989) was also employed. The ex post facto portion of the study examined the conceptual understanding of undergraduate chemistry students using descriptive statistics to summarize the results obtained from the diagnostic instruments. In addition to the descriptive portion of the study, a total score for each student was calculated based on the combination of correct and incorrect choices made for each item. A comparison of scores obtained on the diagnostic instruments by the upper and lower classes of undergraduate students was made using a t-Test. This study also examined an axiomatic assumption that an understanding of atomic structure is important in understanding bonding and molecular structure. A Pearson Correlation Coefficient, ṟ, was calculated to provide a measure of the strength of this association. Additionally, this study gathered information regarding expectations of undergraduate chemistry students' understanding held by the chemical community. Two questionnaires were developed with items based upon the propositional knowledge statements used in the development of the diagnostic instruments. Subgroups of items from the questionnaires were formed from the combination of items found to measure different aspects of a specific topic area using a reliability analysis. Average scores for the subgroups were compared to results obtained by students on the diagnostic instrument targeting the same topic area. There were no significant differences of the scores on both of the diagnostic instruments between the levels of undergraduate chemistry students. There were, however, significant differences on certain items of the diagnostic instruments between upper and lower class students. Additionally, misconceptions were identified within all levels of these undergraduate students that corresponded to previous results reported in the literature. A significant relationship was found to exist between the scores obtained on the two diagnostic instruments, as well as strong correlations between specific items and the total scores of the instruments. Response to the expectations questionnaires revealed no differences between the chemical industry and chemical academia, but did provide information concerning the chemical community's expectations of undergraduate chemistry students. Results indicate that undergraduate students majoring in chemistry have conceptions that are inconsistent with currently accepted scientific views. The findings also support the hypothesis that an understanding of the general structure of the atom and the roles played by electrons in molecular bonding and structure is important to an understanding of chemical properties and behavior.

Development and psychometric evaluation of an information literacy self-efficacy survey and an information literacy knowledge test.

PubMed

Tepe, Rodger; Tepe, Chabha

2015-03-01

To develop and psychometrically evaluate an information literacy (IL) self-efficacy survey and an IL knowledge test. In this test-retest reliability study, a 25-item IL self-efficacy survey and a 50-item IL knowledge test were developed and administered to a convenience sample of 53 chiropractic students. Item analyses were performed on all questions. The IL self-efficacy survey demonstrated good reliability (test-retest correlation = 0.81) and good/very good internal consistency (mean κ = .56 and Cronbach's α = .92). A total of 25 questions with the best item analysis characteristics were chosen from the 50-item IL knowledge test, resulting in a 25-item IL knowledge test that demonstrated good reliability (test-retest correlation = 0.87), very good internal consistency (mean κ = .69, KR20 = 0.85), and good item discrimination (mean point-biserial = 0.48). This study resulted in the development of three instruments: a 25-item IL self-efficacy survey, a 50-item IL knowledge test, and a 25-item IL knowledge test. The information literacy self-efficacy survey and the 25-item version of the information literacy knowledge test have shown preliminary evidence of adequate reliability and validity to justify continuing study with these instruments.

Development and psychometric evaluation of an information literacy self-efficacy survey and an information literacy knowledge test*

PubMed Central

Tepe, Rodger; Tepe, Chabha

2015-01-01

Objective To develop and psychometrically evaluate an information literacy (IL) self-efficacy survey and an IL knowledge test. Methods In this test–retest reliability study, a 25-item IL self-efficacy survey and a 50-item IL knowledge test were developed and administered to a convenience sample of 53 chiropractic students. Item analyses were performed on all questions. Results The IL self-efficacy survey demonstrated good reliability (test–retest correlation = 0.81) and good/very good internal consistency (mean κ = .56 and Cronbach's α = .92). A total of 25 questions with the best item analysis characteristics were chosen from the 50-item IL knowledge test, resulting in a 25-item IL knowledge test that demonstrated good reliability (test–retest correlation = 0.87), very good internal consistency (mean κ = .69, KR20 = 0.85), and good item discrimination (mean point-biserial = 0.48). Conclusions This study resulted in the development of three instruments: a 25-item IL self-efficacy survey, a 50-item IL knowledge test, and a 25-item IL knowledge test. The information literacy self-efficacy survey and the 25-item version of the information literacy knowledge test have shown preliminary evidence of adequate reliability and validity to justify continuing study with these instruments. PMID:25517736

Development of the Contact Lens User Experience: CLUE Scales

PubMed Central

Wirth, R. J.; Edwards, Michael C.; Henderson, Michael; Henderson, Terri; Olivares, Giovanna; Houts, Carrie R.

2016-01-01

ABSTRACT Purpose The field of optometry has become increasingly interested in patient-reported outcomes, reflecting a common trend occurring across the spectrum of healthcare. This article reviews the development of the Contact Lens User Experience: CLUE system designed to assess patient evaluations of contact lenses. CLUE was built using modern psychometric methods such as factor analysis and item response theory. Methods The qualitative process through which relevant domains were identified is outlined as well as the process of creating initial item banks. Psychometric analyses were conducted on the initial item banks and refinements were made to the domains and items. Following this data-driven refinement phase, a second round of data was collected to further refine the items and obtain final item response theory item parameters estimates. Results Extensive qualitative work identified three key areas patients consider important when describing their experience with contact lenses. Based on item content and psychometric dimensionality assessments, the developing CLUE instruments were ultimately focused around four domains: comfort, vision, handling, and packaging. Item response theory parameters were estimated for the CLUE item banks (377 items), and the resulting scales were found to provide precise and reliable assignment of scores detailing users’ subjective experiences with contact lenses. Conclusions The CLUE family of instruments, as it currently exists, exhibits excellent psychometric properties. PMID:27383257

Differential Item Functioning in Primary Healthcare Evaluation Instruments by French/English Version, Educational Level and Urban/Rural Location

PubMed Central

Haggerty, Jeannie L.; Bouharaoui, Fatima; Santor, Darcy A.

2011-01-01

Evaluating the extent to which groups or subgroups of individuals differ with respect to primary healthcare experience depends on first ruling out the possibility of bias. Objective: To determine whether item or subscale performance differs systematically between French/English, high/low education subgroups and urban/rural residency. Method: A sample of 645 adult users balanced by French/English language (in Quebec and Nova Scotia, respectively), high/low education and urban/rural residency responded to six validated instruments: the Primary Care Assessment Survey (PCAS); the Primary Care Assessment Tool – Short Form (PCAT-S); the Components of Primary Care Index (CPCI); the first version of the EUROPEP (EUROPEP-I); the Interpersonal Processes of Care Survey, version II (IPC-II); and part of the Veterans Affairs National Outpatient Customer Satisfaction Survey (VANOCSS). We normalized subscale scores to a 0-to-10 scale and tested for between-group differences using ANOVA tests. We used a parametric item response model to test for differences between subgroups in item discriminability and item difficulty. We re-examined group differences after removing items with differential item functioning. Results: Experience of care was assessed more positively in the English-speaking (Nova Scotia) than in the French-speaking (Quebec) respondents. We found differential English/French item functioning in 48% of the 153 items: discriminability in 20% and differential difficulty in 28%. English items were more discriminating generally than the French. Removing problematic items did not change the differences in French/English assessments. Differential item functioning by high/low education status affected 27% of items, with items being generally more discriminating in high-education groups. Between-group comparisons were unchanged. In contrast, only 9% of items showed differential item functioning by geography, affecting principally the accessibility attribute. Removing problematic items reversed a previously non-significant finding, revealing poorer first-contact access in rural than in urban areas. Conclusion: Differential item functioning does not bias or invalidate French/English comparisons on subscales, but additional development is required to make French and English items equivalent. These instruments are relatively robust by educational status and geography, but results suggest potential differences in the underlying construct in low-education and rural respondents. PMID:23205035

Trainees' Perceptions of Feedback: Validity Evidence for Two FEEDME (Feedback in Medical Education) Instruments.

PubMed

Bing-You, Robert; Ramesh, Saradha; Hayes, Victoria; Varaklis, Kalli; Ward, Denham; Blanco, Maria

2018-01-01

Construct: Medical educators consider feedback a core component of the educational process. Effective feedback allows learners to acquire new skills, knowledge, and attitudes. Learners' perceptions of feedback are an important aspect to assess with valid methods in order to improve the feedback skills of educators and the feedback culture. Although guidelines for delivering effective feedback have existed for several decades, medical students and residents often indicate that they receive little feedback. A recent scoping review on feedback in medical education did not reveal any validity evidence on instruments to assess learner's perceptions of feedback. The purpose of our study was to gather validity evidence on two novel FEEDME (Feedback in Medical Education) instruments to assess medical students' and residents' perceptions of the feedback that they receive. After the authors developed an initial instrument with 54 items, cognitive interviews with medical students and residents suggested that 2 separate instruments were needed, one focused on the feedback culture (FEEDME-Culture) and the other on the provider of feedback (FEEDME-Provider). A Delphi study with 17 medical education experts and faculty members assessed content validity. The response process was explored involving 31 medical students and residents at 2 academic institutions. Exploratory factor analysis and reliability analyses were performed on completed instruments. Two Delphi consultation rounds refined the wording of items and eliminated several items. Learners found both instruments easy and quick to answer; it took them less than 5 minutes to complete. Learners preferred an electronic format of the instruments over paper. Factor analysis revealed a two- and three-factor solution for the FEEDME-Culture and FEEDME-Provider instruments, respectively. Cronbach's alpha was greater than 0.80 for all factors. Items on both instruments were moderately to highly correlated (range, r = .3-.7). Our results provide preliminary validity evidence of 2 novel feedback instruments. After further validation of both FEEDME instruments, sharing the results of the FEEDME-Culture instrument with educational leaders and faculty may improve the culture of feedback on specific educational rotations and at the institutional level. The FEEDME-Provider instrument could be useful for faculty development targeting feedback skills. Additional research studies could assess whether both instruments may be used to help learners receive feedback and prompt reflective learning.

The development and psychometrical evaluation of a set of instruments to evaluate the effectiveness of diabetes patient education.

PubMed

Duprez, Veerle; De Pover, Marleen; De Spiegelaere, Marc; Beeckman, Dimitri

2014-02-01

To develop a set of psychometrically sound instruments to assess knowledge, self-management and self-efficacy of diabetic patients. Furthermore, a survey to evaluate the satisfaction about diabetes education for patients was developed and tested. Treatment and secondary prevention of diabetes require a complex combination of care components. Patients' education has been accepted to improve diabetes knowledge, self-management and self-efficacy. Psychometrically sound instruments are needed to measure these patient-centred outcomes. Psychometric instrument validation. The first phase included a systematic literature review to develop the instruments. Content validity was evaluated using a two-round Delphi procedure involving diabetes experts. The content validity of the instruments was excellent. In a second phase, a convenience sample of 188 diabetic patients in two hospitals in one specific care region in Belgium participated in the psychometric evaluation. The criterion-related validity and internal consistency reliability were evaluated. The study produced a 21-item knowledge instrument, reflecting knowledge about 'glycemic control' and 'medico-social management aspects'. The self-management instrument included 32 statements, reflecting 'treatment and compliance' and 'general lifestyle'. The self-efficacy instrument included 30 items, reflecting 'nutrition', 'treatment' and 'regimen'. The patient satisfaction survey included 36 items, reflecting satisfaction about the relationship among the diabetes specialist, the diabetes educator, podiatrist and dietician. An instrument set with sound psychometric characteristics was developed to assess knowledge, self-management and self-efficacy of diabetic patients. Future studies should focus on the association between the instrument outcomes and clinical patient outcomes. The current instrument can support the design of educational interventions and training programmes and reduce inconsistencies in the information that patients receive. Furthermore, the instruments can be used for benchmarking the quality of diabetic patient education. © 2013 Blackwell Publishing Ltd.

[Development of a measurement of intellectual capital for hospital nursing organizations].

PubMed

Kim, Eun A; Jang, Keum Seong

2011-02-01

This study was done to develop an instrument for measuring intellectual capital and assess its validity and reliability in identifying the components, human capital, structure capital and customer capital of intellectual capital in hospital nursing organizations. The participants were 950 regular clinical nurses who had worked for over 13 months in 7 medical hospitals including 4 national university hospitals and 3 private university hospitals. The data were collected through a questionnaire survey done from July 2 to August 25, 2009. Data from 906 nurses were used for the final analysis. Data were analyzed using descriptive statistics, Cronbach's alpha coefficients, item analysis, factor analysis (principal component analysis, Varimax rotation) with the SPSS PC+ 17.0 for Windows program. Developing the instrument for measuring intellectual capital in hospital nursing organizations involved a literature review, development of preliminary items, and verification of validity and reliability. The final instrument was in a self-report form on a 5-point Likert scale. There were 29 items on human capital (5 domains), 21 items on customer capital (4 domains), 26 items on structure capital (4 domains). The results of this study may be useful to assess the levels of intellectual capital of hospital nursing organizations.

[A self administered survey to assess bullying in schools].

PubMed

Lecannelier, Felipe; Varela, Jorge; Rodríguez, Jorge; Hoffmann, Marianela; Flores, Fernanda; Ascanio, Lorena

2011-04-01

Bullying is common in schools and has negative consequences. It can be assessed using a self-reported instrument. To validate a Spanish self-reporting tool called "Survey of High School Bullying Abuse of Power" (MIAP). The instrument has 13 questions, of which 7 are multiple choice, rendering a total of 49 items. It was applied to 2.341 children of seventh and eighth grade attending private, subsidized and municipal schools in the city of Concepción, Chile. Expert judge analysis and estimated reliability using the Cronbach Alpha were used to validate the survey. The instrument obtained a Cronbach Alpha coefficient of 0.8892, classified as good. This analysis generated four scales that explained 30.9% of the variance. They were called "Witness Bullying" with 18 items, accounting for 11.4% of the variance, "Bullying Victim" with 12 items, accounting for 7.5% of the variance, "Bullying Perpetrator and Severe bullying Victim", with 10 items explaining 6.4% of the variance and "Aggressor Bullying" with 6 items accounting for 5.7% of the variance. The MIAP can recognize four basic factors that facilitate the analysis and understanding of bullying, with good levels of reliability and validity. The remaining questions also deliver valuable information.

Nursing Care Interpersonal Relationship Questionnaire: elaboration and validation 1

PubMed Central

Borges, José Wicto Pereira; Moreira, Thereza Maria Magalhães; de Andrade, Dalton Franscisco

2018-01-01

ABSTRACT Objective: to elaborate an instrument for the measurement of the interpersonal relationship in nursing care through the Item Response Theory, and the validation thereof. Method: methodological study, which followed the three poles of psychometry: theoretical, empirical and analytical. The Nursing Care Interpersonal Relationship Questionnaire was developed in light of the Imogene King’s Interpersonal Conceptual Model and the psychometric properties were studied through the Item Response Theory in a sample of 950 patients attended in Primary, Secondary and Tertiary Health Care. Results: the final instrument consisted of 31 items, with Cronbach’s alpha of 0.90 and McDonald’s Omega of 0.92. The parameters of the Item Response Theory demonstrated high discrimination in 28 items, being developed a five-level interpretive scale. At the first level, the communication process begins, gaining a wealth of interaction. Subsequent levels demonstrate qualitatively the points of effectiveness of the interpersonal relationship with the involvement of behaviors related to the concepts of transaction and interaction, followed by the concept of role. Conclusion: the instrument was created and proved to be consistent to measure interpersonal relationship in nursing care, as it presented adequate reliability and validity parameters. PMID:29319743

Statistical power as a function of Cronbach alpha of instrument questionnaire items.

PubMed

Heo, Moonseong; Kim, Namhee; Faith, Myles S

2015-10-14

In countless number of clinical trials, measurements of outcomes rely on instrument questionnaire items which however often suffer measurement error problems which in turn affect statistical power of study designs. The Cronbach alpha or coefficient alpha, here denoted by C(α), can be used as a measure of internal consistency of parallel instrument items that are developed to measure a target unidimensional outcome construct. Scale score for the target construct is often represented by the sum of the item scores. However, power functions based on C(α) have been lacking for various study designs. We formulate a statistical model for parallel items to derive power functions as a function of C(α) under several study designs. To this end, we assume fixed true score variance assumption as opposed to usual fixed total variance assumption. That assumption is critical and practically relevant to show that smaller measurement errors are inversely associated with higher inter-item correlations, and thus that greater C(α) is associated with greater statistical power. We compare the derived theoretical statistical power with empirical power obtained through Monte Carlo simulations for the following comparisons: one-sample comparison of pre- and post-treatment mean differences, two-sample comparison of pre-post mean differences between groups, and two-sample comparison of mean differences between groups. It is shown that C(α) is the same as a test-retest correlation of the scale scores of parallel items, which enables testing significance of C(α). Closed-form power functions and samples size determination formulas are derived in terms of C(α), for all of the aforementioned comparisons. Power functions are shown to be an increasing function of C(α), regardless of comparison of interest. The derived power functions are well validated by simulation studies that show that the magnitudes of theoretical power are virtually identical to those of the empirical power. Regardless of research designs or settings, in order to increase statistical power, development and use of instruments with greater C(α), or equivalently with greater inter-item correlations, is crucial for trials that intend to use questionnaire items for measuring research outcomes. Further development of the power functions for binary or ordinal item scores and under more general item correlation strutures reflecting more real world situations would be a valuable future study.

A Machine Learning Recommender System to Tailor Preference Assessments to Enhance Person-Centered Care Among Nursing Home Residents.

PubMed

Gannod, Gerald C; Abbott, Katherine M; Van Haitsma, Kimberly; Martindale, Nathan; Heppner, Alexandra

2018-05-21

Nursing homes (NHs) using the Preferences for Everyday Living Inventory (PELI-NH) to assess important preferences and provide person-centered care find the number of items (72) to be a barrier to using the assessment. Using a sample of n = 255 NH resident responses to the PELI-NH, we used the 16 preference items from the MDS 3.0 Section F to develop a machine learning recommender system to identify additional PELI-NH items that may be important to specific residents. Much like the Netflix recommender system, our system is based on the concept of collaborative filtering whereby insights and predictions (e.g., filters) are created using the interests and preferences of many users. The algorithm identifies multiple sets of "you might also like" patterns called association rules, based upon responses to the 16 MDS preferences that recommends an additional set of preferences with a high likelihood of being important to a specific resident. In the evaluation of the combined apriori and logistic regression approach, we obtained a high recall performance (i.e., the ratio of correctly predicted preferences compared with all predicted preferences and nonpreferences) and high precision (i.e., the ratio of correctly predicted rules with respect to the rules predicted to be true) of 80.2% and 79.2%, respectively. The recommender system successfully provides guidance on how to best tailor the preference items asked of residents and can support preference capture in busy clinical environments, contributing to the feasibility of delivering person-centered care.

An instrument to assess the statistical intensity of medical research papers.

PubMed

Nieminen, Pentti; Virtanen, Jorma I; Vähänikkilä, Hannu

2017-01-01

There is widespread evidence that statistical methods play an important role in original research articles, especially in medical research. The evaluation of statistical methods and reporting in journals suffers from a lack of standardized methods for assessing the use of statistics. The objective of this study was to develop and evaluate an instrument to assess the statistical intensity in research articles in a standardized way. A checklist-type measure scale was developed by selecting and refining items from previous reports about the statistical contents of medical journal articles and from published guidelines for statistical reporting. A total of 840 original medical research articles that were published between 2007-2015 in 16 journals were evaluated to test the scoring instrument. The total sum of all items was used to assess the intensity between sub-fields and journals. Inter-rater agreement was examined using a random sample of 40 articles. Four raters read and evaluated the selected articles using the developed instrument. The scale consisted of 66 items. The total summary score adequately discriminated between research articles according to their study design characteristics. The new instrument could also discriminate between journals according to their statistical intensity. The inter-observer agreement measured by the ICC was 0.88 between all four raters. Individual item analysis showed very high agreement between the rater pairs, the percentage agreement ranged from 91.7% to 95.2%. A reliable and applicable instrument for evaluating the statistical intensity in research papers was developed. It is a helpful tool for comparing the statistical intensity between sub-fields and journals. The novel instrument may be applied in manuscript peer review to identify papers in need of additional statistical review.

Development of a Standardized Kalamazoo Communication Skills Assessment Tool for Radiologists: Validation, Multisource Reliability, and Lessons Learned.

PubMed

Brown, Stephen D; Rider, Elizabeth A; Jamieson, Katherine; Meyer, Elaine C; Callahan, Michael J; DeBenedectis, Carolynn M; Bixby, Sarah D; Walters, Michele; Forman, Sara F; Varrin, Pamela H; Forbes, Peter; Roussin, Christopher J

2017-08-01

The purpose of this study was to develop and test a standardized communication skills assessment instrument for radiology. The Delphi method was used to validate the Kalamazoo Communication Skills Assessment instrument for radiology by revising and achieving consensus on the 43 items of the preexisting instrument among an interdisciplinary team of experts consisting of five radiologists and four nonradiologists (two men, seven women). Reviewers assessed the applicability of the instrument to evaluation of conversations between radiology trainees and trained actors portraying concerned parents in enactments about bad news, radiation risks, and diagnostic errors that were video recorded during a communication workshop. Interrater reliability was assessed by use of the revised instrument to rate a series of enactments between trainees and actors video recorded in a hospital-based simulator center. Eight raters evaluated each of seven different video-recorded interactions between physicians and parent-actors. The final instrument contained 43 items. After three review rounds, 42 of 43 (98%) items had an average rating of relevant or very relevant for bad news conversations. All items were rated as relevant or very relevant for conversations about error disclosure and radiation risk. Reliability and rater agreement measures were moderate. The intraclass correlation coefficient range was 0.07-0.58; mean, 0.30; SD, 0.13; and median, 0.30. The range of weighted kappa values was 0.03-0.47; mean, 0.23; SD, 0.12; and median, 0.22. Ratings varied significantly among conversations (χ 2 6 = 1186; p < 0.0001) and varied significantly by viewing order, rater type, and rater sex. The adapted communication skills assessment instrument is highly relevant for radiology, having moderate interrater reliability. These findings have important implications for assessing the relational competencies of radiology trainees.

The Development of a Survey Instrument on South Dakota's School District Leadership Climate as Related to Deming's Fourteen Points.

ERIC Educational Resources Information Center

Holmes, Lawrence W. O.; And Others

Development of an instrument to measure baseline levels of applied Total Quality Management (TQM) practices in South Dakota before the introduction and dissemination of TQM theory to the state's educational leaders is described. Using the interpretation of Deming's 14 points that was developed by J. J. Bonstigl, a 115-item initial item pool was…

Evaluating an Instrument to Measure Mental Load and Mental Effort Considering Different Sources of Validity Evidence

ERIC Educational Resources Information Center

Krell, Moritz

2017-01-01

This study evaluates a 12-item instrument for subjective measurement of mental load (ML) and mental effort (ME) by analysing different sources of validity evidence. The findings of an expert judgement (N = 8) provide "evidence based on test content" that the formulation of the items corresponds to the meaning of ML and ME. An empirical…

A Stratified Study of Students' Understanding of Basic Optics Concepts in Different Contexts Using Two-Tier Multiple-Choice Items

ERIC Educational Resources Information Center

Chu, Hye-Eun; Treagust, David F.; Chandrasegaran, A. L.

2009-01-01

A large scale study involving 1786 year 7-10 Korean students from three school districts in Seoul was undertaken to evaluate their understanding of basic optics concepts using a two-tier multiple-choice diagnostic instrument consisting of four pairs of items, each of which evaluated the same concept in two different contexts. The instrument, which…

Using Cognitive Interviews to Pilot an International Survey of Principal Preparation: A Western Australian Perspective

ERIC Educational Resources Information Center

Wildy, Helen; Clarke, Simon

2009-01-01

This paper provides an example of the application of the cognitive interview, a qualitative tool for pre-testing a survey instrument to check its cognitive validity, that is, whether the items mean to respondents what they mean to the item designers. The instrument is the survey used in the final phase of the International Study of Principal…

Development and validation of an objective instrument to measure surgical performance at tonsillectomy.

PubMed

Roberson, David W; Kentala, Erna; Forbes, Peter

2005-12-01

The goals of this project were 1) to develop and validate an objective instrument to measure surgical performance at tonsillectomy, 2) to assess its interobserver and interobservation reliability and construct validity, and 3) to select those items with best reliability and most independent information to design a simplified form suitable for routine use in otolaryngology surgical evaluation. Prospective, observational data collection for an educational quality improvement project. The evaluation instrument was based on previous instruments developed in general surgery with input from attending otolaryngologic surgeons and experts in medical education. It was pilot tested and subjected to iterative improvements. After the instrument was finalized, a total of 55 tonsillectomies were observed and scored during academic year 2002 to 2003: 45 cases by residents at different points during their rotation, 5 by fellows, and 5 by faculty. Results were assessed for interobserver reliability, interobservation reliability, and construct validity. Factor analysis was used to identify items with independent information. Interobserver and interobservation reliability was high. On technical items, faculty substantially outperformed fellows, who in turn outperformed residents (P < .0001 for both comparisons). On the "global" scale (overall assessment), residents improved an average of 1 full point (on a 5 point scale) during a 3 month rotation (P = .01). In the subscale of "patient care," results were less clear cut: fellows outperformed residents, who in turn outperformed faculty, but only the fellows to faculty comparison was statistically significant (P = .04), and residents did not clearly improve over time (P = .36). Factor analysis demonstrated that technical items and patient care items factor separately and thus represent separate skill domains in surgery. It is possible to objectively measure surgical skill at tonsillectomy with high reliability and good construct validity. Factor analysis demonstrated that patient care is a distinct domain in surgical skill. Although the interobserver reliability for some patient care items reached statistical significance, it was not high enough for "high stakes testing" purposes. Using reliability and factor analysis results, we propose a simplified instrument for use in evaluating trainees in otolaryngologic surgery.

Consulting with children in the development of self-efficacy and recall tools related to nutrition and physical activity.

PubMed

Lassetter, Jane H; Ray, Gaye; Driessnack, Martha; Williams, Mary

2015-01-01

This article chronicles our efforts to develop an instrument with and for children-complete with insights, multiple iterations, and missteps along the way. The instruments we developed assess children's self-efficacy and recall related to healthy eating and physical activity. Five focus groups were held with 39 children to discuss the evolving instrument. A nine-item self-efficacy instrument and a 10-item recall instrument were developed with Flesch-Kincaid grade levels of 1.8 and 4.0, respectively, which fifth graders can complete in less than 5 min. When assessing children in clinical practice or research, we should use instruments that have been developed with children's feedback and are child-centered. Without that assurance, assessment results can be questionable. © 2014, Wiley Periodicals, Inc.

Missing content from health-related quality of life instruments: interviews with young adult survivors of childhood cancer.

PubMed

Quinn, Gwendolyn P; Huang, I-Chan; Murphy, Devin; Zidonik-Eddelton, Katie; Krull, Kevin R

2013-02-01

Young adult survivors of childhood cancer (YASCC) are an ever-growing cohort of survivors due to increasing advances in technology. Today, there is a shift of focus to not just ensuring survivorship but also the quality of survivorship, which can be assessed with standardized instruments. The majority of standardized health related quality of life (HRQoL) instruments, however, are non-specific to this age group and the unique late effects within YASCC populations. The purpose of this study was to investigate the relevance and accuracy of standardized HRQoL instruments used with YASCC. In a previous study, HRQoL items from several instruments (SF-36, QLACS, QLS-CS) were examined for relevance with a population of YASCC. Participants (n = 30) from this study were recruited for a follow-up qualitative interview to expand on their perceptions of missing content from existing instruments. Respondents reported missing, relevant content among all three of the HRQoL instruments. Results identified three content areas of missing information: (1) Perceived sense of self, (2) Relationships, and (3) Parenthood. Existing HRQoL instruments do not take into account the progression and interdependence of emotional development impacted by a cancer diagnosis. The themes derived from our qualitative interviews may serve as a foundation for the generation of new items in future HRQoL instruments for YASCC populations. Further testing is required to examine the prevalence, frequency, and breadth of these items in a larger sample.

Measuring Medical Housestaff Teamwork Performance Using Multiple Direct Observation Instruments: Comparing Apples and Apples.

PubMed

Weingart, Saul N; Yaghi, Omar; Wetherell, Matthew; Sweeney, Megan

2018-04-10

To examine the composition and concordance of existing instruments used to assess medical teams' performance. A trained observer joined 20 internal medicine housestaff teams for morning work rounds at Tufts Medical Center, a 415-bed Boston teaching hospital, from October through December 2015. The observer rated each team's performance using 9 teamwork observation instruments that examined domains including team structure, leadership, situation monitoring, mutual support, and communication. Observations recorded on paper forms were stored electronically. Scores were normalized from 1 (low) to 5 (high) to account for different rating scales. Overall mean scores were calculated and graphed; weighted scores adjusted for the number of items in each teamwork domain. Teamwork scores were analyzed using t-tests, pair-wise correlations, and the Kruskal-Wallis statistic, and team performance was compared across instruments by domain. The 9 tools incorporated 5 major domains, with 5-35 items per instrument for a total of 161 items per observation session. In weighted and unweighted analyses, the overall teamwork performance score for a given team on a given day varied by instrument. While all of the tools identified the same low outlier, high performers on some instruments were low performers on others. Inconsistent scores for a given team across instruments persisted in domain-level analyses. There was substantial variation in the rating of individual teams assessed concurrently by a single observer using multiple instruments. Since existing teamwork observation tools do not yield concordant assessments, researchers should create better tools for measuring teamwork performance.

Development of an Instrument for Measuring Self-Efficacy in Cell Biology

ERIC Educational Resources Information Center

Reeve, Suzanne; Kitchen, Elizabeth; Sudweeks, Richard R.; Bell, John D.; Bradshaw, William S.

2011-01-01

This article describes the development of a ten-item scale to assess biology majors' self-efficacy towards the critical thinking and data analysis skills taught in an upper-division cell biology course. The original seven-item scale was expanded to include three additional items based on the results of item analysis. Evidence of reliability and…

Assessing items on the SF-8 Japanese version for health-related quality of life: a psychometric analysis based on the nominal categories model of item response theory.

PubMed

Tokuda, Yasuharu; Okubo, Tomoya; Ohde, Sachiko; Jacobs, Joshua; Takahashi, Osamu; Omata, Fumio; Yanai, Haruo; Hinohara, Shigeaki; Fukui, Tsuguya

2009-06-01

The Short Form-8 (SF-8) questionnaire is a commonly used 8-item instrument of health-related quality of life (QOL) and provides a health profile of eight subdimensions. Our aim was to examine the psychometric properties of the Japanese version of the SF-8 instrument using methodology based on nominal categories model. Using data from an adjusted random sample from a nationally representative panel, the nominal categories modeling was applied to SF-8 items to characterize coverage of the latent trait (theta). Probabilities for response choices were described as functions on the latent trait. Information functions were generated based on the estimated item parameters. A total of 3344 participants (53%, women; median age, 35 years) provided responses. One factor was retained (eigenvalue, 4.65; variance proportion of 0.58) and used as theta. All item response category characteristic curves satisfied the monotonicity assumption in accurate order with corresponding ordinal responses. Four items (general health, bodily pain, vitality, and mental health) cover most of the spectrum of theta, while the other four items (physical function, role physical [role limitations because of physical health], social functioning, and role emotional [role limitations because of emotional problems] ) cover most of the negative range of theta. Information function for all items combined peaked at -0.7 of theta (information = 18.5) and decreased with increasing theta. The SF-8 instrument performs well among those with poor QOL across the continuum of the latent trait and thus can recognize more effectively persons with relatively poorer QOL than those with relatively better QOL.

Psychometric Evaluation of a Cultural Competency Assessment Instrument for Health Professionals

PubMed Central

Haywood, Sonja H.; Goode, Tawara; Gao, Yong; Smith, Kristyn; Bronheim, Suzanne; Flocke, Susan A; Zyzanski, Steve

2012-01-01

Background Few valid and reliable measures exist for health care professionals interested in determining their levels of cultural and linguistic competence. Objective To evaluate the measurement properties of the Cultural Competence Health Practitioner Assessment (CCHPA-129). Methods The CCHPA-129 is a 129-item web-based instrument, developed by the National Center for Cultural Competence (NCCC). Responses on the CCHPA -129 were examined using factor analysis; Rasch modeling; and Differential Item Functioning (DIF) across race, ethnicity, gender, and profession. Subjects 2504 practitioners, including 1864 nurses (RN/LPN,/BSN); 341 clinicians (PA/NP); and 299 physicians (MD/DO), who completed the CCHPA-129 online between 2005 and 2008. Results Three factors representing domains of knowledge, adapting practice, and promoting health for culturally and linguistically diverse populations accounted for 46% of the variance. Among Knowledge factor items, 53% (23/43) fit the Rasch model, item difficulties ranged from −1.01 logits (least difficult) to +1.11 logits (most difficult), separation index (SI) 13.82, and Cronbach’s α 0.92. Forty-seven percent (21/44) Adapting Practice factor items fit the model, item difficulties −0.07 to +1.11 logits, SI 11.59, Cronbach’s α 0.88; and 58% (23/39). Promoting Health factor items fit the model, item difficulties −1.01 to +1.38 logits, SI 22.64, Cronbach’s α 0.92. Early evidence of validity was established by known groups having statistically different scores. Conclusion The 67-item CCHPA-67 is psychometrically sound. This shorted instrument can be used to establish associations between practitioners’ cultural and linguistic competence and health outcomes as well as to evaluate interventions to increase practitioners’ cultural and linguistic competence. PMID:22437625

Use of Adult Patient Focus Groups to Develop the Initial Item Bank for a Cochlear Implant Quality-of-Life Instrument.

PubMed

McRackan, Theodore R; Velozo, Craig A; Holcomb, Meredith A; Camposeo, Elizabeth L; Hatch, Jonathan L; Meyer, Ted A; Lambert, Paul R; Melvin, Cathy L; Dubno, Judy R

2017-10-01

No instrument exists to assess quality of life (QOL) in adult cochlear implant (CI) users that has been developed and validated using accepted scientific standards. To develop a CI-specific QOL instrument for adults in accordance with the Patient Reported Outcomes Measurement Information System (PROMIS) guidelines. As required in the PROMIS guidelines, patient focus groups participated in creation of the initial item bank. Twenty-three adult CI users were divided into 1 of 3 focus groups stratified by word recognition ability. Three moderator-led focus groups were conducted based on grounded theory on December 3, 2016. Two reviewers independently analyzed focus group recordings and transcripts, with a third reviewer available to resolve discrepancies. All data were reviewed and reported according to the Consolidated Criteria for Reporting Qualitative Research. The setting was a tertiary referral center. Coded focus group data. The 23 focus group participants (10 [43%] female; mean [range] age, 68.1 [46.2-84.2] years) represented a wide range of income levels, education levels, listening modalities, CI device manufacturers, duration of CI use, and age at implantation. Data saturation was determined to be reached before the conclusion of each of the focus groups. After analysis of the transcripts, the central themes identified were communication, emotion, environmental sounds, independence and work function, listening effort, social isolation and ability to socialize, and sound clarity. Cognitive interviews were carried out on 20 adult CI patients who did not participate in the focus groups to ensure item clarity. Based on these results, the initial QOL item bank and prototype were developed. Patient focus groups drawn from the target population are the preferred method of identifying content areas and domains for developing the item bank for a CI-specific QOL instrument. Compared with previously used methods, the use of patient-centered item development for a CI-specific QOL instrument will more accurately reflect patient experience and increase our understanding of how CI use affects QOL.

Online Student Evaluation Improves Course Experience Questionnaire Results in a Physiotherapy Program

ERIC Educational Resources Information Center

Tucker, Beatrice; Jones, Sue; Straker, Leon

2008-01-01

This paper reports the use of an online student evaluation system, Course Experience on the Web (CEW), in a physiotherapy program to improve their Course Experience Questionnaire (CEQ) results. CEW comprises a course survey instrument modeled on the CEQ and a tailored unit survey instrument. Closure of the feedback loop is integral in the CEW…

The PROMIS Physical Function item bank was calibrated to a standardized metric and shown to improve measurement efficiency.

PubMed

Rose, Matthias; Bjorner, Jakob B; Gandek, Barbara; Bruce, Bonnie; Fries, James F; Ware, John E

2014-05-01

To document the development and psychometric evaluation of the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) item bank and static instruments. The items were evaluated using qualitative and quantitative methods. A total of 16,065 adults answered item subsets (n>2,200/item) on the Internet, with oversampling of the chronically ill. Classical test and item response theory methods were used to evaluate 149 PROMIS PF items plus 10 Short Form-36 and 20 Health Assessment Questionnaire-Disability Index items. A graded response model was used to estimate item parameters, which were normed to a mean of 50 (standard deviation [SD]=10) in a US general population sample. The final bank consists of 124 PROMIS items covering upper, central, and lower extremity functions and instrumental activities of daily living. In simulations, a 10-item computerized adaptive test (CAT) eliminated floor and decreased ceiling effects, achieving higher measurement precision than any comparable length static tool across four SDs of the measurement range. Improved psychometric properties were transferred to the CAT's superior ability to identify differences between age and disease groups. The item bank provides a common metric and can improve the measurement of PF by facilitating the standardization of patient-reported outcome measures and implementation of CATs for more efficient PF assessments over a larger range. Copyright © 2014. Published by Elsevier Inc.

Relative Validity and Reliability of a 1-Week, Semiquantitative Food Frequency Questionnaire for Women Participating in the Supplemental Nutrition Assistance Program.

PubMed

Sanjeevi, Namrata; Freeland-Graves, Jeanne; George, Goldy Chacko

2017-12-01

The Supplemental Nutrition Assistance Program (SNAP) plays a critical role in reducing food insecurity by distribution of benefits at a monthly interval to participants. Households that receive assistance from SNAP spend at least three-quarters of benefits within the first 2 weeks of receipt. Because this expenditure pattern may be associated with lower food intake toward the end of the month, it is important to develop a tool that can assess the weekly diets of SNAP participants. The goal of this study was to develop and assess the relative validity and reliability of a semiquantitative 1-week food frequency questionnaire (FFQ) tailored to a population of women participating in SNAP. The FFQ was derived from an existing 195-item FFQ that was based on a reference period of 1 month. This 195-item FFQ has been validated in a population of low-income postpartum women who were recruited from central Texas during 2004. Mean daily servings of each food item in the 195-item FFQ completed by women who took part in the 2004 validation study were calculated to determine the most frequently consumed food items. Emphasis on these items led to the creation of a shorter, 1-week FFQ of only 95 items. This new 1-week instrument was compared with 3-day diet records to evaluate relative validity in a sample of women participating in SNAP. For reliability, the FFQ was administered a second time, separated by a 1-month time interval. The validity study included 70 female SNAP participants who were recruited from the partner agencies of the Central Texas Food Bank from March to June 2015. A subsample of 40 women participated in the reliability study. Outcome measures were mean nutrient intake values obtained from the two tests of the 95-item FFQ and 3-day diet records. Deattenuated Pearson correlation coefficients examined relationships in nutrient intake between the 95-item FFQ and 3-day diet records, and a paired samples t test determined differences in mean nutrient intake. Weighted Cohen's κ indicated agreement in quartile classification of study participants by the 95-item FFQ and 3-day diet records, according to nutrient intake. Test-retest reliability was assessed by intraclass correlations and weighted Cohen's κ. Mean deattenuated Pearson correlation between the FFQ and 3-day diet records was 0.61, and the weighted Cohen's κ=0.39. Finally, the average test-retest correlation and weighted Cohen's κ of the FFQ was 0.66 and 0.50, respectively. These results suggest that the 1-week, 95-item FFQ demonstrated acceptable relative validity and reliability in low-income women participating in SNAP in southwestern United States. Copyright © 2017 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

What constitutes patient safety culture in Chinese hospitals?

PubMed

Zhu, Junya; Li, Liping; Li, Yuxia; Shi, Meiyu; Lu, Haiying; Garnick, Deborah W; Weingart, Saul N

2012-06-01

To develop a patient safety culture instrument for use in Chinese hospitals, we assessed the appropriateness of existing safety culture questionnaires used in the USA and Japan for Chinese respondents and identified new items and domains suitable to Chinese hospitals. Focus group study. Twenty-four physicians, nurses and other health-care workers from 11 hospitals in three Chinese cities. Three focus groups were conducted in 2010 to elicit information from hospital workers about their perceptions of the appropriateness and importance of each of 97 questionnaire items, derived from a literature review and an expert panel, characterizing hospital safety culture. understood the concepts of patient safety and safety culture and identified features associated with safe care. They judged that numerous questions from existing surveys were inappropriate, including 39 items that were dropped because they were judged unimportant, semantically redundant, confusing, ambiguous or inapplicable in Chinese settings. Participants endorsed eight new items and three additional dimensions addressing staff training, mentoring of new hires, compliance with rules and procedures, equipment availability and leadership walk-rounds they judged appropriate to assessing safety culture in Chinese hospitals. This process resulted in a 66-item instrument for testing in cognitive interviews, the next stage of survey development. Focus group participants provided important insights into the refinement of existing items and the construction of new items for measuring patient safety culture in Chinese hospitals. This is a necessary first step in producing a culturally appropriate instrument applicable to specific local contexts.

Developing and testing an instrument for identifying performance incentives in the Greek health care sector.

PubMed

Paleologou, Victoria; Kontodimopoulos, Nick; Stamouli, Aggeliki; Aletras, Vassilis; Niakas, Dimitris

2006-09-13

In the era of cost containment, managers are constantly pursuing increased organizational performance and productivity by aiming at the obvious target, i.e. the workforce. The health care sector, in which production processes are more complicated compared to other industries, is not an exception. In light of recent legislation in Greece in which efficiency improvement and achievement of specific performance targets are identified as undisputable health system goals, the purpose of this study was to develop a reliable and valid instrument for investigating the attitudes of Greek physicians, nurses and administrative personnel towards job-related aspects, and the extent to which these motivate them to improve performance and increase productivity. A methodological exploratory design was employed in three phases: a) content development and assessment, which resulted in a 28-item instrument, b) pilot testing (N = 74) and c) field testing (N = 353). Internal consistency reliability was tested via Cronbach's alpha coefficient and factor analysis was used to identify the underlying constructs. Tests of scaling assumptions, according to the Multitrait-Multimethod Matrix, were used to confirm the hypothesized component structure. Four components, referring to intrinsic individual needs and external job-related aspects, were revealed and explain 59.61% of the variability. They were subsequently labeled: job attributes, remuneration, co-workers and achievement. Nine items not meeting item-scale criteria were removed, resulting in a 19-item instrument. Scale reliability ranged from 0.782 to 0.901 and internal item consistency and discriminant validity criteria were satisfied. Overall, the instrument appears to be a promising tool for hospital administrations in their attempt to identify job-related factors, which motivate their employees. The psychometric properties were good and warrant administration to a larger sample of employees in the Greek healthcare system.

Climate of Respect Evaluation in ICUs: Development of an Instrument (ICU-CORE).

PubMed

Beach, Mary Catherine; Topazian, Rachel; Chan, Kitty S; Sugarman, Jeremy; Geller, Gail

2018-06-01

To develop a valid, reliable measure that reflected the environment of respectfulness within the ICU setting. We developed a preliminary survey instrument based on conceptual domains of respect identified through prior qualitative analyses of ICU patient, family member, and clinician perspectives. The initial instrument consisted of 21 items. After five cognitive interviews and 16 pilot surveys, we revised the instrument to include 23 items. We used standard psychometric methods to analyze the instrument. Eight ICUs serving adult patients affiliated with a large university health system. ICU clinicians. None. Based on 249 responses, we identified three factors and created subscales: General Respect, Respectful Behaviors, and Disrespectful Behaviors. The General Respect subscale had seven items (α = 0.932) and reflected how often patients in the ICU are treated with respect, in a dignified manner, as an individual, equally to all other patients, on the "same level" as the ICU team, as a person, and as you yourself would want to be treated. The Respectful Behaviors subscale had 10 items (α = 0.926) and reflected how often the ICU team responds to patient and/or family anxiety, makes an effort to get to know the patient and family as people, listens carefully, explains things thoroughly, gives the opportunity to provide input into care, protects patient modesty, greets when entering room, and talks to sedated patients. The subscale measuring disrespect has four items (α = 0.702) and reflects how often the ICU team dismisses family concerns, talks down to patients and families, speaks disrespectfully behind their backs, and gets frustrated with patients and families. We created a reliable set of scales to measure the climate of respectfulness in intensive care settings. These measures can be used for ongoing quality improvement that aim to enhance the experience of ICU patients and their families.

Developing and testing an instrument for identifying performance incentives in the Greek health care sector

PubMed Central

Paleologou, Victoria; Kontodimopoulos, Nick; Stamouli, Aggeliki; Aletras, Vassilis; Niakas, Dimitris

2006-01-01

Background In the era of cost containment, managers are constantly pursuing increased organizational performance and productivity by aiming at the obvious target, i.e. the workforce. The health care sector, in which production processes are more complicated compared to other industries, is not an exception. In light of recent legislation in Greece in which efficiency improvement and achievement of specific performance targets are identified as undisputable health system goals, the purpose of this study was to develop a reliable and valid instrument for investigating the attitudes of Greek physicians, nurses and administrative personnel towards job-related aspects, and the extent to which these motivate them to improve performance and increase productivity. Methods A methodological exploratory design was employed in three phases: a) content development and assessment, which resulted in a 28-item instrument, b) pilot testing (N = 74) and c) field testing (N = 353). Internal consistency reliability was tested via Cronbach's alpha coefficient and factor analysis was used to identify the underlying constructs. Tests of scaling assumptions, according to the Multitrait-Multimethod Matrix, were used to confirm the hypothesized component structure. Results Four components, referring to intrinsic individual needs and external job-related aspects, were revealed and explain 59.61% of the variability. They were subsequently labeled: job attributes, remuneration, co-workers and achievement. Nine items not meeting item-scale criteria were removed, resulting in a 19-item instrument. Scale reliability ranged from 0.782 to 0.901 and internal item consistency and discriminant validity criteria were satisfied. Conclusion Overall, the instrument appears to be a promising tool for hospital administrations in their attempt to identify job-related factors, which motivate their employees. The psychometric properties were good and warrant administration to a larger sample of employees in the Greek healthcare system. PMID:16970823

Instrument Psychometrics: Parental Satisfaction and Quality Indicators of Perinatal Palliative Care.

PubMed

Wool, Charlotte

2015-10-01

Despite a life-limiting fetal diagnosis, prenatal attachment often occurs in varying degrees resulting in role identification by an individual as a parent. Parents recognize quality care and report their satisfaction when interfacing with health care providers. The aim was to test an instrument measuring parental satisfaction and quality indicators with parents electing to continue a pregnancy after learning of a life-limiting fetal diagnosis. A cross sectional survey design gathered data using a computer-mediated platform. Subjects were parents (n=405) who opted to continue a pregnancy affected by a life-limiting diagnosis. Factor analysis using principal component analysis with Varimax rotation was used to validate the instrument, evaluate components, and summarize the explained variance achieved among quality indicator items. The Prenatal Scale was reduced to 37 items with a three-component solution explaining 66.19% of the variance and internal consistency reliability of 0.98. The Intrapartum Scale included 37 items with a four-component solution explaining 66.93% of the variance and a Cronbach α of 0.977. The Postnatal Scale was reduced to 44 items with a six-component solution explaining 67.48% of the variance. Internal consistency reliability was 0.975. The Parental Satisfaction and Quality Indicators of Perinatal Palliative Care Instrument is a valid and reliable measure for parent-reported quality care and satisfaction. Use of this instrument will enable clinicians and researchers to measure quality indicators and parental satisfaction. The instrument is useful for assessing, analyzing, and reporting data on quality for care delivered during the prenatal, intrapartum, and postnatal periods.

Developing an instrument to measure emotional behaviour abilities of meaningful learning through the Delphi technique.

PubMed

Cadorin, Lucia; Bagnasco, Annamaria; Tolotti, Angela; Pagnucci, Nicola; Sasso, Loredana

2017-09-01

To identify items for a new instrument that measures emotional behaviour abilities of meaningful learning, according to Fink's Taxonomy. Meaningful learning is an active process that promotes a wider and deeper understanding of concepts. It is the result of an interaction between new and previous knowledge and produces a long-term change of knowledge and skills. To measure meaningful learning capability, it is very important in the education of health professionals to identify problems or special learning needs. For this reason, it is necessary to create valid instruments. A Delphi Study technique was implemented in four phases by means of e-mail. The study was conducted from April-September 2015. An expert panel consisting of ten researchers with experience in Fink's Taxonomy was established to identify the items of the instrument. Data were analysed for conceptual description and item characteristics and attributes were rated. Expert consensus was sought in each of these phases. An 87·5% consensus cut-off was established. After four rounds, consensus was obtained for validation of the content of the instrument 'Assessment of Meaningful learning Behavioural and Emotional Abilities'. This instrument consists of 56 items evaluated on a 6-point Likert-type scale. Foundational Knowledge, Application, Integration, Human Dimension, Caring and Learning How to Learn were the six major categories explored. This content validated tool can help educators (teachers, trainers and tutors) to identify and improve the strategies to support students' learning capability, which could increase their awareness of and/or responsibility in the learning process. © 2017 John Wiley & Sons Ltd.

Assessment of Differential Item Functioning in the Experiences of Discrimination Index

PubMed Central

Cunningham, Timothy J.; Berkman, Lisa F.; Gortmaker, Steven L.; Kiefe, Catarina I.; Jacobs, David R.; Seeman, Teresa E.; Kawachi, Ichiro

2011-01-01

The psychometric properties of instruments used to measure self-reported experiences of discrimination in epidemiologic studies are rarely assessed, especially regarding construct validity. The authors used 2000–2001 data from the Coronary Artery Risk Development in Young Adults (CARDIA) Study to examine differential item functioning (DIF) in 2 versions of the Experiences of Discrimination (EOD) Index, an index measuring self-reported experiences of racial/ethnic and gender discrimination. DIF may confound interpretation of subgroup differences. Large DIF was observed for 2 of 7 racial/ethnic discrimination items: White participants reported more racial/ethnic discrimination for the “at school” item, and black participants reported more racial/ethnic discrimination for the “getting housing” item. The large DIF by race/ethnicity in the index for racial/ethnic discrimination probably reflects item impact and is the result of valid group differences between blacks and whites regarding their respective experiences of discrimination. The authors also observed large DIF by race/ethnicity for 3 of 7 gender discrimination items. This is more likely to have been due to item bias. Users of the EOD Index must consider the advantages and disadvantages of DIF adjustment (omitting items, constructing separate measures, and retaining items). The EOD Index has substantial usefulness as an instrument that can assess self-reported experiences of discrimination. PMID:22038104

Item-Level Psychometrics of the Glasgow Outcome Scale: Extended Structured Interviews.

PubMed

Hong, Ickpyo; Li, Chih-Ying; Velozo, Craig A

2016-04-01

The Glasgow Outcome Scale-Extended (GOSE) structured interview captures critical components of activities and participation, including home, shopping, work, leisure, and family/friend relationships. Eighty-nine community dwelling adults with mild-moderate traumatic brain injury (TBI) were recruited (average = 2.7 year post injury). Nine items of the 19 items were used for the psychometrics analysis purpose. Factor analysis and item-level psychometrics were investigated using the Rasch partial-credit model. Although the principal components analysis of residuals suggests that a single measurement factor dominates the measure, the instrument did not meet the factor analysis criteria. Five items met the rating scale criteria. Eight items fit the Rasch model. The instrument demonstrated low person reliability (0.63), low person strata (2.07), and a slight ceiling effect. The GOSE demonstrated limitations in precisely measuring activities/participation for individuals after TBI. Future studies should examine the impact of the low precision of the GOSE on effect size. © The Author(s) 2016.

The Multidimensional Assessment of Interoceptive Awareness (MAIA)

PubMed Central

Mehling, Wolf E.; Price, Cynthia; Daubenmier, Jennifer J.; Acree, Mike; Bartmess, Elizabeth; Stewart, Anita

2012-01-01

This paper describes the development of a multidimensional self-report measure of interoceptive body awareness. The systematic mixed-methods process involved reviewing the current literature, specifying a multidimensional conceptual framework, evaluating prior instruments, developing items, and analyzing focus group responses to scale items by instructors and patients of body awareness-enhancing therapies. Following refinement by cognitive testing, items were field-tested in students and instructors of mind-body approaches. Final item selection was achieved by submitting the field test data to an iterative process using multiple validation methods, including exploratory cluster and confirmatory factor analyses, comparison between known groups, and correlations with established measures of related constructs. The resulting 32-item multidimensional instrument assesses eight concepts. The psychometric properties of these final scales suggest that the Multidimensional Assessment of Interoceptive Awareness (MAIA) may serve as a starting point for research and further collaborative refinement. PMID:23133619

Development and initial validation of an instrument to assess stressors among South African sports coaches.

PubMed

Kubayi, Alliance; Toriola, Abel; Didymus, Faye

2018-06-01

The aim of this series of studies was to develop and initially validate an instrument to assess stressors among South African sports coaches. In study one, a preliminary pool of 45 items was developed based on existing literature and an expert panel was employed to assess the content validity and applicability of these items. In study two, the 32 items that were retained after study one were analysed using principal component analysis (PCA). The resultant factorial structure comprised four components: environmental stressors, performance stressors, task-related stressors, and athlete stressors. These four components were made up of 26 items and, together, the components and items comprised the provisional Stressors in Sports Coaching Questionnaire (SSCQ). The results show that the SSCQ demonstrates acceptable internal consistency (.73-.89). The findings provide preliminary evidence that SSCQ is a valid tool to assess stressors among South African sports coaches.

Development of the PRE-HIT instrument: patient readiness to engage in health information technology.

PubMed

Koopman, Richelle J; Petroski, Gregory F; Canfield, Shannon M; Stuppy, Julie A; Mehr, David R

2014-01-28

Technology-based aids for lifestyle change are becoming more prevalent for chronic conditions. Important "digital divides" remain, as well as concerns about privacy, data security, and lack of motivation. Researchers need a way to characterize participants' readiness to use health technologies. To address this need, we created an instrument to measure patient readiness to engage with health technologies among adult patients with chronic conditions. Initial focus groups to determine domains, followed by item development and refinement, and exploratory factor analysis to determine final items and factor structure. The development sample included 200 patients with chronic conditions from 6 family medicine clinics. From 98 potential items, 53 best candidate items were examined using exploratory factor analysis. Pearson's Correlation for Test/Retest reliability at 3 months. The final instrument had 28 items that sorted into 8 factors with associated Cronbach's alpha: 1) Health Information Need (0.84), 2) Computer/Internet Experience (0.87), 3) Computer Anxiety (0.82), 4) Preferred Mode of Interaction (0.73), 5) Relationship with Doctor (0.65), 6) Cell Phone Expertise (0.75), 7) Internet Privacy (0.71), and 8) No News is Good News (0.57). Test-retest reliability for the 8 subscales ranged from (0.60 to 0.85). The Patient Readiness to Engage in Health Internet Technology (PRE-HIT) instrument has good psychometric properties and will be an aid to researchers investigating technology-based health interventions. Future work will examine predictive validity.

Development of the PRE-HIT instrument: patient readiness to engage in health information technology

PubMed Central

2014-01-01

Background Technology-based aids for lifestyle change are becoming more prevalent for chronic conditions. Important “digital divides” remain, as well as concerns about privacy, data security, and lack of motivation. Researchers need a way to characterize participants’ readiness to use health technologies. To address this need, we created an instrument to measure patient readiness to engage with health technologies among adult patients with chronic conditions. Methods Initial focus groups to determine domains, followed by item development and refinement, and exploratory factor analysis to determine final items and factor structure. The development sample included 200 patients with chronic conditions from 6 family medicine clinics. From 98 potential items, 53 best candidate items were examined using exploratory factor analysis. Pearson’s Correlation for Test/Retest reliability at 3 months. Results The final instrument had 28 items that sorted into 8 factors with associated Cronbach’s alpha: 1) Health Information Need (0.84), 2) Computer/Internet Experience (0.87), 3) Computer Anxiety (0.82), 4) Preferred Mode of Interaction (0.73), 5) Relationship with Doctor (0.65), 6) Cell Phone Expertise (0.75), 7) Internet Privacy (0.71), and 8) No News is Good News (0.57). Test-retest reliability for the 8 subscales ranged from (0.60 to 0.85). Conclusion The Patient Readiness to Engage in Health Internet Technology (PRE-HIT) instrument has good psychometric properties and will be an aid to researchers investigating technology-based health interventions. Future work will examine predictive validity. PMID:24472182

Using item response theory to address vulnerabilities in FFQ.

PubMed

Kazman, Josh B; Scott, Jonathan M; Deuster, Patricia A

2017-09-01

The limitations for self-reporting of dietary patterns are widely recognised as a major vulnerability of FFQ and the dietary screeners/scales derived from FFQ. Such instruments can yield inconsistent results to produce questionable interpretations. The present article discusses the value of psychometric approaches and standards in addressing these drawbacks for instruments used to estimate dietary habits and nutrient intake. We argue that a FFQ or screener that treats diet as a 'latent construct' can be optimised for both internal consistency and the value of the research results. Latent constructs, a foundation for item response theory (IRT)-based scales (e.g. Patient Reported Outcomes Measurement Information System) are typically introduced in the design stage of an instrument to elicit critical factors that cannot be observed or measured directly. We propose an iterative approach that uses such modelling to refine FFQ and similar instruments. To that end, we illustrate the benefits of psychometric modelling by using items and data from a sample of 12 370 Soldiers who completed the 2012 US Army Global Assessment Tool (GAT). We used factor analysis to build the scale incorporating five out of eleven survey items. An IRT-driven assessment of response category properties indicates likely problems in the ordering or wording of several response categories. Group comparisons, examined with differential item functioning (DIF), provided evidence of scale validity across each Army sub-population (sex, service component and officer status). Such an approach holds promise for future FFQ.

Iranian Effective Clinical Nurse Instructor evaluation tool: Development and psychometric testing

PubMed Central

Shahsavari, Hooman; Yekta, Zohreh Parsa; Zare, Zahra; Sigaroodi, Abdolhossain Emami

2014-01-01

Background: Clinical education is the heart of the nursing education program. Effective nursing clinical instructors are needed for graduating the future qualified nurses. There is a well-developed body of knowledge about the effectiveness of clinical teaching and the instructors. However, translating this knowledge into a context-based evaluation tool for measuring the effectiveness of Iranian clinical nursing instructors remains a deficiency. The purpose of this study is to describe the development and psychometric testing process of an instrument to evaluate the characteristics of Iranian effective clinical nurse instructor. Materials and Methods: Following a precise review of Iranian literatures and expert consultation, 83 statements about the characteristics that make clinical nurse instructors effective were extracted. In the next phase, the psychometric properties of the instrument were established by looking at the content validity, face validity, and internal consistency. Content validity of the instrument was assessed based on the comments of an expert panel including 10 nursing faculty members. During this phase, 30 items of the instrument were omitted or merged. Face validity of the instrument was assured based on the advices of 10 nursing students and 10 nursing faculty members. Finally, in the pilot test, the data of 168 filled questionnaires were gathered and analyzed by an exploratory factor analysis to reduce the items and identify the factor structure of the instrument. Results: Through subsequent analyses, of the 83 items, 31 items were merged or omitted. At last, 52 retained items were divided into four subscales including student-centric behaviors, clinical performances, planning ability, and personality traits. The Cronbach's alpha level of the inventory was 0.96, with the value for each domain ranging from 0.87 to 0.94. Conclusions: Iranian Effective Clinical Nurse Instructor evaluation tool has acceptable psychometric properties and can be used in evaluating the effectiveness of clinical nursing instructors. PMID:24834081

Development of a patient safety climate survey for Chinese hospitals: cross-national adaptation and psychometric evaluation.

PubMed

Zhu, Junya; Li, Liping; Zhao, Hailei; Han, Guangshu; Wu, Albert W; Weingart, Saul N

2014-10-01

Existing patient safety climate instruments, most of which have been developed in the USA, may not accurately reflect the conditions in the healthcare systems of other countries. To develop and evaluate a patient safety climate instrument for healthcare workers in Chinese hospitals. Based on a review of existing instruments, expert panel review, focus groups and cognitive interviews, we developed items relevant to patient safety climate in Chinese hospitals. The draft instrument was distributed to 1700 hospital workers from 54 units in six hospitals in five Chinese cities between July and October 2011, and 1464 completed surveys were received. We performed exploratory and confirmatory factor analyses and estimated internal consistency reliability, within-unit agreement, between-unit variation, unit-mean reliability, correlation between multi-item composites, and association between the composites and two single items of perceived safety. The final instrument included 34 items organised into nine composites: institutional commitment to safety, unit management support for safety, organisational learning, safety system, adequacy of safety arrangements, error reporting, communication and peer support, teamwork and staffing. All composites had acceptable unit-mean reliabilities (≥0.74) and within-unit agreement (Rwg ≥0.71), and exhibited significant between-unit variation with intraclass correlation coefficients ranging from 9% to 21%. Internal consistency reliabilities ranged from 0.59 to 0.88 and were ≥0.70 for eight of the nine composites. Correlations between composites ranged from 0.27 to 0.73. All composites were positively and significantly associated with the two perceived safety items. The Chinese Hospital Survey on Patient Safety Climate demonstrates adequate dimensionality, reliability and validity. The integration of qualitative and quantitative methods is essential to produce an instrument that is culturally appropriate for Chinese hospitals. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Using qualitative and quantitative formative research to develop tailored nutrition intervention materials for a diverse low-income audience.

PubMed

Strolla, Leslie O; Gans, Kim M; Risica, Patricia M

2006-08-01

More effective nutrition education to reach low-income and ethnic minority populations is needed. As part of a project to develop a tailored nutrition education intervention to meet the needs of low-income Hispanics and non-Hispanics, complementary, mixed methods of formative research were used to determine specific characteristics of the target population. The aim was to ensure that the full array of nutrition messages would be comprehensive enough to effectively tailor to the level of the individual. Barriers to healthy eating were delineated for three main dietary behaviors (number of items delineated in parentheses): lowering fat (11), increasing fruit (8) and increasing vegetables (6). Information was also collected regarding motivators for healthy eating (5), situational barriers to making healthy choices (4), other nutrition-related interests (8) and typical eating habits and food-related choices of the target audience.

14 CFR 121.303 - Airplane instruments and equipment.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 14 Aeronautics and Space 3 2012-01-01 2012-01-01 false Airplane instruments and equipment. 121.303... Airplane instruments and equipment. (a) Unless otherwise specified, the instrument and equipment... airspeed limitation and item of related information in the Airplane Flight Manual and pertinent placards...

14 CFR 121.303 - Airplane instruments and equipment.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 14 Aeronautics and Space 3 2013-01-01 2013-01-01 false Airplane instruments and equipment. 121.303... Airplane instruments and equipment. (a) Unless otherwise specified, the instrument and equipment... airspeed limitation and item of related information in the Airplane Flight Manual and pertinent placards...

14 CFR 121.303 - Airplane instruments and equipment.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 14 Aeronautics and Space 3 2011-01-01 2011-01-01 false Airplane instruments and equipment. 121.303... Airplane instruments and equipment. (a) Unless otherwise specified, the instrument and equipment... airspeed limitation and item of related information in the Airplane Flight Manual and pertinent placards...

14 CFR 121.303 - Airplane instruments and equipment.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 14 Aeronautics and Space 3 2014-01-01 2014-01-01 false Airplane instruments and equipment. 121.303... Airplane instruments and equipment. (a) Unless otherwise specified, the instrument and equipment... airspeed limitation and item of related information in the Airplane Flight Manual and pertinent placards...

14 CFR 121.303 - Airplane instruments and equipment.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 14 Aeronautics and Space 3 2010-01-01 2010-01-01 false Airplane instruments and equipment. 121.303... Airplane instruments and equipment. (a) Unless otherwise specified, the instrument and equipment... airspeed limitation and item of related information in the Airplane Flight Manual and pertinent placards...

The matter in extreme conditions instrument at the Linac Coherent Light Source

DOE PAGES

Nagler, Bob; Arnold, Brice; Bouchard, Gary; ...

2015-04-21

The LCLS beam provides revolutionary capabilities for studying the transient behavior of matter in extreme conditions. The particular strength of the Matter in Extreme Conditions instrument is that it combines the unique LCLS beam with high-power optical laser beams, and a suite of dedicated diagnostics tailored for this field of science. In this paper an overview of the beamline, the capabilities of the instrumentation, and selected highlights of experiments and commissioning results are presented.

Measuring Alexithymia via Trait Approach-I: A Alexithymia Scale Item Selection and Formation of Factor Structure

PubMed Central

TATAR, Arkun; SALTUKOĞLU, Gaye; ALİOĞLU, Seda; ÇİMEN, Sümeyye; GÜVEN, Hülya; AY, Çağla Ebru

2017-01-01

Introduction It is not clear in the literature whether available instruments are sufficient to measure alexithymia because of its theoretical structure. Moreover, it has been reported that several measuring instruments are needed to measure this construct, and all the instruments have different error sources. The old and the new forms of Toronto Alexithymia Scale are the only instruments available in Turkish. Thus, the purpose of this study was to develop a new scale to measure alexithymia, selecting items and constructing the factor structure. Methods A total of 1117 patients aged from 19 to 82 years (mean = 35.05 years) were included. A 100-item pool was prepared and applied to 628 women and 489 men. Data were analyzed using Explanatory Factor Analysis, Confirmatory Factor Analysis, and Item Response Theory and 28 items were selected. The new form of 28 items was applied to 415 university students, including 271 women and 144 men aged from 18 to 30 (mean=21.44). Results The results of Explanatory Factor Analysis revealed a five-factor construct of “Solving and Expressing Affective Experiences,” “External Locused Cognitive Style,” “Tendency to Somatize Affections,” “Imaginary Life and Visualization,” and “Acting Impulsively,” along with a two-factor construct representing the “Affective” and “Cognitive” components. All the components of the construct showed good model fit and high internal consistency. The new form was tested in terms of internal consistency, test-retest reliability, and concurrent validity using Toronto Alexithymia Scale as criteria and discriminative validity using Five-Factor Personality Inventory Short Form. Conclusion The results showed that the new scale met the basic psychometric requirements. Results have been discussed in line with related studies. PMID:29033633

Person-centred care in nurse-led outpatient rheumatology clinics: Conceptualization and initial development of a measurement instrument.

PubMed

Bala, Sidona-Valentina; Forslind, Kristina; Fridlund, Bengt; Samuelson, Karin; Svensson, Björn; Hagell, Peter

2018-06-01

Person-centred care (PCC) is considered a key component of effective illness management and high-quality care. However, the PCC concept is underdeveloped in outpatient care. In rheumatology, PCC is considered an unmet need and its further development and evaluation is of high priority. The aim of the present study was to conceptualize and operationalize PCC, in order to develop an instrument for measuring patient-perceived PCC in nurse-led outpatient rheumatology clinics. A conceptual outpatient PCC framework was developed, based on the experiences of people with rheumatoid arthritis (RA), person-centredness principles and existing PCC frameworks. The resulting framework was operationalized into the PCC instrument for outpatient care in rheumatology (PCCoc/rheum), which was tested for acceptability and content validity among 50 individuals with RA attending a nurse-led outpatient clinic. The conceptual framework focuses on the meeting between the person with RA and the nurse, and comprises five interrelated domains: social environment, personalization, shared decision-making, empowerment and communication. Operationalization of the domains into a pool of items generated a preliminary PCCoc/rheum version, which was completed in a mean (standard deviation) of 5.3 (2.5) min. Respondents found items easy to understand (77%) and relevant (93%). The Content Validity Index of the PCCoc/rheum was 0.94 (item level range, 0.87-1.0). About 80% of respondents considered some items redundant. Based on these results, the PCCoc/rheum was revised into a 24-item questionnaire. A conceptual outpatient PCC framework and a 24-item questionnaire intended to measure PCC in nurse-led outpatient rheumatology clinics were developed. The extent to which the questionnaire represents a measurement instrument remains to be tested. Copyright © 2018 John Wiley & Sons, Ltd.

The PROactive innovative conceptual framework on physical activity.

PubMed

Dobbels, Fabienne; de Jong, Corina; Drost, Ellen; Elberse, Janneke; Feridou, Chryssoula; Jacobs, Laura; Rabinovich, Roberto; Frei, Anja; Puhan, Milo A; de Boer, Willem I; van der Molen, Thys; Williams, Kate; Pinnock, Hillary; Troosters, Thierry; Karlsson, Niklas; Kulich, Karoly; Rüdell, Katja

2014-11-01

Although physical activity is considered an important therapeutic target in chronic obstructive pulmonary disease (COPD), what "physical activity" means to COPD patients and how their perspective is best measured is poorly understood. We designed a conceptual framework, guiding the development and content validation of two patient reported outcome (PRO) instruments on physical activity (PROactive PRO instruments). 116 patients from four European countries with diverse demographics and COPD phenotypes participated in three consecutive qualitative studies (63% male, age mean±sd 66±9 years, 35% Global Initiative for Chronic Obstructive Lung Disease stage III-IV). 23 interviews and eight focus groups (n = 54) identified the main themes and candidate items of the framework. 39 cognitive debriefings allowed the clarity of the items and instructions to be optimised. Three themes emerged, i.e. impact of COPD on amount of physical activity, symptoms experienced during physical activity, and adaptations made to facilitate physical activity. The themes were similar irrespective of country, demographic or disease characteristics. Iterative rounds of appraisal and refinement of candidate items resulted in 30 items with a daily recall period and 34 items with a 7-day recall period. For the first time, our approach provides comprehensive insight on physical activity from the COPD patients' perspective. The PROactive PRO instruments' content validity represents the pivotal basis for empirically based item reduction and validation. ©ERS 2014.

Development of a Scale to Assess Knowledge about Suicide Postvention Using Item Response Theory

ERIC Educational Resources Information Center

Nader, Ingo W.; Niederkrotenthaler, Thomas; Schild, Anne H. E.; Koller, Ingrid; Tran, Ulrich S.; Kapusta, Nestor D.; Sonneck, Gernot; Voracek, Martin

2013-01-01

Knowledge about suicide postvention (KSPV) is an important distal outcome in the evaluation of suicide prevention programs that focus on the bereaved. However, most scales are specifically tailored to the evaluation study in question and psychometric properties are often unsatisfactory. Therefore, we developed the KSPV scale. Scale properties were…

Variable-Length Computerized Adaptive Testing: Adaptation of the A-Stratified Strategy in Item Selection with Content Balancing

ERIC Educational Resources Information Center

Huo, Yan

2009-01-01

Variable-length computerized adaptive testing (CAT) can provide examinees with tailored test lengths. With the fixed standard error of measurement ("SEM") termination rule, variable-length CAT can achieve predetermined measurement precision by using relatively shorter tests compared to fixed-length CAT. To explore the application of…

Desirable Difficulty and Other Predictors of Effective Item Orderings

ERIC Educational Resources Information Center

Tang, Steven; Gogel, Hannah; McBride, Elizabeth; Pardos, Zachary A.

2015-01-01

Online adaptive tutoring systems are increasingly being used in classrooms as a way to provide guided learning for students. Such tutors have the potential to provide tailored feedback based on specific student needs and misunderstandings. Bayesian knowledge tracing (BKT) is used to model student knowledge when knowledge is assumed to be changing…

The Theory about CD-CAT Based on FCA and Its Application

ERIC Educational Resources Information Center

Shuqun, Yang; Shuliang, Ding; Zhiqiang, Yao

2009-01-01

Cognitive diagnosis (CD) plays an important role in intelligent tutoring system. Computerized adaptive testing (CAT) is adaptive, fair, and efficient, which is suitable to large-scale examination. Traditional cognitive diagnostic test needs quite large number of items, the efficient and tailored CAT could be a remedy for it, so the CAT with…

[Assessment of criminal responsibility in paraphilic disorder. Can the severity of the disorder be assessed with items of standardized prognostic instruments?].

PubMed

Briken, P; Müller, J L

2014-03-01

Assessment of the severity of paraphilic disorders is an important aspect of psychiatric court reports for assessing criminal responsibility and placement in a forensic psychiatric hospital according to the German penal code (§§ 20, 21, 63 StGB). The minimum requirements for appraisal of criminal responsibility published by an interdisciplinary working group under the guidance of the German Federal Court of Justice define the standards for this procedure. This paper presents a research concept that aims to assess the severity of paraphilic disorders by using items of standardized prognostic instruments. In addition to a formal diagnosis according to the international classification of diseases (ICD) and the diagnostic and statistical manual of mental diseases (DSM) criteria, the items "deviant sexual interests" and "sexual preoccupations" from the prognosis instrument Stable 2007 are used to assess the severity of paraphilic disorders. Other criteria, such as "relationship deficits" are used to support the appraisal of the severity of the disorder. The items "sexual preoccupation", "emotional collapse" and "collapse of social support" from the prognosis instrument Acute 2007 are used to assess the capacity for self-control. In a next step the validity and reliability of this concept will be tested.

Student Questionnaire. [Harvard Project Physics

ERIC Educational Resources Information Center

Welch, Wayne W.; Ahlgren, Andrew

This 60-item questionnaire was designed to gather general background information from students who had used the Harvard Project Physics curriculum. The instrument includes three 20-item subscales: (1) attitude toward physics, (2) career interest, and (3) student characteristics. Items are multiple choice (5 options), and the introductory material…

Developing an Initial Physical Function Item Bank from Existing Sources.

ERIC Educational Resources Information Center

Bode, Rita K.; Cella, David; Lai, Jin-shei; Heinemann, Allen W.

2003-01-01

Illustrates incremental item banking using health-related quality of life data collected from two samples of patients receiving cancer treatment (n=1,755 and n=1,544). Results support findings from previous studies that have equated separate instruments by co-calibrating their items. (SLD)

A More Fine-Grained Measure of Students' Acceptance of Evolution: Development of the Inventory of Student Evolution Acceptance—I-SEA

NASA Astrophysics Data System (ADS)

Nadelson, Louis S.; Southerland, Sherry

2012-07-01

The potential influences of affective perceptions on cognitive engagement in learning, particularly with emotionally charged topics such as evolution, provide justification for acknowledging and assessing learners' attitudes toward content. One approach to determining students' attitudes toward a construct is to explicitly ask them to what degree they accept the related content. This was the approach we took as we developed the Inventory of Student Evolution Acceptance. Our goal was to make a finer-grained instrument that would assess acceptance on three evolution subscales: microevolution, macroevolution, and human evolution. Further, we sought to not conflate understanding with acceptance of the constructs. We began our instrument development with a series of interviews and open-ended questionnaires to determine students' perceptions of evolution acceptance. Based on the responses we developed and field tested a 49-item Likert scale instrument with stems distributed across our three targeted subscales. Using the data from our field test, we reduced the instrument to 24 items evenly distributed across the three subscales, and the revised instrument was again field tested with high school and undergraduate college students. The final instrument has an internal reliability of Cronbach's alpha of 0.96 and the items loaded onto three components that reflect documented evolution acceptance conditions. The instrument development, implications, and applications are discussed.

The Comparative Effectiveness of Different Item Analysis Techniques in Increasing Change Score Reliability.

ERIC Educational Resources Information Center

Crocker, Linda M.; Mehrens, William A.

Four new methods of item analysis were used to select subsets of items which would yield measures of attitude change. The sample consisted of 263 students at Michigan State University who were tested on the Inventory of Beliefs as freshmen and retested on the same instrument as juniors. Item change scores and total change scores were computed for…

Item Banks for Measuring Emotional Distress from the Patient-Reported Outcomes Measurement Information System (PROMIS[R]): Depression, Anxiety, and Anger

ERIC Educational Resources Information Center

Pilkonis, Paul A.; Choi, Seung W.; Reise, Steven P.; Stover, Angela M.; Riley, William T.; Cella, David

2011-01-01

The authors report on the development and calibration of item banks for depression, anxiety, and anger as part of the Patient-Reported Outcomes Measurement Information System (PROMIS[R]). Comprehensive literature searches yielded an initial bank of 1,404 items from 305 instruments. After qualitative item analysis (including focus groups and…

Present status of aircraft instruments

NASA Technical Reports Server (NTRS)

1932-01-01

This report gives a brief description of the present state of development and of the performance characteristics of instruments included in the following group: speed instruments, altitude instruments, navigation instruments, power-plant instruments, oxygen instruments, instruments for aerial photography, fog-flying instruments, general problems, summary of instrument and research problems. The items considered under performance include sensitivity, scale errors, effects of temperature and pressure, effects of acceleration and vibration, time lag, damping, leaks, elastic defects, and friction.

Psychometric properties of WHOQOL-BREF in clinical and health Greek populations: incorporating new culture-relevant items.

PubMed

Ginieri-Coccossis, M; Triantafillou, E; Tomaras, V; Soldatos, C; Mavreas, V; Christodoulou, G

2012-01-01

Τhe present study examines main psychometric properties of the World Health Organisation (WHO) quality of life (QoL) instrument, the WHOQOL-BREF with the inclusion of four national items. Participants were 425 adult native Greek speaking, grouped into patients with physical disorders, psychiatric disorders and healthy individuals. Participants were administered WHOQOL-BREF and 23 national items, the General Health Questionnaire (GHQ-28) and the Life Satisfaction Index (LSI). Confirmatory factor analysis produced acceptable fit values for the original model of 26 items within the four WHOQOL domains: physical health, psychological health, social relationships and environment. Testing for the fit of national items within this model, the results indicated four new items with the most satisfactory fit indices and were thus included forming a 30-items version. The national items refer to: (a) nutrition, (b) satisfaction with work (both loaded in the physical health domain), (c) home life and (d) social life (both loaded in the social relationships domain). Statistical tests were applied to the 26- and 30-items versions producing satisfactory results, with the 30-items version showing slightly better values. Furthermore, results on the 30-items version included: (a) internal consistency, which was found satisfactory, with alpha values ranging from α=0.67-0.81, while the inclusion of new items produced higher alpha values in physical health and social relationships domains, (b) construct validity with good item-domain correlations, as well as strong correlations between domain scores, (c) convergent validity, which was very satisfactory, showing good correlations with GHQ-28 and LSI, (d) discriminant validity, showing instrument's ability to detect QoL differences between healthy and unhealthy participants, and between physically ill and psychiatric patients, and (e) test-retest reliability, with ICC scores in excess of 0.80 obtaining for all domains. The WHOQOL-BREF Greek version was found to perform well with sick and healthy participants, demonstrating satisfactory psychometric properties. Use of the instrument may be recommended for clinical and general populations, for service or intervention evaluation, as well as for cross-cultural clinical trials.

Standard NIM Instrumentation System

DOE Office of Scientific and Technical Information (OSTI.GOV)

Costrell, Louis; Lenkszus, Frank R.; Rudnick, Stanley J.

NIM is a standard modular instrumentation system that is in wide use throughout the world. As the NIM system developed and accommodations were made to a dynamic instrumentation field and a rapidly advancing technology, additions, revisions and clarifications were made. These were incorporated into the standard in the form of addenda and errata. This standard is a revision of the NIM document, AEC Report TID-20893 (Rev 4) dated July 1974. It includes all the addenda and errata items that were previously issued as well as numerous additional items to make the standard current with modern technology and manufacturing practice.

An Instrument to Assess Self-Statements During Public Speaking: Scale Development and Preliminary Psychometric Properties

PubMed Central

Hofmann, Stefan G.; DiBartolo, Patricia Marten

2006-01-01

Public speaking is the most commonly reported fearful social situation. Although a number of contemporary theories emphasize the importance of cognitive processes in social anxiety, there is no instrument available to assess fearful thoughts experienced during public speaking. The Self-Statements During Public Speaking (SSPS) scale is a 10-item questionnaire consisting of two 5-item subscales, the “Positive Self-Statements” (SSPS-P) and the “Negative Self-Statements” subscale (SSPS-N). Four studies report on the development and the preliminary psychometric properties of this instrument. PMID:16763666

The development and validation of an instrument to measure preservice teachers' self-efficacy in regard to the teaching of science as inquiry

NASA Astrophysics Data System (ADS)

Dira-Smolleck, Lori

The purpose of this study was to develop, validate and establish the reliability of an instrument that measures preservice teachers' self-efficacy in regard to the teaching of science as inquiry. The instrument (TSI) is based upon the work of Bandura, Riggs, and Enochs & Riggs (1990). The study used Bandura's theoretical framework in that the instrument uses the self-efficacy construct to explore the beliefs of prospective elementary science teachers with regards to the teaching of science through inquiry: specifically, the two dimensions of self-efficacy beliefs defined by Bandura: personal self-efficacy and outcome expectancy. Self-efficacy in regard to the teaching of science as inquiry was measured through the use of a 69-item Likert scale instrument designed by the author of the study. A 13-step plan was designed and followed in the process of developing the instrument. Using the results from Chronbach Alpha and Analysis of Variance, a 69-item instrument was found to achieve the greatest balance across the construct validity, reliability and item balance with the Essential Elements of Classroom Inquiry content matrix. Based on the standardized development processes used and the associated evidence, the TSI appears to be a content and construct valid instrument, with high internal reliability for use with prospective elementary teachers to assess self-efficacy beliefs in regard to the teaching of science as inquiry. Implications for research, policy and practice are also discussed.

Translation and validation of the Malay version of the Stroke Knowledge Test.

PubMed

Sowtali, Siti Noorkhairina; Yusoff, Dariah Mohd; Harith, Sakinah; Mohamed, Monniaty

2016-04-01

To date, there is a lack of published studies on assessment tools to evaluate the effectiveness of stroke education programs. This study developed and validated the Malay language version of the Stroke Knowledge Test research instrument. This study involved translation, validity, and reliability phases. The instrument underwent backward and forward translation of the English version into the Malay language. Nine experts reviewed the content for consistency, clarity, difficulty, and suitability for inclusion. Perceived usefulness and utilization were obtained from experts' opinions. Later, face validity assessment was conducted with 10 stroke patients to determine appropriateness of sentences and grammar used. A pilot study was conducted with 41 stroke patients to determine the item analysis and reliability of the translated instrument using the Kuder Richardson 20 or Cronbach's alpha. The final Malay version Stroke Knowledge Test included 20 items with good content coverage, acceptable item properties, and positive expert review ratings. Psychometric investigations suggest that Malay version Stroke Knowledge Test had moderate reliability with Kuder Richardson 20 or Cronbach's alpha of 0.58. Improvement is required for Stroke Knowledge Test items with unacceptable difficulty indices. Overall, the average rating of perceived usefulness and perceived utility of the instruments were both 72.7%, suggesting that reviewers were likely to use the instruments in their facilities. Malay version Stroke Knowledge Test was a valid and reliable tool to assess educational needs and to evaluate stroke knowledge among participants of group-based stroke education programs in Malaysia.

Variations in disability and quality of life with age and sex between eight lower income and middle-income countries: data from the INDEPTH WHO-SAGE collaboration.

PubMed

Gomez-Olive, Francesc Xavier; Schröders, Julia; Aboderin, Isabella; Byass, Peter; Chatterji, Somnath; Davies, Justine I; Debpuur, Cornelius; Hirve, Siddhivinayak; Hodgson, Abraham; Juvekar, Sanjay; Kahn, Kathleen; Kowal, Paul; Nathan, Rose; Ng, Nawi; Razzaque, Abdur; Sankoh, Osman; Streatfield, Peter K; Tollman, Stephen M; Wilopo, Siswanto A; Witham, Miles D

2017-01-01

Disability and quality of life are key outcomes for older people. Little is known about how these measures vary with age and gender across lower income and middle-income countries; such information is necessary to tailor health and social care policy to promote healthy ageing and minimise disability. We analysed data from participants aged 50 years and over from health and demographic surveillance system sites of the International Network for the Demographic Evaluation of Populations and their Health Network in Ghana, Kenya, Tanzania, South Africa, Vietnam, India, Indonesia and Bangladesh, using an abbreviated version of the WHO Study on global AGEing survey instrument. We used the eight-item WHO Quality of Life (WHOQoL) tool to measure quality of life and theWHO Disability Assessment Schedule, version 2 (WHODAS-II) tool to measure disability. We collected selected health status measures via the survey instrument and collected demographic and socioeconomic data from linked surveillance site information. We performed regression analyses to quantify differences between countries in the relationship between age, gender and both quality of life and disability, and we used anchoring vignettes to account for differences in interpretation of disability severity. We included 43 935 individuals in the analysis. Mean age was 63.7 years (SD 9.7) and 24 434 (55.6%) were women. In unadjusted analyses across all countries, WHOQoL scores worsened by 0.13 points (95% CI 0.12 to 0.14) per year increase in age and WHODAS scores worsened by 0.60 points (95% CI 0.57 to 0.64). WHODAS-II and WHOQoL scores varied markedly between countries, as did the gradient of scores with increasing age. In regression analyses, differences were not fully explained by age, socioeconomic status, marital status, education or health factors. Differences in disability scores between countries were not explained by differences in anchoring vignette responses. The relationship between age, sex and both disability and quality of life varies between countries. The findings may guide tailoring of interventions to individual country needs, although these associations require further study.

The development and exploratory analysis of the Back Pain Attitudes Questionnaire (Back-PAQ)

PubMed Central

Darlow, Ben; Perry, Meredith; Mathieson, Fiona; Stanley, James; Melloh, Markus; Marsh, Reginald; Baxter, G David; Dowell, Anthony

2014-01-01

Objectives To develop an instrument to assess attitudes and underlying beliefs about back pain, and subsequently investigate its internal consistency and underlying structures. Design The instrument was developed by a multidisciplinary team of clinicians and researchers based on analysis of qualitative interviews with people experiencing acute and chronic back pain. Exploratory analysis was conducted using data from a population-based cross-sectional survey. Setting Qualitative interviews with community-based participants and subsequent postal survey. Participants Instrument development informed by interviews with 12 participants with acute back pain and 11 participants with chronic back pain. Data for exploratory analysis collected from New Zealand residents and citizens aged 18 years and above. 1000 participants were randomly selected from the New Zealand Electoral Roll. 602 valid responses were received. Measures The 34-item Back Pain Attitudes Questionnaire (Back-PAQ) was developed. Internal consistency was evaluated by the Cronbach α coefficient. Exploratory analysis investigated the structure of the data using Principal Component Analysis. Results The 34-item long form of the scale had acceptable internal consistency (α=0.70; 95% CI 0.66 to 0.73). Exploratory analysis identified five two-item principal components which accounted for 74% of the variance in the reduced data set: ‘vulnerability of the back’; ‘relationship between back pain and injury’; ‘activity participation while experiencing back pain’; ‘prognosis of back pain’ and ‘psychological influences on recovery’. Internal consistency was acceptable for the reduced 10-item scale (α=0.61; 95% CI 0.56 to 0.66) and the identified components (α between 0.50 and 0.78). Conclusions The 34-item long form of the scale may be appropriate for use in future cross-sectional studies. The 10-item short form may be appropriate for use as a screening tool, or an outcome assessment instrument. Further testing of the 10-item Back-PAQ's construct validity, reliability, responsiveness to change and predictive ability needs to be conducted. PMID:24860003

Improving Measurement Efficiency of the Inner EAR Scale with Item Response Theory.

PubMed

Jessen, Annika; Ho, Andrew D; Corrales, C Eduardo; Yueh, Bevan; Shin, Jennifer J

2018-02-01

Objectives (1) To assess the 11-item Inner Effectiveness of Auditory Rehabilitation (Inner EAR) instrument with item response theory (IRT). (2) To determine whether the underlying latent ability could also be accurately represented by a subset of the items for use in high-volume clinical scenarios. (3) To determine whether the Inner EAR instrument correlates with pure tone thresholds and word recognition scores. Design IRT evaluation of prospective cohort data. Setting Tertiary care academic ambulatory otolaryngology clinic. Subjects and Methods Modern psychometric methods, including factor analysis and IRT, were used to assess unidimensionality and item properties. Regression methods were used to assess prediction of word recognition and pure tone audiometry scores. Results The Inner EAR scale is unidimensional, and items varied in their location and information. Information parameter estimates ranged from 1.63 to 4.52, with higher values indicating more useful items. The IRT model provided a basis for identifying 2 sets of items with relatively lower information parameters. Item information functions demonstrated which items added insubstantial value over and above other items and were removed in stages, creating a 8- and 3-item Inner EAR scale for more efficient assessment. The 8-item version accurately reflected the underlying construct. All versions correlated moderately with word recognition scores and pure tone averages. Conclusion The 11-, 8-, and 3-item versions of the Inner EAR scale have strong psychometric properties, and there is correlational validity evidence for the observed scores. Modern psychometric methods can help streamline care delivery by maximizing relevant information per item administered.

Developing an item bank to measure the coping strategies of people with hereditary retinal diseases.

PubMed

Prem Senthil, Mallika; Khadka, Jyoti; De Roach, John; Lamey, Tina; McLaren, Terri; Campbell, Isabella; Fenwick, Eva K; Lamoureux, Ecosse L; Pesudovs, Konrad

2018-05-05

Our understanding of the coping strategies used by people with visual impairment to manage stress related to visual loss is limited. This study aims to develop a sophisticated coping instrument in the form of an item bank implemented via Computerised adaptive testing (CAT) for hereditary retinal diseases. Items on coping were extracted from qualitative interviews with patients which were supplemented by items from a literature review. A systematic multi-stage process of item refinement was carried out followed by expert panel discussion and cognitive interviews. The final coping item bank had 30 items. Rasch analysis was used to assess the psychometric properties. A CAT simulation was carried out to estimate an average number of items required to gain precise measurement of hereditary retinal disease-related coping. One hundred eighty-nine participants answered the coping item bank (median age = 58 years). The coping scale demonstrated good precision and targeting. The standardised residual loadings for items revealed six items grouped together. Removal of the six items reduced the precision of the main coping scale and worsened the variance explained by the measure. Therefore, the six items were retained within the main scale. Our CAT simulation indicated that, on average, less than 10 items are required to gain a precise measurement of coping. This is the first study to develop a psychometrically robust coping instrument for hereditary retinal diseases. CAT simulation indicated that on an average, only four and nine items were required to gain measurement at moderate and high precision, respectively.

Assessing child and adolescent pragmatic language competencies: toward evidence-based assessments.

PubMed

Russell, Robert L; Grizzle, Kenneth L

2008-06-01

Using language appropriately and effectively in social contexts requires pragmatic language competencies (PLCs). Increasingly, deficits in PLCs are linked to child and adolescent disorders, including autism spectrum, externalizing, and internalizing disorders. As the role of PLCs expands in diagnosis and treatment of developmental psychopathology, psychologists and educators will need to appraise and select clinical and research PLC instruments for use in assessments and/or studies. To assist in this appraisal, 24 PLC instruments, containing 1,082 items, are assessed by addressing four questions: (1) Can PLC domains targeted by assessment items be reliably identified?, (2) What are the core PLC domains that emerge across the 24 instruments?, (3) Do PLC questionnaires and tests assess similar PLC domains?, and (4) Do the instruments achieve content, structural, diagnostic, and ecological validity? Results indicate that test and questionnaire items can be reliably categorized into PLC domains, that PLC domains featured in questionnaires and tests significantly differ, and that PLC instruments need empirical confirmation of their dimensional structure, content validity across all developmental age bands, and ecological validity. Progress in building a better evidence base for PLC assessments should be a priority in future research.

Preliminary Results for the PAR-PRO: A Measure of Home and Community Participation

PubMed Central

Ostir, Glenn V.; Granger, Carl V.; Black, Terrie; Roberts, Pamela; Burgos, Laura; Martinkewiz, Paula; Ottenbacher, Kenneth J.

2007-01-01

Objective To develop a measure of home and community participation related to the World Health Organization’s International Classification of Functioning, Disability and Health. Design Cross-sectional analysis of survey data. Setting Nine medical inpatient rehabilitation facilities from 6 states. Participants A total of 594 patients of mixed impairment type admitted for inpatient rehabilitation in 2002. Mean age was 74.0 years and 61.4% were women. Interventions Not applicable. Main Outcome Measures Reliability and validity of the participation instrument. Results A 20-item instrument of home and community participation was developed (PAR-PRO). The instrument showed good internal consistency and good Rasch person and item fit statistics. Four subfactors were identified beyond the unidimensional construct of participation including domestic management, socialization, physical vigor, and generative activities. The PAR-PRO total participation score correlated inversely with age (r=−.31, P<.001) but did not differ by sex. Conclusions The 20-item PAR-PRO instrument of home and community participation displayed good psychometric characteristics. The instrument shows promise as a broad measure of home and community involvement for persons with disabilities. Further work is needed to support its application for people without disability. PMID:16876548

Use and Appreciation of a Web-Based, Tailored Intervention (E-health4Uth) Combined With Counseling to Promote Adolescents’ Health in Preventive Youth Health Care: Survey and Log-File Analysis

PubMed Central

Bannink, Rienke; Broeren, Suzanne; Joosten-van Zwanenburg, Evelien; van As, Els; van de Looij-Jansen, Petra

2014-01-01

Background Health promotion for adolescents is important in the prevention of mental health problems and health-risk behaviors. We implemented two interventions in a preventive youth health care setting. Adolescents in the E-health4Uth group received Web-based, tailored messages on their health behavior and well-being. Adolescents in the E-health4Uth and counseling group received the same tailored messages, but were subsequently referred to a school nurse for a consultation if they were at risk of mental health problems. Objective This study evaluated the use and appreciation of these Web-based, tailored messages and additional consultation with a school nurse. Differences in use and appreciation according to demographics (ie, gender, level of education, and ethnicity) of the adolescents were also assessed. Methods Two youth health care organizations participated in this study and conducted the interventions in 12 secondary schools. In total, 1702 adolescents participated; 533 in the E-health4Uth group, 554 in the E-health4Uth and counseling group, and 615 in the control group (ie, care as usual). Adolescents completed an evaluation questionnaire assessing the use and appreciation of the tailored messages immediately after receiving these messages and at a 4-month follow-up. After the consultation, adolescents and nurses completed an evaluation questionnaire on the use and appreciation of the consultation. Results The majority of the adolescents (845/1034, 81.72%) indicated they had read the tailored messages. Most items on the use and appreciation of the tailored messages and the program were scored positive (overall satisfaction on a scale from 1, most-negative, to 10, most-positive: mean 6.70, SD 1.60). In general, adolescents in vocational training, girls, and adolescents of non-Dutch ethnicity, indicated they used the tailored messages more often and appreciated the content of the messages better than adolescents receiving preuniversity education, boys, and adolescents of Dutch ethnicity, respectively (all P<.05). In the E-health4Uth and counseling group, 18.6% (103/553) of the adolescents were referred to a nurse. Adolescents in vocational training and girls were more often referred to a nurse than adolescents receiving preuniversity education (P=.007) and boys (P=.03), respectively. Adolescents and nurses positively evaluated the consultation (overall satisfaction of adolescents: mean 8.07, SD 1.21). Adolescents in vocational training attended the consultation more often (P=.047) and considered the consultation a more valuable addition to the tailored messages than adolescents receiving preuniversity education (P=.034). Conclusions The Web-based, tailored messages and additional consultation were used and appreciated positively by adolescents and nurses. The consultation seems a valuable addition to the tailored messages. However, the tailored messages might need further improvement since adolescents did not rate all evaluation items about these messages explicitly positive. As these interventions were already interweaved with the existing practice of the preventive youth health care, they are especially promising for future implementation. Trial Registration Netherlands Trial Register Number (NTR): NTR3596; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=3596 (Archived by WebCite at http://www.webcitation.org/6LryL42zH). PMID:24394676

Use and Appreciation of a Web-Based, Tailored Intervention (E-health4Uth) Combined With Counseling to Promote Adolescents' Health in Preventive Youth Health Care: Survey and Log-File Analysis.

PubMed

Bannink, Rienke; Broeren, Suzanne; Joosten-van Zwanenburg, Evelien; van As, Els; van de Looij-Jansen, Petra; Raat, Hein

2014-01-06

Health promotion for adolescents is important in the prevention of mental health problems and health-risk behaviors. We implemented two interventions in a preventive youth health care setting. Adolescents in the E-health4Uth group received Web-based, tailored messages on their health behavior and well-being. Adolescents in the E-health4Uth and counseling group received the same tailored messages, but were subsequently referred to a school nurse for a consultation if they were at risk of mental health problems. This study evaluated the use and appreciation of these Web-based, tailored messages and additional consultation with a school nurse. Differences in use and appreciation according to demographics (ie, gender, level of education, and ethnicity) of the adolescents were also assessed. Two youth health care organizations participated in this study and conducted the interventions in 12 secondary schools. In total, 1702 adolescents participated; 533 in the E-health4Uth group, 554 in the E-health4Uth and counseling group, and 615 in the control group (ie, care as usual). Adolescents completed an evaluation questionnaire assessing the use and appreciation of the tailored messages immediately after receiving these messages and at a 4-month follow-up. After the consultation, adolescents and nurses completed an evaluation questionnaire on the use and appreciation of the consultation. The majority of the adolescents (845/1034, 81.72%) indicated they had read the tailored messages. Most items on the use and appreciation of the tailored messages and the program were scored positive (overall satisfaction on a scale from 1, most-negative, to 10, most-positive: mean 6.70, SD 1.60). In general, adolescents in vocational training, girls, and adolescents of non-Dutch ethnicity, indicated they used the tailored messages more often and appreciated the content of the messages better than adolescents receiving preuniversity education, boys, and adolescents of Dutch ethnicity, respectively (all P<.05). In the E-health4Uth and counseling group, 18.6% (103/553) of the adolescents were referred to a nurse. Adolescents in vocational training and girls were more often referred to a nurse than adolescents receiving preuniversity education (P=.007) and boys (P=.03), respectively. Adolescents and nurses positively evaluated the consultation (overall satisfaction of adolescents: mean 8.07, SD 1.21). Adolescents in vocational training attended the consultation more often (P=.047) and considered the consultation a more valuable addition to the tailored messages than adolescents receiving preuniversity education (P=.034). The Web-based, tailored messages and additional consultation were used and appreciated positively by adolescents and nurses. The consultation seems a valuable addition to the tailored messages. However, the tailored messages might need further improvement since adolescents did not rate all evaluation items about these messages explicitly positive. As these interventions were already interweaved with the existing practice of the preventive youth health care, they are especially promising for future implementation. Netherlands Trial Register Number (NTR): NTR3596; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=3596 (Archived by WebCite at http://www.webcitation.org/6LryL42zH).

Validation of a psychometric instrument to assess motivation in veterinary bachelor students.

PubMed

Vandeweerd, Jean-Michel; Dugdale, Alexandra; Romainville, Marc

2014-01-01

There are indications that motivation correlates with better performance for those studying veterinary medicine. To assess objectively whether motivation profiles influence both veterinary students' attitudes towards educational interventions and their academic success and whether changes in curriculum can affect students' motivation, there is need for an instrument that can provide a valid measurement of the strength of motivation for the study of veterinary medicine. Our objectives were to design and validate a questionnaire that can be used as a psychometric scale to capture the motivation profiles of veterinary students. Question items were obtained from semi-structured interviews with students and from a review of the relevant literature. Each item was scored on a 5-point scale. The preliminary instrument was trialed on a cohort of 450 students. Responses were subjected to reliability and principal component analysis. A 14-item scale was designed, within which two factors explained 53.4% of the variance among the items. The scale had good face, content, and construct validities as well as a good internal consistency (Cronbach's alpha=.88).

Operationalization of Burnout.

ERIC Educational Resources Information Center

Matthews, Doris B.

This study was designed to develop instruments to measure employee burnout. The Matthews Burnout Scale for Employees is a 50-item self-report measure. The Matthews Burnout Scale for Supervisors is a 50-item scale for use in evaluating employee burnout. Content-based items were tested for construct validity with a group of employees, and their…

Validation of a condition-specific measure for women having an abnormal screening mammography.

PubMed

Brodersen, John; Thorsen, Hanne; Kreiner, Svend

2007-01-01

The aim of this study is to assess the validity of a new condition-specific instrument measuring psychosocial consequences of abnormal screening mammography (PCQ-DK33). The draft version of the PCQ-DK33 was completed on two occasions by 184 women who had received an abnormal screening mammography and on one occasion by 240 women who had received a normal screening result. Item Response Theories and Classical Test Theories were used to analyze data. Construct validity, concurrent validity, known group validity, objectivity and reliability were established by item analysis examining the fit between item responses and Rasch models. Six dimensions covering anxiety, behavioral impact, sense of dejection, impact on sleep, breast examination, and sexuality were identified. One item belonging to the dejection dimension had uniform differential item functioning. Two items not fitting the Rasch models were retained because of high face validity. A sick leave item added useful information when measuring side effects and socioeconomic consequences of breast cancer screening. Five "poor items" were identified and should be deleted from the final instrument. Preliminary evidence for a valid and reliable condition-specific measure for women having an abnormal screening mammography was established. The measure includes 27 "good" items measuring different attributes of the same overall latent structure-the psychosocial consequences of abnormal screening mammography.

Development of a Survey to Explore Factors Influencing the Adoption of Best Practices for Diabetic Foot Ulcer Offloading.

PubMed

Bleau Lavigne, Maude; Reeves, Isabelle; Sasseville, Marie-Josée; Loignon, Christine

The primary purpose of this study was to develop 2 survey tools to explore factors influencing adoption of best practices for diabetic foot ulcer offloading treatment in primary health care settings. One survey was intended for the patients receiving care for a diabetic foot ulcer in primary health care settings and the other was intended for the health professionals providing treatment. The second purpose of this study was to evaluate the psychometric properties of the 2 surveys. Development and validation of survey instruments. Two surveys were developed using a published guide. Following review of pertinent literature and identification of variables to be measured, a bank of items was developed and pretested to determine clarity of the item and responses. Psychometric testing comprised measurement of content validity index (CVI) and intraclass correlation coefficient (ICC). Only items obtaining satisfactory CVI and ICC scores were included in the final version of the surveys. The final version of the patient survey contained 41 items and the final version of the survey for health care professionals contained 21 items. The patient-intended survey's items demonstrate high content validity scores and satisfactory test-retest reliability scores. The overall CVI score was 0.98. Forty of the 49 items eligible for testing obtain satisfactory ICC scores. One item's test-retest reliability could not be tested but it was retained based on its high CVI. The health professional-intended survey, an overall CVI score of 0.91 but items had lower ICC scores (63%, 31 of the 49 items), did not achieve a satisfactory ICC score for inclusion in the final instrument. This project led to development of 2 instruments designed to identify and explore factors influencing adoption of best practices for diabetic foot ulcer offloading treatment in the primary health care setting. Future research and testing is required to translate these French surveys into English and additional languages, in order to reach a broader population.

The 4-Item Negative Symptom Assessment (NSA-4) Instrument: A Simple Tool for Evaluating Negative Symptoms in Schizophrenia Following Brief Training.

PubMed

Alphs, Larry; Morlock, Robert; Coon, Cheryl; van Willigenburg, Arjen; Panagides, John

2010-07-01

Objective. To assess the ability of mental health professionals to use the 4-item Negative Symptom Assessment instrument, derived from the Negative Symptom Assessment-16, to rapidly determine the severity of negative symptoms of schizophrenia.Design. Open participation.Setting. Medical education conferences.Participants. Attendees at two international psychiatry conferences.Measurements. Participants read a brief set of the 4-item Negative Symptom Assessment instructions and viewed a videotape of a patient with schizophrenia. Using the 1 to 6 4-item Negative Symptom Assessment severity rating scale, they rated four negative symptom items and the overall global negative symptoms. These ratings were compared with a consensus rating determination using frequency distributions and Chi-square tests for the proportion of participant ratings that were within one point of the expert rating.Results. More than 400 medical professionals (293 physicians, 50% with a European practice, and 55% who reported past utilization of schizophrenia ratings scales) participated. Between 82.1 and 91.1 percent of the 4-items and the global rating determinations by the participants were within one rating point of the consensus expert ratings. The differences between the percentage of participant rating scores that were within one point versus the percentage that were greater than one point different from those by the consensus experts was significant (p<0.0001). Participants rating of negative symptoms using the 4-item Negative Symptom Assessment did not generally differ among the geographic regions of practice, the professional credentialing, or their familiarity with the use of schizophrenia symptom rating instruments.Conclusion. These findings suggest that clinicians from a variety of geographic practices can, after brief training, use the 4-item Negative Symptom Assessment effectively to rapidly assess negative symptoms in patients with schizophrenia.

Development of a Valid and Reliable Knee Articular Cartilage Condition-Specific Study Methodological Quality Score.

PubMed

Harris, Joshua D; Erickson, Brandon J; Cvetanovich, Gregory L; Abrams, Geoffrey D; McCormick, Frank M; Gupta, Anil K; Verma, Nikhil N; Bach, Bernard R; Cole, Brian J

2014-02-01

Condition-specific questionnaires are important components in evaluation of outcomes of surgical interventions. No condition-specific study methodological quality questionnaire exists for evaluation of outcomes of articular cartilage surgery in the knee. To develop a reliable and valid knee articular cartilage-specific study methodological quality questionnaire. Cross-sectional study. A stepwise, a priori-designed framework was created for development of a novel questionnaire. Relevant items to the topic were identified and extracted from a recent systematic review of 194 investigations of knee articular cartilage surgery. In addition, relevant items from existing generic study methodological quality questionnaires were identified. Items for a preliminary questionnaire were generated. Redundant and irrelevant items were eliminated, and acceptable items modified. The instrument was pretested and items weighed. The instrument, the MARK score (Methodological quality of ARticular cartilage studies of the Knee), was tested for validity (criterion validity) and reliability (inter- and intraobserver). A 19-item, 3-domain MARK score was developed. The 100-point scale score demonstrated face validity (focus group of 8 orthopaedic surgeons) and criterion validity (strong correlation to Cochrane Quality Assessment score and Modified Coleman Methodology Score). Interobserver reliability for the overall score was good (intraclass correlation coefficient [ICC], 0.842), and for all individual items of the MARK score, acceptable to perfect (ICC, 0.70-1.000). Intraobserver reliability ICC assessed over a 3-week interval was strong for 2 reviewers (≥0.90). The MARK score is a valid and reliable knee articular cartilage condition-specific study methodological quality instrument. This condition-specific questionnaire may be used to evaluate the quality of studies reporting outcomes of articular cartilage surgery in the knee.

The Assessment of Physiotherapy Practice (APP) is a valid measure of professional competence of physiotherapy students: a cross-sectional study with Rasch analysis.

PubMed

Dalton, Megan; Davidson, Megan; Keating, Jenny

2011-01-01

Is the Assessment of Physiotherapy Practice (APP) a valid instrument for the assessment of entry-level competence in physiotherapy students? Cross-sectional study with Rasch analysis of initial (n=326) and validation samples (n=318). Students were assessed on completion of 4, 5, or 6-week clinical placements across one university semester. 298 clinical educators and 456 physiotherapy students at nine universities in Australia and New Zealand provided 644 completed APP instruments. APP data in both samples showed overall fit to a Rasch model of expected item functioning for interval scale measurement. Item 6 (Written communication) exhibited misfit in both samples, but was retained as an important element of competence. The hierarchy of item difficulty was the same in both samples with items related to professional behaviour and communication the easiest to achieve and items related to clinical reasoning the most difficult. Item difficulty was well targeted to person ability. No Differential Item Functioning was identified, indicating that the scale performed in a comparable way regardless of the student's age, gender or amount of prior clinical experience, and the educator's age, gender, or experience as an educator, or the type of facility, university, or clinical area. The instrument demonstrated unidimensionality confirming the appropriateness of summing the scale scores on each item to provide an overall score of clinical competence and was able to discriminate four levels of professional competence (Person Separation Index=0.96). Person ability and raw APP scores had a linear relationship (r(2)=0.99). Rasch analysis supports the interpretation that a student's APP score is an indication of their underlying level of professional competence in workplace practice. Copyright © 2011 Australian Physiotherapy Association. Published by .. All rights reserved.

Raters Interpret Positively and Negatively Worded Items Similarly in a Quality of Life Instrument for Children

PubMed Central

Lin, Chung-Ying; Strong, Carol; Tsai, Meng-Che; Lee, Chih-Ting

2017-01-01

Measurement invariance is an important assumption to meaningfully compare children’s quality of life (QoL) between different raters (eg, children and parents) and across genders. Moreover, QoL instruments may combine using negatively and positively worded items—a common method to reduce response bias. However, the wording effects may have different levels of impact on different raters and genders. Our aim was to investigate the measurement invariance of Kid-KINDL, a commonly used QoL instrument, across genders and raters and to consider the wording effects simultaneously. Third to sixth graders (208 boys and 235 girls) completed the self-rated Kid-KINDL, and 1 parent each of 241 children completed the parent-rated Kid-KINDL. The wording effects were accounted for by correlated traits-uncorrelated methods model. The measurement invariance was examined using multigroup confirmatory factor analysis. Item loadings and item intercepts were invariant across gender and rater when we simultaneously accounted for the wording effects of Kid-KINDL. Our results suggest that Kid-KINDL could be used to compare QoL across gender and that parent-rated Kid-KINDL could be used to measure children’s QoL. Specifically, the invariant factor loadings across child-rated and parent-rated Kid-KINDL suggest that the score weights in each item were the same for both children and parents (ie, the important items identified by the children are the same items identified by the parents). The invariant item intercepts suggest that both children and parents share the same threshold for each item. Based on the results, we tentatively recommend that each score of a parent-rated Kid-KINDL can stand for each child’s QoL. PMID:28292193

Overview of classical test theory and item response theory for the quantitative assessment of items in developing patient-reported outcomes measures.

PubMed

Cappelleri, Joseph C; Jason Lundy, J; Hays, Ron D

2014-05-01

The US Food and Drug Administration's guidance for industry document on patient-reported outcomes (PRO) defines content validity as "the extent to which the instrument measures the concept of interest" (FDA, 2009, p. 12). According to Strauss and Smith (2009), construct validity "is now generally viewed as a unifying form of validity for psychological measurements, subsuming both content and criterion validity" (p. 7). Hence, both qualitative and quantitative information are essential in evaluating the validity of measures. We review classical test theory and item response theory (IRT) approaches to evaluating PRO measures, including frequency of responses to each category of the items in a multi-item scale, the distribution of scale scores, floor and ceiling effects, the relationship between item response options and the total score, and the extent to which hypothesized "difficulty" (severity) order of items is represented by observed responses. If a researcher has few qualitative data and wants to get preliminary information about the content validity of the instrument, then descriptive assessments using classical test theory should be the first step. As the sample size grows during subsequent stages of instrument development, confidence in the numerical estimates from Rasch and other IRT models (as well as those of classical test theory) would also grow. Classical test theory and IRT can be useful in providing a quantitative assessment of items and scales during the content-validity phase of PRO-measure development. Depending on the particular type of measure and the specific circumstances, the classical test theory and/or the IRT should be considered to help maximize the content validity of PRO measures. Copyright © 2014 Elsevier HS Journals, Inc. All rights reserved.

Evaluation applications of instrument calibration research findings in psychology for very small samples

NASA Astrophysics Data System (ADS)

Fisher, W. P., Jr.; Petry, P.

2016-11-01

Many published research studies document item calibration invariance across samples using Rasch's probabilistic models for measurement. A new approach to outcomes evaluation for very small samples was employed for two workshop series focused on stress reduction and joyful living conducted for health system employees and caregivers since 2012. Rasch-calibrated self-report instruments measuring depression, anxiety and stress, and the joyful living effects of mindfulness behaviors were identified in peer-reviewed journal articles. Items from one instrument were modified for use with a US population, other items were simplified, and some new items were written. Participants provided ratings of their depression, anxiety and stress, and the effects of their mindfulness behaviors before and after each workshop series. The numbers of participants providing both pre- and post-workshop data were low (16 and 14). Analysis of these small data sets produce results showing that, with some exceptions, the item hierarchies defining the constructs retained the same invariant profiles they had exhibited in the published research (correlations (not disattenuated) range from 0.85 to 0.96). In addition, comparisons of the pre- and post-workshop measures for the three constructs showed substantively and statistically significant changes. Implications for program evaluation comparisons, quality improvement efforts, and the organization of communications concerning outcomes in clinical fields are explored.

The Matter in Extreme Conditions instrument at the Linac Coherent Light Source

PubMed Central

Nagler, Bob; Arnold, Brice; Bouchard, Gary; Boyce, Richard F.; Boyce, Richard M.; Callen, Alice; Campell, Marc; Curiel, Ruben; Galtier, Eric; Garofoli, Justin; Granados, Eduardo; Hastings, Jerry; Hays, Greg; Heimann, Philip; Lee, Richard W.; Milathianaki, Despina; Plummer, Lori; Schropp, Andreas; Wallace, Alex; Welch, Marc; White, William; Xing, Zhou; Yin, Jing; Young, James; Zastrau, Ulf; Lee, Hae Ja

2015-01-01

The LCLS beam provides revolutionary capabilities for studying the transient behavior of matter in extreme conditions. The particular strength of the Matter in Extreme Conditions instrument is that it combines the unique LCLS beam with high-power optical laser beams, and a suite of dedicated diagnostics tailored for this field of science. In this paper an overview of the beamline, the capabilities of the instrumentation, and selected highlights of experiments and commissioning results are presented. PMID:25931063

Psychological Fitness and Resilience: A Review of Relevant Constructs, Measures, and Links to Well-Being

DTIC Science & Technology

2014-01-01

assessed using self -report instruments. The most widely used instrument is the Rosenberg Self - Esteem Scale ( Rosenberg , 1965), which consists of 10 items...Construct validation of a single-item measure and the Rosenberg self - esteem scale. Personality and Social Psychology Bulletin, 27(2), 151–161. doi...fitness from the scientific literature: self -regulation, positive affect, perceived control, self -efficacy, self - esteem , and optimism. This review

Validation study of the Colorado Learning Attitudes about Science Survey at a Hispanic-serving institution

NASA Astrophysics Data System (ADS)

Sawtelle, Vashti; Brewe, Eric; Kramer, Laird

2009-12-01

The Colorado Learning Attitudes about Science Survey (CLASS) has been widely acknowledged as a useful measure of student cognitive attitudes about science and learning. The initial University of Colorado validation study included only 20% non-Caucasian student populations. In this Brief Report we extend their validation to include a predominately under-represented minority population. We validated the CLASS instrument at Florida International University, a Hispanic-serving institution, by interviewing students in introductory physics classes using a semistructured protocol, examining students’ responses on the CLASS item statements, and comparing them to the items’ intended meaning. We find that in our predominately Hispanic population, 94% of the students’ interview responses indicate that the students interpret the CLASS items correctly, and thus the CLASS is a valid instrument. We also identify one potentially problematic item in the instrument which one third of the students interviewed consistently misinterpreted.

Development of the Brazilian brief version of the Diabetes Quality of Life Measure (DQOL-Brazil-8).

PubMed

Brasil, Fábio; Brasil, Andreia Mara Brolezzi; e Souza, Rodrigo Augusto de Paula; Pontarolo, Roberto; Correr, Cassyano Januário

2015-01-01

To provide for Brazil, through the selection of items of the Brazilian version of the Diabetes Quality of Life Measure (DQOL-Brazil), a concise instrument. This is a cross-sectional study in which the DQOL-Brazil was administered to 150 type 1 diabetic patients and 146 type 2 diabetic patients. The items of the instrument were selected according to the analysis of the principal components and Spearman's correlations with treatment satisfaction, glycated hemoglobin level, and Nottingham Health Profile. From a total of 44 items, only 8 were selected to compose the summary instrument (DQOL-Brazil-8). The DQOL-Brazil-8 presented Spearman's correlation of 0.873 with the DQOL-Brazil and a Cronbach's alpha coefficient of 0.702. The Brazilian health professionals now have a brief tool for a fast application that preserves the best features of the full DQOL-Brazil.

Core Items for a Standardized Resource Use Measure: Expert Delphi Consensus Survey.

PubMed

Thorn, Joanna C; Brookes, Sara T; Ridyard, Colin; Riley, Ruth; Hughes, Dyfrig A; Wordsworth, Sarah; Noble, Sian M; Thornton, Gail; Hollingworth, William

2018-06-01

Resource use measurement by patient recall is characterized by inconsistent methods and a lack of validation. A validated standardized resource use measure could increase data quality, improve comparability between studies, and reduce research burden. To identify a minimum set of core resource use items that should be included in a standardized adult instrument for UK health economic evaluation from a provider perspective. Health economists with experience of UK-based economic evaluations were recruited to participate in an electronic Delphi survey. Respondents were asked to rate 60 resource use items (e.g., medication names) on a scale of 1 to 9 according to the importance of the item in a generic context. Items considered less important according to predefined consensus criteria were dropped and a second survey was developed. In the second round, respondents received the median score and their own score from round 1 for each item alongside summarized comments and were asked to rerate items. A final project team meeting was held to determine the recommended core set. Forty-five participants completed round 1. Twenty-six items were considered less important and were dropped, 34 items were retained for the second round, and no new items were added. Forty-two respondents (93.3%) completed round 2, and greater consensus was observed. After the final meeting, 10 core items were selected, with further items identified as suitable for "bolt-on" questionnaire modules. The consensus on 10 items considered important in a generic context suggests that a standardized instrument for core resource use items is feasible. Copyright © 2018. Published by Elsevier Inc.

Intraoperative Noise Increases Perceived Task Load and Fatigue in Anesthesiology Residents: A Simulation-Based Study.

PubMed

McNeer, Richard R; Bennett, Christopher L; Dudaryk, Roman

2016-02-01

Operating rooms are identified as being one of the noisiest of clinical environments, and intraoperative noise is associated with adverse effects on staff and patient safety. Simulation-based experiments would offer controllable and safe venues for investigating this noise problem. However, realistic simulation of the clinical auditory environment is rare in current simulators. Therefore, we retrofitted our operating room simulator to be able to produce immersive auditory simulations with the use of typical sound sources encountered during surgeries. Then, we tested the hypothesis that anesthesia residents would perceive greater task load and fatigue while being given simulated lunch breaks in noisy environments rather than in quiet ones. As a secondary objective, we proposed and tested the plausibility of a novel psychometric instrument for the assessment of stress. In this simulation-based, randomized, repeated-measures, crossover study, 2 validated psychometric survey instruments, the NASA Task Load Index (NASA-TLX), composed of 6 items, and the Swedish Occupational Fatigue Inventory (SOFI), composed of 5 items, were used to assess perceived task load and fatigue, respectively, in first-year anesthesia residents. Residents completed the psychometric instruments after being given lunch breaks in quiet and noisy intraoperative environments (soundscapes). The effects of soundscape grouping on the psychometric instruments and their comprising items were analyzed with a split-plot analysis. A model for a new psychometric instrument for measuring stress that combines the NASA-TLX and SOFI instruments was proposed, and a factor analysis was performed on the collected data to determine the model's plausibility. Twenty residents participated in this study. Multivariate analysis of variance showed an effect of soundscape grouping on the combined NASA-TLX and SOFI instrument items (P = 0.003) and the comparisons of univariate item reached significance for the NASA Temporal Demand item (P = 0.0004) and the SOFI Lack of Energy item (P = 0.001). Factor analysis extracted 4 factors, which were assigned the following construct names for model development: Psychological Task Load, Psychological Fatigue, Acute Physical Load, and Performance-Chronic Physical Load. Six of the 7 fit tests used in the partial confirmatory factor analysis were positive when we fitted the data to the proposed model, suggesting that further validation is warranted. This study provides evidence that noise during surgery can increase feelings of stress, as measured by perceived task load and fatigue levels, in anesthesiologists and adds to the growing literature pointing to an overall adverse impact of clinical noise on caregivers and patient safety. The psychometric model proposed in this study for assessing perceived stress is plausible based on factor analysis and will be useful for characterizing the impact of the clinical environment on subject stress levels in future investigations.

Different actuarial risk measures produce different risk rankings for sexual offenders.

PubMed

Barbaree, Howard E; Langton, Calvin M; Peacock, Edward J

2006-10-01

Percentile ranks were computed for N=262 sex offenders using each of 5 actuarial risk instruments commonly used with adult sex offenders (RRASOR, Static-99, VRAG, SORAG, and MnSOST-R). Mean differences between percentile ranks obtained by different actuarial measures were found to vary inversely with the correlation between the actuarial scores. Following studies of factor analyses of actuarial items, we argue that the discrepancies among actuarial instruments can be substantially accounted for by the way in which the factor Antisocial Behavior and various factors reflecting sexual deviance are represented among the items contained in each instrument. In the discussion, we provide guidance to clinicians in resolving discrepancies between instruments and we discuss implications for future developments in sex offender risk assessment.

Development and validation of instrument for ergonomic evaluation of tablet arm chairs

PubMed Central

Tirloni, Adriana Seára; dos Reis, Diogo Cunha; Bornia, Antonio Cezar; de Andrade, Dalton Francisco; Borgatto, Adriano Ferreti; Moro, Antônio Renato Pereira

2016-01-01

The purpose of this study was to develop and validate an evaluation instrument for tablet arm chairs based on ergonomic requirements, focused on user perceptions and using Item Response Theory (IRT). This exploratory study involved 1,633 participants (university students and professors) in four steps: a pilot study (n=26), semantic validation (n=430), content validation (n=11) and construct validation (n=1,166). Samejima's graded response model was applied to validate the instrument. The results showed that all the steps (theoretical and practical) of the instrument's development and validation processes were successful and that the group of remaining items (n=45) had a high consistency (0.95). This instrument can be used in the furniture industry by engineers and product designers and in the purchasing process of tablet arm chairs for schools, universities and auditoriums. PMID:28337099

Development and testing of the KERNset: an instrument to assess the quality of telephone triage in out-of-hours primary care services.

PubMed

Smits, Marleen; Keizer, Ellen; Ram, Paul; Giesen, Paul

2017-12-02

Telephone triage is a core but vulnerable part of the care process at out-of-hours general practitioner (GP) cooperatives. In the Netherlands, different instruments have been used for assessing the quality of telephone triage. These instruments focussed mainly on communicational aspects, and less on the medical quality of triage decisions. Our aim was to develop and test a minimum set of items to assess the quality of telephone triage. A national survey among all GP cooperatives in the Netherlands was performed to examine the most important aspects of telephone triage. Next, corresponding items from existing instruments were searched on these topics. Subsequently, an expert panel judged these items on importance, completeness and formulation. The concept KERNset consisted of 24 items about the telephone conversation: 13 medical, ten communicational and one regarding both types. It was pilot tested on measurement characteristics, reliability, validity and variation between triagists. In this pilot study, 114 anonymous calls from four GP cooperatives spread across the Netherlands were judged by three out of eight raters, both internal and external raters. Cronbach's alpha was .94 for the medical items and .75 for the communicational items. Inter-rater reliability: complete agreement between the external raters was 45% and reasonable agreement 73% (difference of maximally one point on the five-point scale). Intra-rater reliability: complete agreement within raters was 55% and reasonable agreement 84%. There were hardly any differences between internal and external raters, but there were differences in strictness between individual raters. The construct validity was confirmed by the high correlation between the general impression of the call and the items of the KERNset. Of the differences within items 19% could be explained by differences between triage nurses, which means the KERNset is able to demonstrate differences between triage nurses. The KERNset can be used to assess the quality of telephone triage. The validity is good and differences between calls and between triage nurses can be measured. A more intensive training for raters could improve the reliability.

Development and psychometric evaluation of a cardiovascular risk and disease management knowledge assessment tool.

PubMed

Rosneck, James S; Hughes, Joel; Gunstad, John; Josephson, Richard; Noe, Donald A; Waechter, Donna

2014-01-01

This article describes the systematic construction and psychometric analysis of a knowledge assessment instrument for phase II cardiac rehabilitation (CR) patients measuring risk modification disease management knowledge and behavioral outcomes derived from national standards relevant to secondary prevention and management of cardiovascular disease. First, using adult curriculum based on disease-specific learning outcomes and competencies, a systematic test item development process was completed by clinical staff. Second, a panel of educational and clinical experts used an iterative process to identify test content domain and arrive at consensus in selecting items meeting criteria. Third, the resulting 31-question instrument, the Cardiac Knowledge Assessment Tool (CKAT), was piloted in CR patients to ensure use of application. Validity and reliability analyses were performed on 3638 adults before test administrations with additional focused analyses on 1999 individuals completing both pretreatment and posttreatment administrations within 6 months. Evidence of CKAT content validity was substantiated, with 85% agreement among content experts. Evidence of construct validity was demonstrated via factor analysis identifying key underlying factors. Estimates of internal consistency, for example, Cronbach's α = .852 and Spearman-Brown split-half reliability = 0.817 on pretesting, support test reliability. Item analysis, using point biserial correlation, measured relationships between performance on single items and total score (P < .01). Analyses using item difficulty and item discrimination indices further verified item stability and validity of the CKAT. A knowledge instrument specifically designed for an adult CR population was systematically developed and tested in a large representative patient population, satisfying psychometric parameters, including validity and reliability.

Development of a new multimedia instrument to measure cancer-specific quality of life in Portuguese-speaking patients with varying literacy skills.

PubMed

Paiva, Carlos Eduardo; Siquelli, Felipe Augusto Ferreira; Zaia, Gabriela Rossi; de Andrade, Diocésio Alves Pinto; Borges, Marcos Aristoteles; Jácome, Alexandre A; Giroldo, Gisele Augusta Sousa Nascimento; Santos, Henrique Amorim; Hahn, Elizabeth A; Uemura, Gilberto; Paiva, Bianca Sakamoto Ribeiro

2016-01-01

To develop and validate a new multimedia instrument to measure health-related quality of life (HRQOL) in Portuguese-speaking patients with cancer. A mixed-methods study conducted in a large Brazilian Cancer Hospital. The instrument was developed along the following sequential phases: identification of HRQOL issues through qualitative content analysis of individual interviews, evaluation of the most important items according to the patients, review of the literature, evaluation by an expert committee, and pretesting. In sequence, an exploratory factor analysis was conducted (pilot testing, n = 149) to reduce the number of items and to define domains and scores. The psychometric properties of the IQualiV-OG-21 were measured in a large multicentre Brazilian study (n = 323). A software containing multimedia resources were developed to facilitate self-administration of IQualiV-OG-21; its feasibility and patients' preferences ("paper and pencil" vs. software) were further tested (n = 54). An exploratory factor analysis reduced the 30-item instrument to 21 items. The IQualiV-OG-21 was divided into 6 domains: emotional, physical, existential, interpersonal relationships, functional and financial. The multicentre study confirmed that it was valid and reliable. The electronic multimedia instrument was easy to complete and acceptable to patients. Regarding preferences, 61.1 % of them preferred the electronic format in comparison with the paper and pencil format. The IQualiV-OG-21 is a new valid and reliable multimedia HRQOL instrument that is well-understood, even by patients with low literacy skills, and can be answered quickly. It is a useful new tool that can be translated and tested in other cultures and languages.

Ordinal-To-Interval Scale Conversion Tables and National Items for the New Zealand Version of the WHOQOL-BREF

PubMed Central

Billington, D. Rex; Hsu, Patricia Hsien-Chuan; Feng, Xuan Joanna; Medvedev, Oleg N.; Kersten, Paula; Landon, Jason; Siegert, Richard J.

2016-01-01

The World Health Organisation Quality of Life (WHOQOL) questionnaires are widely used around the world and can claim strong cross-cultural validity due to their development in collaboration with international field centres. To enhance conceptual equivalence of quality of life across cultures, optional national items are often developed for use alongside the core instrument. The present study outlines the development of national items for the New Zealand WHOQOL-BREF. Focus groups with members of the community as well as health experts discussed what constitutes quality of life in their opinion. Based on themes extracted of aspects not contained in the existing WHOQOL instrument, 46 candidate items were generated and subsequently rated for their importance by a random sample of 585 individuals from the general population. Applying importance criteria reduced these items to 24, which were then sent to another large random sample (n = 808) to be rated alongside the existing WHOQOL-BREF. A final set of five items met the criteria for national items. Confirmatory factor analysis identified four national items as belonging to the psychological domain of quality of life, and one item to the social domain. Rasch analysis validated these results and generated ordinal-to-interval conversion algorithms to allow use of parametric statistics for domain scores with and without national items. PMID:27812203

Developing and validating a scale to measure Food and Nutrition Literacy (FNLIT) in elementary school children in Iran.

PubMed

Doustmohammadian, Aazam; Omidvar, Nasrin; Keshavarz-Mohammadi, Nastaran; Abdollahi, Morteza; Amini, Maryam; Eini-Zinab, Hassan

2017-01-01

Food and nutrition literacy is an emerging term which is increasingly used in policy and research. Though research in this area is growing, progression is limited by the lack of an accepted method to measure food and nutrition literacy. The aim of this study is to develop a valid and reliable questionnaire to assess food and nutrition literacy in elementary school children in the city of Tehran. The study was conducted in three phases. To develop Food and Nutrition Literacy (FNLIT) questionnaire, a comprehensive literature review and a qualitative study were initially performed to identify food and nutrition literacy dimensions and its components. Content and face validity of the questionnaire were evaluated by an expert panel as well as students. In the second phase, construct validity of the scale was evaluated using Explanatory Factor Analyses (EFA) and Confirmatory Factor Analyses (CFA). In the last phase (confirmatory phase), the final version of the questionnaire was evaluated on 400 students. Findings show Content Validity Ratio (CVR) and Content Validity Index (CVI) of the 62-item questionnaire at acceptable levels of 0.87 and 0.92, respectively. EFA suggested a six-factor construct, namely, understanding food and nutrition information, knowledge, functional, interactive, food choice, and critical. The results of CFA indicated acceptable fit indices for the proposed models. All subscales demonstrated satisfactory internal consistency (Cronbach's alpha≥0.70), except for critical skill subscale (0.48). The intraclass correlation coefficient (ICC = 0.90, CI: 0.83-0.94) indicated that Food and Nutrition Literacy (FNLIT) scale had satisfactory stability. Each phase of development progressively improved the questionnaire, which resulted in a 46-item (42 likert-type items and 4 true-false items) Food and Nutrition Literacy (FNLIT) scale. The questionnaire measured two domains with 6 subscales, including: 1) cognitive domain: understanding and knowledge; 2) skill domain: functional, food choice, interactive, and critical skills. The developed food and nutrition literacy scale is a valid and reliable instrument to measure food and nutrition literacy in children. This measure lays a solid empirical and theoretical foundation for future research and tailored interventions to promote food and nutrition literacy in this age group.

Content validity of the Geriatric Health Assessment Instrument

PubMed Central

Pedreira, Rhaine Borges Santos; Rocha, Saulo Vasconcelos; dos Santos, Clarice Alves; Vasconcelos, Lélia Renata Carneiro; Reis, Martha Cerqueira

2016-01-01

ABSTRACT Objective Assess the content validity of the Elderly Health Assessment Tool with low education. Methods The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as “not valid”, “somewhat valid” or “valid”, using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. Results The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. Conclusion The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly. PMID:27462889

Domestic violence on children: development and validation of an instrument to evaluate knowledge of health professionals 1

PubMed Central

Oliveira, Lanuza Borges; Soares, Fernanda Amaral; Silveira, Marise Fagundes; de Pinho, Lucinéia; Caldeira, Antônio Prates; Leite, Maísa Tavares de Souza

2016-01-01

ABSTRACT Objective: to develop and validate an instrument to evaluate the knowledge of health professionals about domestic violence on children. Method: this was a study conducted with 194 physicians, nurses and dentists. A literature review was performed for preparation of the items and identification of the dimensions. Apparent and content validation was performed using analysis of three experts and 27 professors of the pediatric health discipline. For construct validation, Cronbach's alpha was used, and the Kappa test was applied to verify reproducibility. The criterion validation was conducted using the Student's t-test. Results: the final instrument included 56 items; the Cronbach alpha was 0.734, the Kappa test showed a correlation greater than 0.6 for most items, and the Student t-test showed a statistically significant value to the level of 5% for the two selected variables: years of education and using the Family Health Strategy. Conclusion: the instrument is valid and can be used as a promising tool to develop or direct actions in public health and evaluate knowledge about domestic violence on children. PMID:27556878

Development and testing of the questionnaire CEC-61: Knowledge about cervical cancer in Chilean adolescents.

PubMed

Urrutia, María Teresa; Gajardo, Macarena; Padilla, Oslando

2017-05-22

Despite a clear association between human papillomavirus and cervical cancer, knowledge in adolescent populations regarding the disease and methods for its detection and prevention is deficient. The aim of this study was to develop and test a new questionnaire concerning knowledge on cervical cancer. An instrument was developed and validated to measure knowledge in 226 Chilean adolescents between April and June 2011. Content validity, construct validity, and reliability analysis of the instrument were performed. The new, validated instrument, called CEC-61 (Conocimientos en Cancer Cérvicouterino-61 items/Knowledge in Cervical Cancer-61 items), contains nine factors and 61 items. The new questionnaire explained 81% of the variance with a reliability of 0.96. The assessment of knowledge with a valid and reliable instrument is the first step in creating interventions for a population and to encourage appropriate preventive behavior. CEC-61 is highly reliable and has a clear factorial structure to evaluate knowledge in nine domains related to cervical cancer disease, cervical cancer risk, papilloma virus infection, the Papanicolaou test, and the papilloma virus vaccine.

Development of a short version of the modified Yale Preoperative Anxiety Scale.

PubMed

Jenkins, Brooke N; Fortier, Michelle A; Kaplan, Sherrie H; Mayes, Linda C; Kain, Zeev N

2014-09-01

The modified Yale Preoperative Anxiety Scale (mYPAS) is the current "criterion standard" for assessing child anxiety during induction of anesthesia and has been used in >100 studies. This observational instrument covers 5 items and is typically administered at 4 perioperative time points. Application of this complex instrument in busy operating room (OR) settings, however, presents a challenge. In this investigation, we examined whether the instrument could be modified and made easier to use in OR settings. This study used qualitative methods, principal component analyses, Cronbach αs, and effect sizes to create the mYPAS-Short Form (mYPAS-SF) and reduce time points of assessment. Data were obtained from multiple patients (N = 3798; Mage = 5.63) who were recruited in previous investigations using the mYPAS over the past 15 years. After qualitative analysis, the "use of parent" item was eliminated due to content overlap with other items. The reduced item set accounted for 82% or more of the variance in child anxiety and produced the Cronbach α of at least 0.92. To reduce the number of time points of assessment, a minimum Cohen d effect size criterion of 0.48 change in mYPAS score across time points was used. This led to eliminating the walk to the OR and entrance to the OR time points. Reducing the mYPAS to 4 items, creating the mYPAS-SF that can be administered at 2 time points, retained the accuracy of the measure while allowing the instrument to be more easily used in clinical research settings.

NIST display colorimeter calibration facility

NASA Astrophysics Data System (ADS)

Brown, Steven W.; Ohno, Yoshihiro

2003-07-01

A facility has been developed at the National Institute of Standards and Technology (NIST) to provide calibration services for color-measuring instruments to address the need for improving and certifying the measurement uncertainties of this type of instrument. While NIST has active programs in photometry, flat panel display metrology, and color and appearance measurements, these are the first services offered by NIST tailored to color-measuring instruments for displays. An overview of the facility, the calibration approach, and associated uncertainties are presented. Details of a new tunable colorimetric source and the development of new transfer standard instruments are discussed.

Cocoa High School's Academic Courses as Viewed by Their Consumers: A Field Study.

ERIC Educational Resources Information Center

Louwerse, F. H.

A 16-item self-report instrument (included in an appendix) was developed to determine the views held by students (N=1,004) concerning aspects of courses in 5 academic areas: English, foreign languages, mathematics, science, and social studies. Individual items reflected views concerning: understanding course requirments (2 items), teacher/student…

Introduction to Multilevel Item Response Theory Analysis: Descriptive and Explanatory Models

ERIC Educational Resources Information Center

Sulis, Isabella; Toland, Michael D.

2017-01-01

Item response theory (IRT) models are the main psychometric approach for the development, evaluation, and refinement of multi-item instruments and scaling of latent traits, whereas multilevel models are the primary statistical method when considering the dependence between person responses when primary units (e.g., students) are nested within…

The Development and Validation of the Intercultural Sensitivity Scale.

ERIC Educational Resources Information Center

Chen, Guo-Ming; Starosta, William J.

The present study developed and assessed reliability and validity of a new instrument, the Intercultural Sensitivity Scale (ISS). Based on a review of the literature, 44 items thought to be important for intercultural sensitivity were generated. A sample of 414 college students rated these items and generated a 24-item final version of the…

An Objective Instrument for Assessment of Erikson's Developmental Conflicts. Presentation Summary.

ERIC Educational Resources Information Center

Speisman, Joseph C.; And Others

An objective measure of Erikson's ego-identity construct is being developed. The total scale includes seven relatively independent subscales designed to reflect the residuals (part conflicts) of Erikson's psychosocial stages of development. An initial item pool of 194 items has been reduced to 113 items by means of judgemental and statistical…

The Impact of Missing Data on the Detection of Nonuniform Differential Item Functioning

ERIC Educational Resources Information Center

Finch, W. Holmes

2011-01-01

Missing information is a ubiquitous aspect of data analysis, including responses to items on cognitive and affective instruments. Although the broader statistical literature describes missing data methods, relatively little work has focused on this issue in the context of differential item functioning (DIF) detection. Such prior research has…

Development process of an assessment tool for disruptive behavior problems in cross-cultural settings: the Disruptive Behavior International Scale – Nepal version (DBIS-N)

PubMed Central

Burkey, Matthew D.; Ghimire, Lajina; Adhikari, Ramesh P.; Kohrt, Brandon A.; Jordans, Mark J. D.; Haroz, Emily; Wissow, Lawrence

2017-01-01

Systematic processes are needed to develop valid measurement instruments for disruptive behavior disorders (DBDs) in cross-cultural settings. We employed a four-step process in Nepal to identify and select items for a culturally valid assessment instrument: 1) We extracted items from validated scales and local free-list interviews. 2) Parents, teachers, and peers (n=30) rated the perceived relevance and importance of behavior problems. 3) Highly rated items were piloted with children (n=60) in Nepal. 4) We evaluated internal consistency of the final scale. We identified 49 symptoms from 11 scales, and 39 behavior problems from free-list interviews (n=72). After dropping items for low ratings of relevance and severity and for poor item-test correlation, low frequency, and/or poor acceptability in pilot testing, 16 items remained for the Disruptive Behavior International Scale—Nepali version (DBIS-N). The final scale had good internal consistency (α=0.86). A 4-step systematic approach to scale development including local participation yielded an internally consistent scale that included culturally relevant behavior problems. PMID:28093575

Validation of the instrument of health literacy competencies for Chinese-speaking health professionals.

PubMed

Chang, Li-Chun; Chen, Yu-Chi; Liao, Li-Ling; Wu, Fei Ling; Hsieh, Pei-Lin; Chen, Hsiao-Jung

2017-01-01

The study aimed to illustrate the constructs and test the psychometric properties of an instrument of health literacy competencies (IOHLC) for health professionals. A multi-phase questionnaire development method was used to develop the scale. The categorization of the knowledge and practice domains achieved consensus through a modified Delphi process. To reduce the number of items, the 92-item IOHLC was psychometrically evaluated through internal consistency, Rasch modeling, and two-stage factor analysis. In total, 736 practitioners, including nurses, nurse practitioners, health educators, case managers, and dieticians completed the 92-item IOHLC online from May 2012 to January 2013. The final version of the IOHLC covered 9 knowledge items and 40 skill items containing 9 dimensions, with good model fit, and explaining 72% of total variance. All domains had acceptable internal consistency and discriminant validity. The tool in this study is the first to verify health literacy competencies rigorously. Moreover, through psychometric testing, the 49-item IOHLC demonstrates adequate reliability and validity. The IOHLC may serve as a reference for the theoretical and in-service training of Chinese-speaking individuals' health literacy competencies.

Accumulation of Content Validation Evidence for the Critical Thinking Self-Assessment Scale.

PubMed

Nair, Girija Gopinathan; Hellsten, Laurie-Ann M; Stamler, Lynnette Leeseberg

2017-04-01

Critical thinking skills (CTS) are essential for nurses; assessing students' acquisition of these skills is a mandate of nursing curricula. This study aimed to develop a self-assessment instrument of critical thinking skills (Critical Thinking Self-Assessment Scale [CTSAS]) for students' self-monitoring. An initial pool of 196 items across 6 core cognitive skills and 16 subskills were generated using the American Philosophical Association definition of CTS. Experts' content review of the items and their ratings provided evidence of content relevance using the item-level content validity index (I-CVI) and Aiken's content validity coefficient (VIk). 115 items were retained (range of I-CVI values = .70 to .94 and range of VIk values = .69-.95; significant at p< .05). The CTSAS is the first CTS instrument designed specifically for self-assessment purposes.

Concise evaluation of decision aids.

PubMed

Stalmeier, Peep F M; Roosmalen, Marielle S

2009-01-01

Decision aids purport to help patients make treatment related choices. Several instruments exist to evaluate decision aids. Our aim is to compare the responsiveness of several instruments. Two different decision aids were randomized in patients at high risk for breast and ovarian cancer. Treatment choices were between prophylactic surgery and screening. Effect sizes were calculated to compare the responsiveness of the measures. One decision aid was randomized in 390 women, the other in 91 ensuing mutation carriers. Three factors were identified related to Information, Well-being and Decision Making. Within each factor, single item measures were as responsive as multi-item measures. Four single items, 'the amount of information received for decision making,' 'strength of preference,' 'I weighed the pros and cons,' and 'General Health,' were adequately responsive to the decision aids. These items might be considered for inclusion in questionnaires to evaluate decision aids.

Brief Sensation Seeking Scale: Latent structure of 8-item and 4-item versions in Peruvian adolescents.

PubMed

Merino-Soto, Cesar; Salas Blas, Edwin

2018-01-01

This research intended to validate two brief scales of sensations seeking with Peruvian adolescents: the eight item scale (BSSS8; Hoyle, Stephenson, Palmgreen, Lorch, y Donohew, 2002) and the four item scale (BSSS4; Stephenson, Hoyle, Slater, y Palmgreen, 2003). Questionnaires were administered to 618 voluntary participants, with an average age of 13.6 years, from different levels of high school, state and private school in a district in the south of Lima. It analyzed the internal structure of both short versions using three models: a) unidimensional (M1), b) oblique or related dimensions (M2), and c) the bifactor model (M3). Results show that both instruments have a single dimension which best represents the variability of the items; a fact that can be explained both by the complexity of the concept and by the small number of items representing each factor, which is more noticeable in the BSSS4. Reliability is within levels found by previous studies: alpha: .745 = BSSS8 and BSSS4 =. 643; omega coefficient: .747 in BSSS8 and .651 in BSSS4. These are considered suitable for the type of instruments studied. Based on the correlation between the two instruments, it was found that there are satisfactory levels of equivalence between the BSSS8 and BSSS4. However, it is recommended that the BSSS4 is mainly used for research and for the purpose of describing populations.

Development of Elderly Quality of Life Index – Eqoli: Item Reduction and Distribution into Dimensions

PubMed Central

Paschoal, Sérgio Márcio Pacheco; Filho, Wilson Jacob; Litvoc, Júlio

2008-01-01

OBJECTIVE To describe item reduction and its distribution into dimensions in the construction process of a quality of life evaluation instrument for the elderly. METHODS The sampling method was chosen by convenience through quotas, with selection of elderly subjects from four programs to achieve heterogeneity in the “health status”, “functional capacity”, “gender”, and “age” variables. The Clinical Impact Method was used, consisting of the spontaneous and elicited selection by the respondents of relevant items to the construct Quality of Life in Old Age from a previously elaborated item pool. The respondents rated each item’s importance using a 5-point Likert scale. The product of the proportion of elderly selecting the item as relevant (frequency) and the mean importance score they attributed to it (importance) represented the overall impact of that item in their quality of life (impact). The items were ordered according to their impact scores and the top 46 scoring items were grouped in dimensions by three experts. A review of the negative items was performed. RESULTS One hundred and ninety three people (122 women and 71 men) were interviewed. Experts distributed the 46 items into eight dimensions. Closely related items were grouped and dimensions not reaching the minimum expected number of items received additional items resulting in eight dimensions and 43 items. DISCUSSION The sample was heterogeneous and similar to what was expected. The dimensions and items demonstrated the multidimensionality of the construct. The Clinical Impact Method was appropriate to construct the instrument, which was named Elderly Quality of Life Index - EQoLI. An accuracy process will be examined in the future. PMID:18438571

Development of a new occupational balance-questionnaire: incorporating the perspectives of patients and healthy people in the design of a self-reported occupational balance outcome instrument.

PubMed

Dür, Mona; Steiner, Günter; Fialka-Moser, Veronika; Kautzky-Willer, Alexandra; Dejaco, Clemens; Prodinger, Birgit; Stoffer, Michaela Alexandra; Binder, Alexa; Smolen, Josef; Stamm, Tanja Alexandra

2014-04-05

Self-reported outcome instruments in health research have become increasingly important over the last decades. Occupational therapy interventions often focus on occupational balance. However, instruments to measure occupational balance are scarce. The aim of the study was therefore to develop a generic self-reported outcome instrument to assess occupational balance based on the experiences of patients and healthy people including an examination of its psychometric properties. We conducted a qualitative analysis of the life stories of 90 people with and without chronic autoimmune diseases to identify components of occupational balance. Based on these components, the Occupational Balance-Questionnaire (OB-Quest) was developed. Construct validity and internal consistency of the OB-Quest were examined in quantitative data. We used Rasch analyses to determine overall fit of the items to the Rasch model, person separation index and potential differential item functioning. Dimensionality testing was conducted by the use of t-tests and Cronbach's alpha. The following components emerged from the qualitative analyses: challenging and relaxing activities, activities with acknowledgement by the individual and by the sociocultural context, impact of health condition on activities, involvement in stressful activities and fewer stressing activities, rest and sleep, variety of activities, adaptation of activities according to changed living conditions and activities intended to care for oneself and for others. Based on these, the seven items of the questionnaire (OB-Quest) were developed. 251 people (132 with rheumatoid arthritis, 43 with systematic lupus erythematous and 76 healthy) filled in the OB-Quest. Dimensionality testing indicated multidimensionality of the questionnaire (t = 0.58, and 1.66 after item reduction, non-significant). The item on the component rest and sleep showed differential item functioning (health condition and age). Person separation index was 0.51. Cronbach's alpha changed from 0.38 to 0.57 after deleting two items. This questionnaire includes new items addressing components of occupational balance meaningful to patients and healthy people which have not been measured so far. The reduction of two items of the OB-Quest showed improved internal consistency. The multidimensionality of the questionnaire indicates the need for a summary of several components into subscales.

Development of a new occupational balance-questionnaire: incorporating the perspectives of patients and healthy people in the design of a self-reported occupational balance outcome instrument

PubMed Central

2014-01-01

Background Self-reported outcome instruments in health research have become increasingly important over the last decades. Occupational therapy interventions often focus on occupational balance. However, instruments to measure occupational balance are scarce. The aim of the study was therefore to develop a generic self-reported outcome instrument to assess occupational balance based on the experiences of patients and healthy people including an examination of its psychometric properties. Methods We conducted a qualitative analysis of the life stories of 90 people with and without chronic autoimmune diseases to identify components of occupational balance. Based on these components, the Occupational Balance-Questionnaire (OB-Quest) was developed. Construct validity and internal consistency of the OB-Quest were examined in quantitative data. We used Rasch analyses to determine overall fit of the items to the Rasch model, person separation index and potential differential item functioning. Dimensionality testing was conducted by the use of t-tests and Cronbach’s alpha. Results The following components emerged from the qualitative analyses: challenging and relaxing activities, activities with acknowledgement by the individual and by the sociocultural context, impact of health condition on activities, involvement in stressful activities and fewer stressing activities, rest and sleep, variety of activities, adaptation of activities according to changed living conditions and activities intended to care for oneself and for others. Based on these, the seven items of the questionnaire (OB-Quest) were developed. 251 people (132 with rheumatoid arthritis, 43 with systematic lupus erythematous and 76 healthy) filled in the OB-Quest. Dimensionality testing indicated multidimensionality of the questionnaire (t = 0.58, and 1.66 after item reduction, non-significant). The item on the component rest and sleep showed differential item functioning (health condition and age). Person separation index was 0.51. Cronbach’s alpha changed from 0.38 to 0.57 after deleting two items. Conclusions This questionnaire includes new items addressing components of occupational balance meaningful to patients and healthy people which have not been measured so far. The reduction of two items of the OB-Quest showed improved internal consistency. The multidimensionality of the questionnaire indicates the need for a summary of several components into subscales. PMID:24708642

Addressing medication nonadherence by mobile phone: development and delivery of tailored messages.

PubMed

Gatwood, Justin; Balkrishnan, Rajesh; Erickson, Steven R; An, Lawrence C; Piette, John D; Farris, Karen B

2014-01-01

Medication nonadherence remains a significant public health problem, and efforts to improve adherence have shown only limited impact. The tailoring of messages has become a popular method of developing communication to influence specific health-related behaviors but the development and impact of tailored text messages on medication use is poorly understood. The aim of this paper is to describe an approach to developing theory-based tailored messages for delivery via mobile phone to improve medication adherence among patients with diabetes. Kreuter's five-step tailoring process was followed to create tailored messages for mobile phone delivery. Two focus group sessions, using input from 11 people, and expert review of message content were used to adapt the survey instrument on which the messages were tailored and edit the developed messages for the target population. Following established tailoring methods a library of 168 theory-driven and 128 medication-specific tailored messages were developed and formatted for automated delivery to mobile phones. Concepts from the Health Belief Model and Self-Determination Theory were used to craft the messages and an algorithm was applied to determine the order and timing of messages with the aim of progressively influencing disease and treatment-related beliefs driving adherence to diabetes medication. The process described may be applied to future investigations aiming to improve medication adherence in patients with diabetes and the effectiveness of the current messages will be tested in a planned analysis. Copyright © 2014 Elsevier Inc. All rights reserved.

Development of an Instrument to Measure Medical Students' Attitudes toward People with Disabilities

ERIC Educational Resources Information Center

Symons, Andrew B.; Fish, Reva; McGuigan, Denise; Fox, Jeffery; Akl, Elie A.

2012-01-01

As curricula to improve medical students' attitudes toward people with disabilities are developed, instruments are needed to guide the process and evaluate effectiveness. The authors developed an instrument to measure medical students' attitudes toward people with disabilities. A pilot instrument with 30 items in four sections was administered to…

A Computer-Based Instrument That Identifies Common Science Misconceptions

ERIC Educational Resources Information Center

Larrabee, Timothy G.; Stein, Mary; Barman, Charles

2006-01-01

This article describes the rationale for and development of a computer-based instrument that helps identify commonly held science misconceptions. The instrument, known as the Science Beliefs Test, is a 47-item instrument that targets topics in chemistry, physics, biology, earth science, and astronomy. The use of an online data collection system…

Development and validation of a ten-item questionnaire with explanatory illustrations to assess upper extremity disorders: favorable effect of illustrations in the item reduction process.

PubMed

Kurimoto, Shigeru; Suzuki, Mikako; Yamamoto, Michiro; Okui, Nobuyuki; Imaeda, Toshihiko; Hirata, Hitoshi

2011-11-01

The purpose of this study is to develop a short and valid measure for upper extremity disorders and to assess the effect of attached illustrations in item reduction of a self-administered disability questionnaire while retaining psychometric properties. A validated questionnaire used to assess upper extremity disorders, the Hand20, was reduced to ten items using two item-reduction techniques. The psychometric properties of the abbreviated form, the Hand10, were evaluated on an independent sample that was used for the shortening process. Validity, reliability, and responsiveness of the Hand10 were retained in the item reduction process. It was possible that the use of explanatory illustrations attached to the Hand10 helped with its reproducibility. The illustrations for the Hand10 promoted text comprehension and motivation to answer the items. These changes resulted in high acceptability; more than 99.3% of patients, including 98.5% of elderly patients, could complete the Hand10 properly. The illustrations had favorable effects on the item reduction process and made it possible to retain precision of the instrument. The Hand10 is a reliable and valid instrument for individual-level applications with the advantage of being compact and broadly applicable, even in elderly individuals.

Creating a Computer Adaptive Test Version of the Late-Life Function & Disability Instrument

PubMed Central

Jette, Alan M.; Haley, Stephen M.; Ni, Pengsheng; Olarsch, Sippy; Moed, Richard

2009-01-01

Background This study applied Item Response Theory (IRT) and Computer Adaptive Test (CAT) methodologies to develop a prototype function and disability assessment instrument for use in aging research. Herein, we report on the development of the CAT version of the Late-Life Function & Disability instrument (Late-Life FDI) and evaluate its psychometric properties. Methods We employed confirmatory factor analysis, IRT methods, validation, and computer simulation analyses of data collected from 671 older adults residing in residential care facilities. We compared accuracy, precision, and sensitivity to change of scores from CAT versions of two Late-Life FDI scales with scores from the fixed-form instrument. Score estimates from the prototype CAT versus the original instrument were compared in a sample of 40 older adults. Results Distinct function and disability domains were identified within the Late-Life FDI item bank and used to construct two prototype CAT scales. Using retrospective data, scores from computer simulations of the prototype CAT scales were highly correlated with scores from the original instrument. The results of computer simulation, accuracy, precision, and sensitivity to change of the CATs closely approximated those of the fixed-form scales, especially for the 10- or 15-item CAT versions. In the prospective study each CAT was administered in less than 3 minutes and CAT scores were highly correlated with scores generated from the original instrument. Conclusions CAT scores of the Late-Life FDI were highly comparable to those obtained from the full-length instrument with a small loss in accuracy, precision, and sensitivity to change. PMID:19038841

An Attitude Scale on Individual Instrument and Individual Instrument Course: Validity-Reliability Research

ERIC Educational Resources Information Center

Kuçukosmanoglu, Hayrettin Onur

2015-01-01

The main purpose of this study is to develop a scale to determine students' attitude levels on individual instruments and individual instrument courses in instrument training, which is an important dimension of music education, and to conduct a validity-reliability research of the scale that has been developed. The scale consists of 16 items. The…

The Dysexecutive Questionnaire advanced: item and test score characteristics, 4-factor solution, and severity classification.

PubMed

Bodenburg, Sebastian; Dopslaff, Nina

2008-01-01

The Dysexecutive Questionnaire (DEX, , Behavioral assessment of the dysexecutive syndrome, 1996) is a standardized instrument to measure possible behavioral changes as a result of the dysexecutive syndrome. Although initially intended only as a qualitative instrument, the DEX has also been used increasingly to address quantitative problems. Until now there have not been more fundamental statistical analyses of the questionnaire's testing quality. The present study is based on an unselected sample of 191 patients with acquired brain injury and reports on the data relating to the quality of the items, the reliability and the factorial structure of the DEX. Item 3 displayed too great an item difficulty, whereas item 11 was not sufficiently discriminating. The DEX's reliability in self-rating is r = 0.85. In addition to presenting the statistical values of the tests, a clinical severity classification of the overall scores of the 4 found factors and of the questionnaire as a whole is carried out on the basis of quartile standards.

Measuring Nurses' Value, Implementation, and Knowledge of Evidence-Based Practice: Further Psychometric Testing of the Quick-EBP-VIK Survey.

PubMed

Connor, Linda; Paul, Fiona; McCabe, Margaret; Ziniel, Sonja

2017-02-01

The Quick-EBP-VIK is a new instrument for measuring nurses' value, implementation, and knowledge of EBP. Psychometric testing was conducted in two parts. Part 1 describes the tool development and validity testing which resulted in the development of a 25-item survey after receiving ≥0.80 Item-Level Content Validity Index for both clarity and relevance. Part 2 describes psychometric testing was necessary to assess additional types of validity and reliability. The purpose of this paper is to further describe the psychometric testing of the Quick-EBP-VIK survey instrument. This descriptive study was designed to assess test-retest reliability, internal consistency and construct validity via a web-based survey. The survey instrument was e-mailed to all nurses at the study hospital. Nurses who responded to the first survey (Wave 1) received another e-mail invitation to complete the survey instrument again (Wave 2) for the purpose of assessing the test-retest reliability of the instrument. A total of 1,177 deliverable e-mails were sent to all nursing staff at one free standing pediatric hospital with Magnet ® designation in the northeast. A total of 382 nurses returned completed surveys, indicating a 32.5% response rate for Wave 1. A total of 131 nurses responded to Wave 2 indicating a response rate of 34.3%. The intraclass correlation coefficients for the items included in the final instrument ranged from 0.43 to 0.80 and were deemed sufficient. These represent a sufficient intraclass correlation coefficient. The Cronbach's Alpha values for each of the three domains are all higher than 0.7 indicating that the items of each of the measurement dimension are internally consistent. However, the composite reliability of the third domain was slightly lower than 0.7 when using Raykov's Rho. The Quick-EBP-VIK instrument has gone through rigorous comprehensive testing and has demonstrated good psychometric properties. © 2016 Sigma Theta Tau International.

Measuring social impacts of breast carcinoma treatment in Chinese women.

PubMed

Fielding, Richard; Lam, Wendy W T

2004-06-15

There is no existing instrument that is suitable for measuring the social impact of breast carcinoma (BC) and its treatment among women of Southern Chinese descent. In the current study, the authors assessed the validity of the Chinese Social Adjustment Scale, which was designed to address the need for such an instrument. Five dimensions of social concern were identified in a previous study of Cantonese-speaking Chinese women with BC; these dimensions were family and other relationships, intimacy, private self-image, and public self-image. The authors designed 40 items to address perceptions of change in these areas. These items were administered to a group of 226 women who had received treatment for BC, and factor analysis subsequently was performed to determine construct characteristics. The resulting draft instrument then was administered, along with other measures for the assessment of basic psychometric properties, to a second group of 367 women who recently had undergone surgery for BC. Factor analysis optimally identified 5 factors (corresponding to 33 items): 1) Relationships with Family (10 items, accounting for 22% of variance); 2) Self-Image (7 items, accounting for 15% of variance); 3) Relationships with Friends (7 items, accounting for 8% of variance); 4) Social Enjoyment (4 items, accounting for 6% of variance); and 5) Attractiveness and Sexuality (5 items, accounting for 5% of variance). Subscales were reliable (alpha = 0.63-0.93) and exhibited convergent validity in positive correlations with related measures and divergent validity in appropriate inverse or nonsignificant correlations with other measures. Criterion validity was good, and sensitivity was acceptable. Patterns of change on the scales were consistent with reports in the literature. Self-administration resulted in improved sensitivity. The 33-item Chinese Social Adjustment Scale validly, reliably, and sensitively measures the social impact of BC on Cantonese-speaking Hong Kong Chinese women. Further development of the scale to increase its sensitivity is underway. Copyright 2004 American Cancer Society.

Development of a questionnaire for assessing the childbirth experience (QACE).

PubMed

Carquillat, Pierre; Vendittelli, Françoise; Perneger, Thomas; Guittier, Marie-Julia

2017-08-30

Due to its potential impact on women's psychological health, assessing perceptions of their childbirth experience is important. The aim of this study was to develop a multidimensional self-reporting questionnaire to evaluate the childbirth experience. Factors influencing the childbirth experience were identified from a literature review and the results of a previous qualitative study. A total of 25 items were combined from existing instruments or were created de novo. A draft version was pilot tested for face validity with 30 women and submitted for evaluation of its construct validity to 477 primiparous women at one-month post-partum. The recruitment took place in two obstetric clinics from Swiss and French university hospitals. To evaluate the content validity, we compared item responses to general childbirth experience assessments on a numeric, 0 to 10 rating scale. We dichotomized two group assessment scores: "0 to 7" and "8 to 10". We performed an exploratory factor analysis to identify underlying dimensions. In total, 291 women completed the questionnaire (response rate = 61%). The responses to 22 items were statistically significant between the 0 to 7 and 8 to 10 groups for the general childbirth experience assessments. An exploratory factor analysis yielded four sub-scales, which were labelled "relationship with staff" (4 items), "emotional status" (3 items), "first moments with the new born," (3 items) and "feelings at one month postpartum" (3 items). All 4 scales had satisfactory internal consistency levels (alpha coefficients from 0.70 to 0.85). The full 25-item version can be used to analyse each item by itself, and the short 4-dimension version can be scored to summarize the general assessment of the childbirth experience. The Questionnaire for Assessing the Childbirth Experience (QACE) could be useful as a screening instrument to identify women with negative childbirth experiences. It can be used as both a research instrument in its short version and a questionnaire for use in clinical practice in its full version.

Evidence on the validity and reliability of the German, French and Italian nursing home version of the Basel Extent of Rationing of Nursing Care instrument.

PubMed

Zúñiga, Franziska; Schubert, Maria; Hamers, Jan P H; Simon, Michael; Schwendimann, René; Engberg, Sandra; Ausserhofer, Dietmar

2016-08-01

To develop and test psychometrically the Basel Extent of Rationing of Nursing Care for Nursing Homes instrument, providing initial evidence on the validity and reliability of the German, French and Italian-language versions. In the hospital setting, implicit rationing of nursing care is defined as the withholding of nursing activities due to lack of resources, such as staffing or time. No instrument existed to measure this concept in nursing homes. Cross-sectional study. We developed the instrument in three phases: (1) adaption and translation; (2) content validity testing; and (3) initial validity and reliability testing. For phase 3, we analysed survey data from 4748 care workers collected between May 2012-April 2013 from a randomly selected sample of 162 nursing homes in the German-, French- and Italian-speaking regions of Switzerland to provide evidence from response processes (e.g. missing), internal structure (exploratory factor analysis), inter-item inconsistencies (e.g. Cronbach's alpha) and interscorer differences (e.g. within-group agreement). Exploratory factor analysis revealed a four-factor structure with good fit statistics. Rationing of nursing care was structured in four domains: (1) activities of daily living; (2) caring, rehabilitation and monitoring; (3) documentation; and (4) social care. Items of the social care subscale showed lower content validity and more missing values than items of other subscales. First evidence indicates that the new instrument can be recommended for research and practice to measure implicit rationing of nursing care in nursing homes. Further refinements of single items are needed. © 2016 John Wiley & Sons Ltd.

Evaluation and performance of a newly developed patient-reported outcome instrument for diarrhea-predominant irritable bowel syndrome in a clinical study population

PubMed Central

Delgado-Herrera, Leticia; Lasch, Kathryn; Zeiher, Bernhardt; Lembo, Anthony J.; Drossman, Douglas A.; Banderas, Benjamin; Rosa, Kathleen; Lademacher, Christopher; Arbuckle, Rob

2017-01-01

Background: To evaluate the psychometric properties of the newly developed seven-item Irritable Bowel Syndrome – Diarrhea predominant (IBS-D) Daily Symptom Diary and four-item Event Log using phase II clinical trial safety and efficacy data in patients with IBS-D. This instrument measures diarrhea (stool frequency and stool consistency), abdominal pain related to IBS-D (stomach pain, abdominal pain, abdominal cramps), immediate need to have a bowel movement (immediate need and accident occurrence), bloating, pressure, gas, and incomplete evacuation. Methods: Psychometric properties and responsiveness of the instrument were evaluated in a clinical trial population [ClinicalTrials.gov identifier: NCT01494233]. Results: A total of 434 patients were included in the analyses. Significant differences were found among severity groups (p < 0.01) defined by IBS Patient Global Impression of Severity (PGI-S) and IBS Patient Global Impression of Change (PGI-C). Severity scores for each Diary and Event Log item score and five-item, four-item, and three-item summary scores were calculated. Between-group differences in changes over time were significant for all summary scores in groups stratified by changes in PGI-S (p < 0.05), two of six Diary items, and three of four Event Log items; a one-grade change in PGI-S was considered a meaningful difference with mean change scores on all Diary items −0.13 to −0.86 [standard deviation (SD) 0.79–1.39]. Similarly, for patients who reported being ‘slightly improved’ (considered a clinically meaningful difference) on the PGI-C, mean change scores on Diary items ranged from −0.45 to −1.55 (SD 0.69–1.39). All estimates of clinically important change for each item and all summary scores were small and should be considered preliminary. These results are aligned with the previous standalone psychometric study regarding reliability and validity tests. Conclusions: These analyses provide evidence of the psychometric properties of the IBS-D Daily Symptom Diary and Event Log in a clinical trial population. PMID:28932269

The development of a science process assessment for fourth-grade students

NASA Astrophysics Data System (ADS)

Smith, Kathleen A.; Welliver, Paul W.

In this study, a multiple-choice test entitled the Science Process Assessment was developed to measure the science process skills of students in grade four. Based on the Recommended Science Competency Continuum for Grades K to 6 for Pennsylvania Schools, this instrument measured the skills of (1) observing, (2) classifying, (3) inferring, (4) predicting, (5) measuring, (6) communicating, (7) using space/time relations, (8) defining operationally, (9) formulating hypotheses, (10) experimenting, (11) recognizing variables, (12) interpreting data, and (13) formulating models. To prepare the instrument, classroom teachers and science educators were invited to participate in two science education workshops designed to develop an item bank of test questions applicable to measuring process skill learning. Participants formed writing teams and generated 65 test items representing the 13 process skills. After a comprehensive group critique of each item, 61 items were identified for inclusion into the Science Process Assessment item bank. To establish content validity, the item bank was submitted to a select panel of science educators for the purpose of judging item acceptability. This analysis yielded 55 acceptable test items and produced the Science Process Assessment, Pilot 1. Pilot 1 was administered to 184 fourth-grade students. Students were given a copy of the test booklet; teachers read each test aloud to the students. Upon completion of this first administration, data from the item analysis yielded a reliability coefficient of 0.73. Subsequently, 40 test items were identified for the Science Process Assessment, Pilot 2. Using the test-retest method, the Science Process Assessment, Pilot 2 (Test 1 and Test 2) was administered to 113 fourth-grade students. Reliability coefficients of 0.80 and 0.82, respectively, were ascertained. The correlation between Test 1 and Test 2 was 0.77. The results of this study indicate that (1) the Science Process Assessment, Pilot 2, is a valid and reliable instrument applicable to measuring the science process skills of students in grade four, (2) using educational workshops as a means of developing item banks of test questions is viable and productive in the test development process, and (3) involving classroom teachers and science educators in the test development process is educationally efficient and effective.

Evaluation of motivationally tailored vs. standard self-help physical activity interventions at the workplace.

PubMed

Marcus, B H; Emmons, K M; Simkin-Silverman, L R; Linnan, L A; Taylor, E R; Bock, B C; Roberts, M B; Rossi, J S; Abrams, D B

1998-01-01

This study compares the efficacy of a self-help intervention tailored to the individual's stage of motivational readiness for exercise adoption with a standard self-help exercise promotion intervention. Interventions were delivered at baseline and 1 month; assessments were collected at baseline and 3 months. Eleven worksites participating in the Working Healthy Research Trial. Participants (n = 1559) were a subsample of employees at participating worksites, individually randomized to one of two treatment conditions. Printed self-help exercise promotion materials either (1) matched to the individual's stage of motivational readiness for exercise adoption (motivationally tailored), or (2) standard materials (standard). Measures of stage of motivational readiness for exercise and items from the 7-Day Physical Activity Recall. Among intervention completers (n = 903), chi-square analyses showed that, compared to the standard intervention, those receiving the motivationally tailored intervention were significantly more likely to show increases (37% vs. 27%) and less likely to show either no change (52% vs. 58%) or regression (11% vs. 15%) in stage of motivational readiness. Multivariate analyses of variance showed that changes in stage of motivational readiness were significantly associated with changes in self-reported time spent in exercise. This is the first prospective, randomized, controlled trial demonstrating the efficacy of a brief motivationally tailored intervention compared to a standard self-help intervention for exercise adoption. These findings appear to support treatment approaches that tailor interventions to the individual's stage of motivational readiness for exercise adoption.

Association of added sugar intake and caries-related experiences among individuals of Mexican origin.

PubMed

Vega-López, S; Lindberg, N M; Eckert, G J; Nicholson, E L; Maupomé, G

2018-04-16

Determine the association between key dental outcomes and added sugar intake using a survey instrument to assess added sugars, which was specifically tailored to immigrant and US-born adults of Mexican origin. Hispanic adults of Mexican origin (n = 326; 36.2 ± 12.1 years) completed a self-administered survey to gather acculturation, self-reported dental experiences and self-care practices (eg brushing, flossing, pain, bleeding gums), and socio-demographic information. The survey included a culturally tailored 22-item Added Sugar Intake Estimate (ASIE) that assessed added sugar intake from processed foods and sugar-sweetened beverages in a semiquantitative food frequency questionnaire format. Linear regression, 2-sample t test, and ANOVA were used to evaluate associations of demographic and dental outcomes with daily added sugar intake. Of the mean total daily added sugar intake (99.6 ± 94.6 g), 36.5 ± 44.4 g was derived from sugar-containing foods and snacks, and 63.1 ± 68.2 g from beverages. Participants who reported greater added sugar intake were more likely to have reported the presence of a toothache in the preceding 12 months, having been prescribed antibiotics for dental reasons, being less likely to floss daily, have reported eating or drinking within 1 hour before bed and have lower psychological acculturation (P < .05 for all). Results were comparable when assessing intake from sugar-containing foods/snacks and sugar-sweetened beverages. This study confirmed the association between added sugar intake and self-reported dental outcomes among adults of Mexican origin and points to an urgent need to improve dietary behaviours in this population. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Development of the PROMIS positive emotional and sensory expectancies of smoking item banks.

PubMed

Tucker, Joan S; Shadel, William G; Edelen, Maria Orlando; Stucky, Brian D; Li, Zhen; Hansen, Mark; Cai, Li

2014-09-01

The positive emotional and sensory expectancies of cigarette smoking include improved cognitive abilities, positive affective states, and pleasurable sensorimotor sensations. This paper describes development of Positive Emotional and Sensory Expectancies of Smoking item banks that will serve to standardize the assessment of this construct among daily and nondaily cigarette smokers. Data came from daily (N = 4,201) and nondaily (N =1,183) smokers who completed an online survey. To identify a unidimensional set of items, we conducted item factor analyses, item response theory analyses, and differential item functioning analyses. Additionally, we evaluated the performance of fixed-item short forms (SFs) and computer adaptive tests (CATs) to efficiently assess the construct. Eighteen items were included in the item banks (15 common across daily and nondaily smokers, 1 unique to daily, 2 unique to nondaily). The item banks are strongly unidimensional, highly reliable (reliability = 0.95 for both), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.86). Results from simulated CATs indicated that, on average, less than 8 items are needed to assess the construct with adequate precision using the item banks. These analyses identified a new set of items that can assess the positive emotional and sensory expectancies of smoking in a reliable and standardized manner. Considerable efficiency in assessing this construct can be achieved by using the item bank SF, employing computer adaptive tests, or selecting subsets of items tailored to specific research or clinical purposes. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

[Development and validation of an instrument for initial nursing assessment].

PubMed

Fernández-Sola, Cayetano; Granero-Molina, José; Mollinedo-Mallea, Judith; de Gonzales, María Hilda Peredo; Aguilera-Manrique, Gabriel; Ponce, Mara Luna

2012-12-01

The objective of this study, conducted in Bolivia from April to July of 2008, is the design and validation of an initial nursing assessment instrument to be used in clinical and educational environments in Santa Cruz (Bolivia). Twelve Bolivian nurses participated; both document analysis as well as consensus techniques were used to determine the categories and criteria to be assessed. Categories included in the nursing assessment instrument are a physical assessment and the eleven Gordon's Functional Health Patterns. The nursing assessment instrument stands out as being concise, easy to complete and utilizing a nursing approach. It does not include items for advanced nursing assessment. However, it incorporates items regarding lifestyle and the patient's autonomy. The nursing assessment instrument contributes to improving the quality of clinical records, supports the nursing diagnosis and implementation of the nursing process, promotes the nurse's role and helps to standardize practice.

Investigating Assessment Bias for Constructed Response Explanation Tasks: Implications for Evaluating Performance Expectations for Scientific Practice

NASA Astrophysics Data System (ADS)

Federer, Meghan Rector

Assessment is a key element in the process of science education teaching and research. Understanding sources of performance bias in science assessment is a major challenge for science education reforms. Prior research has documented several limitations of instrument types on the measurement of students' scientific knowledge (Liu et al., 2011; Messick, 1995; Popham, 2010). Furthermore, a large body of work has been devoted to reducing assessment biases that distort inferences about students' science understanding, particularly in multiple-choice [MC] instruments. Despite the above documented biases, much has yet to be determined for constructed response [CR] assessments in biology and their use for evaluating students' conceptual understanding of scientific practices (such as explanation). Understanding differences in science achievement provides important insights into whether science curricula and/or assessments are valid representations of student abilities. Using the integrative framework put forth by the National Research Council (2012), this dissertation aimed to explore whether assessment biases occur for assessment practices intended to measure students' conceptual understanding and proficiency in scientific practices. Using a large corpus of undergraduate biology students' explanations, three studies were conducted to examine whether known biases of MC instruments were also apparent in a CR instrument designed to assess students' explanatory practice and understanding of evolutionary change (ACORNS: Assessment of COntextual Reasoning about Natural Selection). The first study investigated the challenge of interpreting and scoring lexically ambiguous language in CR answers. The incorporation of 'multivalent' terms into scientific discourse practices often results in statements or explanations that are difficult to interpret and can produce faulty inferences about student knowledge. The results of this study indicate that many undergraduate biology majors frequently incorporate multivalent concepts into explanations of change, resulting in explanatory practices that were scientifically non-normative. However, use of follow-up question approaches was found to resolve this source of bias and thereby increase the validity of inferences about student understanding. The second study focused on issues of item and instrument structure, specifically item feature effects and item position effects, which have been shown to influence measures of student performance across assessment tasks. Results indicated that, along the instrument item sequence, items with similar surface features produced greater sequencing effects than sequences of items with dissimilar surface features. This bias could be addressed by use of a counterbalanced design (i.e., Latin Square) at the population level of analysis. Explanation scores were also highly correlated with student verbosity, despite verbosity being an intrinsically trivial aspect of explanation quality. Attempting to standardize student response length was one proposed solution to the verbosity bias. The third study explored gender differences in students' performance on constructed-response explanation tasks using impact (i.e., mean raw scores) and differential item function (i.e., item difficulties) patterns. While prior research in science education has suggested that females tend to perform better on constructed-response items, the results of this study revealed no overall differences in gender achievement. However, evaluation of specific item features patterns suggested that female respondents have a slight advantage on unfamiliar explanation tasks. That is, male students tended to incorporate fewer scientifically normative concepts (i.e., key concepts) than females for unfamiliar taxa. Conversely, females tended to incorporate more scientifically non-normative ideas (i.e., naive ideas) than males for familiar taxa. Together these results indicate that gender achievement differences for this CR instrument may be a result of differences in how males and females interpret and respond to combinations of item features. Overall, the results presented in the subsequent chapters suggest that as science education shifts toward the evaluation of fused scientific knowledge and practice (e.g., explanation), it is essential that educators and researchers investigate potential sources of bias inherent to specific assessment practices. This dissertation revealed significant sources of CR assessment bias, and provided solutions to address these problems.

EAACI position paper on occupational rhinitis

PubMed Central

Moscato, Gianna; Vandenplas, Olivier; Van Wijk, Roy Gerth; Malo, Jean-Luc; Perfetti, Luca; Quirce, Santiago; Walusiak, Jolanta; Castano, Roberto; Pala, Gianni; Gautrin, Denyse; De Groot, Hans; Folletti, Ilenia; Yacoub, Mona Rita; Siracusa, Andrea

2009-01-01

The present document is the result of a consensus reached by a panel of experts from European and non-European countries on Occupational Rhinitis (OR), a disease of emerging relevance which has received little attention in comparison to occupational asthma. The document covers the main items of OR including epidemiology, diagnosis, management, socio-economic impact, preventive strategies and medicolegal issues. An operational definition and classification of OR tailored on that of occupational asthma, as well as a diagnostic algorithm based on steps allowing for different levels of diagnostic evidence are proposed. The needs for future research are pointed out. Key messages are issued for each item. PMID:19257881

Introducing the Body-QoL®: A New Patient-Reported Outcome Instrument for Measuring Body Satisfaction-Related Quality of Life in Aesthetic and Post-bariatric Body Contouring Patients.

PubMed

Danilla, Stefan; Cuevas, Pedro; Aedo, Sócrates; Dominguez, Carlos; Jara, Rocío; Calderón, María E; Al-Himdani, Sarah; Rios, Marco A; Taladriz, Cristián; Rodriguez, Diego; Gonzalez, Rolando; Lazo, Ángel; Erazo, Cristián; Benitez, Susana; Andrades, Patricio; Sepúlveda, Sergio

2016-02-01

To develop a new patient-reported outcome instrument (PRO) to measure body-related satisfaction quality of life (QoL). Standard 3-phase PRO design was followed; in the first phase, a qualitative design was used in 45 patients to develop a conceptual framework and to create preliminary scale domains and items. In phase 2, large-scale population testing on 1340 subjects was performed to reduce items and domains. In phase 3, final testing of the developed instrument on 34 patients was performed. Statistics used include Factor, RASCH, and multivariate regression analysis. Psychometric properties measured were internal reliability, item-rest, item-test, and test-retest correlations. The PRO-developed instrument is composed of four domains (satisfaction with the abdomen, sex life, self-esteem and social life, and physical symptoms) and 20 items in total. The score can range from 20 (worst) to 100 (best). Responsiveness was 100 %, internal reliability 93.3 %, and test-retest concordance 97.7 %. Body image-related QoL was superior in men than women (p < 0.001) and decreased with increasing age (p = 0.004) and BMI (p < 0.001). Post-bariatric body contouring patients score lower than cosmetic patients in all domains of the Body-QoL instrument (p < 0.001). After surgery, the score improves by on average 21.9 ± 16.9 (effect size 1.8, p < 0.001). Body satisfaction-related QoL can be measured reliably with the Body-QoL instrument. It can be used to quantify the improvement in cosmetic and post-bariatric patients including non- or minimally invasive procedures, suction assisted lipectomy, abdominoplasty, lipoabdominoplasty, and lower body lift and to give an evidence-based approach to standard practice. This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266.

CTTITEM: SAS macro and SPSS syntax for classical item analysis.

PubMed

Lei, Pui-Wa; Wu, Qiong

2007-08-01

This article describes the functions of a SAS macro and an SPSS syntax that produce common statistics for conventional item analysis including Cronbach's alpha, item difficulty index (p-value or item mean), and item discrimination indices (D-index, point biserial and biserial correlations for dichotomous items and item-total correlation for polytomous items). These programs represent an improvement over the existing SAS and SPSS item analysis routines in terms of completeness and user-friendliness. To promote routine evaluations of item qualities in instrument development of any scale, the programs are available at no charge for interested users. The program codes along with a brief user's manual that contains instructions and examples are downloadable from suen.ed.psu.edu/-pwlei/plei.htm.

Towards more patient centred healthcare: A new Consumer Quality Index instrument to assess patients' experiences with breast care.

PubMed

Damman, Olga C; Hendriks, Michelle; Sixma, Herman J

2009-06-01

To develop a Consumer Quality Index (CQ-index) Breast Care instrument that measures quality of care from the perspective of patients with (suspicion of) breast cancer. To develop a pilot questionnaire, three focus group discussions with breast cancer patients were performed. The questionnaire was sent to 1197 patients. We performed psychometric and descriptive analyses to optimise the new instrument. Focus group discussions revealed nine main themes related to breast care quality. Psychometric analyses resulted in 15 reliable scales. The final instrument consisted of 152 items, of which 118 items regarded patients' experiences. The aspect with the highest need for quality improvement was informing patients about a second opinion. The CQ-index Breast Care (CQI-BC) instrument provides a good starting point for further research on the quality of breast care seen from the perspective of patients. The newly developed instrument can be used by different stakeholders for future quality monitoring.

Preliminary psychometric testing of the Fox Simple Quality-of-Life Scale.

PubMed

Fox, Sherry

2004-06-01

Although quality of life is extensively defined as subjective and multidimensional with both affective and cognitive components, few instruments capture important dimensions of the construct, and few are both conceptually congruent and user friendly for the clinical setting. The aim of this study was to develop and test a measure that would be easy to use clinically and capture both cognitive and affective components of quality of life. Initial item sources for the Fox Simple Quality-of-Life Scale (FSQOLS) were literature-based. Thirty items were compiled for content validity assessment by a panel of expert healthcare clinicians from various disciplines, predominantly nursing. Five items were removed as a result of the review because they reflected negatively worded or redundant items. The 25-item scale was mailed to 177 people with lung, colon, and ovarian cancer in various stages. Cancer types were selected theoretically, based on similarity in prognosis, degree of symptom burden, and possible meaning and experience. Of the 145 participants, all provided complete data on the FSQOLS. Psychometric evaluation of the FSQOLS included item-total correlations, principal components analysis with varimax rotation revealing two factors explaining 50% variance, reliability estimation using alpha estimates, and item-factor correlations. The FSQOLS exhibited significant convergent validity with four popular quality-of-life instruments: the Ferrans and Powers Quality of Life Index, the Functional Assessment of Cancer Therapy Scale, the Short-Form-36 Health Survey, and the General Well-Being Scale. Content validity of the scale was explored and supported using qualitative interviews of 14 participants with lung, colon and ovarian cancer, who were a subgroup of the sample for the initial instrument testing.

Development of the PROMIS health expectancies of smoking item banks.

PubMed

Edelen, Maria Orlando; Tucker, Joan S; Shadel, William G; Stucky, Brian D; Cerully, Jennifer; Li, Zhen; Hansen, Mark; Cai, Li

2014-09-01

Smokers' health-related outcome expectancies are associated with a number of important constructs in smoking research, yet there are no measures currently available that focus exclusively on this domain. This paper describes the development and evaluation of item banks for assessing the health expectancies of smoking. Using data from a sample of daily (N = 4,201) and nondaily (N = 1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning analyses (according to gender, age, and race/ethnicity) to arrive at a unidimensional set of health expectancies items for daily and nondaily smokers. We also evaluated the performance of short forms (SFs) and computer adaptive tests (CATs) to efficiently assess health expectancies. A total of 24 items were included in the Health Expectancies item banks; 13 items are common across daily and nondaily smokers, 6 are unique to daily, and 5 are unique to nondaily. For both daily and nondaily smokers, the Health Expectancies item banks are unidimensional, reliable (reliability = 0.95 and 0.96, respectively), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.87). Results from simulated CATs showed that health expectancies can be assessed with good precision with an average of 5-6 items adaptively selected from the item banks. Health expectancies of smoking can be assessed on the basis of these item banks via SFs, CATs, or through a tailored set of items selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Development of the PROMIS nicotine dependence item banks.

PubMed

Shadel, William G; Edelen, Maria Orlando; Tucker, Joan S; Stucky, Brian D; Hansen, Mark; Cai, Li

2014-09-01

Nicotine dependence is a core construct important for understanding cigarette smoking and smoking cessation behavior. This article describes analyses conducted to develop and evaluate item banks for assessing nicotine dependence among daily and nondaily smokers. Using data from a sample of daily (N = 4,201) and nondaily (N =1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning analyses (according to gender, age, and race/ethnicity) to arrive at a unidimensional set of nicotine dependence items for daily and nondaily smokers. We also evaluated performance of short forms (SFs) and computer adaptive tests (CATs) to efficiently assess dependence. A total of 32 items were included in the Nicotine Dependence item banks; 22 items are common across daily and nondaily smokers, 5 are unique to daily smokers, and 5 are unique to nondaily smokers. For both daily and nondaily smokers, the Nicotine Dependence item banks are strongly unidimensional, highly reliable (reliability = 0.97 and 0.97, respectively), and perform similarly across gender, age, and race/ethnicity groups. SFs common to daily and nondaily smokers consist of 8 and 4 items (reliability = 0.91 and 0.81, respectively). Results from simulated CATs showed that dependence can be assessed with very good precision for most respondents using fewer than 6 items adaptively selected from the item banks. Nicotine dependence on cigarettes can be assessed on the basis of these item banks via one of the SFs, by using CATs, or through a tailored set of items selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Development of the PROMIS negative psychosocial expectancies of smoking item banks.

PubMed

Stucky, Brian D; Edelen, Maria Orlando; Tucker, Joan S; Shadel, William G; Cerully, Jennifer; Kuhfeld, Megan; Hansen, Mark; Cai, Li

2014-09-01

Negative psychosocial expectancies of smoking include aspects of social disapproval and disappointment in oneself. This paper describes analyses conducted to develop and evaluate item banks for assessing psychosocial expectancies among daily and nondaily smokers. Using data from a sample of daily (N = 4,201) and nondaily (N =1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning analyses (according to gender, age, and race/ethnicity) to arrive at a unidimensional set of psychosocial expectancies items for daily and nondaily smokers. We also evaluated performance of short forms (SFs) and computer adaptive tests (CATs) to efficiently assess psychosocial expectancies. A total of 21 items were included in the Psychosocial Expectancies item banks: 14 items are common across daily and nondaily smokers, 6 are unique to daily, and 1 is unique to nondaily. For both daily and nondaily smokers, the Psychosocial Expectancies item banks are strongly unidimensional, highly reliable (reliability = 0.95 and 0.93, respectively), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.85). Results from simulated CATs showed that, on average, fewer than 8 items are needed to assess psychosocial expectancies with adequate precision when using the item banks. Psychosocial expectancies of smoking can be assessed on the basis of these item banks via the SF, by using CAT, or through a tailored set of items selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

An Application of Reverse Engineering to Automatic Item Generation: A Proof of Concept Using Automatically Generated Figures

ERIC Educational Resources Information Center

Lorié, William A.

2013-01-01

A reverse engineering approach to automatic item generation (AIG) was applied to a figure-based publicly released test item from the Organisation for Economic Cooperation and Development (OECD) Programme for International Student Assessment (PISA) mathematical literacy cognitive instrument as part of a proof of concept. The author created an item…

Developing the Communicative Participation Item Bank: Rasch Analysis Results from a Spasmodic Dysphonia Sample

ERIC Educational Resources Information Center

Baylor, Carolyn R.; Yorkston, Kathryn M.; Eadie, Tanya L.; Miller, Robert M.; Amtmann, Dagmar

2009-01-01

Purpose: The purpose of this study was to conduct the initial psychometric analyses of the Communicative Participation Item Bank--a new self-report instrument designed to measure the extent to which communication disorders interfere with communicative participation. This item bank is intended for community-dwelling adults across a range of…

Generalizability and Dependability of a Multi-Item Direct Behavior Rating Scale in a Kindergarten Classroom Setting

ERIC Educational Resources Information Center

Wickerd, Garry; Hulac, David

2017-01-01

Accurate and rapid identification of students displaying behavioral problems requires instrumentation that is user friendly and reliable. The purpose of the study was to evaluate a multi-item direct behavior rating scale called the Direct Behavior Rating-Multiple Item Scale (DBR-MIS) for disruptive behavior to determine the number of…

An Analysis of the Individual Effects of Sex Bias.

ERIC Educational Resources Information Center

Smith, Richard M.

Most attempts to correct for the presence of biased test items in a measurement instrument have been either to remove the items or to adjust the scores to correct for the bias. Using the Rasch Dichotomous Response Model and the independent ability estimates derived from three sets of items, those which favor females, those which favor males, and…

Measuring Collaboration and Communication to Increase Implementation of Evidence-Based Practices: The Cultural Exchange Inventory

ERIC Educational Resources Information Center

Palinkas, Lawrence A.; Garcia, Antonio; Aarons, Gregory; Finno-Velasquez, Megan; Fuentes, Dahlia; Holloway, Ian; Chamberlain, Patricia

2018-01-01

The Cultural Exchange Inventory (CEI) is a 15-item instrument designed to measure the process (7 items) and outcomes (8 items) of exchanges of knowledge, attitudes and practices between members of different organisations collaborating in implementing evidence-based practice. We conducted principal axis factor analyses and parallel analyses of data…

The Swiss Health Literacy Survey: development and psychometric properties of a multidimensional instrument to assess competencies for health

PubMed Central

Wang, Jen; Thombs, Brett D.; Schmid, Margareta R.

2012-01-01

Abstract Background  Growing recognition of the role of citizens and patients in health and health care has placed a spotlight on health literacy and patient education. Objective  To identify specific competencies for health in definitions of health literacy and patient‐centred concepts and empirically test their dimensionality in the general population. Methods  A thorough review of the literature on health literacy, self‐management, patient empowerment, patient education and shared decision making revealed considerable conceptual overlap as competencies for health and identified a corpus of 30 generic competencies for health. A questionnaire containing 127 items covering the 30 competencies was fielded as a telephone interview in German, French and Italian among 1255 respondents randomly selected from the resident population in Switzerland. Findings  Analyses with the software MPlus to model items with mixed response categories showed that the items do not load onto a single factor. Multifactorial models with good fit could be erected for each of five dimensions defined a priori and their corresponding competencies: information and knowledge (four competencies, 17 items), general cognitive skills (four competencies, 17 items), social roles (two competencies, seven items), medical management (four competencies, 27 items) and healthy lifestyle (two competencies, six items). Multiple indicators and multiple causes models identified problematic differential item functioning for only six items belonging to two competencies. Conclusions  The psychometric analyses of this instrument support broader conceptualization of health literacy not as a single competence but rather as a package of competencies for health. PMID:22390287

A mixed methods approach to adapting health-related quality of life measures for use in routine oncology clinical practice.

PubMed

Harley, Clare; Takeuchi, Elena; Taylor, Sally; Keding, Ada; Absolom, Kate; Brown, Julia; Velikova, Galina

2012-04-01

The current study reviewed and adapted existing health-related quality of life (HRQoL) instruments for use in routine clinical practice delivering outpatient chemotherapy for colorectal, breast and gynaecological cancers. 564 (288 gynaecological, 208 breast and 68 colorectal) outpatient consultations of 141 patients were audio-recorded and analysed to identify discussed issues. Issues were ranked from most to least commonly discussed within each disease group. Existing HRQoL instruments were evaluated against these lists and best fitting items entered into cancer-specific item banks. Item banks were evaluated during semi-structured interviews by twenty-one oncologists (13 consultants and 8 specialist registrars), four clinical nurse specialists and thirty patients, from breast, gynaecological and colorectal cancer practices. Pilot questionnaires were completed by 448 (145 breast, 148 gynaecological and 155 colorectal) patients attending outpatient clinics. Item selection and scale reliability was explored using descriptive data and psychometric methods alongside qualitative patient and clinician ratings. Each questionnaire includes five physical and three psychosocial function scales each with good internal consistency reliability (α > 0.70) plus disease-specific individual-symptom items identified as useful in clinical practice. Three cancer-specific health-related quality of life measures were developed for use in routine clinical practice. Initial analyses suggest good clinical utility and acceptable psychometric properties for the new instruments.

The CAT: A Gender-Inclusive Measure of Controlling and Abusive Tactics.

PubMed

Hamel, John; Jones, Daniel N; Dutton, Donald G; Graham-Kevan, Nicola

2015-01-01

Research has consistently found that partner violence, defined as physical abuse between married, cohabitating, or dating partners, is not the only type of abuse with long-term deleterious effects on victims. Male and female victims alike report that emotional abuse, along with controlling behaviors, are often as or more traumatic. Existing instruments used to measure emotional abuse and control have either been limited to male-perpetrated behaviors, as conceived in the well-known Duluth "Power and Control" wheel, or field tested on dating or general population samples. This study discusses the genesis and evolution of a gender-inclusive instrument, the Controlling and Abusive Tactics (CAT) Questionnaire, which was field tested on males and females with both a clinical and general population sample. For perpetration, a preliminary comparison across gender found no significant differences across gender for the great majority of items, with women reporting significantly higher rates on 9 items, and men reporting significantly higher rates on 6 items. Women reported higher rates of received abuse than men on 28 of 30 items in which gender differences were found to be significant, but both males and females reported higher victimization than perpetration rates on all items. Exploratory and confirmatory factor analyses resulted in the CAT-2, a valid and reliable instrument appropriate for clinical use by treatment providers as well as for research purposes.

Development and psychometric evaluation of a health-related quality of life instrument for individuals with adult-onset hearing loss.

PubMed

Stika, Carren J; Hays, Ron D

2015-07-01

Self-reports of 'hearing handicap' are available, but a comprehensive measure of health-related quality of life (HRQOL) for individuals with adult-onset hearing loss (AOHL) does not exist. Our objective was to develop and evaluate a multidimensional HRQOL instrument for individuals with AOHL. The Impact of Hearing Loss Inventory Tool (IHEAR-IT) was developed using results of focus groups, a literature review, advisory expert panel input, and cognitive interviews. The 73-item field-test instrument was completed by 409 adults (22-91 years old) with varying degrees of AOHL and from different areas of the USA. Multitrait scaling analysis supported four multi-item scales and five individual items. Internal consistency reliabilities ranged from 0.93 to 0.96 for the scales. Construct validity was supported by correlations between the IHEAR-IT scales and scores on the 36-item Short Form Health Survey, version 2.0 (SF-36v2) mental composite summary (r = 0.32-0.64) and the Hearing Handicap Inventory for the Elderly/Adults (HHIE/HHIA) (r ≥ -0.70). The field test provides initial support for the reliability and construct validity of the IHEAR-IT for evaluating HRQOL of individuals with AOHL. Further research is needed to evaluate the responsiveness to change of the IHEAR-IT scales and identify items for a short-form.

Diagnostic Efficiency among Psychiatric Outpatients of a Self-Report Version of a Subset of Screen Items of the Structured Clinical Interview for DSM-IV-TR Personality Disorders (SCID-II)

ERIC Educational Resources Information Center

Germans, Sara; Van Heck, Guus L.; Masthoff, Erik D.; Trompenaars, Fons J. W. M.; Hodiamont, Paul P. G.

2010-01-01

This article describes the identification of a 10-item set of the Structured Clinical Interview for DSM-IV Personality Disorders (SCID-II) items, which proved to be effective as a self-report assessment instrument in screening personality disorders. The item selection was based on the retrospective analyses of 495 SCID-II interviews. The…

Patient Evaluation of Emotional Comfort Experienced (PEECE): developing and testing a measurement instrument

PubMed Central

Lester, L; Bulsara, C; Petterson, A; Bennett, K; Allen, E; Joske, D

2017-01-01

Objectives The Patient Evaluation of Emotional Comfort Experienced (PEECE) is a 12-item questionnaire which measures the mental well-being state of emotional comfort in patients. The instrument was developed using previous qualitative work and published literature. Design Instrument development. Setting Acute Care Public Hospital, Western Australia. Participants Sample of 374 patients. Interventions A multidisciplinary expert panel assessed the face and content validity of the instrument and following a pilot study, the psychometric properties of the instrument were explored. Main outcome measures Exploratory and confirmatory factor analysis assessed the underlying dimensions of the PEECE instrument; Cronbach's α was used to determine the reliability; κ was used for test–retest reliability of the ordinal items. Results 2 factors were identified in the instrument and named ‘positive emotions’ and ‘perceived meaning’. A greater proportion of male patients were found to report positive emotions compared with female patients. The instrument was found to be feasible, reliable and valid for use with inpatients and outpatients. Conclusions PEECE was found to be a feasible instrument for use with inpatient and outpatients, being easily understood and completed. Further psychometric testing is recommended. PMID:28122833

National Workshop on Astrobiology: The Life Science Involvement of AAS I Laben

NASA Astrophysics Data System (ADS)

Adami, Giorgio

2006-12-01

The search for traces of past and present life is a complex and multidisciplinary research activity involving several scientific heritages and a specific industrial ability for planetary exploration. Laben was established in 1958 to design and manufacture electronic instruments for research in nuclear physics. In the mid 2004 the company was merged with Alenia Spazio. It is now part of Alcatel Alenia Space, a French Italian joint venture. Alcatel Alenia Space Italia SpA is a Finmeccanica Company. Currently the plant of Vimodrone provides a wide heritage in life science oriented to space application. The experience in Space Life Science is consolidated in the following research areas: (1) Physiology: Mouse models related to studies on human physiology Human neuroscience research and dosimetry (2) Animal Adaptation and Behaviour: mice behaviour related to stabling stress (3) Developmental Biology: aquatic microorganisms cultivation (4) Cell culture & Biotechnology: Protein crystal growth General purpose Multiwell Next Biotechnology studies and development: Bio reactor, mainly oriented to tissue engineering Microsensor for tissue control (organ replacement) Multiwell for adherent cell culture or for automated biosensor based on cell culture Experiment Container for organic systems Experiment Container for small animals Instrumentation based on fluorescent Biosensors Sensors for Life science experiments for Biopan capsule and Space Vehicle Ray Shielding Materials Random Positioning Machine specialisation (Support ground equipment) The biological features of this heritage is at disposal for the exobiology multi science. The involvement of industries, from the beginning of the exobiology projects, allows a cost effective technologies closed loop development between Research Centres, Principal Investigators and industry.

Evaluation of the psychometric properties of the Nighttime Symptoms of COPD Instrument.

PubMed

Mocarski, Michelle; Zaiser, Erica; Trundell, Dylan; Make, Barry J; Hareendran, Asha

2015-01-01

Nighttime symptoms can negatively impact the quality of life of patients with chronic obstructive pulmonary disease (COPD). The Nighttime Symptoms of COPD Instrument (NiSCI) was designed to measure the occurrence and severity of nighttime symptoms in patients with COPD, the impact of symptoms on nighttime awakenings, and rescue medication use. The objective of this study was to explore item reduction, inform scoring recommendations, and evaluate the psychometric properties of the NiSCI. COPD patients participating in a Phase III clinical trial completed the NiSCI daily. Item analyses were conducted using weekly mean and single day scores. Descriptive statistics (including percentage of respondents at floor/ceiling and inter-item correlations), factor analyses, and Rasch model analyses were conducted to examine item performance and scoring. Test-retest reliability was assessed for the final instrument using the intraclass correlation coefficient (ICC). Correlations with assessments conducted during study visits were used to evaluate convergent and known-groups validity. Data from 1,663 COPD patients aged 40-93 years were analyzed. Item analyses supported the generation of four scores. A one-factor structure was confirmed with factor analysis and Rasch analysis for the symptom severity score. Test-retest reliability was confirmed for the six-item symptom severity (ICC, 0.85), number of nighttime awakenings (ICC, 0.82), and rescue medication (ICC, 0.68) scores. Convergent validity was supported by significant correlations between the NiSCI, St George's Respiratory Questionnaire, and Exacerbations of Chronic Obstructive Pulmonary Disease Tool-Respiratory Symptoms scores. The results suggest that the NiSCI can be used to determine the severity of nighttime COPD symptoms, the number of nighttime awakenings due to COPD symptoms, and the nighttime use of rescue medication. The NiSCI is a reliable and valid instrument to evaluate these concepts in COPD patients in clinical trials and clinical practice. Scoring recommendations and steps for further research are discussed.

On Using Simulations to Inform Decision Making during Instrument Development

ERIC Educational Resources Information Center

Morgan, Grant B.; Moore, Courtney A.; Floyd, Harlee S.

2018-01-01

Although content validity--how well each item of an instrument represents the construct being measured--is foundational in the development of an instrument, statistical validity is also important to the decisions that are made based on the instrument. The primary purpose of this study is to demonstrate how simulation studies can be used to assist…

The shortened food expectations--Long-term care questionnaire: Assessing nursing home residents' satisfaction with food and food service.

PubMed

Crogan, Neva L; Evans, Bronwynne C

2006-11-01

Lack of nursing home resident satisfaction with meals often results in reduced food intake, leading to poor nutritional status, weight loss, functional decline, and depression. The purpose of this article is to describe the development and initial testing of the 28-item revised Food Expectations-Long-Term Care (FoodEx-LTC) questionnaire with a convenience sample of nursing home residents (N = 61). Because of possible respondent burden, the original 44-item, five-domain FoodEx-LTC was revised, resulting in the deletion of 16 redundant items and those with inter-item correlations less than .25. Coefficient alpha scores ranged from .65 to .82, and test-retest correlations ranged from .79 to .88, dependent on domain. This revised instrument has good initial validity and reliability, resulting in a shorter instrument that accurately assesses nursing home resident satisfaction with food and food service.

Developing an item bank and short forms that assess the impact of asthma on quality of life.

PubMed

Stucky, Brian D; Edelen, Maria Orlando; Sherbourne, Cathy D; Eberhart, Nicole K; Lara, Marielena

2014-02-01

The present work describes the process of developing an item bank and short forms that measure the impact of asthma on quality of life (QoL) that avoids confounding QoL with asthma symptomatology and functional impairment. Using a diverse national sample of adults with asthma (N = 2032) we conducted exploratory and confirmatory factor analyses, and item response theory and differential item functioning analyses to develop a 65-item unidimensional item bank and separate short form assessments. A psychometric evaluation of the RAND Impact of Asthma on QoL item bank (RAND-IAQL) suggests that though the concept of asthma impact on QoL is multi-faceted, it may be measured as a single underlying construct. The performance of the bank was then evaluated with a real-data simulated computer adaptive test. From the RAND-IAQL item bank we then developed two short forms consisting of 4 and 12 items (reliability = 0.86 and 0.93, respectively). A real-data simulated computer adaptive test suggests that as few as 4-5 items from the bank are needed to obtain highly precise scores. Preliminary validity results indicate that the RAND-IAQL measures distinguish between levels of asthma control. To measure the impact of asthma on QoL, users of these items may choose from two highly reliable short forms, computer adaptive test administration, or content-specific subsets of items from the bank tailored to their specific needs. Copyright © 2013 Elsevier Ltd. All rights reserved.

Development of the PROMIS coping expectancies of smoking item banks.

PubMed

Shadel, William G; Edelen, Maria Orlando; Tucker, Joan S; Stucky, Brian D; Hansen, Mark; Cai, Li

2014-09-01

Smoking is a coping strategy for many smokers who then have difficulty finding new ways to cope with negative affect when they quit. This paper describes analyses conducted to develop and evaluate item banks for assessing the coping expectancies of smoking for daily and nondaily smokers. Using data from a large sample of daily (N = 4,201) and nondaily (N = 1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning (DIF) analyses (according to gender, age, and ethnicity) to arrive at a unidimensional set of items for daily and nondaily smokers. We also evaluated performance of short forms (SFs) and computer adaptive tests (CATs) for assessing coping expectancies of smoking. For both daily and nondaily smokers, the unidimensional Coping Expectancies item banks (21 items) are relatively DIF free and are highly reliable (0.96 and 0.97, respectively). A common 4-item SF for daily and nondaily smokers also showed good reliability (0.85). Adaptive tests required an average of 4.3 and 3.7 items for simulated daily and nondaily respondents, respectively, and achieved reliabilities of 0.91 for both when the maximum test length was 10 items. This research provides a new set of items that can be used to reliably assess coping expectancies of smoking, through a SF, CAT, or a tailored set selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Qualitative modification and development of patient- and caregiver-reported outcome measures for iron chelation therapy.

PubMed

Horodniceanu, Erica G; Bal, Vasudha; Dhatt, Harman; Carter, John A; Huang, Vicky; Lasch, Kathryn

2017-06-23

Compliance, palatability, gastrointestinal (GI) symptom, and treatment satisfaction patient- and observer-reported outcome (PRO, ObsRO) measures were developed/modified for patients with transfusion-dependent anemias or myelodysplastic syndrome (MDS) requiring iron chelation therapy (ICT). This qualitative cross-sectional observational study used grounded theory data collection and analysis methods and followed PRO/ObsRO development industry guidance. Patients and caregivers of patients with transfusion-dependent anemias or MDS were individually interviewed face-to-face to cognitively debrief the Compliance, Palatability, GI Symptom Diary, and Modified Satisfaction with Iron Chelation Therapy (SICT) instruments presented electronically. Interviews were conducted in sets. Interviews began open-endedly to spontaneously elicit ICT experiences. Item modifications were debriefed during the later interviews. Interviews were audio recorded, transcribed, and coded. Data was analyzed using ATLAS.ti qualitative research software. Twenty-one interviews were completed (Set 1: 5 patients, 6 caregivers; Set 2: 6 patients, 4 caregivers) in 6 US cities. Mean age was 43 years for patients and 9 years for children of caregivers. Conditions requiring ICT use across groups included transfusion-dependent anemias (85.7%) and MDS (14.3%). Concepts spontaneously reported were consistent with instruments debriefed. Interview analysis resulted in PRO and ObsRO versions of each instrument: Compliance (2 items), Palatability (4 items), GI Symptom Diary (6 items), and Modified SICT (PRO = 13, ObsRO = 17 items). Qualitative research data from cognitive interviews supports the content validity and relevance of the instruments developed/modified. Quantitative validation of these PRO and ObsRO measures is needed testing for validity, reliability, and responsiveness for future research use with new formulations of oral ICT.

Development and psychometric validation of the general practice nurse satisfaction scale.

PubMed

Halcomb, Elizabeth J; Caldwell, Belinda; Salamonson, Yenna; Davidson, Patricia M

2011-09-01

To develop an instrument to assess consumer satisfaction with nursing in general practice to provide feedback to nurses about consumers' perceptions of their performance. Prospective psychometric instrument validation study. A literature review was conducted to generate items for an instrument to measure consumer satisfaction with nursing in general practice. Face and content validity were evaluated by an expert panel, which had extensive experience in general practice nursing and research. Included in the questionnaire battery was the 27-item General Practice Nurse Satisfaction (GPNS) scale, as well as demographic and health status items. This survey was distributed to 739 consumers following intervention administered by a practice nurse in 16 general practices across metropolitan, rural, and regional Australia. Participants had the option of completing the survey online or receiving a hard copy of the survey form at the time of their visit. These data were collected between June and August 2009. Satisfaction data from 739 consumers were collected following their consultation with a general practice nurse. From the initial 27-item GPNS scale, a 21-item instrument was developed. Two factors, "confidence and credibility" and "interpersonal and communication" were extracted using principal axis factoring and varimax rotation. These two factors explained 71.9% of the variance. Cronbach's α was 0.97. The GPNS scale has demonstrated acceptable psychometric properties and can be used both in research and clinical practice for evaluating consumer satisfaction with general practice nurses. Assessing consumer satisfaction is important for developing and evaluating nursing roles. The GPNS scale is a valid and reliable tool that can be utilized to assess consumer satisfaction with general practice nurses and can assist in performance management and improving the quality of nursing services. © 2011 Sigma Theta Tau International.

Development and validity of a method for the evaluation of printed education material

PubMed Central

Castro, Mauro Silveira; Pilger, Diogo; Fuchs, Flávio Danni; Ferreira, Maria Beatriz Cardoso

Objectives To develop and study the validity of an instrument for evaluation of Printed Education Materials (PEM); to evaluate the use of acceptability indices; to identify possible influences of professional aspects. Methods An instrument for PEM evaluation was developed which included tree steps: domain identification, item generation and instrument design. A reading to easy PEM was developed for education of patient with systemic hypertension and its treatment with hydrochlorothiazide. Construct validity was measured based on previously established errors purposively introduced into the PEM, which served as extreme groups. An acceptability index was applied taking into account the rate of professionals who should approve each item. Participants were 10 physicians (9 men) and 5 nurses (all women). Results Many professionals identified intentional errors of crude character. Few participants identified errors that needed more careful evaluation, and no one detected the intentional error that required literature analysis. Physicians considered as acceptable 95.8% of the items of the PEM, and nurses 29.2%. The differences between the scoring were statistically significant in 27% of the items. In the overall evaluation, 66.6% were considered as acceptable. The analysis of each item revealed a behavioral pattern for each professional group. Conclusions The use of instruments for evaluation of printed education materials is required and may improve the quality of the PEM available for the patients. Not always are the acceptability indices totally correct or represent high quality of information. The professional experience, the practice pattern, and perhaps the gendre of the reviewers may influence their evaluation. An analysis of the PEM by professionals in communication, in drug information, and patients should be carried out to improve the quality of the proposed material. PMID:25214924

Is the content of the Chinese Quality of Life Instrument (ChQOL) really valid in the context of traditional Chinese medicine in Hong Kong?

PubMed

Wong, Wendy; Lam, Cindy L K; Leung, K F; Zhao, L

2009-01-01

Content validity is crucial in quality of life instrument development but there is very little literature on this in Chinese culture. The Chinese Quality of Life Instrument (ChQOL) was developed in Mainland China to capture the health-related quality of life (HRQOL) concepts specific to traditional Chinese medicine (TCM). The aim of this study was to evaluate the content validity of ChQOL in a Chinese population whose spoken dialect and health-care system are different from those of Mainland China to find out whether the instrument is generalizable. 8 TCM practitioners and 10 patients rated the clarity, relevance and appropriateness of each of the 50 items of the ChQOL (HK version), and completed qualitative cognitive debriefing interviews. The content of ChQOL was rated valid by TCM practitioners with CVIs on clarity, relevance and appropriateness ranging from 80 to 100%. 49 out of 50 items were well understood by patients, but 12 items had CVI on relevance and 5 items had CVI on appropriateness lower than 70% among patients. After reviewing the patients and TCM practitioners' opinions, revisions were made for three items (2, 8 and 29) to form the ChQOL (HK version)-2008. In general, the ChQOL was found to be too long which called for shorter version. The content of ChQOL was shown to be really valid in the context of Chinese Medicine for Cantonese speaking Chinese. There was some discrepancy between the judgments of TCM practitioners and patients indicating the importance of evaluation by both experts and lay persons.

Measurement of specific medical school stress: translation of the "Perceived Medical School Stress Instrument" to the German language.

PubMed

Kötter, Thomas; Voltmer, Edgar

2013-01-01

Medical students encounter specific stressors during their studies. As a result, they develop anxiety, depression and burnout symptoms more frequently than their similarly aged, but employed counterparts. In 1984, Vitaliano et al. published a 13-item instrument for the measurement of stress specific to medical school: the "Perceived Medical School Stress Instrument" (PMSS). Since then, it has been widely applied and validated in English-speaking countries. No German version of the PMSS exists to date. Thus, our aim was to translate the instrument into the German language in order to be able to measure medical school stress in German-speaking countries. The items of the PMSS were translated into German by three separate researchers. The resulting translations were compared and combined with each other to establish a first German version of each item in the PMSS. These items were then translated back into English by two native English speakers to validate the correct primary translation. Based on a revised German version, a cognitive debriefing with 19 German medical students and a theoretical testing on 169 German medical students, the final German translations for each of the 13 items were determined. The PMSS was easily translated into German and there was a high congruency between the primary translations into German and the secondary translations back into English. Incongruities between the translations were solved quickly. The assessment of the German equivalent of the PMSS showed good results regarding its reliability (Cronbach's Alpha 0.81). A German version of the PMSS is now available for measuring the medical school related stress in German-speaking countries.

Development and Psychometric Properties of a Tuberculosis-Specific Multidimensional Health-Related Quality-of-Life Measure for Patients with Pulmonary Tuberculosis.

PubMed

Abdulelah, Juman; Sulaiman, Syed Azhar Syed; Hassali, Mohamed A; Blebil, Ali Q; Awaisu, Ahmed; Bredle, Jason M

2015-05-01

Various generic instruments exist to assess health-related quality of life (HRQOL) in patients with tuberculosis (TB), but a psychometrically sound disease-specific instrument is lacking. The present study aimed to develop and psychometrically validate a multidimensional TB-specific HRQOL instrument relevant to the value of patients with pulmonary TB in Iraq with an eye toward cross-cultural application. The core general HRQOL questionnaire is composed of the Functional Assessment of Cancer Therapy-General items. A modular approach was followed for the development of the Functional Assessment of Chronic Illness Therapy-Tuberculosis (FACIT-TB) questionnaire in which a set of items assessing quality-of-life (QOL) issues not sufficiently covered by the core Functional Assessment of Cancer Therapy-General items, but considered to be relevant to the target population, was added. Moreover, principal-component analysis was used to determine the new subscale structure of the questionnaire. In addition to the 27 items of the core questionnaire, a set of 20 items referring to disease symptoms related to the site of infection, adverse effects, and additional QOL dimensions such as fatigue, social stigma, and economic burden of the illness was included. Factor analysis demonstrated that the FACIT-TB construct comprised five domains. A rigorous method was applied in the development of the FACIT-TB measure to fully understand the impact of TB on patients' QOL. The instrument is psychometrically sound and portrays multiple important dimensions of HRQOL. FACIT-TB is relatively brief, is easy to administer and score, and is appropriate for use in clinical trials and practice. Copyright © 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

The Perinatal Palliative Care Perceptions and Barriers Scale Instrument©: development and validation.

PubMed

Wool, Charlotte; Northam, Sally

2011-12-01

To devise and test an instrument measuring clinician perceptions of perinatal palliative care (PPC) and barriers to care delivery. PPC was theorized to involve the care of pregnant women and their families after prenatal testing resulted in a life-limiting fetal diagnosis. Both giving birth to a child with a life-limiting condition or termination of pregnancy for fetal anomaly can be emotionally traumatic life events. Clinicians were thought to face ethical dilemmas that involved approaches to care for this population. The ethical dilemmas were measured on a perceptions scale using items about informed consent, justice, beneficence, and autonomy. Barriers were theorized as obstacles to delivering quality PPC and included insufficient education, personal discomfort, and difficulty garnering team or administrative support for care. Licensed clinicians practicing in the perinatal field. Stage 1 entailed instrument development and validation, which was achieved through a Delphi study involving 11 expert panelists. The devised instrument included 64 six-point Likert items. In stage 2, a computer survey gathered data from a multidisciplinary, clinician group. A total of 264 clinicians completed the survey. Exploratory factor analysis with varimax rotation was used to validate the instrument, evaluate the factors, and summarize the explained variance achieved by sum scores of the perceptions and barriers scales. The perceptions scale was reduced to 23 items with a 6-factor solution explaining 67% of the variance with a good internal consistency reliability of 0.77 (Cronbach α). The 22-item barriers scale had a 6-factor solution explaining 71% of the variance with an alpha reliability of 0.83. The Perinatal Palliative Care Perceptions and Practice Barriers Scale instrument is a valid and reliable measure of PPC perceptions and barriers for measuring the attitudes of physicians and nurses. Use of this instrument can foster educational programs and hospital planning for PPC teams that provide grieving families with the varied support they need. It is also a useful instrument for examining trends in the clinician perspectives and practice barriers as more genetic testing and subsequent terminal diagnoses occur.

The development and exploratory analysis of the Back Pain Attitudes Questionnaire (Back-PAQ).

PubMed

Darlow, Ben; Perry, Meredith; Mathieson, Fiona; Stanley, James; Melloh, Markus; Marsh, Reginald; Baxter, G David; Dowell, Anthony

2014-05-23

To develop an instrument to assess attitudes and underlying beliefs about back pain, and subsequently investigate its internal consistency and underlying structures. The instrument was developed by a multidisciplinary team of clinicians and researchers based on analysis of qualitative interviews with people experiencing acute and chronic back pain. Exploratory analysis was conducted using data from a population-based cross-sectional survey. Qualitative interviews with community-based participants and subsequent postal survey. Instrument development informed by interviews with 12 participants with acute back pain and 11 participants with chronic back pain. Data for exploratory analysis collected from New Zealand residents and citizens aged 18 years and above. 1000 participants were randomly selected from the New Zealand Electoral Roll. 602 valid responses were received. The 34-item Back Pain Attitudes Questionnaire (Back-PAQ) was developed. Internal consistency was evaluated by the Cronbach α coefficient. Exploratory analysis investigated the structure of the data using Principal Component Analysis. The 34-item long form of the scale had acceptable internal consistency (α=0.70; 95% CI 0.66 to 0.73). Exploratory analysis identified five two-item principal components which accounted for 74% of the variance in the reduced data set: 'vulnerability of the back'; 'relationship between back pain and injury'; 'activity participation while experiencing back pain'; 'prognosis of back pain' and 'psychological influences on recovery'. Internal consistency was acceptable for the reduced 10-item scale (α=0.61; 95% CI 0.56 to 0.66) and the identified components (α between 0.50 and 0.78). The 34-item long form of the scale may be appropriate for use in future cross-sectional studies. The 10-item short form may be appropriate for use as a screening tool, or an outcome assessment instrument. Further testing of the 10-item Back-PAQ's construct validity, reliability, responsiveness to change and predictive ability needs to be conducted. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Development and reliability testing of a self-report instrument to measure the office layout as a correlate of occupational sitting.

PubMed

Duncan, Mitch J; Rashid, Mahbub; Vandelanotte, Corneel; Cutumisu, Nicoleta; Plotnikoff, Ronald C

2013-02-04

Spatial configurations of office environments assessed by Space Syntax methodologies are related to employee movement patterns. These methods require analysis of floors plans which are not readily available in large population-based studies or otherwise unavailable. Therefore a self-report instrument to assess spatial configurations of office environments using four scales was developed. The scales are: local connectivity (16 items), overall connectivity (11 items), visibility of co-workers (10 items), and proximity of co-workers (5 items). A panel cohort (N = 1154) completed an online survey, only data from individuals employed in office-based occupations (n = 307) were used to assess scale measurement properties. To assess test-retest reliability a separate sample of 37 office-based workers completed the survey on two occasions 7.7 (±3.2) days apart. Redundant scale items were eliminated using factor analysis; Chronbach's α was used to evaluate internal consistency and test re-test reliability (retest-ICC). ANOVA was employed to examine differences between office types (Private, Shared, Open) as a measure of construct validity. Generalized Linear Models were used to examine relationships between spatial configuration scales and the duration of and frequency of breaks in occupational sitting. The number of items on all scales were reduced, Chronbach's α and ICCs indicated good scale internal consistency and test re-test reliability: local connectivity (5 items; α = 0.70; retest-ICC = 0.84), overall connectivity (6 items; α = 0.86; retest-ICC = 0.87), visibility of co-workers (4 items; α = 0.78; retest-ICC = 0.86), and proximity of co-workers (3 items; α = 0.85; retest-ICC = 0.70). Significant (p ≤ 0.001) differences, in theoretically expected directions, were observed for all scales between office types, except overall connectivity. Significant associations were observed between all scales and occupational sitting behaviour (p ≤ 0.05). All scales have good measurement properties indicating the instrument may be a useful alternative to Space Syntax to examine environmental correlates of occupational sitting in population surveys.

Development and reliability testing of a self-report instrument to measure the office layout as a correlate of occupational sitting

PubMed Central

2013-01-01

Background Spatial configurations of office environments assessed by Space Syntax methodologies are related to employee movement patterns. These methods require analysis of floors plans which are not readily available in large population-based studies or otherwise unavailable. Therefore a self-report instrument to assess spatial configurations of office environments using four scales was developed. Methods The scales are: local connectivity (16 items), overall connectivity (11 items), visibility of co-workers (10 items), and proximity of co-workers (5 items). A panel cohort (N = 1154) completed an online survey, only data from individuals employed in office-based occupations (n = 307) were used to assess scale measurement properties. To assess test-retest reliability a separate sample of 37 office-based workers completed the survey on two occasions 7.7 (±3.2) days apart. Redundant scale items were eliminated using factor analysis; Chronbach’s α was used to evaluate internal consistency and test re-test reliability (retest-ICC). ANOVA was employed to examine differences between office types (Private, Shared, Open) as a measure of construct validity. Generalized Linear Models were used to examine relationships between spatial configuration scales and the duration of and frequency of breaks in occupational sitting. Results The number of items on all scales were reduced, Chronbach’s α and ICCs indicated good scale internal consistency and test re-test reliability: local connectivity (5 items; α = 0.70; retest-ICC = 0.84), overall connectivity (6 items; α = 0.86; retest-ICC = 0.87), visibility of co-workers (4 items; α = 0.78; retest-ICC = 0.86), and proximity of co-workers (3 items; α = 0.85; retest-ICC = 0.70). Significant (p ≤ 0.001) differences, in theoretically expected directions, were observed for all scales between office types, except overall connectivity. Significant associations were observed between all scales and occupational sitting behaviour (p ≤ 0.05). Conclusion All scales have good measurement properties indicating the instrument may be a useful alternative to Space Syntax to examine environmental correlates of occupational sitting in population surveys. PMID:23379485

Development and psychometric testing of an instrument designed to measure chronic pain in dogs with osteoarthritis

PubMed Central

Boston, Raymond C.; Coyne, James C.; Farrar, John T.

2010-01-01

Objective To develop and psychometrically test an owner self-administered questionnaire designed to assess severity and impact of chronic pain in dogs with osteoarthritis. Sample Population 70 owners of dogs with osteoarthritis and 50 owners of clinically normal dogs. Procedures Standard methods for the stepwise development and testing of instruments designed to assess subjective states were used. Items were generated through focus groups and an expert panel. Items were tested for readability and ambiguity, and poorly performing items were removed. The reduced set of items was subjected to factor analysis, reliability testing, and validity testing. Results Severity of pain and interference with function were 2 factors identified and named on the basis of the items contained in them. Cronbach’s α was 0.93 and 0.89, respectively, suggesting that the items in each factor could be assessed as a group to compute factor scores (ie, severity score and interference score). The test-retest analysis revealed κ values of 0.75 for the severity score and 0.81 for the interference score. Scores correlated moderately well (r = 0.51 and 0.50, respectively) with the overall quality-of-life (QOL) question, such that as severity and interference scores increased, QOL decreased. Clinically normal dogs had significantly lower severity and interference scores than dogs with osteoarthritis. Conclusions and Clinical Relevance A psychometrically sound instrument was developed. Responsiveness testing must be conducted to determine whether the questionnaire will be useful in reliably obtaining quantifiable assessments from owners regarding the severity and impact of chronic pain and its treatment on dogs with osteoarthritis. PMID:17542696

Harmonizing routinely collected health information for strengthening quality management in health systems: requirements and practice.

PubMed

Prodinger, Birgit; Tennant, Alan; Stucki, Gerold; Cieza, Alarcos; Üstün, Tevfik Bedirhan

2016-10-01

Our aim was to specify the requirements of an architecture to serve as the foundation for standardized reporting of health information and to provide an exemplary application of this architecture. The World Health Organization's International Classification of Functioning, Disability and Health (ICF) served as the conceptual framework. Methods to establish content comparability were the ICF Linking Rules. The Rasch measurement model, as a special case of additive conjoint measurement, which satisfies the required criteria for fundamental measurement, allowed for the development of a common metric foundation for measurement unit conversion. Secondary analysis of data from the North Yorkshire Survey was used to illustrate these methods. Patients completed three instruments and the items were linked to the ICF. The Rasch measurement model was applied, first to each scale, and then to items across scales which were linked to a common domain. Based on the linking of items to the ICF, the majority of items were grouped into two domains, Mobility and Self-care. Analysis of the individual scales and of items linked to a common domain across scales satisfied the requirements of the Rasch measurement model. The measurement unit conversion between items from the three instruments linked to the Mobility and Self-care domains, respectively, was demonstrated. The realization of an ICF-based architecture for information on patients' functioning enables harmonization of health information while allowing clinicians and researchers to continue using their existing instruments. This architecture will facilitate access to comprehensive and consistently reported health information to serve as the foundation for informed decision-making. © The Author(s) 2016.

Developing a Psychometric Instrument to Measure Physical Education Teachers' Job Demands and Resources.

PubMed

Zhang, Tan; Chen, Ang

2017-01-01

Based on the job demands-resources model, the study developed and validated an instrument that measures physical education teachers' job demands-resources perception. Expert review established content validity with the average item rating of 3.6/5.0. Construct validity and reliability were determined with a teacher sample ( n = 397). Exploratory factor analysis established a five-dimension construct structure matching the theoretical construct deliberated in the literature. The composite reliability scores for the five dimensions range from .68 to .83. Validity coefficients (intraclass correlational coefficients) are .69 for job resources items and .82 for job demands items. Inter-scale correlational coefficients range from -.32 to .47. Confirmatory factor analysis confirmed the construct validity with high dimensional factor loadings (ranging from .47 to .84 for job resources scale and from .50 to .85 for job demands scale) and adequate model fit indexes (root mean square error of approximation = .06). The instrument provides a tool to measure physical education teachers' perception of their working environment.

Children's Depression Inventory (CDI) and the Children's Depression Rating Scale-Revised (CDRS-R): reliability of the Hebrew version.

PubMed

Zalsman, Gil; Misgav, Sagit; Sommerfeld, Eliane; Kohn, Yoav; Brunstein-Klomek, Anat; Diller, Robyne; Sher, Leo; Schwartz, Joseph; Shoval, Gal; Ben-Dor, David H; Wolovik, Luisa; Oquendo, Maria A

2005-01-01

The Children's Depression Inventory (CDI) and Children's Depression Rating Scale-Revised (CDRS-R) are two widely used instruments, which measure depression in children and adolescents. This pilot study assessed the reliability of the Hebrew versions of these two instruments. Both CDRS-R and CDI were translated from English into Hebrew and then back translated. Seventeen healthy Israeli bilingual children volunteers were interviewed with both scales with a one day intermission between the interviews. Non-parametric correlations were used to compare scores in the two versions for each item. Results showed high agreement between the two versions for almost all items of the CDI and moderate to high for the CDRS-R. When CDRS-R summary scores for each item were compared, the agreement was high for this instrument as well. It is concluded that both CDI and CDRS-R Hebrew versions are reliable and can be used for studies of depression in the Israeli pediatric population.

Developing a Psychometric Instrument to Measure Physical Education Teachers’ Job Demands and Resources

PubMed Central

Zhang, Tan; Chen, Ang

2017-01-01

Based on the job demands–resources model, the study developed and validated an instrument that measures physical education teachers’ job demands–resources perception. Expert review established content validity with the average item rating of 3.6/5.0. Construct validity and reliability were determined with a teacher sample (n = 397). Exploratory factor analysis established a five-dimension construct structure matching the theoretical construct deliberated in the literature. The composite reliability scores for the five dimensions range from .68 to .83. Validity coefficients (intraclass correlational coefficients) are .69 for job resources items and .82 for job demands items. Inter-scale correlational coefficients range from −.32 to .47. Confirmatory factor analysis confirmed the construct validity with high dimensional factor loadings (ranging from .47 to .84 for job resources scale and from .50 to .85 for job demands scale) and adequate model fit indexes (root mean square error of approximation = .06). The instrument provides a tool to measure physical education teachers’ perception of their working environment. PMID:29200808

Development and validation of an instrument to assess imminent risk of homelessness among veterans.

PubMed

Montgomery, Ann Elizabeth; Fargo, Jamison D; Kane, Vincent; Culhane, Dennis P

2014-01-01

Veterans are overrepresented within the homeless population compared with their non-veteran counterparts, particularly when controlling for poverty. The U.S. Department of Veterans Affairs (VA) aims to prevent new episodes of homelessness by targeting households at greatest risk; however, there are no instruments that systematically assess veterans' risk of homelessness. We developed and tested a brief screening instrument to identify imminent risk of homelessness among veterans accessing VA health care. The study team developed initial assessment items, conducted cognitive interviews with veterans experiencing homelessness, refined pilot items based on veterans' and experts' feedback and results of psychometric analyses, and assigned weights to items in the final instrument to indicate a measure of homelessness risk. One-third of veterans who responded to the field instrument reported imminent risk of homelessness (i.e., housing instability in the previous 90 days or expected in the next 90 days). The reliability coefficient for the instrument was 0.85, indicating good internal consistency. Veterans who had a recent change in income, had unpaid housing expenses, were living temporarily with family and friends, needed help to get or keep housing, and had poor rental and credit histories were more likely to report a risk of homelessness than those who did not. This study provides the field with an instrument to identify individuals and households at risk of or experiencing homelessness, which is necessary to prevent and end homelessness. In addition, it supports VA's investment in homelessness prevention and rapid rehousing services for veterans who are experiencing or are at risk for homelessness.

OPTION(5) versus OPTION(12) instruments to appreciate the extent to which healthcare providers involve patients in decision-making.

PubMed

Stubenrouch, Fabienne E; Pieterse, Arwen H; Falkenberg, Rijan; Santema, T Katrien B; Stiggelbout, Anne M; van der Weijden, Trudy; Aarts, J Annemijn W M; Ubbink, Dirk T

2016-06-01

The 12-item "observing patient involvement" (OPTION(12))-instrument is commonly used to assess the extent to which healthcare providers involve patients in health-related decision-making. The five-item version (OPTION(5)) claims to be a more efficient measure. In this study we compared the Dutch versions of the OPTION-instruments in terms of inter-rater agreement and correlation in outpatient doctor-patient consultations in various settings, to learn if we can safely switch to the shorter OPTION(5)-instrument. Two raters coded 60 audiotaped vascular surgery and oncology patient consultations using OPTION(12) and OPTION(5). Unweighted Cohen's kappa was used to compute inter-rater agreement on item-level. The association between the total scores of the two OPTION-instruments was investigated using Pearson's correlation coefficient (r) and a Bland & Altman plot. After fine-tuning the OPTION-manuals, inter-rater agreement for OPTION(12) and OPTION(5) was good to excellent (kappa range 0.69-0.85 and 0.63-0.72, respectively). Mean total scores were 23.7 (OPTION(12); SD=7.8) and 39.3 (OPTION(5); SD=12.7). Correlation between the total scores was high (r=0.71; p=0.01). OPTION(5) scored systematically higher with a wider range than OPTION(12). Both OPTION-instruments had a good inter-rater agreement and correlated well. OPTION(5) seems to differentiate better between various levels of patient involvement. The OPTION(5)-instrument is recommended for clinical application. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Pancreatitis Quality of Life Instrument: A Psychometric Evaluation.

PubMed

Wassef, Wahid; DeWitt, John; McGreevy, Kathleen; Wilcox, Mel; Whitcomb, David; Yadav, Dhiraj; Amann, Stephen; Mishra, Girish; Alkaade, Samer; Romagnuolo, Joseph; Stevens, Tyler; Vargo, John; Gardner, Timothy; Singh, Vikesh; Park, Walter; Hartigan, Celia; Barton, Bruce; Bova, Carol

2016-08-01

Chronic pancreatitis is a significant medical problem that impacts a large number of patients worldwide. In 2014, we developed a disease-specific instrument for the evaluation of quality of life in this group of patients: pancreatitis quality of life instrument (PANQOLI). The goal of this study was to evaluate its psychometric properties: its reliability and its construct validity. This is a cross-sectional multi-center study that involved 12 pancreatic disease centers. Patients who met the inclusion/exclusion criteria for chronic pancreatitis were invited to participate. Those who accepted were asked to complete seven questionnaires/instruments. Only patients who completed the PANQOLI were included in the study. Its reliability and its construct validity were tested. A total of 159 patients completed the PANQOLI and were included in the study. They had a mean age of 49.03, 49% were male, and 84% were Caucasian. Six of the 24 items on the scale were removed because of lack of inter-item correlation, redundancy, or lack of correlation to quality of life issues. The final 18-item scale had excellent reliability (Cronbach's alpha coefficient: 0.914) and excellent construct validity with good correlation to generic quality of life instruments (SF-12 and EORTC QLQ-C30/QLQ-PAN26) and lack of correlation to non-quality of life instruments (MAST and DAST). Through exploratory factor analysis, the PANQOLI was found to consist of four subscales: emotional function scale, role function scale, physical function scale, and "self-worth" scale. PANQOLI is the first disease-specific instrument to be developed and validated for the evaluation of quality of life in chronic pancreatitis patients. It has a unique subscale for "self-worth" that differentiates it from other generic instruments. Studies are currently under way to evaluate its use in other populations not included in this study.

Chinese Version of Psychometric Evaluation of Self-Reflection and Insight Scale on Taiwanese Nursing Students.

PubMed

Chen, Shu-Yueh; Lai, Chen-Chun; Chang, Hui-Mei; Hsu, Hui-Chen; Pai, Hsiang-Chu

2016-12-01

Self-reflection (also known as reflection) is an internal process that is difficult to perceive or assess. An instrument that is able to measure self-reflection may serve as a resource for educators to assess the learning process of students and to tailor education approaches to student needs. The aim of this study was to translate the Self-Reflection and Insight Scale (SRIS) into Chinese and evaluate its psychometric properties for use with Taiwanese nursing students. For this cross-sectional study, nursing students were recruited from two nursing schools in southern Taiwan in two phases: Phase 1, which included 361 fourth-year students, and Phase 2, which included 703 fifth-year students. Data were collected in December 2012 and May 2013 using the Chinese version of the SRIS (SRIS-C), Taiwan Critical Thinking Disposition Inventory, and the Perceived Identity as a Nurse Questionnaire, which was developed by the author. In Phase 1, exploratory factor analysis was used to explore the factor structure of the SRIS-C in the fourth-year student participants. In Phase 2, confirmatory factor analysis was used to determine the fitness of the model for the fifth-year student participants. Eight items were deleted from the original SRIS to create the SRIS-C. Thus, the Chinese-version measure had 12 items and two factors (self-reflection and insight) that fit the data well. The Cronbach's alpha coefficients for the total scale and its two subscales were .79, .87, and .83, respectively. The 3-week test-retest reliability was .74. SRIS-C scores correlated significantly with scores on the Taiwan Critical Thinking Disposition Inventory and the Perceived Identity as a Nurse Questionnaire, indicating good convergent validity for the SRIS-C. The current study showed that the SRIS-C has sound psychometric properties. This instrument provides nurse educators with information that may be used to evaluate the self-reflection and insight of students and to develop interventions to effectively improve these skills in Chinese-language-based nursing education.

Item Selection, Evaluation, and Simple Structure in Personality Data

PubMed Central

Pettersson, Erik; Turkheimer, Eric

2010-01-01

We report an investigation of the genesis and interpretation of simple structure in personality data using two very different self-reported data sets. The first consists of a set of relatively unselected lexical descriptors, whereas the second is based on responses to a carefully constructed instrument. In both data sets, we explore the degree of simple structure by comparing factor solutions to solutions from simulated data constructed to have either strong or weak simple structure. The analysis demonstrates that there is little evidence of simple structure in the unselected items, and a moderate degree among the selected items. In both instruments, however, much of the simple structure that could be observed originated in a strong dimension of positive vs. negative evaluation. PMID:20694168

High-precision ground-based photometry of exoplanets

NASA Astrophysics Data System (ADS)

de Mooij, Ernst J. W.; Jayawardhana, Ray

2013-04-01

High-precision photometry of transiting exoplanet systems has contributed significantly to our understanding of the properties of their atmospheres. The best targets are the bright exoplanet systems, for which the high number of photons allow very high signal-to-noise ratios. Most of the current instruments are not optimised for these high-precision measurements, either they have a large read-out overhead to reduce the readnoise and/or their field-of-view is limited, preventing simultaneous observations of both the target and a reference star. Recently we have proposed a new wide-field imager for the Observatoir de Mont-Megantic optimised for these bright systems (PI: Jayawardhana). The instruments has a dual beam design and a field-of-view of 17' by 17'. The cameras have a read-out time of 2 seconds, significantly reducing read-out overheads. Over the past years we have obtained significant experience with how to reach the high precision required for the characterisation of exoplanet atmospheres. Based on our experience we provide the following advice: Get the best calibrations possible. In the case of bad weather, characterise the instrument (e.g. non-linearity, dome flats, bias level), this is vital for better understanding of the science data. Observe the target for as long as possible, the out-of-transit baseline is as important as the transit/eclipse itself. A short baseline can lead to improperly corrected systematic and mis-estimation of the red-noise. Keep everything (e.g. position on detector, exposure time) as stable as possible. Take care that the defocus is not too strong. For a large defocus, the contribution of the total flux from the sky-background in the aperture could well exceed that of the target, resulting in very strict requirements on the precision at which the background is measured.

Test Design Project: Studies in Test Bias. Annual Report.

ERIC Educational Resources Information Center

McArthur, David

Item bias in a multiple-choice test can be detected by appropriate analyses of the persons x items scoring matrix. This permits comparison of groups of examinees tested with the same instrument. The test may be biased if it is not measuring the same thing in comparable groups, if groups are responding to different aspects of the test items, or if…

Factor- and Item-Level Analyses of the 38-Item Activities Scale for Kids-Performance

ERIC Educational Resources Information Center

Bagley, Anita M.; Gorton, George E.; Bjornson, Kristie; Bevans, Katherine; Stout, Jean L.; Narayanan, Unni; Tucker, Carole A.

2011-01-01

Aim: Children and adolescents highly value their ability to participate in relevant daily life and recreational activities. The Activities Scale for Kids-performance (ASKp) instrument measures the frequency of performance of 30 common childhood activities, and has been shown to be valid and reliable. A revised and expanded 38-item ASKp (ASKp38)…

Modified Scoring, Traditional Item Analysis, and Sato's Caution Index Used To Investigate the Reading Recall Protocol.

ERIC Educational Resources Information Center

Deville, Craig W.; Chalhoub-Deville, Micheline

A study demonstrated the utility of item analyses to investigate which items function well or poorly in a second language reading recall protocol instrument. Data were drawn from a larger study of 56 learners of German as a second language at various proficiency levels. Pausal units of scored recall protocols were analyzed using both classical…

Reliability of a store observation tool in measuring availability of alcohol and selected foods.

PubMed

Cohen, Deborah A; Schoeff, Diane; Farley, Thomas A; Bluthenthal, Ricky; Scribner, Richard; Overton, Adrian

2007-11-01

Alcohol and food items can compromise or contribute to health, depending on the quantity and frequency with which they are consumed. How much people consume may be influenced by product availability and promotion in local retail stores. We developed and tested an observational tool to objectively measure in-store availability and promotion of alcoholic beverages and selected food items that have an impact on health. Trained observers visited 51 alcohol outlets in Los Angeles and southeastern Louisiana. Using a standardized instrument, two independent observations were conducted documenting the type of outlet, the availability and shelf space for alcoholic beverages and selected food items, the purchase price of standard brands, the placement of beer and malt liquor, and the amount of in-store alcohol advertising. Reliability of the instrument was excellent for measures of item availability, shelf space, and placement of malt liquor. Reliability was lower for alcohol advertising, beer placement, and items that measured the "least price" of apples and oranges. The average kappa was 0.87 for categorical items and the average intraclass correlation coefficient was 0.83 for continuous items. Overall, systematic observation of the availability and promotion of alcoholic beverages and food items was feasible, acceptable, and reliable. Measurement tools such as the one we evaluated should be useful in studies of the impact of availability of food and beverages on consumption and on health outcomes.

Developing an Iranian ELT Context-Specific Grit Instrument.

PubMed

Ebadi, Saman; Weisi, Hiwa; Khaksar, Zahra

2018-03-06

Grit as an interesting and significant topic in psychology has been associated with better study habits and higher grades through perseverance and passion for long term goals. The only available measurement instrument of grit (Duckworth et al. in J Personal Soc Psychol 92:1087-1101, 2007) is general both in terms of its subject matter and context. Thus, this study aims to develop and validate an English as a foreign language (EFL) grit instrument whose items are specific to EFL context to obtain a more detailed view of its components for Iranian EFL learners, and to tap on other grit related factors in the EFL context. A four component model of EFL grit was developed through reviewing the existing literature and exploring EFL experts' perspectives. This tentative theoretical model of EFL grit encompasses overarching construct of effort including the following main components: Trying hard to learn English (THLE) having interest in learning English (ILE) practicing a lot in order to learn English (PLE) and having goal for learning English (HGLE). The model was then cross checked against the results of the interviews, and evolved into a scenario-based, 5 point Likert-scale EFL grit instrument. It was later operationalized by an instrument consisting of 26 items, i.e. 6 items for each component plus 2 items for themes 1 and 3. The piloting and testing of the tentative model through exploratory and confirmatory data analyses on a sample of 306 EFL learners indicated the reliability of 0.833 and an acceptable validity. The findings called for a more meaningful interpretation of the concept of grit in relation to Iranian EFL context and offered new insights for higher education administrators considering student academic performance.

Development and validation of a quality of life instrument for Kashin-Beck disease: an endemic osteoarthritis in China.

PubMed

Fang, H; Guo, X; Farooq, U; Xia, C; Dong, R

2012-07-01

To develop and validate a disease-specific Quality of Life (QOL) measure for a specialized osteoarthritis (OA)-Kashin-Beck disease (KBD). The standard methodology used for developing QOL instruments was employed. In phase 1, initially a group of health care professionals (HCPs) and KBD patient defined the overall concept of KBDQOL. It was followed by generation of an item pool through literature review, in-depth interview of 20 KBD patients and eight KBD HCPs and four focus group discussions. In phase 2, 368 KBD patients were interviewed and the reinterview of 95 participants, 10-14 days later assessed the reproducibility of the KBDQOL instrument. A 37 items draft instrument was devised during phase 1. Principal Component Analysis (PCA) revealed six domains: physical function, activity limitation, social support, economics, mental health, and general health. Cronbach's alphas of six domains ranged from 0.77 to 0.90. The test-retest reliability (intraclass co-relation coefficient) of six domains was satisfactory, and ranged from 0.73 to 0.90. The smallest detectable change ranged from 13.2 to 30.2 points at the individual level and from 1.4 to 3.1 points at the group level for different domains. The construct validity was adequate when co-related with the EQ-5D (spearman co-relation coefficients: 0.49-0.61) and WHOQOL-BREF (spearman co-relation coefficients: 0.53-0.68). This resulted into the final version of KBDQOL instrument having 28 items and six domains. The KBDQOL is a simple and easy to use 28-item six dimensional questionnaire. The measure has been developed as a true patient-based questionnaire and demonstrates good measurement properties. Copyright © 2012 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

Illness Adaptation: Clarifying the Concept and Validating a Scale.

ERIC Educational Resources Information Center

Young, Rosalie F.; Kahana, Eva

Traditionally, coping and adaptation have been considered synonymous in individual's responses to illness and other stressful situations. The Illness Adaptation Scale (IAS) is a 12-item instrument which was designed to assess adaptational outcomes in illness situations as well as four coping modes (instrumental-self oriented, instrumental-other…

17 CFR 229.1114 - (Item 1114) Credit enhancement and other support, except for certain derivatives instruments.

Code of Federal Regulations, 2011 CFR

2011-04-01

... and other support, except for certain derivatives instruments. 229.1114 Section 229.1114 Commodity and... support, except for certain derivatives instruments. (a) Descriptive information. To the extent material..., guaranteed investment contracts and minimum principal payment agreements. (3) Any derivatives whose primary...

Design and Development of the Aircraft Instrument Comprehension Program.

ERIC Educational Resources Information Center

Higgins, Norman C.

The Aircraft Instrument Comprehension (AIC) Program is a self-instructional program designed to teach undergraduate student pilots to read instruments that indicate the position of the aircraft in flight, based on sequential instructional stages of information, prompted practice, and unprompted practice. The program includes a 36-item multiple…

FILLERS-Q: an instrument for assessing patient experiences after treatment with facial injectable soft tissue fillers.

PubMed

Sclafani, Anthony P; Pizzi, Laura; Jutkowitz, Eric; Mueller, Nancy; Jung, Matthew

2010-08-01

Patient-reported outcomes data are limited after injectable soft tissue filler treatment. Patient-reported outcome measures (PROMs) are becoming integral to medical practices in other specialties and will become so as well in facial plastic surgery. The obvious differences in types of disorders treated and the outcomes of primary importance seen between general medical/surgical and facial plastic surgery practices make institution of standard outcomes studies difficult in facial plastic surgery. However, understanding the patient's experience and satisfaction with treatment is essential to continue to provide excellent care to facial aesthetic patients. This article describes use of a new survey instrument, Facial Injectables: Longevity, Late and Early Reactions and Satisfaction Questionnaire (FILLERS-Q), in assessing patient response to facial injections of soft tissue fillers. FILLERS-Q is a 43-item questionnaire that captures patient demographics (4 items), patient satisfaction with treatment (10 items), procedure-related events (3 to 7 items), impact on relationships (9 to 15 items), and economic considerations related to dermal filler treatment (3 to 7 items). The results provide a "snapshot" of patients treated in an individual surgeon's practice. (c) Thieme Medical Publishers.

We need more replication research - A case for test-retest reliability.

PubMed

Leppink, Jimmie; Pérez-Fuster, Patricia

2017-06-01

Following debates in psychology on the importance of replication research, we have also started to see pleas for a more prominent role for replication research in medical education. To enable replication research, it is of paramount importance to carefully study the reliability of the instruments we use. Cronbach's alpha has been the most widely used estimator of reliability in the field of medical education, notably as some kind of quality label of test or questionnaire scores based on multiple items or of the reliability of assessment across exam stations. However, as this narrative review outlines, Cronbach's alpha or alternative reliability statistics may complement but not replace psychometric methods such as factor analysis. Moreover, multiple-item measurements should be preferred above single-item measurements, and when using single-item measurements, coefficients as Cronbach's alpha should not be interpreted as indicators of the reliability of a single item when that item is administered after fundamentally different activities, such as learning tasks that differ in content. Finally, if we want to follow up on recent pleas for more replication research, we have to start studying the test-retest reliability of the instruments we use.

Construct validity test of evaluation tool for professional behaviors of entry-level occupational therapy students in the United States.

PubMed

Yuen, Hon K; Azuero, Andres; Lackey, Kaitlin W; Brown, Nicole S; Shrestha, Sangita

2016-01-01

This study aimed to test the construct validity of an instrument to measure student professional behaviors in entry-level occupational therapy (OT) students in the academic setting. A total of 718 students from 37 OT programs across the United States answered a self-assessment survey of professional behavior that we developed. The survey consisted of ranking 28 attributes, each on a 5-point Likert scale. A split-sample approach was used for exploratory and then confirmatory factor analysis. A three-factor solution with nine items was extracted using exploratory factor analysis [EFA] (n=430, 60%). The factors were 'Commitment to Learning' (2 items), 'Skills for Learning' (4 items), and 'Cultural Competence' (3 items). Confirmatory factor analysis (CFA) on the validation split (n=288, 40%) indicated fair fit for this three-factor model (fit indices: CFI=0.96, RMSEA=0.06, and SRMR=0.05). Internal consistency reliability estimates of each factor and the instrument ranged from 0.63 to 0.79. Results of the CFA in a separate validation dataset provided robust measures of goodness-of-fit for the three-factor solution developed in the EFA, and indicated that the three-factor model fitted the data well enough. Therefore, we can conclude that this student professional behavior evaluation instrument is a structurally validated tool to measure professional behaviors reported by entry-level OT students. The internal consistency reliability of each individual factor and the whole instrument was considered to be adequate to good.

Development of the Oxford Participation and Activities Questionnaire: constructing an item pool

PubMed Central

Kelly, Laura; Jenkinson, Crispin; Dummett, Sarah; Dawson, Jill; Fitzpatrick, Ray; Morley, David

2015-01-01

Purpose The Oxford Participation and Activities Questionnaire is a patient-reported outcome measure in development that is grounded on the World Health Organization International Classification of Functioning, Disability, and Health (ICF). The study reported here aimed to inform and generate an item pool for the new measure, which is specifically designed for the assessment of participation and activity in patients experiencing a range of health conditions. Methods Items were informed through in-depth interviews conducted with 37 participants spanning a range of conditions. Interviews aimed to identify how their condition impacted their ability to participate in meaningful activities. Conditions included arthritis, cancer, chronic back pain, diabetes, motor neuron disease, multiple sclerosis, Parkinson’s disease, and spinal cord injury. Transcripts were analyzed using the framework method. Statements relating to ICF themes were recast as questionnaire items and shown for review to an expert panel. Cognitive debrief interviews (n=13) were used to assess items for face and content validity. Results ICF themes relevant to activities and participation in everyday life were explored, and a total of 222 items formed the initial item pool. This item pool was refined by the research team and 28 generic items were mapped onto all nine chapters of the ICF construct, detailing activity and participation. Cognitive interviewing confirmed the questionnaire instructions, items, and response options were acceptable to participants. Conclusion Using a clear conceptual basis to inform item generation, 28 items have been identified as suitable to undergo further psychometric testing. A large-scale postal survey will follow in order to refine the instrument further and to assess its psychometric properties. The final instrument is intended for use in clinical trials and interventions targeted at maintaining or improving activity and participation. PMID:26056503

Development of the Oxford Participation and Activities Questionnaire: constructing an item pool.

PubMed

Kelly, Laura; Jenkinson, Crispin; Dummett, Sarah; Dawson, Jill; Fitzpatrick, Ray; Morley, David

2015-01-01

The Oxford Participation and Activities Questionnaire is a patient-reported outcome measure in development that is grounded on the World Health Organization International Classification of Functioning, Disability, and Health (ICF). The study reported here aimed to inform and generate an item pool for the new measure, which is specifically designed for the assessment of participation and activity in patients experiencing a range of health conditions. Items were informed through in-depth interviews conducted with 37 participants spanning a range of conditions. Interviews aimed to identify how their condition impacted their ability to participate in meaningful activities. Conditions included arthritis, cancer, chronic back pain, diabetes, motor neuron disease, multiple sclerosis, Parkinson's disease, and spinal cord injury. Transcripts were analyzed using the framework method. Statements relating to ICF themes were recast as questionnaire items and shown for review to an expert panel. Cognitive debrief interviews (n=13) were used to assess items for face and content validity. ICF themes relevant to activities and participation in everyday life were explored, and a total of 222 items formed the initial item pool. This item pool was refined by the research team and 28 generic items were mapped onto all nine chapters of the ICF construct, detailing activity and participation. Cognitive interviewing confirmed the questionnaire instructions, items, and response options were acceptable to participants. Using a clear conceptual basis to inform item generation, 28 items have been identified as suitable to undergo further psychometric testing. A large-scale postal survey will follow in order to refine the instrument further and to assess its psychometric properties. The final instrument is intended for use in clinical trials and interventions targeted at maintaining or improving activity and participation.

DMD-based programmable wide field spectrograph for Earth observation

NASA Astrophysics Data System (ADS)

Zamkotsian, Frédéric; Lanzoni, Patrick; Liotard, Arnaud; Viard, Thierry; Costes, Vincent; Hébert, Philippe-Jean

2015-03-01

In Earth Observation, Universe Observation and Planet Exploration, scientific return could be optimized in future missions using MOEMS devices. In Earth Observation, we propose an innovative reconfigurable instrument, a programmable wide-field spectrograph where both the FOV and the spectrum could be tailored thanks to a 2D micromirror array (MMA). For a linear 1D field of view (FOV), the principle is to use a MMA to select the wavelengths by acting on intensity. This component is placed in the focal plane of a first grating. On the MMA surface, the spatial dimension is along one side of the device and for each spatial point, its spectrum is displayed along the perpendicular direction: each spatial and spectral feature of the 1D FOV is then fully adjustable dynamically and/or programmable. A second stage with an identical grating recomposes the beam after wavelengths selection, leading to an output tailored 1D image. A mock-up has been designed, fabricated and tested. The micromirror array is the largest DMD in 2048 x 1080 mirrors format, with a pitch of 13.68μm. A synthetic linear FOV is generated and typical images have been recorded o at the output focal plane of the instrument. By tailoring the DMD, we could modify successfully each pixel of the input image: for example, it is possible to remove bright objects or, for each spatial pixel, modify the spectral signature. The very promising results obtained on the mock-up of the programmable wide-field spectrograph reveal the efficiency of this new instrument concept for Earth Observation.

Validation of an instrument to assess evidence-based practice knowledge, attitudes, access, and confidence in the dental environment.

PubMed

Hendricson, William D; Rugh, John D; Hatch, John P; Stark, Debra L; Deahl, Thomas; Wallmann, Elizabeth R

2011-02-01

This article reports the validation of an assessment instrument designed to measure the outcomes of training in evidence-based practice (EBP) in the context of dentistry. Four EBP dimensions are measured by this instrument: 1) understanding of EBP concepts, 2) attitudes about EBP, 3) evidence-accessing methods, and 4) confidence in critical appraisal. The instrument-the Knowledge, Attitudes, Access, and Confidence Evaluation (KACE)-has four scales, with a total of thirty-five items: EBP knowledge (ten items), EBP attitudes (ten), accessing evidence (nine), and confidence (six). Four elements of validity were assessed: consistency of items within the KACE scales (extent to which items within a scale measure the same dimension), discrimination (capacity to detect differences between individuals with different training or experience), responsiveness (capacity to detect the effects of education on trainees), and test-retest reliability. Internal consistency of scales was assessed by analyzing responses of second-year dental students, dental residents, and dental faculty members using Cronbach coefficient alpha, a statistical measure of reliability. Discriminative validity was assessed by comparing KACE scores for the three groups. Responsiveness was assessed by comparing pre- and post-training responses for dental students and residents. To measure test-retest reliability, the full KACE was completed twice by a class of freshman dental students seventeen days apart, and the knowledge scale was completed twice by sixteen faculty members fourteen days apart. Item-to-scale consistency ranged from 0.21 to 0.78 for knowledge, 0.57 to 0.83 for attitude, 0.70 to 0.84 for accessing evidence, and 0.87 to 0.94 for confidence. For discrimination, ANOVA and post hoc testing by the Tukey-Kramer method revealed significant score differences among students, residents, and faculty members consistent with education and experience levels. For responsiveness to training, dental students and residents demonstrated statistically significant changes, in desired directions, from pre- to post-test. For the student test-retest, Pearson correlations for KACE scales were as follows: knowledge 0.66, attitudes 0.66, accessing evidence 0.74, and confidence 0.76. For the knowledge scale test-retest by faculty members, the Pearson correlation was 0.79. The construct validity of the KACE is equivalent to that of instruments that assess similar EBP dimensions in medicine. Item consistency for the knowledge scale was more variable than for other KACE scales, a finding also reported for medically oriented EBP instruments. We conclude that the KACE has good discriminative validity, responsiveness to training effects, and test-retest reliability.

The Ostomy-Q: Development and Psychometric Validation of an Instrument to Evaluate Outcomes Associated with Ostomy Appliances.

PubMed

Nafees, Beenish; Rasmussen, Mikkel; LLoyd, Andrew

2017-01-01

Using an ostomy appliance can affect many aspects of a person's health-related quality of life (HRQL). A 2-part, descrip- tive study was designed to develop and validate an instrument to assess quality-of-life outcomes related to ostomy ap- pliance use. Study inclusion/exclusion criteria stipulated participants should be 18 to 85 years of age, have an ileostomy or colostomy, used an appliance for a minimum of 3 months without assistance, and able to complete an online survey. All participants provided sociodemographic and clinical information. In phase 1, a literature search was conducted and existing instruments used to measure HRQL in persons with an ostomy were assessed. Subsequently, the Ostomy-Q, a 23-item, Likert-response type questionnaire, divided into 4 domains (Discreetness, Comfort, Confidence, and Social Life), was developed based on published evidence and existing ostomy-related HRQL tools. Seven (7) participants re- cruited from a manufacturer user panel took part in exploratory/cognitive qualitative interviews to refine the new quality- of-life questionnaire. In phase 2, the instrument was tested to assess item variability and conceptual structure, item-total correlation, internal consistency, test-retest reliability, sensitivity, and minimal important difference (MID) in an online validation study among 200 participants from the manufacturer's user panel (equally divided by gender, 125 [62.5%] >50 years old, 128 [64%] with an ileostomy). This exercise also included completion of the Stoma Quality of Life Question- naire and 2 domains from the Ostomy Adjustment Inventory-23 to assess convergent validity. Eighty-two (82) participants recompleted these study instruments 2 weeks later to assess test-retest reliability. Sociodemographic and clinical data were assessed using descriptive statistics; Cronbach's alpha was used for internal consistency (minimum 0.70), principle component analysis for item variability/conceptual structure, and item-total correlation; intraclass correlation coefficient was used for test-retest reliability; and standard error of measurement was applied to MID. All domains demonstrated good internal consistency (between 0.69 and 0.78). All scales showed stability, with a minimum intraclass correlation coefficient of 0.743 (P <.001). The Ostomy-Q showed good convergent validity with other instruments to which it was compared (P <.01). In this study, the Ostomy-Q was found to be a reliable and valid outcome measure that can enhance understanding of the impact of ostomy appliances on users. Some items for social relationships and discreetness may need more exploring in the future with other patient groups.

Derivation of Two Critical Appraisal Scores for Trainees to Evaluate Online Educational Resources: A METRIQ Study

PubMed Central

Chan, Teresa M.; Thoma, Brent; Krishnan, Keeth; Lin, Michelle; Carpenter, Christopher R.; Astin, Matt; Kulasegaram, Kulamakan

2016-01-01

Introduction Online education resources (OERs), like blogs and podcasts, increasingly augment or replace traditional medical education resources such as textbooks and lectures. Trainees’ ability to evaluate these resources is poor, and few quality assessment aids have been developed to assist them. This study aimed to derive a quality evaluation instrument for this purpose. Methods We used a three-phase methodology. In Phase 1, a previously derived list of 151 OER quality indicators was reduced to 13 items using data from published consensus-building studies (of medical educators, expert podcasters, and expert bloggers) and subsequent evaluation by our team. In Phase 2, these 13 items were converted to seven-point Likert scales used by trainee raters (n=40) to evaluate 39 OERs. The reliability and usability of these 13 rating items was determined using responses from trainee raters, and top items were used to create two OER quality evaluation instruments. In Phase 3, these instruments were compared to an external certification process (the ALiEM AIR certification) and the gestalt evaluation of the same 39 blog posts by 20 faculty educators. Results Two quality-evaluation instruments were derived with fair inter-rater reliability: the METRIQ-8 Score (Inter class correlation coefficient [ICC]=0.30, p<0.001) and the METRIQ-5 Score (ICC=0.22, p<0.001). Both scores, when calculated using the derivation data, correlated with educator gestalt (Pearson’s r=0.35, p=0.03 and r=0.41, p<0.01, respectively) and were related to increased odds of receiving an ALiEM AIR certification (odds ratio=1.28, p=0.03; OR=1.5, p=0.004, respectively). Conclusion Two novel scoring instruments with adequate psychometric properties were derived to assist trainees in evaluating OER quality and correlated favourably with gestalt ratings of online educational resources by faculty educators. Further testing is needed to ensure these instruments are accurate when applied by trainees. PMID:27625722

Derivation of Two Critical Appraisal Scores for Trainees to Evaluate Online Educational Resources: A METRIQ Study.

PubMed

Chan, Teresa M; Thoma, Brent; Krishnan, Keeth; Lin, Michelle; Carpenter, Christopher R; Astin, Matt; Kulasegaram, Kulamakan

2016-09-01

Online education resources (OERs), like blogs and podcasts, increasingly augment or replace traditional medical education resources such as textbooks and lectures. Trainees' ability to evaluate these resources is poor, and few quality assessment aids have been developed to assist them. This study aimed to derive a quality evaluation instrument for this purpose. We used a three-phase methodology. In Phase 1, a previously derived list of 151 OER quality indicators was reduced to 13 items using data from published consensus-building studies (of medical educators, expert podcasters, and expert bloggers) and subsequent evaluation by our team. In Phase 2, these 13 items were converted to seven-point Likert scales used by trainee raters (n=40) to evaluate 39 OERs. The reliability and usability of these 13 rating items was determined using responses from trainee raters, and top items were used to create two OER quality evaluation instruments. In Phase 3, these instruments were compared to an external certification process (the ALiEM AIR certification) and the gestalt evaluation of the same 39 blog posts by 20 faculty educators. Two quality-evaluation instruments were derived with fair inter-rater reliability: the METRIQ-8 Score (Inter class correlation coefficient [ICC]=0.30, p<0.001) and the METRIQ-5 Score (ICC=0.22, p<0.001). Both scores, when calculated using the derivation data, correlated with educator gestalt (Pearson's r=0.35, p=0.03 and r=0.41, p<0.01, respectively) and were related to increased odds of receiving an ALiEM AIR certification (odds ratio=1.28, p=0.03; OR=1.5, p=0.004, respectively). Two novel scoring instruments with adequate psychometric properties were derived to assist trainees in evaluating OER quality and correlated favourably with gestalt ratings of online educational resources by faculty educators. Further testing is needed to ensure these instruments are accurate when applied by trainees.

Measuring quality of life in opioid-dependent people: a systematic review of assessment instruments.

PubMed

Strada, Lisa; Vanderplasschen, Wouter; Buchholz, Angela; Schulte, Bernd; Muller, Ashley E; Verthein, Uwe; Reimer, Jens

2017-12-01

Opioid dependence is a chronic relapsing disorder. Despite increasing research on quality of life (QOL) in people with opioid dependence, little attention has been paid to the instruments used. This systematic review examines the suitability of QOL instruments for use in opioid-dependent populations and the instruments' quality. A systematic search was performed in the databases Medline, PsycInfo, The Cochrane Library, and CINAHL. Articles were eligible if they assessed QOL of opioid-dependent populations using a validated QOL instrument. Item content relevance to opioid-dependent people was evaluated by means of content analysis, and instrument properties were assessed using minimum standards for patient-reported outcome measures. Eighty-nine articles were retrieved, yielding sixteen QOL instruments, of which ten were assessed in this review. Of the ten instruments, six were disease specific, but none for opioid dependence. Two instruments had good item content relevance. The conceptual and measurement model were described in seven instruments. Four instruments were developed with input from the respective target population. Eight instruments had low respondent and administrator burden. Psychometric properties were either not assessed in opioid-dependent populations or were inconclusive or moderate. No instrument scored perfectly on both the content and properties. The limited suitability of instruments for opioid-dependent people hinders accurate and sensitive measurement of QOL in this population. Future research is in need of an opioid dependence-specific QOL instrument to measure the true impact of the disease on people's lives and to evaluate treatment-related services.

Inter-rater reliability of direct observations of the physical and psychosocial working conditions in eldercare: An evaluation in the DOSES project.

PubMed

Karstad, Kristina; Rugulies, Reiner; Skotte, Jørgen; Munch, Pernille Kold; Greiner, Birgit A; Burdorf, Alex; Søgaard, Karen; Holtermann, Andreas

2018-05-01

The aim of the study was to develop and evaluate the reliability of the "Danish observational study of eldercare work and musculoskeletal disorders" (DOSES) observation instrument to assess physical and psychosocial risk factors for musculoskeletal disorders (MSD) in eldercare work. During 1.5 years, sixteen raters conducted 117 inter-rater observations from 11 nursing homes. Reliability was evaluated using percent agreement and Gwet's AC1 coefficient. Of the 18 examined items, inter-rater reliability was excellent for 7 items (AC1>0.75) fair to good for 7 items (AC1 0.40-0.75) and poor for 2 items (AC1 0-0.40). For 2 items there was no agreement between the raters (AC1 <0). The reliability did not differ between the first and second half of the data collection period and the inter-rater observations were representative regarding occurrence of events in eldercare work. The instrument is appropriate for assessing physical and psychosocial risk factors for MSD among eldercare workers. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

A validation study of the Keyboard Personal Computer Style instrument (K-PeCS) for use with children.

PubMed

Green, Dido; Meroz, Anat; Margalit, Adi Edit; Ratzon, Navah Z

2012-11-01

This study examines a potential instrument for measurement of typing postures of children. This paper describes inter-rater, test-retest reliability and concurrent validity of the Keyboard Personal Computer Style instrument (K-PeCS), an observational measurement of postures and movements during keyboarding, for use with children. Two trained raters independently rated videos of 24 children (aged 7-10 years). Six children returned one week later for identifying test-retest reliability. Concurrent validity was assessed by comparing ratings obtained using the K-PECS to scores from a 3D motion analysis system. Inter-rater reliability was moderate to high for 12 out of 16 items (Kappa: 0.46 to 1.00; correlation coefficients: 0.77-0.95) and test-retest reliability varied across items (Kappa: 0.25 to 0.67; correlation coefficients: r = 0.20 to r = 0.95). Concurrent validity compared favourably across arm pathlength, wrist extension and ulnar deviation. In light of the limitations of other tools the K-PeCS offers a fairly affordable, reliable and valid instrument to address the gap for measurement of typing styles of children, despite the shortcomings of some items. However further research is required to refine the instrument for use in evaluating typing among children. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Fear of cancer recurrence: a systematic literature review of self-report measures.

PubMed

Thewes, Belinda; Butow, Phillis; Zachariae, Robert; Christensen, Soren; Simard, Sébastien; Gotay, Carolyn

2012-06-01

Prior research has shown that many cancer survivors experience ongoing fears of cancer recurrence (FCR) and that this chronic uncertainty of health status during and after cancer treatment can be a significant psychological burden. The field of research on FCR is an emerging area of investigation in the cancer survivorship literature, and several standardised instruments for its assessment have been developed. This review aims to identify all available FCR-specific questionnaires and subscales and critically appraise their properties. A systematic review was undertaken to identify instruments measuring FCR. Relevant studies were identified via Medline (1950-2010), CINAHL (1982-2010), PsycINFO (1967-2010) and AMED (1985-2010) databases, reference lists of articles and reviews, grey literature databases and consultation with experts in the field. The Medical Outcomes Trust criteria were used to examine the psychometric properties of the questionnaires. A total of 20 relevant multi-item measures were identified. The majority of instruments have demonstrated reliability and preliminary evidence of validity. Relatively few brief measures (2-10 items) were found to have comprehensive validation and reliability data available. Several valid and reliable longer measures (>10 items) are available. Three have developed short forms that may prove useful as screening tools. This analysis indicated that further refinement and validation of existing instruments is required. Valid and reliable instruments are needed for both research and clinical care. Copyright © 2011 John Wiley & Sons, Ltd.

Development and Validation of a Quality-of-Life Instrument for Infantile Hemangiomas.

PubMed

Chamlin, Sarah L; Mancini, Anthony J; Lai, Jin-Shei; Beaumont, Jennifer L; Cella, David; Adams, Denise; Drolet, Beth; Baselga, Eulalia; Frieden, Ilona J; Garzon, Maria; Holland, Kristin; Horii, Kimberly A; Lucky, Anne W; McCuaig, Catherine; Metry, Denise; Morel, Kimberly D; Newell, Brandon D; Nopper, Amy J; Powell, Julie; Siegel, Dawn; Haggstrom, Anita N

2015-06-01

Infantile hemangiomas (IH) are common tumors for which there is no validated disease-specific instrument to measure the quality of life in infants and their parents/caregivers during the critical first months of life. This study prospectively developed and validated a quality-of-life instrument for patients with IH and their parents/caregivers and correlated demographic and clinical features to the effects on the quality of life. A total of 220 parents/caregivers completed the 35-item Infantile Hemangioma Quality-of-Life (IH-QoL) instrument and provided demographic information. The dimensionality of the items was evaluated using factor analysis, with results suggesting four factors: child physical symptoms, child social interactions, parent emotional functioning, and parent psychosocial functioning. Each factor fit the Rasch measurement model with acceptable fit index (mean square <1.4) and demonstrated excellent internal consistency, with alpha ranging from 0.76 to 0.88. The final instrument consists of four scales with a total of 29 items. Content validity was verified by analyzing parents' responses to an open-ended question. Test-retest reliability at a 48-hour interval was supported by a total IH-QoL intraclass correlation coefficient of 0.84. Certain clinical characteristics of hemangioma, including those located on the head and neck, in the proliferative stage, and requiring treatment, are associated with a greater impact on QoL.

Measuring everyday functional competence using the Rasch assessment of everyday activity limitations (REAL) item bank.

PubMed

Oude Voshaar, Martijn A H; Ten Klooster, Peter M; Vonkeman, Harald E; van de Laar, Mart A F J

2017-11-01

Traditional patient-reported physical function instruments often poorly differentiate patients with mild-to-moderate disability. We describe the development and psychometric evaluation of a generic item bank for measuring everyday activity limitations in outpatient populations. Seventy-two items generated from patient interviews and mapped to the International Classification of Functioning, Disability and Health (ICF) domestic life chapter were administered to 1128 adults representative of the Dutch population. The partial credit model was fitted to the item responses and evaluated with respect to its assumptions, model fit, and differential item functioning (DIF). Measurement performance of a computerized adaptive testing (CAT) algorithm was compared with the SF-36 physical functioning scale (PF-10). A final bank of 41 items was developed. All items demonstrated acceptable fit to the partial credit model and measurement invariance across age, sex, and educational level. Five- and ten-item CAT simulations were shown to have high measurement precision, which exceeded that of SF-36 physical functioning scale across the physical function continuum. Floor effects were absent for a 10-item empirical CAT simulation, and ceiling effects were low (13.5%) compared with SF-36 physical functioning (38.1%). CAT also discriminated better than SF-36 physical functioning between age groups, number of chronic conditions, and respondents with or without rheumatic conditions. The Rasch assessment of everyday activity limitations (REAL) item bank will hopefully prove a useful instrument for assessing everyday activity limitations. T-scores obtained using derived measures can be used to benchmark physical function outcomes against the general Dutch adult population.

Qualitative Development of the PROMIS® Pediatric Stress Response Item Banks

PubMed Central

Gardner, William; Pajer, Kathleen; Riley, Anne W.; Forrest, Christopher B.

2013-01-01

Objective To describe the qualitative development of the Patient-Reported Outcome Measurement Information System (PROMIS®) Pediatric Stress Response item banks. Methods Stress response concepts were specified through a literature review and interviews with content experts, children, and parents. A library comprising 2,677 items derived from 71 instruments was developed. Items were classified into conceptual categories; new items were written and redundant items were removed. Items were then revised based on cognitive interviews (n = 39 children), readability analyses, and translatability reviews. Results 2 pediatric Stress Response sub-domains were identified: somatic experiences (43 items) and psychological experiences (64 items). Final item pools cover the full range of children’s stress experiences. Items are comprehensible among children aged ≥8 years and ready for translation. Conclusions Child- and parent-report versions of the item banks assess children’s somatic and psychological states when demands tax their adaptive capabilities. PMID:23124904

Cross-cultural validity of four quality of life scales in persons with spinal cord injury

PubMed Central

2010-01-01

Background Quality of life (QoL) in persons with spinal cord injury (SCI) has been found to differ across countries. However, comparability of measurement results between countries depends on the cross-cultural validity of the applied instruments. The study examined the metric quality and cross-cultural validity of the Satisfaction with Life Scale (SWLS), the Life Satisfaction Questionnaire (LISAT-9), the Personal Well-Being Index (PWI) and the 5-item World Health Organization Quality of Life Assessment (WHOQoL-5) across six countries in a sample of persons with spinal cord injury (SCI). Methods A cross-sectional multi-centre study was conducted and the data of 243 out-patients with SCI from study centers in Australia, Brazil, Canada, Israel, South Africa, and the United States were analyzed using Rasch-based methods. Results The analyses showed high reliability for all 4 instruments (person reliability index .78-.92). Unidimensionality of measurement was supported for the WHOQoL-5 (Chi2 = 16.43, df = 10, p = .088), partially supported for the PWI (Chi2 = 15.62, df = 16, p = .480), but rejected for the LISAT-9 (Chi2 = 50.60, df = 18, p = .000) and the SWLS (Chi2 = 78.54, df = 10, p = .000) based on overall and item-wise Chi2 tests, principal components analyses and independent t-tests. The response scales showed the expected ordering for the WHOQoL-5 and the PWI, but not for the other two instruments. Using differential item functioning (DIF) analyses potential cross-country bias was found in two items of the SWLS and the WHOQoL-5, three items of the LISAT-9 and four items of the PWI. However, applying Rasch-based statistical methods, especially subtest analyses, it was possible to identify optimal strategies to enhance the metric properties and the cross-country equivalence of the instruments post-hoc. Following the post-hoc procedures the WHOQOL-5 and the PWI worked in a consistent and expected way in all countries. Conclusions QoL assessment using the summary scores of the WHOQOL-5 and the PWI appeared cross-culturally valid in persons with SCI. In contrast, summary scores of the LISAT-9 and the SWLS have to be interpreted with caution. The findings of the current study can be especially helpful to select instruments for international research projects in SCI. PMID:20815864

Assessing the validity and intra-observer agreement of the MIDAM-LTC; an instrument measuring factors that influence personal dignity in long-term care facilities

PubMed Central

2014-01-01

Background Patients who are cared for in long-term care facilities are vulnerable to lose personal dignity. An instrument measuring factors that influence dignity can be used to better target dignity-conserving care to an individual patient, but no such instrument is yet available for the long-term care setting. The aim of this study was to create the Measurement Instrument for Dignity AMsterdam - for Long-Term Care facilities (MIDAM-LTC) and to assess its validity and intra-observer agreement. Methods Thirteen items specific for the LTC setting were added to the earlier developed, more general MIDAM. The MIDAM-LTC consisted of 39 symptoms or experiences for which presence as well as influence on dignity were asked, and a single item score for overall personal dignity. Questionnaires containing the MIDAM-LTC were administered face-to-face at two moments (with a 1-week interval) to 95 nursing home residents residing on general medical wards of six nursing homes in the Netherlands. Constructs related to dignity (WHO Well-Being Five Index, quality of life and physical health status) were also measured. Ten residents answered the questions while thinking aloud. Content validity, construct validity and intra-observer agreement were examined. Results Nine of the 39 items barely exerted influence on dignity. Eight of them could be omitted from the MIDAM-LTC, because the thinking aloud method revealed sensible explanations for their small influence on dignity. Residents reported that they missed no important items. Hypotheses to support construct validity, about the strength of correlations between on the one hand personal dignity and on the other hand well-being, quality of life or physical health status, were confirmed. On average, 83% of the scores given for each item’s influence on dignity were practically consistent over 1 week, and more than 80% of the residents gave consistent scores for the single item score for overall dignity. Conclusion The MIDAM-LTC has good content validity, construct validity and intra-observer agreement. By omitting 8 items from the instrument, a good balance between comprehensiveness and feasibility is realised. The MIDAM-LTC allows researchers to examine the concept of dignity more closely in the LTC setting, and can assist caregivers in providing dignity-conserving care. PMID:24512296

Validation and psychometric properties of the Alcohol Positive and Negative Affect Schedule: Are drinking emotions distinct from general emotions?

PubMed

Lac, Andrew; Donaldson, Candice D

2018-02-01

People vary in experiences of positive and negative emotions from consuming alcohol, but no validated measurement instrument exclusively devoted to assessing drinking emotions exists in the literature. The current research validated and evaluated the psychometric properties of an alcohol affect scale based on adjectives from the Positive and Negative Affect Schedule (PANAS) and tested the extent that emotions incurred from drinking were distinct from general trait-based emotions. Three studies tested independent samples of adult alcohol users. In Study 1 (N = 494), exploratory factor analyses of the Alcohol PANAS revealed that both the 20-item model and the 9-parcel model (represented by similar mood content) supported the 2-factor dimensionality of alcohol positive and negative affect. In Study 2 (N = 302), confirmatory factor analyses corroborated the measurement structure of alcohol positive and negative affect, and both constructs evidenced statistical independence from general positive and negative affect. In Study 3 (N = 452), alcohol positive and negative affect exhibited discriminant, convergent, and criterion validity with established alcohol scales. Incremental validity tests demonstrated that alcohol positive and negative affect uniquely contributed (beyond general positive and negative affect) to alcohol expectancies, use, and problems. Findings support that alcohol emotions are conceptually distinct from trait emotions, and underscore the necessity of an assessment instrument tailored to the former to examine associations with alcohol beliefs and behaviors. The Alcohol PANAS confers theoretical and practical applications to understand the emotional consequences of drinking. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Program Helps Standardize Documentation Of Software

NASA Technical Reports Server (NTRS)

Howe, G.

1994-01-01

Intelligent Documentation Management System, IDMS, computer program developed to assist project managers in implementing information system documentation standard known as NASA-STD-2100-91, NASA STD, COS-10300, of NASA's Software Management and Assurance Program. Standard consists of data-item descriptions or templates, each of which governs particular component of software documentation. IDMS helps program manager in tailoring documentation standard to project. Written in C language.

Electronic circuits for communications systems: A compilation

NASA Technical Reports Server (NTRS)

1972-01-01

The compilation of electronic circuits for communications systems is divided into thirteen basic categories, each representing an area of circuit design and application. The compilation items are moderately complex and, as such, would appeal to the applications engineer. However, the rationale for the selection criteria was tailored so that the circuits would reflect fundamental design principles and applications, with an additional requirement for simplicity whenever possible.

Development and Psychometric Evaluation of a Health-Related Quality of Life Instrument for Individuals with Adult-Onset Hearing Loss

PubMed Central

Stika, Carren J.; Hays, Ron D.

2016-01-01

Objective Self-reports of “hearing handicap” are available, but a comprehensive measure of health-related quality of life (HRQOL) for individuals with adult-onset hearing loss (AOHL) does not exist. Our objective was to develop and evaluate a multidimensional HRQOL instrument for individuals with AOHL. Design The Impact of Hearing Loss Inventory Tool (IHEAR-IT) was developed using results of focus groups, a literature review, Advisory Expert Panel input, and cognitive interviews. Study Sample The 73-item field-test instrument was completed by 409 adults (22-91 years old) with varying degrees of AOHL and from different areas of the US. Results Multitrait scaling analysis supported four multi-item scales and five individual items. Internal consistency reliabilities ranged from 0.93 to 0.96 for the scales. Construct validity was supported by correlations between the IHEAR-IT scales and scores on the 36-Item Short Form Health Survey, Version 2.0 (SF-36v2) Mental Composite Summary (r’s = 0.32 – 0.64) and the Hearing Handicap Inventory for the Elderly/Adults (HHIE/HHIA) (r’s > −0.70). Conclusions The field test provide initial support for the reliability and construct validity of the IHEAR-IT for evaluating HRQOL of individuals with AOHL. Further research is needed to evaluate the responsiveness to change of the IHEAR-IT scales and identify items for a short-form. PMID:27104754

Psychometric properties of the Finnish version of the Women's Health Questionnaire.

PubMed

Katainen, Riina E; Engblom, Janne R; Vahlberg, Tero J; Polo-Kantola, Päivi

2017-08-01

The Women's Health Questionnaire (WHQ) is a validated and commonly used instrument for measuring climacteric-related symptoms. A revised version was previously developed. However, validation in a Finnish population is lacking. As it is important to use qualified instruments, we performed a validation study of the WHQ in a Finnish population. In all, 3,421 women, aged 41 to 54 years, formed the study population. In the original 36-item WHQ, the items were rated on a 1 to 4 scale and on a binary scale (0-1). The scaling of the revised 23-item WHQ was 0 to 100. We evaluated the psychometric properties (internal consistency, correlations between the symptom domains, factor structure, and sampling adequacy) in all three versions. For the 1 to 4 scale and on the revised version of the WHQ, the internal consistency was acceptable (the Cronbach's α coefficients >0.70) for most of the domains. On the binary scale, the majority of the coefficient values were below the acceptable level. The original symptom domains, especially those on the revised version, were recognizable from the factors in the exploratory factor analysis, but there were some limitations. The Kaiser-Meyer-Olkin values were high. The WHQ is a valid instrument for measuring climacteric-related symptoms in Finnish middle-aged women. The psychometric properties of the revised 23-item WHQ were as good or even better than those of the original 36-item WHQ. Thus, we encourage use of the revised version.

Diabetes knowledge in nursing homes and home-based care services: a validation study of the Michigan Diabetes Knowledge Test adapted for use among nursing personnel.

PubMed

Haugstvedt, Anne; Aarflot, Morten; Igland, Jannicke; Landbakk, Tilla; Graue, Marit

2016-01-01

Providing high-quality diabetes care in nursing homes and home-based care facilities requires suitable instruments to evaluate the level of diabetes knowledge among the health-care providers. Thus, the aim of this study was to examine the psychometric properties of the Michigan Diabetes Knowledge Test adapted for use among nursing personnel. The study included 127 nursing personnel (32 registered nurses, 69 nursing aides and 26 nursing assistants) at three nursing homes and one home-based care facility in Norway. We examined the reliability and content and construct validity of the Michigan Diabetes Knowledge Test. The items in both the general diabetes subscale and the insulin-use subscale were considered relevant and appropriate. The instrument showed satisfactory properties for distinguishing between groups. Item response theory-based measurements and item information curves indicate maximum information at average or lower knowledge scores. Internal consistency and the item-total correlations were quite weak, indicating that the Michigan Diabetes Knowledge Test measures a set of items related to various relevant knowledge topics but not necessarily related to each other. The Michigan Diabetes Knowledge Test measures a broad range of topics relevant to diabetes care. It is an appropriate instrument for identifying individual and distinct needs for diabetes education among nursing personnel. The knowledge gaps identified by the Michigan Diabetes Knowledge Test could also provide useful input for the content of educational activities. However, some revision of the test should be considered.

The Consumer Motivation Scale: A detailed review of item generation, exploration, confirmation, and validation procedures.

PubMed

Barbopoulos, I; Johansson, L-O

2017-08-01

This data article offers a detailed description of analyses pertaining to the development of the Consumer Motivation Scale (CMS), from item generation and the extraction of factors, to confirmation of the factor structure and validation of the emergent dimensions. The established goal structure - consisting of the sub-goals Value for Money, Quality, Safety, Stimulation, Comfort, Ethics, and Social Acceptance - is shown to be related to a variety of consumption behaviors in different contexts and for different products, and should thereby prove useful in standard marketing research, as well as in the development of tailored marketing strategies, and the segmentation of consumer groups, settings, brands, and products.

Micro-marketing healthier choices: effects of personalized ordering suggestions on restaurant purchases.

PubMed

Bedard, Kelly; Kuhn, Peter

2015-01-01

We study the effects of the Nutricate receipt, which makes personalized recommendations to switch from unhealthy to healthier items at a restaurant chain. We find that the receipts shifted the mix of items purchased toward the healthier alternatives. For example, the share of adult main dishes requesting "no sauce" increased by 6.8 percent, the share of kids' meals with apples (instead of fries) rose by 7.0 percent and the share of breakfast sandwiches without sausage increased by 3.8 percent. The results illustrate the potential of emerging information technologies, which allow retailers to tailor product marketing to individual consumers, to generate healthier choices. Copyright © 2014 Elsevier B.V. All rights reserved.

Micro-Marketing Healthier Choices: Effects of Personalized Ordering Suggestions on Restaurant Purchases

PubMed Central

Bedard, Kelly; Kuhn, Peter

2014-01-01

We study the effects of the Nutricate receipt, which makes personalized recommendations to switch from unhealthy to healthier items at a restaurant chain. We find that the receipts shifted the mix of items purchased towards the healthier alternatives. For example, the share of adult main dishes requesting “no sauce” increased by 6.8 percent, the share of kids’ meals with apples (instead of fries) rose by 7.0 percent and the share of breakfast sandwiches without sausage increased by 3.8 percent. The results illustrate the potential of emerging information technologies, which allow retailers to tailor product marketing to individual consumers, to generate healthier choices. PMID:25544398

Promoting the hydrostatic conceptual change test (HCCT) with four-tier diagnostic test item

NASA Astrophysics Data System (ADS)

Purwanto, M. G.; Nurliani, R.; Kaniawati, I.; Samsudin, A.

2018-05-01

Hydrostatic Conceptual Change Test (HCCT) is a diagnostic test instrument to identify students’ conception on Hydrostatic field. It is very important to support the learning process in the classroom. Based on that point of view, the researcher decided to develop HCCT instrument test into four-tier test diagnostic items. The resolve of this research is planned as the first step of four-tier test-formatted HCCT development as one of investigative test instrument on Hydrostatic. The research method used the 4D model which has four comprehensive steps: 1) defining, 2) designing, 3) developing and 4) disseminating. The instrument developed has been tried to 30 students in one of senior high schools. The data showed that four-tier- test-formatted HCCT is able to identify student’s conception level of Hydrostatic. In conclusion, the development of four-tier test-formatted HCCT is one of potential diagnostic test instrument that able to classify the category of students who misconception, no understanding, understanding, partial understanding and no codeable about concept of Hydrostatic.

Predicting violence and recidivism in a large sample of males on probation or parole.

PubMed

Prell, Lettie; Vitacco, Michael J; Zavodny, Denis

This study evaluated the utility of items and scales from the Iowa Violence and Victimization Instrument in a sample of 1961 males from the state of Iowa who were on probation or released from prison to parole supervision. This is the first study to examine the potential of the Iowa Violence and Victimization Instrument to predict criminal offenses. The males were followed for 30months immediately following their admission to probation or parole. AUC analyses indicated fair to good predictive power for the Iowa Violence and Victimization Instrument for charges of violence and victimization, but chance predictive power for drug offenses. Notably, both scales of the instrument performed equally well at the 30-month follow-up. Items on the Iowa Violence and Victimization Instrument not only predicted violence, but are straightforward to score. Violence management strategies are discussed as they relate to the current findings, including the potential to expand the measure to other jurisdictions and populations. Copyright © 2016 Elsevier Ltd. All rights reserved.

Measuring attributes of health literate health care organizations from the patients' perspective: Development and validation of a questionnaire to assess health literacy-sensitive communication (HL-COM).

PubMed

Ernstmann, Nicole; Halbach, Sarah; Kowalski, Christoph; Pfaff, Holger; Ansmann, Lena

2017-04-01

Studies addressing the organizational contexts of care that may help increase the patients' ability to cope with a disease and to navigate through the health care system are still rare. Especially instruments allowing the assessment of such organizational efforts from the patients' perspective are missing. The aim of our study was to develop a survey instrument assessing organizational health literacy (HL) from the patients' perspective, i. e., health care organizations' responsiveness to patients' individual needs. A pool of 30 items was developed by a group of experts based on a literature review. The items were developed, tested and prioritized according to their importance in 11 semi-structured interviews and cognitive think-aloud interviews with cancer patients. The resulting 16 items were rated in a standardized postal survey involving a total of N=453 colon and breast cancer patients treated in cancer centers in Germany. An exploratory factor analysis, a confirmatory factor analysis and structural equation modelling were conducted. Item properties were analyzed. 83.2 % of the patients were diagnosed with breast cancer, 16.8 % had a diagnosis of colon cancer. The patients' mean age was 61 (26-88), 89.4 % were female. The most common comorbidities were hypertension (34.0 %) and cardiovascular disease (11.0 %). The final prediction model included nine items measuring the degree of health literacy-sensitivity of communication. The model showed an acceptable model fit. The nine items showed corrected item-total correlations between .622 and .762 and item difficulties between 0.77 and 0.87. Cronbach's α was .912. In a comprehensive development process, the original item pool comprising several aspects of organizational HL was reduced to a one-dimensional scale. The instrument measures an important aspect of organizational HL; i.e., the degree of health literacy-sensitivity of communication (HL-COM). HL-COM was found to impact patient enablement, mediated through the support by physicians. Future research will have to test these associations in the context of other diseases or institutions. Copyright © 2017. Published by Elsevier GmbH.