SEQUenCE: a service user-centred quality of care instrument for mental health services.

PubMed

Hester, Lorraine; O'Doherty, Lorna Jane; Schnittger, Rebecca; Skelly, Niamh; O'Donnell, Muireann; Butterly, Lisa; Browne, Robert; Frorath, Charlotte; Morgan, Craig; McLoughlin, Declan M; Fearon, Paul

2015-08-01

To develop a quality of care instrument that is grounded in the service user perspective and validate it in a mental health service. The instrument (SEQUenCE (SErvice user QUality of CarE)) was developed through analysis of focus group data and clinical practice guidelines, and refined through field-testing and psychometric analyses. All participants were attending an independent mental health service in Ireland. Participants had a diagnosis of bipolar affective disorder (BPAD) or a psychotic disorder. Twenty-nine service users participated in six focus group interviews. Seventy-one service users participated in field-testing: 10 judged the face validity of an initial 61-item instrument; 28 completed a revised 52-item instrument from which 12 items were removed following test-retest and convergent validity analyses; 33 completed the resulting 40-item instrument. Test-retest reliability, internal consistency and convergent validity of the instrument. The final instrument showed acceptable test-retest reliability at 5-7 days (r = 0.65; P < 0.001), good convergent validity with the Verona Service Satisfaction Scale (r = 0.84, P < 0.001) and good internal consistency (Cronbach's alpha = 0.87). SEQUenCE is a valid, reliable scale that is grounded in the service user perspective and suitable for routine use. It may serve as a useful tool in individual care planning, service evaluation and research. The instrument was developed and validated with service users with a diagnosis of either BPAD or a psychotic disorder; it does not yet have established external validity for other diagnostic groups. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Domestic violence on children: development and validation of an instrument to evaluate knowledge of health professionals 1

PubMed Central

Oliveira, Lanuza Borges; Soares, Fernanda Amaral; Silveira, Marise Fagundes; de Pinho, Lucinéia; Caldeira, Antônio Prates; Leite, Maísa Tavares de Souza

2016-01-01

ABSTRACT Objective: to develop and validate an instrument to evaluate the knowledge of health professionals about domestic violence on children. Method: this was a study conducted with 194 physicians, nurses and dentists. A literature review was performed for preparation of the items and identification of the dimensions. Apparent and content validation was performed using analysis of three experts and 27 professors of the pediatric health discipline. For construct validation, Cronbach's alpha was used, and the Kappa test was applied to verify reproducibility. The criterion validation was conducted using the Student's t-test. Results: the final instrument included 56 items; the Cronbach alpha was 0.734, the Kappa test showed a correlation greater than 0.6 for most items, and the Student t-test showed a statistically significant value to the level of 5% for the two selected variables: years of education and using the Family Health Strategy. Conclusion: the instrument is valid and can be used as a promising tool to develop or direct actions in public health and evaluate knowledge about domestic violence on children. PMID:27556878

[Design and validation of an instrument to assess families at risk for health problems].

PubMed

Puschel, Klaus; Repetto, Paula; Solar, María Olga; Soto, Gabriela; González, Karla

2012-04-01

There is a paucity of screening instruments with a high clinical predictive value to identify families at risk and therefore, develop focused interventions in primary care. To develop an easy to apply screening instrument with a high clinical predictive value to identify families with a higher health vulnerability. In the first stage of the study an instrument with a high content validity was designed through a review of existent instruments, qualitative interviews with families and expert opinions following a Delphi approach of three rounds. In the second stage, concurrent validity was tested through a comparative analysis between the pilot instrument and a family clinical interview conducted to 300 families randomly selected from a population registered at a primary care clinic in Santiago. The sampling was blocked based on the presence of diabetes, depression, child asthma, behavioral disorders, presence of an older person or the lack of previous conditions among family members. The third stage, was directed to test the clinical predictive validity of the instrument by comparing the baseline vulnerability obtained by the instrument and the change in clinical status and health related quality of life perceptions of the family members after nine months of follow-up. The final SALUFAM instrument included 13 items and had a high internal consistency (Cronbach's alpha: 0.821), high test re-test reproducibility (Pearson correlation: 0.84) and a high clinical predictive value for clinical deterioration (Odds ratio: 1.826; 95% confidence intervals: 1.101-3.029). SALUFAM instrument is applicable, replicable, has a high content validity, concurrent validity and clinical predictive value.

The construction and validation of an instrument for the assessment of graduates of undergraduate nursing courses 1

PubMed Central

Vieira, Maria Aparecida; Ohara, Conceição Vieira da Silva; de Domenico, Edvane Birelo Lopes

2016-01-01

Abstract Objective: to construct an instrument for the assessment of graduates of undergraduate nursing courses and to validate this instrument through the consensus of specialists. Method: methodological study. In order to elaborate the instrument, documental analysis and a literature review were undertaken. Validation took place through use of the Delphi Conference, between September 2012 and September 2013, in which 36 specialists from Brazilian Nursing participated. In order to analyze reliability, the Cronbach alpha coefficient, the item/total correlation, and the Pearson correlation coefficient were calculated. Results: the instrument was constructed with the participation of specialist nurses representing all regions of Brazil, with experience in lecturing and research. The first Delphi round led to changes in the first instrument, which was restructured and submitted to another round, with a response rate of 94.44%. In the second round, the instrument was validated with a Cronbach alpha of 0.75. Conclusion: the final instrument possessed three dimensions related to the characterization of the graduate, insertion in the job market, and evaluation of the professional training process. This instrument may be used across the territory of Brazil as it is based on the curricular guidelines and contributes to the process of regulation of the quality of the undergraduate courses in Nursing. PMID:27305184

[Development and validity of workplace bullying in nursing-type inventory (WPBN-TI)].

PubMed

Lee, Younju; Lee, Mihyoung

2014-04-01

The purpose of this study was to develop an instrument to assess bullying of nurses, and test the validity and reliability of the instrument. The initial thirty items of WPBN-TI were identified through a review of the literature on types bullying related to nursing and in-depth interviews with 14 nurses who experienced bullying at work. Sixteen items were developed through 2 content validity tests by 9 experts and 10 nurses. The final WPBN-TI instrument was evaluated by 458 nurses from five general hospitals in the Incheon metropolitan area. SPSS 18.0 program was used to assess the instrument based on internal consistency reliability, construct validity, and criterion validity. WPBN-TI consisted of 16 items with three distinct factors (verbal and nonverbal bullying, work-related bullying, and external threats), which explained 60.3% of the total variance. The convergent validity and determinant validity for WPBN-TI were 100.0%, 89.7%, respectively. Known-groups validity of WPBN-TI was proven through the mean difference between subjective perception of bullying. The satisfied criterion validity for WPBN-TI was more than .70. The reliability of WPBN-TI was Cronbach's α of .91. WPBN-TI with high validity and reliability is suitable to determine types of bullying in nursing workplace.

Development and preliminary testing of a self-rating instrument to measure self-directed learning ability of nursing students.

PubMed

Cheng, Su-Fen; Kuo, Chien-Lin; Lin, Kuan-Chia; Lee-Hsieh, Jane

2010-09-01

With the growing trend of preparing students for lifelong learning, the theory of self-directed learning (SDL) has been increasingly applied in the context of higher education. In order to foster lifelong learning, abilities among nursing students, faculties need to have an appropriate instrument to measure the SDL abilities of nursing students. The objectives of this study were to develop an instrument to measure the SDL abilities of nursing students and to test the validity and reliability of this instrument. This study was conducted in 4 phases. In Phase 1, based on a review of the literature, the researchers developed an instrument to measure SDL. In Phase 2, two rounds of the Delphi study were conducted, to determine the content validity of the instrument. In Phase 3, a convenience sample of 1072 nursing students from two representative schools across three different types of nursing programs were recruited to test the construct validity of the Self-Directed Learning Instrument (SDLI). Finally, in Phase 4, the internal consistency and reliability of the instrument were tested. The resulting SDLI consists of 20 items across the following four domains: learning motivation, planning and implementing, self-monitoring, and interpersonal, communication. The final model in confirmatory factor analysis revealed that this 20-item SDLI indicated a good fit of the model. The value of Cronbach's alpha for the total scale was .916 and for the four domains were .801, .861, .785, and .765, respectively. The SDLI is a valid and reliable instrument for identifying student SDL abilities. It is available to students in nursing and similar medical programs to evaluate their own SDL. This scale may also enable nursing faculty to assess students' SDL status, design better lesson plans and curricula, and, implement appropriate teaching strategies for nursing students in order to foster the growth of lifelong learning abilities. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

Predictive Validity of the HKT-R Risk Assessment Tool: Two and 5-Year Violent Recidivism in a Nationwide Sample of Dutch Forensic Psychiatric Patients.

PubMed

Bogaerts, Stefan; Spreen, Marinus; Ter Horst, Paul; Gerlsma, Coby

2018-06-01

This study has examined the predictive validity of the Historical Clinical Future [ Historisch Klinisch Toekomst] Revised risk assessment scheme in a cohort of 347 forensic psychiatric patients, which were discharged between 2004 and 2008 from any of 12 highly secure forensic centers in the Netherlands. Predictive validity was measured 2 and 5 years after release. Official reconviction data obtained from the Dutch Ministry of Security and Justice were used as outcome measures. Violent reoffending within 2 and 5 years after discharge was assessed. With regard to violent reoffending, results indicated that the predictive validity of the Historical domain was modest for 2 (area under the curve [AUC] = .75) and 5 (AUC = .74) years. The predictive validity of the Clinical domain was marginal for 2 (admission: AUC = .62; discharge: AUC = .63) and 5 (admission: AUC = .69; discharge: AUC = .62) years after release. The predictive validity of the Future domain was modest (AUC = .71) for 2 years and low for 5 (AUC = .58) years. The total score of the instrument was modest for 2 years (AUC = .78) and marginal for 5 (AUC = .68) years. Finally, the Final Risk Judgment was modest for 2 years (AUC = .78) and marginal for 5 (AUC = .63) years time at risk. It is concluded that this risk assessment instrument appears to be a satisfactory instrument for risk assessment.

Content Validity for the VVSymQ® Instrument: A New Patient-Reported Outcome Measure for the Assessment of Varicose Veins Symptoms.

PubMed

Paty, Jean; Elash, Celeste A; Turner-Bowker, Diane M

2017-02-01

Varicose veins are common and can impact patients' quality of life, but consensus regarding the evaluation of varicose vein symptoms is lacking and existing measures have limitations. This research aimed to develop and establish the content validity of a new electronic patient-reported outcome (PRO) measure, the VVSymQ ® instrument, to assess symptoms of superficial venous insufficiency (varicose veins) in clinical trials. The development of the VVSymQ ® instrument began with qualitative interviews with patients based on the symptom domain of the VEINES-QOL/Sym, an existing PRO instrument for chronic venous disorders of the leg. Three phases of qualitative research were conducted to examine the relevance and importance of the symptoms to patients with varicose veins, and the patients' ability to understand and use the VVSymQ ® instrument. The development included evaluating questions that had 1-week and 24-h recall periods, and paper and electronic versions of the new instrument. Five symptoms (heaviness, achiness, swelling, throbbing, and itching [HASTI™]) were consistently reported by patients across all sources of qualitative data. The final version of the VVSymQ ® instrument queries patients on the HASTI™ symptoms using a 24-h recall period and a 6-point duration-based response scale ranging from "None of the time" to "All of the time," and is administered daily via an electronic diary. Cognitive interviews demonstrated varicose vein patients' understanding of and their ability to use the final version of the VVSymQ ® instrument. Content validity was established for the VVSymQ ® instrument, which assesses the five HASTI™ symptoms of varicose veins daily via an electronic diary and has promise for use in research and practice.

Development and psychometric evaluation of the Undergraduate Clinical Education Environment Measure (UCEEM).

PubMed

Strand, Pia; Sjöborg, Karolina; Stalmeijer, Renée; Wichmann-Hansen, Gitte; Jakobsson, Ulf; Edgren, Gudrun

2013-12-01

There is a paucity of instruments designed to evaluate the multiple dimensions of the workplace as an educational environment for undergraduate medical students. The aim was to develop and psychometrically evaluate an instrument to measure how undergraduate medical students perceive the clinical workplace environment, based on workplace learning theories and empirical findings. Development of the instrument relied on established standards including theoretical and empirical grounding, systematic item development and expert review at various stages to ensure content validity. Qualitative and quantitative methods were employed using a series of steps from conceptualization through psychometric analysis of scores in a Swedish medical student population. The final result was a 25-item instrument with two overarching dimensions, experiential learning and social participation, and four subscales that coincided well with theory and empirical findings: Opportunities to learn in and through work & quality of supervision; Preparedness for student entry; Workplace interaction patterns & student inclusion; and Equal treatment. Evidence from various sources supported content validity, construct validity and reliability of the instrument. The Undergraduate Clinical Education Environment Measure represents a valid, reliable and feasible multidimensional instrument for evaluation of the clinical workplace as a learning environment for undergraduate medical students. Further validation in different populations using various psychometric methods is needed.

Development and Validation of an Instrument Measuring Theory-Based Determinants of Monitoring Obesogenic Behaviors of Pre-Schoolers among Hispanic Mothers.

PubMed

Branscum, Paul; Lora, Karina R

2016-06-02

Public health interventions are greatly needed for obesity prevention, and planning for such strategies should include community participation. The study's purpose was to develop and validate a theory-based instrument with low-income, Hispanic mothers of preschoolers, to assess theory-based determinants of maternal monitoring of child's consumption of fruits and vegetables and sugar-sweetened beverages (SSB). Nine focus groups with mothers were conducted to determine nutrition-related behaviors that mothers found as most obesogenic for their children. Next, behaviors were operationally defined and rated for importance and changeability. Two behaviors were selected for investigation (fruits and vegetable and SSB). Twenty semi-structured interviews with mothers were conducted next to develop culturally appropriate items for the instrument. Afterwards, face and content validity were established using a panel of six experts. Finally, the instrument was tested with a sample of 238 mothers. Psychometric properties evaluated included construct validity (using the maximum likelihood extraction method of factor analysis), and internal consistency reliability (Cronbach's alpha). Results suggested that all scales on the instrument were valid and reliable, except for the autonomy scales. Researchers and community planners working with Hispanic families can use this instrument to measure theory-based determinants of parenting behaviors related to preschoolers' consumption of fruits and vegetables, and SSB.

[Development of a questionnaire to measure family stress among married working women].

PubMed

Kim, Gwang Suk; Cho, Won Jung

2006-08-01

Even though a number of studies have suggested that appropriate measuring instruments of family stress for working women have to be developed, the validity and reliability of the instruments used have not been consistently examined. The purpose of the present study was to develop a sensitive instrument to measure family stress for married working women, and to test the validity and reliability of the instrument. The items generated for this instrument were drawn from a comprehensive literature review. Twenty four items were developed through evaluation by 10 experts and twenty one items were finally confirmed through item analysis. Psychometric testing was preformed and confirmed with a convenient sample of 240 women employed in the industrial sector. Four factors evolved by factor analysis, which explained 50.5% of the total variance. The first factor 'Cooperation' explained 28.1%, 2nd factor 'Satisfaction with relationships' 10.6%, 3rd factor 'Democratic and comfortable environment' 6.3%, and 4th factor 'Disturbance of own living' 5.5%. Cronbach's coefficient of this instrument was 0.86. The study supports the validity and reliability of the instrument.

Development and Validation of a Scale for the Measurement of Adolescents' Developmental Assets in the Neighborhood

ERIC Educational Resources Information Center

Oliva, Alfredo; Antolin, Lucia; Lopez, Ana Maria

2012-01-01

The aim of this study was to develop a valid and reliable instrument to assess features of a neighborhood that are relevant to the development and adjustment of adolescents. First, a scale was created from a literature review. Second, the content validity of this scale was validated through expert opinion. Finally, the scale was administered to a…

ITEM SELECTION TECHNIQUES AND EVALUATION OF INSTRUCTIONAL OBJECTIVES.

ERIC Educational Resources Information Center

COX, RICHARD C.

THE VALIDITY OF AN EDUCATIONAL ACHIEVEMENT TEST DEPENDS UPON THE CORRESPONDENCE BETWEEN SPECIFIED EDUCATIONAL OBJECTIVES AND THE EXTENT TO WHICH THESE OBJECTIVES ARE MEASURED BY THE EVALUATION INSTRUMENT. THIS STUDY IS DESIGNED TO EVALUATE THE EFFECT OF STATISTICAL ITEM SELECTION ON THE STRUCTURE OF THE FINAL EVALUATION INSTRUMENT AS COMPARED WITH…

Criterion Referenced Measures of Technical Proficiency in Maintenance Activities. Final Report.

ERIC Educational Resources Information Center

Foley, John P., Jr.

The paper concerns instruments used in the determination of task performance efficiency of mechanical and electronic maintenance men. Composite results of unvalidated knowledge tests, theory tests, school marks, and supervisors' ratings are presented which indicate that these measurement instruments have low empirical validity. The limitations of…

Nurses' Attitudes Regarding the Safe Handling of Patients Who Are Morbidly Obese: Instrument Development and Psychometric Analysis.

PubMed

Bejciy-Spring, Susan; Vermillion, Brenda; Morgan, Sally; Newton, Cheryl; Chucta, Sheila; Gatens, Cindy; Zadvinskis, Inga; Holloman, Christopher; Chipps, Esther

2016-12-01

Nurses' attitudes play an important role in the consistent practice of safe patient handling behaviors. The purposes of this study were to develop and assess the psychometric properties of a newly developed instrument measuring attitudes of nurses related to the care and safe handling of patients who are obese. Phases of instrument development included (a) item generation, (b) content validity assessment, (c) reliability assessment, (d) cognitive interviewing, and (e) construct validity assessment through factor analysis. The final data from the exploratory factor analysis produced a 26-item multidimensional instrument that contains 9 subscales. Based on the factor analysis, a 26-item instrument can be used to examine nurses' attitudes regarding patients who are morbidly obese and related safe handling practices.

Validation of the Portuguese DSM-IV-MR-J.

PubMed

Calado, Filipa; Alexandre, Joana; Griffiths, Mark D

2016-01-01

Youth problem gambling is viewed as an emergent public health issue in many countries, and is also an emerging area of public concern in Portugal. However, there is currently no Portuguese instrument that focuses specifically on the measurement of problem gambling among young people. Consequently, the present study aimed to validate the DSM-IV-MR-J for use among Portuguese adolescents and to examine its' psychometric properties. A cross-cultural adaption of this instrument to the Portuguese language was performed using the translation and back translation method. The final version of the instrument was administered to 753 Portuguese high school and first year college students. The findings revealed an acceptable internal reliability and replicated the one-factor structure of this scale. Based on these findings, the Portuguese DSM-IV-MR-J appears to be a valid and reliable instrument, and provides a much needed psychometric tool for the development of more research on youth gambling in Portugal.

Development and Validation of a Two-Tier Instrument to Examine Understanding of Internal Transport in Plants and the Human Circulatory System

ERIC Educational Resources Information Center

Wang, Jing-Ru

2004-01-01

This study is intended to develop an assessment instrument to investigate students' understandings about internal transport in plants and human circulatory system. A refined process of a two-tier diagnostic test was used to develop the instrument. Finally, three versions of the Internal Transport in Plants and the Human Circulatory System test…

Developing a Validated Instrument to Measure Preservice Teachers' ICT Competencies: Meeting the Demands of the 21st Century

ERIC Educational Resources Information Center

Tondeur, Jo; Aesaert, Koen; Pynoo, Bram; van Braak, Johan; Fraeyman, Norbert; Erstad, Ola

2017-01-01

The main objective of this study is to develop a self-report instrument to measure preservice teachers' ICT competencies in education. The questionnaire items of this instrument are based on an existing comprehensive framework and were created with input from experts in the field. The data were collected from a sample of 931 final-year preservice…

The development of a survey instrument for community health improvement.

PubMed Central

Bazos, D A; Weeks, W B; Fisher, E S; DeBlois, H A; Hamilton, E; Young, M J

2001-01-01

OBJECTIVE: To develop a survey instrument that could be used both to guide and evaluate community health improvement efforts. DATA SOURCES/STUDY SETTING: A randomized telephone survey was administered to a sample of about 250 residents in two communities in Lehigh Valley, Pennsylvania in the fall of 1997. METHODS: The survey instrument was developed by health professionals representing diverse health care organizations. This group worked collaboratively over a period of two years to (1) select a conceptual model of health as a foundation for the survey; (2) review relevant literature to identify indicators that adequately measured the health constructs within the chosen model; (3) develop new indicators where important constructs lacked specific measures; and (4) pilot test the final survey to assess the reliability and validity of the instrument. PRINCIPAL FINDINGS: The Evans and Stoddart Field Model of the Determinants of Health and Well-Being was chosen as the conceptual model within which to develop the survey. The Field Model depicts nine domains important to the origins and production of health and provides a comprehensive framework from which to launch community health improvement efforts. From more than 500 potential indicators we identified 118 survey questions that reflected the multiple determinants of health as conceptualized by this model. Sources from which indicators were selected include the Behavior Risk Factor Surveillance Survey, the National Health Interview Survey, the Consumer Assessment of Health Plans Survey, and the SF-12 Summary Scales. The work group developed 27 new survey questions for constructs for which we could not locate adequate indicators. Twenty-five questions in the final instrument can be compared to nationally published norms or benchmarks. The final instrument was pilot tested in 1997 in two communities. Administration time averaged 22 minutes with a response rate of 66 percent. Reliability of new survey questions was adequate. Face validity was supported by previous findings from qualitative and quantitative studies. CONCLUSIONS: We developed, pilot tested, and validated a survey instrument designed to provide more comprehensive and timely data to communities for community health assessments. This instrument allows communities to identify and measure critical domains of health that have previously not been captured in a single instrument. PMID:11508639

Development of an instrument for the evaluation of advanced life support performance.

PubMed

Peltonen, L-M; Peltonen, V; Salanterä, S; Tommila, M

2017-10-01

Assessing advanced life support (ALS) competence requires validated instruments. Existing instruments include aspects of technical skills (TS), non-technical skills (NTS) or both, but one instrument for detailed assessment that suits all resuscitation situations is lacking. This study aimed to develop an instrument for the evaluation of the overall ALS performance of the whole team. This instrument development study had four phases. First, we reviewed literature and resuscitation guidelines to explore items to include in the instrument. Thereafter, we interviewed resuscitation team professionals (n = 66), using the critical incident technique, to determine possible additional aspects associated with the performance of ALS. Second, we developed an instrument based on the findings. Third, we used an expert panel (n = 20) to assess the validity of the developed instrument. Finally, we revised the instrument based on the experts' comments and tested it with six experts who evaluated 22 video recorded resuscitations. The final version of the developed instrument had 69 items divided into adherence to guidelines (28 items), clinical decision-making (5 items), workload management (12 items), team behaviour (8 items), information management (6 items), patient integrity and consideration of laymen (4 items) and work routines (6 items). The Cronbach's α values were good, and strong correlations between the overall performance and the instrument were observed. The instrument may be useful for detailed assessment of the team's overall performance, but the numerous items make the use demanding. The instrument is still under development, and more research is needed to determine its psychometric properties. © 2017 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.

Validation of an instrument to evaluate health promotion at schools

PubMed Central

Pinto, Raquel Oliveira; Pattussi, Marcos Pascoal; Fontoura, Larissa do Prado; Poletto, Simone; Grapiglia, Valenca Lemes; Balbinot, Alexandre Didó; Teixeira, Vanessa Andina; Horta, Rogério Lessa

2016-01-01

ABSTRACT OBJECTIVE To validate an instrument designed to assess health promotion in the school environment. METHODS A questionnaire, based on guidelines from the World Health Organization and in line with the Brazilian school health context, was developed to validate the research instrument. There were 60 items in the instrument that included 40 questions for the school manager and 20 items with direct observations made by the interviewer. The items’ content validation was performed using the Delphi technique, with the instrument being applied in 53 schools from two medium-sized cities in the South region of Brazil. Reliability (Cronbach’s alpha and split-half) and validity (principal component analysis) analyses were performed. RESULTS The final instrument remained composed of 28 items, distributed into three dimensions: pedagogical, structural and relational. The resulting components showed good factorial loads (> 0.4) and acceptable reliability (> 0.6) for most items. The pedagogical dimension identifies educational activities regarding drugs and sexuality, violence and prejudice, auto care and peace and quality of life. The structural dimension is comprised of access, sanitary structure, and conservation and equipment. The relational dimension includes relationships within the school and with the community. CONCLUSIONS The proposed instrument presents satisfactory validity and reliability values, which include aspects relevant to promote health in schools. Its use allows the description of the health promotion conditions to which students from each educational institution are exposed. Because this instrument includes items directly observed by the investigator, it should only be used during periods when there are full and regular activities at the school in question. PMID:26982958

Diagnostic Criteria for Temporomandibular Disorders (DC/TMD) for Clinical and Research Applications: Recommendations of the International RDC/TMD Consortium Network* and Orofacial Pain Special Interest Group†

PubMed Central

Schiffman, Eric; Ohrbach, Richard; Truelove, Edmond; Look, John; Anderson, Gary; Goulet, Jean-Paul; List, Thomas; Svensson, Peter; Gonzalez, Yoly; Lobbezoo, Frank; Michelotti, Ambra; Brooks, Sharon L.; Ceusters, Werner; Drangsholt, Mark; Ettlin, Dominik; Gaul, Charly; Goldberg, Louis J.; Haythornthwaite, Jennifer A.; Hollender, Lars; Jensen, Rigmor; John, Mike T.; De Laat, Antoon; de Leeuw, Reny; Maixner, William; van der Meulen, Marylee; Murray, Greg M.; Nixdorf, Donald R.; Palla, Sandro; Petersson, Arne; Pionchon, Paul; Smith, Barry; Visscher, Corine M.; Zakrzewska, Joanna; Dworkin, Samuel F.

2015-01-01

Aims The original Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Axis I diagnostic algorithms have been demonstrated to be reliable. However, the Validation Project determined that the RDC/TMD Axis I validity was below the target sensitivity of ≥ 0.70 and specificity of ≥ 0.95. Consequently, these empirical results supported the development of revised RDC/TMD Axis I diagnostic algorithms that were subsequently demonstrated to be valid for the most common pain-related TMD and for one temporomandibular joint (TMJ) intra-articular disorder. The original RDC/TMD Axis II instruments were shown to be both reliable and valid. Working from these findings and revisions, two international consensus workshops were convened, from which recommendations were obtained for the finalization of new Axis I diagnostic algorithms and new Axis II instruments. Methods Through a series of workshops and symposia, a panel of clinical and basic science pain experts modified the revised RDC/TMD Axis I algorithms by using comprehensive searches of published TMD diagnostic literature followed by review and consensus via a formal structured process. The panel's recommendations for further revision of the Axis I diagnostic algorithms were assessed for validity by using the Validation Project's data set, and for reliability by using newly collected data from the ongoing TMJ Impact Project—the follow-up study to the Validation Project. New Axis II instruments were identified through a comprehensive search of the literature providing valid instruments that, relative to the RDC/TMD, are shorter in length, are available in the public domain, and currently are being used in medical settings. Results The newly recommended Diagnostic Criteria for TMD (DC/TMD) Axis I protocol includes both a valid screener for detecting any pain-related TMD as well as valid diagnostic criteria for differentiating the most common pain-related TMD (sensitivity ≥ 0.86, specificity ≥ 0.98) and for one intra-articular disorder (sensitivity of 0.80 and specificity of 0.97). Diagnostic criteria for other common intra-articular disorders lack adequate validity for clinical diagnoses but can be used for screening purposes. Inter-examiner reliability for the clinical assessment associated with the validated DC/TMD criteria for pain-related TMD is excellent (kappa ≥ 0.85). Finally, a comprehensive classification system that includes both the common and less common TMD is also presented. The Axis II protocol retains selected original RDC/TMD screening instruments augmented with new instruments to assess jaw function as well as behavioral and additional psychosocial factors. The Axis II protocol is divided into screening and comprehensive self-report instrument sets. The screening instruments’ 41 questions assess pain intensity, pain-related disability, psychological distress, jaw functional limitations, and parafunctional behaviors, and a pain drawing is used to assess locations of pain. The comprehensive instruments, composed of 81 questions, assess in further detail jaw functional limitations and psychological distress as well as additional constructs of anxiety and presence of comorbid pain conditions. Conclusion The recommended evidence-based new DC/TMD protocol is appropriate for use in both clinical and research settings. More comprehensive instruments augment short and simple screening instruments for Axis I and Axis II. These validated instruments allow for identification of patients with a range of simple to complex TMD presentations. PMID:24482784

Psychometric properties concerning four instruments measuring job satisfaction, strain, and stress of conscience in a residential care context.

PubMed

Orrung Wallin, Anneli; Edberg, Anna-Karin; Beck, Ingela; Jakobsson, Ulf

2013-01-01

There are many instruments assessing the wellbeing of staff, but far from all have been psychometrically investigated. When evaluating supportive interventions directed toward nurse assistants in residential care, valid and reliable instruments are needed in order to detect possible changes. The aim of the study was to investigate validity in terms of data quality, construct validity, convergent and divergent validity and reliability in terms of the internal consistency and stability of the Job Satisfaction Questionnaire, the Psychosocial Aspects of Job Satisfaction, the Strain in Dementia Care Scale (SDCS), and the Stress of Conscience Questionnaire (SCQ) in a residential care context. The psychometric properties of the instruments were investigated in terms of data quality, construct validity, convergent and divergent validity and reliability, including test-retest reliability, in a residential care context with a sample consisting of nurse assistants (n=114). The four instruments responded with different psychometric-related problems such as internal missing data, floor and ceiling effects, problems with construct validity and low test-retest reliability, especially when assessed on the item level. These problems were however reduced or disappeared completely when assessed for total and factor scores. From a psychometric perspective, the SDCS seemed to stand out as the best instrument. However, it should be modified in order to reduce floor effects on item level and thereby gain sensitivity. The Job Satisfaction Questionnaire seemed to have problems both with the construct validity and test-retest reliability. The final choice of instrument must, however, be made dependent on what one intends to measure. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Validation of the Malay Version of the Parental Bonding Instrument among Malaysian Youths Using Exploratory Factor Analysis.

PubMed

Muhammad, Noor Azimah; Shamsuddin, Khadijah; Omar, Khairani; Shah, Shamsul Azhar; Mohd Amin, Rahmah

2014-01-01

Parenting behaviour is culturally sensitive. The aims of this study were (1) to translate the Parental Bonding Instrument into Malay (PBI-M) and (2) to determine its factorial structure and validity among the Malaysian population. The PBI-M was generated from a standard translation process and comprehension testing. The validation study of the PBI-M was administered to 248 college students aged 18 to 22 years. Participants in the comprehension testing had difficulty understanding negative items. Five translated double negative items were replaced with five positive items with similar meanings. Exploratory factor analysis showed a three-factor model for the PBI-M with acceptable reliability. Four negative items (items 3, 4, 8, and 16) and item 19 were omitted from the final PBI-M list because of incorrect placement or low factor loading (< 0.32). Out of the final 20 items of the PBI-M, there were 10 items for the care factor, five items for the autonomy factor and five items for the overprotection factor. All the items loaded positively on their respective factors. The Malaysian population favoured positive items in answering questions. The PBI-M confirmed the three-factor model that consisted of care, autonomy and overprotection. The PBI-M is a valid and reliable instrument to assess the Malaysian parenting style. Confirmatory factor analysis may further support this finding. Malaysia, parenting, questionnaire, validity.

Pretest information for a test to validate plume simulation procedures (FA-17)

NASA Technical Reports Server (NTRS)

Hair, L. M.

1978-01-01

The results of an effort to plan a final verification wind tunnel test to validate the recommended correlation parameters and application techniques were presented. The test planning effort was complete except for test site finalization and the associated coordination. Two suitable test sites were identified. Desired test conditions were shown. Subsequent sections of this report present the selected model and test site, instrumentation of this model, planned test operations, and some concluding remarks.

Validation of an instrument for mathematics enhancement teaching efficacy of Pacific Northwest agricultural educators

NASA Astrophysics Data System (ADS)

Jansen, Daniel J.

Teacher efficacy continues to be an important area of study in educational research. This study tested an instrument designed to assess the perceived efficacy of agricultural education teachers when engaged in lessons involving mathematics instruction. The study population of Oregon and Washington agricultural educators utilized in the validation of the instrument revealed important demographic findings and specific results related to teacher efficacy for the study population. An instrument was developed from the assimilation of three scales previously used and validated in efficacy research. Participants' mathematics teaching efficacy was assessed using a portion of the Mathematics Teaching Efficacy Beliefs Instrument (MTEBI), and personal mathematics efficacy was evaluated by the mathematics self-belief instrument which was derived from the Betz and Hackett's Mathematics Self-Efficacy Scale. The final scale, the Teachers' Sense of Efficacy Scale (TSES) created by Tschannen-Moran and Woolfolk Hoy, examined perceived personal teaching efficacy. Structural equation modeling was used as the statistical analyses tool to validate the instrument and examine correlations between efficacy constructs used to determine potential professional development needs of the survey population. As part of the data required for validation of the Mathematics Enhancement Teaching Efficacy instrument, demographic information defining the population of Oregon and Washington agricultural educators was obtained and reported. A hypothetical model derived from teacher efficacy literature was found to be an acceptable model to verify construct validity and determine strength of correlations between the scales that defined the instrument. The instrument produced an alpha coefficient of .905 for reliability. Both exploratory and confirmatory factor analyses were used to verify construct and discriminate validity. Specifics results related to the survey population of agricultural educators concluded that personal mathematics efficacy has a stronger correlation with mathematics teaching efficacy than personal teaching efficacy of teachers for this population. The implications of such findings suggest that professional development and pre-service preparation should be more focused on mathematics content knowledge rather than pedagogical knowledge when the objective is to enhance mathematics in interdisciplinary lessons.

Measuring Attitude toward Computers: The Computer Appreciator-Critic Attitude Scales.

ERIC Educational Resources Information Center

Mathews, Walter M.; Wolf, Abraham W.

The purpose of this study was to develop a reliable and valid instrument that conveniently measures a person's attitude toward computers. The final version of the instrument is composed of 40 items on a Likert-type scale which assign scores to subjects on their "appreciative" and "critical" attitude toward computers. The sample…

Development and Validation of the Biobanking Attitudes and Knowledge Survey (BANKS)

PubMed Central

Wells, Kristen J.; Arevalo, Mariana; Meade, Cathy D.; Gwede, Clement K.; Quinn, Gwendolyn P.; Luque, John S.; Miguel, Gloria San; Watson, Dale; Phillips, Rebecca; Reyes, Carmen; Romo, Margarita; West, Jim; Jacobsen, Paul B.

2014-01-01

Background No validated multi-scale instruments exist that measure community members’ views on biobanking and biospecimen donation. This study describes the development and psychometric properties of the English-language BANKS (Biobanking Attitudes aNd Knowledge Survey). Methods The BANKS was created by item generation through review of scientific literature, focus groups with community members, and input from a community advisory board. Items were refined through cognitive interviews. Content validity was assessed through an expert panel review. Psychometric properties of the BANKS were assessed in a sample of 85 community members. Results The final BANKS includes 3 scales: Attitudes, Knowledge, and Self-Efficacy; as well as 3 single items, which evaluated receptivity and intention to donate a biospecimen for research. Cronbach's alpha coefficients for two scales that use Likert response format indicated high internal consistency (Attitudes: α=.88; Self-Efficacy: α=.95). Content validity indices were moderate, ranging from 0.69 to 0.89. Intention to donate blood and intention to donate urine were positively correlated with attitudes, knowledge, self-efficacy, and receptivity to learning more about biobanking (p's range from .029 to <.001). Conclusions The final BANKS shows evidence of satisfactory reliability and validity, is easy to administer, and is a promising tool to inform biospecimen research. Additional studies should be conducted with larger samples considering biospecimen donation to further assess the instrument's reliability and validity. Impact A valid and reliable instrument measuring community members’ views about biobanking may help researchers evaluate relevant communication interventions to enhance understanding, intention, and actual biospecimen donation. A Spanish-language BANKS is under development. PMID:24609846

Development and Validation of an Instrument Measuring Theory-Based Determinants of Monitoring Obesogenic Behaviors of Pre-Schoolers among Hispanic Mothers

PubMed Central

Branscum, Paul; Lora, Karina R.

2016-01-01

Public health interventions are greatly needed for obesity prevention, and planning for such strategies should include community participation. The study’s purpose was to develop and validate a theory-based instrument with low-income, Hispanic mothers of preschoolers, to assess theory-based determinants of maternal monitoring of child’s consumption of fruits and vegetables and sugar-sweetened beverages (SSB). Nine focus groups with mothers were conducted to determine nutrition-related behaviors that mothers found as most obesogenic for their children. Next, behaviors were operationally defined and rated for importance and changeability. Two behaviors were selected for investigation (fruits and vegetable and SSB). Twenty semi-structured interviews with mothers were conducted next to develop culturally appropriate items for the instrument. Afterwards, face and content validity were established using a panel of six experts. Finally, the instrument was tested with a sample of 238 mothers. Psychometric properties evaluated included construct validity (using the maximum likelihood extraction method of factor analysis), and internal consistency reliability (Cronbach’s alpha). Results suggested that all scales on the instrument were valid and reliable, except for the autonomy scales. Researchers and community planners working with Hispanic families can use this instrument to measure theory-based determinants of parenting behaviors related to preschoolers’ consumption of fruits and vegetables, and SSB. PMID:27271643

Development and validation of a survey instrument for assessing prescribers' perception of computerized drug-drug interaction alerts.

PubMed

Zheng, Kai; Fear, Kathleen; Chaffee, Bruce W; Zimmerman, Christopher R; Karls, Edward M; Gatwood, Justin D; Stevenson, James G; Pearlman, Mark D

2011-12-01

To develop a theoretically informed and empirically validated survey instrument for assessing prescribers' perception of computerized drug-drug interaction (DDI) alerts. The survey is grounded in the unified theory of acceptance and use of technology and an adapted accident causation model. Development of the instrument was also informed by a review of the extant literature on prescribers' attitude toward computerized medication safety alerts and common prescriber-provided reasons for overriding. To refine and validate the survey, we conducted a two-stage empirical validation study consisting of a pretest with a panel of domain experts followed by a field test among all eligible prescribers at our institution. The resulting survey instrument contains 28 questionnaire items assessing six theoretical dimensions: performance expectancy, effort expectancy, social influence, facilitating conditions, perceived fatigue, and perceived use behavior. Satisfactory results were obtained from the field validation; however, a few potential issues were also identified. We analyzed these issues accordingly and the results led to the final survey instrument as well as usage recommendations. High override rates of computerized medication safety alerts have been a prevalent problem. They are usually caused by, or manifested in, issues of poor end user acceptance. However, standardized research tools for assessing and understanding end users' perception are currently lacking, which inhibits knowledge accumulation and consequently forgoes improvement opportunities. The survey instrument presented in this paper may help fill this methodological gap. We developed and empirically validated a survey instrument that may be useful for future research on DDI alerts and other types of computerized medication safety alerts more generally.

Health Service Quality Scale: Brazilian Portuguese translation, reliability and validity.

PubMed

Rocha, Luiz Roberto Martins; Veiga, Daniela Francescato; e Oliveira, Paulo Rocha; Song, Elaine Horibe; Ferreira, Lydia Masako

2013-01-17

The Health Service Quality Scale is a multidimensional hierarchical scale that is based on interdisciplinary approach. This instrument was specifically created for measuring health service quality based on marketing and health care concepts. The aim of this study was to translate and culturally adapt the Health Service Quality Scale into Brazilian Portuguese and to assess the validity and reliability of the Brazilian Portuguese version of the instrument. We conducted a cross-sectional, observational study, with public health system patients in a Brazilian university hospital. Validity was assessed using Pearson's correlation coefficient to measure the strength of the association between the Brazilian Portuguese version of the instrument and the SERVQUAL scale. Internal consistency was evaluated using Cronbach's alpha coefficient; the intraclass (ICC) and Pearson's correlation coefficients were used for test-retest reliability. One hundred and sixteen consecutive postoperative patients completed the questionnaire. Pearson's correlation coefficient for validity was 0.20. Cronbach's alpha for the first and second administrations of the final version of the instrument were 0.982 and 0.986, respectively. For test-retest reliability, Pearson's correlation coefficient was 0.89 and ICC was 0.90. The culturally adapted, Brazilian Portuguese version of the Health Service Quality Scale is a valid and reliable instrument to measure health service quality.

Development of a clinical feeding assessment scale for very young infants in South Africa

PubMed Central

2016-01-01

Background There is a need for validated neonatal feeding assessment instruments in South Africa. A locally developed instrument may contribute to standardised evaluation procedures of high-risk neonates and address needs in resource constrained developing settings. Objective The aim of the study was to develop and validate the content of a clinical feeding assessment scale to diagnose oropharyngeal dysphagia (OPD) in neonates. Method The Neonatal Feeding Assessment Scale (NFAS) was developed using the Delphi method. Five international and South African speech-language therapists (SLTs) formed the expert panel, participating in two rounds of electronic questionnaires to develop and validate the content of the NFAS. Results All participants agreed on the need for the development of a valid clinical feeding assessment instrument to use with the neonatal population. The initial NFAS consisted of 240 items across 8 sections, and after the Delphi process was implemented, the final format was reduced to 211 items across 6 sections. The final format of the NFAS is scored using a binary scoring system guiding the clinician to diagnose the presence or absence of OPD. All members agreed on the format, the scoring system and the feeding constructs addressed in the revised final format of the NFAS. Conclusion The Delphi method and the diverse clinical and research experience of participants could be integrated to develop the NFAS which may be used in clinical practice in South Africa or similar developing contexts. Because of demographically different work settings marked by developed versus developing contexts, participants did not have the same expectations of a clinical dysphagia assessment. The international participants contributed to evidence-based content development. Local participants considered the contextual challenges of South African SLTs entering the field with basic competencies in neonatal dysphagia management, thereby justifying a comprehensive clinical instrument. The NFAS is aimed at clinicians working in Neonatal Intensive Care Units where they manage large caseloads of high-risk neonates. Further validation of the NFAS is recommended to determine its criterion validity in comparison with a widely accepted standard such as the modified barium swallow study. PMID:27796101

Psychometric Properties and Validation of the Arabic Social Media Addiction Scale.

PubMed

Al-Menayes, Jamal

2015-01-01

This study investigated the psychometric properties of the Arabic version of the SMAS. SMAS is a variant of IAT customized to measure addiction to social media instead of the Internet as a whole. Using a self-report instrument on a cross-sectional sample of undergraduate students, the results revealed the following. First, the exploratory factor analysis showed that a three-factor model fits the data well. Second, concurrent validity analysis showed the SMAS to be a valid measure of social media addiction. However, further studies and data should verify the hypothesized model. Finally, this study showed that the Arabic version of the SMAS is a valid and reliable instrument for use in measuring social media addiction in the Arab world.

Psychometric Properties and Validation of the Arabic Social Media Addiction Scale

PubMed Central

Al-Menayes, Jamal

2015-01-01

This study investigated the psychometric properties of the Arabic version of the SMAS. SMAS is a variant of IAT customized to measure addiction to social media instead of the Internet as a whole. Using a self-report instrument on a cross-sectional sample of undergraduate students, the results revealed the following. First, the exploratory factor analysis showed that a three-factor model fits the data well. Second, concurrent validity analysis showed the SMAS to be a valid measure of social media addiction. However, further studies and data should verify the hypothesized model. Finally, this study showed that the Arabic version of the SMAS is a valid and reliable instrument for use in measuring social media addiction in the Arab world. PMID:26347848

Development of a questionnaire to measure quality of life in adolescents with food allergy: the FAQL-teen.

PubMed

Resnick, Elena S; Pieretti, Mariah M; Maloney, Jennifer; Noone, Sally; Muñoz-Furlong, Anne; Sicherer, Scott H

2010-11-01

Living with food allergies affects quality of life (QOL) and may be particularly problematic for teenagers. To develop a validated food allergy QOL assessment tool for US adolescents (FAQL-teen). Initial items were developed through expert opinion, literature review, and adolescent focus groups, resulting in an 88-question impact assessment questionnaire. This questionnaire was completed by 52 adolescents for effect scoring; final instrument questions were determined through analysis of effect scores. The final 17-item instrument was completed by 203 participants aged 13 to 19 years via an Internet link on the Food Allergy & Anaphylaxis Network Web site and via paper surveys distributed at a Food Allergy & Anaphylaxis Network conference. Items were scored on a 7-point Likert scale: 0 corresponded to "not troubled/limited," 3 to "moderately troubled/limited," and 6 to "extremely troubled/limited." Areas most troubling included limitations on social activities (score, 2.7), not being able to eat what others were eating (score, 2.7), and limited choice of restaurants (score, 3.9). Instrument validation steps showed strong internal validity (Cronbach α = .9). The instrument discriminated by disease severity: adolescents with a history of anaphylaxis had significantly lower QOL (higher scores) than did those without a history of anaphylaxis (P = .003). While developing a food allergy QOL assessment tool for US adolescents (FAQL-teen), we identified multiple social and emotional concerns that could be targeted for adolescent counseling. This instrument is internally valid and has the ability to discriminate, making it a useful tool in adolescent food allergy studies. Copyright © 2010 American College of Allergy, Asthma & Immunology. Published by Elsevier Inc. All rights reserved.

Developing and testing the CHORDS: Characteristics of Responsible Drinking Survey.

PubMed

Barry, Adam E; Goodson, Patricia

2011-01-01

Report on the development and psychometric testing of a theoretically and evidence-grounded instrument, the Characteristics of Responsible Drinking Survey (CHORDS). Instrument subjected to four phases of pretesting (cognitive validity, cognitive and motivational qualities, pilot test, and item evaluation) and a final posttest implementation. Large public university in Texas. Randomly selected convenience sample (n  =  729) of currently enrolled students. This 78-item questionnaire measures individuals' responsible drinking beliefs, motivations, intentions, and behaviors. Cronbach α, split-half reliability, principal components analysis and Spearman ρ were conducted to investigate reliability, stability, and validity. Measures in the CHORDS exhibited high internal consistency reliability and strong correlations of split-half reliability. Factor analyses indicated five distinct scales were present, as proposed in the theoretical model. Subscale composite scores also exhibited a correlation to alcohol consumption behaviors, indicating concurrent validity. The CHORDS represents the first instrument specifically designed to assess responsible drinking beliefs and behaviors. It was found to elicit valid and reliable data among a college student sample. This instrument holds much promise for practitioners who desire to empirically investigate dimensions of responsible drinking.

Development and Psychometric Validation of HIPER-Q to Assess Knowledge of Hypertensive Patients in Cardiac Rehabilitation.

PubMed

Santos, Rafaella Zulianello Dos; Bonin, Christiani Decker Batista; Martins, Eliara Ten Caten; Pereira Junior, Moacir; Ghisi, Gabriela Lima de Melo; Macedo, Kassia Rosangela Paz de; Benetti, Magnus

2018-01-01

The absence of instruments capable of measuring the level of knowledge of hypertensive patients in cardiac rehabilitation programs about their disease reflects the lack of specific recommendations for these patients. To develop and validate a questionnaire to evaluate the knowledge of hypertensive patients in cardiac rehabilitation programs about their disease. A total of 184 hypertensive patients (mean age 60.5 ± 10 years, 66.8% men) were evaluated. Reproducibility was assessed by calculation of the intraclass correlation coefficient using the test-retest method. Internal consistency was assessed by the Cronbach's alpha and the construct validity by the exploratory factorial analysis. The final version of the instrument had 17 questions organized in areas considered important for patient education. The instrument proposed showed a clarity index of 8.7 (0.25). The intraclass correlation coefficient was 0.804 and the Cronbach's correlation coefficient was 0.648. Factor analysis revealed five factors associated with knowledge areas. Regarding the criterion validity, patients with higher education level and higher family income showed greater knowledge about hypertension. The instrument has a satisfactory clarity index and adequate validity, and can be used to evaluate the knowledge of hypertensive participants in cardiac rehabilitation programs.

Social Skills Questionnaire for Argentinean College Students (SSQ-U) Development and Validation.

PubMed

Morán, Valeria E; Olaz, Fabián O; Del Prette, Zilda A P

2015-11-27

In this paper we present a new instrument called Social Skills Questionnaire for Argentinean College Students (SSQ-U). Based on the adapted version of the Social Skills Inventory - Del Prette (SSI-Del Prette) (Olaz, Medrano, Greco, & Del Prette, 2009), we wrote new items for the scale, and carried out psychometric analysis to assess the validity and reliability of the instrument. In the first study, we collected evidence based on test content through expert judges who evaluated the quality and the relevance of the items. In the second and third studies, we provided validity evidence based on the internal structure of the instrument using exploratory (n = 1067) and confirmatory (n = 661) factor analysis. Results suggested a five-factor structure consistent with the dimensions of social skills, as proposed by Kelly (2002). The fit indexes corresponding to the obtained model were adequate, and composite reliability coefficients of each factor were excellent (above .75). Finally, in the fourth study, we provided evidence of convergent and discriminant validity. The obtained results allow us to conclude that the SSQ-U is the first valid and reliable instrument for measuring social skills in Argentinean college students.

The Development and Validation of the Intercultural Sensitivity Scale.

ERIC Educational Resources Information Center

Chen, Guo-Ming; Starosta, William J.

The present study developed and assessed reliability and validity of a new instrument, the Intercultural Sensitivity Scale (ISS). Based on a review of the literature, 44 items thought to be important for intercultural sensitivity were generated. A sample of 414 college students rated these items and generated a 24-item final version of the…

[Adapting and validating the generic instrument CollaboRATE™ to measure women's participation in health related decision-making during the reproductive process].

PubMed

Bravo, Paulina; Contreras, Aixa; Dois, Angelina; Villarroel, Luis

2018-05-01

There is a worldwide interest in involving patients in health related decisions, so patients can actively search for therapeutic options and choose course of action that allows them to have better quality of life and wellbeing. The majority of the instruments available to capture the degree of participation in medical decision-making are in English and have been developed in high income countries. To adapt and validate for the Chilean context the instrument CollaboRATE™, to measure women's participation in medical decisions during the reproductive process. Cross-sectional study to adapt and validate the instrument CollaboRATE™. Maternity units in Santiago, Chile. Puerperal women in maternity units of three public hospitals. Translation and back-translation, cultural and linguistic relevance with service users and final revision by experts. Study for validation with 90 puerperal women. The Chilean version of CollaboRATE™ demonstrated to be a reliable instrument to capture the degree of patients' participation in medical decision-making. Cronbach alpha was above 0.89. This study provides the first instrument to capture the prevalence of SDM in a Latin American country. This instrument will be critical in future research efforts that seek to explore to what extent people are being involved in the decisions related to their healthcare. Copyright © 2017. Publicado por Elsevier España, S.L.U.

Validation of the Malay Version of the Parental Bonding Instrument among Malaysian Youths Using Exploratory Factor Analysis

PubMed Central

MUHAMMAD, Noor Azimah; SHAMSUDDIN, Khadijah; OMAR, Khairani; SHAH, Shamsul Azhar; MOHD AMIN, Rahmah

2014-01-01

Background: Parenting behaviour is culturally sensitive. The aims of this study were (1) to translate the Parental Bonding Instrument into Malay (PBI-M) and (2) to determine its factorial structure and validity among the Malaysian population. Methods: The PBI-M was generated from a standard translation process and comprehension testing. The validation study of the PBI-M was administered to 248 college students aged 18 to 22 years. Results: Participants in the comprehension testing had difficulty understanding negative items. Five translated double negative items were replaced with five positive items with similar meanings. Exploratory factor analysis showed a three-factor model for the PBI-M with acceptable reliability. Four negative items (items 3, 4, 8, and 16) and item 19 were omitted from the final PBI-M list because of incorrect placement or low factor loading (< 0.32). Out of the final 20 items of the PBI-M, there were 10 items for the care factor, five items for the autonomy factor and five items for the overprotection factor. All the items loaded positively on their respective factors. Conclusion: The Malaysian population favoured positive items in answering questions. The PBI-M confirmed the three-factor model that consisted of care, autonomy and overprotection. The PBI-M is a valid and reliable instrument to assess the Malaysian parenting style. Confirmatory factor analysis may further support this finding. Keywords: Malaysia, parenting, questionnaire, validity PMID:25977634

Dental Management Survey Brazil (DMS-BR): creation and validation of a management instrument

PubMed

Gonzales, Paola Sampaio; Martins, Ismar Eduardo; Biazevic, Maria Gabriela Haye; Silva, Paulo Roberto da; Michel-Crosato, Edgard

2017-04-10

Questionnaires for the assessment of knowledge and self-perception can be useful to diagnose what a dentist knows about management and administration. The aim of the present study was to create and validate the Dental Management Survey Brazil (DMS-BR) scale, based on meetings with experts in the field. After having elaborated the first version, 10 audits were performed in dental offices in order to produce the final version, which included nine dimensions: location, patient, finance, marketing, competition, quality, staff, career, and productivity. The accuracy of the instrument was measured by intrarater and interrater reliability. In the validation phase, 247 Brazilian dentists answered a web-based questionnaire. The data were processed using Stata 13.0 and the significance level was set at 95%. The instrument had intrarater and interrater reliability (ICC-0.93 and 0.94). The overall average of respondents for the DMS-BR scale was 3.77 (SD = 0.45). Skewness and kurtosis were below absolute values 3 and 7, respectively. Internal validity measured by Cronbach's alpha was 0.925 and the correlation of each dimension with the final result of the DMS-BR ranged between 0.606 and 0.810. Correlation with the job satisfaction scale was 0.661. The SEM data ranged between 0.80 and 0.56. The questionnaire presented satisfactory indicators of dentists' self-perception about management and administration activities.

Health related quality of life in disorders of defecation: the Defecation Disorder List

PubMed Central

Voskuijl, W; van der Zaag-Loon..., H J; Ketel, I; Grootenhuis, M; Derkx, B; Benninga, M

2004-01-01

Background: Constipation and encopresis frequently cause problems with respect to emotional wellbeing, and social and family life. Instruments to measure Health Related Quality of Life (HRQoL) in these disorders are not available. Methods: A disease specific HRQoL instrument, the "Defecation Disorder List" (DDL) for children with constipation or functional non-retentive faecal soiling (FNRFS) was developed using accepted guidelines. For each phase of the process, different samples of patients were used. The final phase of development included 27 children. Reliability was assessed in two ways: internal consistency of domains with Cronbach's alpha, and test-retest reliability with intra-class correlation coefficients (ICC). To assess validity, comparable items and domains were correlated with Tacqol, a generic HRQoL instrument for children (TNO-AZL). Results: In the final phase of the development, 27 children completed the instrument. It consisted of 37 items in four domains. The response rate was 96%. Reliability was good for all domains, with Cronbach's alpha values ranging from 0.61 to 0.76. Measures of test-retest stability were good for all four domains with ICCs ranging from 0.82 to 0.92. Validity based on comparison with the Tacqol instrument was moderate. Conclusion: The DDL is promising as a measure of HRQoL in childhood defecation disorders. PMID:15557046

Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems—I-MeDeSA

PubMed Central

Zachariah, Marianne; Seidling, Hanna M; Neri, Pamela M; Cresswell, Kathrin M; Duke, Jon; Bloomrosen, Meryl; Volk, Lynn A; Bates, David W

2011-01-01

Background Medication-related decision support can reduce the frequency of preventable adverse drug events. However, the design of current medication alerts often results in alert fatigue and high over-ride rates, thus reducing any potential benefits. Methods The authors previously reviewed human-factors principles for relevance to medication-related decision support alerts. In this study, instrument items were developed for assessing the appropriate implementation of these human-factors principles in drug–drug interaction (DDI) alerts. User feedback regarding nine electronic medical records was considered during the development process. Content validity, construct validity through correlation analysis, and inter-rater reliability were assessed. Results The final version of the instrument included 26 items associated with nine human-factors principles. Content validation on three systems resulted in the addition of one principle (Corrective Actions) to the instrument and the elimination of eight items. Additionally, the wording of eight items was altered. Correlation analysis suggests a direct relationship between system age and performance of DDI alerts (p=0.0016). Inter-rater reliability indicated substantial agreement between raters (κ=0.764). Conclusion The authors developed and gathered preliminary evidence for the validity of an instrument that measures the appropriate use of human-factors principles in the design and display of DDI alerts. Designers of DDI alerts may use the instrument to improve usability and increase user acceptance of medication alerts, and organizations selecting an electronic medical record may find the instrument helpful in meeting their clinicians' usability needs. PMID:21946241

Development and validation of an instrument to assess the prescribing readiness of medical students in Malaysia.

PubMed

Lai, Pauline Siew Mei; Sim, Si Mui; Chua, Siew Siang; Tan, Choo Hock; Ng, Chirk Jenn; Achike, Francis Ifejika; Teng, Cheong Lieng

2015-09-21

Prescribing incompetence is an important factor that contributes to prescribing error, and this is often due to inadequate training during medical schools. We therefore aimed to develop and validate an instrument to assess the prescribing readiness of medical students (PROMS) in Malaysia. The PROMS comprised of 26 items with four domains: undergraduate learning opportunities; hands-on clinical skills practice; information gathering behaviour; and factors affecting the learning of prescribing skills. The first three domains were adapted from an existing questionnaire, while items from the last domain were formulated based on findings from a nominal group discussion. Face and content validity was determined by an expert panel, pilot tested in a class of final year (Year 5) medical students, and assessed using the Flesch reading ease. To assess the reliability of the PROMS, the internal consistency and test-retest (at baseline and 2 weeks later) were assessed using the Wilcoxon Signed Ranks test and Spearman's rho. The discriminative validity of the PROMS was assessed using the Mann-Whitney U-test (to assess if the PROMS could discriminate between final year medical students from a public and a private university). A total of 119 medical students were recruited. Flesch reading ease was 46.9, indicating that the instrument was suitable for use in participants undergoing tertiary education. The overall Cronbach alpha value of the PROMS was 0.695, which was satisfactory. Test-retest showed no difference for 25/26 items, indicating that our instrument was reliable. Responses from the public and private university final year medical students were significantly different in 10/26 items, indicating that the PROMS was able to discriminate between these two groups. Medical students from the private university reported fewer learning opportunities and hands-on practice compared to those from the public university. On the other hand, medical students from the private university reported more frequent use of both web based and non-web-based resources compared to their public university counterparts. The PROMS instrument was found to be a reliable and valid tool for assessing medical students' readiness to prescribe in Malaysia. It may also inform on the adequacy of medical programmes in training prescribing skills.

A Reliable and Valid Weighted Scoring Instrument for Use in Grading APA-Style Empirical Research Report

ERIC Educational Resources Information Center

Greenberg, Kathleen Puglisi

2012-01-01

The scoring instrument described in this article is based on a deconstruction of the seven sections of an American Psychological Association (APA)-style empirical research report into a set of learning outcomes divided into content-, expression-, and format-related categories. A double-weighting scheme used to score the report yields a final grade…

Developing an ICT-Literacy Task-Based Assessment Instrument: The Findings on the Final Testing Phase

ERIC Educational Resources Information Center

Mat-jizat, Jessnor Elmy

2013-01-01

This paper reports the findings of a study which seeks to identify the information and communications technology (ICT) literacy levels of trainee teachers, by investigating their ICT proficiency using a task-bask assessment instrument. The Delphi technique was used as a primary validation method for the new assessment tool and the ICT literacy…

Development and validation of the Hospitality Axiological Scale for Humanization of Nursing Care

PubMed Central

Galán González-Serna, José María; Ferreras-Mencia, Soledad; Arribas-Marín, Juan Manuel

2017-01-01

ABSTRACT Objective: to develop and validate a scale to evaluate nursing attitudes in relation to hospitality for the humanization of nursing care. Participants: the sample consisted of 499 nursing professionals and undergraduate students of the final two years of the Bachelor of Science in Nursing program. Method: the instrument has been developed and validated to evaluate the ethical values related to hospitality using a methodological approach. Subsequently, a model was developed to measure the dimensions forming the construct hospitality. Results: the Axiological Hospitality Scale showed a high internal consistency, with Cronbach’s Alpha=0.901. The validation of the measuring instrument was performed using factorial, exploratory and confirmatory analysis techniques with high goodness of fit measures. Conclusions: the developed instrument showed an adequate validity and a high internal consistency. Based on the consistency of its psychometric properties, it is possible to affirm that the scale provides a reliable measurement of the hospitality. It was also possible to determine the dimensions or sources that embrace it: respect, responsibility, quality and transpersonal care. PMID:28793127

Screening emergency department patients for opioid drug use: A qualitative systematic review.

PubMed

Sahota, Preet Kaur; Shastry, Siri; Mukamel, Dana B; Murphy, Linda; Yang, Narisu; Lotfipour, Shahram; Chakravarthy, Bharath

2018-05-24

The opioid drug epidemic is a major public health concern and an economic burden in the United States. The purpose of this systematic review is to assess the reliability and validity of screening instruments used in emergency medicine settings to detect opioid use in patients and to assess psychometric data for each screening instrument. PubMed/MEDLINE, PsycINFO, Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, Web of Science, Cumulative Index to Nursing and Allied Health Literature and ClinicalTrials.gov were searched for articles published up to May 2018. The extracted articles were independently screened for eligibility by two reviewers. We extracted 1555 articles for initial screening and 95 articles were assessed for full-text eligibility. Six articles were extracted from the full-text assessment. Six instruments were identified from the final article list: Screener and Opioid Assessment for Patients with Pain - Revised; Drug Abuse Screening Test; Opioid Risk Tool; Current Opioid Misuse Measure; an Emergency Medicine Providers Clinician Assessment Questionnaire; and an Emergency Provider Impression Data Collection Form. Screening instrument characteristics, and reliability and validity data were extracted from the six studies. A meta-analysis was not conducted due to heterogeneity between the studies. There is a lack of validity and reliability evidence in all six articles; and sensitivity, specificity and predictive values varied between the different instruments. These instruments cannot be validated for use in emergency medicine settings. There is no clear evidence to state which screening instruments are appropriate for use in detecting opioid use disorders in emergency medicine patients. There is a need for brief, reliable, valid and feasible opioid use screening instruments in the emergency medicine setting. Copyright © 2018 Elsevier Ltd. All rights reserved.

A New Clinical Pain Knowledge Test for Nurses: Development and Psychometric Evaluation.

PubMed

Bernhofer, Esther I; St Marie, Barbara; Bena, James F

2017-08-01

All nurses care for patients with pain, and pain management knowledge and attitude surveys for nurses have been around since 1987. However, no validated knowledge test exists to measure postlicensure clinicians' knowledge of the core competencies of pain management in current complex patient populations. To develop and test the psychometric properties of an instrument designed to measure pain management knowledge of postlicensure nurses. Psychometric instrument validation. Four large Midwestern U.S. hospitals. Registered nurses employed full time and part time August 2015 to April 2016, aged M = 43.25 years; time as RN, M = 16.13 years. Prospective survey design using e-mail to invite nurses to take an electronic multiple choice pain knowledge test. Content validity of initial 36-item test "very good" (95.1% agreement). Completed tests that met analysis criteria, N = 747. Mean initial test score, 69.4% correct (range 27.8-97.2). After revision/removal of 13 unacceptable questions, mean test score was 50.4% correct (range 8.7-82.6). Initial test item percent difficulty range was 15.2%-98.1%; discrimination values range, 0.03-0.50; final test item percent difficulty range, 17.6%-91.1%, discrimination values range, -0.04 to 1.04. Split-half reliability final test was 0.66. A high decision consistency reliability was identified, with test cut-score of 75%. The final 23-item Clinical Pain Knowledge Test has acceptable discrimination, difficulty, decision consistency, reliability, and validity in the general clinical inpatient nurse population. This instrument will be useful in assessing pain management knowledge of clinical nurses to determine gaps in education, evaluate knowledge after pain management education, and measure research outcomes. Copyright © 2017 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

Evaluation of an immunosuppressant side effect instrument.

PubMed

Winsett, Rebecca P; Arheart, Kris; Stratta, Robert J; Alloway, Rita; Wicks, Mona N; Gaber, A Osama; Hathaway, Donna K

2004-09-01

Clinicians continue to be compelled to evaluate the impact of immunosuppressive medication side effects on the quality of life of transplant recipients. We Were asked to develop an instrument to measure side effects in immunosuppressed transplant recipients. To construct an instrument that measures the impact and severity of side effects of immunosuppressive medications used in transplantation and to assess the reliability and validity of the newly developed instrument called the Memphis Survey. The instrument was constructed by a panel of physicians, nurses, and pharmacists with experience in treating transplant recipients. A small group of kidney transplant recipients (n= 13) provided pilot data for refining and testing the instrument. A national sample of kidney, liver, and heart transplant recipients (n = 505) provided data that were used to further develop the instrument. Factor analysis was used to determine the psychological dimensions underlying the instrument and to guide the construction of scales from the survey items. The instrument scales were then computed from the dataset of 505 transplant recipients to quantify the impact of immunosuppressant side effects on the quality of life of transplant recipients. Analyses showed the final instrument scales to be valid and reliable. Exploratory analysis suggests the need for further testing of the instrument to determine gender differences.

Knowledge about dietary fibres (KADF): development and validation of an evaluation instrument through structural equation modelling (SEM).

PubMed

Guiné, R P F; Duarte, J; Ferreira, M; Correia, P; Leal, M; Rumbak, I; Barić, I C; Komes, D; Satalić, Z; Sarić, M M; Tarcea, M; Fazakas, Z; Jovanoska, D; Vanevski, D; Vittadini, E; Pellegrini, N; Szűcs, V; Harangozó, J; El-Kenawy, A; El-Shenawy, O; Yalçın, E; Kösemeci, C; Klava, D; Straumite, E

2016-09-01

Because there is scientific evidence that an appropriate intake of dietary fibre should be part of a healthy diet, given its importance in promoting health, the present study aimed to develop and validate an instrument to evaluate the knowledge of the general population about dietary fibres. The present study was a cross sectional study. The methodological study of psychometric validation was conducted with 6010 participants, residing in 10 countries from three continents. The instrument is a questionnaire of self-response, aimed at collecting information on knowledge about food fibres. Exploratory factor analysis (EFA) was chosen as the analysis of the main components using varimax orthogonal rotation and eigenvalues greater than 1. In confirmatory factor analysis by structural equation modelling (SEM) was considered the covariance matrix and adopted the maximum likelihood estimation algorithm for parameter estimation. Exploratory factor analysis retained two factors. The first was called dietary fibre and promotion of health (DFPH) and included seven questions that explained 33.94% of total variance (α = 0.852). The second was named sources of dietary fibre (SDF) and included four questions that explained 22.46% of total variance (α = 0.786). The model was tested by SEM giving a final solution with four questions in each factor. This model showed a very good fit in practically all the indexes considered, except for the ratio χ(2)/df. The values of average variance extracted (0.458 and 0.483) demonstrate the existence of convergent validity; the results also prove the existence of discriminant validity of the factors (r(2) = 0.028) and finally good internal consistency was confirmed by the values of composite reliability (0.854 and 0.787). This study allowed validating the KADF scale, increasing the degree of confidence in the information obtained through this instrument in this and in future studies. Copyright © 2016 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Resident Wellness and Social Support: Development and Cognitive Validation of a Resident Social Capital Assessment Tool.

PubMed

Kaplan, Stephen J; Seabott, Heather M; Cunningham, Erika B; Helman, James D; Calderon, Alvin; Thirlby, Richard C; Schenarts, Kimberly D

The purpose of this study is to develop and generate validity evidence for an instrument to measure social capital in residents. Mixed-methods, phased approach utilizing a modified Delphi technique, focus groups, and cognitive interviews. Four residency training institutions in Washington state between February 2016 and March 2017. General surgery, anesthesia, and internal medicine residents ranging from PGY-1 to PGY-6. The initial resident-focused instrument underwent revision via Delphi process with 6 experts; 100% expert consensus was achieved after 4 cycles. Three focus groups were conducted with 19 total residents. Focus groups identified 6 of 11 instrument items with mean quality ratings ≤4.0 on a 1-5 scale. The composite instrument rating of the draft version was 4.1 ± 0.5. After refining the instrument, cognitive interviews with the final version were completed with 22 residents. All items in the final version had quality ratings >4.0; the composite instrument rating was 4.8 ± 0.1. Social capital may be an important factor in resident wellness as residents rely upon each other and external social support to withstand fatigue, burnout, and other negative sequelae of rigorous training. This instrument for assessment of social capital in residents may provide an avenue for data collection and potentially, identification of residents at-risk for wellness degradation. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Development and psychometric validation of a questionnaire to evaluate nurses' adherence to recommendations for preventing pressure ulcers (QARPPU).

PubMed

Moya-Suárez, Ana Belén; Morales-Asencio, José Miguel; Aranda-Gallardo, Marta; Enríquez de Luna-Rodríguez, Margarita; Canca-Sánchez, José Carlos

2017-11-01

The main objective of this work is the development and psychometric validation of an instrument to evaluate nurses' adherence to the main recommendations issued for preventing pressure ulcers. An instrument was designed based on the main recommendations for the prevention of pressure ulcers published in various clinical practice guides. Subsequently, it was proceeded to evaluate the face and content validity of the instrument by an expert group. It has been applied to 249 Spanish nurses took part in a cross-sectional study to obtain a psychometric evaluation (reliability and construct validity) of the instrument. The study data were compiled from June 2015 to July 2016. From the results of the psychometric analysis, a final 18-item, 4-factor questionnaire was derived, which explained 60.5% of the variance and presented the following optimal indices of fit (CMIN/DF: 1.40 p < 0.001; GFI: 0.93; NFI: 0.92; CFI: 0.98; TLI: 0.97; RMSEA: 0.04 (90% CI 0.025-0.054). The results obtained show that the instrument presents suitable psychometric properties for evaluating nurses' adherence to recommendations for the prevention of pressure ulcers. Copyright © 2017 Tissue Viability Society. Published by Elsevier Ltd. All rights reserved.

Women's perceptions of social support during labour: development, reliability and validity of the Birth Companion Support Questionnaire.

PubMed

Dunne, Carmel L; Fraser, Jennifer; Gardner, Glenn E

2014-07-01

to develop and test the reliability and validity of a research instrument to measure women's perceptions of social support provided during labour by at least one lay birth companion. a cross-sectional study was carried out from April 2009 to February 2010. non-tertiary hospital in the outer western region of Brisbane, Australia. six registered midwives and 10 postnatal women reviewed the instrument. The instrument was then completed by 293 inpatient women who had experienced a vaginal birth. the Birth Companion Support Questionnaire (BCSQ) was developed and its reliability and validity were evaluated in this study. An exploratory factor analysis was performed on the final instrument using principal component analysis with an oblique (Promax) rotation. This process suggested two subscales: emotional support and tangible support. The questionnaire was found to be reliable and valid for use in midwifery research. the BCSQ is an appropriate instrument to measure women's perceptions of lay birth companion support during labour. this is the first rigorous study to develop and test a measure of social support in labour which is critical at a time when policy makers and health planners need to consider the needs of birthing women and their network of support friends and family. © 2013 Elsevier Ltd. All rights reserved.

Construction of a survey to assess workload and fatigue among AMT operators in Mexico.

PubMed

Hernández Arellano, Juan Luis; Ibarra Mejía, Gabriel; Serratos Pérez, J Nieves; García Alcaraz, Jorge Luis; Brunette, María Julia

2012-01-01

Operators of machinery classified as Advanced Manufacturing Technology (AMT) are exposed to high levels of workload and fatigue. However, only few studies have been conducted on this topic in Hispanic-American countries workers. Several instruments be used to assess workload and fatigue; however, only few of them have been adapted to Spanish language. This paper reports on the development and validity testing of a survey instrument in Spanish, aiming to subjectively assess workload and fatigue among AMT operators in Mexico. After an exhaustive literature review in search of already available measurement instruments, they were adapted for content and later translated into Spanish; a pilot test was conducted to evaluate validity and reliability; afterwards appropriate modifications were made to the testing instruments. Final version of the instrument was applied to a group of 121 operators of CNC lathes. Reliability was analyzed using KMO and Cronbach alpha indices. For the assessment of workload, both NASA-TLX and ISTAS 21 methods were incorporated to the survey instrument. As for fatigue assessment tools, these were SOFI-S, FAS and OFER questionnaires. RESULTS show KMO value and Cronbach alpha above 0.6.Conclusions. The survey instrument as designed, allows the collection of reliable and valid data regarding workload and fatigue among AMT operators in Mexico.

Instrumented Taylor anvil-on-rod impact tests for validating applicability of standard strength models to transient deformation states

NASA Astrophysics Data System (ADS)

Eakins, D. E.; Thadhani, N. N.

2006-10-01

Instrumented Taylor anvil-on-rod impact tests have been conducted on oxygen-free electronic copper to validate the accuracy of current strength models for predicting transient states during dynamic deformation events. The experiments coupled the use of high-speed digital photography to record the transient deformation states and laser interferometry to monitor the sample back (free surface) velocity as a measure of the elastic/plastic wave propagation through the sample length. Numerical continuum dynamics simulations of the impact and plastic wave propagation employing the Johnson-Cook [Proceedings of the Seventh International Symposium on Ballistics, 1983, The Netherlands (Am. Def. Prep. Assoc. (ADPA)), pp. 541-547], Zerilli-Armstrong [J. Appl. Phys. C1, 1816 (1987)], and Steinberg-Guinan [J. Appl. Phys. 51, 1498 (1980)] constitutive equations were used to generate transient deformation profiles and the free surface velocity traces. While these simulations showed good correlation with the measured free surface velocity traces and the final deformed sample shape, varying degrees of deviations were observed between the photographed and calculated specimen profiles at intermediate deformation states. The results illustrate the usefulness of the instrumented Taylor anvil-on-rod impact technique for validating constitutive equations that can describe the path-dependent deformation response and can therefore predict the transient and final deformation states.

Developing instruments concerning scientific epistemic beliefs and goal orientations in learning science: a validation study

NASA Astrophysics Data System (ADS)

Lin, Tzung-Jin; Tsai, Chin-Chung

2017-11-01

The purpose of this study was to develop and validate two survey instruments to evaluate high school students' scientific epistemic beliefs and goal orientations in learning science. The initial relationships between the sampled students' scientific epistemic beliefs and goal orientations in learning science were also investigated. A final valid sample of 600 volunteer Taiwanese high school students participated in this survey by responding to the Scientific Epistemic Beliefs Instrument (SEBI) and the Goal Orientations in Learning Science Instrument (GOLSI). Through both exploratory and confirmatory factor analyses, the SEBI and GOLSI were proven to be valid and reliable for assessing the participants' scientific epistemic beliefs and goal orientations in learning science. The path analysis results indicated that, by and large, the students with more sophisticated epistemic beliefs in various dimensions such as Development of Knowledge, Justification for Knowing, and Purpose of Knowing tended to adopt both Mastery-approach and Mastery-avoidance goals. Some interesting results were also found. For example, the students tended to set a learning goal to outperform others or merely demonstrate competence (Performance-approach) if they had more informed epistemic beliefs in the dimensions of Multiplicity of Knowledge, Uncertainty of Knowledge, and Purpose of Knowing.

Development and Field-Test of an Instrument to Assess the Extent to Which a Vocational Educational Program Is Either Competency-Based or Conventional. Final Report from September 1, 1984 to August 31, 1985.

ERIC Educational Resources Information Center

University of Central Florida, Orlando. Coll. of Education.

This report describes the production and pilot test of an assessment instrument for vocational education programs. The instrument was designed to be used following a site visit that includes a 30- to 45-minute interview with the program instructor and a 30-minute interview with one small group of students. Reliability and validity information was…

Development and evaluation of an instrument to measure health-related quality of life in Cuban breast cancer patients receiving radiotherapy.

PubMed

Lugo, Josefina; Nápoles, Misleidy; Pérez, Inés; Ordaz, Niurka; Luzardo, Mario; Fernández, Leticia

2014-01-01

INTRODUCTION Although modern technology has extended the survival of breast cancer patients, treatment's adverse effects impact their health-related quality of life. Currently, no instrument exists capable of identifying the range of problems affecting breast cancer patients receiving radiotherapy in Cuba's socioeconomic and cultural context. OBJECTIVES Construct and validate an instrument to measure the effects of breast cancer and radiotherapy on health-related quality of life in Cuban patients. METHODS The study was conducted at the Oncology and Radiobiology Institute, Havana, Cuba, from January 2010 through December 2011. Inclusion criteria were: adult female, histological diagnosis of breast cancer, treated with ambulatory radiotherapy, and written informed consent; patients unable to communicate orally or in writing, or who had neurologic or psychiatric conditions were excluded. Development phase: focus groups guided by a list of questions were carried out with 50 women. The patients reported 61 problems affecting their health-related quality-of-life. A nominal group (six oncologists and two nurses) identified the same problems. A syntactic analysis of the information was performed to create items for study and measurement scales. Content validity was determined by a nominal group of seven experts using professional judgment. Another 20 patients were selected to evaluate face validity. Validation phase: the instrument was applied to 230 patients at three different points: before radiotherapy, at the end of radiotherapy and four weeks after radiotherapy was concluded. Reliability, construct validity, discriminant validity, predictive validity, interpretability and response burden were evaluated. RESULTS The final instrument developed had 33 items distributed in 4 domains: physical functioning, psychological functioning, social and family relationships, and physical and emotional adverse effects of disease and treatment. There were two discrete items: perceived general health and perceived health-related quality of life. Content validity and face validity were assessed as acceptable, by experts and patients respectively. Homogeneity, construct validity, and discriminant validity were satisfactory. The best results were obtained with test-retest reliability, predictive validity, and interpretability; the low rate of unanswered questions indicated that the instrument did not produce excessive patient response burden. CONCLUSION The new instrument fulfilled the requirements for measuring impact of breast cancer and of radiotherapy on health-related quality of life in these Cuban patients, validating its usefulness for inclusion in clinical trial protocols.

Instrument translation and initial psychometric evaluation of the Danish Body Image Quality of Life Inventory.

PubMed

Rasmussen, Trine Bernholdt; Berg, Selina Kikkenborg; Dixon, Jane; Moons, Philip; Konradsen, Hanne

2016-12-01

Negative body perception has been reported in a number of patient populations. No instrument in Danish for measuring body image-related concerns has been available. Without such an instrument, understanding of the phenomenon in Danish-speaking populations is limited. The purpose of the study was thus to translate and validate a Danish version of the Body Image Quality of Life Inventory (BIQLI), in order to obtain a valid instrument applicable for healthcare research. The study consisted of two phases: (i) instrument adaptation, including forward and back translation, expert committee comparisons and cognitive interviewing, and (ii) empirical testing of the Danish version (BIQLI-DA) with subsequent psychometric evaluation. Hypothesised correlations to other measures, including body mass index (BMI), Medical Outcome Short Form-8 (SF-8), Patient Health Questionnaire-9 (PHQ-9), General Anxiety Disorder-7 and Symptom Check List-90-Revised (SCL-90-R ® ) were tested. In addition, exploratory factor structure analysis (EFA) and internal consistency on item and scale level were performed. The adapted instrument was found to be semantically sound, yet concerns about face validity did arise through cognitive interviews. Danish college students (n = 189, 65 men, M age = 21.1 years) participated in the piloting of the BIQLI-DA. Convergent construct validity was demonstrated through associations to related constructs. Exploratory factor analysis revealed a potential subscale structure. Finally, results showed a high internal consistency (Cronbach's alpha = 0.92). Support for the validity of the BIQLI-DA might have been strengthened by repeating cognitive interviews after layout alterations, by piloting the instrument on a larger sample. This study demonstrated tentative support for the validity of the Danish Body Image Quality of Life (BIQLI-DA) and found the measure to be reliable in terms of internal consistency. Further exploration of response processes and construct validity is needed. © 2016 Nordic College of Caring Science.

Astronomical Instrumentation Systems Quality Management Planning: AISQMP

NASA Astrophysics Data System (ADS)

Goldbaum, Jesse

2017-06-01

The capability of small aperture astronomical instrumentation systems (AIS) to make meaningful scientific contributions has never been better. The purpose of AIS quality management planning (AISQMP) is to ensure the quality of these contributions such that they are both valid and reliable. The first step involved with AISQMP is to specify objective quality measures not just for the AIS final product, but also for the instrumentation used in its production. The next step is to set up a process to track these measures and control for any unwanted variation. The final step is continual effort applied to reducing variation and obtaining measured values near optimal theoretical performance. This paper provides an overview of AISQMP while focusing on objective quality measures applied to astronomical imaging systems.

Astronomical Instrumentation Systems Quality Management Planning: AISQMP (Abstract)

NASA Astrophysics Data System (ADS)

Goldbaum, J.

2017-12-01

(Abstract only) The capability of small aperture astronomical instrumentation systems (AIS) to make meaningful scientific contributions has never been better. The purpose of AIS quality management planning (AISQMP) is to ensure the quality of these contributions such that they are both valid and reliable. The first step involved with AISQMP is to specify objective quality measures not just for the AIS final product, but also for the instrumentation used in its production. The next step is to set up a process to track these measures and control for any unwanted variation. The final step is continual effort applied to reducing variation and obtaining measured values near optimal theoretical performance. This paper provides an overview of AISQMP while focusing on objective quality measures applied to astronomical imaging systems.

Using Cognitive Interviews to Pilot an International Survey of Principal Preparation: A Western Australian Perspective

ERIC Educational Resources Information Center

Wildy, Helen; Clarke, Simon

2009-01-01

This paper provides an example of the application of the cognitive interview, a qualitative tool for pre-testing a survey instrument to check its cognitive validity, that is, whether the items mean to respondents what they mean to the item designers. The instrument is the survey used in the final phase of the International Study of Principal…

The Toronto outcome measure for craniofacial prosthetics: reliability and validity of a condition-specific quality-of-life instrument.

PubMed

Anderson, James D; Johnston, Dennis A; Haugh, Gil S; Kiat-Amnuay, Sudarat; Gettleman, Lawrence

2013-01-01

The purpose of this study was to refine the Toronto Outcome Measure for Craniofacial Prosthetics (TOMCP), present evidence for its reliability and validity, and use the instrument to explore differences in quality of life between prostheses made with chlorinated polyethylene (CPE) (experimental) and silicone (control). As part of a multicenter prospective controlled randomized double-blind single-crossover clinical trial of the two materials, the TOMCP was administered at the start and end of two 4-month study arms, during which 42 patients wore prostheses made from one material then the other. Reliability was assessed at the crossover. To determine validity of the TOMCP, the Linear Analogue Self-Assessment (LASA-12) and the Short-Form 8 (SF-8) were also administered with the TOMCP. The TOMCP was reduced by removing items that were unreliable, had poorly distributed answers, showed increased internal consistency after their removal, or were too highly correlated with more than one other item. The tests of reliability and validity were then repeated. Finally, the reduced instrument was used to test for differences in quality of life between prostheses made of the two materials. The item reduction tactics pared the 52-item instrument down to 27 items. The correlations of both TOMCP versions with the LASA-12 and the SF-8 were found to be statistically significant, providing evidence of the validity of the TOMCP. The instrument revealed significantly better quality of life with silicone rather than CPE prostheses. Both versions of the TOMCP were found to be reliable and valid. The instrument was able to show differences in quality of life between two materials.

Psychometric properties of the Chinese version of the attitudes towards cardiopulmonary resuscitation with defibrillation (ACPRD-C) among female hospital nurses in Taiwan.

PubMed

Lin, Hsing-Long; Lin, Mei-Hsiang; Ho, Chao-Chung; Fu, Chin-Hua; Koo, Malcolm

2017-07-01

Nurses are often the first responders to in-hospital cardiac emergencies. A positive attitude towards cardiopulmonary resuscitation with defibrillation may contribute to early cardiopulmonary resuscitation and rapid defibrillation, which are associated with enhanced long-term survival. The aim of this study was to translate and adapt the 31-item attitudes towards cardiopulmonary resuscitation with defibrillation and the national resuscitation guidelines (ACPRD) instrument into Chinese and to evaluate its psychometric properties in a sample of Taiwanese hospital nurses. The ACPRD instrument was translated into Chinese using professional translation services. Content validity index based on five experts to refine the translated instrument. The final instrument was applied to a sample of 290 female nurses, recruited from a regional hospital in southern Taiwan, to assess its internal consistency, factor structure, and discriminative validity. The Chinese ACPRD instrument showed good internal consistency (Cronbach's alpha=0.87). Seven factors emerged from the factor analysis. The instrument showed good discriminative validity and were able to differentiate the attitudes of nurses with more experience of defibrillation or cardiopulmonary resuscitation from those with less experience. Nurses working in emergency ward or intensive care unit also showed significantly higher overall scores compared to those working in other units. The Chinese ACPRD demonstrated adequate content validity, internal consistency, sensible factor structure, and good discriminative validity. Among Chinese-speaking nurses, it may be used as a tool for assessing the effectiveness of educational programs that aim to improve their confidence in performing cardiopulmonary resuscitation with defibrillation. Copyright © 2017 Elsevier Ltd. All rights reserved.

The development of an instrument to measure teachers' use of fear appeals in the GCSE classroom.

PubMed

Putwain, David W; Roberts, Christine M

2009-12-01

Previous work has suggested that teachers of General Certificate of Secondary Education classes may use fear appeals as a motivational device but these may have unwanted consequences by increasing examination-related anxiety in students. To facilitate future work in this area, an instrument was developed to measure teachers' use of fear appeals in the course of normal classroom instruction. Students in their final 2 years of compulsory schooling in England: 192 in Study 1 and 133 in Study 2. A construct validity approach was used in the development of this instrument. Study 1 reports the development and piloting of this measure. Study 2 reports refinement of this measure and relations with other constructs. A three-factor structure provided a reasonable model fit and all factors demonstrated acceptable reliability. Factors 1 and 2 described the perceived frequency of fear appeals made in relation to educational/occupational consequences and the third factor described the perceived threat of fear appeals. This instrument has demonstrated sufficient convergent and discriminant validity and reliability to be used in subsequent research, although the validation process should continue and it is hoped that the instrument will be adapted for use in other contexts.

Flight set 360L003 instrumentation final test report, volume 9

NASA Technical Reports Server (NTRS)

1989-01-01

Post-flight instrumentation hardware and data evaluation for 360L003 is summarized. The 360L003 motors were equipped with Developmental Flight Instrumentation (DFI), Operational Flight Instrumentation (OFI), and Ground Environmental Instrumentation (GEI). The DFI was designed to measure strain, temperature, pressure, and vibration at various locations on the motor during flight. The DFI is used to validate engineering models in a flight environment. The OFI consists of six Operational Pressure Tranducers which monitor chamber pressure during flight. These pressure transducers are used in the SRB separation cue. GEI measures the motor case, igniter flange, and nozzle temperature prior to launch.

Development of the multiple sclerosis (MS) early mobility impairment questionnaire (EMIQ).

PubMed

Ziemssen, Tjalf; Phillips, Glenn; Shah, Ruchit; Mathias, Adam; Foley, Catherine; Coon, Cheryl; Sen, Rohini; Lee, Andrew; Agarwal, Sonalee

2016-10-01

The Early Mobility Impairment Questionnaire (EMIQ) was developed to facilitate early identification of mobility impairments in multiple sclerosis (MS) patients. We describe the initial development of the EMIQ with a focus on the psychometric evaluation of the questionnaire using classical and item response theory methods. The initial 20-item EMIQ was constructed by clinical specialists and qualitatively tested among people with MS and physicians via cognitive interviews. Data from an observational study was used to make additional updates to the instrument based on exploratory factor analysis (EFA) and item response theory (IRT) analysis, and psychometric analyses were performed to evaluate the reliability and validity of the final instrument's scores and screening properties (i.e., sensitivity and specificity). Based on qualitative interview analyses, a revised 15-item EMIQ was included in the observational study. EFA, IRT and item-to-item correlation analyses revealed redundant items which were removed leading to the final nine-item EMIQ. The nine-item EMIQ performed well with respect to: test-retest reliability (ICC = 0.858); internal consistency (α = 0.893); convergent validity; and known-groups methods for construct validity. A cut-point of 41 on the 0-to-100 scale resulted in sufficient sensitivity and specificity statistics for viably identifying patients with mobility impairment. The EMIQ is a content valid and psychometrically sound instrument for capturing MS patients' experience with mobility impairments in a clinical practice setting. Additional research is suggested to further confirm the EMIQ's screening properties over time.

Measuring the reasons that discourage medical students from working in rural areas

PubMed Central

Goel, Sonu; Angeli, Federica; Singla, Neetu; Ruwaard, Dirk

2018-01-01

Abstract The sharply uneven distribution of human resources for health care across urban and rural areas has been a long-standing concern globally. The present study aims to develop and validate an instrument measuring the factors deterring final year students of Bachelor of Medicine and Bachelor of Surgery (MBBS) in 3 northern states of India, from working in rural areas. The medical student's de-motivation to work in rural India (MSDRI) scale was developed using extensive literature review followed by Delphi technique. The psychometric properties of the questionnaire were assessed in terms of content validity, construct validity, data quality and reliability. Exploratory factor analysis (EFA) followed by confirmatory factor analysis (CFA) was performed to identify the primary deterrents. Thirty-three items were generated from literature search followed by Delphi exercise. After assessing psychometric properties, the final instrument included 29 items whereas the EFA and CFA highlighted 5 main factors, namely lack of professional challenge, social segregation, socio-cultural gap, hostile professional environment, and lack of financial incentives as underpinning students’ demotivation towards working in rural areas. The MSDRI instrument is the first valid and reliable measure for identifying deterring factors for MBBS students to work in rural areas of India. The use of it may be very helpful for policymakers as well as healthcare organizations in formulating effective measures to encourage medical students to work in rural areas, which suffer from a chronic shortage of medical personnel. PMID:29480833

Translation and validation of the Malay version of the Stroke Knowledge Test.

PubMed

Sowtali, Siti Noorkhairina; Yusoff, Dariah Mohd; Harith, Sakinah; Mohamed, Monniaty

2016-04-01

To date, there is a lack of published studies on assessment tools to evaluate the effectiveness of stroke education programs. This study developed and validated the Malay language version of the Stroke Knowledge Test research instrument. This study involved translation, validity, and reliability phases. The instrument underwent backward and forward translation of the English version into the Malay language. Nine experts reviewed the content for consistency, clarity, difficulty, and suitability for inclusion. Perceived usefulness and utilization were obtained from experts' opinions. Later, face validity assessment was conducted with 10 stroke patients to determine appropriateness of sentences and grammar used. A pilot study was conducted with 41 stroke patients to determine the item analysis and reliability of the translated instrument using the Kuder Richardson 20 or Cronbach's alpha. The final Malay version Stroke Knowledge Test included 20 items with good content coverage, acceptable item properties, and positive expert review ratings. Psychometric investigations suggest that Malay version Stroke Knowledge Test had moderate reliability with Kuder Richardson 20 or Cronbach's alpha of 0.58. Improvement is required for Stroke Knowledge Test items with unacceptable difficulty indices. Overall, the average rating of perceived usefulness and perceived utility of the instruments were both 72.7%, suggesting that reviewers were likely to use the instruments in their facilities. Malay version Stroke Knowledge Test was a valid and reliable tool to assess educational needs and to evaluate stroke knowledge among participants of group-based stroke education programs in Malaysia.

Development process of an assessment tool for disruptive behavior problems in cross-cultural settings: the Disruptive Behavior International Scale – Nepal version (DBIS-N)

PubMed Central

Burkey, Matthew D.; Ghimire, Lajina; Adhikari, Ramesh P.; Kohrt, Brandon A.; Jordans, Mark J. D.; Haroz, Emily; Wissow, Lawrence

2017-01-01

Systematic processes are needed to develop valid measurement instruments for disruptive behavior disorders (DBDs) in cross-cultural settings. We employed a four-step process in Nepal to identify and select items for a culturally valid assessment instrument: 1) We extracted items from validated scales and local free-list interviews. 2) Parents, teachers, and peers (n=30) rated the perceived relevance and importance of behavior problems. 3) Highly rated items were piloted with children (n=60) in Nepal. 4) We evaluated internal consistency of the final scale. We identified 49 symptoms from 11 scales, and 39 behavior problems from free-list interviews (n=72). After dropping items for low ratings of relevance and severity and for poor item-test correlation, low frequency, and/or poor acceptability in pilot testing, 16 items remained for the Disruptive Behavior International Scale—Nepali version (DBIS-N). The final scale had good internal consistency (α=0.86). A 4-step systematic approach to scale development including local participation yielded an internally consistent scale that included culturally relevant behavior problems. PMID:28093575

The development of an instrument to assess chemistry perceptions

NASA Astrophysics Data System (ADS)

Wells, Raymond R.

The instrument, developed in this study, attempted to correct the deficiencies of previous instruments. Statements of belief and opinion can be validly included under the construct of chemistry perceptions. Further, statements that might be better characterized as science attitudes, math attitudes, or attitudes toward a specific course or program were not included. Eliminating statements of math anxiety and test anxiety insured that responses to statements of anxiety were perceptions of anxiety solely related to chemistry. The results of the expert judges' responses to the Validation of Proposed Perception Statements forms were detailed to establish construct and content validity. The nature of Likert scale construction and calculation of internal consistency also supported the validity of the instrument. A pilot Chemistry Perception Questionnaire (CPQ) was then constructed based on agreement of the appropriate subscale and mean importance of the perception statements. The pilot CPQ results were subjected to an item analysis based on three sets of statistics: the frequency of each response and the percentage of respondents making each response for each perception statement, the mean and standard deviations for each item, and the item discrimination index which correlated the item scores with the subscale scores. With no zero or negative correlations to the subscale scores, it was not necessary to replace any of the perception statements contained in the pilot instrument. Therefore, the piloted Chemistry Perception Questionnaire became the final instrument. Factor analysis confirmed the multidimensionality of the instrument. The instrument was administered twice with a separation interval of approximately one month in order to perform a test-retest reliability analysis. One hundred and forty-one pairs were matched and results detailed. The correlation between forms, for the total instrument, was 0.9342. The mean coefficient alpha, for the total instrument, was 0.9495. With test-retest correlations and alphas exceeding 0.70 for all seven subscales and the total instrument, it was determined that the Chemistry Perception Questionnaire instrument achieved reasonably high reliability estimations.

Pancreatitis Quality of Life Instrument: Development of a new instrument

PubMed Central

Bova, Carol; Barton, Bruce; Hartigan, Celia

2014-01-01

Objectives: The goal of this project was to develop the first disease-specific instrument for the evaluation of quality of life in chronic pancreatitis. Methods: Focus groups and interview sessions were conducted, with chronic pancreatitis patients, to identify items felt to impact quality of life which were subsequently formatted into a paper-and-pencil instrument. This instrument was used to conduct an online survey by an expert panel of pancreatologists to evaluate its content validity. Finally, the modified instrument was presented to patients during precognitive testing interviews to evaluate its clarity and appropriateness. Results: In total, 10 patients were enrolled in the focus groups and interview sessions where they identified 50 items. Once redundant items were removed, the 40 remaining items were made into a paper-and-pencil instrument referred to as the Pancreatitis Quality of Life Instrument. Through the processes of content validation and precognitive testing, the number of items in the instrument was reduced to 24. Conclusions: This marks the development of the first disease-specific instrument to evaluate quality of life in chronic pancreatitis. It includes unique features not found in generic instruments (economic factors, stigma, and spiritual factors). Although this marks a giant step forward, psychometric evaluation is still needed prior to its clinical use. PMID:26770703

Development and Validation of a Quality-of-Life Instrument for Infantile Hemangiomas.

PubMed

Chamlin, Sarah L; Mancini, Anthony J; Lai, Jin-Shei; Beaumont, Jennifer L; Cella, David; Adams, Denise; Drolet, Beth; Baselga, Eulalia; Frieden, Ilona J; Garzon, Maria; Holland, Kristin; Horii, Kimberly A; Lucky, Anne W; McCuaig, Catherine; Metry, Denise; Morel, Kimberly D; Newell, Brandon D; Nopper, Amy J; Powell, Julie; Siegel, Dawn; Haggstrom, Anita N

2015-06-01

Infantile hemangiomas (IH) are common tumors for which there is no validated disease-specific instrument to measure the quality of life in infants and their parents/caregivers during the critical first months of life. This study prospectively developed and validated a quality-of-life instrument for patients with IH and their parents/caregivers and correlated demographic and clinical features to the effects on the quality of life. A total of 220 parents/caregivers completed the 35-item Infantile Hemangioma Quality-of-Life (IH-QoL) instrument and provided demographic information. The dimensionality of the items was evaluated using factor analysis, with results suggesting four factors: child physical symptoms, child social interactions, parent emotional functioning, and parent psychosocial functioning. Each factor fit the Rasch measurement model with acceptable fit index (mean square <1.4) and demonstrated excellent internal consistency, with alpha ranging from 0.76 to 0.88. The final instrument consists of four scales with a total of 29 items. Content validity was verified by analyzing parents' responses to an open-ended question. Test-retest reliability at a 48-hour interval was supported by a total IH-QoL intraclass correlation coefficient of 0.84. Certain clinical characteristics of hemangioma, including those located on the head and neck, in the proliferative stage, and requiring treatment, are associated with a greater impact on QoL.

Coaching leadership: leaders' and followers' perception assessment questionnaires in nursing

PubMed Central

Cardoso, Maria Lúcia Alves Pereira; Ramos, Laís Helena; D'Innocenzo, Maria

2014-01-01

ABSTRACT Objective: To describe the development, content analysis, and reliability of two questionnaires to assess the perception of nurse leaders, nurse technicians, and licensed practical nurses – coached in the practice of leadership and the relation with the dimensions of the coaching process. Methods: This was a methodological study with a quantitative and qualitative approach, which had the goal of instrumentation in reference to the construction and validation of measuring instruments. The instrument proposition design was based on the literature on leadership, coaching, and assessment of psychometric properties, subjected to content validation as to clarity, relevance, and applicability in order to validate the propositions through the consensus of judges, using the Delphi technique, in 2010. The final version of the questionnaires was administered to 279 nurses and 608 nurse technicians and licensed practical nurses, at two university hospitals and two private hospitals. Results: The Cronbach's alpha value with all items of the self-perception instrument was very high (0.911). The team members' instrument of perception showed that for all determinants and for each dimension of the coaching process, Cronbach's overall alpha value (0.952) was considered quite high, pointing to a very strong consistency of the scale. Confirmatory analysis showed that the models were well adjusted. Conclusion: From the statistical validation we compared the possibility of reusing the questionnaires for other study samples, because there was evidence of reliability and applicability. PMID:24728249

Development and Validation of a Cross-Cultural Knowledge, Attitudes, and Practices Survey Instrument for Chronic Kidney Disease in a Swahili-Speaking Population

PubMed Central

Stanifer, John W.; Karia, Francis; Voils, Corrine I.; Turner, Elizabeth L.; Maro, Venance; Shimbi, Dionis; Kilawe, Humphrey; Lazaro, Matayo; Patel, Uptal D.

2015-01-01

Introduction Non-communicable diseases are a growing global burden, and structured surveys can identify critical gaps to address this epidemic. In sub-Saharan Africa, there are very few well-tested survey instruments measuring population attributes related to non-communicable diseases. To meet this need, we have developed and validated the first instrument evaluating knowledge, attitudes and practices pertaining to chronic kidney disease in a Swahili-speaking population. Methods and Results Between December 2013 and June 2014, we conducted a four-stage, mixed-methods study among adults from the general population of northern Tanzania. In stage 1, the survey instrument was constructed in English by a group of cross-cultural experts from multiple disciplines and through content analysis of focus group discussions to ensure local significance. Following translation, in stage 2, we piloted the survey through cognitive and structured interviews, and in stage 3, in order to obtain initial evidence of reliability and construct validity, we recruited and then administered the instrument to a random sample of 606 adults. In stage 4, we conducted analyses to establish test-retest reliability and known-groups validity which was informed by thematic analysis of the qualitative data in stages 1 and 2. The final version consisted of 25 items divided into three conceptual domains: knowledge, attitudes and practices. Each item demonstrated excellent test-retest reliability with established content and construct validity. Conclusions We have developed a reliable and valid cross-cultural survey instrument designed to measure knowledge, attitudes and practices of chronic kidney disease in a Swahili-speaking population of Northern Tanzania. This instrument may be valuable for addressing gaps in non-communicable diseases care by understanding preferences regarding healthcare, formulating educational initiatives, and directing development of chronic disease management programs that incorporate chronic kidney disease across sub-Saharan Africa. PMID:25811781

Development and Validation of the Scan of Postgraduate Educational Environment Domains (SPEED): A Brief Instrument to Assess the Educational Environment in Postgraduate Medical Education

PubMed Central

Schönrock-Adema, Johanna; Visscher, Maartje; Raat, A. N. Janet; Brand, Paul L. P.

2015-01-01

Introduction Current instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality. Methods Stepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected. Results Two hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ≥80% by the items representing the domains in the final SPEED. Conclusions The SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity and brevity, the SPEED is promising as useful and easily applicable tool to regularly screen educational environment quality in postgraduate medical education. PMID:26413836

Ecological Validity and Clinical Utility of Patient-Reported Outcomes Measurement Information System (PROMIS®) instruments for detecting premenstrual symptoms of depression, anger, and fatigue

PubMed Central

Junghaenel, Doerte U.; Schneider, Stefan; Stone, Arthur A.; Christodoulou, Christopher; Broderick, Joan E.

2014-01-01

Objective This study examined the ecological validity and clinical utility of NIH Patient Reported-Outcomes Measurement Information System (PROMIS®) instruments for anger, depression, and fatigue in women with premenstrual symptoms. Methods One-hundred women completed daily diaries and weekly PROMIS assessments over 4 weeks. Weekly assessments were administered through Computerized Adaptive Testing (CAT). Weekly CATs and corresponding daily scores were compared to evaluate ecological validity. To test clinical utility, we examined if CATs could detect changes in symptom levels, if these changes mirrored those obtained from daily scores, and if CATs could identify clinically meaningful premenstrual symptom change. Results PROMIS CAT scores were higher in the pre-menstrual than the baseline (ps < .0001) and post-menstrual (ps < .0001) weeks. The correlations between CATs and aggregated daily scores ranged from .73 to .88 supporting ecological validity. Mean CAT scores showed systematic changes in accordance with the menstrual cycle and the magnitudes of the changes were similar to those obtained from the daily scores. Finally, Receiver Operating Characteristic (ROC) analyses demonstrated the ability of the CATs to discriminate between women with and without clinically meaningful premenstrual symptom change. Conclusions PROMIS CAT instruments for anger, depression, and fatigue demonstrated validity and utility in premenstrual symptom assessment. The results provide encouraging initial evidence of the utility of PROMIS instruments for the measurement of affective premenstrual symptoms. PMID:24630180

Pancreatitis Quality of Life Instrument: A Psychometric Evaluation.

PubMed

Wassef, Wahid; DeWitt, John; McGreevy, Kathleen; Wilcox, Mel; Whitcomb, David; Yadav, Dhiraj; Amann, Stephen; Mishra, Girish; Alkaade, Samer; Romagnuolo, Joseph; Stevens, Tyler; Vargo, John; Gardner, Timothy; Singh, Vikesh; Park, Walter; Hartigan, Celia; Barton, Bruce; Bova, Carol

2016-08-01

Chronic pancreatitis is a significant medical problem that impacts a large number of patients worldwide. In 2014, we developed a disease-specific instrument for the evaluation of quality of life in this group of patients: pancreatitis quality of life instrument (PANQOLI). The goal of this study was to evaluate its psychometric properties: its reliability and its construct validity. This is a cross-sectional multi-center study that involved 12 pancreatic disease centers. Patients who met the inclusion/exclusion criteria for chronic pancreatitis were invited to participate. Those who accepted were asked to complete seven questionnaires/instruments. Only patients who completed the PANQOLI were included in the study. Its reliability and its construct validity were tested. A total of 159 patients completed the PANQOLI and were included in the study. They had a mean age of 49.03, 49% were male, and 84% were Caucasian. Six of the 24 items on the scale were removed because of lack of inter-item correlation, redundancy, or lack of correlation to quality of life issues. The final 18-item scale had excellent reliability (Cronbach's alpha coefficient: 0.914) and excellent construct validity with good correlation to generic quality of life instruments (SF-12 and EORTC QLQ-C30/QLQ-PAN26) and lack of correlation to non-quality of life instruments (MAST and DAST). Through exploratory factor analysis, the PANQOLI was found to consist of four subscales: emotional function scale, role function scale, physical function scale, and "self-worth" scale. PANQOLI is the first disease-specific instrument to be developed and validated for the evaluation of quality of life in chronic pancreatitis patients. It has a unique subscale for "self-worth" that differentiates it from other generic instruments. Studies are currently under way to evaluate its use in other populations not included in this study.

Data Validation for Earth Probe-Total Ozone Mapping Spectrometer

NASA Technical Reports Server (NTRS)

Stanford, John L.

1995-01-01

This presentation represents the final report for the NASA grant project. The goal of this project was to provide scientific analysis to aid in validation fo data sets used in detection of long term global trends of total ozone. Ozone data from the Earth Probe Total Ozone Mapping Spectrometer instrument was compared for validation purposes with features in previous TOMS data. Atmospheric dynamic concepts were used in the analysis. The publications sponsored by the grant are listed along with abstracts.

Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study.

PubMed

Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh

2015-05-01

The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

The development of a Chinese-language instrument to measure social smoking motives among male Taiwanese smokers.

PubMed

Huang, Chih-Ling; Cheng, Chung-Ping; Huang, Hui-Wen

2013-10-01

The purpose of this study was to develop a scale to measure the social smoking motives of adult male smokers using a Chinese social context. Three phases were conducted between February 2006 and May 2009. First, the initial instrument development was guided by a literature review, interviews with smokers, and item analysis. Second, the validity and reliability of the refined scale were tested. The factor structures of the Social Smoking Measures (SSM-12) scale were validated. The final scale consists of 12 items. Two factors that account for 49.2% of the variance emerged from the exploratory factor analysis. Cronbach's alpha was .88, and test-retest reliability was .82. The results of the confirmatory factor analysis indicated that the SSM model was a two-correlated factor. Field testing revealed the SSM-12 to be a reliable and valid Chinese-language instrument to measure social smoking motives, which can be used to guide nursing interventions that support culturally and socially appropriate smoking cessation programs.

Development and Validation of a Questionnaire on Breastfeeding Intentions, Attitudes and Knowledge of a Sample of Croatian Secondary-School Students.

PubMed

Čatipović, Marija; Marković, Martina; Grgurić, Josip

2018-04-27

Validating a questionnaire/instrument before proceeding to the field for data collection is important. An 18-item breastfeeding intention, 39-item attitude and 44-item knowledge questionnaire was validated in a Croatian sample of secondary-school students ( N = 277). For the intentions, principal component analysis (PCA) yielded a four-factor solution with 8 items explaining 68.3% of the total variance. Cronbach’s alpha (0.71) indicated satisfactory internal consistency. For the attitudes, PCA showed a seven-factor structure with 33 items explaining 58.41% of total variance. Cronbach’s alpha (0.87) indicated good internal consistency. There were 13 knowledge questions that were retained after item analysis, showing good internal consistency (KR20 = 0.83). In terms of criterion validity, the questionnaire differentiated between students who received breastfeeding education compared to students who were not educated in breastfeeding. Correlations between intentions and attitudes (r = 0.49), intentions and knowledge (r = 0.29), and attitudes and knowledge (r = 0.38) confirmed concurrent validity. The final instrument is reliable and valid for data collection on breastfeeding. Therefore, the instrument is recommended for evaluation of breastfeeding education programs aimed at upper-grade elementary and secondary school students.

Development and Validation of a Questionnaire on Breastfeeding Intentions, Attitudes and Knowledge of a Sample of Croatian Secondary-School Students

PubMed Central

Marković, Martina; Grgurić, Josip

2018-01-01

Background: Validating a questionnaire/instrument before proceeding to the field for data collection is important. Methods: An 18-item breastfeeding intention, 39-item attitude and 44-item knowledge questionnaire was validated in a Croatian sample of secondary-school students (N = 277). Results: For the intentions, principal component analysis (PCA) yielded a four-factor solution with 8 items explaining 68.3% of the total variance. Cronbach’s alpha (0.71) indicated satisfactory internal consistency. For the attitudes, PCA showed a seven-factor structure with 33 items explaining 58.41% of total variance. Cronbach’s alpha (0.87) indicated good internal consistency. There were 13 knowledge questions that were retained after item analysis, showing good internal consistency (KR20 = 0.83). In terms of criterion validity, the questionnaire differentiated between students who received breastfeeding education compared to students who were not educated in breastfeeding. Correlations between intentions and attitudes (r = 0.49), intentions and knowledge (r = 0.29), and attitudes and knowledge (r = 0.38) confirmed concurrent validity. Conclusions: The final instrument is reliable and valid for data collection on breastfeeding. Therefore, the instrument is recommended for evaluation of breastfeeding education programs aimed at upper-grade elementary and secondary school students. PMID:29702616

A neuropsychological instrument measuring age-related cerebral decline in older drivers: development, reliability, and validity of MedDrive

PubMed Central

Vaucher, Paul; Cardoso, Isabel; Veldstra, Janet L.; Herzig, Daniela; Herzog, Michael; Mangin, Patrice; Favrat, Bernard

2014-01-01

When facing age-related cerebral decline, older adults are unequally affected by cognitive impairment without us knowing why. To explore underlying mechanisms and find possible solutions to maintain life-space mobility, there is a need for a standardized behavioral test that relates to behaviors in natural environments. The aim of the project described in this paper was therefore to provide a free, reliable, transparent, computer-based instrument capable of detecting age-related changes on visual processing and cortical functions for the purposes of research into human behavior in computational transportation science. After obtaining content validity, exploring psychometric properties of the developed tasks, we derived (Study 1) the scoring method for measuring cerebral decline on 106 older drivers aged ≥70 years attending a driving refresher course organized by the Swiss Automobile Association to test the instrument's validity against on-road driving performance (106 older drivers). We then validated the derived method on a new sample of 182 drivers (Study 2). We then measured the instrument's reliability having 17 healthy, young volunteers repeat all tests included in the instrument five times (Study 3) and explored the instrument's psychophysical underlying functions on 47 older drivers (Study 4). Finally, we tested the instrument's responsiveness to alcohol and effects on performance on a driving simulator in a randomized, double-blinded, placebo, crossover, dose-response, validation trial including 20 healthy, young volunteers (Study 5). The developed instrument revealed good psychometric properties related to processing speed. It was reliable (ICC = 0.853) and showed reasonable association to driving performance (R2 = 0.053), and responded to blood alcohol concentrations of 0.5 g/L (p = 0.008). Our results suggest that MedDrive is capable of detecting age-related changes that affect processing speed. These changes nevertheless do not necessarily affect driving behavior. PMID:25346674

Development and study of self-efficacy scale in medication adherence among Iranian patients with hypertension

PubMed Central

Najimi, Arash; Mostafavi, Firoozeh; Sharifirad, Gholamreza; Golshiri, Parastoo

2017-01-01

BACKGROUND: This study was aimed at developing and studying the scale of self-efficacy in adherence to treatment in Iranian patients with hypertension. METHODS: A mix-method study was conducted on the two stages: in the first phase, a qualitative study was done using content analysis through deep and semi-structured interviews. After data analysis, the draft of tool was prepared. Items in the draft were selected based on the extracted concepts. In the second phase, validity and reliability of the instrument were implemented using a quantitative study. The prepared instrument in the first phase was studied among 612 participants. To test the construct validity and internal consistency, exploratory factor analysis and Cronbach's alpha were used, respectively. To study the validity of the final scale, the average score of self-efficacy in patients with controlled hypertension were compared with patients with uncontrolled hypertension. RESULTS: In overall, 16 patients were interviewed. Twenty-six items were developed to assess different concepts of self-efficacy. Concept-related items were extracted from interviews to study the face validity of the tool from patient's point of view. Four items were deleted because scored 0.79 in content validity. The mean of questionnaire content validity was 0.85. Items were collected in two factors with an eigenvalue >1. Four items were deleted with load factor <0.4. Reliability was 0.84 for the entire instrument. CONCLUSION: Self-efficacy scale in patients with hypertension is a valid and reliable instrument that can effectively evaluate the self-efficacy in medication adherence in the management of hypertension. PMID:29114551

Navy Calibration/Validation Protocols and Procedures for Visible and Thermal Satellites: Preparing for NPOESS

DTIC Science & Technology

2007-05-01

difficult but it determines the long-term stability of the sensor. This step includes sensor drift ( spectral response) and spectral (channel...and Navy products using high spectral resolution satellites. This program (Hyperspectral 34 Characterization of the Coastal Zone) is a core NRLSSC...absorption and total attenuation) the standard accepted instrument is the WetLab’s Inc., ac-9, with a higher resolution spectral instrument in final

Noncognitive constructs in graduate admissions: an integrative review of available instruments.

PubMed

Megginson, Lucy

2009-01-01

In the graduate admission process, both cognitive and noncognitive instruments evaluate a candidate's potential success in a program of study. Traditional cognitive measures include the Graduate Record Examination or graduate grade point average, while noncognitive constructs such as personality, attitude, and motivation are generally measured through letters of recommendation, interviews, or personality inventories. Little consensus exists as to what criteria constitute valid and effective measurements of graduate student potential. This integrative review of available tools to measure noncognitive constructs will assist graduate faculty in identifying valid and reliable instruments that will enhance a more holistic assessment of nursing graduate candidates. Finally, as evidence-based practice begins to penetrate academic processes and as graduate faculty realize the predictive significance of noncognitive attributes, faculty can use the information in this integrative review to guide future research.

Initial development and psychometric testing of an instrument to measure the quality of children's end-of-life care.

PubMed

Widger, Kimberley; Tourangeau, Ann E; Steele, Rose; Streiner, David L

2015-01-01

The field of pediatric palliative care is hindered by the lack of a well-defined, reliable, and valid method for measuring the quality of end-of-life care. The study purpose was to develop and test an instrument to measure mothers' perspectives on the quality of care received before, at the time of, and following a child's death. In Phase 1, key components of quality end-of-life care for children were synthesized through a comprehensive review of research literature. These key components were validated in Phase 2 and then extended through focus groups with bereaved parents. In Phase 3, items were developed to assess structures, processes, and outcomes of quality end-of-life care then tested for content and face validity with health professionals. Cognitive testing was conducted through interviews with bereaved parents. In Phase 4, bereaved mothers were recruited through 10 children's hospitals/hospices in Canada to complete the instrument, and psychometric testing was conducted. Following review of 67 manuscripts and 3 focus groups with 10 parents, 141 items were initially developed. The overall content validity index for these items was 0.84 as rated by 7 health professionals. Based on feedback from health professionals and cognitive testing with 6 parents, a 144-item instrument was finalized for further testing. In Phase 4, 128 mothers completed the instrument, 31 of whom completed it twice. Test-retest reliability, internal consistency, and construct validity were demonstrated for six subscales: Connect With Families, Involve Parents, Share Information With Parents, Share Information Among Health Professionals, Support Parents, and Provide Care at Death. Additional items with content validity were grouped in four domains: Support the Child, Support Siblings, Provide Bereavement Follow-up, and Structures of Care. Forty-eight items were deleted through psychometric testing, leaving a 95-item instrument. There is good initial evidence for the reliability and validity of this new quality of end-of-life care instrument as a mechanism for evaluative feedback to health professionals, health systems, and policy makers to improve children's end-of-life care.

The positive mental health instrument: development and validation of a culturally relevant scale in a multi-ethnic Asian population.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Chong, Siow Ann; Abdin, Edimansyah; Orlando Edelen, Maria; Picco, Louisa; Lim, Yee Wei; Phua, Mei Yen; Chua, Boon Yiang; Tee, Joseph Y S; Sherbourne, Cathy

2011-10-31

Instruments to measure mental health and well-being are largely developed and often used within Western populations and this compromises their validity in other cultures. A previous qualitative study in Singapore demonstrated the relevance of spiritual and religious practices to mental health, a dimension currently not included in exiting multi-dimensional measures. The objective of this study was to develop a self-administered measure that covers all key and culturally appropriate domains of mental health, which can be applied to compare levels of mental health across different age, gender and ethnic groups. We present the item reduction and validation of the Positive Mental Health (PMH) instrument in a community-based adult sample in Singapore. Surveys were conducted among adult (21-65 years) residents belonging to Chinese, Malay and Indian ethnicities. Exploratory and confirmatory factor analysis (EFA, CFA) were conducted and items were reduced using item response theory tests (IRT). The final version of the PMH instrument was tested for internal consistency and criterion validity. Items were tested for differential item functioning (DIF) to check if items functioned in the same way across all subgroups. EFA and CFA identified six first-order factor structure (General coping, Personal growth and autonomy, Spirituality, Interpersonal skills, Emotional support, and Global affect) under one higher-order dimension of Positive Mental Health (RMSEA=0.05, CFI=0.96, TLI=0.96). A 47-item self-administered multi-dimensional instrument with a six-point Likert response scale was constructed. The slope estimates and strength of the relation to the theta for all items in each six PMH subscales were high (range:1.39 to 5.69), suggesting good discrimination properties. The threshold estimates for the instrument ranged from -3.45 to 1.61 indicating that the instrument covers entire spectrums for the six dimensions. The instrument demonstrated high internal consistency and had significant and expected correlations with other well-being measures. Results confirmed absence of DIF. The PMH instrument is a reliable and valid instrument that can be used to measure and compare level of mental health across different age, gender and ethnic groups in Singapore.

[Development of a measurement of intellectual capital for hospital nursing organizations].

PubMed

Kim, Eun A; Jang, Keum Seong

2011-02-01

This study was done to develop an instrument for measuring intellectual capital and assess its validity and reliability in identifying the components, human capital, structure capital and customer capital of intellectual capital in hospital nursing organizations. The participants were 950 regular clinical nurses who had worked for over 13 months in 7 medical hospitals including 4 national university hospitals and 3 private university hospitals. The data were collected through a questionnaire survey done from July 2 to August 25, 2009. Data from 906 nurses were used for the final analysis. Data were analyzed using descriptive statistics, Cronbach's alpha coefficients, item analysis, factor analysis (principal component analysis, Varimax rotation) with the SPSS PC+ 17.0 for Windows program. Developing the instrument for measuring intellectual capital in hospital nursing organizations involved a literature review, development of preliminary items, and verification of validity and reliability. The final instrument was in a self-report form on a 5-point Likert scale. There were 29 items on human capital (5 domains), 21 items on customer capital (4 domains), 26 items on structure capital (4 domains). The results of this study may be useful to assess the levels of intellectual capital of hospital nursing organizations.

Designing communication and remote controlling of virtual instrument network system

NASA Astrophysics Data System (ADS)

Lei, Lin; Wang, Houjun; Zhou, Xue; Zhou, Wenjian

2005-01-01

In this paper, a virtual instrument network through the LAN and finally remote control of virtual instruments is realized based on virtual instrument and LabWindows/CVI software platform. The virtual instrument network system is made up of three subsystems. There are server subsystem, telnet client subsystem and local instrument control subsystem. This paper introduced virtual instrument network structure in detail based on LabWindows. Application procedure design of virtual instrument network communication, the Client/the programming mode of the server, remote PC and server communication far realizing, the control power of the workstation is transmitted, server program and so on essential technical were introduced. And virtual instruments network may connect to entire Internet on. Above-mentioned technology, through measuring the application in the electronic measurement virtual instrument network that is already built up, has verified the actual using value of the technology. Experiment and application validate that this design is resultful.

Development of a Survey to Explore Factors Influencing the Adoption of Best Practices for Diabetic Foot Ulcer Offloading.

PubMed

Bleau Lavigne, Maude; Reeves, Isabelle; Sasseville, Marie-Josée; Loignon, Christine

The primary purpose of this study was to develop 2 survey tools to explore factors influencing adoption of best practices for diabetic foot ulcer offloading treatment in primary health care settings. One survey was intended for the patients receiving care for a diabetic foot ulcer in primary health care settings and the other was intended for the health professionals providing treatment. The second purpose of this study was to evaluate the psychometric properties of the 2 surveys. Development and validation of survey instruments. Two surveys were developed using a published guide. Following review of pertinent literature and identification of variables to be measured, a bank of items was developed and pretested to determine clarity of the item and responses. Psychometric testing comprised measurement of content validity index (CVI) and intraclass correlation coefficient (ICC). Only items obtaining satisfactory CVI and ICC scores were included in the final version of the surveys. The final version of the patient survey contained 41 items and the final version of the survey for health care professionals contained 21 items. The patient-intended survey's items demonstrate high content validity scores and satisfactory test-retest reliability scores. The overall CVI score was 0.98. Forty of the 49 items eligible for testing obtain satisfactory ICC scores. One item's test-retest reliability could not be tested but it was retained based on its high CVI. The health professional-intended survey, an overall CVI score of 0.91 but items had lower ICC scores (63%, 31 of the 49 items), did not achieve a satisfactory ICC score for inclusion in the final instrument. This project led to development of 2 instruments designed to identify and explore factors influencing adoption of best practices for diabetic foot ulcer offloading treatment in the primary health care setting. Future research and testing is required to translate these French surveys into English and additional languages, in order to reach a broader population.

Development of a quality-of-life instrument for autoimmune bullous disease: the Autoimmune Bullous Disease Quality of Life questionnaire.

PubMed

Sebaratnam, Deshan F; Hanna, Anna Marie; Chee, Shien-ning; Frew, John W; Venugopal, Supriya S; Daniel, Benjamin S; Martin, Linda K; Rhodes, Lesley M; Tan, Jeremy Choon Kai; Wang, Charles Qian; Welsh, Belinda; Nijsten, Tamar; Murrell, Dédée F

2013-10-01

Quality-of-life (QOL) evaluation is an increasingly important outcome measure in dermatology, with disease-specific QOL instruments being the most sensitive to changes in disease status. To develop a QOL instrument specific to autoimmune bullous disease (AIBD). A comprehensive item generation process was used to build a 45-item pilot Autoimmune Bullous Disease Quality of Life (ABQOL) questionnaire, distributed to 70 patients with AIBD. Experts in bullous disease refined the pilot ABQOL before factor analysis was performed to yield the final ABQOL questionnaire of 17 questions. We evaluated validity and reliability across a range of indices. Australian dermatology outpatient clinics and private dermatology practices. PATIENTS AND EXPOSURE: Patients with a histological diagnosis of AIBD. The development of an AIBD-specific QOL instrument. Face and content validity were established through the comprehensive patient interview process and expert review. In terms of convergent validity, the ABQOL was found to have a moderate correlation with scores on the Dermatology Life Quality Index (R = 0.63) and the General Health subscale of the 36-Item Short Form Health Survey (R = 0.69; P = .009) and low correlation with the Pemphigus Disease Area Index (R = 0.42) and Autoimmune Bullous Disease Skin Disorder Intensity Score (R = 0.48). In terms of discriminant validity, the ABQOL was found to be more sensitive than the Dermatology Life Quality Index (P = .02). The ABQOL was also found to be a reliable instrument evaluated by internal consistency (Cronbach α coefficient, 0.84) and test-retest reliability (mean percentage variation, 0.92). The ABQOL has been shown to be a valid and reliable instrument that may serve as an end point in clinical trials. Future work should include incorporating patient weighting on questions to further increase content validity and translation of the measure to other languages. anzctr.org.au Identifier: ACTRN12612000750886.

Validation of Ionospheric Measurements from the International Space Station (ISS)

NASA Technical Reports Server (NTRS)

Coffey, Victoria; Minow, Joseph; Wright, Kenneth

2009-01-01

The International Space Station orbit provides an ideal platform for in-situ studies of space weather effects on the mid and low-latitude F-2 region ionosphere. The Floating Potential Measurement Unit (FPMU) operating on the ISS since Aug 2006, is a suite of plasma instruments: a Floating Potential Probe (FPP), a Plasma Impedance Probe (PIP), a Wide-sweep Langmuir Probe (WLP), and a Narrow-Sweep Langmuir Probe. This instrument package provides a new opportunity for collaborative multi-instrument studies of the F-region ionosphere during both quiet and disturbed periods. This presentation first describes the operational parameters for each of the FPMU probes and shows examples of an intra-instrument validation. We then show comparisons with the plasma density and temperature measurements derived from the TIMED GUVI ultraviolet imager, the Millstone Hill ground based incoherent scatter radar, and DIAS digisondes, Finally we show one of several observations of night-time equatorial density holes demonstrating the capabilities of the probes for monitoring mid and low latitude plasma processes.

Factor analysis methods and validity evidence: A systematic review of instrument development across the continuum of medical education

NASA Astrophysics Data System (ADS)

Wetzel, Angela Payne

Previous systematic reviews indicate a lack of reporting of reliability and validity evidence in subsets of the medical education literature. Psychology and general education reviews of factor analysis also indicate gaps between current and best practices; yet, a comprehensive review of exploratory factor analysis in instrument development across the continuum of medical education had not been previously identified. Therefore, the purpose for this study was critical review of instrument development articles employing exploratory factor or principal component analysis published in medical education (2006--2010) to describe and assess the reporting of methods and validity evidence based on the Standards for Educational and Psychological Testing and factor analysis best practices. Data extraction of 64 articles measuring a variety of constructs that have been published throughout the peer-reviewed medical education literature indicate significant errors in the translation of exploratory factor analysis best practices to current practice. Further, techniques for establishing validity evidence tend to derive from a limited scope of methods including reliability statistics to support internal structure and support for test content. Instruments reviewed for this study lacked supporting evidence based on relationships with other variables and response process, and evidence based on consequences of testing was not evident. Findings suggest a need for further professional development within the medical education researcher community related to (1) appropriate factor analysis methodology and reporting and (2) the importance of pursuing multiple sources of reliability and validity evidence to construct a well-supported argument for the inferences made from the instrument. Medical education researchers and educators should be cautious in adopting instruments from the literature and carefully review available evidence. Finally, editors and reviewers are encouraged to recognize this gap in best practices and subsequently to promote instrument development research that is more consistent through the peer-review process.

[Validation of an instrument to measure health-related quality of life in Chilean children and adolescents].

PubMed

Sepúlveda P, Rodrigo; Molina G, Temístocles; Molina C, Ramiro; Martínez N, Vania; González A, Electra; L, Myriam George; Montaño E, Rosa; Hidalgo-Rasmussen, Carlos

2013-10-01

KIDSCREEN-52 is an instrument to assess health related quality of life in children and adolescents. To culturally adapt and validate the KIDSCREEN-52 questionnaire in Chileans. Two independent translations from the English Spanish language were conciliated and retranslated to English. The conciliated version was tested during a cognitive interview to adolescents of different socioeconomic levels. The final version was validated in 7,910 school attending adolescents. In the cross-cultural adaptation, 50 of the 52 items presented low or medium levels of difficulty and a high semantic equivalence. Distribution according to gender, grades and types of schools was similar to the sample. Single ages were not affected by sex distribution. The Confirmatory Factor Analyses were: X² (1229) = 20996.7, Root Mean Square Error of Approximation = .045 and Comparative Fit Index = .96. The instrument had a Cronbach's alpha of .93. The domains had scores over 0.70 points, with the exception of the "Selfperception" domain, with a score of 0.62. The Chilean version of KIDSCREEN-52 is culturally appropriate and semantically equivalent in its English and Spanish versions (from Spain). Its reliability and validity were adequate.

Ecological validity and clinical utility of Patient-Reported Outcomes Measurement Information System (PROMIS®) instruments for detecting premenstrual symptoms of depression, anger, and fatigue.

PubMed

Junghaenel, Doerte U; Schneider, Stefan; Stone, Arthur A; Christodoulou, Christopher; Broderick, Joan E

2014-04-01

This study examined the ecological validity and clinical utility of NIH Patient Reported-Outcomes Measurement Information System (PROMIS®) instruments for anger, depression, and fatigue in women with premenstrual symptoms. One-hundred women completed daily diaries and weekly PROMIS assessments over 4weeks. Weekly assessments were administered through Computerized Adaptive Testing (CAT). Weekly CATs and corresponding daily scores were compared to evaluate ecological validity. To test clinical utility, we examined if CATs could detect changes in symptom levels, if these changes mirrored those obtained from daily scores, and if CATs could identify clinically meaningful premenstrual symptom change. PROMIS CAT scores were higher in the pre-menstrual than the baseline (ps<.0001) and post-menstrual (ps<.0001) weeks. The correlations between CATs and aggregated daily scores ranged from .73 to .88 supporting ecological validity. Mean CAT scores showed systematic changes in accordance with the menstrual cycle and the magnitudes of the changes were similar to those obtained from the daily scores. Finally, Receiver Operating Characteristic (ROC) analyses demonstrated the ability of the CATs to discriminate between women with and without clinically meaningful premenstrual symptom change. PROMIS CAT instruments for anger, depression, and fatigue demonstrated validity and utility in premenstrual symptom assessment. The results provide encouraging initial evidence of the utility of PROMIS instruments for the measurement of affective premenstrual symptoms. Copyright © 2014 Elsevier Inc. All rights reserved.

Development and validation of the Simulation Learning Effectiveness Inventory.

PubMed

Chen, Shiah-Lian; Huang, Tsai-Wei; Liao, I-Chen; Liu, Chienchi

2015-10-01

To develop and psychometrically test the Simulation Learning Effectiveness Inventory. High-fidelity simulation helps students develop clinical skills and competencies. Yet, reliable instruments measuring learning outcomes are scant. A descriptive cross-sectional survey was used to validate psychometric properties of the instrument measuring students' perception of stimulation learning effectiveness. A purposive sample of 505 nursing students who had taken simulation courses was recruited from a department of nursing of a university in central Taiwan from January 2010-June 2010. The study was conducted in two phases. In Phase I, question items were developed based on the literature review and the preliminary psychometric properties of the inventory were evaluated using exploratory factor analysis. Phase II was conducted to evaluate the reliability and validity of the finalized inventory using confirmatory factor analysis. The results of exploratory and confirmatory factor analyses revealed the instrument was composed of seven factors, named course arrangement, equipment resource, debriefing, clinical ability, problem-solving, confidence and collaboration. A further second-order analysis showed comparable fits between a three second-order factor (preparation, process and outcome) and the seven first-order factor models. Internal consistency was supported by adequate Cronbach's alphas and composite reliability. Convergent and discriminant validities were also supported by confirmatory factor analysis. The study provides evidence that the Simulation Learning Effectiveness Inventory is reliable and valid for measuring student perception of learning effectiveness. The instrument is helpful in building the evidence-based knowledge of the effect of simulation teaching on students' learning outcomes. © 2015 John Wiley & Sons Ltd.

Benefits of an automated GLP final report preparation software solution.

PubMed

Elvebak, Larry E

2011-07-01

The final product of analytical laboratories performing US FDA-regulated (or GLP) method validation and bioanalysis studies is the final report. Although there are commercial-off-the-shelf (COTS) software/instrument systems available to laboratory managers to automate and manage almost every aspect of the instrumental and sample-handling processes of GLP studies, there are few software systems available to fully manage the GLP final report preparation process. This lack of appropriate COTS tools results in the implementation of rather Byzantine and manual processes to cobble together all the information needed to generate a GLP final report. The manual nature of these processes results in the need for several iterative quality control and quality assurance events to ensure data accuracy and report formatting. The industry is in need of a COTS solution that gives laboratory managers and study directors the ability to manage as many portions as possible of the GLP final report writing process and the ability to generate a GLP final report with the click of a button. This article describes the COTS software features needed to give laboratory managers and study directors such a solution.

Development and initial validation of the Pharmacist Frequency of Interprofessional Collaboration Instrument (FICI-P) in primary care.

PubMed

Van, Connie; Costa, Daniel; Mitchell, Bernadette; Abbott, Penny; Krass, Ines

2012-01-01

Existing validated measures of pharmacist-physician collaboration focus on measuring attitudes toward collaboration and do not measure frequency of collaborative interactions. To develop and validate an instrument to measure the frequency of collaboration between pharmacists and general practitioners (GPs) from the pharmacist's perspective. An 11-item Pharmacist Frequency of Interprofessional Collaboration Instrument (FICI-P) was developed and administered to 586 pharmacists in 8 divisions of general practice in New South Wales, Australia. The initial items were informed by a review of the literature in addition to interviews of pharmacists and GPs. Items were subjected to principal component and Rasch analyses to determine each item's and the overall measure's psychometric properties and for any needed refinements. Two hundred and twenty four (38%) of pharmacist surveys were completed and returned. Principal component analysis suggested removal of 1 item for a final 1-factor solution. The refined 10-item FICI-P demonstrated internal consistency reliability at Cronbach's alpha=0.90. After collapsing the original 5-point response scale to a 4-point response scale, the refined FICI-P demonstrated fit to the Rasch model. Criterion validity of the FICI-P was supported by the correlation of FICI-P scores with scores on a previously validated Physician-Pharmacist Collaboration Instrument. Validity was also supported by predicted differences in FICI-P scores between subgroups of respondents stratified on age, colocation with GPs, and interactions during the intern-training period. The refined 10-item FICI-P was shown to have good internal consistency, criterion validity, and fit to the Rasch model. The creation of such a tool may allow for the measure of impact in the evaluation of interventions designed to improve interprofessional collaboration between GPs and pharmacists. Copyright © 2012 Elsevier Inc. All rights reserved.

Validation of the Physician Teaching Motivation Questionnaire (PTMQ).

PubMed

Dybowski, Christoph; Harendza, Sigrid

2015-10-02

Physicians play a major role as teachers in undergraduate medical education. Studies indicate that different forms and degrees of motivation can influence work performance in general and that teachers' motivation to teach can influence students' academic achievements in particular. Therefore, the aim of this study was to develop and to validate an instrument measuring teaching motivations in hospital-based physicians. We chose self-determination theory as a theoretical framework for item and scale development. It distinguishes between different dimensions of motivation depending on the amount of self-regulation and autonomy involved and its empirical evidence has been demonstrated in other areas of research. To validate the new instrument (PTMQ = Physician Teaching Motivation Questionnaire), we used data from a sample of 247 physicians from internal medicine and surgery at six German medical faculties. Structural equation modelling was conducted to confirm the factorial structure, correlation analyses and linear regressions were performed to examine concurrent and incremental validity. Structural equation modelling confirmed a good global fit for the factorial structure of the final instrument (RMSEA = .050, TLI = .957, SRMR = .055, CFI = .966). Cronbach's alphas indicated good internal consistencies for all scales (α = .75 - .89) except for the identified teaching motivation subscale with an acceptable internal consistency (α = .65). Tests of concurrent validity with global work motivation, perceived teaching competence, perceived teaching involvement and voluntariness of lesson allocation delivered theory-consistent results with slight deviations for some scales. Incremental validity over global work motivation in predicting perceived teaching involvement was also confirmed. Our results indicate that the PTMQ is a reliable, valid and therefore suitable instrument for assessing physicians' teaching motivation.

The Italian validation of the Salford-Scott Nursing Values Questionnaire.

PubMed

Mecugni, Daniela; Albinelli, Patrizia; Pellegrin, Joellemarie; Finotto, Stefano

2015-03-01

To properly direct nursing training and to improve the professional practice to become more effective, it is important to understand students' values. Literature review has shown that there have been changes in students' values in the last 20 years. In contemporary students, a general decrease in altruism has been observed, but also a larger appreciation for honesty toward patients has been declared. The analyzed literature did not find validated tools available in Italian that explore personal and professional values of nursing students. This study was an Italian linguistic and cultural adaptation of a research tool. The authors aimed to validate, for the Italian context, the Salford-Scott Nursing Values Questionnaire, enhanced by Johnson to explore the nursing profession's values. The Beaton Model was used as well as Valmi's. These models require five phases, with the goal of producing a pre-final version of the instrument for it to then be administered to a sample of the target and expert population. The study was approved by the Council of the Nursing Degree University course of the Modena and Reggio Emilia University, Reggio Emilia site, and the identity of the subjects was protected at every moment of the testing. Face validation was achieved since the clarity percentile for each item was 100%. Content validity was also reached, measured from the content validity index and the scale validity index. The study has confirmed the reliability of the instrument's internal consistence with a value of Cronbach's alpha on 0.95 of total of items. The reliability of the test-retest confirms the stability of the instrument in time (r = 0.908; p = 0.01). The study concludes that the instrument is ready to be administered to the target population, a sample group of nursing students. © The Author(s) 2014.

The challenges of developing an instrument to assess health provider motivation at primary care level in rural Burkina Faso, Ghana and Tanzania

PubMed Central

Prytherch, Helen; Leshabari, Melkidezek T.; Wiskow, Christiane; Aninanya, Gifty A.; Kakoko, Deodatus C.V.; Kagoné, Moubassira; Burghardt, Juliane; Kynast-Wolf, Gisela; Marx, Michael; Sauerborn, Rainer

2012-01-01

Background The quality of health care depends on the competence and motivation of the health workers that provide it. In the West, several tools exist to measure worker motivation, and some have been applied to the health sector. However, none have been validated for use in sub-Saharan Africa. The complexity of such tools has also led to concerns about their application at primary care level. Objective To develop a common instrument to monitor any changes in maternal and neonatal health (MNH) care provider motivation resulting from the introduction of pilot interventions in rural, primary level facilities in Ghana, Burkina Faso, and Tanzania. Design Initially, a conceptual framework was developed. Based upon this, a literature review and preliminary qualitative research, an English-language instrument was developed and validated in an iterative process with experts from the three countries involved. The instrument was then piloted in Ghana. Reliability testing and exploratory factor analysis were used to produce a final, parsimonious version. Results and discussion This paper describes the actual process of developing the instrument. Consequently, the concepts and items that did not perform well psychometrically at pre-test are first presented and discussed. The final version of the instrument, which comprises 42 items for self-assessment and eight for peer-assessment, is then shown. This is followed by a presentation and discussion of the findings from first use of the instrument with MNH providers from 12 rural, primary level facilities in each of the three countries. Conclusions It is possible to undertake work of this nature at primary health care level, particularly if the instruments are kept as straightforward as possible and well introduced. However, their development requires very lengthy preparatory periods. The effort needed to adapt such instruments for use in different countries within the region of sub-Saharan Africa should not be underestimated. PMID:23043816

Final Report of the Vocational Assessment Project, 1979-80.

ERIC Educational Resources Information Center

Rutgers, The State Univ., New Brunswick, NJ. School of Medicine.

To improve vocational rehabilitation programs for schizophrenic persons, a project sought to design an effective assessment strategy. Inactive records of schizophrenic clients at New Jersey sheltered workshops were examined to determine validity and reliability of assessment instruments being used. General Aptitude Test Battery (GATB) profiles of…

Can we measure patients' perception during dental impressions? The Burdens in Dental Impression-Making Questionnaire - BiDIM-Q.

PubMed

Tsirogiannis, Panagiotis; Neophytou, Sophia; Reul, Anika; Heydecke, Guido; Reissmann, Daniel R

2017-01-01

To develop a reliable and valid instrument for the comprehensive assessment of patients' burdens during dental impression making, the Burdens in Dental Impression Making Questionnaire, BiDIM-Q. The item pool was generated in a convenience sample of 20 prosthodontic patients using semi-structured face-to-face interviews. The final instrument was tested in 145 consecutively recruited patients, and psychometric properties of the BiDIM-Q were determined. Four different impression materials were used according to the manufacturers' instructions and indications: alginate, c-silicone, polyvinylsiloxane, and polyether. The final BiDIM-Q consisting of 12 items showed sufficient reliability, indicated by Cronbach's alpha of .82 and an average inter-item correlation of .29. Validity was supported by Pearson correlation coefficients for the correlation between the instrument's total score with the patients' overall satisfaction rating (r=.63), and by the correlation matrix for the correlations of the patients' perceptions with the practitioners' satisfaction ratings. Overall, patient perceived burdens were low with highest burdens observed when using polyether in partially dentate patients for pick-up impressions, while lowest burdens were reported when using c-silicone for impressions of edentulous jaws. The BiDIM-Q is a reliable and valid tool for assessing patient-based process-related quality of care in dentistry allowing a deeper insight into patients' perspective during dental impression making. Copyright © 2016 Japan Prosthodontic Society. Published by Elsevier Ltd. All rights reserved.

Development and Psychometric Properties of the Nursing Critical Thinking in Clinical Practice Questionnaire.

PubMed

Zuriguel-Pérez, Esperanza; Falcó-Pegueroles, Anna; Roldán-Merino, Juan; Agustino-Rodriguez, Sandra; Gómez-Martín, Maria Del Carmen; Lluch-Canut, Maria Teresa

2017-08-01

A complex healthcare environment, with greater need for care based on the patient and evidence-based practice, are factors that have contributed to the increased need for critical thinking in professional competence. At the theoretical level, Alfaro-LeFevre () put forward a model of critical thinking made up of four components. And although these explain the construct, instruments for their empirical measurement are lacking. The purpose of the study was to develop and validate the psychometric properties of an instrument, the Nursing Critical Thinking in Clinical Practice Questionnaire (N-CT-4 Practice), designed to evaluate the critical thinking abilities of nurses in the clinical setting. A cross-sectional survey design was used. A pool of items was generated for evaluation by a panel of experts who considered their validity for the new instrument, which was finally made up of 109 items. Following this, validation was carried out using a sample of 339 nurses at a hospital in Barcelona, Spain. Reliability was determined by means of internal consistency and test-retest stability over time, although the validity of the construct was assessed by means of confirmatory factor analysis. The content validity index of the N-CT-4 Practice was .85. Cronbach's alpha coefficient for the whole instrument was .96. The intraclass correlation coefficient was .77. Confirmatory factor analysis showed that the instrument was in line with the four-dimensional model proposed by Alfaro-LeFevre (). The psychometric properties of theN-CT-4 Practice uphold its potential for use in measuring critical thinking and in future research related with the examination of critical thinking. © 2017 The Authors Worldviews on Evidence-Based Nursing published by Wiley Periodicals, Inc. on behalf of Sigma Theta Tau International The Honor Society of Nursing.

Quality of prenatal care questionnaire: instrument development and testing.

PubMed

Heaman, Maureen I; Sword, Wendy A; Akhtar-Danesh, Noori; Bradford, Amanda; Tough, Suzanne; Janssen, Patricia A; Young, David C; Kingston, Dawn A; Hutton, Eileen K; Helewa, Michael E

2014-06-03

Utilization indices exist to measure quantity of prenatal care, but currently there is no published instrument to assess quality of prenatal care. The purpose of this study was to develop and test a new instrument, the Quality of Prenatal Care Questionnaire (QPCQ). Data for this instrument development study were collected in five Canadian cities. Items for the QPCQ were generated through interviews with 40 pregnant women and 40 health care providers and a review of prenatal care guidelines, followed by assessment of content validity and rating of importance of items. The preliminary 100-item QPCQ was administered to 422 postpartum women to conduct item reduction using exploratory factor analysis. The final 46-item version of the QPCQ was then administered to another 422 postpartum women to establish its construct validity, and internal consistency and test-retest reliability. Exploratory factor analysis reduced the QPCQ to 46 items, factored into 6 subscales, which subsequently were validated by confirmatory factor analysis. Construct validity was also demonstrated using a hypothesis testing approach; there was a significant positive association between women's ratings of the quality of prenatal care and their satisfaction with care (r = 0.81). Convergent validity was demonstrated by a significant positive correlation (r = 0.63) between the "Support and Respect" subscale of the QPCQ and the "Respectfulness/Emotional Support" subscale of the Prenatal Interpersonal Processes of Care instrument. The overall QPCQ had acceptable internal consistency reliability (Cronbach's alpha = 0.96), as did each of the subscales. The test-retest reliability result (Intra-class correlation coefficient = 0.88) indicated stability of the instrument on repeat administration approximately one week later. Temporal stability testing confirmed that women's ratings of their quality of prenatal care did not change as a result of giving birth or between the early postpartum period and 4 to 6 weeks postpartum. The QPCQ is a valid and reliable instrument that will be useful in future research as an outcome measure to compare quality of care across geographic regions, populations, and service delivery models, and to assess the relationship between quality of care and maternal and infant health outcomes.

Nursing Care Interpersonal Relationship Questionnaire: elaboration and validation.

PubMed

Borges, José Wicto Pereira; Moreira, Thereza Maria Magalhães; Andrade, Dalton Franscisco de

2018-01-08

to elaborate an instrument for the measurement of the interpersonal relationship in nursing care through the Item Response Theory, and the validation thereof. methodological study, which followed the three poles of psychometry: theoretical, empirical and analytical. The Nursing Care Interpersonal Relationship Questionnaire was developed in light of the Imogene King's Interpersonal Conceptual Model and the psychometric properties were studied through the Item Response Theory in a sample of 950 patients attended in Primary, Secondary and Tertiary Health Care. the final instrument consisted of 31 items, with Cronbach's alpha of 0.90 and McDonald's Omega of 0.92. The parameters of the Item Response Theory demonstrated high discrimination in 28 items, being developed a five-level interpretive scale. At the first level, the communication process begins, gaining a wealth of interaction. Subsequent levels demonstrate qualitatively the points of effectiveness of the interpersonal relationship with the involvement of behaviors related to the concepts of transaction and interaction, followed by the concept of role. the instrument was created and proved to be consistent to measure interpersonal relationship in nursing care, as it presented adequate reliability and validity parameters.

Development and content validation of performance assessments for endoscopic third ventriculostomy.

PubMed

Breimer, Gerben E; Haji, Faizal A; Hoving, Eelco W; Drake, James M

2015-08-01

This study aims to develop and establish the content validity of multiple expert rating instruments to assess performance in endoscopic third ventriculostomy (ETV), collectively called the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). The important aspects of ETV were identified through a review of current literature, ETV videos, and discussion with neurosurgeons, fellows, and residents. Three assessment measures were subsequently developed: a procedure-specific checklist (CL), a CL of surgical errors, and a global rating scale (GRS). Neurosurgeons from various countries, all identified as experts in ETV, were then invited to participate in a modified Delphi survey to establish the content validity of these instruments. In each Delphi round, experts rated their agreement including each procedural step, error, and GRS item in the respective instruments on a 5-point Likert scale. Seventeen experts agreed to participate in the study and completed all Delphi rounds. After item generation, a total of 27 procedural CL items, 26 error CL items, and 9 GRS items were posed to Delphi panelists for rating. An additional 17 procedural CL items, 12 error CL items, and 1 GRS item were added by panelists. After three rounds, strong consensus (>80% agreement) was achieved on 35 procedural CL items, 29 error CL items, and 10 GRS items. Moderate consensus (50-80% agreement) was achieved on an additional 7 procedural CL items and 1 error CL item. The final procedural and error checklist contained 42 and 30 items, respectively (divided into setup, exposure, navigation, ventriculostomy, and closure). The final GRS contained 10 items. We have established the content validity of three ETV assessment measures by iterative consensus of an international expert panel. Each measure provides unique assessment information and thus can be used individually or in combination, depending on the characteristics of the learner and the purpose of the assessment. These instruments must now be evaluated in both the simulated and operative settings, to determine their construct validity and reliability. Ultimately, the measures contained in the NEVAT may prove suitable for formative assessment during ETV training and potentially as summative assessment measures during certification.

A Validation Study of the Impression Replica Technique.

PubMed

Segerström, Sofia; Wiking-Lima de Faria, Johanna; Braian, Michael; Ameri, Arman; Ahlgren, Camilla

2018-04-17

To validate the well-known and often-used impression replica technique for measuring fit between a preparation and a crown in vitro. The validation consisted of three steps. First, a measuring instrument was validated to elucidate its accuracy. Second, a specimen consisting of male and female counterparts was created and validated by the measuring instrument. Calculations were made for the exact values of three gaps between the male and female. Finally, impression replicas were produced of the specimen gaps and sectioned into four pieces. The replicas were then measured with the use of a light microscope. The values received from measuring the specimen were then compared with the values received from the impression replicas, and the technique was thereby validated. The impression replica technique overvalued all measured gaps. Depending on location of the three measuring sites, the difference between the specimen and the impression replicas varied from 47 to 130 μm. The impression replica technique overestimates gaps within the range of 2% to 11%. The validation of the replica technique enables the method to be used as a reference when testing other methods for evaluating fit in dentistry. © 2018 by the American College of Prosthodontists.

Development and psychometric evaluation of the Dialysis patient-perceived Exercise Benefits and Barriers Scale.

PubMed

Zheng, Jing; You, Li-Ming; Lou, Tan-Qi; Chen, Nian-Chang; Lai, De-Yuan; Liang, Yan-Yi; Li, Ying-Na; Gu, Ying-Ming; Lv, Shao-Fen; Zhai, Cui-Qiu

2010-02-01

Perceptions of exercise benefits and barriers affect exercise behavior. Because of the clinical course and treatment, dialysis patients differ from the general population in their perceptions of exercise benefits and barriers, especially the latter. At present, no valid instruments for assessing perceived exercise benefits and barriers in dialysis patients are available. Our goal was to develop and test the psychometric properties of the Dialysis patient-perceived Exercise Benefits and Barriers Scale (DPEBBS). A literature review and two focus groups were conducted to generate the initial item pool. An expert panel examined the content validity. Then, 269 Chinese hemodialysis patients were recruited by convenience sampling. Exploratory and confirmatory factor analyses were used to test construct validity. Finally, internal consistency and test-retest reliability were assessed. The expert panel determined that the content validity index was satisfactory. The final 24-item scale consisted of six factors explaining 57% of the total variance in the data. Confirmative factor analysis supported the six-factor structure and a higher-order model. Cronbach's alpha was 0.87 for the total scale, and 0.84 for test-retest reliability. The DPEBBS was a valid and reliable instrument for evaluating dialysis patients' perceived benefits and barriers to exercise. The application value of this scale remains to be investigated by increasing the sample size and evaluating patients undergoing different dialysis modalities and coming from different regions and cultural backgrounds. Copyright 2009 Elsevier Ltd. All rights reserved.

Development of the Human Factors Skills for Healthcare Instrument: a valid and reliable tool for assessing interprofessional learning across healthcare practice settings.

PubMed

Reedy, Gabriel B; Lavelle, Mary; Simpson, Thomas; Anderson, Janet E

2017-10-01

A central feature of clinical simulation training is human factors skills, providing staff with the social and cognitive skills to cope with demanding clinical situations. Although these skills are critical to safe patient care, assessing their learning is challenging. This study aimed to develop, pilot and evaluate a valid and reliable structured instrument to assess human factors skills, which can be used pre- and post-simulation training, and is relevant across a range of healthcare professions. Through consultation with a multi-professional expert group, we developed and piloted a 39-item survey with 272 healthcare professionals attending training courses across two large simulation centres in London, one specialising in acute care and one in mental health, both serving healthcare professionals working across acute and community settings. Following psychometric evaluation, the final 12-item instrument was evaluated with a second sample of 711 trainees. Exploratory factor analysis revealed a 12-item, one-factor solution with good internal consistency (α=0.92). The instrument had discriminant validity, with newly qualified trainees scoring significantly lower than experienced trainees ( t (98)=4.88, p<0.001) and was sensitive to change following training in acute and mental health settings, across professional groups (p<0.001). Confirmatory factor analysis revealed an adequate model fit (RMSEA=0.066). The Human Factors Skills for Healthcare Instrument provides a reliable and valid method of assessing trainees' human factors skills self-efficacy across acute and mental health settings. This instrument has the potential to improve the assessment and evaluation of human factors skills learning in both uniprofessional and interprofessional clinical simulation training.

Toward a Measure of Accountability in Nursing: A Three-Stage Validation Study.

PubMed

Drach-Zahavy, Anat; Leonenko, Marina; Srulovici, Einav

2018-06-04

To develop and psychometrically evaluate a three-dimensional questionnaire suitable for evaluating personal and organizational accountability in nurses. Accountability is defined as a three-dimensional value, directing professionals to take responsibility for their decisions and actions, to be willing to explain them (transparency) and to be judged according to society's accepted values (answerability). Despite the relatively clear definition, measurement of accountability lags well behind. Existing self-report questionnaires do not fully capture the complexity of the concept; nor do they capture the different sources of accountability (e.g., personal accountability, organizational accountability). A three-stage measure development. Data were collected during 2015-2016. In Phase 1, an initial database of items (N = 74) was developed, based on literature review and qualitative study, establishing face and content validity. In Phase 2, the face, content, construct and criterion-related validity of the initial questionnaires (19 items for personal and organizational accountability questionnaire) was established with a sample of 229 nurses. In Phase 3, the final questionnaires (19 items each) were validated with a new sample of 329 nurses and established construct validity. The final version of the instruments comprised 19 items, suitable for assessing personal and organizational accountability. The questionnaire referred to the dimensions of responsibility, transparency and answerability. The findings established the instrument's content, construct and criterion-related validity, as well as good internal reliability. The questionnaire portrays accountability in nursing, by capturing nurses' subjective perceptions of accountability dimensions (responsibility, transparency, answerability), as demonstrated by personal and organizational values. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

System-Level Experimental Validations for Supersonic Commercial Transport Aircraft Entering Service in the 2018-2020 Time Period

NASA Technical Reports Server (NTRS)

Magee, Todd E.; Wilcox, Peter A.; Fugal, Spencer R.; Acheson, Kurt E.; Adamson, Eric E.; Bidwell, Alicia L.; Shaw, Stephen G.

2013-01-01

This report describes the work conducted by The Boeing Company under American Recovery and Reinvestment Act (ARRA) and NASA funding to experimentally validate the conceptual design of a supersonic airliner feasible for entry into service in the 2018 to 2020 timeframe (NASA N+2 generation). The report discusses the design, analysis and development of a low-boom concept that meets aggressive sonic boom and performance goals for a cruise Mach number of 1.8. The design is achieved through integrated multidisciplinary optimization tools. The report also describes the detailed design and fabrication of both sonic boom and performance wind tunnel models of the low-boom concept. Additionally, a description of the detailed validation wind tunnel testing that was performed with the wind tunnel models is provided along with validation comparisons with pretest Computational Fluid Dynamics (CFD). Finally, the report describes the evaluation of existing NASA sonic boom pressure rail measurement instrumentation and a detailed description of new sonic boom measurement instrumentation that was constructed for the validation wind tunnel testing.

Validation to Spanish of the Caring Assessment Tool (CAT-V)

PubMed Central

Ayuso, Rosa María Fernández; Velázquez, Juan Manuel Morillo; Ayuso, David Fernández; de la Torre-Montero, Julio César

2017-01-01

Resume Objective: to translate and validate to Spanish the Caring Assessment Scale tool, CAT-V, by Joanne Duffy, within the framework of Jean Watson; as a secondary objective, it is proposed to evaluate its psychometric properties. There are tools designed to measure the patient’s perception of provided cares, including CAT-V, the subject of our interest, in a way that it can be used in Spanish-speaking patients. Methods: to meet the objectives, it was performed sequential translation and retro-translation of the scale to be validated, through a standardized procedure. The final version of that scale was validated in a sample of 349 patients from four public and two private hospitals in Madrid, Spain. Results: The instrument was translated and validated with high internal consistency (Cronbach’s alpha .953). The subsequent factor analysis revealed a three-factor structure, not coincident with the data from the US population. Conclusion: it is considered that the translation of CAT-V is a suitable instrument to be used in the evaluation of patient care in Ibero-american health centers whose language is Spanish. PMID:29069268

Subjective health literacy: Development of a brief instrument for school-aged children.

PubMed

Paakkari, Olli; Torppa, Minna; Kannas, Lasse; Paakkari, Leena

2016-12-01

The present paper focuses on the measurement of health literacy (HL), which is an important determinant of health and health behaviours. HL starts to develop in childhood and adolescence; hence, there is a need for instruments to monitor HL among younger age groups. These instruments are still rare. The aim of the project reported here was, therefore, to develop a brief, multidimensional, theory-based instrument to measure subjective HL among school-aged children. The development of the instrument covered four phases: item generation based on a conceptual framework; a pilot study ( n = 405); test-retest ( n = 117); and construction of the instrument ( n = 3853). All the samples were taken from Finnish 7th and 9th graders. Initially, 65 items were generated, of which 32 items were selected for the pilot study. After item reduction, the instrument contained 16 items. The test-retest phase produced estimates of stability. In the final phase a 10-item instrument was constructed, referred to as Health Literacy for School-Aged Children (HLSAC). The instrument exhibited a high Cronbach alpha (0.93), and included two items from each of the five predetermined theoretical components (theoretical knowledge, practical knowledge, critical thinking, self-awareness, citizenship). The iterative and validity-driven development process made it possible to construct a brief multidimensional HLSAC instrument. Such instruments are suitable for large-scale studies, and for use with children and adolescents. Validation will require further testing for use in other countries.

[Validity of an instrument for assessing food consumption, food habits and cooking skills in 8-11 years old students].

PubMed

Lera, Lydia; Fretes, Gabriela; González, Carmen Gloria; Salinas, Judith; Vio del Rio, Fernando

2015-05-01

An instrument to measure food knowledge, food consumption, cooking skills, food habits and food expenses at school is necessary to assess changes in food practices. To validate an instrument to measure changes in food knowledge, food consumption, cooking skills, food habits and food expenses in Chilean school children 8 - 11 years from third to fifth grade. A validation of a questionnaire with 42 questions was conducted in two stages: the first to assess temporal stability, concordance and internal consistency in 45 children. The second one to apply the survey, modified with the results of the first stage, in 90 children assessing internal consistency. The first survey with 42 questions showed a reasonable temporal stability, concordance and internal consistency for cooking skills, habits and food expenditure at school. Internal consistency was good for food consumption, but not so good for food knowledge. In the final validation with 90 children, there was good consistency for food consumption but bad for food knowledge. Besides, children with cooking skills ate more healthy food and those who expended more money at school, consumed less healthy food. Food knowledge questions were eliminated from the instrument, which was elaborated with 28 questions about food consumption, cooking skills, food habits and food expenses at school. This instrument is useful to assess changes in food and nutrition education interventions in 8 -11 years children, in particular to measure cooking skills and food expenses at school. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

Development and evaluation of the content validity, practicability and feasibility of the Innovative dementia-oriented Assessment system for challenging behaviour in residents with dementia.

PubMed

Halek, Margareta; Holle, Daniela; Bartholomeyczik, Sabine

2017-08-14

One of the most difficult issues for care staff is the manifestation of challenging behaviour among residents with dementia. The first step in managing this type of behaviour is analysing its triggers. A structured assessment instrument can facilitate this process and may improve carers' management of the situation. This paper describes the development of an instrument designed for this purpose and an evaluation of its content validity and its feasibility and practicability in nursing homes. The development process and evaluation of the content validity were based on Lynn's methodology (1998). A literature review (steps 1 + 2) provided the theoretical framework for the instrument and for item formation. Ten experts (step 3) evaluated the first version of the instrument (the Innovative dementia-oriented Assessment (IdA®)) regarding its relevance, clarity, meaningfulness and completeness; content validity indices at the scale-level (S-CVI) and item-level (I-CVI) were calculated. Health care workers (step 4) evaluated the second version in a workshop. Finally, the instrument was introduced to 17 units in 11 nursing homes in a field study (step 5), and 60 care staff members assessed its practicability and feasibility. The IdA® used the need-driven dementia-compromised behaviour (NDB) model as a theoretical framework. The literature review and expert-based panel supported the content validity of the IdA®. At the item level, 77% of the ratings had a CVI greater than or equal to 0.78. The majority of the question-ratings (84%, n = 154) and answer-ratings (69%, n = 122) showed valid results, with none below 0.50. The health care workers confirmed the understandability, completeness and plausibility of the IdA®. Steps 3 and 4 led to further item clarification. The carers in the study considered the instrument helpful for reflecting challenging behaviour and beneficial for the care of residents with dementia. Negative ratings referred to the time required and the lack of effect on residents´ behaviour. There was strong evidence supporting the content validity of the IdA®. Despite the substantial length and time requirement, the instrument was considered helpful for analysing challenging behaviour. Thus, further research on the psychometric qualities, implementation aspects and effectiveness of the IdA® in understanding challenging behaviour is needed.

Development and validation of an achievement test in introductory quantum mechanics: The Quantum Mechanics Visualization Instrument (QMVI)

NASA Astrophysics Data System (ADS)

Cataloglu, Erdat

The purpose of this study was to construct a valid and reliable multiple-choice achievement test to assess students' understanding of core concepts of introductory quantum mechanics. Development of the Quantum Mechanics Visualization Instrument (QMVI) occurred across four successive semesters in 1999--2001. During this time 213 undergraduate and graduate students attending the Pennsylvania State University (PSU) at University Park and Arizona State University (ASU) participated in this development and validation study. Participating students were enrolled in four distinct groups of courses: Modern Physics, Undergraduate Quantum Mechanics, Graduate Quantum Mechanics, and Chemistry Quantum Mechanics. Expert panels of professors of physics experienced in teaching quantum mechanics courses and graduate students in physics and science education established the core content and assisted in the validating of successive versions of the 24-question QMVI. Instrument development was guided by procedures outlined in the Standards for Educational and Psychological Testing (AERA-APA-NCME, 1999). Data gathered in this study provided information used in the development of successive versions of the QMVI. Data gathered in the final phase of administration of the QMVI also provided evidence that the intended score interpretation of the QMVI achievement test is valid and reliable. A moderate positive correlation coefficient of 0.49 was observed between the students' QMVI scores and their confidence levels. Analyses of variance indicated that students' scores in Graduate Quantum Mechanics and Undergraduate Quantum Mechanics courses were significantly higher than the mean scores of students in Modern Physics and Chemistry Quantum Mechanics courses (p < 0.05). That finding is consistent with the additional understanding and experience that should be anticipated in graduate students and junior-senior level students over sophomore physics majors and majors in another field. The moderate positive correlation coefficient of 0.42 observed between students' QMVI scores and their final course grades was also consistent with expectations in a valid instrument. In addition, the Cronbach-alpha reliability coefficient of the QMVI was found to be 0.82. Limited findings were drawn on students' understanding of introductory quantum mechanics concepts. Data suggested that the construct of quantum mechanics understanding is most likely multidimensional and the Main Topic defined as "Quantum Mechanics Postulates" may be an especially important factor for students in acquiring a successful understanding of quantum mechanics.

Psychometric Validation of the Pulmonary Arterial Hypertension-Symptoms and Impact (PAH-SYMPACT®) Questionnaire: Results of the SYMPHONY Trial.

PubMed

Chin, Kelly M; Gomberg-Maitland, Mardi; Channick, Richard N; Cuttica, Michael J; Fischer, Aryeh; Frantz, Robert P; Hunsche, Elke; Kleinman, Leah; McConnell, John W; McLaughlin, Vallerie V; Miller, Chad E; Zamanian, Roham T; Zastrow, Michael S; Badesch, David B

2018-04-26

Disease-specific patient-reported outcome (PRO) instruments are important in assessing the impact of disease and treatment. PAH-SYMPACT ® is the first questionnaire for quantifying pulmonary arterial hypertension (PAH) symptoms and impacts developed following the 2009 FDA PRO guidance; previous qualitative research with PAH patients supported its initial content validity. Content finalization and psychometric validation were conducted using data from SYMPHONY, a single-arm, 16-week study with macitentan 10mg in US patients with PAH. Item performance, Rasch, and factor analyses were used to select final item content of the PRO and define its domain structure. Internal consistency, test-retest reliability, known-group and construct validity, sensitivity to change, and influence of oxygen on item performance were evaluated. Data from 278 patients (79% female, mean age 60 years) were analyzed. Following removal of redundant/misfitting items, the final questionnaire has 11 symptom items across 2 domains (cardiopulmonary and cardiovascular symptoms) and 11 impact items across 2 domains (physical and cognitive/emotional impacts). Differential item function analysis confirmed PRO scoring is unaffected by oxygen use. For all 4 domains, internal consistency reliability was high (Cronbach's alpha >0.80) and scores were highly reproducible in stable patients (intra-class correlation coefficient 0.84-0.94). Correlations with CAMPHOR and SF-36 were moderate-to-high ([r]=0.34-0.80). The questionnaire differentiated well between patients with different disease severity levels, and was sensitive to improvements in clinician- and patient-reported disease severity. The PAH-SYMPACT ® is a brief, disease-specific PRO instrument possessing good psychometric properties which can be administered in clinical practice and clinical studies. Copyright © 2018. Published by Elsevier Inc.

Skin-electrode impedance measurement during ECG acquisition: method’s validation

NASA Astrophysics Data System (ADS)

Casal, Leonardo; La Mura, Guillermo

2016-04-01

Skm-electrode impedance measurement can provide valuable information prior. dunng and post electrocardiographic (ECG) or electroencephalographs (EEG) acquisitions. In this work we validate a method for skm-electrode impedance measurement using test circuits with known resistance and capacitor values, at different frequencies for injected excitation current. Finally the method is successfully used for impedance measurement during ECG acquisition on a subject usmg 125 Hz and 6 nA square wave excitation signal at instrumentation amplifier mput. The method can be used for many electrodes configuration.

Leadership: validation of a self-report scale: comment on Dussault, Frenette, and Fernet (2013).

PubMed

Chakrabarty, Subhra

2014-10-01

In a recent study, Dussault, Frenette, and Fernet (2013) developed a 21-item self-report instrument to measure leadership based on Bass's (1985) transformational/transactional leadership paradigm. The final specification included a third-order dimension (leadership), two second-order dimensions (transactional leadership and transformational leadership), and a first-order dimension (laissez-faire leadership). This note focuses on the need for assessing convergent and discriminant validity of the scale, and on ruling out the potential for common method bias.

Qualitative adaptation of child behaviour problem instruments in a developing-country setting.

PubMed

Khan, B; Avan, B I

2014-07-08

A key barrier to epidemiological research on child behaviour problems in developing countries is the lack of culturally relevant, internationally recognized psychometric instruments. This paper proposes a model for the qualitative adaptation of psychometric instruments in developing-country settings and presents a case study of the adaptation of 3 internationally recognized instruments in Pakistan: the Child Behavior Checklist, the Youth Self-Report and the Teacher's Report Form. This model encompassed a systematic procedure with 6 distinct phases to minimize bias and ensure equivalence with the original instruments: selection, deliberation, alteration, feasibility, testing and formal approval. The process was conducted in collaboration with the instruments' developer. A multidisciplinary working group of experts identified equivalence issues and suggested modifications. Focus group discussions with informants highlighted comprehension issues. Subsequently modified instruments were thoroughly tested. Finally, the instruments' developer approval further validated the qualitative adaptation. The study proposes a rigorous and systematic model to effectively achieve cultural adaptation of psychometric instruments.

Developing and Validating an Instrument for Student Ratings of Teaching

ERIC Educational Resources Information Center

Hunt, Gary; Baldwin, Lyn; Tsui, Ernest; Matthews, Les

2013-01-01

In May 2007, the Thompson Rivers University Faculty of Science established an ad hoc subcommittee to develop a new student ratings of teaching survey. The final survey, approved by the Faculty in February 2011, includes statements categorized in the dimensions of teaching shown in previous studies to be correlated with student achievement. The…

Coaxial cable sensors and sensing instrument for crack detection in bridge structures--phase I : field qualification/validation planning : final report.

DOT National Transportation Integrated Search

2009-11-06

The objectives of this study are to pre-test analyze a decommissioned RC bridge that is selected in consultation : with New York State Department of Transportation (NYSDOT), and design and plan the field tests of the bridge : for the performance qual...

Measuring Nurses' Value, Implementation, and Knowledge of Evidence-Based Practice: Further Psychometric Testing of the Quick-EBP-VIK Survey.

PubMed

Connor, Linda; Paul, Fiona; McCabe, Margaret; Ziniel, Sonja

2017-02-01

The Quick-EBP-VIK is a new instrument for measuring nurses' value, implementation, and knowledge of EBP. Psychometric testing was conducted in two parts. Part 1 describes the tool development and validity testing which resulted in the development of a 25-item survey after receiving ≥0.80 Item-Level Content Validity Index for both clarity and relevance. Part 2 describes psychometric testing was necessary to assess additional types of validity and reliability. The purpose of this paper is to further describe the psychometric testing of the Quick-EBP-VIK survey instrument. This descriptive study was designed to assess test-retest reliability, internal consistency and construct validity via a web-based survey. The survey instrument was e-mailed to all nurses at the study hospital. Nurses who responded to the first survey (Wave 1) received another e-mail invitation to complete the survey instrument again (Wave 2) for the purpose of assessing the test-retest reliability of the instrument. A total of 1,177 deliverable e-mails were sent to all nursing staff at one free standing pediatric hospital with Magnet ® designation in the northeast. A total of 382 nurses returned completed surveys, indicating a 32.5% response rate for Wave 1. A total of 131 nurses responded to Wave 2 indicating a response rate of 34.3%. The intraclass correlation coefficients for the items included in the final instrument ranged from 0.43 to 0.80 and were deemed sufficient. These represent a sufficient intraclass correlation coefficient. The Cronbach's Alpha values for each of the three domains are all higher than 0.7 indicating that the items of each of the measurement dimension are internally consistent. However, the composite reliability of the third domain was slightly lower than 0.7 when using Raykov's Rho. The Quick-EBP-VIK instrument has gone through rigorous comprehensive testing and has demonstrated good psychometric properties. © 2016 Sigma Theta Tau International.

Validation of three short physical activity questionnaires with accelerometers among university students in Spain.

PubMed

Rodríguez-Muñoz, Sheila; Corella, Cristina; Abarca-Sos, Alberto; Zaragoza, Javier

2017-12-01

Physical activity (PA) in university students has not been analyzed with specific questionnaires tailored to this population. Therefore, the purpose of this study was to analyze the validity of three PA questionnaires developed on other populations comparing with accelerometer values: counts and moderate to vigorous PA (MVPA) calculated with uniaxial and triaxial cut points. One hundred and forty-five university students (of whom, 92 women) from Spain wore an accelerometer GT3X or GTX+ to collect PA data of 7 full days. Three questionnaires, Physical Activity Questionnaire for Adults (PAQ-AD), Assessment of Physical Activity Questionnaire (APALQ), and the International Physical Activity Questionnaire Short Form (IPAQ-SF) were administrated jointly with the collection of accelerometer values. Finally, after the application of inclusion criteria, data from 95 participants (62 women) with a mean age of 21.96±2.33 years were analyzed to compare the instruments measures. The correlational analysis showed that PAQ-AD (0.44-0.56) and IPAQ-SF (0.26-0.69) questionnaires were significantly related to accelerometers scores: counts, uniaxial MVPA and triaxial MVPA. Conversely, APALQ displayed no significant relations for males with accelerometers scores for MVPA created with both cut points. PAQ-AD and IPAQ-SF questionnaires have shown adequate validity to use with Spanish university students. The use of counts to validate self-report data in order to reduce the variability display by MVPA created with different cut points is discussed. Finally, validated instruments to measure PA in university students will allow implementation of strategies for PA promotion based on reliable data.

Development & standardization of a scale to measure socio-economic status in urban & rural communities in India.

PubMed

Tiwari, S C; Kumar, Aditya; Kumar, Ambrish

2005-10-01

The commonly used available scales for measurement of socio-economic status (SES) with some cross regional applicability are old and have lost their relevance. There is a need for the development of a valid and reliable instrument for measurement of SES in rural and urban communities in India. The present study was undertaken to develop a cross regionally applicable scale for the purpose of enlisting true measures of socio-economic items applicable in multilingual, multicultural, multireligious, setting of the country. For developing the scale, seven indicators (house, materials possession, education, occupation, monthly income, land, social participation and understanding), presumably determining the socioeconomic status were selected. These indicators were named as profiles. Thus, initially the scale had seven profiles and every profile contained five alternatives. This instrument was prepared on a 10-point scale. Weightage system of scoring (varying from 2 to 10) was followed from first to sixth profile while the additive pattern of scoring was followed in seventh profile. The final version of the scale was arrived at through three trial administrations on rural and urban families. The basis of selection of the families for the first two trials was stratified random. The validity and reliability of the scale was established through a defined visual analogue scale (VAS) and test-retest methods. Both the initial version as well as the final version of the scale for the measurement of SES of incumbents had seven profiles. The difference between the two versions was in terms of contents and range of items in different categories of SES. The final version was arrived at through field trials and suggestions of the experts. The reliability of the scale was high with a correlation coefficient of 0.998. The new scale appears to be a valid and reliable instrument for the assessment of socio-economic status of the families/individuals from urban as well as rural areas in India.

Adolescents' perception of parental feeding practices: Adaptation and validation of the Comprehensive Feeding Practices Questionnaire for Brazilian adolescents—The CFPQ-Teen

PubMed Central

Piccoli, Ângela Bein; Neiva-Silva, Lucas; Mosmann, Clarisse Pereira; Musher-Eizenman, Dara; Pellanda, Lucia C.

2017-01-01

Background Parental feeding practices may play a key role in dietary habits and nutritional status of adolescents, but research from adolescents’ point of view on this topic is scarce. Objective To adapt and validate an instrument of parental feeding practices as perceived by adolescents in a Brazilian setting. Methods The Comprehensive Feeding Practices Questionnaire was translated into Portuguese and adapted to be answered by adolescents (ages 12 to 18). Content analysis and FACE validity to assess cultural equivalence was undertaken by experts in the adolescent nutritional and psychological fields. Pilot study was evaluated in 23 adolescents. The final version was administered to 41 students to assess instrument reproducibility (Intraclass Correlation Coefficient). Internal consistency (Cronbach's Alpha) and construct validity (Confirmatory Factor Analysis) were assessed in a third sample of 307 adolescents. Results Experts and adolescents considered content validity as appropriate. In reproducibility analysis (Intraclass Correlation Coefficient), 10 of the 12 factors were above 0.7. The factors “teaching about nutrition” and “food as reward” obtained values of 0.60 and 0.68, respectively. The Cronbach's Alpha of the whole scale was 0.83 and alphas for subscales ranged from 0.52 to 0.85; the factors “teaching about nutrition” and “food as a reward” had the lowest values (0.52). After removing these two factors, the Confirmatory Factor Analysis indicated that the structural model was appropriate. The final scale was made up of 10 factors with 43 questions. Conclusions The Comprehensive Feeding Practices Questionnaire-Teen demonstrates validity and reliability, and is a suitable tool to evaluate the perceptions of adolescents regarding parental feeding practices. PMID:29145485

Validation of the Brazilian Portuguese version of the Premenstrual Symptoms Screening Tool (PSST) and association of PSST scores with health-related quality of life.

PubMed

Câmara, Rachel de A; Köhler, Cristiano A; Frey, Benicio N; Hyphantis, Thomas N; Carvalho, André F

2017-01-01

To develop and validate a Brazilian Portuguese version of the Premenstrual Symptoms Screening Tool (PSST), a questionnaire used for the screening of premenstrual syndrome (PMS) and of the most severe form of PMS, premenstrual dysphoric disorder (PMDD). The PSST also rates the impact of premenstrual symptoms on daily activities. A consecutive sample of 801 women aged ≥ 18 years completed the study protocol. The internal consistency, test-retest reliability, and content validity of the Brazilian PSST were determined. The independent association of a positive screen for PMS or PMDD and quality of life determined by the World Health Organization Quality of Life instrument-Abbreviated version (WHOQOL-Bref) was also assessed. Of 801 participants, 132 (16.5%) had a positive screening for PMDD. The Brazilian PSST had adequate internal consistency (Cronbach's alpha = 0.91) and test-retest reliability. The PSST also had adequate convergent/discriminant validity, without redundancy. Content validity ratio and content validity index were 0.61 and 0.94 respectively. Finally, a positive screen for PMS/PMDD was associated with worse WHOQOL-Bref scores. These findings suggest that PSST is a reliable and valid instrument to screen for PMS/PMDD in Brazilian women.

Validation of a condition-specific measure for women having an abnormal screening mammography.

PubMed

Brodersen, John; Thorsen, Hanne; Kreiner, Svend

2007-01-01

The aim of this study is to assess the validity of a new condition-specific instrument measuring psychosocial consequences of abnormal screening mammography (PCQ-DK33). The draft version of the PCQ-DK33 was completed on two occasions by 184 women who had received an abnormal screening mammography and on one occasion by 240 women who had received a normal screening result. Item Response Theories and Classical Test Theories were used to analyze data. Construct validity, concurrent validity, known group validity, objectivity and reliability were established by item analysis examining the fit between item responses and Rasch models. Six dimensions covering anxiety, behavioral impact, sense of dejection, impact on sleep, breast examination, and sexuality were identified. One item belonging to the dejection dimension had uniform differential item functioning. Two items not fitting the Rasch models were retained because of high face validity. A sick leave item added useful information when measuring side effects and socioeconomic consequences of breast cancer screening. Five "poor items" were identified and should be deleted from the final instrument. Preliminary evidence for a valid and reliable condition-specific measure for women having an abnormal screening mammography was established. The measure includes 27 "good" items measuring different attributes of the same overall latent structure-the psychosocial consequences of abnormal screening mammography.

Cross-Cultural Adaptation, Reliability and Validity of the Danish Version of the Readiness for Return to Work Instrument.

PubMed

Stapelfeldt, Christina Malmose; Momsen, Anne-Mette Hedeager; Lund, Thomas; Grønborg, Therese Koops; Hogg-Johnson, Sheilah; Jensen, Chris; Skakon, Janne; Labriola, Merete

2018-06-06

The objective of the present study was to translate and validate the Canadian Readiness for Return To Work instrument (RRTW-CA) into a Danish version (RRTWDK) by testing its test-retest and internal consistency reliability and its structural and construct validity. Cross-cultural adaptation of the six-staged RRTW-CA instrument was performed in a standardised, systematic five-step-procedure; forward translation, panel synthesis of the translation, back translation, consolidation and revision by researchers, and finally pre-testing. This RRTW-DK beta-version was tested for its psychometric properties by intra-class correlation coefficient and standard error of measurement (n = 114), Cronbach's alpha (n = 471), confirmatory factor analyses (n = 373), and Spearman's rank correlation coefficient (n = 436) in sickness beneficiaries from a municipal employment agency and hospital wards. The original RRTW-CA stage structure could not be confirmed in the RRTWDK. The psychometric properties were thus inconclusive. The RRTW-DK cannot be recommended for use in the current version as the RRTW construct is questionable. The RRTW construct needs further exploration, preferably in a population that is homogeneous with regard to cause of sickness, disability duration and age.

Treatment Readiness as a Determinant of Treatment Participation in a Prison-Based Rehabilitation Program: An Exploratory Study.

PubMed

Bosma, Anouk Q; Kunst, Maarten J J; Dirkzwager, Anja J E; Nieuwbeerta, Paul

2017-06-01

The current study had three aims. First, it measured treatment readiness among offenders who entered the Prevention of Recidivism program. This is a prison-based rehabilitation program in the Netherlands that aims to lower re-offending rates among offenders with a prison sentence of at least for months and that is carried out during the final months of incarceration. Second, the study evaluated whether treatment readiness was associated with treatment participation. Third, the study examined whether treatment readiness measured with a validated instrument predicted treatment participation above and beyond a clinical assessment of treatment readiness, currently used as a criterion to include offenders in rehabilitation programs. To address these aims, data were used from the fourth wave of a research project studying the effects of imprisonment on the life of detainees in the Netherlands. Results indicated that treatment readiness as measured with a validated instrument was a significant predictor of treatment participation. Also, the current study showed that treatment readiness measured with a validated instrument improved the prediction of treatment participation above and beyond a clinical assessment of treatment readiness. Outcomes were discussed in light of study limitations and implications.

Nursing Care Interpersonal Relationship Questionnaire: elaboration and validation 1

PubMed Central

Borges, José Wicto Pereira; Moreira, Thereza Maria Magalhães; de Andrade, Dalton Franscisco

2018-01-01

ABSTRACT Objective: to elaborate an instrument for the measurement of the interpersonal relationship in nursing care through the Item Response Theory, and the validation thereof. Method: methodological study, which followed the three poles of psychometry: theoretical, empirical and analytical. The Nursing Care Interpersonal Relationship Questionnaire was developed in light of the Imogene King’s Interpersonal Conceptual Model and the psychometric properties were studied through the Item Response Theory in a sample of 950 patients attended in Primary, Secondary and Tertiary Health Care. Results: the final instrument consisted of 31 items, with Cronbach’s alpha of 0.90 and McDonald’s Omega of 0.92. The parameters of the Item Response Theory demonstrated high discrimination in 28 items, being developed a five-level interpretive scale. At the first level, the communication process begins, gaining a wealth of interaction. Subsequent levels demonstrate qualitatively the points of effectiveness of the interpersonal relationship with the involvement of behaviors related to the concepts of transaction and interaction, followed by the concept of role. Conclusion: the instrument was created and proved to be consistent to measure interpersonal relationship in nursing care, as it presented adequate reliability and validity parameters. PMID:29319743

[The Profile of Leisure Activities, a promising instrument in occupational therapy].

PubMed

Dutil, Elisabeth; Bier, Nathalie; Gaudreault, Céline

2007-10-04

Although the benefits of leisure activities are well known, few instruments have been specifically designed to measure a person's engagement in their leisure activities and to assess the personal or environmental factors affecting their capacity to participate in leisure activities. The purpose of this paper is to present the steps leading to the development of the Profil du Loisir between 1990 and 2002. The planning, construction, and validation of the tool were done according to the steps suggested by Benson and Clark (1982). The first versions were tested by occupational therapists on individuals with traumatic brain injuries. The validation led to the development of the final version (3.0). The inter-rater reliability of the instrument was rated from acceptable (kappa 0.21-0.4) to very good (0.61-0.80) and the test-retest reliability was rated from acceptable to moderate (0.41-0.60). The Profil du Loisir is a promising tool that invites occupational therapists to systematically consider and assess client leisure time in their practice.

Psychometric validation of the PROQOL-HIV questionnaire, a new health-related quality of life instrument-specific to HIV disease.

PubMed

Duracinsky, Martin; Lalanne, Christophe; Le Coeur, Sophie; Herrmann, Susan; Berzins, Baiba; Armstrong, Andrew Richard; Lau, Joseph Tak Fai; Fournier, Isabelle; Chassany, Olivier

2012-04-15

This study reports the psychometric validation of a new HIV/AIDS-specific health-related quality of life (HRQL) questionnaire, the Patient Reported Outcomes Quality of Life-HIV. The instrument was developed simultaneously across Europe, North and South America, Africa, Asia, and Australia to assess multidimensional quality of life impairments in the era of highly active antiretroviral therapy. A cross-sectional study was performed in 8 countries. The pilot 70-item questionnaire was co-administered with the HIV symptoms index, the EQ-5D and Medical Outcomes Study-HIV questionnaires. Demographic and biomedical data were collected. After item analysis and reduction, convergent discriminant concurrent validity and known-group validity were examined. Internal consistency and reliability scores were assessed using Cronbach alpha and intraclass correlation. The final sample of 791 patients was composed of 64% males (median age: 41 years, HIV diagnosis = 5 years), 13.8% were treatment naive. Item reduction yielded a 43-item form surveying 8 dimensions and 1 global health item that showed good convergent and discriminant validity and reliability (98% scaling success; Cronbach alphas 0.77-0.89). Correlations with EQ-5D and Medical Outcomes Study-HIV complied with concurrent validity expectations; likewise, correlations against the number of self-reported symptoms and depression showed good support for criterion validity. A test-retest study on French patients (n = 34) showed temporal stability (intraclass correlation coefficient = 0.86). Significant and meaningful differences of HRQL scores between countries were found. The Patient Reported Outcomes Quality of Life-HIV questionnaire is a valid and reliable instrument for assessing HRQL specific to HIV disease in different cultures and healthcare systems.

Developing a tool to measure satisfaction among health professionals in sub-Saharan Africa

PubMed Central

2013-01-01

Background In sub-Saharan Africa, lack of motivation and job dissatisfaction have been cited as causes of poor healthcare quality and outcomes. Measurement of health workers’ satisfaction adapted to sub-Saharan African working conditions and cultures is a challenge. The objective of this study was to develop a valid and reliable instrument to measure satisfaction among health professionals in the sub-Saharan African context. Methods A survey was conducted in Senegal and Mali in 2011 among 962 care providers (doctors, midwives, nurses and technicians) practicing in 46 hospitals (capital, regional and district). The participation rate was very high: 97% (937/962). After exploratory factor analysis (EFA), construct validity was assessed through confirmatory factor analysis (CFA). The discriminant validity of our subscales was evaluated by comparing the average variance extracted (AVE) for each of the constructs with the squared interconstruct correlation (SIC), and finally for criterion validity, each subscale was tested with two hypotheses. Two dimensions of reliability were assessed: internal consistency with Cronbach’s alpha subscales and stability over time using a test-retest process. Results Eight dimensions of satisfaction encompassing 24 items were identified and validated using a process that combined psychometric analyses and expert opinions: continuing education, salary and benefits, management style, tasks, work environment, workload, moral satisfaction and job stability. All eight dimensions demonstrated significant discriminant validity. The final model showed good performance, with a root mean square error of approximation (RMSEA) of 0.0508 (90% CI: 0.0448 to 0.0569) and a comparative fit index (CFI) of 0.9415. The concurrent criterion validity of the eight dimensions was good. Reliability was assessed based on internal consistency, which was good for all dimensions but one (moral satisfaction < 0.70). Test-retest showed satisfactory temporal stability (intra class coefficient range: 0.60 to 0.91). Conclusions Job satisfaction is a complex construct; this study provides a multidimensional instrument whose content, construct and criterion validities were verified to ensure its suitability for the sub-Saharan African context. When using these subscales in further studies, the variability of the reliability of the subscales should be taken in to account for calculating the sample sizes. The instrument will be useful in evaluative studies which will help guide interventions aimed at improving both the quality of care and its effectiveness. PMID:23826720

Development and evaluation of the EOL-ICDQ as a measure of experiences, attitudes and knowledge in end-of-life in patients living with an implantable cardioverter defibrillator.

PubMed

Thylén, Ingela; Wenemark, Marika; Fluur, Christina; Strömberg, Anna; Bolse, Kärstin; Årestedt, Kristofer

2014-04-01

Due to extended indications and resynchronization therapy, many implantable cardioverter defibrillator (ICD) recipients will experience progressive co-morbid conditions and will be more likely to die of causes other than cardiac death. It is therefore important to elucidate the ICD patients' preferences when nearing end-of-life. Instead of avoiding the subject of end-of-life, a validated questionnaire may be helpful to explore patients' experiences and attitudes about end-of-life concerns and to assess knowledge of the function of the ICD in end-of-life. Validated instruments assessing patients' perspective concerning end-of-life issues are scarce. The purpose of this study was to develop and evaluate respondent satisfaction and measurement properties of the 'Experiences, Attitudes and Knowledge of End-of-Life Issues in Implantable Cardioverter Defibrillator Patients' Questionnaire' (EOL-ICDQ). The instrument was tested for validity, respondent satisfaction, and for homogeneity and stability in the Swedish language. An English version of the EOL-ICDQ was validated, but has not yet been pilot tested. The final instrument contained three domains, which were clustered into 39 items measuring: experiences (10 items), attitudes (18 items), and knowledge (11 items) of end-of-life concerns in ICD patients. In addition, the questionnaire also contained items on socio-demographic background (six items) and ICD-specific background (eight items). The validity and reliability properties were considered sufficient. The EOL-ICDQ has the potential to be used in clinical practice and future research. Further studies are needed using this instrument in an Anglo-Saxon context with a sample of English-speaking ICD recipients.

The development and validation of the speech quality instrument.

PubMed

Chen, Stephanie Y; Griffin, Brianna M; Mancuso, Dean; Shiau, Stephanie; DiMattia, Michelle; Cellum, Ilana; Harvey Boyd, Kelly; Prevoteau, Charlotte; Kohlberg, Gavriel D; Spitzer, Jaclyn B; Lalwani, Anil K

2017-12-08

Although speech perception tests are available to evaluate hearing, there is no standardized validated tool to quantify speech quality. The objective of this study is to develop a validated tool to measure quality of speech heard. Prospective instrument validation study of 35 normal hearing adults recruited at a tertiary referral center. Participants listened to 44 speech clips of male/female voices reciting the Rainbow Passage. Speech clips included original and manipulated excerpts capturing goal qualities such as mechanical and garbled. Listeners rated clips on a 10-point visual analog scale (VAS) of 18 characteristics (e.g. cartoonish, garbled). Skewed distribution analysis identified mean ratings in the upper and lower 2-point limits of the VAS (ratings of 8-10, 0-2, respectively); items with inconsistent responses were eliminated. The test was pruned to a final instrument of nine speech clips that clearly define qualities of interest: speech-like, male/female, cartoonish, echo-y, garbled, tinny, mechanical, rough, breathy, soothing, hoarse, like, pleasant, natural. Mean ratings were highest for original female clips (8.8) and lowest for not-speech manipulation (2.1). Factor analysis identified two subsets of characteristics: internal consistency demonstrated Cronbach's alpha of 0.95 and 0.82 per subset. Test-retest reliability of total scores was high, with an intraclass correlation coefficient of 0.76. The Speech Quality Instrument (SQI) is a concise, valid tool for assessing speech quality as an indicator for hearing performance. SQI may be a valuable outcome measure for cochlear implant recipients who, despite achieving excellent speech perception, often experience poor speech quality. 2b. Laryngoscope, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Construct Validity of the SF-12v2 for the Homeless Population with Mental Illness: An Instrument to Measure Self-Reported Mental and Physical Health

PubMed Central

Chum, Antony; Skosireva, Anna; Tobon, Juliana; Hwang, Stephen

2016-01-01

Background Self-reported health measures are important indicators used by clinicians and researchers for the evaluation of health interventions, outcome assessment of clinical studies, and identification of health needs to improve resource allocation. However, the application of self-reported health measures relies on developing reliable and valid instruments that are suitable across diverse populations. The main objective of this study is to evaluate the construct validity of the SF-12v.2, an instrument for measuring self-rated physical and mental health, for homeless adults with mental illness. Various interventions have been aimed at improving the health of homeless people with mental illness, and the development of valid instruments to evaluate these interventions is imperative. Study Design We measured self-rated mental and physical health from a quota sample of 575 homeless people with mental illness using the SF-12v2, EQ-5D, Colorado Symptoms Index, and physical/mental health visual analogue scales. We examined the construct validity of the SF-12v2 through confirmatory factor analyses (CFA), and using ANOVA/correlation analyses to compare the SF-12v2 to the other instruments to ascertain discriminant/convergent validity. Results Our CFA showed that the measurement properties of the original SF-12v2 model had a mediocre fit with our empirical data (χ2 = 193.6, df = 43, p < .0001, CFI = 0.85, NFI = 0.83, RMSEA = 0.08). We demonstrate that changes based on theoretical rationale and previous studies can significantly improve the model, achieving an excellent fit in our final model (χ2 = 160.6, df = 48, p < .0001, CFI = 0.95, NFI = 0.95, RMSEA = 0.06). Our CFA results suggest that an alternative scoring method based on the new model may optimize health status measurement of a homeless population. Despite these issues, convergent and discriminant validity of the SF-12v2 (scored based on the original model) was supported through multiple comparisons with other instruments. Conclusion Our study demonstrates for the first time that the SF-12v2 is generally appropriate as a measure of physical and mental health status for a homeless population with mental illness. PMID:26938990

Construct Validity of the SF-12v2 for the Homeless Population with Mental Illness: An Instrument to Measure Self-Reported Mental and Physical Health.

PubMed

Chum, Antony; Skosireva, Anna; Tobon, Juliana; Hwang, Stephen

2016-01-01

Self-reported health measures are important indicators used by clinicians and researchers for the evaluation of health interventions, outcome assessment of clinical studies, and identification of health needs to improve resource allocation. However, the application of self-reported health measures relies on developing reliable and valid instruments that are suitable across diverse populations. The main objective of this study is to evaluate the construct validity of the SF-12v.2, an instrument for measuring self-rated physical and mental health, for homeless adults with mental illness. Various interventions have been aimed at improving the health of homeless people with mental illness, and the development of valid instruments to evaluate these interventions is imperative. We measured self-rated mental and physical health from a quota sample of 575 homeless people with mental illness using the SF-12v2, EQ-5D, Colorado Symptoms Index, and physical/mental health visual analogue scales. We examined the construct validity of the SF-12v2 through confirmatory factor analyses (CFA), and using ANOVA/correlation analyses to compare the SF-12v2 to the other instruments to ascertain discriminant/convergent validity. Our CFA showed that the measurement properties of the original SF-12v2 model had a mediocre fit with our empirical data (χ2 = 193.6, df = 43, p < .0001, CFI = 0.85, NFI = 0.83, RMSEA = 0.08). We demonstrate that changes based on theoretical rationale and previous studies can significantly improve the model, achieving an excellent fit in our final model (χ2 = 160.6, df = 48, p < .0001, CFI = 0.95, NFI = 0.95, RMSEA = 0.06). Our CFA results suggest that an alternative scoring method based on the new model may optimize health status measurement of a homeless population. Despite these issues, convergent and discriminant validity of the SF-12v2 (scored based on the original model) was supported through multiple comparisons with other instruments. Our study demonstrates for the first time that the SF-12v2 is generally appropriate as a measure of physical and mental health status for a homeless population with mental illness.

Automation is an Effective Way to Improve Quality of Verification (Calibration) of Measuring Instruments

NASA Astrophysics Data System (ADS)

Golobokov, M.; Danilevich, S.

2018-04-01

In order to assess calibration reliability and automate such assessment, procedures for data collection and simulation study of thermal imager calibration procedure have been elaborated. The existing calibration techniques do not always provide high reliability. A new method for analyzing the existing calibration techniques and developing new efficient ones has been suggested and tested. A type of software has been studied that allows generating instrument calibration reports automatically, monitoring their proper configuration, processing measurement results and assessing instrument validity. The use of such software allows reducing man-hours spent on finalization of calibration data 2 to 5 times and eliminating a whole set of typical operator errors.

Content Validity and Psychometric Characteristics of the "Knowledge about Older Patients Quiz" for Nurses Using Item Response Theory.

PubMed

Dikken, Jeroen; Hoogerduijn, Jita G; Kruitwagen, Cas; Schuurmans, Marieke J

2016-11-01

To assess the content validity and psychometric characteristics of the Knowledge about Older Patients Quiz (KOP-Q), which measures nurses' knowledge regarding older hospitalized adults and their certainty regarding this knowledge. Cross-sectional. Content validity: general hospitals. Psychometric characteristics: nursing school and general hospitals in the Netherlands. Content validity: 12 nurse specialists in geriatrics. Psychometric characteristics: 107 first-year and 78 final-year bachelor of nursing students, 148 registered nurses, and 20 nurse specialists in geriatrics. Content validity: The nurse specialists rated each item of the initial KOP-Q (52 items) on relevance. Ratings were used to calculate Item-Content Validity Index and average Scale-Content Validity Index (S-CVI/ave) scores. Items with insufficient content validity were removed. Psychometric characteristics: Ratings of students, nurses, and nurse specialists were used to test for different item functioning (DIF) and unidimensionality before item characteristics (discrimination and difficulty) were examined using Item Response Theory. Finally, norm references were calculated and nomological validity was assessed. Content validity: Forty-three items remained after assessing content validity (S-CVI/ave = 0.90). Psychometric characteristics: Of the 43 items, two demonstrating ceiling effects and 11 distorting ability estimates (DIF) were subsequently excluded. Item characteristics were assessed for the remaining 30 items, all of which demonstrated good discrimination and difficulty parameters. Knowledge was positively correlated with certainty about this knowledge. The final 30-item KOP-Q is a valid, psychometrically sound, comprehensive instrument that can be used to assess the knowledge of nursing students, hospital nurses, and nurse specialists in geriatrics regarding older hospitalized adults. It can identify knowledge and certainty deficits for research purposes or serve as a tool in educational or quality improvement programs. © 2016, Copyright the Authors Journal compilation © 2016, The American Geriatrics Society.

Development and validation of the ASPIRE-VA coaching fidelity checklist (ACFC): a tool to help ensure delivery of high-quality weight management interventions.

PubMed

Damschroder, Laura J; Goodrich, David E; Kim, Hyungjin Myra; Holleman, Robert; Gillon, Leah; Kirsh, Susan; Richardson, Caroline R; Lutes, Lesley D

2016-09-01

Practical and valid instruments are needed to assess fidelity of coaching for weight loss. The purpose of this study was to develop and validate the ASPIRE Coaching Fidelity Checklist (ACFC). Classical test theory guided ACFC development. Principal component analyses were used to determine item groupings. Psychometric properties, internal consistency, and inter-rater reliability were evaluated for each subscale. Criterion validity was tested by predicting weight loss as a function of coaching fidelity. The final 19-item ACFC consists of two domains (session process and session structure) and five subscales (sets goals and monitor progress, assess and personalize self-regulatory content, manages the session, creates a supportive and empathetic climate, and stays on track). Four of five subscales showed high internal consistency (Cronbach alphas > 0.70) for group-based coaching; only two of five subscales had high internal reliability for phone-based coaching. All five sub-scales were positively and significantly associated with weight loss for group- but not for phone-based coaching. The ACFC is a reliable and valid instrument that can be used to assess fidelity and guide skill-building for weight management interventionists.

Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project.

PubMed

2003-02-01

International interest in clinical practice guidelines has never been greater but many published guidelines do not meet the basic quality requirements. There have been renewed calls for validated criteria to assess the quality of guidelines. To develop and validate an international instrument for assessing the quality of the process and reporting of clinical practice guideline development. The instrument was developed through a multi-staged process of item generation, selection and scaling, field testing, and refinement procedures. 100 guidelines selected from 11 participating countries were evaluated independently by 194 appraisers with the instrument. Following refinement the instrument was further field tested on three guidelines per country by a new set of 70 appraisers. The final version of the instrument contained 23 items grouped into six quality domains with a 4 point Likert scale to score each item (scope and purpose, stakeholder involvement, rigour of development, clarity and presentation, applicability, editorial independence). 95% of appraisers found the instrument useful for assessing guidelines. Reliability was acceptable for most domains (Cronbach's alpha 0.64-0.88). Guidelines produced as part of an established guideline programme had significantly higher scores on editorial independence and, after the publication of a national policy, had significantly higher quality scores on rigour of development (p<0.005). Guidelines with technical documentation had higher scores on that domain (p<0.0001). This is the first time an appraisal instrument for clinical practice guidelines has been developed and tested internationally. The instrument is sensitive to differences in important aspects of guidelines and can be used consistently and easily by a wide range of professionals from different backgrounds. The adoption of common standards should improve the consistency and quality of the reporting of guideline development worldwide and provide a framework to encourage international comparison of clinical practice guidelines.

Validation of NOCTI Instruments Using Vocational Education Completers of Florida Comprehensive High Schools. Final Report (April 9, 1979-June 30, 1980).

ERIC Educational Resources Information Center

Hill, Raymond; Klein, Raymond S.

A study examined the feasibility of adopting National Occupational Competency Testing Institute (NOCTI) examinations for use by completers of vocational programs in Florida comprehensive high schools. A total of 34 candidates in five occupational areas (architectural drafting, carpentry, plumbing, small engine repair, and welding) at four…

Visual Scanning: Comparisons Between Student and Instructor Pilots. Final Report.

ERIC Educational Resources Information Center

DeMaio, Joseph; And Others

The performance of instructor pilots and student pilots was compared in two visual scanning tasks. In the first task both groups were shown slides of T-37 instrument displays in which errors were to be detected. Instructor pilots detected errors faster and with greater accuracy than student pilots, thus providing evidence for the validity of the…

A Validated Methodology for Determination of Laboratory Instrument Computer Interface Efficacy.

DTIC Science & Technology

1984-12-10

Final report for period 12/15/83-12/05/84 Prepared for DTIC TRIMIS PROGRAM OFFICE ELECT I" 5401 Westbard Avenue JN 18 Bethesda, Maryland 20816 JN0 2...NAME AND ADDRESS 12. REPORT DATE *TRIMIS PROGRAM OFFICE December 10, 1984 6 5401 Westbard Avenue 13. NUMBEROF PAGES Bethesda. Maryland 20816 30 14

Development and psychometric evaluation of the Premarital Sexual Behavior Assessment Scale for Young Women (PSAS-YW): an exploratory mixed method study.

PubMed

Rahmani, Azam; Merghati-Khoei, Effat; Moghadam-Banaem, Lida; Hajizadeh, Ebrahim; Hamdieh, Mostafa; Montazeri, Ali

2014-06-13

Premarital sexual behaviors are important issue for women's health. The present study was designed to develop and examine the psychometric properties of a scale in order to identify young women who are at greater risk of premarital sexual behavior. This was an exploratory mixed method investigation. Indeed, the study was conducted in two phases. In the first phase, qualitative methods (focus group discussion and individual interview) were applied to generate items and develop the questionnaire. In the second phase, psychometric properties (validity and reliability) of the questionnaire were assessed. In the first phase an item pool containing 53 statements related to premarital sexual behavior was generated. In the second phase item reduction was applied and the final version of the questionnaire containing 26 items was developed. The psychometric properties of this final version were assessed and the results showed that the instrument has a good structure, and reliability. The results from exploratory factory analysis indicated a 5-factor solution for the instrument that jointly accounted for the 57.4% of variance observed. The Cronbach's alpha coefficient for the instrument was found to be 0.87. This study provided a valid and reliable scale to identify premarital sexual behavior in young women. Assessment of premarital sexual behavior might help to improve women's sexual abstinence.

Development and psychometric evaluation of the Premarital Sexual Behavior Assessment Scale for Young Women (PSAS-YW): an exploratory mixed method study

PubMed Central

2014-01-01

Background Premarital sexual behaviors are important issue for women’s health. The present study was designed to develop and examine the psychometric properties of a scale in order to identify young women who are at greater risk of premarital sexual behavior. Method This was an exploratory mixed method investigation. Indeed, the study was conducted in two phases. In the first phase, qualitative methods (focus group discussion and individual interview) were applied to generate items and develop the questionnaire. In the second phase, psychometric properties (validity and reliability) of the questionnaire were assessed. Results In the first phase an item pool containing 53 statements related to premarital sexual behavior was generated. In the second phase item reduction was applied and the final version of the questionnaire containing 26 items was developed. The psychometric properties of this final version were assessed and the results showed that the instrument has a good structure, and reliability. The results from exploratory factory analysis indicated a 5-factor solution for the instrument that jointly accounted for the 57.4% of variance observed. The Cronbach’s alpha coefficient for the instrument was found to be 0.87. Conclusion This study provided a valid and reliable scale to identify premarital sexual behavior in young women. Assessment of premarital sexual behavior might help to improve women’s sexual abstinence. PMID:24924696

Transcultural adaptation to Spanish of the instrument "Effectiveness of Auditory Rehabilitation" for the assessment of quality of life in patients using hearing aids.

PubMed

Cardemil, Felipe; Esquivel, Patricia; Aguayo, Lorena; Barría, Tamara; Fuente, Adrian; Carvajal, Rocío; Fromín, Rose; Villalobos, Iván; Yueh, Bevan

2013-01-01

It is becoming increasingly important to have reliable and valid questionnaires. This becomes especially important when evaluating hearing loss. the "Effectiveness of Auditory Rehabilitation" (EAR) questionnaire for the Spanish-speaking population. This instrument assesses quality of life and hearing aspects in patients using hearing aids. Cross-sectional validation study. A cultural adaptation through the use of English to Spanish translations and re-translations was carried out. The validity and reliability of the newly adapted instrument were evaluated. A total of 69 individuals (44 older adults and 25 younger adults) were examined. The pure-tone averages (PTA, 500, 1,000 and 2,000 Hz) were 47.3 dB HL and 47.1 dB HL for the left and right ears, respectively. The mean maximum speech discrimination in silence for monosyllables were 83.3% and 82.9% for the left and right ears, respectively. Internal consistency presented Cronbach alpha values of 0.85 and 0.77 for the internal and external dimensions, respectively. The intraclass correlation coefficients were 0.80 for the internal module and 0.85 for the external module. Construct validity reported a correlation coefficient of 0.71 at baseline and 0.76 at 3 months after the initial assessment for the internal module, and 0.62 at baseline and 0.74 at 3 months after the initial assessment for the external module. The size effects were 1.3 and 1.1 for the internal and external modules, respectively. The Spanish version of the EAR questionnaire seems to be a reliable and valid instrument. The evaluation of audiological aspects, as well as aspects relating to aesthetics and comfort are the main strengths of this instrument. Finally, the EAR scale is more sensitive to change than other scales. Copyright © 2013 Elsevier España, S.L. All rights reserved.

[The scale of social provisions: their validation in Quebec].

PubMed

Caron, J

1996-01-01

This article presents the results of the Quebec validation of the Social Provisions Scale (Cutrona et Russell, 1989). L'échelle de provision sociales was administered to 790 people on the course of two studies. The first one included 387 university students of first level and the second was realized with 266 people from the general population, 79 welfare recipients and 58 persons with a diagnosis related to psychosis. The results show that the scale presents a good internal coherence and a satisfying temporal stability, thus assuring the fidelity of the instrument. The factorial analyses have not reproduced exactly the same profile as the original instrument, however the moderate correlations between the different social provisions sustain the validity of the multidimensional construct of social support. Moreover, analyses of the variance and the discriminating analysis allow to acknowledge that the sub-scales have a high discriminating power; they allow to distinguish the general population from welfare recipients and people suffering from psychosis. Finally, norms are presented for the general population.

The Youth Throwing Score: Validating Injury Assessment in Young Baseball Players.

PubMed

Ahmad, Christopher S; Padaki, Ajay S; Noticewala, Manish S; Makhni, Eric C; Popkin, Charles A

2017-02-01

Epidemic levels of shoulder and elbow injuries have been reported recently in youth and adolescent baseball players. Despite the concerning frequency of these injuries, no instrument has been validated to assess upper extremity injury in this patient population. Purpose/Hypothesis: The purpose of this study was to validate an upper extremity assessment tool specifically designed for young baseball players. We hypothesized that this tool will be both reliable and valid. Cohort study (diagnosis); Level of evidence, 2. The Youth Throwing Score (YTS) was constructed by an interdisciplinary team of providers and coaches as a tool to assess upper extremity injury in youth and adolescent baseball players (age range, 10-18 years). The psychometric properties of the test were then determined. A total of 223 players completed the final survey. The players' mean age was 14.3 ± 2.7 years. Pilot analysis showed that none of the 14 questions received a mean athlete importance rating less than 3 of 5, and the final survey read at a Flesch-Kincaid level of 4.1, which is appropriate for patients aged 9 years and older. The players self-assigned their injury status, resulting in a mean instrument score of 59.7 ± 8.4 for the 148 players "playing without pain," 42.0 ± 11.5 for the 60 players "playing with pain," and 40.4 ± 10.5 for the 15 players "not playing due to pain." Players playing without pain scored significantly higher than those playing with pain and those not playing due to pain ( P < .001). Psychometric analysis showed a test-retest intraclass correlation coefficient of 0.90 and a Cronbach alpha intra-item reliability coefficient of 0.93, indicating excellent reliability and internal consistency. Pearson correlation coefficients of 0.65, 0.62, and 0.31 were calculated between the YTS and the Pediatric Outcomes Data Collection Instrument sports/physical functioning module, the Kerlan-Jobe Orthopaedic Clinic Shoulder and Elbow score, and the Quick Disabilities of the Arm, Shoulder, and Hand (QuickDASH) score, respectively. Injured players scored a mean of 9.4 points higher after treatment ( P < .001), and players who improved in their self-assigned pain categorization scored 16.5 points higher ( P < .001). The YTS is the first valid and reliable instrument for assessing young baseball players' upper extremity health.

Internet Gaming Disorder Among Slovenian Primary Schoolchildren: Findings From a Nationally Representative Sample of Adolescents

PubMed Central

Pontes, Halley M.; Macur, Mirna; Griffiths, Mark D.

2016-01-01

Background and aims Since the inclusion of Internet Gaming Disorder (IGD) in the latest (fifth) edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) as a tentative disorder, a few psychometric screening instruments have been developed to assess IGD, including the 9-item Internet Gaming Disorder Scale – Short-Form (IGDS9-SF) – a short, valid, and reliable instrument. Methods Due to the lack of research on IGD in Slovenia, this study aimed to examine the psychometric properties of the IGDS9-SF in addition to investigating the prevalence rates of IGD in a nationally representative sample of eighth graders from Slovenia (N = 1,071). Results The IGDS9-SF underwent rigorous psychometric scrutiny in terms of validity and reliability. Construct validation was investigated with confirmatory factor analysis to examine the factorial structure of the IGDS9-SF and a unidimensional structure appeared to fit the data well. Concurrent and criterion validation were also investigated by examining the association between IGD and relevant psychosocial and game-related measures, which warranted these forms of validity. In terms of reliability, the Slovenian version IGDS9-SF obtained excellent results regarding its internal consistency at different levels, and the test appears to be a valid and reliable instrument to assess IGD among Slovenian youth. Finally, the prevalence rates of IGD were found to be around 2.5% in the whole sample and 3.1% among gamers. Discussion and conclusion Taken together, these results illustrate the suitability of the IGDS9-SF and warrants further research on IGD in Slovenia. PMID:27363464

Understanding the Patient Perspective of Seizure Severity in Epilepsy: Development of a Conceptual Model.

PubMed

Borghs, Simon; Tomaszewski, Erin L; Halling, Katarina; de la Loge, Christine

2016-10-01

For patients with uncontrolled epilepsy, the severity and postictal sequelae of seizures might be more impactful than their frequency. Seizure severity is often assessed using patient-reported outcome (PRO) instruments; however, evidence of content validity for existing instruments is lacking. Our aim was to understand the real-life experiences of patients with uncontrolled epilepsy. A preliminary conceptual model was developed. The model was refined through (1) a targeted literature review of qualitative research on seizure severity; (2) interviews with four clinical epilepsy experts to evaluate identified concepts; and (3) qualitative interviews with patients with uncontrolled epilepsy, gathering descriptions of symptoms and impacts of epilepsy, focusing on how patients experience and describe "seizure severity." Findings were summarized in a final conceptual model of seizure severity in epilepsy. Twenty-five patients (12 who experienced primary generalized tonic-clonic seizures and 13 who experienced partial-onset seizures) expressed 42 different symptoms and 26 different impacts related to seizures. The final conceptual model contained a wide range of concepts related to seizure frequency, symptoms, and duration. Our model identified several new concepts that characterize the patient experience of seizure severity. A seizure severity PRO instrument should cover a wide range of seizure symptoms alongside frequency and duration of seizures. This qualitative work reinforces the notion that measuring seizure frequency is insufficient and that seizure severity is important in defining the patient's experience of epilepsy. This model could be used to assess the content validity of existing PRO instruments, or could support the development of a new one.

Linguistic and clinical validation of the Arabic-translated Aberdeen Menorrhagia Severity Scale as an indicator of quality of life for women with abnormal uterine bleeding.

PubMed

Abu-Rafea, Basim F; Vilos, George A; Al Jasser, Rakia S; Al Anazy, Reem M; Javaid, Khalida; Al-Mandeel, Hazem M

2012-08-01

To develop a conceptually and semantically valid Arabic version of a validated disease-specific instrument of quality of life (QoL) for women with abnormal uterine bleeding (AUB). This is a prospective cohort study conducted at the Department of Obstetrics & Gynecology, King Saud University, Riyadh, Kingdom of Saudi Arabia between December 2010 and December 2011 following ethics approval. Forward translation of the Aberdeen Menorrhagia Severity Scale (AMSS) from English into Arabic was followed by backward translation of the consensus target (Arabic) version into the source (English) language. Subsequently, a final target (Arabic) language version was created. Sixty-one Arabic-speaking women of reproductive age participated in the study. The final Arabic questionnaire was administered to 41 women with self-perceived normal menses (Group 1) on 2 occasions 2 weeks apart. Agreement in the answers deems the questionnaire reliable. The final Arabic version was administered to 20 women with self-perceived AUB (Group 2), and their scores were compared with the first response of Group 1. A significant difference between the groups deems the questionnaire valid. For linguistic validation; intra-class correlation coefficient (ICC) of 0.87 and Kappa statistics of 0.56 to 0.87 indicated good to excellent agreement. For clinical validation, there was a significant difference between Group 1 and 2 (p=0.001). The translated Arabic AMSS is a reliable and valid indicator of QoL in Saudi women with AUB.

Development of Mother’s Lifestyle Scale during Pregnancy with an Approach to Social Determinants of Health

PubMed Central

Mahmoodi, Zohreh; Karimlou, Masoud; Sajjadi, Homeira; Dejman, Masoumeh; Vameghi, Meroe

2013-01-01

Background and Objective: The present study was conducted to design and measure psychometrics of mothers’ lifestyle scale during pregnancy with regards to Iranians’ cultural norms and an approach to social determinants. Method: this study, started by reviewing previous studies and exploring similar questionnaires that examine different domains of lifestyle (nutrition, exercising, self-care, smoking, using alcohol and illegal drugs, social relations, and stress control), then besides translating questions of the questionnaires, content of some questions was modified and proper statements with regards to social determinant of health and Iranian cultural, was used. Secondly, the validity of the designed instruments was determined using face, content, criterion, and construct validity. Thirdly, the reliability of the measurement instruments was examined using Cronbach’s alpha. Participants were Healthy Iranian pregnant women (37-42 week) who refer to selected hospital for delivery. Results: In the first step of the study, of the 222 questions obtained from a review of the related instruments, certain questions were omitted due to their irrelevance to social determinants of health and finally 160 questions were selected in 10 sections. After determining the face and content validity qualitatively and quantitatively and exploratory factor analysis, the number of questionnaire items was reduced to 132. Calculation of Cronbach’s alpha confirmed the high internal consistency (0.76) of the questionnaire. Conclusion: This measurement instrument was designed in the context of the Iranian culture and sounded suitable for studying the pregnant women’s lifestyle due to its appropriate validity and reliability, simplicity, and functionality in different situations. PMID:23618491

Iranian Effective Clinical Nurse Instructor evaluation tool: Development and psychometric testing

PubMed Central

Shahsavari, Hooman; Yekta, Zohreh Parsa; Zare, Zahra; Sigaroodi, Abdolhossain Emami

2014-01-01

Background: Clinical education is the heart of the nursing education program. Effective nursing clinical instructors are needed for graduating the future qualified nurses. There is a well-developed body of knowledge about the effectiveness of clinical teaching and the instructors. However, translating this knowledge into a context-based evaluation tool for measuring the effectiveness of Iranian clinical nursing instructors remains a deficiency. The purpose of this study is to describe the development and psychometric testing process of an instrument to evaluate the characteristics of Iranian effective clinical nurse instructor. Materials and Methods: Following a precise review of Iranian literatures and expert consultation, 83 statements about the characteristics that make clinical nurse instructors effective were extracted. In the next phase, the psychometric properties of the instrument were established by looking at the content validity, face validity, and internal consistency. Content validity of the instrument was assessed based on the comments of an expert panel including 10 nursing faculty members. During this phase, 30 items of the instrument were omitted or merged. Face validity of the instrument was assured based on the advices of 10 nursing students and 10 nursing faculty members. Finally, in the pilot test, the data of 168 filled questionnaires were gathered and analyzed by an exploratory factor analysis to reduce the items and identify the factor structure of the instrument. Results: Through subsequent analyses, of the 83 items, 31 items were merged or omitted. At last, 52 retained items were divided into four subscales including student-centric behaviors, clinical performances, planning ability, and personality traits. The Cronbach's alpha level of the inventory was 0.96, with the value for each domain ranging from 0.87 to 0.94. Conclusions: Iranian Effective Clinical Nurse Instructor evaluation tool has acceptable psychometric properties and can be used in evaluating the effectiveness of clinical nursing instructors. PMID:24834081

A qualitative approach to assessing work ability.

PubMed

Tengland, Per-Anders

2013-01-01

We often need to be able to assess the extent to which individuals have or lack work ability. For this we need instruments. Most of the instruments available have flaws. They either lack validity or they use roundabout methods when collecting information about the individual's work ability. The aim of this paper is to present a conceptual model for constructing a questionnaire that can be used for assessing work ability. The methods used are philosophical, i.e. analytical and deductive. A conceptual theory is provided, and based on the resulting definition of the concept of "work ability" conclusions are drawn regarding how to assess work ability. When constructing quantitative instruments, we can increase validity through using a more strict definition of work ability. However, such an approach will only solve some of the problems noted above. The proposal is, instead, to create a qualitative questionnaire, founded on a definition of "work ability", which focuses on the concrete problems concerning the work ability of the individual. Finally, a sketch of such an instrument is provided, with questions covering all the relevant aspects of work ability. The qualitative questionnaire proposed is believed to be superior to more traditional (quantitative) instruments for assessing a person's work ability, as well as for finding solutions to her problems concerning work ability.

Development and validation of the Vellore Occupational Therapy Evaluation Scale to assess functioning in people with mental illness.

PubMed

Samuel, Reema; Russell, Paul Ss; Paraseth, Tapan Kumar; Ernest, Sharmila; Jacob, K S

2016-08-26

Available occupational therapy assessment scales focus on specific areas of functioning. There is a need for comprehensive evaluation of diverse aspects of functioning in people with mental illness. To develop a comprehensive assessment scale to evaluate diverse aspects of functioning among people with mental illness and to assess its validity and reliability. Available instruments, which evaluate diverse aspects of functioning in people with mental illness, were retrieved. Relevant items, which evaluate specific functions, were selected by a committee of mental health experts and combined to form a comprehensive instrument. Face and content validity and feasibility were assessed and the new instrument was piloted among 60 patients with mental illness. The final version of the instrument was employed in 151 consecutive clients, between 18 and 60 years of age, who were also assessed using Global Assessment of Functioning (GAF), Occupational Therapy Task Observation Scale (OTTOS), Social Functioning Questionnaire (SFQ), Rosenberg Self Esteem Scale (RSES) and Pai and Kapur Family Burden Interview Schedule (FBIS) by two therapists. The inter-rater reliability and test-retest reliability of the new instrument (Vellore Occupational Therapy Evaluation Scale (VOTES)) were also evaluated. The new scale had good internal consistency (Cronbach's alpha = .817), inter-rater reliability .928 (.877-.958) and test-retest reliability .928 (.868-.961). The correlation between the general behaviour domain (Pearson's Correlation Coefficient [PCC] = -.763, p = .000), task behaviour (PCC = -.829, p = .000), social skills (PCC = -.351, p = .000), intrapersonal skills (PCC = -.208, p = .010), instrumental activities of daily living (IADL) (PCC = -.329, p = .038) and leisure activities (PCC = -.433, p = .005) scores of VOTES with the corresponding domains in the scales used for comparison was statistically significant. The correlation between the total score of VOTES and the total scores of OTTOS, SFQ and RSES was also statistically significant suggesting convergent validity. The correlation between the total score of VOTES with the total score of FBI is not statistically significant, implying good divergent validity. VOTES seems to be a promising tool to assess overall functioning of people with mental illness. © The Author(s) 2016.

Development and validation of an objective instrument to measure surgical performance at tonsillectomy.

PubMed

Roberson, David W; Kentala, Erna; Forbes, Peter

2005-12-01

The goals of this project were 1) to develop and validate an objective instrument to measure surgical performance at tonsillectomy, 2) to assess its interobserver and interobservation reliability and construct validity, and 3) to select those items with best reliability and most independent information to design a simplified form suitable for routine use in otolaryngology surgical evaluation. Prospective, observational data collection for an educational quality improvement project. The evaluation instrument was based on previous instruments developed in general surgery with input from attending otolaryngologic surgeons and experts in medical education. It was pilot tested and subjected to iterative improvements. After the instrument was finalized, a total of 55 tonsillectomies were observed and scored during academic year 2002 to 2003: 45 cases by residents at different points during their rotation, 5 by fellows, and 5 by faculty. Results were assessed for interobserver reliability, interobservation reliability, and construct validity. Factor analysis was used to identify items with independent information. Interobserver and interobservation reliability was high. On technical items, faculty substantially outperformed fellows, who in turn outperformed residents (P < .0001 for both comparisons). On the "global" scale (overall assessment), residents improved an average of 1 full point (on a 5 point scale) during a 3 month rotation (P = .01). In the subscale of "patient care," results were less clear cut: fellows outperformed residents, who in turn outperformed faculty, but only the fellows to faculty comparison was statistically significant (P = .04), and residents did not clearly improve over time (P = .36). Factor analysis demonstrated that technical items and patient care items factor separately and thus represent separate skill domains in surgery. It is possible to objectively measure surgical skill at tonsillectomy with high reliability and good construct validity. Factor analysis demonstrated that patient care is a distinct domain in surgical skill. Although the interobserver reliability for some patient care items reached statistical significance, it was not high enough for "high stakes testing" purposes. Using reliability and factor analysis results, we propose a simplified instrument for use in evaluating trainees in otolaryngologic surgery.

Development and validation of a quality of life questionnaire for patients with colostomy or ileostomy

PubMed Central

Prieto, Luis; Thorsen, Hanne; Juul, Kristian

2005-01-01

Background Quality of life of stoma patients is increasingly being addressed in clinical trials. However, the instruments used in the majority of these studies have not been validated specifically for stoma patients. The aim of this paper is to describe the development and validation of a quality-of-life instrument, "Stoma-QOL", specifically for patients with colostomy or ileostomy. Methods Potential items were formulated in English on the basis of the results of a series of semi-structured interviews with 169 adult stoma patients. The process resulted in a preliminary 37-item version, which was translated into French, German, Spanish and Danish, and administered repeatedly to 182 patients with colostomy or ileostomy. A psychometric selection of items was performed through Rasch Analysis. The measurement properties of the final questionnaire version were subsequently tested. Results The 20 items in the final questionnaire covered four domains – sleep, sexual activity, relations to family and close friends, and social relations to other than family and close friends. These items were found to define a unidimensional variable according to Rasch specifications (Infit MNSQ < 1.3). Internal consistency reliability calculated as Cronbach's alpha was 0.92, i.e., highly reliable. Spearman's correlation coefficients of scores across times of administration was >0.88 (p < 0.01), indicating a high test-retest reliability. Item calibrations by country calculated as ICC were 0.81 (0.67–0.91 95% CI), confirming cross-cultural comparability across the European countries included in the study. Conclusion Given the adequacy of the metric properties of the Stoma-QOL suggested by the psychometric analyses, this study confirms the suitability of the instrument in clinical practice and in clinical research. PMID:16219109

Development of an instrument to measure patient perception of the quality of nursing care and related hospital services at the national hospital of sri lanka.

PubMed

Senarat, Upul; Gunawardena, Nalika S

2011-06-01

This study aimed to develop and validate an instrument to measure patient perception of quality of nursing care and related hospital services in a tertiary care setting. We compiled an instrument with 72 items that patients may perceive as quality of nursing care and related hospital services, following an extensive literature search, discussions with patients and care pro-I viders and a brainstorming session with an expert panel. A cross-sectional study was conducted at the National Hospital of Sri Lanka. A sample (n = 120) of patients stayed in general surgical or medical units responded to the interviewer administered instrument upon discharge. Item analysis and principal component factor analysis were performed to assess validity, and internal consistency was calculated to measure reliability. Of the 72 items, 18 had greater than 20% of responses as 'not relevant'. A further 11 items were eliminated since item-total correlations were less than .2. Factor analysis was performed on remaining 43 items which resulted in 36 items classifying into eight factors accounting for 71% of the variation. Factor loadings in the final solution after Varimax rotation were interpersonal aspects (.68-.85), efficiency (.62-.79), competency (.66-.68), comfort (.60-.84), physical environment (.65-.82), cleanliness (.81-.85), personalized information (.76-.83), and general instructions (.61-.78). The instrument had high Internal consistency (Cronbach's alpha = .91). We developed a comprehensive, reliable and valid, 36-item instrument that may be used to measure patient perception of quality of nursing care in tertiary care settings. Copyright © 2011 Korean Society of Nursing Science. Published by Elsevier B.V. All rights reserved.

Developing a cultural competence inventory for nurses in China.

PubMed

Cai, D; Kunaviktikul, W; Klunklin, A; Sripusanapan, A; Avant, P K

2017-06-01

To develop and psychometrically test the Cultural Competence Inventory for Nurses in China. Cultural competence is expected worldwide from nurses due to the increasing cultural diversity of people in healthcare establishments. Yet, no cultural competence framework or instrument for nurses has been identified to guide nursing practice in China where the cultural diversity of the populations and the characteristics of the healthcare system are different from those of the West. A review of literature and individual interviews among nurse experts generated 74 items, which were evaluated by six experts in transcultural nursing. A stratified random sampling technique was used to recruit 520 Chinese nurses for the field test. Construct validity and internal consistency reliability of the instrument were estimated by exploratory factor analysis and Cronbach's alpha, respectively. The data were collected from May 2015 to January 2016. The final instrument consists of 29 items in five dimensions, namely 'cultural awareness, cultural respect, cultural knowledge, cultural understanding and cultural skills'. Cronbach's alpha for the instrument was 0.94, with a range of 0.79-0.92 for the individual dimensions. The evidence for contrast-group validity (P < 0.001) was also obtained. The study provides evidence that the Cultural Competence Inventory for Nurses in China is reliable, valid and culturally sensitive for measuring nurses' cultural competence. The instrument development process facilitates the understanding of cultural competence globally. Cultural competence of nurses can be evaluated for self-development, workforce management and quality assurance. The instrument can also serve as the foundation to develop education curricula and nursing procedures or protocols to improve culturally competent nursing practice. © 2017 International Council of Nurses.

Developing an instrument to measure effective factors on Clinical Learning.

PubMed

Dadgaran, Ideh; Shirazi, Mandana; Mohammadi, Aeen; Ravari, Ali

2016-07-01

Although nursing students spend a large part of their learning period in the clinical environment, clinical learning has not been perceived by its nature yet. To develop an instrument to measure effective factors on clinical learning in nursing students. This is a mixed methods study performed in 2 steps. First, the researchers defined "clinical learning" in nursing students through qualitative content analysis and designed items of the questionnaire based on semi-structured individual interviews with nursing students. Then, as the second step, psychometric properties of the questionnaire were evaluated using the face validity, content validity, construct validity, and internal consistency evaluated on 227 students from fourth or higher semesters. All the interviews were recorded and transcribed, and then, they were analyzed using Max Qualitative Data Analysis and all of qualitative data were analyzed using SPSS 14. To do the study, we constructed the preliminary questionnaire containing 102 expressions. After determination of face and content validities by qualitative and quantitative approaches, the expressions of the questionnaire were reduced to 45. To determine the construct validity, exploratory factor analysis was applied. The results indicated that the maximum variance percentage (40.55%) was defined by the first 3 factors while the rest of the total variance percentage (59.45%) was determined by the other 42 factors. Results of exploratory factor analysis of this questionnaire indicated the presence of 3 instructor-staff, students, and educational related factors. Finally, 41 expressions were kept in 3 factor groups. The α-Cronbach coefficient (0.93) confirmed the high internal consistency of the questionnaire. Results indicated that the prepared questionnaire was an efficient instrument in the study of the effective factors on clinical learning as viewed by nursing students since it involves 41 expressions and properties such as instrument design based on perception and experiences of the nursing students about effective factors on clinical learning, definition of facilitator and preventive factors of the clinical learning, simple scoring, suitable validity and reliability, and applicability in different occasions.

Psychometric instrumentation: reliability and validity of instruments used for clinical practice, evidence-based practice projects and research studies.

PubMed

Mayo, Ann M

2015-01-01

It is important for CNSs and other APNs to consider the reliability and validity of instruments chosen for clinical practice, evidence-based practice projects, or research studies. Psychometric testing uses specific research methods to evaluate the amount of error associated with any particular instrument. Reliability estimates explain more about how well the instrument is designed, whereas validity estimates explain more about scores that are produced by the instrument. An instrument may be architecturally sound overall (reliable), but the same instrument may not be valid. For example, if a specific group does not understand certain well-constructed items, then the instrument does not produce valid scores when used with that group. Many instrument developers may conduct reliability testing only once, yet continue validity testing in different populations over many years. All CNSs should be advocating for the use of reliable instruments that produce valid results. Clinical nurse specialists may find themselves in situations where reliability and validity estimates for some instruments that are being utilized are unknown. In such cases, CNSs should engage key stakeholders to sponsor nursing researchers to pursue this most important work.

Reporter-Interpreter-Manager-Educator (RIME) descriptive ratings as an evaluation tool in an emergency medicine clerkship.

PubMed

Ander, Douglas S; Wallenstein, Joshua; Abramson, Jerome L; Click, Lorie; Shayne, Philip

2012-10-01

Emergency Medicine (EM) clerkships traditionally assess students using numerical ratings of clinical performance. The descriptive ratings of the Reporter, Interpreter, Manager, and Educator (RIME) method have been shown to be valuable in other specialties. We hypothesized that the RIME descriptive ratings would correlate with clinical performance and examination scores in an EM clerkship, indicating that the RIME ratings are a valid measure of performance. This was a prospective cohort study of an evaluation instrument for 4(th)-year medical students completing an EM rotation. This study received exempt Institutional Review Board status. EM faculty and residents completed shift evaluation forms including both numerical and RIME ratings. Students completed a final examination. Mean scores for RIME and clinical evaluations were calculated. Linear regression models were used to determine whether RIME ratings predicted clinical evaluation scores or final examination scores. Four hundred thirty-nine students who completed the EM clerkship were enrolled in the study. After excluding items with missing data, there were 2086 evaluation forms (based on 289 students) available for analysis. There was a clear positive relationship between RIME category and clinical evaluation score (r(2)=0.40, p<0.01). RIME ratings correlated most strongly with patient management skills and least strongly with humanistic qualities. A very weak correlation was seen with RIME and final examination. We found a positive association between RIME and clinical evaluation scores, suggesting that RIME is a valid clinical evaluation instrument. RIME descriptive ratings can be incorporated into EM evaluation instruments and provides useful data related to patient management skills. Copyright © 2012 Elsevier Inc. All rights reserved.

The Miller Assessment for Preschoolers: A Longitudinal and Predictive Study. Final Report.

ERIC Educational Resources Information Center

Foundation for Knowledge in Development, Littleton, CO.

The study reported here sought to establish the predictive validity of the Miller Assessment for Preschoolers (MAP), an instrument designed to identify preschool children at risk for school-related problems in the primary years. Children (N=338) in 11 states who were originally tested in 1980 as part of the MAP standardization project were given a…

New resilience instrument for patients with cancer.

PubMed

Ye, Zeng Jie; Liang, Mu Zi; Li, Peng Fei; Sun, Zhe; Chen, Peng; Hu, Guang Yun; Yu, Yuan Liang; Wang, Shu Ni; Qiu, Hong Zhong

2018-02-01

Resilience is an important concept in the cancer literature and is a salient indicator of cancer survivorship. The aim of this study is to develop and validate a new resilience instrument that is specific to patients with cancer diagnosis (RS-SC) in Mainland China. First, a resilience framework was constructed for patients with cancer diagnosis. Second, items were formulated based on the framework to reflect different aspects of resilience. Third, two rounds of expert panel discussion were performed to select important and relevant items. Finally, two cross-sectional studies were conducted to evaluate the psychometric properties of this instrument. Fifty-one items were generated based on the resilience framework and the final 25-item RS-SC resulted in a five-factor solution including Generic Elements, Benefit Finding, Support and Coping, Hope for the Future and Meaning for Existence, accounting for 64.72% of the variance. The Cronbach's α of the RS-SC was 0.825 and the test-retest reliability was 0.874. The RS-SC is a brief and specific self-report resilience instrument for Chinese patients with cancer and shows sound psychometric properties in this study. The RS-SC has potential applications in both clinical practice and research with strength-based resiliency interventions.

Construct Validity and Reliability of a New Spanish Empathy Questionnaire for Children and Early Adolescents

PubMed Central

Richaud, Maria C.; Lemos, Viviana N.; Mesurado, Belen; Oros, Laura

2017-01-01

Empathy is a basic socio-emotional process of human development that involves the ability to perceive, share, and understand the emotional states of others. This process is essential to successful social functioning. However, despite its significance, empathy has been difficult to define and measure, particularly when incorporating both its emotional and cognitive aspects. The purpose of this study was to develop an Empathy Questionnaire for children aged 9–12 years based on a model of social cognitive neuroscience and to analyze its construct validity and reliability. This questionnaire aimed to integrate the following aspects: emotional contagion, self-other awareness, perspective-taking, emotional regulation, and empathic action. Three studies were conducted. Study 1 evaluated the discriminative power of the items and studied the underlying structure of the instrument using exploratory factor analysis. In Study 2, confirmatory factor analysis was performed to test the model obtained. Finally, the goal of Study 3 was to analyze the convergent and discriminant validity of the questionnaire and the internal consistency of its dimensions. The final version of the instrument contained 15 items that operationalized the previously listed dimensions. The results of the 3 studies indicated that the questionnaire had good validity and reliability. This study has important implications for research and clinical practice. Given its simplicity and brevity, this new self-report scale may work well as a screening method to evaluate the key psychological issues underlying numerous child behaviors that predict the success or failure of social relationships, individual quality of life, and mental well-being. PMID:28659848

Construct Validity and Reliability of a New Spanish Empathy Questionnaire for Children and Early Adolescents.

PubMed

Richaud, Maria C; Lemos, Viviana N; Mesurado, Belen; Oros, Laura

2017-01-01

Empathy is a basic socio-emotional process of human development that involves the ability to perceive, share, and understand the emotional states of others. This process is essential to successful social functioning. However, despite its significance, empathy has been difficult to define and measure, particularly when incorporating both its emotional and cognitive aspects. The purpose of this study was to develop an Empathy Questionnaire for children aged 9-12 years based on a model of social cognitive neuroscience and to analyze its construct validity and reliability. This questionnaire aimed to integrate the following aspects: emotional contagion, self-other awareness, perspective-taking, emotional regulation , and empathic action. Three studies were conducted. Study 1 evaluated the discriminative power of the items and studied the underlying structure of the instrument using exploratory factor analysis. In Study 2, confirmatory factor analysis was performed to test the model obtained. Finally, the goal of Study 3 was to analyze the convergent and discriminant validity of the questionnaire and the internal consistency of its dimensions. The final version of the instrument contained 15 items that operationalized the previously listed dimensions. The results of the 3 studies indicated that the questionnaire had good validity and reliability. This study has important implications for research and clinical practice. Given its simplicity and brevity, this new self-report scale may work well as a screening method to evaluate the key psychological issues underlying numerous child behaviors that predict the success or failure of social relationships, individual quality of life, and mental well-being.

Development and Validation of a Disease-Specific Instrument to Measure Diet-Targeted Quality of Life for Postoperative Patients with Esophagogastric Cancer.

PubMed

Honda, Michitaka; Wakita, Takafumi; Onishi, Yoshihiro; Nunobe, Souya; Miura, Akinori; Nishigori, Tatsuto; Kusanagi, Hiroshi; Yamamoto, Takatsugu; Boddy, Alexander; Fukuhara, Shunichi

2015-12-01

Patients who have undergone esophagectomy or gastrectomy have certain dietary limitations because of changes to the alimentary tract. This study attempted to develop a psychometric scale, named "Esophago-Gastric surgery and Quality of Dietary life (EGQ-D)," for assessment of impact of upper gastrointestinal surgery on diet-targeted quality of life. Using qualitative methods, the study team interviewed both patients and surgeons involved in esophagogastric cancer surgery, and we prepared an item pool and a draft scale. To evaluate the scale's psychometric reliability and validity, a survey involving a large number of patients was conducted. Items for the final scale were selected by factor analysis and item response theory. Cronbach's alpha was used for assessment of reliability, and correlations with the short form (SF)-12, esophagus and stomach surgery symptom scale (ES(4)), and nutritional indicators were analyzed to assess the criterion-related validity. Through multifaceted discussion and the pilot study, a draft questionnaire comprising 14 items was prepared, and a total of 316 patients were enrolled. On the basis of factor analysis and item response theory, six items were excluded, and the remaining eight items demonstrated strong unidimensionality for the final scale. Cronbach's alpha was 0.895. There were significant associations with all the subscale scores for SF-12, ES(4), and nutritional indicators. The EGQ-D scale has good contents and psychometric validity and can be used to evaluate disease-specific instrument to measure diet-targeted quality of life for postoperative patients with esophagogastric cancer.

The development and initial validation of the Decent Work Scale.

PubMed

Duffy, Ryan D; Allan, Blake A; England, Jessica W; Blustein, David L; Autin, Kelsey L; Douglass, Richard P; Ferreira, Joaquim; Santos, Eduardo J R

2017-03-01

Decent work is positioned as the centerpiece of the recently developed Psychology of Working Theory (PWT; Duffy, Blustein, Diemer, & Autin, 2016). However, to date, no instrument exists which assesses all 5 components of decent work from a psychological perspective. In the current study, we developed the Decent Work Scale (DWS) and demonstrated several aspects of validity with 2 samples of working adults. In Study 1 (N = 275), a large pool of items were developed and exploratory factor analysis was conducted resulting in a final 15-item scale with 5 factors/subscales corresponding to the 5 components of decent work: (a) physically and interpersonally safe working conditions, (b) access to health care, (c) adequate compensation, (d) hours that allow for free time and rest, and (e) organizational values that complement family and social values. In Study 2 (N = 589), confirmatory factor analysis demonstrated that a 5-factor, bifactor model offered the strongest and most parsimonious fit to the data. Configural, metric, and scalar invariance models were tested demonstrating that the structure of the instrument did not differ across gender, income, social class, and majority/minority racial/ethnic groups. Finally, the overall scale score and 5 subscale scores correlated in the expected directions with similar constructs supporting convergent and discriminant evidence of validity, and subscale scores evidenced predictive validity in the prediction of job satisfaction, work meaning, and withdrawal intentions. The development of this scale provides a useful tool for researchers and practitioners seeking to assess the attainment of decent work among employed adults. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

A core competency model for Chinese baccalaureate nursing graduates: a descriptive correlational study in Beijing.

PubMed

Yang, Fang Yu; Zhao, Rong Rong; Liu, Yi Si; Wu, Ying; Jin, Ning Ning; Li, Rui Ying; Shi, Shu Ping; Shao, Yue Ying; Guo, Ming; Arthur, David; Elliott, Malcolm

2013-12-01

A review of the literature showed that the core competencies needed by newly graduated Chinese nurses were not as of yet undocumented. To develop a psychometrically sound instrument for identifying and measuring the core competencies needed by Chinese nursing baccalaureate graduates. Descriptive correlational and multicentre study. Seven major tertiary teaching hospitals and three major medical universities in Beijing. 790 subjects, including patients, nursing faculty members, doctors and nurses. A reliable and valid self-report instrument, consisting of 58 items, was developed using multiple methods. It was then distributed to 790 subjects to measure nursing competency in a broader Chinese context. The psychometric characteristics of reliability and validity were supported by descriptive and inferential analyses. The final instrument consists of six dimensions with 47 items. The content validity index was 0.90. The overall scale reliability was 0.97 with dimensions range from 0.87 to 0.94. Six domains of core competencies were identified: professionalism; direct care; support and communication; application of professional knowledge; personal traits; and critical thinking and innovation. The findings of this study provide valuable evidence for a psychometrically sound measurement tool, as well as for competency-based nursing curriculum reform. Copyright © 2013 Elsevier Ltd. All rights reserved.

Passive Markers for Tracking Surgical Instruments in Real-Time 3-D Ultrasound Imaging

PubMed Central

Stoll, Jeffrey; Ren, Hongliang; Dupont, Pierre E.

2013-01-01

A family of passive echogenic markers is presented by which the position and orientation of a surgical instrument can be determined in a 3-D ultrasound volume, using simple image processing. Markers are attached near the distal end of the instrument so that they appear in the ultrasound volume along with the instrument tip. They are detected and measured within the ultrasound image, thus requiring no external tracking device. This approach facilitates imaging instruments and tissue simultaneously in ultrasound-guided interventions. Marker-based estimates of instrument pose can be used in augmented reality displays or for image-based servoing. Design principles for marker shapes are presented that ensure imaging system and measurement uniqueness constraints are met. An error analysis is included that can be used to guide marker design and which also establishes a lower bound on measurement uncertainty. Finally, examples of marker measurement and tracking algorithms are presented along with experimental validation of the concepts. PMID:22042148

PANIC: A General-purpose Panoramic Near-infrared Camera for the Calar Alto Observatory

NASA Astrophysics Data System (ADS)

Cárdenas Vázquez, M.-C.; Dorner, B.; Huber, A.; Sánchez-Blanco, E.; Alter, M.; Rodríguez Gómez, J. F.; Bizenberger, P.; Naranjo, V.; Ibáñez Mengual, J.-M.; Panduro, J.; García Segura, A. J.; Mall, U.; Fernández, M.; Laun, W.; Ferro Rodríguez, I. M.; Helmling, J.; Terrón, V.; Meisenheimer, K.; Fried, J. W.; Mathar, R. J.; Baumeister, H.; Rohloff, R.-R.; Storz, C.; Verdes-Montenegro, L.; Bouy, H.; Ubierna, M.; Fopp, P.; Funke, B.

2018-02-01

PANIC7 is the new PAnoramic Near-Infrared Camera for Calar Alto and is a project jointly developed by the MPIA in Heidelberg, Germany, and the IAA in Granada, Spain, for the German-Spanish Astronomical Center at Calar Alto Observatory (CAHA; Almería, Spain). This new instrument works with the 2.2 m and 3.5 m CAHA telescopes covering a field of view of 30 × 30 arcmin and 15 × 15 arcmin, respectively, with a sampling of 4096 × 4096 pixels. It is designed for the spectral bands from Z to K S , and can also be equipped with narrowband filters. The instrument was delivered to the observatory in 2014 October and was commissioned at both telescopes between 2014 November and 2015 June. Science verification at the 2.2 m telescope was carried out during the second semester of 2015 and the instrument is now at full operation. We describe the design, assembly, integration, and verification process, the final laboratory tests and the PANIC instrument performance. We also present first-light data obtained during the commissioning and preliminary results of the scientific verification. The final optical model and the theoretical performance of the camera were updated according to the as-built data. The laboratory tests were made with a star simulator. Finally, the commissioning phase was done at both telescopes to validate the camera real performance on sky. The final laboratory test confirmed the expected camera performances, complying with the scientific requirements. The commissioning phase on sky has been accomplished.

Assessing Chronic Illness Care Education (ACIC-E): a tool for tracking educational re-design for improving chronic care education.

PubMed

Bowen, Judith L; Provost, Lloyd; Stevens, David P; Johnson, Julie K; Woods, Donna M; Sixta, Connie S; Wagner, Edward H

2010-09-01

Recent Breakthrough Series Collaboratives have focused on improving chronic illness care, but few have included academic practices, and none have specifically targeted residency education in parallel with improving clinical care. Tools are available for assessing progress with clinical improvements, but no similar instruments have been developed for monitoring educational improvements for chronic care education. To design a survey to assist teaching practices with identifying curricular gaps in chronic care education and monitor efforts to address those gaps. During a national academic chronic care collaborative, we used an iterative method to develop and pilot test a survey instrument modeled after the Assessing Chronic Illness Care (ACIC). We implemented this instrument, the ACIC-Education, in a second collaborative and assessed the relationship of survey results with reported educational measures. A combined 57 self-selected teams from 37 teaching hospitals enrolled in one of two collaboratives. We used descriptive statistics to report mean ACIC-E scores and educational measurement results, and Pearson's test for correlation between the final ACIC-E score and reported educational measures. A total of 29 teams from the national collaborative and 15 teams from the second collaborative in California completed the final ACIC-E. The instrument measured progress on all sub-scales of the Chronic Care Model. Fourteen California teams (70%) reported using two to six education measures (mean 4.3). The relationship between the final survey results and the number of educational measures reported was weak (R(2) = 0.06, p = 0.376), but improved when a single outlier was removed (R(2) = 0.37, p = 0.022). The ACIC-E instrument proved feasible to complete. Participating teams, on average, recorded modest improvement in all areas measured by the instrument over the duration of the collaboratives. The relationship between the final ACIC-E score and the number of educational measures was weak. Further research on its utility and validity is required.

Translation and validation of the assistive technology device predisposition assessment in Greek in order to assess satisfaction with use of the selected assistive device.

PubMed

Koumpouros, Yiannis; Papageorgiou, Effie; Karavasili, Alexandra; Alexopoulou, Despoina

2017-07-01

To examine the Assistive Technology Device Predisposition Assessment scale and provide evidence of validity and reliability of the Greek version. We translated and adapted the original instrument in Greek according to the most well-known guidelines recommendations. Field test studies were conducted in a rehabilitation hospital to validate the appropriateness of the final results. Ratings of the different items were statistically analyzed. We recruited 115 subjects who were administered the Form E of the original questionnaire. The experimental analysis conducted revealed a three subscales structure: (i) Adaptability, (ii) Fit to Use, and (iii) Socializing. According to the results of our study the three subscales measure different constructs. Reliability measures (ICC = 0.981, Pearson's correlation = 0.963, Cronbach's α = 0.701) yielded high values. Test-retest outcome showed great stability. This is the first study, at least to the knowledge of the authors, which focuses merely on measuring the satisfaction of the users from the used assistive device, while exploring the Assistive Technology Device Predisposition Assessment - Device Form in such depth. According to the results, it is a stable, valid and reliable instrument and applicable to the Greek population. Thus, it can be used to measure the satisfaction of patients with assistive devices. Implications for Rehabilitation The paper explores the cultural adaptability and applicability of ATD PA - Device Form. ATD PA - Device Form can be used to assess user satisfaction by the selected assistive device. ATD PA - Device Form is a valid and reliable instrument in measuring users' satisfaction in Greekreality.

Diagnosing Students' Understanding of the Nature of Models

NASA Astrophysics Data System (ADS)

Gogolin, Sarah; Krüger, Dirk

2017-10-01

Students' understanding of models in science has been subject to a number of investigations. The instruments the researchers used are suitable for educational research but, due to their complexity, cannot be employed directly by teachers. This article presents forced choice (FC) tasks, which, assembled as a diagnostic instrument, are supposed to measure students' understanding of the nature of models efficiently, while being sensitive enough to detect differences between individuals. In order to evaluate if the diagnostic instrument is suitable for its intended use, we propose an approach that complies with the demand to integrate students' responses to the tasks into the validation process. Evidence for validity was gathered based on relations to other variables and on students' response processes. Students' understanding of the nature of models was assessed using three methods: FC tasks, open-ended tasks and interviews ( N = 448). Furthermore, concurrent think-aloud protocols ( N = 30) were performed. The results suggest that the method and the age of the students have an effect on their understanding of the nature of models. A good understanding of the FC tasks as well as a convergence in the findings across the three methods was documented for grades eleven and twelve. This indicates that teachers can use the diagnostic instrument for an efficient and, at the same time, valid diagnosis for this group. Finally, the findings of this article may provide a possible explanation for alternative findings from previous studies as a result of specific methods that were used.

Measuring conflict management, emotional self-efficacy, and problem solving confidence in an evaluation of outdoor programs for inner-city youth in Baltimore, Maryland.

PubMed

Caldas, Stephanie V; Broaddus, Elena T; Winch, Peter J

2016-08-01

Substantial evidence supports the value of outdoor education programs for promoting healthy adolescent development, yet measurement of program outcomes often lacks rigor. Accurately assessing the impacts of programs that seek to promote positive youth development is critical for determining whether youth are benefitting as intended, identifying best practices and areas for improvement, and informing decisions about which programs to invest in. We generated brief, customized instruments for measuring three outcomes among youth participants in Baltimore City Outward Bound programs: conflict management, emotional self-efficacy, and problem solving confidence. Measures were validated through exploratory and confirmatory factor analyses of pilot-testing data from two groups of program participants. We describe our process of identifying outcomes for measurement, developing and adapting measurement instruments, and validating these instruments. The finalized measures support evaluations of outdoor education programs serving urban adolescent youth. Such evaluations enhance accountability by determining if youth are benefiting from programs as intended, and strengthen the case for investment in programs with demonstrated success. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and validation of the Vietnamese primary care assessment tool.

PubMed

Hoa, Nguyen Thi; Tam, Nguyen Minh; Peersman, Wim; Derese, Anselme; Markuns, Jeffrey F

2018-01-01

To adapt the consumer version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity. A quantitative cross sectional study. 56 communes in 3 representative provinces of central Vietnam. Total of 3289 people who used health care services at health facility at least once over the past two years. The Vietnamese adult expanded consumer version of the PCAT (VN PCAT-AE) is an instrument for evaluation of primary care in Vietnam with 70 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. Sixteen other items from the original tool were not included in the final instrument, due to problems with missing values, floor or ceiling effects, and item-total correlations. All the retained scales have a Cronbach's alpha above 0.70 except for the subscale of Family Centeredness. The VN PCAT-AE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the consumer perspective. Additional work in the future to optimize valid measurement in all domains consistent with the original version of the tool may be helpful as the primary care system in Vietnam further develops.

Development and validation of the Healthy-Unhealthy Music Scale

PubMed Central

Saarikallio, Suvi; Gold, Christian; McFerran, Katrina

2015-01-01

Background Music is an integral part of life in youth, and although it has been acknowledged that musical behavior reflects broader psychosocial aspects of adolescent behavior, no measurement instruments have been specifically designed for assessing musical engagement as an indicator of adolescent wellbeing and/or symptomatology. This study was conducted in order to develop and validate a scale for assessing musical engagement as an indicator of proneness for depression in youth. Method Items were developed based on the literature and a prior grounded theory analysis and three surveys (N = 54, N = 187, N = 211) were conducted to select, refine, test, and validate the items. Scale structure was investigated through interitem correlations, exploratory and confirmatory factor analyses (EFA, CFA), and concurrent validity was tested with correlations to depression and wellbeing. Results The final Healthy-Unhealthy Music Scale (HUMS) consists of 13 items that are divided into Healthy and Unhealthy subscales. Cronbach's alpha coefficients were .78 for Healthy and .83 for Unhealthy. The concurrent validity of the HUMS was confirmed through correlations to wellbeing, happiness and school satisfaction on one hand and depression, rumination, and stress on the other. Conclusions The HUMS is as a promising instrument for screening musical engagement that is indicative of proneness for depression in youth. PMID:26726295

[Translation and validation of the Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0) into Portuguese].

PubMed

de Carvalho, Karla Emanuelle Cotias; Gois Júnior, Miburge Bolívar; Sá, Katia Nunes

2014-01-01

To translate and validate the Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0) into Brazilian Portuguese. Certified translators translated and back-translated Quest. Content validity (CVI) was determined by 5 experts and, after the final version of B-Quest, a pre-test was applied to users of manual wheelchairs, walkers and crutches. The psychometric properties were tested to assure the validity of items and the reliability and stability of the scale. Data were obtained from 121 users of the above-mentioned devices. Our study showed a CVI of 91.66% and a satisfactory factor analysis referent to the two-dimensional structure of the instrument that ensured the representativeness of the items. The Cron-bach's alpha of the items device, service and total score of B-Quest were 0.862, 0.717 and 0.826, respectively. Test-retest stability conducted after a time interval of 2 months was analyzed using Spearman's correlation test, which showed high correlation (ρ >0.6) for most items. The study suggests that the B-Quest is a reliable, representative, and valid instrument to measure the satisfaction of users of assistive technology in Brazil. Copyright © 2014 Elsevier Editora Ltda. All rights reserved.

Development and Psychometric Evaluation of the HPV Clinical Trial Survey for Parents (CTSP-HPV) Using Traditional Survey Development Methods and Community Engagement Principles.

PubMed

Cunningham, Jennifer; Wallston, Kenneth A; Wilkins, Consuelo H; Hull, Pamela C; Miller, Stephania T

2015-12-01

This study describes the development and psychometric evaluation of HPV Clinical Trial Survey for Parents with Children Aged 9 to 15 (CTSP-HPV) using traditional instrument development methods and community engagement principles. An expert panel and parental input informed survey content and parents recommended study design changes (e.g., flyer wording). A convenience sample of 256 parents completed the final survey measuring parental willingness to consent to HPV clinical trial (CT) participation and other factors hypothesized to influence willingness (e.g., HPV vaccine benefits). Cronbach's a, Spearman correlations, and multiple linear regression were used to estimate internal consistency, convergent and discriminant validity, and predictively validity, respectively. Internal reliability was confirmed for all scales (a ≥ 0.70.). Parental willingness was positively associated (p < 0.05) with trust in medical researchers, adolescent CT knowledge, HPV vaccine benefits, advantages of adolescent CTs (r range 0.33-0.42), supporting convergent validity. Moderate discriminant construct validity was also demonstrated. Regression results indicate reasonable predictive validity with the six scales accounting for 31% of the variance in parents' willingness. This instrument can inform interventions based on factors that influence parental willingness, which may lead to the eventual increase in trial participation. Further psychometric testing is warranted. © 2015 Wiley Periodicals, Inc.

Integrating Validity Theory with Use of Measurement Instruments in Clinical Settings

PubMed Central

Kelly, P Adam; O'Malley, Kimberly J; Kallen, Michael A; Ford, Marvella E

2005-01-01

Objective To present validity concepts in a conceptual framework useful for research in clinical settings. Principal Findings We present a three-level decision rubric for validating measurement instruments, to guide health services researchers step-by-step in gathering and evaluating validity evidence within their specific situation. We address construct precision, the capacity of an instrument to measure constructs it purports to measure and differentiate from other, unrelated constructs; quantification precision, the reliability of the instrument; and translation precision, the ability to generalize scores from an instrument across subjects from the same or similar populations. We illustrate with specific examples, such as an approach to validating a measurement instrument for veterans when prior evidence of instrument validity for this population does not exist. Conclusions Validity should be viewed as a property of the interpretations and uses of scores from an instrument, not of the instrument itself: how scores are used and the consequences of this use are integral to validity. Our advice is to liken validation to building a court case, including discovering evidence, weighing the evidence, and recognizing when the evidence is weak and more evidence is needed. PMID:16178998

Content validation of terms and definitions in a wound glossary.

PubMed

Milne, Catherine T; Paine, Tim; Sullivan, Valerie; Sawyer, Allen

2011-12-01

A common language and lexicon provide the easiest means of mutual understanding. Inconsistency in terminology makes effective information exchange difficult. Previous studies identified the need to determine standard, accepted definitions for the vocabulary frequently used in wound care. The objective of this study was to establish content validation for these terms and develop an evidence-based glossary for this specialty. Members of the Association for the Advancement of Wound Care Quality of Care Task Force reviewed literature to determine glossary content generation and the associated literature-based definitions. Thirty-nine wound care professionals from wound care stakeholder professional organizations in the United States and Canada participated in the content validation process. Participants were asked to quantify the degree of validity using a 367-item, 4-point Likert-type scale. On a scale of 1 to 4, the mean score of the entire instrument was 3.84. The instrument's overall scale content validity index was 0.96. Terms with an item content validity index of less than 0.70 were removed from the glossary, leaving 365 items with established content validity. Qualitative data analysis revealed themes suggesting that enhanced communication between providers improves patient outcomes. The need for ongoing updates of the glossary was also identified. The wound care glossary in its finalized form proved valid. An evidence-based glossary bridges the chasm of miscommunication and nonstandardization so that wound care, as an emerging specialized medical science field, can move forward to optimize both process and clinical outcomes.

The physical therapy profile questionnaire (PTPQ): development, validation and pilot testing.

PubMed

Dizon, Janine Margarita R; Grimmer-Somers, Karen; Kumar, Saravana

2011-09-19

Country by country similarities and differences in physical therapy practice exists. Therefore, before updates in practice can be provided, such as trainings in evidence-based practice, it is necessary to identify the profile and nature of practice in a given country or setting. Following a search of the international literature, no appropriate tool was identified to collect and establish data to create the profile of physical therapy practice in the Philippines. We therefore developed, validated and pilot tested a survey instrument which would comprehensively describe the practice of physical therapy in the Philippines We used a mixed methods design to answer our study aims. A focus group interview was conducted among a group of physical therapists to establish the content and contexts of items to be included in the survey instrument. Findings were amalgamated with the information from the literature on developing survey instruments/questionnaires. A survey instrument was drafted and named as the Physical Therapy Profile Questionnaire (PTPQ). The PTPQ was then validated and pilot tested to a different group of physical therapists.The final version consisted of five separate parts namely (A) General information and demographics, (B) Practice Profile, (C) Treatment Preferences, (D) Bases for clinical work and (E) Bases for educational/research work. At present the PTPQ is relevant to the Philippines and could be used by any country which has a similar nature of practice with the Philippines. The Physical Therapy Practice Questionnaire (PTPQ) was shown to have good face and content validity among the Filipino physical therapists and their context of practice. It has also been found to be useful, easy to administer tool and in a format appealing to respondents. The PTPQ is expected to assist comprehensive data collection to create a profile of physical therapy practice in the Philippines.

Predictive validity evidence for medical education research study quality instrument scores: quality of submissions to JGIM's Medical Education Special Issue.

PubMed

Reed, Darcy A; Beckman, Thomas J; Wright, Scott M; Levine, Rachel B; Kern, David E; Cook, David A

2008-07-01

Deficiencies in medical education research quality are widely acknowledged. Content, internal structure, and criterion validity evidence support the use of the Medical Education Research Study Quality Instrument (MERSQI) to measure education research quality, but predictive validity evidence has not been explored. To describe the quality of manuscripts submitted to the 2008 Journal of General Internal Medicine (JGIM) medical education issue and determine whether MERSQI scores predict editorial decisions. Cross-sectional study of original, quantitative research studies submitted for publication. Study quality measured by MERSQI scores (possible range 5-18). Of 131 submitted manuscripts, 100 met inclusion criteria. The mean (SD) total MERSQI score was 9.6 (2.6), range 5-15.5. Most studies used single-group cross-sectional (54%) or pre-post designs (32%), were conducted at one institution (78%), and reported satisfaction or opinion outcomes (56%). Few (36%) reported validity evidence for evaluation instruments. A one-point increase in MERSQI score was associated with editorial decisions to send manuscripts for peer review versus reject without review (OR 1.31, 95%CI 1.07-1.61, p = 0.009) and to invite revisions after review versus reject after review (OR 1.29, 95%CI 1.05-1.58, p = 0.02). MERSQI scores predicted final acceptance versus rejection (OR 1.32; 95% CI 1.10-1.58, p = 0.003). The mean total MERSQI score of accepted manuscripts was significantly higher than rejected manuscripts (10.7 [2.5] versus 9.0 [2.4], p = 0.003). MERSQI scores predicted editorial decisions and identified areas of methodological strengths and weaknesses in submitted manuscripts. Researchers, reviewers, and editors might use this instrument as a measure of methodological quality.

An instrument based on protection motivation theory to predict Chinese adolescents' intention to engage in protective behaviors against schistosomiasis.

PubMed

Xiao, Han; Peng, Minjin; Yan, Hong; Gao, Mengting; Li, Jingjing; Yu, Bin; Wu, Hanbo; Li, Shiyue

2016-01-01

Further advancement in schistosomiasis prevention requires new tools to assess protective motivation, and promote innovative intervention program. This study aimed to develop and evaluate an instrument developed based on the Protection Motivation Theory (PMT) to predict protective behavior intention against schistosomiasis among adolescents in China. We developed the Schistosomiasis PMT Scale based on two appraisal pathways of protective motivation- threat appraisal pathway and coping appraisal pathway. Data from a large sample of middle school students ( n  = 2238, 51 % male, mean age 13.13 ± 1.10) recruited in Hubei, China was used to evaluated the validity and reliability of the scale. The final scale contains 18 items with seven sub-constructs. Cronbach's Alpha coefficients for the entire instrument was 0.76, and for the seven sub-constructs of severity, vulnerability, intrinsic reward, extrinsic reward, response efficacy, self-efficacy and response cost was 0.56, 0.82, 0.75, 0.80, 0.90, 0.72 and 0.70, respectively. The construct validity analysis revealed that the one level 7 sub-constructs model fitted data well (GFI = 0.98, CFI = 0.98, RMSEA = 0.03, Chi-sq/df = 3.90, p  < 0.001). Predictive validity showed that both the PMT instrument score and the 7 sub-construct scores were significantly correlated with the intention engaged in protective behavior against schistosomiasis ( p  < 0.05). This study provides a reliable and valid tool to measure protective motivation in schistosomiasis prevention control. Further studies are needed to develop more effective intervention programs for schistosomiasis prevention.

Achievement-Relevant Personality: Relations with the Big Five and Validation of an Efficient Instrument

PubMed Central

Briley, Daniel A.; Domiteaux, Matthew; Tucker-Drob, Elliot M.

2014-01-01

Many achievement-relevant personality measures (APMs) have been developed, but the interrelations among APMs or associations with the broader personality landscape are not well-known. In Study 1, 214 participants were measured on 36 APMs and a measure of the Big Five. Factor analytic results supported the convergent and discriminant validity of five latent dimensions: performance, mastery, self-doubt, effort, and intellectual investment. Conscientiousness, neuroticism, and openness to experience had the most consistent associations with APMs. We constructed a more efficient scale– the Multidimensional Achievement-Relevant Personality Scale (MAPS). In Study 2, we replicated the factor structure and external correlates of the MAPS in a sample of 359 individuals. Finally, we validated the MAPS with four indicators of academic performance and demonstrated incremental validity. PMID:24839374

Corporate Entrepreneurship Assessment Instrument (CEAI): Systematic Validation of a Measure

DTIC Science & Technology

2006-03-01

CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE THESIS...the United States Government. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION...DISTRIBUTION UNLIMITED. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE

Development and validation of a new condition-specific instrument for evaluation of smile esthetics-related quality of life.

PubMed

Saltovic, Ema; Lajnert, Vlatka; Saltovic, Sabina; Kovacevic Pavicic, Daniela; Pavlic, Andrej; Spalj, Stjepan

2018-03-01

Orofacial esthetics raises psychosocial issues. The purpose was to create and validate new short instrument for psychosocial impacts of altered smile esthetics. A team of an orthodontist, two prosthodontists, psychologist, and a dental student generated items that could draw up specific hypothetical psychosocial dimensions (69 items initially, 39 in final analysis). The sample consisted of 261 Caucasian subjects attending local high schools and university (26% male) aged 14 to 28 years that have self-administrated the designed questionnaire. Factorial analysis, Cronbach's alpha, Pearson correlation, paired samples t-test and analysis of variance were used for analyses of internal consistency, construct validity, responsiveness, and test-retest. Three dimensions of psychosocial impacts of altered smile esthetics were identified: dental self-consciousness, dental self-confidence and social contacts that can be best fitted by 12 items, 4 items in each dimension. Internal consistency was good (α in range 0.85-0.89). Good stability in test-retest was confirmed. In responsiveness testing, tooth whitening induced increase in dental self-confidence (P = 0.002), but no significant changes in other dimensions. The new instrument, Smile Esthetics-Related Quality of Life (SERQoL), is short and has proven to be a good indicator of psychosocial dimensions related to perception of smile esthetics. Smile Esthetics-Related Quality of Life questionnaire might have practical validity when applied in esthetic dental clinical procedures. © 2017 Wiley Periodicals, Inc.

Identifying dyspepsia in the Greek population: translation and validation of a questionnaire.

PubMed

Anastasiou, Foteini; Antonakis, Nikos; Chaireti, Georgia; Theodorakis, Pavlos N; Lionis, Christos

2006-03-04

Studies on clinical issues, including diagnostic strategies, are considered to be the core content of general practice research. The use of standardised instruments is regarded as an important component for the development of Primary Health Care research capacity. Demand for epidemiological cross-cultural comparisons in the international setting and the use of common instruments and definitions valid to each culture is bigger than ever. Dyspepsia is a common complaint in primary practice but little is known with respect to its incidence in Greece. There are some references about the Helicobacter Pylori infection in patients with functional dyspepsia or gastric ulcer in Greece but there is no specific instrument for the identification of dyspepsia. This paper reports on the validation and translation into Greek, of an English questionnaire for the identification of dyspepsia in the general population and discusses several possibilities of its use in the Greek primary care. The selected English postal questionnaire for the identification of people with dyspepsia in the general population consists of 30 items and was developed in 1995. The translation and cultural adaptation of the questionnaire has been performed according to international standards. For the validation of the instrument the internal consistency of the items was established using the alpha coefficient of Chronbach, the reproducibility (test - retest reliability) was measured by kappa correlation coefficient and the criterion validity was calculated against the diagnosis of the patients' records using also kappa correlation coefficient. The final Greek version of the postal questionnaire for the identification of dyspepsia in the general population was reliably translated. The internal consistency of the questionnaire was good, Chronbach's alpha was found to be 0.88 (95% CI: 0.81-0.93), suggesting that all items were appropriate to measure. Kappa coefficient for reproducibility (test - retest reliability) was found 0.66 (95% CI: 0.62-0.71), whereas the kappa analysis for criterion validity was 0.63 (95% CI: 0.36-0.89). This study indicates that the Greek translation is comparable with the English-language version in terms of validity and reliability, and is suitable for epidemiological research within the Greek primary health care setting.

Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication

PubMed Central

Zamanzadeh, Vahid; Ghahramanian, Akram; Rassouli, Maryam; Abbaszadeh, Abbas; Alavi-Majd, Hamid; Nikanfar, Ali-Reza

2015-01-01

Introduction: The importance of content validity in the instrument psychometric and its relevance with reliability, have made it an essential step in the instrument development. This article attempts to give an overview of the content validity process and to explain the complexity of this process by introducing an example. Methods: We carried out a methodological study conducted to examine the content validity of the patient-centered communication instrument through a two-step process (development and judgment). At the first step, domain determination, sampling (item generation) and instrument formation and at the second step, content validity ratio, content validity index and modified kappa statistic was performed. Suggestions of expert panel and item impact scores are used to examine the instrument face validity. Results: From a set of 188 items, content validity process identified seven dimensions includes trust building (eight items), informational support (seven items), emotional support (five items), problem solving (seven items), patient activation (10 items), intimacy/friendship (six items) and spirituality strengthening (14 items). Content validity study revealed that this instrument enjoys an appropriate level of content validity. The overall content validity index of the instrument using universal agreement approach was low; however, it can be advocated with respect to the high number of content experts that makes consensus difficult and high value of the S-CVI with the average approach, which was equal to 0.93. Conclusion: This article illustrates acceptable quantities indices for content validity a new instrument and outlines them during design and psychometrics of patient-centered communication measuring instrument. PMID:26161370

Development and psychometric testing of a new instrument to measure factors influencing women's breast cancer prevention behaviors (ASSISTS).

PubMed

Khazaee-Pool, Maryam; Majlessi, Fereshteh; Montazeri, Ali; Pashaei, Tahereh; Gholami, Ali; Ponnet, Koen

2016-07-22

Breast cancer preventive behaviors have an extreme effect on women's health. Despite the benefits of preventive behaviors regarding breast cancer, they have not been implemented as routine care for healthy women. To assess this health issue, a reliable and valid scale is needed. The aim of the present study is to develop and examine the psychometric properties of a new scale, called the ASSISTS, in order to identify factors that affect women's breast cancer prevention behaviors. A multi-phase instrument development method was performed to develop the questionnaire from February 2012 to September 2014. The item pool was generated based on secondary analyses of previous qualitative data. Then, content and face validity were applied to provide a pre-final version of the scale. The scale validation was conducted with a sample of women recruited from health centers affiliated with Tehran University of Medical Sciences. The construct validity (both exploratory and confirmatory), convergent validity, discriminate validity, internal consistency reliability and test-retest analysis of the questionnaire were tested. Fifty-eight items were initially extracted from the secondary analysis of previous qualitative data. After content validity, this was reduced to 49 items. The exploratory factor analysis revealed seven factors (Attitude, supportive systems, self-efficacy, information seeking, stress management, stimulant and self-care) containing 33 items that jointly accounted for 60.62 % of the observed variance. The confirmatory factor analysis showed a model with appropriate fitness for the data. The Cronbach's alpha coefficient for the subscales ranged from 0.68 to 0.85, and the Intraclass Correlation Coefficient (ICC) ranged from 0.71 to 0.98; which is well above the acceptable thresholds. The findings showed that the designed questionnaire was a valid and reliable instrument for assessing factors affecting women's breast cancer prevention behaviors that can be used both in practice and in future studies.

Development of a Chinese medicine assessment measure: an interdisciplinary approach using the delphi method.

PubMed

Schnyer, Rosa N; Conboy, Lisa A; Jacobson, Eric; McKnight, Patrick; Goddard, Thomas; Moscatelli, Francesca; Legedza, Anna T R; Kerr, Catherine; Kaptchuk, Ted J; Wayne, Peter M

2005-12-01

The diagnostic framework and clinical reasoning process in Chinese medicine emphasizes the contextual and qualitative nature of a patient's illness. Chinese medicine assessment data may help interpret clinical outcomes. As part of a study aimed at assessing the validity and improving the inter-rater reliability of the Chinese diagnostic process, a structured assessment instrument was developed for use in clinical trials of acupuncture and other Chinese medical therapies. To foster collaboration and maximize resources and information, an interdisciplinary advisory team was assembled. Under the guidance of two group process facilitators, and in order to establish whether the assessment instrument was consistent with accepted Chinese medicine diagnostic categories (face validity) and included the full range of each concept's meaning (content validity), a panel of Traditional Chinese Medicine (TCM) expert clinicians was convened and their responses were organized using the Delphi process, an iterative, anonymous, idea-generating and consensus-building process. An aggregate rating measure was obtained by taking the mean of mean ratings for each question across all 10 experts. Over three rounds, the overall rating increased from 7.4 (SD = 1.3) in Round 1 to 9.1 (SD = 0.5) in Round 3. The level of agreement among clinicians was measured by a decrease in SD. The final instrument TEAMSI-TCM (Traditional East Asian Medicine Structured Interview, TCM version) uses the pattern differentiation model characteristic of TCM. This modular, dynamic version was specifically designed to assess women, with a focus on gynecologic conditions; with modifications it can be adapted for use with other populations and conditions. TEAMSI-TCM is a prescriptive instrument that guides clinicians to use the proper indicators, combine them in a systematic manner, and generate conclusions. In conjunction with treatment manualization and training it may serve to increase inter-rater reliability and inter-trial reproducibility in Chinese medicine clinical trials. Testing of the validity and reliability of this instrument currently is underway.

Mothers' attitudes toward adolescent confidential services: development and validation of scales for use in English- and Spanish-speaking populations.

PubMed

Tebb, Kathleen P; Pollack, Lance M; Millstein, Shana; Otero-Sabogal, Regina; Wibbelsman, Charles J

2014-09-01

To explore parental beliefs and attitudes about confidential services for their teenagers; and to develop an instrument to assess these beliefs and attitudes that could be used among English and Spanish speakers. The long-term goal is to use this research to better understand and evaluate interventions to improve parental knowledge and attitudes toward their adolescent's access and utilization of comprehensive confidential health services. The instrument was developed using an extensive literature review and theoretical framework followed by qualitative data from focus groups and in-depth interviews. It was then pilot tested with a random sample of English- and Spanish-speaking parents and further revised. The final instrument was administered to a random sample of 1,000 mothers. The psychometric properties of the instrument were assessed for Spanish and English speakers. The instrument consisted of 12 scales. Most Cronbach alphas were >.70 for Spanish and English speakers. Fewer items for Spanish speakers "loaded" for the Responsibility and Communication scales. Parental Control of Health Information failed for Spanish speakers. The Parental Attitudes of Adolescent Confidential Health Services Questionnaire (PAACS-Q) contains 12 scales and is a valid and reliable instrument to assess parental knowledge and attitudes toward confidential health services for adolescents among English speakers and all but one scale was applicable for Spanish speakers. More research is needed to understand key constructs with Spanish speakers. Copyright © 2014 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

Construction and validation of the chronic acquired polyneuropathy patient-reported index, “CAP-PRI:” a disease-specific, health-related quality of life instrument

PubMed Central

Gwathmey, Kelly G.; Conaway, Mark R.; Seyedsadjadi, Reza; Joshi, Amruta; Barnett, Carolina; Bril, Vera; Ng, Eduardo; David, William; Gable, Karissa; Guptill, Jeffrey T.; Hobson-Webb, Lisa D.; Dineen, Jennifer; Hehir, Michael; Brannagan, Thomas H.; Byun, Esther; Adler, Margaret; Burns, Ted M.

2016-01-01

Introduction Generic health-related quality of life (HRQOL) patient-reported outcome measures have been used in patients with chronic immune-mediated polyneuropathies. We have created a disease-specific HRQOL instrument. Methods and Results The 15-item chronic acquired polyneuropathy patient-reported index (CAP-PRI) was developed and validated in multiple steps. Items were initially generated through patient and specialist input. The performance of the preliminary 20 items was analyzed from a prospective, 5-center study involving chronic immune-mediated polyneuropathy patients. Data analysis suggested modification to a 15-item scale with 3 response categories, rather than 5. The final CAP-PRI was then validated in another prospective, 5-center study. The CAP-PRI appeared to be a unidimensional outcome measure that fits the Rasch Partial Credit Model in our multicenter cohort. It correlated appropriately with the outcome measures commonly used in this patient population. Discussion The CAP-PRI is a simple, easy, disease-specific HRQOL measure that appears to be useful for clinical care and possibly also for clinical trials. PMID:26600438

Validation of the instrument of health literacy competencies for Chinese-speaking health professionals.

PubMed

Chang, Li-Chun; Chen, Yu-Chi; Liao, Li-Ling; Wu, Fei Ling; Hsieh, Pei-Lin; Chen, Hsiao-Jung

2017-01-01

The study aimed to illustrate the constructs and test the psychometric properties of an instrument of health literacy competencies (IOHLC) for health professionals. A multi-phase questionnaire development method was used to develop the scale. The categorization of the knowledge and practice domains achieved consensus through a modified Delphi process. To reduce the number of items, the 92-item IOHLC was psychometrically evaluated through internal consistency, Rasch modeling, and two-stage factor analysis. In total, 736 practitioners, including nurses, nurse practitioners, health educators, case managers, and dieticians completed the 92-item IOHLC online from May 2012 to January 2013. The final version of the IOHLC covered 9 knowledge items and 40 skill items containing 9 dimensions, with good model fit, and explaining 72% of total variance. All domains had acceptable internal consistency and discriminant validity. The tool in this study is the first to verify health literacy competencies rigorously. Moreover, through psychometric testing, the 49-item IOHLC demonstrates adequate reliability and validity. The IOHLC may serve as a reference for the theoretical and in-service training of Chinese-speaking individuals' health literacy competencies.

Psychometrics of the Laffrey Health Conception Scale for adolescents.

PubMed

Yarcheski, Adela; Mahon, Noreen E; Yarcheski, Thomas J

2005-01-01

The purposes of this methodological study were to factor analyze the Laffrey Health Conception Scale (LHCS) and to assess construct validity of the instrument with early adolescents. The final sample consisted of 230 early adolescents, aged 12 to 14, who responded to instrument packets in classrooms in an urban middle school. Data obtained on the LHCS were subjected to principal components factor analysis with oblique rotation. A two-factor solution was accepted, which is consistent with early adolescents' conceptions of health. Factor I was labeled Wellness and Factor II was labeled Clinical Health. A higher order factor analysis yielded one factor with 26 items, labeled the LHCS for Early Adolescents. The 26-item LHCS had a coefficient alpha of .95. Construct validity was assessed by testing three theoretical propositions, which significantly linked health conception to social support, self-esteem, and positive health practices. The findings indicate that the LHCS is a reliable and valid measure of health conceptions in early adolescents. Results also offer flexibility to researchers interested in testing theory involving the constructs of the definition of health, wellness, and clinical health in early adolescents.

The Multidimensional Assessment of Interoceptive Awareness (MAIA)

PubMed Central

Mehling, Wolf E.; Price, Cynthia; Daubenmier, Jennifer J.; Acree, Mike; Bartmess, Elizabeth; Stewart, Anita

2012-01-01

This paper describes the development of a multidimensional self-report measure of interoceptive body awareness. The systematic mixed-methods process involved reviewing the current literature, specifying a multidimensional conceptual framework, evaluating prior instruments, developing items, and analyzing focus group responses to scale items by instructors and patients of body awareness-enhancing therapies. Following refinement by cognitive testing, items were field-tested in students and instructors of mind-body approaches. Final item selection was achieved by submitting the field test data to an iterative process using multiple validation methods, including exploratory cluster and confirmatory factor analyses, comparison between known groups, and correlations with established measures of related constructs. The resulting 32-item multidimensional instrument assesses eight concepts. The psychometric properties of these final scales suggest that the Multidimensional Assessment of Interoceptive Awareness (MAIA) may serve as a starting point for research and further collaborative refinement. PMID:23133619

Development and validation of an educational booklet for healthy eating during pregnancy1

PubMed Central

de Oliveira, Sheyla Costa; Lopes, Marcos Venícios de Oliveira; Fernandes, Ana Fátima Carvalho

2014-01-01

OBJECTIVE: to describe the validation process of an educational booklet for healthy eating in pregnancy using local and regional food. METHODS: methodological study, developed in three steps: construction of the educational booklet, validation of the educational material by judges, and by pregnant women. The validation process was conducted by 22 judges and 20 pregnant women, by convenience selection. We considered a p-value<0.85 to validate the booklet compliance and relevance, according to the six items of the instrument. As for content validation, the item-level Content Validity Index (I-CVI) was considered when a minimum score of at least 0.80 was obtained. RESULTS: five items were considered relevant by the judges. The mean I-CVI was 0.91. The pregnant women evaluated positively the booklet. The suggestions were accepted and included in the final version of the material. CONCLUSION: the booklet was validated in terms of content and relevance, and should be used by nurses for advice on healthy eating during pregnancy. PMID:25296145

Development and Evaluation of the Lifestyle History Questionnaire (LHQ) for People Entering Treatment for Substance Addictions.

PubMed

Martin, Linda M; Triscari, Robert; Boisvert, Rosemary; Hipp, Kristi; Gersten, Jennifer; West, Rachel C; Kisling, Elizabeth; Donham, Aaron; Kollar, Naomi; Escobar, Patricia

2015-01-01

We developed and investigated the psychometric properties of the Lifestyle History Questionnaire (LHQ), a self-report instrument designed to measure the extent of occupational dysfunction attributable to substance abuse. The instrument was developed using concepts in the ecological models of occupational therapy and in the work of William L. White, who defined addiction culture in terms of the patterns of life in context. We analyzed data from two field tests using both classical test theory and item response theory. The final version of the instrument has 70 items, 1 unifying construct, and 8 subscales. We found it to be valid and reliable (α=.93) for measuring the extent of occupational dysfunction and specific areas of strengths and weaknesses. The LHQ is a promising new instrument, the first of its kind to measure occupational dysfunction in context for people with substance addictions. Copyright © 2015 by the American Occupational Therapy Association, Inc.

Assessing the heterogeneity of aggressive behavior traits: exploratory and confirmatory analyses of the reactive and instrumental aggression Personality Assessment Inventory (PAI) scales.

PubMed

Antonius, Daniel; Sinclair, Samuel Justin; Shiva, Andrew A; Messinger, Julie W; Maile, Jordan; Siefert, Caleb J; Belfi, Brian; Malaspina, Dolores; Blais, Mark A

2013-01-01

The heterogeneity of violent behavior is often overlooked in risk assessment despite its importance in the management and treatment of psychiatric and forensic patients. In this study, items from the Personality Assessment Inventory (PAI) were first evaluated and rated by experts in terms of how well they assessed personality features associated with reactive and instrumental aggression. Exploratory principal component analyses (PCA) were then conducted on select items using a sample of psychiatric and forensic inpatients (n = 479) to examine the latent structure and construct validity of these reactive and instrumental aggression factors. Finally, a confirmatory factor analysis (CFA) was conducted on a separate sample of psychiatric inpatients (n = 503) to evaluate whether these factors yielded acceptable model fit. Overall, the exploratory and confirmatory analyses supported the existence of two latent PAI factor structures, which delineate personality traits related to reactive and instrumental aggression.

Psychometric properties of the Transitions from Foster Care Key Leader Survey.

PubMed

Salazar, Amy M; Brown, Eric C; Monahan, Kathryn C; Catalano, Richard F

2016-04-01

This study summarizes the development and piloting of the Transitions from Foster Care Key Leader Survey (TFC-KLS), an instrument designed to measure change in systems serving young people transitioning from foster care to adulthood. The Jim Casey Youth Opportunity Initiative's logic model was used as a basis for instrument development. The instrument was piloted with 119 key leaders in six communities. Seven of eight latent scales performed well in psychometric testing. The relationships among the 24 measures of system change were explored. A CFA testing overall model fit was satisfactory following slight modifications. Finally, a test of inter-rater reliability between two raters did not find reliable reporting of service availability in a supplemental portion of the survey. The findings were generally positive and supported the validity and utility of the instrument for measuring system change, following some adaptations. Implications for the field are discussed. Copyright © 2015 Elsevier Ltd. All rights reserved.

The AAO fiber instrument data simulator

NASA Astrophysics Data System (ADS)

Goodwin, Michael; Farrell, Tony; Smedley, Scott; Heald, Ron; Heijmans, Jeroen; De Silva, Gayandhi; Carollo, Daniela

2012-09-01

The fiber instrument data simulator is an in-house software tool that simulates detector images of fiber-fed spectrographs developed by the Australian Astronomical Observatory (AAO). In addition to helping validate the instrument designs, the resulting simulated images are used to develop the required data reduction software. Example applications that have benefited from the tool usage are the HERMES and SAMI instrumental projects for the Anglo-Australian Telescope (AAT). Given the sophistication of these projects an end-to-end data simulator that accurately models the predicted detector images is required. The data simulator encompasses all aspects of the transmission and optical aberrations of the light path: from the science object, through the atmosphere, telescope, fibers, spectrograph and finally the camera detectors. The simulator runs under a Linux environment that uses pre-calculated information derived from ZEMAX models and processed data from MATLAB. In this paper, we discuss the aspects of the model, software, example simulations and verification.

Development and validation of a quality of life instrument for Kashin-Beck disease: an endemic osteoarthritis in China.

PubMed

Fang, H; Guo, X; Farooq, U; Xia, C; Dong, R

2012-07-01

To develop and validate a disease-specific Quality of Life (QOL) measure for a specialized osteoarthritis (OA)-Kashin-Beck disease (KBD). The standard methodology used for developing QOL instruments was employed. In phase 1, initially a group of health care professionals (HCPs) and KBD patient defined the overall concept of KBDQOL. It was followed by generation of an item pool through literature review, in-depth interview of 20 KBD patients and eight KBD HCPs and four focus group discussions. In phase 2, 368 KBD patients were interviewed and the reinterview of 95 participants, 10-14 days later assessed the reproducibility of the KBDQOL instrument. A 37 items draft instrument was devised during phase 1. Principal Component Analysis (PCA) revealed six domains: physical function, activity limitation, social support, economics, mental health, and general health. Cronbach's alphas of six domains ranged from 0.77 to 0.90. The test-retest reliability (intraclass co-relation coefficient) of six domains was satisfactory, and ranged from 0.73 to 0.90. The smallest detectable change ranged from 13.2 to 30.2 points at the individual level and from 1.4 to 3.1 points at the group level for different domains. The construct validity was adequate when co-related with the EQ-5D (spearman co-relation coefficients: 0.49-0.61) and WHOQOL-BREF (spearman co-relation coefficients: 0.53-0.68). This resulted into the final version of KBDQOL instrument having 28 items and six domains. The KBDQOL is a simple and easy to use 28-item six dimensional questionnaire. The measure has been developed as a true patient-based questionnaire and demonstrates good measurement properties. Copyright © 2012 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

An integrated assessment instrument: Developing and validating instrument for facilitating critical thinking abilities and science process skills on electrolyte and nonelectrolyte solution matter

NASA Astrophysics Data System (ADS)

Astuti, Sri Rejeki Dwi; Suyanta, LFX, Endang Widjajanti; Rohaeti, Eli

2017-05-01

The demanding of assessment in learning process was impact by policy changes. Nowadays, assessment is not only emphasizing knowledge, but also skills and attitudes. However, in reality there are many obstacles in measuring them. This paper aimed to describe how to develop integrated assessment instrument and to verify instruments' validity such as content validity and construct validity. This instrument development used test development model by McIntire. Development process data was acquired based on development test step. Initial product was observed by three peer reviewer and six expert judgments (two subject matter experts, two evaluation experts and two chemistry teachers) to acquire content validity. This research involved 376 first grade students of two Senior High Schools in Bantul Regency to acquire construct validity. Content validity was analyzed used Aiken's formula. The verifying of construct validity was analyzed by exploratory factor analysis using SPSS ver 16.0. The result show that all constructs in integrated assessment instrument are asserted valid according to content validity and construct validity. Therefore, the integrated assessment instrument is suitable for measuring critical thinking abilities and science process skills of senior high school students on electrolyte solution matter.

Development and validation of a brief screening instrument for psychosocial risk associated with genetic testing: a pan-Canadian cohort study

PubMed Central

Esplen, Mary Jane; Cappelli, Mario; Wong, Jiahui; Bottorff, Joan L; Hunter, Jon; Carroll, June; Dorval, Michel; Wilson, Brenda; Allanson, Judith; Semotiuk, Kara; Aronson, Melyssa; Bordeleau, Louise; Charlemagne, Nicole; Meschino, Wendy

2013-01-01

Objectives To develop a brief, reliable and valid instrument to screen psychosocial risk among those who are undergoing genetic testing for Adult-Onset Hereditary Disease (AOHD). Design A prospective two-phase cohort study. Setting 5 genetic testing centres for AOHD, such as cancer, Huntington's disease or haemochromatosis, in ambulatory clinics of tertiary hospitals across Canada. Participants 141 individuals undergoing genetic testing were approached and consented to the instrument development phase of the study (Phase I). The Genetic Psychosocial Risk Instrument (GPRI) developed in Phase I was tested in Phase II for item refinement and validation. A separate cohort of 722 individuals consented to the study, 712 completed the baseline package and 463 completed all follow-up assessments. Most participants were female, at the mid-life stage. Individuals in advanced stages of the illness or with cognitive impairment or a language barrier were excluded. Interventions Phase I: GPRI items were generated from (1) a review of the literature, (2) input from genetic counsellors and (3) phase I participants. Phase II: further item refinement and validation were conducted with a second cohort of participants who completed the GPRI at baseline and were followed for psychological distress 1-month postgenetic testing results. Primary and secondary outcome measures GPRI, Hamilton Depression Rating Scale (HAM-D), Hamilton Anxiety Rating Scale (HAM-A), Brief Symptom Inventory (BSI) and Impact of Event Scale (IES). Results The final 20-item GPRI had a high reliability—Cronbach's α at 0.81. The construct validity was supported by high correlations between GPRI and BSI and IES. The predictive value was demonstrated by a receiver operating characteristic curve of 0.78 plotting GPRI against follow-up assessments using HAM-D and HAM-A. Conclusions With a cut-off score of 50, GPRI identified 84% of participants who displayed distress postgenetic testing results, supporting its potential usefulness in a clinical setting. PMID:23485718

Asthma Outcomes: Quality of Life

PubMed Central

Wilson, Sandra R.; Rand, Cynthia S.; Cabana, Michael D.; Foggs, Michael B.; Halterman, Jill S.; Olson, Lynn; Vollmer, William M.; Wright, Rosalind J.; Taggart, Virginia

2014-01-01

Background “Asthma-related quality of life” refers to the perceived impact that asthma has on the patient’s quality of life. Objective National Institutes of Health (NIH) institutes and other federal agencies convened an expert group to recommend standardized measures of the impact of asthma on quality of life for use in future asthma clinical research. Methods We reviewed published documentation regarding the development and psychometric evaluation; clinical research use since 2000; and extent to which the content of each existing quality of life instrument provides a unique, reliable, and valid assessment of the intended construct. We classified instruments as core (required in future studies), supplemental (used according to the study’s aims and standardized), or emerging (requiring validation and standardization). This work was discussed at an NIH-organized workshop convened in March 2010 and finalized in September 2011. Results Eleven instruments for adults and 6 for children were identified for review. None qualified as core instruments because they predominantly measured indicators of asthma control (symptoms and/or functional status); failed to provide a distinct, reliable score measuring all key dimensions of the intended construct; and/or lacked adequate psychometric data. Conclusions In the absence of existing instruments that meet the stated criteria, currently available instruments are classified as either supplemental or emerging. Research is strongly recommended to develop and evaluate instruments that provide a distinct, reliable measure of the patient’s perception of the impact of asthma on all of the key dimensions of quality of life, an important outcome that is not captured in other outcome measures. PMID:22386511

The Strengths and Difficulties Questionnaire: psychometric properties of the parent and teacher version in children aged 4-7.

PubMed

Stone, Lisanne L; Janssens, Jan M A M; Vermulst, Ad A; Van Der Maten, Marloes; Engels, Rutger C M E; Otten, Roy

2015-01-01

The Strengths and Difficulties Questionnaire is one of the most employed screening instruments. Although there is a large research body investigating its psychometric properties, reliability and validity are not yet fully tested using modern techniques. Therefore, we investigate reliability, construct validity, measurement invariance, and predictive validity of the parent and teacher version in children aged 4-7. Besides, we intend to replicate previous studies by investigating test-retest reliability and criterion validity. In a Dutch community sample 2,238 teachers and 1,513 parents filled out questionnaires regarding problem behaviors and parenting, while 1,831 children reported on sociometric measures at T1. These children were followed-up during three consecutive years. Reliability was examined using Cronbach's alpha and McDonald's omega, construct validity was examined by Confirmatory Factor Analysis, and predictive validity was examined by calculating developmental profiles and linking these to measures of inadequate parenting, parenting stress and social preference. Further, mean scores and percentiles were examined in order to establish norms. Omega was consistently higher than alpha regarding reliability. The original five-factor structure was replicated, and measurement invariance was established on a configural level. Further, higher SDQ scores were associated with future indices of higher inadequate parenting, higher parenting stress and lower social preference. Finally, previous results on test-retest reliability and criterion validity were replicated. This study is the first to show SDQ scores are predictively valid, attesting to the feasibility of the SDQ as a screening instrument. Future research into predictive validity of the SDQ is warranted.

Development of ACLEEM questionnaire, an instrument measuring residents' educational environment in postgraduate ambulatory setting.

PubMed

Riquelme, Arnoldo; Padilla, Oslando; Herrera, Cristian; Olivos, Trinidad; Román, José Antonio; Sarfatis, Alberto; Solís, Nancy; Pizarro, Margarita; Torres, Patricio; Roff, Sue

2013-01-01

Students' perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. Postgraduate EE has been measured in hospital settings. However, there are no instruments available to measure the EE in postgraduate ambulatory settings. The aim of this study was to develop the "ambulatory care learning education environment measure" (ACLEEM). A mixed methodology was used including three stages: (1) Grounded theory (focus groups); (2) Delphi technique to identify consensus; and (3) Pilot study. Three quota samples of approximately 60 stakeholders were formed, one as focus groups and two as Delphi panels. Eight focus groups were carried out including 58 residents (Latin-American Spanish speakers). The results were analysed and 173 items were offered to a National Delphi panel (61 residents and teachers). They reduced in two rounds the number of important items to 54. The 54-item questionnaire was then piloted with 63 residents and refined to the final version of the ACLEEM with 50 items and three domains. The 50-item inventory is a valid instrument to measure the EE in postgraduate ambulatory setting in Chile. Large-scale administration of the ACLEEM questionnaire to evaluate its construct validity and reliability are the next steps to test the psychometric properties of the instrument.

Validation of a Measure of Chinese Outpatients’ Satisfaction in the Taiwan Setting

PubMed Central

Stanworth, James O.; Hsu, Ryan Shuwei; Warden, Clyde A.

2017-01-01

The medical services market is rapidly expanding around the world, following the experience of the industrialized Western economies. Cultural differences make existing assumptions about health care quality risky to export, leading to an increasing interest in understanding patient satisfaction with care within non-Western contexts. Within the Greater China region, both Western and traditional Chinese medicine coexist, yet there is a lack of research instruments that include distinct values of Chinese patients. This article reports the development of a measure of Chinese patient satisfaction with outpatient care. We describe the foundation of the scale in a qualitative report that includes 8 dimensions of Chinese patient satisfaction. A sample of 400 Chinese patients completed the final instrument. A quantitative analytical procedure leads to a 6-dimension and 27-item instrument to measure Chinese patients’ satisfaction with outpatient care. Our proposed instrument has good internal consistency supporting the use of the instrument in contexts where Chinese patients are being treated. PMID:28140760

Corporate Entrepreneurship Assessment Instrument (CEAI): Refinement and Validation of a Survey Measure

DTIC Science & Technology

2007-03-01

CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE...States Government. AFIT/GIR/ENV/07-M7 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE...UNLIMITED AFIT/GIR/ENV/07-M7 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE Michael

Basic psychometric properties of the transfer assessment instrument (version 3.0).

PubMed

Tsai, Chung-Ying; Rice, Laura A; Hoelmer, Claire; Boninger, Michael L; Koontz, Alicia M

2013-12-01

To refine the Transfer Assessment Instrument (TAI 2.0), develop a training program for the TAI, and analyze the basic psychometric properties of the TAI 3.0, including reliability, standard error of measurement (SEM), minimal detectable change (MDC), and construct validity. Repeated measures. A winter sports clinic for disabled veterans. Wheelchair users (N=41) who perform sitting-pivot or standing-pivot transfers. Not applicable. TAI version 3.0, intraclass correlation coefficients, SEMs, and MDCs for reliable measurement of raters' responses. Spearman correlation coefficient, 1-way analysis of variance, and independent t tests to evaluate construct validity. TAI 3.0 had acceptable to high levels of reliability (range, .74-.88). The SEMs for part 1, part 2, and final scores ranged from .45 to .75. The MDC was 1.5 points on the 10-point scale for the final score. There were weak correlations (ρ range, -.13 to .25; P>.11) between TAI final scores and subjects' characteristics (eg, sex, body mass index, age, type of disability, length of wheelchair use, grip and elbow strength, sitting balance). With comprehensive training, the refined TAI 3.0 yields high reliability among raters of different clinical backgrounds and experience. TAI 3.0 was unbiased toward certain physical characteristics that may influence transfer. TAI fills a void in the field by providing a quantitative measurement of transfers and a tool that can be used to detect problems and guide transfer training. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Design and validation of instruments to measure knowledge.

PubMed

Elliott, T E; Regal, R R; Elliott, B A; Renier, C M

2001-01-01

Measuring health care providers' learning after they have participated in educational interventions that use experimental designs requires valid, reliable, and practical instruments. A literature review was conducted. In addition, experience gained from designing and validating instruments for measuring the effect of an educational intervention informed this process. The eight main steps for designing, validating, and testing the reliability of instruments for measuring learning outcomes are presented. The key considerations and rationale for this process are discussed. Methods for critiquing and adapting existent instruments and creating new ones are offered. This study may help other investigators in developing valid, reliable, and practical instruments for measuring the outcomes of educational activities.

[Development and validation of the Family Vulnerability Index to Disability and Dependence (FVI-DD)].

PubMed

Amendola, Fernanda; Alvarenga, Márcia Regina Martins; Latorre, Maria do Rosário Dias de Oliveira; Oliveira, Maria Amélia de Campos

2014-02-01

This exploratory, descriptive, cross-sectional, and quantitative study aimed to develop and validate an index of family vulnerability to disability and dependence (FVI-DD). This study was adapted from the Family Development Index, with the addition of social and health indicators of disability and dependence. The instrument was applied to 248 families in the city of Sao Paulo, followed by exploratory factor analysis. Factor validation was performed using the concurrent and discriminant validity of the Lawton scale and Katz Index. The descriptive level adopted for the study was p < 0.05. The final vulnerability index comprised 50 questions classified into seven factors contemplating social and health dimensions, and this index exhibited good internal consistency (Cronbach's alpha = 0.82). FVI-DD was validated using both the Lawton scale and Katz Index. We conclude that FVI-DD can accurately and reliably assess family vulnerability to disability and dependence.

Measuring psychosocial exposures: validation of the Persian of the copenhagen psychosocial questionnaire (COPSOQ)

PubMed Central

Pournik, Omid; Ghalichi, Leila; TehraniYazdi, Alireza; Tabatabaee, Seyed Mohammad; Ghaffari, Mostafa; Vingard, Eva

2015-01-01

Background: The effect of psychosocial work environment on personal and organizational aspects of employees is well-known; and it is of fundamental importance to have valid tools to evaluate them. This study aims to evaluate the reliability and validity of the Persian version of Copenhagen Psychosocial Questionnaire (COPSOQ). Methods: The questionnaire was translated into Persian and then back translated into English by two translators separately. The wording of the final Persian version was established by comparing the translated versions with the original questionnaire. One hundred three health care workers completed the questionnaire. Chronbach’s alpha was calculated, and factor analysis was performed. Results: Factor analysis revealed acceptable validity for the five contexts of the questionnaire. Cronbach’s alpha ranged from 0.73 to 0.82 in different contexts. Conclusion: This study revealed that the Persian version of COPSOQ is a reliable and valid instrument for measuring psychosocial factors at work. PMID:26478879

Development of a questionnaire to assess the impact on parents of their infant’s bronchiolitis hospitalization

PubMed Central

2013-01-01

Background Bronchiolitis is a distressing respiratory condition and the most common cause of hospitalization during the first year of life. The hospitalization of an infant is a stressful event for parents and deserves careful consideration. The objective of this work was to develop and validate a self-administered instrument that comprehensively assesses the impact on parents of the hospitalization of their infant for bronchiolitis. Methods The Impact of Bronchiolitis Hospitalization Questionnaire (IBHQ©) was developed using a literature review and pre-study interviews with both parents and clinicians. For finalization and psychometric validation, it was included in a multicenter, longitudinal, observational study conducted in France. Parents of infants under the age of 1 year and hospitalized for bronchiolitis were asked to complete the questionnaire at hospital discharge, and 3 months after. Results Seven hundred and seven questionnaires were completed by the parents of the 463 eligible infants. After finalization, based on principal component analyses, the IBHQ included 30 core items allowing the calculation of 7 dimension core scores (Worries and distress; Fear for future; Guilt; Impact on daily organization; Physical impact; Impact on behavior with hospitalized infant; Financial impact), as well as 16 optional items, allowing the calculation of 5 optional dimension scores (Disturbed breastfeeding; Physical reaction of hospitalized infant; Impact on feeding; Impact on behavior with other infants; Siblings’ reaction). Internal consistency reliability and construct validity of the IBHQ were satisfactory. The highest impact was observed for “Worries and distress”, “Fear for future” and “Impact on daily organization” scores. Conclusions The IBHQ is a reliable and valid instrument for assessing the multifaceted impact on parents of the hospitalization of their infant for bronchiolitis. PMID:23849687

Instruments to measure cancer management knowledge of rural health care providers.

PubMed

Elliott, T E; Regal, R R; Renier, C M; Crouse, B J; Gangeness, D E; Pharmd; Elliott, B A; Witrak, M

2001-01-01

Instruments to measure cancer management knowledge of rural physicians, nurses, and pharmacists were needed to evaluate the effect of an educational intervention. Since such instruments did not exist, the authors designed and validated a new instrument for each discipline. The design and validation process for these instruments are described. These three instruments were shown to be practical and to have high content and construct validity. Content validation demonstrated that all items were rated as essential or useful by 90% or more of the respondents. Construct validation show highly significant differences in mean scores among several levels of learners and practitioners as expected. These instruments may be useful to other investigators for measuring cancer management knowledge of rural physicians, nurses, and pharmacists.

Current Status of the Validation of the Atmospheric Chemistry Instruments on Envisat

NASA Astrophysics Data System (ADS)

Lecomte, P.; Koopman, R.; Zehner, C.; Laur, H.; Attema, E.; Wursteisen, P.; Snoeij, P.

2003-04-01

Envisat is ESA's advanced Earth observing satellite launched in March 2002 and is designed to provide measurements of the atmosphere, ocean, land and ice over a five-year period. After the launch and the switch-on period, a six-month commissioning phase has taken place for instrument calibration and geophysical validation, concluded with the Envisat Calibration Review held in September 2002. In addition to ESA and its industrial partners in the Envisat consortium, many other companies and research institutes have contributed to the calibration and validation programme under ESA contract as expert support laboratories (ESLs). A major contribution has also been made by the Principal Investigators of approved proposals submitted to ESA in response to a worldwide "Announcement of Opportunity for the Exploitation of the Envisat Data Products" in 1998. Working teams have been formed in which the different participants worked side by side to achieve the objectives of the calibration and validation programme. Validation is a comparison of Envisat level-2 data products and estimates of the different geophysical variables obtained by independent means, the validation instruments. Validation is closely linked to calibration because inconsistencies discovered in the comparison of Envisat Level 2 data products to well-known external instruments can have many different sources, including inaccuracies of the Envisat instrument calibration and the data calibration algorithms. Therefore, initial validation of the geophysical variables has provided feedback to calibration, de-bugging and algorithm improvement. The initial validation phase ended in December 2002 with the Envisat Validation Workshop at which, for a number of products, a final quality statement was given. Full validation of all data products available from the Atmospheric Chemistry Instruments on Envisat (MIPAS, GOMOS and SCIAMACHY) is quite a challenge and therefore it has been decided to adopt a step-wise approach. As a first step the intention is to arrive at a first quality assessment of the data products for near-real time distribution. This core validation was performed during the commissioning and validation phase of Envisat. The results of this exercise have been presented at the Envisat Validation Workshop. It was already anticipated early in the program that more work needed to be done after this workshop on all Envisat data products both for near-real time and for off-line distribution. The algorithms designed to derive estimates of the atmospheric constitutes need to be verified. For this a large number of correlative observations under a wide range of conditions are needed to arrive at a representative and statistically significant data quality assessment, and to provide insight into sources of error both in the Envisat data and the correlative data sets. In order to achieve this within the tight time schedule the best use must be made of the available resources. For the Atmospheric Chemistry Instruments on Envisat it has therefore been decided to plan a joint geophysical validation programme that is not instrument specific but serves all three instruments. For the co-ordination of the activities the Atmospheric Chemistry Validation Team was formed (ACVT). The ACVT methods can roughly be categorised into different approaches and consistent with these the group is divided into different subgroups on · balloon and aircraft campaigns · ground-based measurements · model assimilation and satellite intercomparison The data coming from the various validation campaigns are stored within a central data storage facility established at the Norwegian Institute for Air Research (NILU) in Norway. NILU provides access to correlative measurements from sensors on-board satellites, aircraft, balloons and ships, as well as from ground-based instruments and numerical models, such as that of the ECMWF. Particular emphasis has been put on the quality control of such data. Users are able to connect with the database to add or retrieve data according to their requirements. Access to such a range of data have strengthened the statistical significance of the results and increased the chances of detecting errors in the processing algorithms. Two types of data are stored in the NILU database, fixed point and transect data. Transect data is only provided for inclusion in the database for selected times which correspond to the satellite overpass. Envisat data is not stored in the NILU database although other correlative satellite data is included to facilitate their comparison with data acquired by Envisat. The European Space Agency (ESA) organised a workshop in Frascati from 9 to 13 December 2002 to review the first results of the validation of the geophysical data products from its environmental satellite Envisat. The objectives of the Envisat Validation Workshop were: . to review the Level 2 product algorithms using the results of the validation campaigns, . to review the geophysical consistency of the Level 2 processor products, . to provide an error estimation of the Level 2 products, . to recommend instrument re-calibration and algorithm development where needed. At the Envisat Validation workshop held in Frascati, Italy, from 9-13 December, scientists and engineers presented analyses of the exhaustive series of tests that have been run on each of Envisat's sensors since the spacecraft was launched in March. On the basis of workshop results it was decided that most of the 73 data products provided by the Envisat instruments are ready for operational delivery. Although the main validation phase for the atmospheric instruments of Envisat will be completed this year, ongoing validation products will continue throughout the lifetime of the Envisat mission. More specifically, the main validation phase (i.e. with intensive validation activities) will be completed in 2003, whereas the long-term validation phase will: - Provide assurance of data quality and accuracy for applications such as climate change research - Investigate the fully representative range of geophysical conditions - Investigate the fully representative range of seasonal cycles - Perform long term monitoring for instrumental drifts and other artefacts - Validate new products. The paper will discuss the general status of the calibration and validation activities for GOMOS, MIPAS and SCIAMACHY. The short-term and long-term validation plans will be presented.

Translation and cross-cultural adaptation of the Sexual Function Questionnaire (SFQ) into Brazilian Portuguese.

PubMed

Lapa, Clara de Oliveira; Rocha, Gibsi Possapp; Marques, Tiago Reis; Howes, Oliver; Smith, Shubulade; Monteiro, Ricardo Tavares; Zorzetti, Roberta; Spanemberg, Lucas

2017-01-01

Sexual dysfunction is common in patients with psychotic illness. This article describes the translation and cross-cultural adaptation of the Sexual Function Questionnaire (SFQ) into Brazilian Portuguese. The translation and cross-cultural adaptation followed the guidelines for adapting self-report instruments proposed by the Task Force of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Briefly, ISPOR steps include: preparation, forward translation, reconciliation, back-translation, back-translation review, harmonization, cognitive debriefing, review of cognitive debriefing and finalization, before proofreading and final version. The original authors authorized the translation and participated in the study. There was good agreement between translations and between the back-translation and the original English version of the SFQ. The final version was prepared with certificated evaluators in the original language and in Portuguese. Few changes were necessary to the new version in Portuguese. The translated and adapted Brazilian Portuguese version of the SFQ is reliable and semantically equivalent to the original version. Studies on psychotropic-related sexual dysfunction may now test the validity of the instrument and can investigate sexual dysfunction in Portuguese-speaking patients.

Assessing decentering: validation, psychometric properties, and clinical usefulness of the Experiences Questionnaire in a Spanish sample.

PubMed

Soler, Joaquim; Franquesa, Alba; Feliu-Soler, Albert; Cebolla, Ausias; García-Campayo, Javier; Tejedor, Rosa; Demarzo, Marcelo; Baños, Rosa; Pascual, Juan Carlos; Portella, Maria J

2014-11-01

Decentering is defined as the ability to observe one's thoughts and feelings in a detached manner. The Experiences Questionnaire (EQ) is a self-report instrument that originally assessed decentering and rumination. The purpose of this study was to evaluate the psychometric properties of the Spanish version of EQ-Decentering and to explore its clinical usefulness. The 11-item EQ-Decentering subscale was translated into Spanish and psychometric properties were examined in a sample of 921 adult individuals, 231 with psychiatric disorders and 690 without. The subsample of nonpsychiatric participants was also split according to their previous meditative experience (meditative participants, n=341; and nonmeditative participants, n=349). Additionally, differences among these three subgroups were explored to determine clinical validity of the scale. Finally, EQ-Decentering was administered twice in a group of borderline personality disorder, before and after a 10-week mindfulness intervention. Confirmatory factor analysis indicated acceptable model fit, sbχ(2)=243.8836 (p<.001), CFI=.939, GFI=.936, SRMR=.040, and RMSEA=.06 (.060-.077), and psychometric properties were found to be satisfactory (reliability: Cronbach's α=.893; convergent validity: r>.46; and divergent validity: r<-.35). The scale detected changes in decentering after a 10-session intervention in mindfulness (t=-4.692, p<.00001). Differences among groups were significant (F=134.8, p<.000001), where psychiatric participants showed the lowest scores compared to nonpsychiatric meditative and nonmeditative participants. The Spanish version of the EQ-Decentering is a valid and reliable instrument to assess decentering either in clinical and nonclinical samples. In addition, the findings show that EQ-Decentering seems an adequate outcome instrument to detect changes after mindfulness-based interventions. Copyright © 2014. Published by Elsevier Ltd.

Development and validation of a new instrument to measure health-related quality of life in patients with psoriatic arthritis: the VITACORA-19.

PubMed

Torre-Alonso, Juan Carlos; Gratacós, Jordi; Rey-Rey, José Santos; Valdazo de Diego, Juan Pablo; Urriticoechea-Arana, Ana; Daudén, Esteban; Moreno, Mireia; Zarco-Montejo, Pedro; Collantes-Estévez, Eduardo; Fernández-López, Juan Antonio

2014-10-01

To develop/validate an instrument to measure health-related quality of life (HRQoL) in patients with psoriatic arthritis (PsA), for use in clinical studies. An item pool of 35 items was generated following standardized procedures. Item reduction was performed using clinimetric and psychometric approaches after administration to 66 patients with PsA. The resulting instrument, the VITACORA-19, consists of 19 items. Its validity content, internal consistency, test-retest reliability, known groups/convergent validity, and sensitivity to change were tested in a longitudinal and multicenter study conducted in 10 hospitals in Spain, with 323 patients who also completed the EuroQol 5-dimensional questionnaire (EQ-5D) and a health status transition item. There were 3 study groups: group A (n = 209, patients with PsA), group B (n = 71, patients with arthritis without psoriatic aspect, patients with arthrosis, and patients with dermatitis), and group C (n = 43, healthy controls). The questionnaire was considered easy/very easy to answer by 94.7% of the patients with PsA. The factorial analysis clearly identified only 1 factor. Cronbach's alpha coefficient and interclass correlation coefficients exceeded 0.90. Statistically significant differences (p < 0.001) were observed between groups: subjects from group C had better HRQoL, followed by group B, and finally group A had the worst HRQoL. The VITACORA-19 scores showed significant correlations (p < 0.001) to PsA disease activity, EQ-5D, and perceived health state, scoring the patients with better health state higher. The minimum important difference was established as an 8-point change in the global score. The Spanish-developed VITACORA-19, designed to measure HRQoL in patients with PsA, has good validity, reliability, and sensitivity to change.

Perceived Organizational Justice in Care Services: creation and multi-sample validation of a measure.

PubMed

Pérez-Arechaederra, Diana; Briones, Elena; Lind, Allan; García-Ortiz, Luis

2014-02-01

Organizational justice (OJ) perceptions predict attitudes and behaviors of customers and employees across a broad range of services. Although OJ has proven predictive power and relevance, it has rarely been studied in health care settings. This stems partially from the lack of a reliable and valid measure of patients' OJ in health care encounters. The objective here was to create and validate a measure of patients' OJ. With that purpose, a survey study with two sampling contexts - the U.S. and Spain - was carried out in order to provide a cross-national validation of the scale in two versions: English (Perceived Organizational Justice in Care Services, PJustCS) and Spanish (Percepción de Justicia Organizacional en el Ámbito Sanitario, PJustAS). Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) were used to select the appropriate items in the final version of the instrument. Reliability and validity of the measure were tested. A total of 406 patients in the U.S. and 473 patients in Spain participated. The measures used were the newly created scale of Perceived Organizational Justice in Care Services (PJustCS/PJustAS) and scales of patients' Satisfaction, Trust and Global Justice. Factor Analyses supported the four dimensional structure of the instrument for each group. Multigroup CFA substantiated invariant factor loadings and invariant structural models across both samples, hence, supporting that the instrument is applicable in its two versions: English and Spanish. Validation results showed expected positive relations of OJ with patients' satisfaction, trust in clinicians and global perceived justice. These results point out the importance of health care customers' perceived organizational justice in the explanation of health care dynamics. The scale has desirable psychometric properties and shows adequate validity, contributing to the potential development of the area. Copyright © 2013 Elsevier Ltd. All rights reserved.

[Internet addiction: development and validation of an instrument in adolescent scholars in Lima, Peru].

PubMed

Lam-Figueroa, Nelly; Contreras-Pulache, Hans; Mori-Quispe, Elizabeth; Nizama-Valladolid, Martín; Gutiérrez, César; Hinostroza-Camposano, Williams; Reyes, Erasmo Torrejón; Hinostroza-Camposano, Richard; Coaquira-Condori, Elizabeth; Hinostroza-Camposano, Willy David

2011-01-01

To develop and validate an instrument to assess Internet Addiction (IA) phenomenon in adolescents of Metropolitan Lima. We performed an observational analytical study, including a sample of 248 high school adolescent students. In order to evaluate the IA, we constructed the questionnaire: "Scale for Internet Addiction of Lima" (SIAL), which assesses symptoms and dysfunctional characteristics. The resulting items were submitted to experts' judgment, finally obtaining a 11-item scale. The mean age was 14 years old. The psychometric analysis of the instrument showed a Cronbach' Alpha Coefficient of 0.84, with values of item-total correlation ranging from 0.45 to 0.59. The dimensional analysis yielded a two-dimensional structure that explained up to 50.7% of the total variance. The bi-dimensional data analysis revealed a significant association (p<0,001) between Dimension I (symptoms of IA) and the weekly time spent on the Internet, male sex, past history of bad behavior in school and plans for the future. Dimension II (dysfunction due to IA) had a significant association to past history of bad behavior, plans for the future (p<0,001) and missing school without valid reasons. The SIAL showed a good internal consistency, with moderate and significant inter-item correlations. The findings show that addiction has a dynamic role, which evidences a problem generated in family patterns and inadequate social networks.

The Therapeutic Environment Screening Survey for Nursing Homes (TESS-NH): an observational instrument for assessing the physical environment of institutional settings for persons with dementia.

PubMed

Sloane, Philip D; Mitchell, C Madeline; Weisman, Gerald; Zimmerman, Sheryl; Foley, Kristie M Long; Lynn, Mary; Calkins, Margaret; Lawton, M Powell; Teresi, Jeanne; Grant, Leslie; Lindeman, David; Montgomery, Rhonda

2002-03-01

To develop an observational instrument that describes the ability of physical environments of institutional settings to address therapeutic goals for persons with dementia. A National Institute on Aging workgroup identified and subsequently revised items that evaluated exit control, maintenance, cleanliness, safety, orientation/cueing, privacy, unit autonomy, outdoor access, lighting, noise, visual/tactile stimulation, space/seating, and familiarity/homelikeness. The final instrument contains 84 discrete items and one global rating. A summary scale, the Special Care Unit Environmental Quality Scale (SCUEQS), consists of 18 items. Lighting items were validated using portable light meters. Concurrent criterion validation compared SCUEQS scores with the Professional Environmental Assessment Protocol (PEAP). Interrater kappa statistics for 74% of items were above.60. For another 10% of items, kappas could not be calculated due to empty cells, but interrater agreement was above 80%. The SCUEQS demonstrated an interrater reliability of.93, a test--retest reliability of.88, and an internal consistency of.81--.83. Light meter ratings correlated significantly with the Therapeutic Environment Screening Survey for Nursing Homes (TESS-NH) lighting items (r =.29--.38, p =.01--.04), and the SCUEQS correlated significantly with global PEAP ratings (r =.52, p <.01). The TESS-NH efficiently assesses discrete elements of the physical environment and has strong reliability and validity. The SCUEQS provides a quantitative measure of environmental quality in institutional settings.

Validation of an ion optics software model against the DANDE Wind & Temperature Spectrometer

NASA Astrophysics Data System (ADS)

Kemble, Kyle Dux

The Drag & Atmospheric Neutral Density Explorer (DANDE) is slated for launch in the first half of 2013 into a highly eccentric near polar orbit to study the neutral thermosphere. It is a 50kg ˜0.45m diameter spherical payload that will attempt to make measurements of the drag forces on spacecraft in LEO between 200-400km altitude and simultaneously sample the composition, thermal energy, and wind vector of the atmosphere. These two measurements together on a single platform will offer greater spatial and temporal detail to space weather measurements in this region on a single low-cost platform. This will be done with a sub-microg resolution accelerometer suite designed and built at the University of Colorado at Boulder. Complementary measurements by a Wind & Temperature Spectrometer (WTS) developed in part with Goddard Space Flight Center will gather information of the wind vector and atmospheric composition. This work focuses primarily on the WTS instrument and the operational considerations levied on it through analysis of proto-flight and flight testing results. Additionally an ion optics modeling software is utilized called SIMION to take these empirical results and form a test correlated model of the instrument. The process for validation of the instrument behavior in SIMION is outlined by first identifying the performance metrics of the final instrument and running a similar testing campaign on the simulate instrument. The performance components in question are the relation the Small Deflection Energy Analyzer (SDEA) voltage to particle energy called the SDEA Plate factor observed at 3.6eV/V. The energy resolution of the system, or its ability to differentiate between selected energies and unselected energies which is ˜7% of the overall sampled species. Finally for consideration is the overall selection efficiency of the instrument across an energy spectra within the SDEA chamber, lower selection efficiency will result in less overall observable particles reducing the signal to noise ratio. These metrics can then lend to operational considerations for the impending flight of DANDE.

The Development and Preliminary Testing of an Instrument for Assessing Fatigue Self-management Outcomes in Patients With Advanced Cancer.

PubMed

Chan, Raymond Javan; Yates, Patsy; McCarthy, Alexandra L

Fatigue is one of the most distressing and commonly experienced symptoms in patients with advanced cancer. Although the self-management (SM) of cancer-related symptoms has received increasing attention, no research instrument assessing fatigue SM outcomes for patients with advanced cancer is available. The aim of this study was to describe the development and preliminary testing of an interviewer-administered instrument for assessing the frequency and perceived levels of effectiveness and self-efficacy associated with fatigue SM behaviors in patients with advanced cancer. The development and testing of the Self-efficacy in Managing Symptoms Scale-Fatigue Subscale for Patients With Advanced Cancer (SMSFS-A) involved a number of procedures: item generation using a comprehensive literature review and semistructured interviews, content validity evaluation using expert panel reviews, and face validity and test-retest reliability evaluation using pilot testing. Initially, 23 items (22 specific behaviors with 1 global item) were generated from the literature review and semistructured interviews. After 2 rounds of expert panel review, the final scale was reduced to 17 items (16 behaviors with 1 global item). Participants in the pilot test (n = 10) confirmed that the questions in this scale were clear and easy to understand. Bland-Altman analysis showed agreement of results over a 1-week interval. The SMSFS-A items were generated using multiple sources. This tool demonstrated preliminary validity and reliability. The SMSFS-A has the potential to be used for clinical and research purposes. Nurses can use this instrument for collecting data to inform the initiation of appropriate fatigue SM support for this population.

Development of a Theory-based, Sociocultural Instrument to Assess Black Maternal Intentions to Vaccinate Their Daughters Aged 9 to 12 Against HPV.

PubMed

Cunningham-Erves, Jennifer; Talbott, Laura L; O'Neal, Marcia R; Ivankova, Nataliya V; Wallston, Kenneth A

2016-09-01

The human papillomavirus (HPV) vaccine could assist in reducing the cervical cancer disparity existing between Black and White women. Understanding factors influencing Black maternal intentions to vaccinate their daughter is essential in improving vaccination uptake. However, existing instruments do not comprehensively assess factors (e.g., culture) influencing maternal intentions. This paper describes the development of the Human Papillomavirus Vaccination Survey for Black Mothers with Girls Aged 9 to 12 (HPVS-BM), the first instrument to measure knowledge, attitudes, subjective norms, and cultural beliefs relating to Black maternal intentions to vaccinate their daughters aged 9 to 12 years against HPV. The items and scales were refined using content review by experts, as well as cognitive interviews and pilot testing with target audience participants. The final version of the HPVS-BM was administered to 242 Black mothers with adolescent daughters. Internal reliability was determined using Cronbach's alpha. An a priori hypothetical model was developed to determine convergent and discriminant validity. All scales of the HPVS-BM had an acceptable internal reliability of 0.70 or higher. The intention scale of HPVS-BM was significantly correlated (p < .05) with perceived benefits, perceived barriers, and subjective norms, supporting strong convergent validity. Moderate discriminant construct validity was also demonstrated. Exhibiting good psychometrics, this instrument could be used by healthcare researchers and professionals to develop programs to increase HPV vaccination among Black adolescent females aimed at reducing the racial disparities in cervical cancer. Further psychometric testing of this survey tool for understanding factors influencing maternal intentions is warranted.

Assessment of the elderly's functional ability to manage their medication: a systematic literature review.

PubMed

Advinha, Ana Margarida; Lopes, Manuel José; de Oliveira-Martins, Sofia

2017-02-01

Background The evaluation of the elderly's ability to manage medication through the use of a validated tool can be a significant step in identifying inabilities and needs, with the objective of increasing their self-care skills, and promoting successful aging. Aim of the review To identify studies assessing the elderly's functional ability to manage their own medication. Method For the search strategy, the PICO method was used: P-Population (elderly), I-Instruments (tools for assessing medication management ability), C-Context (community) and O-Outcomes (functional ability to manage medication). The final search query was run in MEDLINE/PubMed, CINAHL Plus, ISI Web of Science and Scopus. The whole process was developed according to the PRISMA statement. Results The search retrieved 8051 records. In each screening stage, the selection criteria were applied to eliminate records where at least one of the exclusion criteria was verified. At the end of this selection, we obtained a total of 18 papers (17 studies). The results allow the conclusion to be drawn that studies use several different instruments, most of them not validated. The authors agree that medication management abilities decrease as cognitive impairment increases, even if a lot of studies assess only the physical dimension. DRUGS was the instrument most often used. Conclusion Older adults' ability to manage their medication should be assessed using tools specifically built and validate for the purpose. DRUGS (which uses the real regimen taken by the elderly) was the most widely used assessment instrument in the screened studies.

[Social support and cardiovascular health: Adaptation of a social support scale for hypertensive and diabetic patients in primary care, Chile].

PubMed

Poblete, Fernando; Glasinovic, Andrés; Sapag, Jaime; Barticevic, Nicolás; Arenas, Artzy; Padilla, Oslando

2015-10-01

Validate an instrument to measure the Perceived Social Support in outpatients who are in treatment to hypertension and/or diabetes mellitus ii. Observational and exploratory design with mixed methods, qualitative and quantitative. Two community health centers from the municipality of Puente Alto (Santiago, Chile). Hypertensive and/or diabetic patients between 18 and 65 years old. A purposive sample was undertaken for the qualitative study, and a random sample for the final survey. Focus groups and semi-structured interviews were conducted to explore the constructs of social support as perceived by patients. According to expert opinion and literature review, a scale of social support was selected and a pilot study was conducted in 40 patients, then we interviewed in depth to some of those participants. The instrument was modified according the results of this process. The final version was applied to 250 participants. The construct existence was verified in the population. In the adaptation, one item was eliminated. The alpha of Cronbach was 0.89 and the factorial analysis had the same four factors from the original study. Nine new items obtained from the focal groups were added to the instrument, obtaining an alpha of Cronbach of 0.92. The final instrument has good psychometric proprieties, and is applicable in our population. The additional items from the qualitative study improve its internal consistency, but don't add new information about Perceived Social Support. This is consistent with other studies, and suggests the application of the original version of the instrument. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

Transcultural adaptation and initial validation of Brazilian-Portuguese version of the Basel assessment of adherence to immunosuppressive medications scale (BAASIS) in kidney transplants

PubMed Central

2013-01-01

Background Transplant recipients are expected to adhere to a lifelong immunosuppressant therapeutic regimen. However, nonadherence to treatment is an underestimated problem for which no properly validated measurement tool is available for Portuguese-speaking patients. We aimed to initially validate the Basel Assessment of Adherence to Immunosuppressive Medications Scale (BAASIS®) to accurately estimate immunosuppressant nonadherence in Brazilian transplant patients. Methods The BAASIS® (English version) was transculturally adapted and its psychometric properties were assessed. The transcultural adaptation was performed using the Guillemin protocol. Psychometric testing included reliability (intraobserver and interobserver reproducibility, agreement, Kappa coefficient, and the Cronbach’s alpha) and validity (content, criterion, and construct validities). Results The final version of the transculturally adapted BAASIS® was pretested, and no difficulties in understanding its content were found. The intraobserver and interobserver reproducibility variances (0.007 and 0.003, respectively), the Cronbach’s alpha (0.7), Kappa coefficient (0.88) and the agreement (95.2%) suggest accuracy, preciseness and reliability. For construct validity, exploratory factorial analysis demonstrated unidimensionality of the first three questions (r = 0.76, r = 0.80, and r = 0.68). For criterion validity, the adapted BAASIS® was correlated with another self-report instrument, the Measure of Adherence to Treatment, and showed good congruence (r = 0.65). Conclusions The BAASIS® has adequate psychometric properties and may be employed in advance to measure adherence to posttransplant immunosuppressant treatments. This instrument will be the first one validated to use in this specific transplant population and in the Portuguese language. PMID:23692889

Developing an instrument to measure effective factors on Clinical Learning

PubMed Central

DADGARAN, IDEH; SHIRAZI, MANDANA; MOHAMMADI, AEEN; RAVARI, ALI

2016-01-01

Introduction Although nursing students spend a large part of their learning period in the clinical environment, clinical learning has not been perceived by its nature yet. To develop an instrument to measure effective factors on clinical learning in nursing students. Methods This is a mixed methods study performed in 2 steps. First, the researchers defined “clinical learning” in nursing students through qualitative content analysis and designed items of the questionnaire based on semi-structured individual interviews with nursing students. Then, as the second step, psychometric properties of the questionnaire were evaluated using the face validity, content validity, construct validity, and internal consistency evaluated on 227 students from fourth or higher semesters. All the interviews were recorded and transcribed, and then, they were analyzed using Max Qualitative Data Analysis and all of qualitative data were analyzed using SPSS 14. Results To do the study, we constructed the preliminary questionnaire containing 102 expressions. After determination of face and content validities by qualitative and quantitative approaches, the expressions of the questionnaire were reduced to 45. To determine the construct validity, exploratory factor analysis was applied. The results indicated that the maximum variance percentage (40.55%) was defined by the first 3 factors while the rest of the total variance percentage (59.45%) was determined by the other 42 factors. Results of exploratory factor analysis of this questionnaire indicated the presence of 3 instructor-staff, students, and educational related factors. Finally, 41 expressions were kept in 3 factor groups. The α-Cronbach coefficient (0.93) confirmed the high internal consistency of the questionnaire. Conclusion Results indicated that the prepared questionnaire was an efficient instrument in the study of the effective factors on clinical learning as viewed by nursing students since it involves 41 expressions and properties such as instrument design based on perception and experiences of the nursing students about effective factors on clinical learning, definition of facilitator and preventive factors of the clinical learning, simple scoring, suitable validity and reliability, and applicability in different occasions. PMID:27382579

Development and Psychometric Evaluation of the HPV Clinical Trial Survey for Parents (CTSP‐HPV) Using Traditional Survey Development Methods and Community Engagement Principles

PubMed Central

Wallston, Kenneth A.; Wilkins, Consuelo H.; Hull, Pamela C.; Miller, Stephania T.

2015-01-01

Abstract Objective This study describes the development and psychometric evaluation of HPV Clinical Trial Survey for Parents with Children Aged 9 to 15 (CTSP‐HPV) using traditional instrument development methods and community engagement principles. Methods An expert panel and parental input informed survey content and parents recommended study design changes (e.g., flyer wording). A convenience sample of 256 parents completed the final survey measuring parental willingness to consent to HPV clinical trial (CT) participation and other factors hypothesized to influence willingness (e.g., HPV vaccine benefits). Cronbach's a, Spearman correlations, and multiple linear regression were used to estimate internal consistency, convergent and discriminant validity, and predictively validity, respectively. Results Internal reliability was confirmed for all scales (a ≥ 0.70.). Parental willingness was positively associated (p < 0.05) with trust in medical researchers, adolescent CT knowledge, HPV vaccine benefits, advantages of adolescent CTs (r range 0.33–0.42), supporting convergent validity. Moderate discriminant construct validity was also demonstrated. Regression results indicate reasonable predictive validity with the six scales accounting for 31% of the variance in parents’ willingness. Conclusions This instrument can inform interventions based on factors that influence parental willingness, which may lead to the eventual increase in trial participation. Further psychometric testing is warranted. PMID:26530324

Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report.

PubMed

Rothman, Margaret; Burke, Laurie; Erickson, Pennifer; Leidy, Nancy Kline; Patrick, Donald L; Petrie, Charles D

2009-01-01

Patient-reported outcome (PRO) instruments are used to evaluate the effect of medical products on how patients feel or function. This article presents the results of an ISPOR task force convened to address good clinical research practices for the use of existing or modified PRO instruments to support medical product labeling claims. The focus of the article is on content validity, with specific reference to existing or modified PRO instruments, because of the importance of content validity in selecting or modifying an existing PRO instrument and the lack of consensus in the research community regarding best practices for establishing and documenting this measurement property. Topics addressed in the article include: definition and general description of content validity; PRO concept identification as the important first step in establishing content validity; instrument identification and the initial review process; key issues in qualitative methodology; and potential threats to content validity, with three case examples used to illustrate types of threats and how they might be resolved. A table of steps used to identify and evaluate an existing PRO instrument is provided, and figures are used to illustrate the meaning of content validity in relationship to instrument development and evaluation. RESULTS & RECOMMENDATIONS: Four important threats to content validity are identified: unclear conceptual match between the PRO instrument and the intended claim, lack of direct patient input into PRO item content from the target population in which the claim is desired, no evidence that the most relevant and important item content is contained in the instrument, and lack of documentation to support modifications to the PRO instrument. In some cases, careful review of the threats to content validity in a specific application may be reduced through additional well documented qualitative studies that specifically address the issue of concern. Published evidence of the content validity of a PRO instrument for an intended application is often limited. Such evidence is, however, important to evaluating the adequacy of a PRO instrument for the intended application. This article provides an overview of key issues involved in assessing and documenting content validity as it relates to using existing instruments in the drug approval process.

Survey Instrument Validity Part I: Principles of Survey Instrument Development and Validation in Athletic Training Education Research

ERIC Educational Resources Information Center

Burton, Laura J.; Mazerolle, Stephanie M.

2011-01-01

Context: Instrument validation is an important facet of survey research methods and athletic trainers must be aware of the important underlying principles. Objective: To discuss the process of survey development and validation, specifically the process of construct validation. Background: Athletic training researchers frequently employ the use of…

Development and validation of the Vietnamese primary care assessment tool

PubMed Central

2018-01-01

Objective To adapt the consumer version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity. Design A quantitative cross sectional study. Setting 56 communes in 3 representative provinces of central Vietnam. Participants Total of 3289 people who used health care services at health facility at least once over the past two years. Results The Vietnamese adult expanded consumer version of the PCAT (VN PCAT-AE) is an instrument for evaluation of primary care in Vietnam with 70 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. Sixteen other items from the original tool were not included in the final instrument, due to problems with missing values, floor or ceiling effects, and item-total correlations. All the retained scales have a Cronbach’s alpha above 0.70 except for the subscale of Family Centeredness. Conclusions The VN PCAT-AE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the consumer perspective. Additional work in the future to optimize valid measurement in all domains consistent with the original version of the tool may be helpful as the primary care system in Vietnam further develops. PMID:29324851

Systematic literature review and assessment of patient-reported outcome instruments in sickle cell disease.

PubMed

Sarri, Grammati; Bhor, Menaka; Abogunrin, Seye; Farmer, Caroline; Nandal, Savita; Halloway, Rashid; Revicki, Dennis A

2018-05-21

Sickle cell disease (SCD) is a chronic condition associated with high mortality and morbidity. It is characterized by acute clinical symptoms such as painful vaso-occlusive crises, which can impair health-related quality of life (HRQL). This study was conducted to identify validated patient-reported outcome (PRO) instruments for use in future trials of potential treatments for SCD. A systematic literature review (SLR) was performed using MEDLINE and EMBASE to identify United States (US)-based studies published in English between 1997 and 2017 that reported on validated PRO instruments used in randomized controlled trials and real-world settings. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was used to assess the quality of PRO instruments. The SLR included 21 studies assessing the psychometric properties of 24 PRO instruments. Fifteen of those instruments were developed and validated for adults and 10 for children (one instrument was used in both children and young adults aged up to 21 years). Only five of the 15 adult instruments and three of the 10 pediatric instruments were developed specifically for SCD. For most instruments, there were few or no data on validation conducted in SCD development cohorts. Of the 24 PRO instruments identified, 16 had strong internal reliability (Cronbach's α ≥0.80). There was often insufficient information to assess the content validity, construct validity, responsiveness, or test-retest reliability of the instruments identified for both child and adult populations. No validated PRO instruments measuring caregiver burden in SCD were identified. The evidence on the psychometric properties of PRO instruments was limited. However, the results of this SLR provide key information on such tools to help inform the design of future clinical trials for patients with SCD in the US.

Process Skill Assessment Instrument: Innovation to measure student’s learning result holistically

NASA Astrophysics Data System (ADS)

Azizah, K. N.; Ibrahim, M.; Widodo, W.

2018-01-01

Science process skills (SPS) are very important skills for students. However, the fact that SPS is not being main concern in the primary school learning is undeniable. This research aimed to develop a valid, practical, and effective assessment instrument to measure student’s SPS. Assessment instruments comprise of worksheet and test. This development research used one group pre-test post-test design. Data were obtained with validation, observation, and test method to investigate validity, practicality, and the effectivenss of the instruments. Results showed that the validity of assessment instruments is very valid, the reliability is categorized as reliable, student SPS activities have a high percentage, and there is significant improvement on student’s SPS score. It can be concluded that assessment instruments of SPS are valid, practical, and effective to be used to measure student’s SPS result.

Measuring Networking as an Outcome Variable in Undergraduate Research Experiences

PubMed Central

Hanauer, David I.; Hatfull, Graham

2015-01-01

The aim of this paper is to propose, present, and validate a simple survey instrument to measure student conversational networking. The tool consists of five items that cover personal and professional social networks, and its basic principle is the self-reporting of degrees of conversation, with a range of specific discussion partners. The networking instrument was validated in three studies. The basic psychometric characteristics of the scales were established by conducting a factor analysis and evaluating internal consistency using Cronbach’s alpha. The second study used a known-groups comparison and involved comparing outcomes for networking scales between two different undergraduate laboratory courses (one involving a specific effort to enhance networking). The final study looked at potential relationships between specific networking items and the established psychosocial variable of project ownership through a series of binary logistic regressions. Overall, the data from the three studies indicate that the networking scales have high internal consistency (α = 0.88), consist of a unitary dimension, can significantly differentiate between research experiences with low and high networking designs, and are related to project ownership scales. The ramifications of the networking instrument for student retention, the enhancement of public scientific literacy, and the differentiation of laboratory courses are discussed. PMID:26538387

TCM Pattern Questionnaire for Lateral Elbow Pain: Development of an Instrument via a Delphi Process

PubMed Central

Bian, Zhao-Xiang

2016-01-01

Individualized acupuncture treatment has been practiced for pain therapy. This study used acupuncture treatment for lateral elbow pain (LEP) as an example to study the diagnostic practice of individualized acupuncture treatment. A provisional version of LEP pattern questionnaire was developed based on a recent systematic review on TCM pattern diagnosis for LEP. A Delphi panel of 33 clinical experts from seven different countries was formed, and the Delphi survey was conducted in Chinese and English language for two rounds. Consensus was achieved from all 26 panelists who responded to the second round on 243 items of the instrument, which included a 72-question-long questionnaire. The mean level of expert consensus on the items of the final questionnaire was 85%. Consensus was found on four TCM patterns that could underlie LEP, namely, the wind-cold-dampness pattern, the qi stagnation and blood stasis pattern, the dual deficiency of qi and blood pattern, and the retained dampness-heat pattern. A list of signs and symptoms indicating one of the four TCM patterns and a list of preferred treatment modalities for each pattern were also generated. Our instrument shows considerable content validity. Further validity and reliability studies are under way. PMID:27525024

[Systematic development of a scale for determination of health-related quality of life in multiple trauma patients. The Polytrauma Outcome (POLO) Chart].

PubMed

Pirente, N; Bouillon, B; Schäfer, B; Raum, M; Helling, H J; Berger, E; Neugebauer, E

2002-05-01

Even years after having sustained multiple injuries patients often suffer from its sequelae. These comprise restrictions in physical function, but also pain, social and psychological impairments. Although the Meran Consensus Conference in 1990 defined the contents of "quality of life" (QoL) measures in surgery, still no instrument is available for the valid assessment of all relevant QoL domains in multiple injured patients. This paper describes the systematic development of a modular instrument for the assessment of health related QoL. Within three phases (phase I: generation of items, phase II: item reduction, phase III: pre-testing in 70 multiple injured and control patients) a questionnaire of 57 items was developed, which measures all relevant trauma-related aspects of QoL after acute hospital care. In combination with the Glascow Outcome Scale (GOS), the EUROQOL and the SF-36, the newly developed instrument builds the Polytrauma Outcome Chart (POLO-Chart) which will also be used as "Part E" for outcome assessment within the "Trauma registry" of the German Society for Trauma Surgery. In phase IV, the POLO-Chart will finally be validated in five trauma centres (Celle, Essen, Hanover, Cologne und Munich).

Development and validation of the impact of dry eye on everyday life (IDEEL) questionnaire, a patient-reported outcomes (PRO) measure for the assessment of the burden of dry eye on patients.

PubMed

Abetz, Linda; Rajagopalan, Krithika; Mertzanis, Polyxane; Begley, Carolyn; Barnes, Rod; Chalmers, Robin

2011-12-08

To develop and validate a comprehensive patient-reported outcomes instrument focusing on the impact of dry eye on everyday life (IDEEL). Development and validation of the IDEEL occurred in four phases: 1) focus groups with 45 dry eye patients to develop a draft instrument, 2) item generation, 3) pilot study to assess content validity in 16 patients and 4) psychometric validation in 210 subjects: 130 with non-Sjögren's keratoconjunctivitis sicca, 32 with Sjögren's syndrome and 48 controls, and subsequent item reduction. Focus groups identified symptoms and the associated bother, the impact of dry eye on daily life and the patients' satisfaction with their treatment as the central concepts in patients' experience of dry eye. Qualitative analysis indicated that saturation was achieved for these concepts and yielded an initial 112-item draft instrument. Patients understood the questionnaire and found the items to be relevant indicating content validity. Patient input, item descriptive statistics and factor analysis identified 55 items that could be deleted. The final 57-item IDEEL assesses dry eye impact constituting 3 modules: dry eye symptom-bother, dry eye impact on daily life comprising impact on daily activities, emotional impact, impact on work, and dry eye treatment satisfaction comprising satisfaction with treatment effectiveness and treatment-related bother/inconvenience. The psychometric analysis results indicated that the IDEEL met the criteria for item discriminant validity, internal consistency reliability, test-retest reliability and floor/ceiling effects. As expected, the correlations between IDEEL and the Dry Eye Questionnaire (a habitual symptom questionnaire) were higher than between IDEEL and Short-Form-36 and EuroQoL-5D, indicating concurrent validity. The IDEEL is a reliable, valid and comprehensive questionnaire relevant to issues that are specific to dry eye patients, and meets current FDA patient-reported outcomes guidelines. The use of this questionnaire will provide assessment of the impact of dry eye on patient dry eye-related quality of life, impact of treatment on patient outcomes in clinical trials, and may aid in treatment effectiveness evaluation.

Developments in fiber-positioning technology for the WEAVE instrument at the William Herschel Telescope

NASA Astrophysics Data System (ADS)

Schallig, Ellen; Lewis, Ian J.; Gilbert, James; Dalton, Gavin; Brock, Matthew; Abrams, Don Carlos; Middleton, Kevin; Aguerri, J. Alfonso L.; Bonifacio, Piercarlo; Carrasco, Esperanza; Trager, Scott C.; Vallenari, Antonella

2016-08-01

WEAVE is the next-generation wide-field optical spectroscopy facility for the William Herschel Telescope (WHT) on La Palma in the Canary Islands, Spain. It is a multi-object "pick-and-place" fibre-fed spectrograph with a 1000 fibre multiplex behind a new dedicated 2° prime focus corrector. The WEAVE positioner concept uses two robots working in tandem in order to reconfigure a fully populated field within the expected 1 hour dwell-time for the instrument (a good match between the required exposure times and the limit of validity for a given configuration due to the effects of differential refraction). In this paper we describe some of the final design decisions arising from the prototyping phase of the instrument design and provide an update on the current manufacturing status of the fibre positioner system.

Brazilian transcultural adaptation of an instrument on physicians' knowledge and attitudes towards dementia

PubMed Central

Jacinto, Alessandro Ferrari; de Oliveira, Erika Correa; Citero, Vanessa de Albuquerque

2015-01-01

Objective The aim of this study was to obtain a Brazilian transcultural adaptation of an instrument developed in the United Kingdom for assessing the knowledge and attitudes towards dementia by physicians. Methods The "Knowledge Quiz" (KQ) contains 14 items on epidemiology, diagnosis and management of dementia, while the "Attitude Quiz" contains 10 sentences about physicians' thoughts on the management of demented patients. The Quizzes were translated, back-translated and the resultant version applied to five physicians. Results The transcultural equivalence process was performed and four items of the KQ needed adapting to the Brazilian context. After changes suggested by a panel of specialists, the final version was applied to another five physicians and the transcultural equivalence considered adequate. Conclusion The Brazilian version of the instrument was successfully transculturally adapted for future validation and application in Brazil. PMID:29213968

Development of a Standardized Kalamazoo Communication Skills Assessment Tool for Radiologists: Validation, Multisource Reliability, and Lessons Learned.

PubMed

Brown, Stephen D; Rider, Elizabeth A; Jamieson, Katherine; Meyer, Elaine C; Callahan, Michael J; DeBenedectis, Carolynn M; Bixby, Sarah D; Walters, Michele; Forman, Sara F; Varrin, Pamela H; Forbes, Peter; Roussin, Christopher J

2017-08-01

The purpose of this study was to develop and test a standardized communication skills assessment instrument for radiology. The Delphi method was used to validate the Kalamazoo Communication Skills Assessment instrument for radiology by revising and achieving consensus on the 43 items of the preexisting instrument among an interdisciplinary team of experts consisting of five radiologists and four nonradiologists (two men, seven women). Reviewers assessed the applicability of the instrument to evaluation of conversations between radiology trainees and trained actors portraying concerned parents in enactments about bad news, radiation risks, and diagnostic errors that were video recorded during a communication workshop. Interrater reliability was assessed by use of the revised instrument to rate a series of enactments between trainees and actors video recorded in a hospital-based simulator center. Eight raters evaluated each of seven different video-recorded interactions between physicians and parent-actors. The final instrument contained 43 items. After three review rounds, 42 of 43 (98%) items had an average rating of relevant or very relevant for bad news conversations. All items were rated as relevant or very relevant for conversations about error disclosure and radiation risk. Reliability and rater agreement measures were moderate. The intraclass correlation coefficient range was 0.07-0.58; mean, 0.30; SD, 0.13; and median, 0.30. The range of weighted kappa values was 0.03-0.47; mean, 0.23; SD, 0.12; and median, 0.22. Ratings varied significantly among conversations (χ 2 6 = 1186; p < 0.0001) and varied significantly by viewing order, rater type, and rater sex. The adapted communication skills assessment instrument is highly relevant for radiology, having moderate interrater reliability. These findings have important implications for assessing the relational competencies of radiology trainees.

Students' Initial Knowledge State and Test Design: Towards a Valid and Reliable Test Instrument

ERIC Educational Resources Information Center

CoPo, Antonio Roland I.

2015-01-01

Designing a good test instrument involves specifications, test construction, validation, try-out, analysis and revision. The initial knowledge state of forty (40) tertiary students enrolled in Business Statistics course was determined and the same test instrument undergoes validation. The designed test instrument did not only reveal the baseline…

Cross-cultural adaptation of the Brazilian version of the Vocal Fatigue Index - VFI.

PubMed

Zambon, Fabiana; Moreti, Felipe; Nanjundeswaran, Chayadevie; Behlau, Mara

2017-03-13

The purpose of this study was to perform the cultural adaptation of the Brazilian version of the Vocal Fatigue Index (VFI). Two Brazilian bilingual speech-language pathologists (SLP) translated the original version of the VFI in English into Portuguese. The translations were reviewed by a committee of five voice specialist SLPs resulting in the final version of the instrument. A third bilingual SLP back-translated this final version and the same committee reviewed the differences from its original version. The final Portuguese version of the VFI, as in the original English version, was answered on a categorical scale of 0-4 indicating the frequency they experience the symptoms: 0=never, 1=almost never, 2=sometimes, 3=almost always, and 4=always. For cultural equivalence of the Portuguese version, the option "not applicable" was added to the categorical scale and 20 individuals with vocal complaints and dysphonia completed the index. Questions considered "not applicable" would be disregarded from the Brazilian version of the protocol; no question had to be removed from the instrument. The Brazilian Portuguese version was entitled "Índice de Fadiga Vocal - IFV" and features 19 questions, equivalent to the original instrument. Of the 19 items, 11 were related with tiredness of voice and voice avoidance, five concerned physical discomfort associated with voicing, and three were related to improvement of symptoms with rest or lack thereof. The Brazilian version of the VFI presents cultural and linguistic equivalence to the original instrument. The IFV validation into Brazilian Portuguese is in progress.

Development and validation of instrument for ergonomic evaluation of tablet arm chairs

PubMed Central

Tirloni, Adriana Seára; dos Reis, Diogo Cunha; Bornia, Antonio Cezar; de Andrade, Dalton Francisco; Borgatto, Adriano Ferreti; Moro, Antônio Renato Pereira

2016-01-01

The purpose of this study was to develop and validate an evaluation instrument for tablet arm chairs based on ergonomic requirements, focused on user perceptions and using Item Response Theory (IRT). This exploratory study involved 1,633 participants (university students and professors) in four steps: a pilot study (n=26), semantic validation (n=430), content validation (n=11) and construct validation (n=1,166). Samejima's graded response model was applied to validate the instrument. The results showed that all the steps (theoretical and practical) of the instrument's development and validation processes were successful and that the group of remaining items (n=45) had a high consistency (0.95). This instrument can be used in the furniture industry by engineers and product designers and in the purchasing process of tablet arm chairs for schools, universities and auditoriums. PMID:28337099

Using the Theory of Planned Behavior to predict HPV vaccination intentions of college men.

PubMed

Catalano, Hannah Priest; Knowlden, Adam P; Birch, David A; Leeper, James D; Paschal, Angelia M; Usdan, Stuart L

2017-04-01

The purpose of this study was to test Theory of Planned Behavior (TPB) constructs in predicting human papillomavirus (HPV) vaccination behavioral intentions of vaccine-eligible college men. Participants were unvaccinated college men aged 18-26 years attending a large public university in the southeastern United States during Spring 2015. A nonexperimental, cross-sectional study design was employed. Instrumentation comprised a qualitative elicitation study, expert panel review, pilot test, test-retest, and internal consistency, construct validity, and predictive validity assessments using data collected from an online self-report questionnaire. The sample consisted of 256 college men, and the final structural model exhibited acceptable fit of the data. Attitude toward the behavior (β = .169) and subjective norm (β = 0.667) were significant predictors of behavioral intention, accounting for 58% of its variance. Practitioners may utilize this instrument for the development and evaluation of TPB-based interventions to increase HPV vaccination intentions of undergraduate college men.

A Primer on Observational Measurement.

PubMed

Girard, Jeffrey M; Cohn, Jeffrey F

2016-08-01

Observational measurement plays an integral role in a variety of scientific endeavors within biology, psychology, sociology, education, medicine, and marketing. The current article provides an interdisciplinary primer on observational measurement; in particular, it highlights recent advances in observational methodology and the challenges that accompany such growth. First, we detail the various types of instrument that can be used to standardize measurements across observers. Second, we argue for the importance of validity in observational measurement and provide several approaches to validation based on contemporary validity theory. Third, we outline the challenges currently faced by observational researchers pertaining to measurement drift, observer reactivity, reliability analysis, and time/expense. Fourth, we describe recent advances in computer-assisted measurement, fully automated measurement, and statistical data analysis. Finally, we identify several key directions for future observational research to explore.

US Participation in the GOME and SCIAMACHY Projects

NASA Technical Reports Server (NTRS)

Chance, K. V.; Geary, J. C.

1996-01-01

The research performed during this reporting period includes development and maintenance of scientific software for the GOME retrieval algorithms, consultation on operational software development for GOME, further sensitivity and instrument studies to help finalize the definition of the SCIAMACHY instrument, and consultation on optical and detector issues for both GOME and SCIAMACHY. The Global Ozone Monitoring Experiment was successfully launched on the ERS-2 satellite on April 20, 1995, during this reporting period, and is working in the expected fashion. The European Space Agency has made their selections from responses to the Announcement of Opportunity for GOME validation and science studies, part of the overall ERS AO. The Smithsonian Astrophysical Observatory (SAO) proposal has been selected. These proposals are primarily for access to the data; ESA does not provide research funding for the selected investigations. The SAO activities that are carried out as a result of selection by ESA are funded by the present grant, to the limit that can be accomplished at the present level of funding. SCIAMACHY is currently in Phase C/D. Instrument design is almost finalized and selection of infrared detectors from the initial production run has been made.

Risk assessment for juvenile justice: a meta-analysis.

PubMed

Schwalbe, Craig S

2007-10-01

Risk assessment instruments are increasingly employed by juvenile justice settings to estimate the likelihood of recidivism among delinquent juveniles. In concert with their increased use, validation studies documenting their predictive validity have increased in number. The purpose of this study was to assess the average predictive validity of juvenile justice risk assessment instruments and to identify risk assessment characteristics that are associated with higher predictive validity. A search of the published and grey literature yielded 28 studies that estimated the predictive validity of 28 risk assessment instruments. Findings of the meta-analysis were consistent with effect sizes obtained in larger meta-analyses of criminal justice risk assessment instruments and showed that brief risk assessment instruments had smaller effect sizes than other types of instruments. However, this finding is tentative owing to limitations of the literature.

Identifying dyspepsia in the Greek population: translation and validation of a questionnaire

PubMed Central

Anastasiou, Foteini; Antonakis, Nikos; Chaireti, Georgia; Theodorakis, Pavlos N; Lionis, Christos

2006-01-01

Background Studies on clinical issues, including diagnostic strategies, are considered to be the core content of general practice research. The use of standardised instruments is regarded as an important component for the development of Primary Health Care research capacity. Demand for epidemiological cross-cultural comparisons in the international setting and the use of common instruments and definitions valid to each culture is bigger than ever. Dyspepsia is a common complaint in primary practice but little is known with respect to its incidence in Greece. There are some references about the Helicobacter Pylori infection in patients with functional dyspepsia or gastric ulcer in Greece but there is no specific instrument for the identification of dyspepsia. This paper reports on the validation and translation into Greek, of an English questionnaire for the identification of dyspepsia in the general population and discusses several possibilities of its use in the Greek primary care. Methods The selected English postal questionnaire for the identification of people with dyspepsia in the general population consists of 30 items and was developed in 1995. The translation and cultural adaptation of the questionnaire has been performed according to international standards. For the validation of the instrument the internal consistency of the items was established using the alpha coefficient of Chronbach, the reproducibility (test – retest reliability) was measured by kappa correlation coefficient and the criterion validity was calculated against the diagnosis of the patients' records using also kappa correlation coefficient. Results The final Greek version of the postal questionnaire for the identification of dyspepsia in the general population was reliably translated. The internal consistency of the questionnaire was good, Chronbach's alpha was found to be 0.88 (95% CI: 0.81–0.93), suggesting that all items were appropriate to measure. Kappa coefficient for reproducibility (test – retest reliability) was found 0.66 (95% CI: 0.62–0.71), whereas the kappa analysis for criterion validity was 0.63 (95% CI: 0.36–0.89). Conclusion This study indicates that the Greek translation is comparable with the English-language version in terms of validity and reliability, and is suitable for epidemiological research within the Greek primary health care setting. PMID:16515708

Validation of integrated water vapor from OMI satellite instrument against reference GPS data at the Iberian Peninsula.

PubMed

Vaquero-Martínez, Javier; Antón, Manuel; Ortiz de Galisteo, José Pablo; Cachorro, Victoria E; Wang, Huiqun; González Abad, Gonzalo; Román, Roberto; Costa, Maria João

2017-02-15

This paper shows the validation of integrated water vapor (IWV) measurements retrieved from the Ozone Monitoring Instrument (OMI), using as reference nine ground-based GPS stations in the Iberian Peninsula. The study period covers from 2007 to 2009. The influence of two factors, - solar zenith angle (SZA) and IWV -, on OMI-GPS differences was studied in detail, as well as the seasonal dependence. The pseudomedian of the relative differences is -1 ± 1% and the inter-quartile range (IQR) is 41%. Linear regressions calculated over each station show an acceptable agreement (R 2 up to 0.77). The OMI-GPS differences display a clear dependence on IWV values. Hence, OMI substantially overestimates the lower IWV data recorded by GPS (∼ 40%), while underestimates the higher IWV reference values (∼ 20%). In connection to this IWV dependence, the relative differences also show an evident SZA dependence when the whole range of IWV values are analyzed (OMI overestimates for high SZA values while underestimates for low values). Finally, the seasonal variation of the OMI-GPS differences is also associated with the strong IWV dependence found in this validation exercise. Copyright © 2016 Elsevier B.V. All rights reserved.

Detecting and measuring deprivation in primary care: development, reliability and validity of a self-reported questionnaire: the DiPCare-Q

PubMed Central

Bischoff, Thomas; Diserens, Esther-Amélie; Herzig, Lilli; Meystre-Agustoni, Giovanna; Panese, Francesco; Favrat, Bernard; Sass, Catherine; Bodenmann, Patrick

2012-01-01

Objectives Advances in biopsychosocial science have underlined the importance of taking social history and life course perspective into consideration in primary care. For both clinical and research purposes, this study aims to develop and validate a standardised instrument measuring both material and social deprivation at an individual level. Methods We identified relevant potential questions regarding deprivation using a systematic review, structured interviews, focus group interviews and a think-aloud approach. Item response theory analysis was then used to reduce the length of the 38-item questionnaire and derive the deprivation in primary care questionnaire (DiPCare-Q) index using data obtained from a random sample of 200 patients during their planned visits to an ambulatory general internal medicine clinic. Patients completed the questionnaire a second time over the phone 3 days later to enable us to assess reliability. Content validity of the DiPCare-Q was then assessed by 17 general practitioners. Psychometric properties and validity of the final instrument were investigated in a second set of patients. The DiPCare-Q was administered to a random sample of 1898 patients attending one of 47 different private primary care practices in western Switzerland along with questions on subjective social status, education, source of income, welfare status and subjective poverty. Results Deprivation was defined in three distinct dimensions: material (eight items), social (five items) and health deprivation (three items). Item consistency was high in both the derivation (Kuder-Richardson Formula 20 (KR20) =0.827) and the validation set (KR20 =0.778). The DiPCare-Q index was reliable (interclass correlation coefficients=0.847) and was correlated to subjective social status (rs=−0.539). Conclusion The DiPCare-Q is a rapid, reliable and validated instrument that may prove useful for measuring both material and social deprivation in primary care. PMID:22307103

Development and validation of a questionnaire to evaluate the factors influencing training transfer among nursing professionals.

PubMed

Bai, Yangjing; Li, Jiping; Bai, Yangjuan; Ma, Weiguang; Yang, Xiangyu; Ma, Fang

2018-02-13

Most organizations invest in people for training to improve human capital and maximize profitability. Yet it is reported in industry and nursing as well that training effectiveness is constrained because of inadequate transfer of training and the underlying reasons for the transfer problem remain unknown. And there is lack of tool to measure transfer problem. The purpose of this study was to develop and validate a questionnaire to evaluate the scores of factors influencing training transfer (FITT) among nursing professionals. The questionnaire was developed by item generation through interview with nurses and literature review. The FITT was validated in terms of content validity through expert reviews. Psychometric properties of the final instrument were assessed in a sample of 960 nurses with training experiences. The content validity of the instrument were as follows: the IR was 0.8095. 51 items on the 63-item scale had I-CVIs of 1.0 and the remaining 12 items had I-CVIs of 0.88. The S-CVI/UA was 0.976 and the S-CVI/Ave was 0.977. For the exploratory step, principal axis factoring (PAF) was selected for this study. Parallel analysis was used to decide the number of factors to extract and oblimin rotation method was used. Exploratory factor analysis identified a five-factor solution including 53 items, accounting for 68.23% of the total variance. The confirmatory factor analysis showed some support for this five-factor model. The findings demonstrate high internal consistency (Cronbach's alpha = .965). This study indicates that the FITT is a valid and reliable instrument for assessing the factors influencing training transfer among nursing professionals. The FITT can be used to assess individual perceptions of catalysts and barriers to the transfer of training among nursing professionals, which can help promote training transfer and training effectiveness in the workplace.

Nursing Home Administrator Quality Improvement Self-Efficacy Scale.

PubMed

Siegel, Elena O; Zisberg, Anna; Bakerjian, Debra; Zysberg, Leehu

Nursing home (NH) quality improvement (QI) is challenging. The critical role of NH leaders in successful QI is well established; however, current options for assessing the QI capabilities of leaders such as the licensed NH administrator are limited. This article presents the development and preliminary validation of an instrument to measure NH administrator self-efficacy in QI. We used a mixed-methods cross-sectional design to develop and test the measure. For item generation, 39 NH leaders participated in qualitative interviews. Item reduction and content validity were established with a sample of eight subject matter experts. A random sample of 211 administrators from NHs with the lowest and highest Centers for Medicare and Medicaid Services Five-Star Quality ratings completed the measure. We conducted exploratory and confirmatory factor analyses and tested the measure for internal reliability and convergent, discriminant, and known group validity. The final measure included five subscales and 32 items. Confirmatory factor analysis reaffirmed the factorial structure with good fit indices. The new measure's subscales correlated with valid measures of self-efficacy and locus of control, supporting the measure's convergent and discriminant validity. Significant differences in most of the subscales were found between the objective (Centers for Medicare and Medicaid Services Five-Star Quality rating) and subjective (Self-Rated Facility QI Index) quality outcomes, supporting the measure's known group validity. The instrument has usefulness to both NH organizations and individual NH administrators as a diagnostic tool to identify administrators with higher/lower chances of successfully implementing QI. Organizations and individuals can use this diagnostic to identify the administrator's professional development needs for QI, in general, and specific to the instrument's five subscales, informing directions for in-house training, mentoring, and outside professional development. Attending to NH administrators' QI professional development needs prior to implementing QI holds promise to enhance the chances for successful implementation of QI, which is urgently needed in many NHs.

The Validity of a New Structured Assessment of Gastrointestinal Symptoms Scale (SAGIS) for Evaluating Symptoms in the Clinical Setting.

PubMed

Koloski, N A; Jones, M; Hammer, J; von Wulffen, M; Shah, A; Hoelz, H; Kutyla, M; Burger, D; Martin, N; Gurusamy, S R; Talley, N J; Holtmann, G

2017-08-01

The clinical assessments of patients with gastrointestinal symptoms can be time-consuming, and the symptoms captured during the consultation may be influenced by a variety of patient and non-patient factors. To facilitate standardized symptom assessment in the routine clinical setting, we developed the Structured Assessment of Gastrointestinal Symptom (SAGIS) instrument to precisely characterize symptoms in a routine clinical setting. We aimed to validate SAGIS including its reliability, construct and discriminant validity, and utility in the clinical setting. Development of the SAGIS consisted of initial interviews with patients referred for the diagnostic work-up of digestive symptoms and relevant complaints identified. The final instrument consisted of 22 items as well as questions on extra intestinal symptoms and was given to 1120 consecutive patients attending a gastroenterology clinic randomly split into derivation (n = 596) and validation datasets (n = 551). Discriminant validity along with test-retest reliability was assessed. The time taken to perform a clinical assessment with and without the SAGIS was recorded along with doctor satisfaction with this tool. Exploratory factor analysis conducted on the derivation sample suggested five symptom constructs labeled as abdominal pain/discomfort (seven items), gastroesophageal reflux disease/regurgitation symptoms (four items), nausea/vomiting (three items), diarrhea/incontinence (five items), and difficult defecation and constipation (2 items). Confirmatory factor analysis conducted on the validation sample supported the initially developed five-factor measurement model ([Formula: see text], p < 0.0001, χ 2 /df = 4.6, CFI = 0.90, TLI = 0.88, RMSEA = 0.08). All symptom groups demonstrated differentiation between disease groups. The SAGIS was shown to be reliable over time and resulted in a 38% reduction of the time required for clinical assessment. The SAGIS instrument has excellent psychometric properties and supports the clinical assessment of and symptom-based categorization of patients with a wide spectrum of gastrointestinal symptoms.

A Valid and Reliable Instrument for Cognitive Complexity Rating Assignment of Chemistry Exam Items

ERIC Educational Resources Information Center

Knaus, Karen; Murphy, Kristen; Blecking, Anja; Holme, Thomas

2011-01-01

The design and use of a valid and reliable instrument for the assignment of cognitive complexity ratings to chemistry exam items is described in this paper. Use of such an instrument provides a simple method to quantify the cognitive demands of chemistry exam items. Instrument validity was established in two different ways: statistically…

The reporting of functional outcome instruments in the Journal of Orthopaedic Trauma over a 5-year period.

PubMed

Horwitz, Daniel S; Richard, Raveesh D; Suk, Michael

2014-01-01

Orthopaedic journals, such as the Journal of Orthopaedic Trauma, frequently publish studies reporting functional outcome instruments, but little information has been provided regarding the validity and overall strength of these instruments. This study analyzes the trends in reported functional outcome instruments in articles published in the Journal of Orthopaedic Trauma over a 5-year period and examines the utilization rate, "overall" strength, and validity of these functional outcome instruments for the populations being studied. Articles that were published in the Journal of Orthopaedic Trauma from January 2006 to December 2010 were reviewed, and each article was assigned to 1 of 4 different categories, based on the subspecialty focus and body region. The total number of articles reporting the use of functional outcome instruments, articles with at least 1 functional outcome instrument found in the AO Handbook, and the total number of functional outcome instruments reported were recorded. Each functional outcome instrument was assigned to 1 of 3 categories (generic, nonvalidated, validated), and each validated instrument was also examined to determine whether the category of interest for which it was used was one in which it was previously validated in. A total of 171 articles (34%) of the articles initially reviewed met the inclusion criteria. The average number of articles per year that reported functional outcome instruments was 56% (range, 47%-65%), and the average number of articles that reported at least 1 validated outcome instrument was 51% (range, 44%-61%). The average percentage of validated scores that were appropriately used within the category of interest was 23% (range, 13%-41%). Even though the 56% utilization rate of functional outcome instruments in The Journal of Orthopaedic Trauma is much higher than other journals, it is still low given the importance of measuring and attaining excellent functional outcomes. It is clear that future effort should be given to validating outcome measures for correct evaluation of orthopaedic trauma patients.

Quality appraisal of generic self-reported instruments measuring health-related productivity changes: a systematic review

PubMed Central

2014-01-01

Background Health impairments can result in disability and changed work productivity imposing considerable costs for the employee, employer and society as a whole. A large number of instruments exist to measure health-related productivity changes; however their methodological quality remains unclear. This systematic review critically appraised the measurement properties in generic self-reported instruments that measure health-related productivity changes to recommend appropriate instruments for use in occupational and economic health practice. Methods PubMed, PsycINFO, Econlit and Embase were systematically searched for studies whereof: (i) instruments measured health-related productivity changes; (ii) the aim was to evaluate instrument measurement properties; (iii) instruments were generic; (iv) ratings were self-reported; (v) full-texts were available. Next, methodological quality appraisal was based on COSMIN elements: (i) internal consistency; (ii) reliability; (iii) measurement error; (iv) content validity; (v) structural validity; (vi) hypotheses testing; (vii) cross-cultural validity; (viii) criterion validity; and (ix) responsiveness. Recommendations are based on evidence syntheses. Results This review included 25 articles assessing the reliability, validity and responsiveness of 15 different generic self-reported instruments measuring health-related productivity changes. Most studies evaluated criterion validity, none evaluated cross-cultural validity and information on measurement error is lacking. The Work Limitation Questionnaire (WLQ) was most frequently evaluated with moderate respectively strong positive evidence for content and structural validity and negative evidence for reliability, hypothesis testing and responsiveness. Less frequently evaluated, the Stanford Presenteeism Scale (SPS) showed strong positive evidence for internal consistency and structural validity, and moderate positive evidence for hypotheses testing and criterion validity. The Productivity and Disease Questionnaire (PRODISQ) yielded strong positive evidence for content validity, evidence for other properties is lacking. The other instruments resulted in mostly fair-to-poor quality ratings with limited evidence. Conclusions Decisions based on the content of the instrument, usage purpose, target country and population, and available evidence are recommended. Until high-quality studies are in place to accurately assess the measurement properties of the currently available instruments, the WLQ and, in a Dutch context, the PRODISQ are cautiously preferred based on its strong positive evidence for content validity. Based on its strong positive evidence for internal consistency and structural validity, the SPS is cautiously recommended. PMID:24495301

Instruments to assess self-care among healthy children: A systematic review of measurement properties.

PubMed

Urpí-Fernández, Ana-María; Zabaleta-Del-Olmo, Edurne; Montes-Hidalgo, Javier; Tomás-Sábado, Joaquín; Roldán-Merino, Juan-Francisco; Lluch-Canut, María-Teresa

2017-12-01

To identify, critically appraise and summarize the measurement properties of instruments to assess self-care in healthy children. Assessing self-care is a proper consideration for nursing practice and nursing research. No systematic review summarizes instruments of measurement validated in healthy children. Psychometric review in accordance with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) panel. MEDLINE, CINAHL, PsycINFO, Web of Science and Open Grey were searched from their inception to December 2016. Validation studies with a healthy child population were included. Search was not restricted by language. Two reviewers independently assessed the methodological quality of included studies using the COSMIN checklist. Eleven studies were included in the review assessing the measurement properties of ten instruments. There was a maximum of two studies per instrument. None of the studies evaluated the properties of test-retest reliability, measurement error, criterion validity and responsiveness. Internal consistency and structural validity were rated as "excellent" or "good" in four studies. Four studies were rated as "excellent" in content validity. Cross-cultural validity was rated as "poor" in the two studies (three instruments) which cultural adaptation was carried out. The evidence available does not allow firm conclusions about the instruments identified in terms of reliability and validity. Future research should focus on generate evidence about a wider range of measurement properties of these instruments using a rigorous methodology, as well as instrument testing on different countries and child population. © 2017 John Wiley & Sons Ltd.

Inflammatory bowel disease-specific health-related quality of life instruments: a systematic review of measurement properties.

PubMed

Chen, Xin-Lin; Zhong, Liang-Huan; Wen, Yi; Liu, Tian-Wen; Li, Xiao-Ying; Hou, Zheng-Kun; Hu, Yue; Mo, Chuan-Wei; Liu, Feng-Bin

2017-09-15

This review aims to critically appraise and compare the measurement properties of inflammatory bowel disease (IBD)-specific health-related quality of life instruments. Medline, EMBASE and ISI Web of Knowledge were searched from their inception to May 2016. IBD-specific instruments for patients with Crohn's disease, ulcerative colitis or IBD were enrolled. The basic characteristics and domains of the instruments were collected. The methodological quality of measurement properties and measurement properties of the instruments were assessed. Fifteen IBD-specific instruments were included, which included twelve instruments for adult IBD patients and three for paediatric IBD patients. All of the instruments were developed in North American and European countries. The following common domains were identified: IBD-related symptoms, physical, emotional and social domain. The methodological quality was satisfactory for content validity; fair in internal consistency, reliability, structural validity, hypotheses testing and criterion validity; and poor in measurement error, cross-cultural validity and responsiveness. For adult IBD patients, the IBDQ-32 and its short version (SIBDQ) had good measurement properties and were the most widely used worldwide. For paediatric IBD patients, the IMPACT-III had good measurement properties and had more translated versions. Most methodological quality should be promoted, especially measurement error, cross-cultural validity and responsiveness. The IBDQ-32 was the most widely used instrument with good reliability and validity, followed by the SIBDQ and IMPACT-III. Further validation studies are necessary to support the use of other instruments.

The development and validation of a health-related quality of life questionnaire for pre-school children with a chronic heart disease.

PubMed

Niemitz, M; Seitz, D C M; Oebels, M; Schranz, D; Hövels-Gürich, H; Hofbeck, M; Kaulitz, R; Galm, C; Berger, F; Nagdymann, N; Stiller, B; Borth-Bruhns, T; Konzag, I; Balmer, C; Goldbeck, L

2013-12-01

Heart diseases are often associated with residual injuries, persisting functional restrictions, and long-term sequelae for psychosocial development. Currently, there are no disease-specific instruments to assess the health-related quality of life (HrQoL) of pre-school children. The aims of this study were to develop a parent proxy instrument to measure the HrQoL of children aged 3-7 years with a heart disease and to confirm its validity and reliability. Items from the Preschool Pediatric Cardiac Quality of Life Inventory (P-PCQLI) were generated through focus groups of caregivers. In a pilot study, comprehensibility and feasibility were tested. Five subdimensions were defined theoretically. Psychometric properties were analysed within a multicentre study with 167 parental caregivers. The final 52-item instrument contains a total score covering five moderately inter-correlated dimensions. The total score of the questionnaire showed a very high internal consistency (Cronbachs' α = 0.95). Test-retest correlation was at r tt = 0.96. External validity was indicated by higher correlations (r = 0.24-0.68) with a generic paediatric quality of life questionnaire (KINDL) compared to the Strengths and Difficulties Questionnaire (r = 0.17 to 0.59). Low P-PCQLI total scores were significantly associated with inpatient as opposed to outpatient treatment (t = 6.04, p < .001), with at least moderate disease severity ((t = 5.05, p < .001) NYHA classification) and with poorer prognosis (t = 5.53, p < .001) as estimated by the physician. The P-PCQLI is reliable and valid for pre-school children with a heart disease. It could be used as a screening instrument in routine care, and for evaluation of HrQoL outcomes in clinical trials and intervention research.

[Valuating public health in some zoos in Colombia. Phase 1: designing and validating instruments].

PubMed

Agudelo-Suárez, Angela N; Villamil-Jiménez, Luis C

2009-10-01

Designing and validating instruments for identifying public health problems in some zoological parks in Colombia, thereby allowing them to be evaluated. Four instruments were designed and validated along with the participation of five zoos. The instruments were validated regarding appearance, content, sensitivity to change, reliability tests and determining the tools' usefulness. An evaluation scale was created which assigned a maximum of 400 points, having the following evaluation intervals: 350-400 points meant good public health management, 100-349 points for regular management and 0-99 points for deficient management. The instruments were applied to the five zoos as part of the validation, forming a base-line for future evaluation of public health in them. Four valid and useful instruments were obtained for evaluating public health in zoos in Colombia. The five zoos presented regular public health management. The base-line obtained when validating the instruments led to identifying strengths and weaknesses regarding public health management in the zoos. The instruments obtained generally and specifically evaluated public health management; they led to diagnosing, identifying, quantifying and scoring zoos in Colombia in terms of public health. The base-line provided a starting point for making comparisons and enabling future follow-up of public health in Colombian zoos.

[New method and instrument to diagnose crop growth status in greenhouse based on spectroscopy].

PubMed

Zhang, Xi-Jie; Li, Min-Zan; Cui, Di; Zhao, Peng; Sun, Jian-Ying; Tang, Ning

2006-05-01

Spectral reflectance of cucumber leaves in greenhouse was measured using an ASD FieldSpec Pro VNIR spectrometer with natural illumination. Two sensitive wavelengths, 527 nm and 762 nm, were selected to evaluate the nitrogen content of the cucumber leaves. A model was established and validated using normal difference color index(NDCI) with the correlation coefficient of 0.881. Based on the above efforts, a handheld spectral instrument was developed to diagnose the growth status of the crop in greenhouse using fiber optics. The instrument was mainly composed of four parts: reflected light acquisition system, light intensity measurement unit, signal conditioning unit, and data acquisition system. The sunlight reflected by the crop was transmitted by the fiber, and passed through the light filter to obtain light at the sensitive wavelengths. Finally it was transformed into electronic signal by the photoelectric transistor, and was used to diagnose the growth status of the crop according to the evaluation model. The result showed that the developed instrument was practical.

Implementation of graduate employability skills SJT instrument in Universiti Utara Malaysia

NASA Astrophysics Data System (ADS)

Zakaria, Mohd Hafiz; Yatim, Bidin; Ismail, Suzilah

2014-12-01

Assessing graduate employability skills before they enter the job market is very important because if they are lacking certain skills, improvement can be made through the process of training. In this study, a valid and reliable new instrument for measuring graduate employability skills using Situational Judgement Test (SJT) approach was implemented. The instrument consisted of 12 items representing five employability skills namely communication skill, professional ethics & morality, entrepreneurial skill, critical thinking in problem solving and personal quality. The purpose was to obtain a norm score for each of these skills. A survey was conducted using the SJT instrument on 1012 Universiti Utara Malaysia (UUM) local undergraduate final year students. The norm score was generated by employing BCA bootstrap technique. Scores guideline was created based on three levels (low, moderate and high). The outcomes indicated that the students possessed moderate level of communicationskill, entrepreneurial skill, critical thinking in problem solving and personal quality but has high professional ethics & morality.

In-situ Observations of the Ionospheric F2-Region from the International Space Station

NASA Technical Reports Server (NTRS)

Coffey, Victoria N.; Wright, Kenneth H.; Minow, Joseph I.; Chandler, Michael O.; Parker, Linda N.

2008-01-01

The International Space Station orbit provides an ideal platform for in-situ studies of space weather effects on the mid and low latitude F-2 region ionosphere. The Floating Potential Measurement Unit (FPMU) operating on the ISS since Aug 2006, is a suite of plasma instruments: a Floating Potential Probe (FPP), a Plasma Impedance Probe (PIP), a Wide-sweep Langmuir Probe (WLP), and a Narrow-sweep Langmuir Probe (NLP). This instrument package provides a new opportunity for collaborative multi-instrument studies of the F-region ionosphere during both quiet and disturbed periods. This presentation first describes the operational parameters for each of the FPMU probes and shows examples of an intra-instrument validation. We then show comparisons with the plasma density and temperature measurements derived from the TIMED GUVI ultraviolet imager, the Millstone Hill ground based incoherent scatter radar, and DIAS digisondes, Finally we show one of several observations of night-time equatorial density holes demonstrating the capabilities of the probes for monitoring mid and low latitude plasma processes.

Mindfulness: A systematic review of instruments to measure an emergent patientreported outcome (PRO)

PubMed Central

Park, Taehwan; Reilly-Spong, Maryanne

2013-01-01

Purpose Mindfulness has emerged as an important health concept based on evidence that mindfulness interventions reduce symptoms and improve health-related quality of life. The objectives of this study were to systematically assess and compare the properties of instruments to measure self-reported mindfulness. Methods Ovid Medline®, CINAHL®, and PsycINFO® were searched through May 2012, and articles were selected if their primary purpose was development or evaluation of the measurement properties (validity, reliability, responsiveness) of a self-report mindfulness scale. Two reviewers independently evaluated the methodological quality of the selected studies using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. Discrepancies were discussed with a third reviewer, and scored by consensus. Finally, a level of evidence approach was used to synthesize results and study quality. Results Our search strategy identified a total of 2,588 articles. Forty-six articles, reporting 79 unique studies, met inclusion criteria. Ten instruments quantifying mindfulness as a unidimensional scale (n=5) or as a set of 2 to 5 subscales (n=5) were reviewed. The Mindful Attention Awareness Scale (MAAS) was evaluated by the most studies (n=27), and had positive overall quality ratings for most of the psychometric properties reviewed. The Five Facet Mindfulness Questionnaire (FFMQ) received the highest possible rating (“consistent findings in multiple studies of good methodological quality”) for two properties, internal consistency and construct validation by hypothesis testing. However, none of the instruments had sufficient evidence of content validity. Comprehensiveness of construct coverage had not been assessed; qualitative methods to confirm understanding and relevance were absent. In addition, estimates of test-retest reliability, responsiveness, or measurement error to guide users in protocol development or interpretation of scores were lacking. Conclusions Current mindfulness scales have important conceptual differences, and none can be strongly recommended based solely on superior psychometric properties. Important limitations in the field are the absence of qualitative evaluations and accepted external referents to support construct validity. Investigators need to proceed cautiously before optimizing any mindfulness intervention based on the existing scales. PMID:23539467

Contextualization and standardization of the supportive leadership behavior questionnaire based on socio- cognitive theory in Iran.

PubMed

Shirazi, Mandana; Emami, Amir Hosein; Mirmoosavi, Seyed Jamal; Alavinia, Seyed Mohammad; Zamanian, Hadi; Fathollahbeigi, Faezeh; Masiello, Italo

2014-01-01

Effective leadership is of prime importance in any organization and it goes through changes based on accepted health promotion and behavior change theory. Although there are many leadership styles, transformational leadership, which emphasizes supportive leadership behaviors, seems to be an appropriate style in many settings particularly in the health care and educational sectors which are pressured by high turnover and safety demands. Iran has been moving rapidly forward and its authorities have understood and recognized the importance of matching leadership styles with effective and competent care for success in health care organizations. This study aimed to develop the Supportive Leadership Behaviors Scale based on accepted health and educational theories and to psychometrically test it in the Iranian context. The instrument was based on items from established questionnaires. A pilot study validated the instrument which was also cross-validated via re-translation. After validation, 731 participants answered the questionnaire. The instrument was finalized and resulted in a 20-item questionnaire using the exploratory factor analysis, which yielded four factors of support for development, integrity, sincerity and recognition and explaining the supportive leadership behaviors (all above 0.6). Mapping these four measures of leadership behaviors can be beneficial to determine whether effective leadership could support innovation and improvements in medical education and health care organizations on the national level. The reliability measured as Cronbach's alpha was 0.84. This new instrument yielded four factors of support for development, integrity, sincerity and recognition and explaining the supportive leadership behaviors which are applicable in health and educational settings and are helpful in improving self -efficacy among health and academic staff.

Contextualization and standardization of the supportive leadership behavior questionnaire based on socio- cognitive theory in Iran

PubMed Central

Shirazi, Mandana; Emami, Amir Hosein; Mirmoosavi, ,Seyed Jamal; Alavinia, Seyed Mohammad; Zamanian, Hadi; Fathollahbeigi, Faezeh; Masiello, Italo

2014-01-01

Background: Effective leadership is of prime importance in any organization and it goes through changes based on accepted health promotion and behavior change theory. Although there are many leadership styles, transformational leadership, which emphasizes supportive leadership behaviors, seems to be an appropriate style in many settings particularly in the health care and educational sectors which are pressured by high turnover and safety demands. Iran has been moving rapidly forward and its authorities have understood and recognized the importance of matching leadership styles with effective and competent care for success in health care organizations. This study aimed to develop the Supportive Leadership Behaviors Scale based on accepted health and educational theories and to psychometrically test it in the Iranian context. Methods: The instrument was based on items from established questionnaires. A pilot study validated the instrument which was also cross-validated via re-translation. After validation, 731 participants answered the questionnaire. Results: The instrument was finalized and resulted in a 20-item questionnaire using the exploratory factor analysis, which yielded four factors of support for development, integrity, sincerity and recognition and explaining the supportive leadership behaviors (all above 0.6). Mapping these four measures of leadership behaviors can be beneficial to determine whether effective leadership could support innovation and improvements in medical education and health care organizations on the national level. The reliability measured as Cronbach’s alpha was 0.84. Conclusion: This new instrument yielded four factors of support for development, integrity, sincerity and recognition and explaining the supportive leadership behaviors which are applicable in health and educational settings and are helpful in improving self –efficacy among health and academic staff. PMID:25679004

The Fermi Large Area Telescope on Orbit: Event Classification, Instrument Response Functions, and Calibration

NASA Technical Reports Server (NTRS)

Ackermann, M.; Ajello, M.; Albert, A.; Allafort, A.; Atwood, W. B.; Axelsson, M.; Baldini, L.; Ballet, J.; Barbiellini, G.; Bastieri, D.;

Developing an instrument for assessing students' concepts of the nature of technology

NASA Astrophysics Data System (ADS)

Liou, Pey-Yan

2015-05-01

Background:The nature of technology has been rarely discussed despite the fact that technology plays an essential role in modern society. It is important to discuss students' concepts of the nature of technology, and further to advance their technological literacy and adaptation to modern society. There is a need to assess high school students' concepts of the nature of technology. Purpose:This study aims to engage in discourse on students' concepts of the nature of technology based on a proposed theoretical framework. Moreover, another goal is to develop an instrument for measuring students' concepts of the nature of technology. Sample:Four hundred and fifty-five high school students' perceptions of technology were qualitatively analyzed. Furthermore, 530 students' responses to a newly developed questionnaire were quantitatively analyzed in the final test. Design and method:First, content analysis was utilized to discuss and categorize students' statements regarding technology and its related issues. The Student Concepts of the Nature of Technology Questionnaire was developed based on the proposed theoretical framework and was supported by the students' qualitative data. Finally, exploratory factor analysis and reliability analysis were applied to determine the structure of the items and the internal consistency of each scale. Results:Through a process of instrument development, the Student Concepts of the Nature of Technology Questionnaire was shown to be a valid and reliable tool for measuring students' concepts of the nature of technology. This newly developed questionnaire is composed of 29 items in six scales, namely 'technology as artifacts,' 'technology as an innovation change,' 'the current role of technology in society,' 'technology as a double-edged sword,' 'technology as a science-based form,' and 'history of technology.' Conclusions:The Student Concepts of the Nature of Technology Questionnaire has been confirmed as a reasonably valid and reliable instrument. This study provides a useful questionnaire for educational researchers and practitioners for measuring students' concepts of the nature of technology.

Survey Instrument Validity Part II: Validation of a Survey Instrument Examining Athletic Trainers' Knowledge and Practice Beliefs Regarding Exertional Heat Stroke

ERIC Educational Resources Information Center

Burton, Laura J.; Mazerolle, Stephanie M.

2011-01-01

Objective: The purpose of this article is to discuss the process of developing and validating an instrument to investigate an athletic trainer's attitudes and behaviors regarding the recognition and treatment of exertional heat stroke. Background: Following up from our initial paper, which discussed the process of survey instrument design and…

Measuring Science Instructional Practice: A Survey Tool for the Age of NGSS

NASA Astrophysics Data System (ADS)

Hayes, Kathryn N.; Lee, Christine S.; DiStefano, Rachelle; O'Connor, Dawn; Seitz, Jeffery C.

2016-03-01

Ambitious efforts are taking place to implement a new vision for science education in the United States, in both Next Generation Science Standards (NGSS)-adopted states and those states creating their own, often related, standards. In-service and pre-service teacher educators are involved in supporting teacher shifts in practice toward the new standards. With these efforts, it will be important to document shifts in science instruction toward the goals of NGSS and broader science education reform. Survey instruments are often used to capture instructional practices; however, existing surveys primarily measure inquiry based on previous definitions and standards and with a few exceptions, disregard key instructional practices considered outside the scope of inquiry. A comprehensive survey and a clearly defined set of items do not exist. Moreover, items specific to the NGSS Science and Engineering practices have not yet been tested. To address this need, we developed and validated a Science Instructional Practices survey instrument that is appropriate for NGSS and other related science standards. Survey construction was based on a literature review establishing key areas of science instruction, followed by a systematic process for identifying and creating items. Instrument validity and reliability were then tested through a procedure that included cognitive interviews, expert review, exploratory and confirmatory factor analysis (using independent samples), and analysis of criterion validity. Based on these analyses, final subscales include: Instigating an Investigation, Data Collection and Analysis, Critique, Explanation and Argumentation, Modeling, Traditional Instruction, Prior Knowledge, Science Communication, and Discourse.

Suicidality and risk of suicide--definition, drug safety concerns, and a necessary target for drug development: a brief report.

PubMed

Meyer, Roger E; Salzman, Carl; Youngstrom, Eric A; Clayton, Paula J; Goodwin, Frederick K; Mann, J John; Alphs, Larry D; Broich, Karl; Goodman, Wayne K; Greden, John F; Meltzer, Herbert Y; Normand, Sharon-Lise T; Posner, Kelly; Shaffer, David; Oquendo, Maria A; Stanley, Barbara; Trivedi, Madhukar H; Turecki, Gustavo; Beasley, Charles M; Beautrais, Annette L; Bridge, Jeffrey A; Brown, Gregory K; Revicki, Dennis A; Ryan, Neal D; Sheehan, David V

2010-08-01

To address issues concerning potential treatment-emergent "suicidality," a consensus conference was convened March 23-24, 2009. This gathering of participants from academia, government, and industry brought together experts in suicide prevention, clinical trial design, psychometrics, pharmacoepidemiology, and genetics, as well as research psychiatrists involved in studies in studies of psychiatric disorders associated with elevated suicide risk across the life cycle. The process involved reviews of the relevant literature, and a series of 6 breakout sessions focused on specific questions of interest. Each of the participants at the meeting received references relevant to the formal presentations (as well as the slides for the presentations) for their review prior to the meeting. In addition, the assessment instruments of suicidal ideation/behavior were reviewed in relationship to standard measures of validity, reliability, and clinical utility, and these findings were discussed at length in relevant breakout groups, in the final plenary session, and in the preparation of the article. Consensus and dissenting views were noted. Discussion and questions followed each formal presentation during the plenary sessions. Approximately 6 questions per breakout group were prepared in advance by members of the Steering Committee and each breakout group chair. Consensus in the breakout groups was achieved by nominal group process. Consensus recommendations and any dissent were reviewed for each breakout group at the final plenary session. All plenary sessions were recorded and transcribed by a court stenographer. Following the transcript, with input by each of the authors, the final paper went through 14 drafts. The output of the meeting was organized into this brief report and the accompanying full article from which it is distilled. The full article was developed by the authors with feedback from all participants at the meeting and represents a consensus view. Any areas of disagreement at the conference have been noted in the text. The term suicidality is not as clinically useful as more specific terminology (ideation, behavior, attempts, and suicide). Most participants applauded the FDA's encouragement of standard definitions and definable expectations for investigators and industry sponsors. Further research of available assessment instruments is needed to verify their utility, reliability, and validity in identifying suicide-associated treatment-emergent adverse effects and/or a signal of efficacy in suicide prevention trials. The FDA needs to systematically monitor postmarketing events by encouraging the development of a validated instrument for postmarketing surveillance of suicidal ideation, behavior, and risk. Over time, the FDA, industry, and clinical researchers should evaluate the impact of the requirement that all central nervous system clinical drug trials must include a Columbia Classification Algorithm of Suicide Assessment (C-CASA)-compatible screening instrument for assessing and documenting the occurrence of treatment-emergent suicidal ideation and behavior. Finally, patients at high risk for suicide can safely be included in clinical trials, if proper precautions are followed. Copyright 2010 Physicians Postgraduate Press, Inc.

Validity issues in the evaluation of a measure of science and mathematics teacher knowledge

NASA Astrophysics Data System (ADS)

Talbot, Robert M., III

2011-12-01

This study investigates the reliability and validity of an instrument designed to measure science and mathematics teachers' strategic knowledge . Strategic knowledge is conceptualized as a construct that is related to pedagogical knowledge and is comprised of two dimensions: Flexible Application (FA) and Student Centered Instruction (SCI). The FA dimension describes how a science teacher invokes, applies and modifies her instructional repertoire in a given teaching context. The SCI dimension describes how a science teacher conceives of a given situation as an opportunity for active engagement with the students. The Flexible Application of Student-Centered Instruction (FASCI) survey instrument was designed to measure science teachers' strategic knowledge by eliciting open-ended responses to scenario-based items. This study addresses the following overarching question: What are some potential issues pertaining to the validity of measures of science and mathematics teacher knowledge? Using a validity argument framework, different sources of evidence are identified, collected, and evaluated to examine support for a set or propositions related to the intended score interpretation and instrument use: FASCI scores can be used to compare and distinguish the strategic knowledge of novice science and mathematics teachers in the evaluation of teacher education programs. Three separate but related studies are presented and discussed. These studies focus on the reliability of FASCI scores, the effect of adding specific science content to the scenario-based items, and the observation of strategic knowledge in teaching practice. Serious issues were found with the reliability of scores from the FASCI instrument. It was also found that adding science content to the scenario-based items has an effect on FASCI scores, but not for the reason hypothesized. Finally, it was found that more evidence is needed to make stronger claims about the relationship between FASCI scores and novice teachers' practice. In concluding this work, a set of four recommendations are presented for others who are engaged in similar measure development efforts. These recommendations focus on the areas of construct definition, item design and development, rater recruitment and training, and the validation process.

The Experiences in Close Relationship Scale (ECR)-short form: reliability, validity, and factor structure.

PubMed

Wei, Meifen; Russell, Daniel W; Mallinckrodt, Brent; Vogel, David L

2007-04-01

We developed a 12-item, short form of the Experiences in Close Relationship Scale (ECR; Brennan, Clark, & Shaver, 1998) across 6 studies. In Study 1, we examined the reliability and factor structure of the measure. In Studies 2 and 3, we cross-validated the reliability, factor structure, and validity of the short form measure; whereas in Study 4, we examined test-retest reliability over a 1-month period. In Studies 5 and 6, we further assessed the reliability, factor structure, and validity of the short version of the ECR when administered as a stand-alone instrument. Confirmatory factor analyses indicated that 2 factors, labeled Anxiety and Avoidance, provided a good fit to the data after removing the influence of response sets. We found validity to be equivalent for the short and the original versions of the ECR across studies. Finally, the results were comparable when we embedded the short form within the original version of the ECR and when we administered it as a stand-alone measure.

A call for change: clinical evaluation of student registered nurse anesthetists.

PubMed

Collins, Shawn; Callahan, Margaret Faut

2014-02-01

The ability to integrate theory with practice is integral to a student's success. A common reason for attrition from a nurse anesthesia program is clinical issues. To document clinical competence, students are evaluated using various tools. For use of a clinical evaluation tool as possible evidence for a student's dismissal, an important psychometric property to ensure is instrument validity. Clinical evaluation instruments of nurse anesthesia programs are not standardized among programs, which suggests a lack of instrument validity. The lack of established validity of the instruments used to evaluate students' clinical progress brings into question their ability to detect a student who is truly in jeopardy of attrition. Given this possibility, clinical instrument validity warrants research to be fair to students and improve attrition rates based on valid data. This ex post facto study evaluated a 17-item clinical instrument tool to demonstrate the need for validity of clinical evaluation tools. It also compared clinical scores with scores on the National Certification Examination.

Assessing the Quality of Mobile Exercise Apps Based on the American College of Sports Medicine Guidelines: A Reliable and Valid Scoring Instrument.

PubMed

Guo, Yi; Bian, Jiang; Leavitt, Trevor; Vincent, Heather K; Vander Zalm, Lindsey; Teurlings, Tyler L; Smith, Megan D; Modave, François

2017-03-07

Regular physical activity can not only help with weight management, but also lower cardiovascular risks, cancer rates, and chronic disease burden. Yet, only approximately 20% of Americans currently meet the physical activity guidelines recommended by the US Department of Health and Human Services. With the rapid development of mobile technologies, mobile apps have the potential to improve participation rates in exercise programs, particularly if they are evidence-based and are of sufficient content quality. The goal of this study was to develop and test an instrument, which was designed to score the content quality of exercise program apps with respect to the exercise guidelines set forth by the American College of Sports Medicine (ACSM). We conducted two focus groups (N=14) to elicit input for developing a preliminary 27-item scoring instruments based on the ACSM exercise prescription guidelines. Three reviewers who were no sports medicine experts independently scored 28 exercise program apps using the instrument. Inter- and intra-rater reliability was assessed among the 3 reviewers. An expert reviewer, a Fellow of the ACSM, also scored the 28 apps to create criterion scores. Criterion validity was assessed by comparing nonexpert reviewers' scores to the criterion scores. Overall, inter- and intra-rater reliability was high with most coefficients being greater than .7. Inter-rater reliability coefficients ranged from .59 to .99, and intra-rater reliability coefficients ranged from .47 to 1.00. All reliability coefficients were statistically significant. Criterion validity was found to be excellent, with the weighted kappa statistics ranging from .67 to .99, indicating a substantial agreement between the scores of expert and nonexpert reviewers. Finally, all apps scored poorly against the ACSM exercise prescription guidelines. None of the apps received a score greater than 35, out of a possible maximal score of 70. We have developed and presented valid and reliable scoring instruments for exercise program apps. Our instrument may be useful for consumers and health care providers who are looking for apps that provide safe, progressive general exercise programs for health and fitness. ©Yi Guo, Jiang Bian, Trevor Leavitt, Heather K Vincent, Lindsey Vander Zalm, Tyler L Teurlings, Megan D Smith, François Modave. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 07.03.2017.

University of Wisconsin-Madison Participation in the International Water-Vapor Project (IHOP)

NASA Technical Reports Server (NTRS)

Knuteson, Robert; Antonelli, Paolo; Best, Fred; Dutcher, Steve; Feltz, Wayne; Revercomb, Henry

2003-01-01

This is the final report for NASA grant NAG-1-02057/University of Wisconsin-Madison/Dr. Henry E Revercomb, PI. This grant supported the University of Wisconsin-Madison participation in the International Water-Vapor Project (IHOP) experiment in May-June 2002. The upwelling thermal infrared emission from the surface and atmosphere over the U. S. Southern Great Plains was obtained from the NASA DC-8 with the Scanning High-resolution Interferometer Sounder (S-HIS) instrument, Analysis of the S-HIS radiances were used to obtain atmospheric temperature profiles below the aircraft. In a complementary manner, the downwelling thermal infrared emission at the surface was obtained by the University of Wisconsin Atmospheric Emitted Radiance Interferometer (AERI) instrument from a mobile research vehicle and used to profile the atmospheric boundary layer at the Homestead site. This report summarizes the observations of the S-HIS and AERI instruments during IHOP including validation against in situ observations.

[The instruments for subjective assessment of work-related stress].

PubMed

Conway, P M

2009-01-01

The instruments for subjective assessment of work-related stress are aimed to evaluate individual perceptions of aspects that are crucial in the causal process linking psychosocial exposure to harmful physical and psychological health effects. Subjective assessment is most commonly performed by means of self-administered questionnaires, non least for their ability to hold down financial and economic costs of both field studies and data analyses. A common problem is that, for the major part of these questionnaires, no Italian validated (or accept) versions exist. Among available questionnaires, those that have been applied to a higher number of subjects in Italy are the Job Content Questionnaire, the Effort/Reward Imbalance Questionnaire, the Occupational Stress Indicator and the Multidimensional Questionnaire of Organizational Health. In this contribution, the main characteristics of the above-mentioned instruments are depicted. Finally, important aspects relating to the usage of self-administered questionnaires are emphasized, mainly when field evaluations are undertaken in specific work contexts.

Instrumental variable methods in comparative safety and effectiveness research.

PubMed

Brookhart, M Alan; Rassen, Jeremy A; Schneeweiss, Sebastian

2010-06-01

Instrumental variable (IV) methods have been proposed as a potential approach to the common problem of uncontrolled confounding in comparative studies of medical interventions, but IV methods are unfamiliar to many researchers. The goal of this article is to provide a non-technical, practical introduction to IV methods for comparative safety and effectiveness research. We outline the principles and basic assumptions necessary for valid IV estimation, discuss how to interpret the results of an IV study, provide a review of instruments that have been used in comparative effectiveness research, and suggest some minimal reporting standards for an IV analysis. Finally, we offer our perspective of the role of IV estimation vis-à-vis more traditional approaches based on statistical modeling of the exposure or outcome. We anticipate that IV methods will be often underpowered for drug safety studies of very rare outcomes, but may be potentially useful in studies of intended effects where uncontrolled confounding may be substantial.

Validation of a quality-of-life measure for deaf or hard of hearing youth.

PubMed

Patrick, Donald L; Edwards, Todd C; Skalicky, Anne M; Schick, Brenda; Topolski, Tari D; Kushalnagar, Poorna; Leng, Mei; O'Neill-Kemp, Aprille M; Sie, Kathleen Sie

2011-07-01

Quality-of-life (QOL) measures targeting youth with hearing loss are useful in population needs assessment, educational placement, and program design and evaluation. This study assesses the cross-sectional validity of the Youth Quality of Life Instrument-Deaf and Hard of Hearing Module (YQOL-DHH). STUDY DESIGN. Instrument development and cross-sectional survey. Recruitment through schools, professional organizations, clinics, and programs for youth who are deaf or hard of hearing. SUBJECTS AND METHODS. Thirty-five candidate items were administered to 230 adolescents aged 11 to 18 years: 49% female, 61% white, 11% mild hearing loss, 20% moderate/moderate-severe, 41% severe/profound, and 28% with cochlear implants. Participants completed individual or group-administered questionnaires by paper and pencil (58%), Web-based English (29%), American Sign Language (ASL) or Pidgin Signed English (PSE) (9%) on DVD, or interviewer-supervised ASL or PSE DVD (4%). The Children's Depression Inventory (CDI-S) was also completed. Factor structure, reliability, construct validity, and respondent burden were assessed. Thirty-two items were retained in the final instrument covering 3 domains: self-acceptance/advocacy (14 items, Cronbach α = 0.84), perceived stigma (8 items, Cronbach α = 0.85), and participation (10 items, Cronbach α = 0.86). QOL was not significantly associated with hearing level. One-week test-retest coefficients were acceptable: self-acceptance/ advocacy (0.70), perceived stigma (0.78), and participation 0.92). As predicted, the total CDI-S score was associated in the appropriate direction (P < .0001) with all YQOL-DHH domains. Time to complete the paper-and-pencil version was 12 minutes. The YQOL-DHH shows good reliability and validity for assessing hearing-specific QOL in adolescents.

Validation of an instrument to assess barriers to care-seeking for accidental bowel leakage in women: the BCABL questionnaire

PubMed Central

Brown, Heidi Wendell; Wise, Meg E.; Westenberg, Danielle; Schmuhl, Nicholas B.; Brezoczky, Kelly Lewis; Rogers, Rebecca G.; Constantine, Melissa L.

2017-01-01

Introduction and hypothesis Fewer than 30% of women with accidental bowel leakage (ABL) seek care, despite the existence of effective, minimally invasive therapies. We developed and validated a condition-specific instrument to assess barriers to care-seeking for ABL in women. Methods Adult women with ABL completed an electronic survey about condition severity, patient activation, previous care-seeking, and demographics. The Barriers to Care-seeking for Accidental Bowel Leakage (BCABL) instrument contained 42 potential items completed at baseline and again 2 weeks later. Paired t tests evaluated test–retest reliability. Factor analysis evaluated factor structure and guided item retention. Cronbach’s alpha evaluated internal consistency. Within and across factor item means generated a summary BCABL score used to evaluate scale validity with six external criterion measures. Results Among 1,677 click-throughs, 736 (44%) entered the survey; 95% of eligible female respondents (427 out of 458) provided complete data. Fifty-three percent of respondents had previously sought care for their ABL; median age was 62 years (range 27–89); mean Vaizey score was 12.8 (SD = 5.0), indicating moderate to severe ABL. Test–retest reliability was excellent for all items. Factor extraction via oblique rotation resulted in the final structure of 16 items in six domains, within which internal consistency was high. All six external criterion measures correlated significantly with BCABL score. Conclusions The BCABL questionnaire, with 16 items mapping to six domains, has excellent criterion validity and test–retest reliability when administered electronically in women with ABL. The BCABL can be used to identify care-seeking barriers for ABL in different populations, inform targeted interventions, and measure their effectiveness. PMID:28236039

78 FR 21617 - Notice of Proposed Information Collection: Comment Request; Final Endorsement of Credit Instrument

Federal Register 2010, 2011, 2012, 2013, 2014

2013-04-11

... Information Collection: Comment Request; Final Endorsement of Credit Instrument AGENCY: Office of the... Proposal: Final Endorsement of Credit Instrument. OMB Control Number, if applicable: 2502-0016. Description... Endorsement of Credit Instrument'' form is used to request to request final endorsement by HUD of the credit...

The Development of an Instrument for Measuring Healing

PubMed Central

Meza, James Peter; Fahoome, Gail F.

2008-01-01

PURPOSE Our lack of ability to measure healing attributes impairs our ability to research the topic. The specific aim of this project is to describe the psychological and social construct of healing and to create a valid and reliable measurement scale for attributes of healing. METHODS A content expert conducted a domain analysis examining the existing literature of midrange theories of healing. Theme saturation of content sampling was ensured by brainstorming more than 220 potential items. Selection of items was sequential: pile sorting and data reduction, with factor analysis of a mailed 54-item questionnaire. Criterion validity (convergent and divergent) and temporal reliability were established using a second mailing of the development version of the instrument. Construct validity was judged with structural equation modeling for goodness of fit. RESULTS Cronbach’s α of the original questionnaire was .869 and the final scale was .862. The test-retest reliability was .849. Eigenvalues for the 2 factors were 8 and 4, respectively. Divergent and convergent validity using the Spann-Fischer Codependency Scale and SF-36 mental health and emotional subscales were consistent with predictions. The root mean square error of approximation was 0.066 and Bentler’s Comparative Fit Index was 0.871. Root mean square residual was 0.102. CONCLUSIONS We developed a valid and reliable measurement scale for attributes of healing, which we named the Self-Integration Scale v 2.1. By creating a new variable, new areas of research in humanistic health care are possible. PMID:18626036

Development and Validation of an Instrument to Assess the Implementation of Family-Centred Care in Traditional Open Bay Neonatal Intensive Care Units

ERIC Educational Resources Information Center

Al-Motlaq, Mohammad A.; Abuidhail, Jamila; Salameh, Taghreed; Awwad, Wesam

2017-01-01

Objective: To develop an instrument to study family-centred care (FCC) in traditional open bay Neonatal Intensive Care Units (NICUs). Methods: The development process involved constructing instrument's items, establishing content validity by an expert panel and testing the instrument for validity and reliability with a convenience sample of 25…

Social Loafing Construct Validity in Higher Education: How Well Do Three Measures of Social Loafing Stand up to Scrutiny?

ERIC Educational Resources Information Center

de l'Eau, Jacquelyn

2017-01-01

The purpose of this study was to examine the construct validity of social loafing using convergent and discriminant validity principles. Three instruments that purport to measure social loafing were factor analyzed: A ten-item instrument by George (1992), a 13-item instrument by Mulvey and Klein (1998), and a 22-item instrument by Jassawalla,…

A Reliability and Validity of an Instrument to Evaluate the School-Based Assessment System: A Pilot Study

ERIC Educational Resources Information Center

Ghazali, Nor Hasnida Md

2016-01-01

A valid, reliable and practical instrument is needed to evaluate the implementation of the school-based assessment (SBA) system. The aim of this study is to develop and assess the validity and reliability of an instrument to measure the perception of teachers towards the SBA implementation in schools. The instrument is developed based on a…

Reliability and Validity of the Turkish Version of the Job Performance Scale Instrument.

PubMed

Harmanci Seren, Arzu Kader; Tuna, Rujnan; Eskin Bacaksiz, Feride

2018-02-01

Objective measurement of the job performance of nursing staff using valid and reliable instruments is important in the evaluation of healthcare quality. A current, valid, and reliable instrument that specifically measures the performance of nurses is required for this purpose. The aim of this study was to determine the validity and reliability of the Turkish version of the Job Performance Instrument. This study used a methodological design and a sample of 240 nurses working at different units in four hospitals in Istanbul, Turkey. A descriptive data form, the Job Performance Scale, and the Employee Performance Scale were used to collect data. Data were analyzed using IBM SPSS Statistics Version 21.0 and LISREL Version 8.51. On the basis of the data analysis, the instrument was revised. Some items were deleted, and subscales were combined. The Turkish version of the Job Performance Instrument was determined to be valid and reliable to measure the performance of nurses. The instrument is suitable for evaluating current nursing roles.

Development and testing of an assessment instrument for the formative peer review of significant event analyses.

PubMed

McKay, J; Murphy, D J; Bowie, P; Schmuck, M-L; Lough, M; Eva, K W

2007-04-01

To establish the content validity and specific aspects of reliability for an assessment instrument designed to provide formative feedback to general practitioners (GPs) on the quality of their written analysis of a significant event. Content validity was quantified by application of a content validity index. Reliability testing involved a nested design, with 5 cells, each containing 4 assessors, rating 20 unique significant event analysis (SEA) reports (10 each from experienced GPs and GPs in training) using the assessment instrument. The variance attributable to each identified variable in the study was established by analysis of variance. Generalisability theory was then used to investigate the instrument's ability to discriminate among SEA reports. Content validity was demonstrated with at least 8 of 10 experts endorsing all 10 items of the assessment instrument. The overall G coefficient for the instrument was moderate to good (G>0.70), indicating that the instrument can provide consistent information on the standard achieved by the SEA report. There was moderate inter-rater reliability (G>0.60) when four raters were used to judge the quality of the SEA. This study provides the first steps towards validating an instrument that can provide educational feedback to GPs on their analysis of significant events. The key area identified to improve instrument reliability is variation among peer assessors in their assessment of SEA reports. Further validity and reliability testing should be carried out to provide GPs, their appraisers and contractual bodies with a validated feedback instrument on this aspect of the general practice quality agenda.

ISSARS Aerosol Database : an Incorporation of Atmospheric Particles into a Universal Tool to Simulate Remote Sensing Instruments

NASA Technical Reports Server (NTRS)

Goetz, Michael B.

2011-01-01

The Instrument Simulator Suite for Atmospheric Remote Sensing (ISSARS) entered its third and final year of development with an overall goal of providing a unified tool to simulate active and passive space borne atmospheric remote sensing instruments. These simulations focus on the atmosphere ranging from UV to microwaves. ISSARS handles all assumptions and uses various models on scattering and microphysics to fill the gaps left unspecified by the atmospheric models to create each instrument's measurements. This will help benefit mission design and reduce mission cost, create efficient implementation of multi-instrument/platform Observing System Simulation Experiments (OSSE), and improve existing models as well as new advanced models in development. In this effort, various aerosol particles are incorporated into the system, and a simulation of input wavelength and spectral refractive indices related to each spherical test particle(s) generate its scattering properties and phase functions. These atmospheric particles being integrated into the system comprise the ones observed by the Multi-angle Imaging SpectroRadiometer(MISR) and by the Multiangle SpectroPolarimetric Imager(MSPI). In addition, a complex scattering database generated by Prof. Ping Yang (Texas A&M) is also incorporated into this aerosol database. Future development with a radiative transfer code will generate a series of results that can be validated with results obtained by the MISR and MSPI instruments; nevertheless, test cases are simulated to determine the validity of various plugin libraries used to determine or gather the scattering properties of particles studied by MISR and MSPI, or within the Single-scattering properties of tri-axial ellipsoidal mineral dust particles database created by Prof. Ping Yang.

Patient-Oriented Eczema Measure (POEM), a core instrument to measure symptoms in clinical trials: a Harmonising Outcome Measures for Eczema (HOME) statement.

PubMed

Spuls, P I; Gerbens, L A A; Simpson, E; Apfelbacher, C J; Chalmers, J R; Thomas, K S; Prinsen, C A C; von Kobyletzki, L B; Singh, J A; Williams, H C; Schmitt, J

2017-04-01

The Harmonising Outcome Measures for Eczema (HOME) initiative has defined four core outcome domains for a core outcome set (COS) to be measured in all atopic eczema (AE) trials to ensure cross-trial comparison: clinical signs, symptoms, quality of life and long-term control. The aim of this paper is to report on the consensus process that was used to select the core instrument to consistently assess symptoms in all future AE trials. Following the HOME roadmap, two systematic reviews were performed which identified three instruments that had sufficient evidence of validity, reliability and feasibility to be considered for the final COS. At the fourth international HOME meeting, there was broad consensus among all stakeholders that the Patient-Oriented Eczema Measure (POEM) should be used as the core instrument (87·5% agreed, 9·4% unsure, 3·1% disagreed). All relevant stakeholders are encouraged to use POEM as the chosen instrument to measure the core domain of symptoms in all future AE clinical trials. Other instruments of interest can be used in addition to POEM. © 2016 British Association of Dermatologists.

Cognitive assessment: A challenge for occupational therapists in Brazil

PubMed Central

Conti, Juliana

2017-01-01

Cognitive impairment is a common dysfunction after neurological injury. Cognitive assessment tools can help the therapist understand how impairments are affecting functional status and quality of life. Objective The aim of the study was to identify instruments for cognitive assessment that Occupational Therapists (OT) can use in clinical practice. Methods The instruments published in English and Portuguese between 1999 and 2016 were systematically reviewed. Results The search identified 17 specific instruments for OT not validated in Brazilian Portuguese, 10 non-specific instruments for OT not validated in Brazilian Portuguese, and 25 instruments validated for Portuguese, only one of which was specific for OT (Lowenstein Occupational Therapy Cognitive Assessment). Conclusion There are few assessment cognitive tools validated for use in the Brazilian culture and language. The majority of the instruments appear not to be validated for use by OT in clinical practice. PMID:29213503

Development of the Patient Education Materials Assessment Tool (PEMAT): A new measure of understandability and actionability for print and audiovisual patient information

PubMed Central

Shoemaker, Sarah J.; Wolf, Michael S.; Brach, Cindy

2016-01-01

Objective To develop a reliable and valid instrument to assess the understandability and actionability of print and audiovisual materials. Methods We compiled items from existing instruments/guides that the expert panel assessed for face/content validity. We completed four rounds of reliability testing, and produced evidence of construct validity with consumers and readability assessments. Results The experts deemed the PEMAT items face/content valid. Four rounds of reliability testing and refinement were conducted using raters untrained on the PEMAT. Agreement improved across rounds. The final PEMAT showed moderate agreement per Kappa (Average K = 0.57) and strong agreement per Gwet’s AC1 (Average = 0.74). Internal consistency was strong (α = 0.71; Average Item-Total Correlation = 0.62). For construct validation with consumers (n = 47), we found significant differences between actionable and poorly-actionable materials in comprehension scores (76% vs. 63%, p < 0.05) and ratings (8.9 vs. 7.7, p < 0.05). For understandability, there was a significant difference for only one of two topics on consumer numeric scores. For actionability, there were significant positive correlations between PEMAT scores and consumer-testing results, but no relationship for understandability. There were, however, strong, negative correlations between grade-level and both consumer-testing results and PEMAT scores. Conclusions The PEMAT demonstrated strong internal consistency, reliability, and evidence of construct validity. Practice implications The PEMAT can help professionals judge the quality of materials (available at: http://www.ahrq.gov/pemat). PMID:24973195

Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information.

PubMed

Shoemaker, Sarah J; Wolf, Michael S; Brach, Cindy

2014-09-01

To develop a reliable and valid instrument to assess the understandability and actionability of print and audiovisual materials. We compiled items from existing instruments/guides that the expert panel assessed for face/content validity. We completed four rounds of reliability testing, and produced evidence of construct validity with consumers and readability assessments. The experts deemed the PEMAT items face/content valid. Four rounds of reliability testing and refinement were conducted using raters untrained on the PEMAT. Agreement improved across rounds. The final PEMAT showed moderate agreement per Kappa (Average K=0.57) and strong agreement per Gwet's AC1 (Average=0.74). Internal consistency was strong (α=0.71; Average Item-Total Correlation=0.62). For construct validation with consumers (n=47), we found significant differences between actionable and poorly-actionable materials in comprehension scores (76% vs. 63%, p<0.05) and ratings (8.9 vs. 7.7, p<0.05). For understandability, there was a significant difference for only one of two topics on consumer numeric scores. For actionability, there were significant positive correlations between PEMAT scores and consumer-testing results, but no relationship for understandability. There were, however, strong, negative correlations between grade-level and both consumer-testing results and PEMAT scores. The PEMAT demonstrated strong internal consistency, reliability, and evidence of construct validity. The PEMAT can help professionals judge the quality of materials (available at: http://www.ahrq.gov/pemat). Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Adaptation and Validation of the Cambridge Pulmonary Hypertension Outcome Review (CAMPHOR) for Use in Spain.

PubMed

Aguirre-Camacho, Aldo; Stepanous, Jessica; Blanco-Donoso, Luis M; Moreno-Jiménez, Bernardo; Wilburn, Jeanette; González-Saiz, Laura; McKenna, Stephen P

2017-06-01

The Cambridge Pulmonary Hypertension Outcome Review (CAMPHOR) is a patient-reported outcome measure of health-related quality of life and quality of life specific to individuals with pulmonary hypertension (PH). This questionnaire has demonstrated superiority over other instruments assessing similar domains. The objective of the present study was to adapt and validate the Spanish version of the questionnaire. The adaptation consisted of 3 stages: translation from English to Spanish using bilingual and lay panels, cognitive debriefing interviews with patients, and assessment of psychometric properties by means of a postal validation survey. The translation panels produced a version of the CAMPHOR that was considered suitable for use by Spanish PH patients. The relevance, comprehensiveness, and acceptability of this version were confirmed in interviews with PH patients. Finally, the validation survey (n = 70) revealed that the 3 CAMPHOR scales (Symptoms, Activities, and Quality of life) showed strong psychometric properties. The internal consistency (Cronbach α) coefficients of the scales were above 0.89, and the test-retest reliability was above 0.87. The convergent and known group validity of the CAMPHOR scales was also demonstrated. The Spanish version of the CAMPHOR is a valid and reliable instrument for the assessment of health-related quality of life and quality of life in Spanish PH patients. Therefore, it is recommended for use in future research and clinical practice in the Spanish population of PH patients. Copyright © 2016 Sociedad Española de Cardiología. Published by Elsevier España, S.L.U. All rights reserved.

The Servant Leadership Survey: Development and Validation of a Multidimensional Measure.

PubMed

van Dierendonck, Dirk; Nuijten, Inge

2011-09-01

PURPOSE: The purpose of this paper is to describe the development and validation of a multi-dimensional instrument to measure servant leadership. DESIGN/METHODOLOGY/APPROACH: Based on an extensive literature review and expert judgment, 99 items were formulated. In three steps, using eight samples totaling 1571 persons from The Netherlands and the UK with a diverse occupational background, a combined exploratory and confirmatory factor analysis approach was used. This was followed by an analysis of the criterion-related validity. FINDINGS: The final result is an eight-dimensional measure of 30 items: the eight dimensions being: standing back, forgiveness, courage, empowerment, accountability, authenticity, humility, and stewardship. The internal consistency of the subscales is good. The results show that the Servant Leadership Survey (SLS) has convergent validity with other leadership measures, and also adds unique elements to the leadership field. Evidence for criterion-related validity came from studies relating the eight dimensions to well-being and performance. IMPLICATIONS: With this survey, a valid and reliable instrument to measure the essential elements of servant leadership has been introduced. ORIGINALITY/VALUE: The SLS is the first measure where the underlying factor structure was developed and confirmed across several field studies in two countries. It can be used in future studies to test the underlying premises of servant leadership theory. The SLS provides a clear picture of the key servant leadership qualities and shows where improvements can be made on the individual and organizational level; as such, it may also offer a valuable starting point for training and leadership development.

Antineoplastic agents extravasation from peripheral intravenous line in children: a simple strategy for a safer nursing care.

PubMed

Chanes, Daniella Cristina; da Luz Gonçalves Pedreira, Mavilde; de Gutiérrez, Maria Gaby Rivero

2012-02-01

The antineoplastic agents infusion through peripheral lines may lead to several adverse events such as extravasation that is one of the most severe acute reactions of this sort of treatment. The extravasation prevention and management must be part of a safe and evidence-based nursing care. Due to this fact, two algorithms were developed with the purpose of guiding nursing care to children who undergo chemotherapy through peripheral line. The objectives of this study were to determine the content validity of both algorithms with pediatric oncology nurses in Brazil and United States of America, and to verify the agreement between the evaluations of both groups. A descriptive validation study was carried out through the Delphi Technique that has the following steps: development of the data collection instrument, application to the specialists, data analysis, algorithms' review, re-evaluation by the specialists, final data analysis and content validity determination. The data analysis was descriptive and based on the specialists agreement consensus equal or higher than 80% in every step of the algorithms. The process showed that the agreement with both instruments ranged from 92.8% to 99.0%. The algorithms are valid for application in nursing care with the main purpose of preventing and managing the antineoplastic agents' extravasation. Copyright © 2011 Elsevier Ltd. All rights reserved.

Stroke and aphasia quality-of-life scale-39: Reliability and validity of the Turkish version.

PubMed

Noyan-ErbaŞ, AyŞin; Toğram, Bülent

2016-10-01

The aim of this study was to adapt the stroke and aphasia quality-of-life scale-39 (SAQoL-39) to the Turkish language and carry out a reliability and validity study of the instrument in a group of patients with aphasia. The study was a descriptive study and contained three phases: adaptation of the SAQoL-39 to the Turkish language, administration of the scale to 30 aphasia patients and reliability and validity studies of the scale. Internal consistency was assessed with Cronbach's alpha and test-re-test reliability was explored (n = 14). The adaptation process was completed based on inter-rater agreement on the translated items and within the scope of final editing by the authors of the study. The SAQoL-39 in Turkish exhibited high test-re-test reliability (ICC =0.97) as well as acceptability with minimal missing data (0-1.4). This instrument exhibited high internal consistency (Cronbach's α = 0.70-0.97), domain-total correlations (r = 0.76-0.85) and inter-domain correlations (r = 0.40-0.68). The analysis shows that the Turkish version of SAQoL-39 is a scale that is highly acceptable, valid and reliable and can be easily used in evaluating the quality-of-life of Turkish people with aphasia.

The sense of security in care--Relatives' Evaluation instrument: its development and presentation.

PubMed

Krevers, Barbro; Milberg, Anna

2015-03-01

Relatives' sense of security in their family members' palliative home care is important, and a valid and reliable instrument is needed to measure this. The aim of this article is to report the development, structure, and psychometric properties of a new instrument, the Sense of Security in Care--Relatives' Evaluation (SEC-R), in palliative home care. Instrument development was based on a previous study and review of the literature; 213 relatives (55% women) of patients in palliative home care were recruited (response rate 73%) and participated in a structured interview based on a questionnaire. Principal component analysis (PCA) was used to identify subscales. The construction was tested in correlation with other scales and questions representing concepts expected to be related to sense of security in care. The PCA resulted in three subscales, namely care interaction, mastery and patient situation, which had an explained variance of 53%. Internal consistency of the subscales ranged from 0.76 to 0.78. The final instrument comprises 17 items. The scales were associated with the quality-of-care process and the relatives' situation, perceived health, quality of life, stress, general sense of security, and general sense of security in care. The SEC-R provides a three-component assessment of palliative home care settings using valid and reliable scales associated with other concepts. The SEC-R is a manageable means of assessment that may contribute to quality-of-care measures and to further research on relatives' sense of security in care. Copyright © 2015 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Student mathematical imagination instruments: construction, cultural adaptation and validity

NASA Astrophysics Data System (ADS)

Dwijayanti, I.; Budayasa, I. K.; Siswono, T. Y. E.

2018-03-01

Imagination has an important role as the center of sensorimotor activity of the students. The purpose of this research is to construct the instrument of students’ mathematical imagination in understanding concept of algebraic expression. The researcher performs validity using questionnaire and test technique and data analysis using descriptive method. Stages performed include: 1) the construction of the embodiment of the imagination; 2) determine the learning style questionnaire; 3) construct instruments; 4) translate to Indonesian as well as adaptation of learning style questionnaire content to student culture; 5) perform content validation. The results stated that the constructed instrument is valid by content validation and empirical validation so that it can be used with revisions. Content validation involves Indonesian linguists, english linguists and mathematics material experts. Empirical validation is done through a legibility test (10 students) and shows that in general the language used can be understood. In addition, a questionnaire test (86 students) was analyzed using a biserial point correlation technique resulting in 16 valid items with a reliability test using KR 20 with medium reability criteria. While the test instrument test (32 students) to find all items are valid and reliability test using KR 21 with reability is 0,62.

26 CFR 1.1041-2 - Redemptions of stock.

Code of Federal Regulations, 2010 CFR

2010-04-01

... paragraph (a)(2) of this section, if a divorce or separation instrument, or a valid written agreement... of paragraph (a)(1) of this section, if a divorce or separation instrument, or a valid written... paragraph (c), a divorce or separation instrument must be effective, or a valid written agreement must be...

26 CFR 1.1041-2 - Redemptions of stock.

Code of Federal Regulations, 2014 CFR

2014-04-01

... paragraph (a)(2) of this section, if a divorce or separation instrument, or a valid written agreement... of paragraph (a)(1) of this section, if a divorce or separation instrument, or a valid written... paragraph (c), a divorce or separation instrument must be effective, or a valid written agreement must be...

26 CFR 1.1041-2 - Redemptions of stock.

Code of Federal Regulations, 2013 CFR

2013-04-01

... paragraph (a)(2) of this section, if a divorce or separation instrument, or a valid written agreement... of paragraph (a)(1) of this section, if a divorce or separation instrument, or a valid written... paragraph (c), a divorce or separation instrument must be effective, or a valid written agreement must be...

26 CFR 1.1041-2 - Redemptions of stock.

Code of Federal Regulations, 2011 CFR

2011-04-01

... paragraph (a)(2) of this section, if a divorce or separation instrument, or a valid written agreement... of paragraph (a)(1) of this section, if a divorce or separation instrument, or a valid written... paragraph (c), a divorce or separation instrument must be effective, or a valid written agreement must be...

26 CFR 1.1041-2 - Redemptions of stock.

Code of Federal Regulations, 2012 CFR

2012-04-01

... paragraph (a)(2) of this section, if a divorce or separation instrument, or a valid written agreement... of paragraph (a)(1) of this section, if a divorce or separation instrument, or a valid written... paragraph (c), a divorce or separation instrument must be effective, or a valid written agreement must be...

Register of Validated Short Dietary Assessment Instruments

Cancer.gov

The register contains descriptive information about the instruments identified (over 135) along with any associated validation studies and publications, and copies of the instruments themselves when available.

Assessing the overuse of antibiotics in children in Saudi Arabia: validation of the parental perception on antibiotics scale (PAPA scale)

PubMed Central

2013-01-01

Background Antibiotics overuse is a global public health issue influenced by several factors, of which some are parent-related psychosocial factors that can only be measured using valid and reliable psychosocial measurement instruments. The PAPA scale was developed to measure these factors and the content validity of this instrument was assessed. Aim This study further validated the recently developed instrument in terms of (1) face validity and (2) construct validity including: deciding the number and nature of factors, and item selection. Methods Questionnaires were self-administered to parents of children between the ages of 0 and 12 years old. Parents were conveniently recruited from schools’ parental meetings in the Eastern Province, Saudi Arabia. Face validity was assessed with regards to questionnaire clarity and unambiguity. Construct validity and item selection processes were conducted using Exploratory factor analysis. Results Parallel analysis and Exploratory factor analysis using principal axis factoring produced six factors in the developed instrument: knowledge and beliefs, behaviours, sources of information, adherence, awareness about antibiotics resistance, and parents’ perception regarding doctors’ prescribing behaviours. Reliability was assessed (Cronbach’s alpha = 0.78) which demonstrates the instrument as being reliable. Conclusion The ‘factors’ produced in this study coincide with the constructs contextually identified in the development phase of other instruments used to study antibiotic use. However, no other study considering perceptions of antibiotic use had gone beyond content validation of such instruments. This study is the first to constructively validate the factors underlying perceptions regarding antibiotic use in any population and in parents in particular. PMID:23497151

Cross-cultural validation of instruments measuring health beliefs about colorectal cancer screening among Korean Americans.

PubMed

Lee, Shin-Young; Lee, Eunice E

2015-02-01

The purpose of this study was to report the instrument modification and validation processes to make existing health belief model scales culturally appropriate for Korean Americans (KAs) regarding colorectal cancer (CRC) screening utilization. Instrument translation, individual interviews using cognitive interviewing, and expert reviews were conducted during the instrument modification phase, and a pilot test and a cross-sectional survey were conducted during the instrument validation phase. Data analyses of the cross-sectional survey included internal consistency and construct validity using exploratory and confirmatory factor analysis. The main issues identified during the instrument modification phase were (a) cultural and linguistic translation issues and (b) newly developed items reflecting Korean cultural barriers. Cross-sectional survey analyses during the instrument validation phase revealed that all scales demonstrate good internal consistency reliability (Cronbach's alpha=.72~.88). Exploratory factor analysis showed that susceptibility and severity loaded on the same factor, which may indicate a threat variable. Items with low factor loadings in the confirmatory factor analysis may relate to (a) lack of knowledge about fecal occult blood testing and (b) multiple dimensions of the subscales. Methodological, sequential processes of instrument modification and validation, including translation, individual interviews, expert reviews, pilot testing and a cross-sectional survey, were provided in this study. The findings indicate that existing instruments need to be examined for CRC screening research involving KAs.

Development of the Brazilian Portuguese version of the Achilles Tendon Total Rupture Score (ATRS BrP): a cross-cultural adaptation with reliability and construct validity evaluation.

PubMed

Zambelli, Roberto; Pinto, Rafael Z; Magalhães, João Murilo Brandão; Lopes, Fernando Araujo Silva; Castilho, Rodrigo Simões; Baumfeld, Daniel; Dos Santos, Thiago Ribeiro Teles; Maffulli, Nicola

2016-01-01

There is a need for a patient-relevant instrument to evaluate outcome after treatment in patients with a total Achilles tendon rupture. The purpose of this study was to undertake a cross-cultural adaptation of the Achilles Tendon Total Rupture Score (ATRS) into Brazilian Portuguese, determining the test-retest reliability and construct validity of the instrument. A five-step approach was used in the cross-cultural adaptation process: initial translation (two bilingual Brazilian translators), synthesis of translation, back-translation (two native English language translators), consensus version and evaluation (expert committee), and testing phase. A total of 46 patients were recruited to evaluate the test-retest reproducibility and construct validity of the Brazilian Portuguese version of the ATRS. Test-retest reproducibility was performed by assessing each participant on two separate occasions. The construct validity was determined by the correlation index between the ATRS and the Orthopedic American Foot and Ankle Society (AOFAS) questionnaires. The final version of the Brazilian Portuguese ATRS had the same number of questions as the original ATRS. For the reliability analysis, an ICC(2,1) of 0.93 (95 % CI: 0.88 to 0.96) with SEM of 1.56 points and MDC of 4.32 was observed, indicating excellent reliability. The construct validity showed excellent correlation with R = 0.76 (95 % CI: 0.52 to 0.89, P < 0.001). The ATRS was successfully cross-culturally validated into Brazilian Portuguese. This version was a reliable and valid measure of function in patients who suffered complete rupture of the Achilles Tendon.

A framework and a measurement instrument for sustainability of work practices in long-term care

PubMed Central

2011-01-01

Background In health care, many organizations are working on quality improvement and/or innovation of their care practices. Although the effectiveness of improvement processes has been studied extensively, little attention has been given to sustainability of the changed work practices after implementation. The objective of this study is to develop a theoretical framework and measurement instrument for sustainability. To this end sustainability is conceptualized with two dimensions: routinization and institutionalization. Methods The exploratory methodological design consisted of three phases: a) framework development; b) instrument development; and c) field testing in former improvement teams in a quality improvement program for health care (N teams = 63, N individual = 112). Data were collected not until at least one year had passed after implementation. Underlying constructs and their interrelations were explored using Structural Equation Modeling and Principal Component Analyses. Internal consistency was computed with Cronbach's alpha coefficient. A long and a short version of the instrument are proposed. Results The χ2- difference test of the -2 Log Likelihood estimates demonstrated that the hierarchical two factor model with routinization and institutionalization as separate constructs showed a better fit than the one factor model (p < .01). Secondly, construct validity of the instrument was strong as indicated by the high factor loadings of the items. Finally, the internal consistency of the subscales was good. Conclusions The theoretical framework offers a valuable starting point for the analysis of sustainability on the level of actual changed work practices. Even though the two dimensions routinization and institutionalization are related, they are clearly distinguishable and each has distinct value in the discussion of sustainability. Finally, the subscales conformed to psychometric properties defined in literature. The instrument can be used in the evaluation of improvement projects. PMID:22087884

Measuring patients' satisfaction with their anti-TNF treatment in severe Crohn's disease: scoring and psychometric validation of the Satisfaction for PAtients in Crohn's diseasE Questionnaire (SPACE-Q(©)).

PubMed

Gilet, Hélène; Arnould, Benoit; Fofana, Fatoumata; Clerson, Pierre; Colombel, Jean-Frédéric; D'Hondt, Olivier; Faure, Patrick; Hagège, Hervé; Nachury, Maria; Nahon, Stéphane; Tucat, Gilbert; Vandromme, Luc; Cazala-Telinge, Ines; Thibout, Emmanuel

2014-01-01

Severe Crohn's disease management includes anti-tumor necrosis factor (anti-TNF) drugs that differ from early-stage treatments regarding efficacy, safety, and convenience. This study aimed to finalize and psychometrically validate the Satisfaction for PAtients in Crohn's diseasE Questionnaire (SPACE-Q(©)), developed to measure satisfaction with anti-TNF treatment in patients with severe Crohn's disease. A total of 279 patients with severe Crohn's disease receiving anti-TNF therapy completed the SPACE-Q 62-item pilot version at inclusion and 12 and 13 weeks after first anti-TNF injection. The final SPACE-Q scoring was defined using multitrait and regression analyses and clinical relevance considerations. Psychometric validation included clinical validity against Harvey-Bradshaw score, concurrent validity against Treatment Satisfaction Questionnaire for Medication (TSQM), internal consistency reliability, test-retest reliability, and responsiveness against the patient global impression of change (PGIC). Quality of completion was good (55%-67% of patients completed all items). Four items were removed from the questionnaire. Eleven scores were defined within the final 58-item SPACE-Q: disease control; symptoms, anal symptoms, and quality of life transition scales; tolerability; convenience; expectation confirmation toward efficacy, side effects, and convenience; satisfaction with treatment; and motivation. Scores met standards for concurrent validity (correlation between SPACE-Q satisfaction with treatment and TSQM satisfaction scores =0.59), internal consistency reliability (Cronbach's α=0.67-0.93), test-retest reliability (intraclass correlations =0.62-0.91), and responsiveness (improvement in treatment experience assessed by the SPACE-Q for patients reporting improvement on the PGIC). Significantly different mean scores were observed between groups of patients with different Harvey-Bradshaw disease severity scores. The SPACE-Q is a valid, reliable, and responsive instrument to measure satisfaction with anti-TNF treatment in patients with severe Crohn's disease and for use in future studies.

The construction and validation of an instrument for the assessment of graduates of undergraduate nursing courses.

PubMed

Vieira, Maria Aparecida; Ohara, Conceição Vieira da Silva; Domenico, Edvane Birelo Lopes de

2016-06-14

to construct an instrument for the assessment of graduates of undergraduate nursing courses and to validate this instrument through the consensus of specialists. methodological study. In order to elaborate the instrument, documental analysis and a literature review were undertaken. Validation took place through use of the Delphi Conference, between September 2012 and September 2013, in which 36 specialists from Brazilian Nursing participated. In order to analyze reliability, the Cronbach alpha coefficient, the item/total correlation, and the Pearson correlation coefficient were calculated. the instrument was constructed with the participation of specialist nurses representing all regions of Brazil, with experience in lecturing and research. The first Delphi round led to changes in the first instrument, which was restructured and submitted to another round, with a response rate of 94.44%. In the second round, the instrument was validated with a Cronbach alpha of 0.75. the final instrument possessed three dimensions related to the characterization of the graduate, insertion in the job market, and evaluation of the professional training process. This instrument may be used across the territory of Brazil as it is based on the curricular guidelines and contributes to the process of regulation of the quality of the undergraduate courses in Nursing. construir um instrumento para a avaliação de egressos de cursos de graduação em enfermagem e validar esse instrumento pelo consenso de especialistas. estudo metodológico. Para a elaboração do instrumento, realizou-se análise documental e revisão de literatura. A validação ocorreu por Conferência Delphi, entre setembro de 2012 e setembro de 2013, da qual participaram 36 especialistas da Enfermagem brasileira. Para a análise de confiabilidade, calculou-se o coeficiente alfa de Cronbach, a correlação item/total e o coeficiente de correlação de Pearson. o instrumento foi construído com a participação de especialistas enfermeiros, representantes de todas as regiões do país, com experiência em docência e pesquisa. A primeira rodada Delphi gerou alterações no primeiro instrumento, que foi reestruturado e submetido a nova rodada, com taxa de resposta de 94,44%. Na segunda rodada, validou-se o instrumento com alfa de Cronbach de 0,75. o instrumento final possui três dimensões relacionadas à caracterização do egresso, inserção no mercado de trabalho e avaliação do processo de formação profissional. Esse instrumento pode ser utilizado em território nacional por basear-se nas diretrizes curriculares e contribuir com o processo de regulação da qualidade dos cursos de graduação em enfermagem. construir un instrumento para evaluación de egresados de cursos de graduación en enfermería y validar ese instrumento a través del consenso de especialistas. estudo metodológico. Para la elaboración del instrumento, se realizó análisis documental y revisión de literatura. La validación se realizó por Conferencia Delphi, entre septiembre de 2012 y septiembre de 2013, de la cual participaron 36 especialistas de la Enfermería brasileña. Para el análisis de confiabilidad, se calculó el coeficiente alfa de Cronbach, la correlación ítem/total y el coeficiente de correlación de Pearson. el instrumento fue construido con la participación de especialistas enfermeros, representantes de todas las regiones del país, con experiencia en docencia e investigación. La primera rodada Delphi generó alteraciones en el primer instrumento, el que fue reestructurado y sometido a una nueva rodada, con tasa de respuesta de 94,44%. En la segunda rodada, se validó el instrumento con alfa de Cronbach de 0,75. el instrumento final posee tres dimensiones: caracterización del egresado, introducción en el mercado de trabajo y evaluación del proceso de formación profesional. El instrumento podrá ser utilizado en el territorio nacional por basarse en las directrices curriculares y contribuir con el proceso de regulación de la calidad de los cursos de graduación en enfermería.

The Swedish P-CAT: modification and exploration of psychometric properties of two different versions.

PubMed

Selan, Denis; Jakobsson, Ulf; Condelius, Anna

2017-09-01

The aim of this study was to further investigate the psychometric properties (with focus on construct validity and scale function) of the Swedish version of the Person-centred Care Assessment Tool (P-CAT) in a sample consisting of staff working in elderly care units (N = 142). The aim was also to further develop and psychometrically test a modified, noncontext-specific version of the instrument (mP-CAT) in a sample consisting of staff working in primary health care or within home care for older people (N = 182). Principal component analysis with varimax rotation initially suggested a three-factor solution for the P-CAT, explaining 55.96% of variance. Item 13 solely represented one factor wherefore this solution was rejected. A final 2-factor solution, without item 13, had a cumulative explained variance of 50.03%. All communalities were satisfactory (>0.3), and alpha values for both first factor (items 1-6, 11) and second factor (items 7-10, 12) were found to be acceptable. Principal component analysis with varimax rotation suggested a final 2-factor solution for the mP-CAT explaining 46.15% of the total variance with communalities ranging from 0.263 to 0.712. Cronbach's α for both factors was found to be acceptable (>0.7). This study suggests a 2-factor structure for the P-CAT and an exclusion of item 13. The results indicated that the modified noncontext-specific version, mP-CAT, seems to be a valid measure. Further psychometric testing of the mP-CAT is however needed in order to establish the instrument's validity and reliability in various contexts. © 2016 Nordic College of Caring Science.

Health-related quality of life questionnaire for polycystic ovary syndrome (PCOSQ-50): development and psychometric properties.

PubMed

Nasiri-Amiri, Fatemeh; Ramezani Tehrani, Fahimeh; Simbar, Masoumeh; Montazeri, Ali; Mohammadpour, Reza Ali

2016-07-01

The determinants of the health-related quality of life of women with polycystic ovary syndrome are not fully understood. The aim of this study was to develop a comprehensive instrument to assess the health-related quality of life of Iranian women with PCOS and to assess its psychometric properties. We used a mixed-method, sequential, exploratory design including both qualitative [in-depth interview to define the components of health-related quality of life questionnaire (PCOSQ)] and quantitative approaches (to assess the psychometric properties of PCOSQ). A preliminary questionnaire was developed including 147 items which emerged from the qualitative phase of the study. Considering the optimum cutoff points for content validity ratio (CVR), content validity index (CVI), and impact score, items of the preliminary questionnaire were reduced from 147 to 88 items. Finally, by excluding highly correlated items using the exploratory factor analysis, a 50-item questionnaire was obtained. The Kaiser criteria (eigenvalues >1) and Scree plot tests demonstrated that six factors were optimum with an estimated 47.3 % of variance. Assessment of the psychometric properties of the questionnaire demonstrated a mean CVI = 0.92, CVR = 0.91, Cronbach's alpha for whole questionnaire = 0.88 (0.61-0.88 for subscales), Spearman's correlation coefficients of test-retest = 0.75, and the intra-class correlation coefficient for the PCOS questionnaire subscales ranging from 0.57 to 0.88. Eventually the final questionnaire included 50 items in six domains, 'psychosocial and emotional,' 'fertility,' 'sexual function,' 'obesity and menstrual disorders,' 'hirsutism,' and 'coping' and rated on a 5-point Likert scale. The PCOSQ-50 is a valid and reliable instrument for the assessment of quality of life of women with PCOS, capable of assessing some obscure aspects overlooked by previous HRQL questionnaires.

Therapeutic risk management of the suicidal patient: augmenting clinical suicide risk assessment with structured instruments.

PubMed

Homaifar, Beeta; Matarazzo, Bridget; Wortzel, Hal S

2013-09-01

This column is the second in a series presenting a model for therapeutic risk management of the suicidal patient. As discussed in the first part of the series, the model involves several elements including augmenting clinical risk assessment with structured instruments, stratifying risk in terms of both severity and temporality, and developing and documenting a safety plan. This column explores in more detail how to augment clinical risk assessment with structured instruments. Unstructured clinical interviews have the potential to miss important aspects of suicide risk assessment. By augmenting the free-form clinical interview with structured instruments that demonstrate reliability and validity, a more nuanced and multifaceted approach to suicide risk assessment is achieved. Incorporating structured instruments into practice also serves a medicolegal function, since these instruments may become a living part of the medical record, establishing baseline levels of suicidal thoughts and behaviors and facilitating future clinical determinations regarding safety needs. We describe several instruments used in a multidisciplinary suicide consultation service, each of which has demonstrated relevance to suicide risk assessment and screening, ease of administration, and strong psychometric properties. In addition, we emphasize the importance of viewing suicide risk assessment as an ongoing process rather than as a singular event. Finally, we discuss special considerations in the evolving practice of risk assessment.

[Design and validation of a brief questionnaire to assess young´s sexual knowledge].

PubMed

Leon-Larios, Fátima; Gómez-Baya, Diego

2018-06-01

Only very few instruments have been developed to assess sexual knowledge and practices. Most of the research to date has been carried out with adolescent samples, but not with university students, who are also at a particularly risky stage. The aim of this study was to design and validate a brief questionnaire to assess young´s sexual knowledge, practices and behaviors to design health education programs in the university context. We created a specific questionnaire about sexual pattern in university adolescents and a brief questionnaire consisted of 9 items (true/false) about contraception, sexuality and sexual transmission diseases. We carried out a pilot study, reliability (KR-20) and validity analyses using factorial analysis and examining the association with other variables. 566 students from University of Seville participated during 2015/16. One item was eliminated because of comprehension (only 13.9% of correct answers) and weak or non significant associations (p more than 0.05). Finally, the scale was formed by 8 items and had good internal consistency reliability (KR-20 = 0.57), and both factorial and external validity reliability. A three-factor model showed good data fit, χ2 (14, N=566)=17.48, p= 0.232, Comparative Fit Index CFI = 0.97, root mean squared error of prediction RMSEA = 0.02. Participants with less knowledge about sexuality were whose did not receive any information (M=6.82, SD=1.41), without partner (M=6.87, SD=1.35), had an abortion (M=6.43, SD=1.95) and did not use any contraceptive method (M=6.66, SD=0.58) or coitus interruptus (M=6.55, SD=1.39), and had less sexual relationships, e.g., once or twice a year (M=6.49, SD=1.70). This questionnaire is a short instrument to assess students´ practices and knowledge about sexuality and contraception. The analyses of reliability and validity have shown the good psychometric properties of this instrument.

Validation of QUALAS-T, a health-related quality of life instrument for teenagers with spina bifida

PubMed Central

Misseri, Rosalia; Whittam, Benjamin; Casey, Jessica T.; Yang, David Y.; Raposo, Sonia-Maria; King, Shelly J.; Kaefer, Martin; Rink, Richard C.; Cain, Mark P.

2017-01-01

Introduction We aimed to develop and validate a self-reported QUAlity of Life Assessment in Spina bifida for Teenagers (QUALAS-T). Material and methods We drafted a 46-question pilot instrument using a patient-centered comprehensive item generation/refinement process. A group of 13–17 years olds with spina bifida (SB) was recruited online via social media and in person at SB clinics (2013–2015). Healthy controls were recruited during routine pediatrician visits. Final questions were identified based on clinical relevance, factor analysis and domain psychometrics. Teenagers with SB completed the validated generic Kidscreen-27 instrument. Results Median age of 159 participants was 15.2 years (42.0% male, 77.4% Caucasian), similar to 58 controls (p ≥ 0.06). There were 102 online and 57 clinic participants (82.8% of eligible). Patients, parents and an expert panel established face and content validity of the 2-domain, 10-question QUALAS-T. Internal consistency and test-retest reliability were high for the Family and Independence and Bladder and Bowel domains (Cronbach's alpha: 0.76–0.78, ICC: 0.72–0.75). The Bladder and Bowel domain is the same for QUALAS-T , QUALAS-A for adults and QUALAS-C for children. Correlations between QUALAS-T domains were low (r = 0.34), indicating QUALAS-T can differentiate between distinct HRQOL components. Correlations between QUALAS-T and Kidscreen-27 were also low (r ≤0.41). QUALAS-T scores were lower in teenagers with SB than without (p <0.0001). Conclusions QUALAS-T is a short, valid HRQOL tool for adolescents with SB, applicable in clinical and research settings. Since the Bladder & Bowel domains for all QUALAS versions are the same, Bladder and Bowel HRQOL can be measured on the same scale from age 8 through adulthood. PMID:29104796

Development and Initial Validation of the Performance Perfectionism Scale for Sport (PPS-S)

ERIC Educational Resources Information Center

Hill, Andrew P.; Appleton, Paul R.; Mallinson, Sarah H.

2016-01-01

Valid and reliable instruments are required to appropriately study perfectionism. With this in mind, three studies are presented that describe the development and initial validation of a new instrument designed to measure multidimensional performance perfectionism for use in sport (Performance Perfectionism Scale--Sport [PPS-S]). The instrument is…

Hopes and Cautions for Instrument-Based Evaluation of Consent Capacity: Results of a Construct Validity Study of Three Instruments

PubMed Central

Moye, Jennifer; Azar, Annin R.; Karel, Michele J.; Gurrera, Ronald J.

2016-01-01

Does instrument based evaluation of consent capacity increase the precision and validity of competency assessment or does ostensible precision provide a false sense of confidence without in fact improving validity? In this paper we critically examine the evidence for construct validity of three instruments for measuring four functional abilities important in consent capacity: understanding, appreciation, reasoning, and expressing a choice. Instrument based assessment of these abilities is compared through investigation of a multi-trait multi-method matrix in 88 older adults with mild to moderate dementia. Results find variable support for validity. There appears to be strong evidence for good hetero-method validity for the measurement of understanding, mixed evidence for validity in the measurement of reasoning, and strong evidence for poor hetero-method validity for the concepts of appreciation and expressing a choice, although the latter is likely due to extreme range restrictions. The development of empirically based tools for use in capacity evaluation should ultimately enhance the reliability and validity of assessment, yet clearly more research is needed to define and measure the constructs of decisional capacity. We would also emphasize that instrument based assessment of capacity is only one part of a comprehensive evaluation of competency which includes consideration of diagnosis, psychiatric and/or cognitive symptomatology, risk involved in the situation, and individual and cultural differences. PMID:27330455

Is there a role for the use of aviation assessment instruments in surgical training preparation? A feasibility study.

PubMed

Stolk-Vos, Aline C; Heres, Marion H; Kesteloo, Jasper; Verburg, Dick; Hiddema, Frans; Lie, Desiree A; de Korne, Dirk F

2017-01-01

Selection for surgical residency programmes could potentially be improved through pretraining preparation, after assessment of surgical candidates' sensorimotor skills and personality traits. Existing aviation pilot selection instruments are available to test sensorimotor skills and personality traits. This study examined selected instruments to assess medical trainees' sensorimotor skills and personality traits. Aviation's validated computer-based Computerized Pilot Aptitude and Screening System (COMPASS) and Checklist Professional Profile (CPP) were applied to 166 final year medical students during a surgical clerkship between 2013 and 2015. All trainees completed COMPASS and CPP within the prescribed 2 hours. Compared with an age-matched and gender-matched cohort of 165 pilot candidates, medical trainees scored significantly higher on eye-hand coordination (p<0.001), need for variation (p<0.001), empathy (p=0.006), helpfulness (p<0.001) and autonomy (p<0.001). Pilot candidates scored higher on eye-hand-foot coordination (p<0.001), spatial orientation (p<0.001), persuasiveness (p<0.001), stress tolerance (p<0.001), dominance (p<0.001), ambition (p<0.001) and resilience (p<0.001). Final year medical trainees from one medical school were able to complete aviation's sensorimotor skills and personality traits selection instruments within the set time frame. They scored differently from aviation trainees on selected skills and personality traits. The applicability and utility of aviation instruments to presurgical training preparation remains to be tested. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Cross-Cultural Adaptation and Validation of the SWAL-QoL Questionnaire in Greek.

PubMed

Georgopoulos, Voula C; Perdikogianni, Myrto; Mouskenteri, Myrto; Psychogiou, Loukia; Oikonomou, Maria; Malandraki, Georgia A

2018-02-01

The purpose of this study was to translate and adapt the 44-item SWAL-QoL into Greek and examine its internal consistency, test-retest reliability, external construct validity, and discriminant validity in order to provide a validated dysphagia-specific QoL instrument in the Greek language. The instrument was translated into Greek using the back translation to ensure linguistic validity and was culturally adapted resulting in the SWAL-QoL-GR. Two groups of participants were included: a patient group of 86 adults (48 males; age range: 18-87 years) diagnosed with oropharyngeal dysphagia, and an age-matched healthy control group (39 adults; 19 males; age range: 18-84 years). The Greek 30-item version of the WHOQOL-BREF was used for assessment of construct validity. Overall, the questionnaire achieved good to excellent psychometric values. Internal consistency of all 10 subscales and the physical symptoms scale of the SWAL-QoL-GR assessed by Cronbach's α was good to excellent (0.811 < α < 0.940). Test-retest validity was found to be good to excellent as well. In addition, moderate to strong correlations were found between seven of the ten subscales of the SWAL-QoL-GR with limited items of the WHOQΟL-BREF (0.401 < ρ < 0.65), supporting good construct validity of the SWAL-QoL-GR. The SWAL-QoL-GR also correctly differentiated between patients with dysphagia and age-matched healthy controls (p < 0.001) on all 11 scales, further indicating excellent discriminant validity. Finally, no significant differences were found between the two sexes. This cultural adaptation and validation allows the use of this tool in Greece, further enhancing our clinical and scientific efforts to increase the evidence-based practice resources for dysphagia rehabilitation in Greece.

EOS-Aura's Ozone Monitoring Instrument (OMI): Validation Requirements

NASA Technical Reports Server (NTRS)

Brinksma, E. J.; McPeters, R.; deHaan, J. F.; Levelt, P. F.; Hilsenrath, E.; Bhartia, P. K.

2003-01-01

OMI is an advanced hyperspectral instrument that measures backscattered radiation in the UV and visible. It will be flown as part of the EOS Aura mission and provide data on atmospheric chemistry that is highly synergistic with other Aura instruments HIRDLS, MLS, and TES. OMI is designed to measure total ozone, aerosols, cloud information, and UV irradiances, continuing the TOMS series of global mapped products but with higher spatial resolution. In addition its hyperspectral capability enables measurements of trace gases such as SO2, NO2, HCHO, BrO, and OClO. A plan for validation of the various OM1 products is now being formulated. Validation of the total column and UVB products will rely heavily on existing networks of instruments, like NDSC. NASA and its European partners are planning aircraft missions for the validation of Aura instruments. New instruments and techniques (DOAS systems for example) will need to be developed, both ground and aircraft based. Lidar systems are needed for validation of the vertical distributions of ozone, aerosols, NO2 and possibly SO2. The validation emphasis will be on the retrieval of these products under polluted conditions. This is challenging because they often depend on the tropospheric profiles of the product in question, and because of large spatial variations in the troposphere. Most existing ground stations are located in, and equipped for, pristine environments. This is also true for almost all NDSC stations. OMI validation will need ground based sites in polluted environments and specially developed instruments, complementing the existing instrumentation.

The Development and Validation of a Concise Instrument for Formative Assessment of Team Leader Performance During Simulated Pediatric Resuscitations.

PubMed

Nadkarni, Lindsay D; Roskind, Cindy G; Auerbach, Marc A; Calhoun, Aaron W; Adler, Mark D; Kessler, David O

2018-04-01

The aim of this study was to assess the validity of a formative feedback instrument for leaders of simulated resuscitations. This is a prospective validation study with a fully crossed (person × scenario × rater) study design. The Concise Assessment of Leader Management (CALM) instrument was designed by pediatric emergency medicine and graduate medical education experts to be used off the shelf to evaluate and provide formative feedback to resuscitation leaders. Four experts reviewed 16 videos of in situ simulated pediatric resuscitations and scored resuscitation leader performance using the CALM instrument. The videos consisted of 4 pediatric emergency department resuscitation teams each performing in 4 pediatric resuscitation scenarios (cardiac arrest, respiratory arrest, seizure, and sepsis). We report on content and internal structure (reliability) validity of the CALM instrument. Content validity was supported by the instrument development process that involved professional experience, expert consensus, focused literature review, and pilot testing. Internal structure validity (reliability) was supported by the generalizability analysis. The main component that contributed to score variability was the person (33%), meaning that individual leaders performed differently. The rater component had almost zero (0%) contribution to variance, which implies that raters were in agreement and argues for high interrater reliability. These results provide initial evidence to support the validity of the CALM instrument as a reliable assessment instrument that can facilitate formative feedback to leaders of pediatric simulated resuscitations.

The Validation of a Software Evaluation Instrument.

ERIC Educational Resources Information Center

Schmitt, Dorren Rafael

This study, conducted at six southern universities, analyzed the validity and reliability of a researcher developed instrument designed to evaluate educational software in secondary mathematics. The instrument called the Instrument for Software Evaluation for Educators uses measurement scales, presents a summary section of the evaluation, and…

Development, validity and reliability of the short multidimensional positive mental health instrument.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Abdin, Edimansyah; Picco, Louisa; Chua, Boon Yiang; Eng, Goi Khia; Sambasivam, Rajeswari; Shafie, Saleha; Zhang, Yunjue; Chong, Siow Ann

2014-06-01

The 47-item positive mental health (PMH) instrument measures the level of PMH in multiethnic adult Asian populations. This study aimed to (1) develop a short PMH instrument and (2) establish its validity and reliability among the adult Singapore population. Two separate studies were conducted among adult community-dwelling Singapore residents of Chinese, Malay or Indian ethnicity where participants completed self-administered questionnaires. In the first study, secondary data analysis was conducted using confirmatory factor analysis (CFA) to shorten the PMH instrument. In the second study, the newly developed short PMH instrument and other scales were administered to 201 residents to establish its factor structure, validity and reliability. A 20-item short PMH instrument fulfilling a higher-order six-factor structure was developed following secondary analysis. The mean age of the participants in the second study was 41 years and about 53% were women. One item with poor factor loading was further removed to generate a 19-item version of the PMH instrument. CFA demonstrated a first-order six-factor model of the short PMH instrument. The PMH-19 instrument and its subscales fulfilled criterion validity hypotheses. Internal consistency and test-retest reliability of the PMH-19 instrument were high (Cronbach's α coefficient = 0.87; intraclass correlation coefficient = 0.93, respectively). The 19-item PMH instrument is multidimensional, valid and reliable, and most importantly, with its reduced administration time, the short PMH instrument can be used to measure and evaluate PMH in Asian communities.

[The Basel Screening Instrument for Psychosis (BSIP): development, structure, reliability and validity].

PubMed

Riecher-Rössler, A; Aston, J; Ventura, J; Merlo, M; Borgwardt, S; Gschwandtner, U; Stieglitz, R-D

2008-04-01

Early detection of psychosis is of growing clinical importance. So far there is, however, no screening instrument for detecting individuals with beginning psychosis in the atypical early stages of the disease with sufficient validity. We have therefore developed the Basel Screening Instrument for Psychosis (BSIP) and tested its feasibility, interrater-reliability and validity. Aim of this paper is to describe the development and structure of the instrument, as well as to report the results of the studies on reliability and validity. The instrument was developed based on a comprehensive search of literature on the most important risk factors and early signs of schizophrenic psychoses. The interraterreliability study was conducted on 24 psychiatric cases. Validity was tested based on 206 individuals referred to our early detection clinic from 3/1/2000 until 2/28/2003. We identified seven categories of relevance for early detection of psychosis and used them to construct a semistructured interview. Interrater-reliability for high risk individuals was high (Kappa .87). Predictive validity was comparable to other, more comprehensive instruments: 16 (32 %) of 50 individuals classified as being at risk for psychosis by the BSIP have in fact developed frank psychosis within an follow-up period of two to five years. The BSIP is the first screening instrument for the early detection of psychosis which has been validated based on transition to psychosis. The BSIP is easy to use by experienced psychiatrists and has a very good interrater-reliability and predictive validity.

Final Checks of Aquarius Instrument

NASA Image and Video Library

2011-04-29

Less than two months before launch, team members conduct their final checks of NASA Aquarius instrument at Vandenberg Air Force Base, Calif. Subsequent final instrument tests will be conducted on the launch pad.

Development of assessment instruments to measure critical thinking skills

NASA Astrophysics Data System (ADS)

Sumarni, W.; Supardi, K. I.; Widiarti, N.

2018-04-01

Assessment instruments that is commonly used in the school generally have not been orientated on critical thinking skills. The purpose of this research is to develop assessment instruments to measure critical thinking skills, to test validity, reliability, and practicality. This type of research is Research and Development. There are two stages on the preface step, which are field study and literacy study. On the development steps, there some parts, which are 1) instrument construction, 2) expert validity, 3) limited scale tryout and 4) narrow scale try-out. The developed assessment instrument are analysis essay and problem solving. Instruments were declared valid, reliable and practical.

Using Lunar Observations to Validate In-Flight Calibrations of Clouds and Earth Radiant Energy System Instruments

NASA Technical Reports Server (NTRS)

Daniels, Janet L.; Smith, G. Louis; Priestley, Kory J.; Thomas, Susan

2014-01-01

The validation of in-orbit instrument performance requires stability in both instrument and calibration source. This paper describes a method of validation using lunar observations scanning near full moon by the Clouds and Earth Radiant Energy System (CERES) instruments. Unlike internal calibrations, the Moon offers an external source whose signal variance is predictable and non-degrading. From 2006 to present, in-orbit observations have become standardized and compiled for the Flight Models-1 and -2 aboard the Terra satellite, for Flight Models-3 and -4 aboard the Aqua satellite, and beginning 2012, for Flight Model-5 aboard Suomi-NPP. Instrument performance parameters which can be gleaned are detector gain, pointing accuracy and static detector point response function validation. Lunar observations are used to examine the stability of all three detectors on each of these instruments from 2006 to present. This validation method has yielded results showing trends per CERES data channel of 1.2% per decade or less.

[Cross-cultural adaptation and validation of the PROMIS Global Health scale in the Portuguese language].

PubMed

Zumpano, Camila Eugênia; Mendonça, Tânia Maria da Silva; Silva, Carlos Henrique Martins da; Correia, Helena; Arnold, Benjamin; Pinto, Rogério de Melo Costa

2017-01-23

This study aimed to perform the cross-cultural adaptation and validation of the Patient-Reported Outcomes Measurement Information System (PROMIS) Global Health scale in the Portuguese language. The ten Global Health items were cross-culturally adapted by the method proposed in the Functional Assessment of Chronic Illness Therapy (FACIT). The instrument's final version in Portuguese was self-administered by 1,010 participants in Brazil. The scale's precision was verified by floor and ceiling effects analysis, reliability of internal consistency, and test-retest reliability. Exploratory and confirmatory factor analyses were used to assess the construct's validity and instrument's dimensionality. Calibration of the items used the Gradual Response Model proposed by Samejima. Four global items required adjustments after the pretest. Analysis of the psychometric properties showed that the Global Health scale has good reliability, with Cronbach's alpha of 0.83 and intra-class correlation of 0.89. Exploratory and confirmatory factor analyses showed good fit in the previously established two-dimensional model. The Global Physical Health and Global Mental Health scale showed good latent trait coverage according to the Gradual Response Model. The PROMIS Global Health items showed equivalence in Portuguese compared to the original version and satisfactory psychometric properties for application in clinical practice and research in the Brazilian population.

A Slovenian version of the "clinical learning environment, supervision and nurse teacher scale (Cles+T)" and its comparison with the Croatian version.

PubMed

Žvanut, Boštjan; Lovrić, Robert; Kolnik, Tamara Štemberger; Šavle, Majda; Pucer, Patrik

2018-05-01

Nursing clinical learning environments are particularly important for the achievement of good practice in clinical training of student nurses, and thus, for the nursing competence development. Hence, it is important to have an instrument consisting of reliable and valid criteria for assessing the clinical learning environment, applicable in different contexts, and translated in the respondents mother tongue. The goal of the present research was to test the reliability and validity of the Slovenian version of the "Clinical Learning Environment, Supervision and Nurse Teacher evaluation scale", and to compare it with the Croatian version. The data was collected between 10 March and 10 June 2015 at four Slovenian institutions, where nursing BSc study programmes are performed. The final sample consisted of 232 students (response rate 68.8%): 81.9% were females and 18.1% males, average age was 23. The translated instrument in Slovenian language resulted as reliable and valid, it reflects the expected five factors of the original version despite some minor problems in the factor structure and in test-retest. The most important difference between the Slovenian and Croatian version is in the factor structure regarding the implementation of roles in clinical learning environment. Copyright © 2018 Elsevier Ltd. All rights reserved.

Validity and Reliability of Malay Version of the Job Content Questionnaire among Public Hospital Female Nurses in Malaysia.

PubMed

Amin, N A; Quek, K F; Oxley, J A; Noah, R M; Nordin, R

2015-10-01

The Job Content Questionnaire (M-JCQ) is an established self-reported instrument used across the world to measure the work dimensions based on the Karasek's demand-control-support model. To evaluate the psychometrics properties of the Malay version of M-JCQ among nurses in Malaysia. This cross-sectional study was carried out on nurses working in 4 public hospitals in Klang Valley area, Malaysia. M-JCQ was used to assess the perceived psychosocial stressors and physical demands of nurses at their workplaces. Construct validity of the questionnaire was examined using exploratory factor analysis (EFA). Cronbach's α values were used to estimate the reliability (internal consistency) of the M-JCQ. EFA showed that 34 selected items were loaded in 4 factors. Except for psychological job demand (Cronbach's α 0.51), the remaining 3 α values for 3 subscales (job control, social support, and physical demand) were greater than 0.70, indicating acceptable internal consistency. However, an item was excluded due to poor item-total correlation (r<0.3). The final M-JCQ was consisted of 33 items. The M-JCQ is a reliable and valid instrument to measure psychosocial and physical stressors in the workplace of public hospital nurses in Malaysia.

Navigation of guidewires and catheters in the body during intervention procedures: a review of computer-based models.

PubMed

Sharei, Hoda; Alderliesten, Tanja; van den Dobbelsteen, John J; Dankelman, Jenny

2018-01-01

Guidewires and catheters are used during minimally invasive interventional procedures to traverse in vascular system and access the desired position. Computer models are increasingly being used to predict the behavior of these instruments. This information can be used to choose the right instrument for each case and increase the success rate of the procedure. Moreover, a designer can test the performance of instruments before the manufacturing phase. A precise model of the instrument is also useful for a training simulator. Therefore, to identify the strengths and weaknesses of different approaches used to model guidewires and catheters, a literature review of the existing techniques has been performed. The literature search was carried out in Google Scholar and Web of Science and limited to English for the period 1960 to 2017. For a computer model to be used in practice, it should be sufficiently realistic and, for some applications, real time. Therefore, we compared different modeling techniques with regard to these requirements, and the purposes of these models are reviewed. Important factors that influence the interaction between the instruments and the vascular wall are discussed. Finally, different ways used to evaluate and validate the models are described. We classified the developed models based on their formulation into finite-element method (FEM), mass-spring model (MSM), and rigid multibody links. Despite its numerical stability, FEM requires a very high computational effort. On the other hand, MSM is faster but there is a risk of numerical instability. The rigid multibody links method has a simple structure and is easy to implement. However, as the length of the instrument is increased, the model becomes slower. For the level of realism of the simulation, friction and collision were incorporated as the most influential forces applied to the instrument during the propagation within a vascular system. To evaluate the accuracy, most of the studies compared the simulation results with the outcome of physical experiments on a variety of phantom models, and only a limited number of studies have done face validity. Although a subset of the validated models is considered to be sufficiently accurate for the specific task for which they were developed and, therefore, are already being used in practice, these models are still under an ongoing development for improvement. Realism and computation time are two important requirements in catheter and guidewire modeling; however, the reviewed studies made a trade-off depending on the purpose of their model. Moreover, due to the complexity of the interaction with the vascular system, some assumptions have been made regarding the properties of both instruments and vascular system. Some validation studies have been reported but without a consistent experimental methodology.

Evaluation Instruments for Quality of Life Related to Melasma: An Integrative Review.

PubMed

Pollo, Camila Fernandes; Meneguin, Silmara; Miot, Helio Amante

2018-05-21

The aim of this study was to analyze scientific production concerning the validation and cultural adaptation of quality of life evaluation instruments for patients with melasma and to offer a critical reflection on these methods. A literature review was performed based on a search of the Web of Science, Bireme, PubMed, Elsevier Scopus, and Google Scholar databases. All published articles from indexed periodicals in these electronic databases up to December 2015 were included. Eight articles were identified, of which only one (12.5%) referred to the development and validation of a specific instrument for evaluation of the quality of life of melasma patients. An additional six articles (75%) referred to transcultural adjustment and validation of the same instrument in other languages, and another (12.5%) article reported the development of a generic instrument for evaluation of quality of life in patients with pigment disorders. This review revealed only one specific instrument developed and validated in different cultures. Despite being widely used, this instrument did not follow the classic construction steps for psychometric instruments, which paves the way for future studies to develop novel instruments.

A Critical Review of Instruments Measuring Breastfeeding Attitudes, Knowledge, and Social Support.

PubMed

Casal, Corrine S; Lei, Ann; Young, Sera L; Tuthill, Emily L

2017-02-01

Breastfeeding provides beneficial health outcomes for infants and their mothers, and increasing its practice is a national priority in many countries. Despite increasing support to exclusively breastfeed, the prevalence at 6 months remains low. Breastfeeding behavior is influenced by a myriad of determinants, including breastfeeding attitudes, knowledge, and social support. Effective measurement of these determinants is critical to provide optimal support for women throughout the breastfeeding period. However, there are a multitude of available instruments measuring these constructs, which makes identification of an appropriate instrument challenging. Research aim: Our aim was to identify and critically examine the existing instruments measuring breastfeeding attitudes, knowledge, and social support. A total of 16 instruments was identified. Each instrument's purpose, theoretical underpinnings, and validity were analyzed. An overview, validation and adaptation for use in other settings was assessed for each instrument. Depth of reporting and validation testing differed greatly between instruments. Content, construct, and predictive validity were present for most but not all scales. When selecting and adapting instruments, attention should be paid to domains within the scale, number of items, and adaptation.

Evaluation Instruments for Quality of Life Related to Melasma: An Integrative Review

PubMed Central

Pollo, Camila Fernandes; Meneguin, Silmara; Miot, Helio Amante

2018-01-01

The aim of this study was to analyze scientific production concerning the validation and cultural adaptation of quality of life evaluation instruments for patients with melasma and to offer a critical reflection on these methods. A literature review was performed based on a search of the Web of Science, Bireme, PubMed, Elsevier Scopus, and Google Scholar databases. All published articles from indexed periodicals in these electronic databases up to December 2015 were included. Eight articles were identified, of which only one (12.5%) referred to the development and validation of a specific instrument for evaluation of the quality of life of melasma patients. An additional six articles (75%) referred to transcultural adjustment and validation of the same instrument in other languages, and another (12.5%) article reported the development of a generic instrument for evaluation of quality of life in patients with pigment disorders. This review revealed only one specific instrument developed and validated in different cultures. Despite being widely used, this instrument did not follow the classic construction steps for psychometric instruments, which paves the way for future studies to develop novel instruments. PMID:29791603

Context sensitive regulation of pain and emotion: Development and initial validation of a scale for context insensitive avoidance.

PubMed

Flink, Ida K; Klein-Strandberg, Ester; Linton, Steven J

2017-10-01

Context insensitivity has been put forward as a potential mechanism explaining the high co-occurrence of pain and emotional distress. In the pain literature, the concept has only been introduced at a theoretical level and an assessment tool for exploring its impact is lacking. In an interpersonal setting, a core aspect of context sensitivity and insensitivity concerns when to disclose and when to avoid expressing pain and related distress. Both context insensitive disclosure and context insensitive avoidance may hamper interpersonal support and fuel the problem. This exploratory study describes an attempt to develop a self-report instrument to assess tendencies to disclose vs. avoid expressions of pain and related distress, as well as self-perceived adjustment of disclosure vs. avoidance to the context. A pool of items was systematically developed to assess different aspects of context insensitivity, including disclosure vs. avoidance of expression. 105 participants with persistent pain were recruited at pain rehabilitation clinics (80% of the sample) and in a university setting (20% of the sample). The participants responded to the pool of items as well as to a number of validated self-report instruments covering pain, pain-related disability, pain catastrophizing, emotion regulation tendencies, self-compassion and pain acceptance. The analyses explored the factorial structure of the initial instrument, as well as the criterion and construct validity. The analyses confirmed a stable underlying structure of the initial scale, with four distinct factors explaining 64.4% of the total variance. However, the criterion and construct validity could only be confirmed for one of the factors, which contained items reflecting context insensitive avoidance of expression. Consequently, only this factor, demonstrating very good internal consistency, was kept in the final version of the instrument which was named context insensitive avoidance (CIA). We found support for the final version of our instrument, capturing one prominent aspect of context insensitivity. Avoidance of expression was related to higher ratings of pain, disability, catastrophizing and suppression as well as to lower levels of self-compassion. We encourage further studies to explore the impact of context insensitive avoidance for regulating pain and associated negative emotions. Yet, more research is needed that goes beyond self-report and includes other aspects of context. It is urgent to develop systematic ways for assessing context insensitivity, as it will enhance our understanding of regulatory strategies as potential transdiagnostic mechanisms in pain and emotion. This tool for assessing contextually insensitive avoidance of expression could potentially be used both clinically and in future research to advance our understanding of comorbid problems with pain and emotional distress. Further research is needed to develop methods for assessing other aspects of context insensitivity to fully understand its impact in patients suffering from pain. Copyright © 2017 Scandinavian Association for the Study of Pain. Published by Elsevier B.V. All rights reserved.

Measuring Stakeholder Participation in Evaluation: An Empirical Validation of the Participatory Evaluation Measurement Instrument (PEMI)

ERIC Educational Resources Information Center

Daigneault, Pierre-Marc; Jacob, Steve; Tremblay, Joel

2012-01-01

Background: Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. Objectives: This study consists of a first empirical validation of a measurement instrument that…

Unexpected but Most Welcome: Mixed Methods for the Validation and Revision of the Participatory Evaluation Measurement Instrument

ERIC Educational Resources Information Center

Daigneault, Pierre-Marc; Jacob, Steve

2014-01-01

Although combining methods is nothing new, more contributions about why and how to mix methods for validation purposes are needed. This article presents a case of validating the inferences drawn from the Participatory Evaluation Measurement Instrument, an instrument that purports to measure stakeholder participation in evaluation. Although the…

Validation of a Performance Assessment Instrument in Problem-Based Learning Tutorials Using Two Cohorts of Medical Students

ERIC Educational Resources Information Center

Lee, Ming; Wimmers, Paul F.

2016-01-01

Although problem-based learning (PBL) has been widely used in medical schools, few studies have attended to the assessment of PBL processes using validated instruments. This study examined reliability and validity for an instrument assessing PBL performance in four domains: Problem Solving, Use of Information, Group Process, and Professionalism.…

The Need, Development, and Validation of the Innovation Test Instrument

ERIC Educational Resources Information Center

Wheadon, Jacob; Wright, Geoff A.; West, Richard E.; Skaggs, Paul

2017-01-01

This study discusses the need, development, and validation of the Innovation Test Instrument (ITI). This article outlines how the researchers identified the content domain of the assessment and created test items. Then, it describes initial validation testing of the instrument. The findings suggest that the ITI is a good first step in creating an…

Development and Initial Validation of an Instrument for Human Capital Planning

ERIC Educational Resources Information Center

Zula, Kenneth J.; Chermack, Thomas J.

2008-01-01

This article reports on development and validation of an instrument for use in human capital approaches for organizational planning. The article describes use of a team of subject matter experts in developing a measure of human capital planning, and use of exploratory factor analysis techniques to validate the resulting instrument. These data were…

Non-linear assessment and deficiency of linear relationship for healthcare industry

NASA Astrophysics Data System (ADS)

Nordin, N.; Abdullah, M. M. A. B.; Razak, R. C.

2017-09-01

This paper presents the development of the non-linear service satisfaction model that assumes patients are not necessarily satisfied or dissatisfied with good or poor service delivery. With that, compliment and compliant assessment is considered, simultaneously. Non-linear service satisfaction instrument called Kano-Q and Kano-SS is developed based on Kano model and Theory of Quality Attributes (TQA) to define the unexpected, hidden and unspoken patient satisfaction and dissatisfaction into service quality attribute. A new Kano-Q and Kano-SS algorithm for quality attribute assessment is developed based satisfaction impact theories and found instrumentally fit the reliability and validity test. The results were also validated based on standard Kano model procedure before Kano model and Quality Function Deployment (QFD) is integrated for patient attribute and service attribute prioritization. An algorithm of Kano-QFD matrix operation is developed to compose the prioritized complaint and compliment indexes. Finally, the results of prioritized service attributes are mapped to service delivery category to determine the most prioritized service delivery that need to be improved at the first place by healthcare service provider.

Development of the scale of hygıene behavıors for nursıng students.

PubMed

Ipek Coban, Gulay; Bilgin, Sonay

2015-08-21

There is a need to have an appropriate instrument to measure the hygiene behaviors for nursing students. This study was carried out to develop a Hygiene Behavior Scale (HBS). The population of the study is composed of the students of students of nursing department. A total of 416 participants were included in this study. The students in the sampling group were asked to write a composition containing their feelings and thoughts about hygiene. These compositions were analysed and 87 items about positive and negative behaviors were determined. These items were presented to expert opinion and after necessary editions, reliability and validity analyses were conducted. The resulting HBS consists of 25 items across the following three domains: Personal hygiene, handwashing technique and food-related hygiene . The final model in confirmatory factor analysis showed that this 25-item HBS indicated a good fit of the model. The value of the Cronbach's a for the total scale was 0.90. The HBS is determined to be quite highly valid and reliable, sufficient measuring instrument to determine hygiene behaviors of nursing students.

Assessing reliability and validity measures in managed care studies.

PubMed

Montoya, Isaac D

2003-01-01

To review the reliability and validity literature and develop an understanding of these concepts as applied to managed care studies. Reliability is a test of how well an instrument measures the same input at varying times and under varying conditions. Validity is a test of how accurately an instrument measures what one believes is being measured. A review of reliability and validity instructional material was conducted. Studies of managed care practices and programs abound. However, many of these studies utilize measurement instruments that were developed for other purposes or for a population other than the one being sampled. In other cases, instruments have been developed without any testing of the instrument's performance. The lack of reliability and validity information may limit the value of these studies. This is particularly true when data are collected for one purpose and used for another. The usefulness of certain studies without reliability and validity measures is questionable, especially in cases where the literature contradicts itself

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20).

PubMed

Jo, Min-Woo; Lee, Hyeon-Jeong; Kim, Soo Young; Kim, Seon-Ha; Chang, Hyejung; Ahn, Jeonghoon; Ock, Minsu

2017-01-01

Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability.

Development and psychometric testing of a new instrument to measure the caring behaviour of nurses in Italian acute care settings.

PubMed

Piredda, Michela; Ghezzi, Valerio; Fenizia, Elisa; Marchetti, Anna; Petitti, Tommasangelo; De Marinis, Maria Grazia; Sili, Alessandro

2017-12-01

To develop and psychometrically test the Italian-language Nurse Caring Behaviours Scale, a short measure of nurse caring behaviour as perceived by inpatients. Patient perceptions of nurses' caring behaviours are a predictor of care quality. Caring behaviours are culture-specific, but no measure of patient perceptions has previously been developed in Italy. Moreover, existing tools show unclear psychometric properties, are burdensome for respondents, or are not widely applicable. Instrument development and psychometric testing. Item generation included identifying and adapting items from existing measures of caring behaviours as perceived by patients. A pool of 28 items was evaluated for face validity. Content validity indexes were calculated for the resulting 15-item scale; acceptability and clarity were pilot tested with 50 patients. To assess construct validity, a sample of 2,001 consecutive adult patients admitted to a hospital in 2014 completed the scale and was split into two groups. Reliability was evaluated using nonlinear structural equation modelling coefficients. Measurement invariance was tested across subsamples. Item 15 loaded poorly in the exploratory factor analysis (n = 983) and was excluded from the final solution, positing a single latent variable with 14 indicators. This model fitted the data moderately. The confirmatory factor analysis (n = 1018) returned similar results. Internal consistency was excellent in both subsamples. Full scalar invariance was reached, and no significant latent mean differences were detected across subsamples. The new instrument shows reasonable psychometric properties and is a promising short and widely applicable measure of inpatient perceptions of nurse caring behaviours. © 2017 John Wiley & Sons Ltd.

Assessment of Community Functioning in People With Schizophrenia and Other Severe Mental Illnesses: A White Paper Based on an NIMH-Sponsored Workshop

PubMed Central

Bellack, Alan S.; Green, Michael F.; Cook, Judith A.; Fenton, Wayne; Harvey, Philip D.; Heaton, Robert K.; Laughren, Thomas; Leon, Andrew C.; Mayo, Donna J.; Patrick, Donald L.; Patterson, Thomas L.; Rose, Andrew; Stover, Ellen; Wykes, Til

2007-01-01

People with schizophrenia frequently have significant problems in community functioning. Progress in developing effective interventions to ameliorate these problems has been slowed by the absence of reliable and valid measures that are suitable for use in clinical trials. The National Institute of Mental Health convened a workgroup in September 2005 to examine this issue and make recommendations to the field that would foster research in this area. This article reports on issues raised at the meeting. Many instruments have been developed to assess community functioning, but overall insufficient attention has been paid to psychometric issues and many instruments are not suitable for use in clinical trials. Consumer self-report, informant report, ratings by clinicians and trained raters, and behavioral assessment all can provide useful and valid information in some circumstances and may be practical for use in clinical trials. However, insufficient attention has been paid to when and how different forms of assessment and sources of information are useful or how to understand inconsistencies. A major limiting factor in development of reliable and valid instruments is failure to develop a suitable model of functioning and its primary mediators and moderators. Several examples that can guide thinking are presented. Finally, the field is limited by the absence of an objective gold standard of community functioning. Hence, outcomes must be evaluated in part by “clinical significance.” This criterion is problematic because different observers and constituencies often have different opinions about what types of change are clinically important and how much change is significant. PMID:16931542

Study on bending behaviour of nickel–titanium rotary endodontic instruments by analytical and numerical analyses

PubMed Central

Tsao, C C; Liou, J U; Wen, P H; Peng, C C; Liu, T S

2013-01-01

Aim To develop analytical models and analyse the stress distribution and flexibility of nickel–titanium (NiTi) instruments subject to bending forces. Methodology The analytical method was used to analyse the behaviours of NiTi instruments under bending forces. Two NiTi instruments (RaCe and Mani NRT) with different cross-sections and geometries were considered. Analytical results were derived using Euler–Bernoulli nonlinear differential equations that took into account the screw pitch variation of these NiTi instruments. In addition, the nonlinear deformation analysis based on the analytical model and the finite element nonlinear analysis was carried out. Numerical results are obtained by carrying out a finite element method. Results According to analytical results, the maximum curvature of the instrument occurs near the instrument tip. Results of the finite element analysis revealed that the position of maximum von Mises stress was near the instrument tip. Therefore, the proposed analytical model can be used to predict the position of maximum curvature in the instrument where fracture may occur. Finally, results of analytical and numerical models were compatible. Conclusion The proposed analytical model was validated by numerical results in analysing bending deformation of NiTi instruments. The analytical model is useful in the design and analysis of instruments. The proposed theoretical model is effective in studying the flexibility of NiTi instruments. Compared with the finite element method, the analytical model can deal conveniently and effectively with the subject of bending behaviour of rotary NiTi endodontic instruments. PMID:23173762

The development and validation of the advance care planning questionnaire in Malaysia.

PubMed

Lai, Pauline Siew Mei; Mohd Mudri, Salinah; Chinna, Karuthan; Othman, Sajaratulnisah

2016-10-18

Advance care planning is a voluntary process whereby individual preferences, values and beliefs are used to aid a person in planning for end-of-life care. Currently, there is no local instrument to assess an individual's awareness and attitude towards advance care planning. This study aimed to develop an Advance Care Planning Questionnaire and to determine its validity and reliability among older people in Malaysia. The Advance Care Planning Questionnaire was developed based on literature review. Face and content validity was verified by an expert panel, and piloted among 15 participants. Our study was conducted from October 2013 to February 2014, at an urban primary care clinic in Malaysia. Included were those aged >50 years, who could understand English. A retest was conducted 2 weeks after the first administration. Participants from the pilot study did not encounter any problems in answering the Advance Care Planning Questionnaire. Hence, no further modifications were made. Flesch reading ease was 71. The final version of the Advance Care Planning Questionnaire consists of 66 items: 30 items were measured on a nominal scale, whilst 36 items were measured on a Likert-like scale; of which we were only able to validate 22 items, as the remaining 14 items were descriptive in nature. A total of 245 eligible participants were approached; of which 230 agreed to participate (response rate = 93.9 %). Factor analysis on the 22 items measured on a Likert-scale revealed four domains: "feelings regarding advance care planning", "justifications for advance care planning", "justifications for not having advance care planning: fate and religion", and "justifications for not having advance care planning: avoid thinking about death". The Cronbach's alpha values for items each domain ranged from 0.637-0.915. In test-retest, kappa values ranged from 0.738-0.947. The final Advance Care Planning Questionnaire consisted of 63 items and 4 domains. It was found to be a valid and reliable instrument to assess the awareness and attitude of older people in Malaysia towards advance care planning.

Validation of Radiometric Standards for the Laboratory Calibration of Reflected-Solar Earth Observing Satellite Instruments

NASA Technical Reports Server (NTRS)

Butler, James J.; Johnson, B. Carol; Rice, Joseph P.; Brown, Steven W.; Barnes, Robert A.

2007-01-01

Historically, the traceability of the laboratory calibration of Earth-observing satellite instruments to a primary radiometric reference scale (SI units) is the responsibility of each instrument builder. For the NASA Earth Observing System (EOS), a program has been developed using laboratory transfer radiometers, each with its own traceability to the primary radiance scale of a national metrology laboratory, to independently validate the radiances assigned to the laboratory sources of the instrument builders. The EOS Project Science Office also developed a validation program for the measurement of onboard diffuse reflecting plaques, which are also used as radiometric standards for Earth-observing satellite instruments. Summarized results of these validation campaigns, with an emphasis on the current state-of-the-art uncertainties in laboratory radiometric standards, will be presented. Future mission uncertainty requirements, and possible enhancements to the EOS validation program to ensure that those uncertainties can be met, will be presented.

Development and Validation of an Instrument to Measure University Students' Biotechnology Attitude

NASA Astrophysics Data System (ADS)

Erdogan, Mehmet; Özel, Murat; Uşak, Muhammet; Prokop, Pavol

2009-06-01

The impact of biotechnologies on peoples' everyday lives continuously increases. Measuring young peoples' attitudes toward biotechnologies is therefore very important and its results are useful not only for science curriculum developers and policy makers, but also for producers and distributors of genetically modified products. Despite of substantial number of instruments which focused on measuring student attitudes toward biotechnology, a majority of them were not rigorously validated. This study deals with the development and validation of an attitude questionnaire toward biotechnology. Detailed information on development and validation process of the instrument is provided. Data gathered from 326 university students provided evidence for the validity and reliability of the new instrument which consists of 28 attitude items on a five point likert type scale. It is believed that the instrument will serve as a valuable tool for both instructors and researchers in science education to assess students' biotechnology attitudes.

Design and validation of the INICIARE instrument, for the assessment of dependency level in acutely ill hospitalised patients.

PubMed

Morales-Asencio, José Miguel; Porcel-Gálvez, Ana María; Oliveros-Valenzuela, Rosa; Rodríguez-Gómez, Susana; Sánchez-Extremera, Lucrecia; Serrano-López, Francisco Andrés; Aranda-Gallardo, Marta; Canca-Sánchez, José Carlos; Barrientos-Trigo, Sergio

2015-03-01

The aim of this study was to establish the validity and reliability of an instrument (Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería) used to assess the dependency level in acutely hospitalised patients. This instrument is novel, and it is based on the Nursing Outcomes Classification. Multiple existing instruments for needs assessment have been poorly validated and based predominately on interventions. Standardised Nursing Languages offer an ideal framework to develop nursing sensitive instruments. A cross-sectional validation study in two acute care hospitals in Spain. This study was implemented in two phases. First, the research team developed the instrument to be validated. In the second phase, the validation process was performed by experts, and the data analysis was conducted to establish the psychometric properties of the instrument. Seven hundred and sixty-one patient ratings performed by nurses were collected during the course of the research study. Data analysis yielded a Cronbach's alpha of 0·91. An exploratory factorial analysis identified three factors (Physiological, Instrumental and Cognitive-behavioural), which explained 74% of the variance. Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería was demonstrated to be a valid and reliable instrument based on its use in acutely hospitalised patients to assess the level of dependency. Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería can be used as an assessment tool in hospitalised patients during the nursing process throughout the entire hospitalisation period. It contributes information to support decisions on nursing diagnoses, interventions and outcomes. It also enables data codification in large databases. © 2014 John Wiley & Sons Ltd.

The ENVISAT Atmospheric Chemistry mission (GOMOS, MIPAS and SCIAMACHY) -Processing status and data availability

NASA Astrophysics Data System (ADS)

Dehn, Angelika; Brizzi, G.; Barrot, G.; Bovensmann, H.; Canela, M.; Fehr, T.; Laur, H.; Lichtenberg, G.; Niro, F.; Perron, G.; Raspollini, P.; Saavedra de Miguel, L.; Scarpino, G.; Vogel, P.

The atmospheric chemistry instruments on board the ENVISAT platform (GOMOS, MIPAS and SCIAMACHY) provide a unique dataset of geophysical parameters (e.g.: trace gases, clouds, and aerosol) that allows a comprehensive characterization of the atmosphere's chemical and climatological processes [1]. These instruments started to provide significant science data shortly after the launch of the ENVISAT satellite (March 2002). At the time of writing this paper, these instruments and the whole payload modules are fully working and are well beyond the expected lifetime of 5 years. In addition the orbit control strategy of the platform will be modified starting from 2010, in order to extend the mission lifetime up to 2013 [2]. This means that if no instrument problems will appear, the ENVISAT atmospheric sensors will provide at the end of their life, three separated, but complementary datasets of the most important atmospheric state parameters, spanning a time interval of about 11 years. This represents an extraordinary source of information for the scientific user community, both for the completeness and quality of the data and for the extent of the dataset. The aim of this paper is to present the actual status of the ESA operational atmospheric chemistry dataset provided by the three ENVISAT atmospheric chemistry instruments and the future evolution. The processing and reprocessing status will be described in details for each instrument. The outcomes of the geophysical validation and the planned validation activities will be discussed. Finally the data availability and the source of information will be specified. [1] H. Nett, J. Frerick, T. Paulsen, and G. Levrini, "The atmospheric instruments and their applications: GOMOS, MIPAS and SCIAMACHY", ESA Bulletin (ISSN 0376-4265), No. 106, p. 77 -87 (2001) [2] J. Frerick, B. Duesmann, and M. Canela, "2010 and beyond -The ENVISAT mission extension", Proc. `Envisat Symposium 2007', Montreux, Switzerland, 23-27 April 2007 (ESA SP-636, July 2007)

The ENVISAT Atmospheric Chemistry mission (GOMOS, MIPAS and SCIAMACHY) - Processing status and data availability

NASA Astrophysics Data System (ADS)

Niro, F.

2009-04-01

The atmospheric chemistry instruments on board the ENVISAT platform (GOMOS, MIPAS and SCIAMACHY) provide a unique dataset of geophysical parameters (e.g.: trace gases, clouds, and aerosol) that allows a comprehensive characterization of the atmosphere's chemical and climatological processes [1]. These instruments started to provide significant science data shortly after the launch of the ENVISAT satellite (March 2002). At the time of writing this paper, these instruments and the whole payload modules are fully working and are well beyond the expected lifetime of 5 years. In addition the orbit control strategy of the platform will be modified starting from 2010, in order to extend the mission lifetime up to 2013 [2]. This means that if no instrument problems will appear, the ENVISAT atmospheric sensors will provide at the end of their life, three separated, but complementary datasets of the most important atmospheric state parameters, spanning a time interval of about 11 years. This represents an extraordinary source of information for the scientific user community, both for the completeness and quality of the data and for the extent of the dataset. The aim of this paper is to present the actual status of the ESA operational atmospheric chemistry dataset provided by the three ENVISAT atmospheric chemistry instruments and the future evolution. The processing and reprocessing status will be described in details for each instrument. The outcomes of the geophysical validation and the planned validation activities will be discussed. Finally the data availability and the source of information will be specified. [1] H. Nett, J. Frerick, T. Paulsen, and G. Levrini, "The atmospheric instruments and their applications: GOMOS, MIPAS and SCIAMACHY", ESA Bulletin (ISSN 0376-4265), No. 106, p. 77 - 87 (2001) [2] J. Frerick, B. Duesmann, and M. Canela, "2010 and beyond - The ENVISAT mission extension", Proc. ‘Envisat Symposium 2007', Montreux, Switzerland, 23-27 April 2007 (ESA SP-636, July 2007)

An Attitude Scale on Individual Instrument and Individual Instrument Course: Validity-Reliability Research

ERIC Educational Resources Information Center

Kuçukosmanoglu, Hayrettin Onur

2015-01-01

The main purpose of this study is to develop a scale to determine students' attitude levels on individual instruments and individual instrument courses in instrument training, which is an important dimension of music education, and to conduct a validity-reliability research of the scale that has been developed. The scale consists of 16 items. The…

Development of the PRE-HIT instrument: patient readiness to engage in health information technology.

PubMed

Koopman, Richelle J; Petroski, Gregory F; Canfield, Shannon M; Stuppy, Julie A; Mehr, David R

2014-01-28

Technology-based aids for lifestyle change are becoming more prevalent for chronic conditions. Important "digital divides" remain, as well as concerns about privacy, data security, and lack of motivation. Researchers need a way to characterize participants' readiness to use health technologies. To address this need, we created an instrument to measure patient readiness to engage with health technologies among adult patients with chronic conditions. Initial focus groups to determine domains, followed by item development and refinement, and exploratory factor analysis to determine final items and factor structure. The development sample included 200 patients with chronic conditions from 6 family medicine clinics. From 98 potential items, 53 best candidate items were examined using exploratory factor analysis. Pearson's Correlation for Test/Retest reliability at 3 months. The final instrument had 28 items that sorted into 8 factors with associated Cronbach's alpha: 1) Health Information Need (0.84), 2) Computer/Internet Experience (0.87), 3) Computer Anxiety (0.82), 4) Preferred Mode of Interaction (0.73), 5) Relationship with Doctor (0.65), 6) Cell Phone Expertise (0.75), 7) Internet Privacy (0.71), and 8) No News is Good News (0.57). Test-retest reliability for the 8 subscales ranged from (0.60 to 0.85). The Patient Readiness to Engage in Health Internet Technology (PRE-HIT) instrument has good psychometric properties and will be an aid to researchers investigating technology-based health interventions. Future work will examine predictive validity.

Development of the PRE-HIT instrument: patient readiness to engage in health information technology

PubMed Central

2014-01-01

Background Technology-based aids for lifestyle change are becoming more prevalent for chronic conditions. Important “digital divides” remain, as well as concerns about privacy, data security, and lack of motivation. Researchers need a way to characterize participants’ readiness to use health technologies. To address this need, we created an instrument to measure patient readiness to engage with health technologies among adult patients with chronic conditions. Methods Initial focus groups to determine domains, followed by item development and refinement, and exploratory factor analysis to determine final items and factor structure. The development sample included 200 patients with chronic conditions from 6 family medicine clinics. From 98 potential items, 53 best candidate items were examined using exploratory factor analysis. Pearson’s Correlation for Test/Retest reliability at 3 months. Results The final instrument had 28 items that sorted into 8 factors with associated Cronbach’s alpha: 1) Health Information Need (0.84), 2) Computer/Internet Experience (0.87), 3) Computer Anxiety (0.82), 4) Preferred Mode of Interaction (0.73), 5) Relationship with Doctor (0.65), 6) Cell Phone Expertise (0.75), 7) Internet Privacy (0.71), and 8) No News is Good News (0.57). Test-retest reliability for the 8 subscales ranged from (0.60 to 0.85). Conclusion The Patient Readiness to Engage in Health Internet Technology (PRE-HIT) instrument has good psychometric properties and will be an aid to researchers investigating technology-based health interventions. Future work will examine predictive validity. PMID:24472182

75 FR 6682 - Notice of Proposed Information Collection: Comment Request; Final Endorsement of Credit Instrument

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-10

... Information Collection: Comment Request; Final Endorsement of Credit Instrument AGENCY: Office of the.... This Notice also lists the following information: Title of Proposal: Final Endorsement of Credit... proposed use: The information collected on the ``Final Endorsement of Credit Instrument'' form is used to...

Safe surgery: validation of pre and postoperative checklists 1

PubMed Central

Alpendre, Francine Taporosky; Cruz, Elaine Drehmer de Almeida; Dyniewicz, Ana Maria; Mantovani, Maria de Fátima; Silva, Ana Elisa Bauer de Camargo e; dos Santos, Gabriela de Souza

2017-01-01

ABSTRACT Objective: to develop, evaluate and validate a surgical safety checklist for patients in the pre and postoperative periods in surgical hospitalization units. Method: methodological research carried out in a large public teaching hospital in the South of Brazil, with application of the principles of the Safe Surgery Saves Lives Programme of the World Health Organization. The checklist was applied to 16 nurses of 8 surgical units and submitted for validation by a group of eight experts using the Delphi method online. Results: the instrument was validated and it was achieved a mean score ≥1, level of agreement ≥75% and Cronbach’s alpha >0.90. The final version included 97 safety indicators organized into six categories: identification, preoperative, immediate postoperative, immediate postoperative, other surgical complications, and hospital discharge. Conclusion: the Surgical Safety Checklist in the Pre and Postoperative periods is another strategy to promote patient safety, as it allows the monitoring of predictive signs and symptoms of surgical complications and the early detection of adverse events. PMID:28699994

Mapping Phonetic Features for Voice-Driven Sound Synthesis

NASA Astrophysics Data System (ADS)

Janer, Jordi; Maestre, Esteban

In applications where the human voice controls the synthesis of musical instruments sounds, phonetics convey musical information that might be related to the sound of the imitated musical instrument. Our initial hypothesis is that phonetics are user- and instrument-dependent, but they remain constant for a single subject and instrument. We propose a user-adapted system, where mappings from voice features to synthesis parameters depend on how subjects sing musical articulations, i.e. note to note transitions. The system consists of two components. First, a voice signal segmentation module that automatically determines note-to-note transitions. Second, a classifier that determines the type of musical articulation for each transition based on a set of phonetic features. For validating our hypothesis, we run an experiment where subjects imitated real instrument recordings with their voice. Performance recordings consisted of short phrases of saxophone and violin performed in three grades of musical articulation labeled as: staccato, normal, legato. The results of a supervised training classifier (user-dependent) are compared to a classifier based on heuristic rules (user-independent). Finally, from the previous results we show how to control the articulation in a sample-concatenation synthesizer by selecting the most appropriate samples.

Cross-cultural Adaptation of the Oral Anticoagulation Knowledge Test to the Brazilian Portuguese.

PubMed

Praxedes, Marcus Fernando da Silva; Abreu, Mauro Henrique Nogueira Guimarães; Ribeiro, Daniel Dias; Marcolino, Milena Soriano; Paiva, Saul Martins de; Martins, Maria Auxiliadora Parreiras

2017-05-01

Patients' knowledge about oral anticoagulant therapy may favor the achievement of therapeutic results and the prevention of adverse pharmacotherapy-related events. Brazil lacks validated instruments for assessing the patient's knowledge about treatment with warfarin. This study aimed to perform the cross-cultural adaptation of the Oral Anticoagulation Knowledge (OAK) Test instrument from English into Portuguese. This is a methodological study developed in an anticoagulation clinic of a public university hospital. The study included initial translation, synthesis of translations, back-translation, review by the experts committee and pre-testing with 30 individuals. We obtained semantic equivalence through the analysis of the referential and general meaning of each item. The conceptual equivalence of the items sought to demonstrate the relevance and acceptability of the instrument. The process of cross-cultural adaptation produced the final version of the OAK Test in Brazilian Portuguese entitled "Teste de Conhecimento sobre Anticoagulação Oral". There was a suitable semantic and conceptual equivalence between the adapted version and the original version, as well as an excellent acceptability of this instrument.

In-Situ F2-Region Plasma Density and Temperature Measurements from the International Space Station

NASA Technical Reports Server (NTRS)

Coffey, Victoria; Wright, Kenneth; Minow, Joseph

2008-01-01

The International Space Station orbit provides an ideal platform for in-situ studies of space weather effects on the mid and low latitude F-2 region ionosphere. The Floating Potential Measurement Unit (FPMU) operating on the ISS since Aug 2006. is a suite of plasma instruments: a Floating Potential Probe (FPP), a Plasma Impedance Probe (PIP), a Wide-sweep langmuir Probe (WLP), and a Narrow-sweep Langmuir Probe (NLP). This instrument package provides a new opportunity lor collaborative multi-instrument studies of the F-region ionosphere during both quiet and disturbed periods. This presentation first describes the operational parameters for each of the FPMU probes and shOWS examples of an intra-instrument validation. We then show comparisons with the plasma density and temperature measurements derived from the TIMED GUVI ultraviolet imager, the Millstone Hill ground based incoherent scatter radar, and DIAS digisondes, Finally we show one of several observations of night-time equatorial density holes demonstrating the capabilities of the probes lor monitoring mid and low latitude plasma processes.

[Validation of a scale measuring coping with extreme risks].

PubMed

López-Vázquez, Esperanza; Marván, María Luisa

2004-01-01

The objective of this study was to validate, in Mexico, the French coping scale "Echelle Toulousaine de Coping". In the fall of 2001, the scale questionnaire was applied to 209 subjects living in different areas of Mexico, exposed to five different types of extreme natural or industrial risks. The discriminatory capacity of the items, as well as the factorial structure and internal consistency of the scale, were analyzed using Mann-Whitney's U test, principal components factorial analysis, and Cronbach's alpha. The final scale was composed of 26 items forming two groups: active coping and passive coping. Internal consistency of the instrument was high, both in the total sample and in the subsample of natural and industrial risks. The coping scale is reliable and valid for the Mexican population. The English version of this paper is available at: http://www.insp.mx/salud/index.html.

NASA Sea Ice and Snow Validation Program for the DMSP SSM/I: NASA DC-8 flight report

NASA Technical Reports Server (NTRS)

Cavalieri, D. J.

1988-01-01

In June 1987 a new microwave sensor called the Special Sensor Microwave Imager (SSM/I) was launched as part of the Defense Meteorological Satellite Program (DMSP). In recognition of the importance of this sensor to the polar research community, NASA developed a program to acquire the data, to convert the data into sea ice parameters, and finally to validate and archive both the SSM/I radiances and the derived sea ice parameters. Central to NASA's sea ice validation program was a series of SSM/I aircraft underflights with the NASA DC-8 airborne Laboratory. The mission (the Arctic '88 Sea Ice Mission) was completed in March 1988. This report summarizes the mission and includes a summary of aircraft instrumentation, coordination with participating Navy aircraft, flight objectives, flight plans, data collected, SSM/I orbits for each day during the mission, and lists several piggyback experiments supported during this mission.

Instruments Measuring Integrated Care: A Systematic Review of Measurement Properties.

PubMed

Bautista, Mary Ann C; Nurjono, Milawaty; Lim, Yee Wei; Dessers, Ezra; Vrijhoef, Hubertus Jm

2016-12-01

Policy Points: Investigations on systematic methodologies for measuring integrated care should coincide with the growing interest in this field of research. A systematic review of instruments provides insights into integrated care measurement, including setting the research agenda for validating available instruments and informing the decision to develop new ones. This study is the first systematic review of instruments measuring integrated care with an evidence synthesis of the measurement properties. We found 209 index instruments measuring different constructs related to integrated care; the strength of evidence on the adequacy of the majority of their measurement properties remained largely unassessed. Integrated care is an important strategy for increasing health system performance. Despite its growing significance, detailed evidence on the measurement properties of integrated care instruments remains vague and limited. Our systematic review aims to provide evidence on the state of the art in measuring integrated care. Our comprehensive systematic review framework builds on the Rainbow Model for Integrated Care (RMIC). We searched MEDLINE/PubMed for published articles on the measurement properties of instruments measuring integrated care and identified eligible articles using a standard set of selection criteria. We assessed the methodological quality of every validation study reported using the COSMIN checklist and extracted data on study and instrument characteristics. We also evaluated the measurement properties of each examined instrument per validation study and provided a best evidence synthesis on the adequacy of measurement properties of the index instruments. From the 300 eligible articles, we assessed the methodological quality of 379 validation studies from which we identified 209 index instruments measuring integrated care constructs. The majority of studies reported on instruments measuring constructs related to care integration (33%) and patient-centered care (49%); fewer studies measured care continuity/comprehensive care (15%) and care coordination/case management (3%). We mapped 84% of the measured constructs to the clinical integration domain of the RMIC, with fewer constructs related to the domains of professional (3.7%), organizational (3.4%), and functional (0.5%) integration. Only 8% of the instruments were mapped to a combination of domains; none were mapped exclusively to the system or normative integration domains. The majority of instruments were administered to either patients (60%) or health care providers (20%). Of the measurement properties, responsiveness (4%), measurement error (7%), and criterion (12%) and cross-cultural validity (14%) were less commonly reported. We found <50% of the validation studies to be of good or excellent quality for any of the measurement properties. Only a minority of index instruments showed strong evidence of positive findings for internal consistency (15%), content validity (19%), and structural validity (7%); with moderate evidence of positive findings for internal consistency (14%) and construct validity (14%). Our results suggest that the quality of measurement properties of instruments measuring integrated care is in need of improvement with the less-studied constructs and domains to become part of newly developed instruments. © 2016 Milbank Memorial Fund.

Instruments Measuring Integrated Care: A Systematic Review of Measurement Properties

PubMed Central

BAUTISTA, MARY ANN C.; NURJONO, MILAWATY; DESSERS, EZRA; VRIJHOEF, HUBERTUS JM

2016-01-01

Policy Points: Investigations on systematic methodologies for measuring integrated care should coincide with the growing interest in this field of research.A systematic review of instruments provides insights into integrated care measurement, including setting the research agenda for validating available instruments and informing the decision to develop new ones.This study is the first systematic review of instruments measuring integrated care with an evidence synthesis of the measurement properties.We found 209 index instruments measuring different constructs related to integrated care; the strength of evidence on the adequacy of the majority of their measurement properties remained largely unassessed. Context Integrated care is an important strategy for increasing health system performance. Despite its growing significance, detailed evidence on the measurement properties of integrated care instruments remains vague and limited. Our systematic review aims to provide evidence on the state of the art in measuring integrated care. Methods Our comprehensive systematic review framework builds on the Rainbow Model for Integrated Care (RMIC). We searched MEDLINE/PubMed for published articles on the measurement properties of instruments measuring integrated care and identified eligible articles using a standard set of selection criteria. We assessed the methodological quality of every validation study reported using the COSMIN checklist and extracted data on study and instrument characteristics. We also evaluated the measurement properties of each examined instrument per validation study and provided a best evidence synthesis on the adequacy of measurement properties of the index instruments. Findings From the 300 eligible articles, we assessed the methodological quality of 379 validation studies from which we identified 209 index instruments measuring integrated care constructs. The majority of studies reported on instruments measuring constructs related to care integration (33%) and patient‐centered care (49%); fewer studies measured care continuity/comprehensive care (15%) and care coordination/case management (3%). We mapped 84% of the measured constructs to the clinical integration domain of the RMIC, with fewer constructs related to the domains of professional (3.7%), organizational (3.4%), and functional (0.5%) integration. Only 8% of the instruments were mapped to a combination of domains; none were mapped exclusively to the system or normative integration domains. The majority of instruments were administered to either patients (60%) or health care providers (20%). Of the measurement properties, responsiveness (4%), measurement error (7%), and criterion (12%) and cross‐cultural validity (14%) were less commonly reported. We found <50% of the validation studies to be of good or excellent quality for any of the measurement properties. Only a minority of index instruments showed strong evidence of positive findings for internal consistency (15%), content validity (19%), and structural validity (7%); with moderate evidence of positive findings for internal consistency (14%) and construct validity (14%). Conclusions Our results suggest that the quality of measurement properties of instruments measuring integrated care is in need of improvement with the less‐studied constructs and domains to become part of newly developed instruments. PMID:27995711

Implementing the Science Assessment Standards: Developing and validating a set of laboratory assessment tasks in high school biology

NASA Astrophysics Data System (ADS)

Saha, Gouranga Chandra

Very often a number of factors, especially time, space and money, deter many science educators from using inquiry-based, hands-on, laboratory practical tasks as alternative assessment instruments in science. A shortage of valid inquiry-based laboratory tasks for high school biology has been cited. Driven by this need, this study addressed the following three research questions: (1) How can laboratory-based performance tasks be designed and developed that are doable by students for whom they are designed/written? (2) Do student responses to the laboratory-based performance tasks validly represent at least some of the intended process skills that new biology learning goals want students to acquire? (3) Are the laboratory-based performance tasks psychometrically consistent as individual tasks and as a set? To answer these questions, three tasks were used from the six biology tasks initially designed and developed by an iterative process of trial testing. Analyses of data from 224 students showed that performance-based laboratory tasks that are doable by all students require careful and iterative process of development. Although the students demonstrated more skill in performing than planning and reasoning, their performances at the item level were very poor for some items. Possible reasons for the poor performances have been discussed and suggestions on how to remediate the deficiencies have been made. Empirical evidences for validity and reliability of the instrument have been presented both from the classical and the modern validity criteria point of view. Limitations of the study have been identified. Finally implications of the study and directions for further research have been discussed.

Assessing quality of maternity care in Hungary: expert validation and testing of the mother-centered prenatal care (MCPC) survey instrument.

PubMed

Rubashkin, Nicholas; Szebik, Imre; Baji, Petra; Szántó, Zsuzsa; Susánszky, Éva; Vedam, Saraswathi

2017-11-16

Instruments to assess quality of maternity care in Central and Eastern European (CEE) region are scarce, despite reports of poor doctor-patient communication, non-evidence-based care, and informal cash payments. We validated and tested an online questionnaire to study maternity care experiences among Hungarian women. Following literature review, we collated validated items and scales from two previous English-language surveys and adapted them to the Hungarian context. An expert panel assessed items for clarity and relevance on a 4-point ordinal scale. We calculated item-level Content Validation Index (CVI) scores. We designed 9 new items concerning informal cash payments, as well as 7 new "model of care" categories based on mode of payment. The final questionnaire (N = 111 items) was tested in two samples of Hungarian women, representative (N = 600) and convenience (N = 657). We conducted bivariate analysis and thematic analysis of open-ended responses. Experts rated pre-existing English-language items as clear and relevant to Hungarian women's maternity care experiences with an average CVI for included questions of 0.97. Significant differences emerged across the model of care categories in terms of informal payments, informed consent practices, and women's perceptions of autonomy. Thematic analysis (N = 1015) of women's responses identified 13 priority areas of the maternity care experience, 9 of which were addressed by the questionnaire. We developed and validated a comprehensive questionnaire that can be used to evaluate respectful maternity care, evidence-based practice, and informal cash payments in CEE region and beyond.

[Design and validation of a questionnaire to assess dietary behavior in Mexican students in the area of health].

PubMed

Márquez-Sandoval, Yolanda Fabiola; Salazar-Ruiz, Erika Nohemi; Macedo-Ojeda, Gabriela; Altamirano-Martínez, Macedo-Ojeda; Bernal-Orozco, María Fernanda; Salas-Salvadó, Jordi; Vizmanos-Lamotte, Barbara

2014-07-01

The dietary behavior (DB) establishes the relationship between the human being and foods and has an influence on nutrient intake and, therefore, it contributes to the health or disease status of a population, even among college students. There exit some validated instruments to assess food and nutrients intake, but there are very few assessing DB. To design and validate a questionnaire to assess DB in Mexican college students. According to the literature and Reasoned Theory, a questionnaire assessing DB was designed. Its logic and content validity was determined by expert assessment. It was applied on two occasions with a 4-week interval to 333 students from the University of Guadalajara coursing the sixth semester of Medicine or Nutrition. The reproducibility was assessed by means of the interclass correlation coefficient. The construct validity and the internal consistency were calculated by Rasch analysis, for both the difficulty of the items and the subjects' capability. The questionnaire finally included 31 questions with multiple choice answers. The interclass correlation coefficient of the instrument was 0.76. The Cronbach alpha was 0.50 for the subjects' capability and 0.98 for the internal consistency of the items. 87.1% of the subjects and 89.8% of the items had INFIT and OUTFIT values within acceptable limits. The present questionnaire has the potentiality of measuring at low cost and in a practical way aspects related with DB in college student with the aim of establishing or following-up corrective or preventive actions. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

Trainees' Perceptions of Feedback: Validity Evidence for Two FEEDME (Feedback in Medical Education) Instruments.

PubMed

Bing-You, Robert; Ramesh, Saradha; Hayes, Victoria; Varaklis, Kalli; Ward, Denham; Blanco, Maria

2018-01-01

Construct: Medical educators consider feedback a core component of the educational process. Effective feedback allows learners to acquire new skills, knowledge, and attitudes. Learners' perceptions of feedback are an important aspect to assess with valid methods in order to improve the feedback skills of educators and the feedback culture. Although guidelines for delivering effective feedback have existed for several decades, medical students and residents often indicate that they receive little feedback. A recent scoping review on feedback in medical education did not reveal any validity evidence on instruments to assess learner's perceptions of feedback. The purpose of our study was to gather validity evidence on two novel FEEDME (Feedback in Medical Education) instruments to assess medical students' and residents' perceptions of the feedback that they receive. After the authors developed an initial instrument with 54 items, cognitive interviews with medical students and residents suggested that 2 separate instruments were needed, one focused on the feedback culture (FEEDME-Culture) and the other on the provider of feedback (FEEDME-Provider). A Delphi study with 17 medical education experts and faculty members assessed content validity. The response process was explored involving 31 medical students and residents at 2 academic institutions. Exploratory factor analysis and reliability analyses were performed on completed instruments. Two Delphi consultation rounds refined the wording of items and eliminated several items. Learners found both instruments easy and quick to answer; it took them less than 5 minutes to complete. Learners preferred an electronic format of the instruments over paper. Factor analysis revealed a two- and three-factor solution for the FEEDME-Culture and FEEDME-Provider instruments, respectively. Cronbach's alpha was greater than 0.80 for all factors. Items on both instruments were moderately to highly correlated (range, r = .3-.7). Our results provide preliminary validity evidence of 2 novel feedback instruments. After further validation of both FEEDME instruments, sharing the results of the FEEDME-Culture instrument with educational leaders and faculty may improve the culture of feedback on specific educational rotations and at the institutional level. The FEEDME-Provider instrument could be useful for faculty development targeting feedback skills. Additional research studies could assess whether both instruments may be used to help learners receive feedback and prompt reflective learning.

Psychometric testing of the properties of the spiritual health scale short form.

PubMed

Hsiao, Ya-Chu; Chiang, Yi-Chien; Lee, Hsiang-Chun; Han, Chin-Yen

2013-11-01

To further examine the psychometric properties of the spiritual health scale short form, including its reliability and validity. Spirituality is one of the main factors associated with good health outcomes. A reliable and valid instrument to measure spirituality is essential to identify the spiritual needs of an individual and to evaluate the effect of spiritual care. A cross-sectional study design was used. The study was conducted in six nursing schools in northern, central and southern Taiwan. The inclusion criterion for participants was nursing students with clinical practice experience. Initially, 1141 participants were recruited for the study, but 67 were absent and 48 did not complete the questionnaires. A total of 1026 participants were finally recruited, indicating a response rate of 89·9%. The psychometric testing of the spiritual health scale short form included construct validity with confirmatory factor analysis, known-group validity and internal consistency reliability. The results of the confirmatory factor analysis supported the five-factor model as an acceptable model fit. In the known-group validity, the results indicated that people who are in the category of primary religious affiliation have better spiritual health than people in the category of secondary religious affiliation and atheism. The result also indicated that the 24-item spiritual health scale short form achieved an acceptable internal consistency coefficient. The findings suggest that the spiritual health scale short form is a valid and reliable instrument for the appraisal of individual spiritual health. The spiritual health scale short form could provide useful information to guide clinical practice in assessing and managing people's spiritual health in Taiwan. © 2013 John Wiley & Sons Ltd.

Development and psychometric testing of Holistic Clinical Assessment Tool (HCAT) for undergraduate nursing students.

PubMed

Wu, Xi Vivien; Enskär, Karin; Pua, Lay Hoon; Heng, Doreen Gek Noi; Wang, Wenru

2016-09-22

A major focus in nursing education is on the judgement of clinical performance, and it is a complex process due to the diverse nature of nursing practice. A holistic approach in assessment of competency is advocated. Difficulties in the development of valid and reliable assessment measures in nursing competency have resulted in the development of assessment instruments with an increase in face and content validity, but few studies have tested these instruments psychometrically. It is essential to develop a holistic assessment tool to meet the needs of the clinical education. The study aims to develop a Holistic Clinical Assessment Tool (HCAT) and test its psychometric properties. The HCAT was developed based on the systematic literature review and the findings of qualitative studies. An expert panel was invited to evaluate the content validity of the tool. A total of 130 final-year nursing undergraduate students were recruited to evaluate the psychometric properties (i.e. factor structure, internal consistency and test-retest reliability) of the tool. The HCAT has good content validity with content validity index of .979. The exploratory factor analysis reveals a four-factor structure of the tool. The internal consistency and test-retest reliability of the HCAT are satisfactory with Cronbach alpha ranging from .789 to .965 and Intraclass Correlation Coefficient ranging from .881 to .979 for the four subscales and total scale. HCAT has the potential to be used as a valid measure to evaluate clinical competence in nursing students, and provide specific and ongoing feedback to enhance the holistic clinical learning experience. In addition, HCAT functions as a tool for self-reflection, peer-assessment and guides preceptors in clinical teaching and assessment.

Validation of an Instructional Observation Instrument for Teaching English as a Foreign Language in Spain

ERIC Educational Resources Information Center

Gomez-Garcia, Maria

2011-01-01

The design and validation of a classroom observation instrument to provide formative feedback for teachers of EFL in Spain is the overarching purpose of this study. This study proposes that a valid and reliable classroom observation instrument, based on effective practice in teaching EFL, can be developed and used in Spain to enable teachers to…

Development and Validation of Scores from an Instrument Measuring Student Test-Taking Motivation

ERIC Educational Resources Information Center

Eklof, Hanna

2006-01-01

Using the expectancy-value model of achievement motivation as a basis, this study's purpose is to develop, apply, and validate scores from a self-report instrument measuring student test-taking motivation. Sampled evidence of construct validity for the present sample indicates that a number of the items in the instrument could be used as an…

Scrutinizing A Survey-Based Measure of Science and Mathematics Teacher Knowledge: Relationship to Observations of Teaching Practice

ERIC Educational Resources Information Center

Talbot, Robert M., III

2017-01-01

There is a clear need for valid and reliable instrumentation that measures teacher knowledge. However, the process of investigating and making a case for instrument validity is not a simple undertaking; rather, it is a complex endeavor. This paper presents the empirical case of one aspect of such an instrument validation effort. The particular…

Clinical instruments: reliability and validity critical appraisal.

PubMed

Brink, Yolandi; Louw, Quinette A

2012-12-01

RATIONALE, AIM AND OBJECTIVES: There is a lack of health care practitioners using objective clinical tools with sound psychometric properties. There is also a need for researchers to improve their reporting of the validity and reliability results of these clinical tools. Therefore, to promote the use of valid and reliable tools or tests for clinical evaluation, this paper reports on the development of a critical appraisal tool to assess the psychometric properties of objective clinical tools. A five-step process was followed to develop the new critical appraisal tool: (1) preliminary conceptual decisions; (2) defining key concepts; (3) item generation; (4) assessment of face validity; and (5) formulation of the final tool. The new critical appraisal tool consists of 13 items, of which five items relate to both validity and reliability studies, four items to validity studies only and four items to reliability studies. The 13 items could be scored as 'yes', 'no' or 'not applicable'. This critical appraisal tool will aid both the health care practitioner to critically appraise the relevant literature and researchers to improve the quality of reporting of the validity and reliability of objective clinical tools. © 2011 Blackwell Publishing Ltd.

Assessing Empathy across Childhood and Adolescence: Validation of the Empathy Questionnaire for Children and Adolescents (EmQue-CA)

PubMed Central

Overgaauw, Sandy; Rieffe, Carolien; Broekhof, Evelien; Crone, Eveline A.; Güroğlu, Berna

2017-01-01

Empathy plays a crucial role in healthy social functioning and in maintaining positive social relationships. In this study, 1250 children and adolescents (10–15 year olds) completed the newly developed Empathy Questionnaire for Children and Adolescents (EmQue-CA) that was tested on reliability, construct validity, convergent validity, and concurrent validity. The EmQue-CA aims to assess empathy using the following scales: affective empathy, cognitive empathy, and intention to comfort. A Principal Components Analysis, which was directly tested with a Confirmatory Factor Analysis, confirmed the proposed three-factor model resulting in 14 final items. Reliability analyses demonstrated high internal consistency of the scales. Furthermore, the scales showed high convergent validity, as they were positively correlated with related scales of the Interpersonal Reactivity Index (Davis, 1983). With regard to concurrent validity, higher empathy was related to more attention to others’ emotions, higher friendship quality, less focus on own affective state, and lower levels of bullying behavior. Taken together, we show that the EmQue-CA is a reliable and valid instrument to measure empathy in typically developing children and adolescents aged 10 and older. PMID:28611713

Validation of problem drinking screening instruments for DWI offenders

DOT National Transportation Integrated Search

1999-05-01

This document summarizes the results of a validation study for five adult screening instruments in use for preliminary screening of driving while intoxicated (DWI) offenders for problem drinking. The instruments were the Driver Risk Inventory (DRI), ...

Topex Microwave Radiometer thermal control - Post-system-test modifications and on-orbit performance

NASA Technical Reports Server (NTRS)

Lin, Edward I.

1993-01-01

The Topex Microwave Radiometer has had an excellent thermal performance since launch. The instrument, however, went through a hardware modification right before launch to correct for a thermal design inadequacy that was uncovered during the spacecraft thermal vacuum test. This paper reports on how the initially obscure problem was tracked down, and how the thermal models were revised, validated, and utilized to investigate the solution options and guide the hardware modification decisions. Details related to test data interpretation, analytical uncertainties, and model-prediction vs. test-data correlation, are documented. Instrument/spacecraft interface issues, where the problem originated and where in general pitfalls abound, are dealt with specifically. Finally, on-orbit thermal performance data are presented, which exhibit good agreement with flight predictions, and lessons learned are discussed.

Adding the third dimension on adaptive optics retina imager thanks to full-field optical coherence tomography

NASA Astrophysics Data System (ADS)

Blavier, Marie; Blanco, Leonardo; Glanc, Marie; Pouplard, Florence; Tick, Sarah; Maksimovic, Ivan; Mugnier, Laurent; Chènegros, Guillaume; Rousset, Gérard; Lacombe, François; Pâques, Michel; Le Gargasson, Jean-François; Sahel, José-Alain

2009-02-01

Retinal pathologies, like ARMD or glaucoma, need to be early detected, requiring imaging instruments with resolution at a cellular scale. However, in vivo retinal cells studies and early diagnoses are severely limited by the lack of resolution on eye-fundus images from classical ophthalmologic instruments. We built a 2D retina imager using Adaptive Optics to improve lateral resolution. This imager is currently used in clinical environment. We are currently developing a time domain full-field optical coherence tomograph. The first step was to conceive the images reconstruction algorithms and validation was realized on non-biological samples. Ex vivo retina are currently being imaged. The final step will consist in coupling both setups to acquire high resolution retina cross-sections.

Correcting Bidirectional Effects in Remote Sensing Reflectance from Coastal Waters

NASA Astrophysics Data System (ADS)

Stamnes, K. H.; Fan, Y.; Li, W.; Voss, K. J.; Gatebe, C. K.

2016-02-01

Understanding bidirectional effects including sunglint is important for GEO-CAPE for several reasons: (i) correct interpretation of ocean color data; (ii) comparing consistency of spectral radiance data derived from space observations with a single instrument for a variety of illumination and viewing conditions; (iii) merging data collected by different instruments operating simultaneously. We present a new neural network (NN) method to correct bidirectional effects in water-leaving radiance for both Case 1 and Case 2 waters. We also discuss a new BRDF and 2D sun-glint model that was validated by comparing simulated surface reflectances with Cloud Absorption Radiometer (CAR) data. Finally, we present an extension of our marine bio-optical model to the UV range that accounts for the seasonal dependence of the inherent optical properties (IOPs).

Confirmatory factor analysis of the Malay version comprehensive feeding practices questionnaire tested among mothers of primary school children in Malaysia.

PubMed

Shohaimi, Shamarina; Wei, Wong Yoke; Shariff, Zalilah Mohd

2014-01-01

Comprehensive feeding practices questionnaire (CFPQ) is an instrument specifically developed to evaluate parental feeding practices. It has been confirmed among children in America and applied to populations in France, Norway, and New Zealand. In order to extend the application of CFPQ, we conducted a factor structure validation of the translated version of CFPQ (CFPQ-M) using confirmatory factor analysis among mothers of primary school children (N = 397) in Malaysia. Several items were modified for cultural adaptation. Of 49 items, 39 items with loading factors >0.40 were retained in the final model. The confirmatory factor analysis revealed that the final model (twelve-factor model with 39 items and 2 error covariances) displayed the best fit for our sample (Chi-square = 1147; df = 634; P < 0.05; CFI = 0.900; RMSEA = 0.045; SRMR = 0.0058). The instrument with some modifications was confirmed among mothers of school children in Malaysia. The present study extends the usability of the CFPQ and enables researchers and parents to better understand the relationships between parental feeding practices and related problems such as childhood obesity.

The WOMB (Women's views of birth) antenatal satisfaction questionnaire: development, dimensions, internal reliability, and validity.

PubMed Central

Smith, L F

1999-01-01

BACKGROUND: Antenatal services continue to change, stimulated by the Changing Childbirth report. Women's views should be an important component of assessing the quality of such services. To date, no published quantitative multidimensional assessment instrument has been available to measure their satisfaction with care. AIM: To develop a valid, reliable, multidimensional questionnaire to assess quality of antenatal care. METHOD: A multidimensional satisfaction questionnaire was developed using psychometric methods. Following fieldwork to pilot a questionnaire, three successive versions of it were given by midwives to pregnant women in their final trimester in nine trusts in the old South Western region of England. Their replies were analysed by principal components analysis (PCA) with varimax rotation; internal reliability was assessed by Cronbach's alpha. Face, content, and construct validity were all assessed during development. RESULTS: Out of 196 women, 134 (68.4%) returned the pilot questionnaires. One hundred and seventy-two (57.3%) out of 300 women returned version 1 of the WOMB (WOMen's views of Birth) antenatal satisfaction questionnaire proper, 283 (56.6%) out of 500 returned version 2, and 328 (65.6%) out of 500 returned the final development version. This final version consisted of 11 dimensions in addition to a general satisfaction one. These were [Cronbach's alpha]: five related to antenatal clinic characteristics (travelling to clinic [0.75], waiting at clinic [0.90], clinic environment [0.69], timing of appointment [0.78], car parking [0.85]), three 'professional' characteristics (professional competence [0.80], knowing carers [0.79], information provided [0.81]), antenatal classes [0.76], social support from other pregnant women [0.83], checking for the baby's heart beat [0.63]. There were significant moderate correlations (range = 0.24 to 0.77) between individual dimensions and the general satisfaction dimension. Women's dimension scores were significantly related to age, parity, social class, and best educational achievement. CONCLUSION: This multidimensional satisfaction instrument has good face, content, and construct validity, and excellent internal reliability. It could be used to generally assess antenatal services or to screen them to detect areas where further in-depth qualitative enquiry is merited. Its sensitivity to change over time, external reliability, and transferability to non-Caucasian groups needs to be assessed. PMID:10824341

Developing evaluation instrument based on CIPP models on the implementation of portfolio assessment

NASA Astrophysics Data System (ADS)

Kurnia, Feni; Rosana, Dadan; Supahar

2017-08-01

This study aimed to develop an evaluation instrument constructed by CIPP model on the implementation of portfolio assessment in science learning. This study used research and development (R & D) method; adapting 4-D by the development of non-test instrument, and the evaluation instrument constructed by CIPP model. CIPP is the abbreviation of Context, Input, Process, and Product. The techniques of data collection were interviews, questionnaires, and observations. Data collection instruments were: 1) the interview guidelines for the analysis of the problems and the needs, 2) questionnaire to see level of accomplishment of portfolio assessment instrument, and 3) observation sheets for teacher and student to dig up responses to the portfolio assessment instrument. The data obtained was quantitative data obtained from several validators. The validators consist of two lecturers as the evaluation experts, two practitioners (science teachers), and three colleagues. This paper shows the results of content validity obtained from the validators and the analysis result of the data obtained by using Aikens' V formula. The results of this study shows that the evaluation instrument based on CIPP models is proper to evaluate the implementation of portfolio assessment instruments. Based on the experts' judgments, practitioners, and colleagues, the Aikens' V coefficient was between 0.86-1,00 which means that it is valid and can be used in the limited trial and operational field trial.

Attributional Bias Instrument (ABI): Validation of a Measure to Assess Ability and Effort Explanations for Math Performance

ERIC Educational Resources Information Center

Espinoza, Penelope P.; Quezada, Stephanie A.; Rincones, Rodolfo; Strobach, E. Natalia; Gutierrez, Maria Armida Estrada

2012-01-01

The present work investigates the validation of a newly developed instrument, the attributional bias instrument, based on achievement attribution theories that distinguish between effort and ability explanations of behavior. The instrument further incorporates the distinction between explanations for success versus failure in academic performance.…

Perception of Competence in Middle School Physical Education: Instrument Development and Validation

ERIC Educational Resources Information Center

Scrabis-Fletcher, Kristin; Silverman, Stephen

2010-01-01

Perception of Competence (POC) has been studied extensively in physical activity (PA) research with similar instruments adapted for physical education (PE) research. Such instruments do not account for the unique PE learning environment. Therefore, an instrument was developed and the scores validated to measure POC in middle school PE. A…

Validation of an Adapted Instrument to Measure Students' Attitude towards Science

ERIC Educational Resources Information Center

Chin, Sook Fui; Lim, Hooi Lian

2016-01-01

Attitude towards science (ATS) is a major concern in science education. Although many ATS instruments have been developed, they are based on different cultural systems and having some limitations. This study aims to validate an instrument for measuring students' ATS in Malaysia context. The instrument was adapted from Test of Science-Related…

Measuring Uncertainty within Organizational Relationships: An Analysis of the CLUES Instrument.

ERIC Educational Resources Information Center

Jorgensen, Jerry D.; Petelle, John L.

1992-01-01

Presents an overview of the CLUES (also known as the CL7) instrument. Discusses the instrument's reliability and validity and its application to organizational communication research. Suggests that the instrument demonstrates unidimensionality in low-context cultures, high reliability, and known validity in a wide array of relational types. (RS)

[Development of an evaluation instrument for service quality in nursing homes].

PubMed

Lee, Jia; Ji, Eun Sun

2011-08-01

The purposes of this study were to identify the factors influencing service quality in nursing homes, and to develop an evaluation instrument for service quality. A three-phase process was employed for the study. 1) The important factors to evaluate the service quality in nursing homes were identified through a literature review, panel discussion and focus group interview, 2) the evaluation instrument was developed, and 3) validity and reliability of the study instrument were tested by factor analysis, Pearson correlation coefficient, Cronbach's α and Cohen's Kappa. Factor analysis showed that the factors influencing service quality in nursing homes were healthcare, diet/assistance, therapy, environment and staff. To improve objectivity of the instrument, quantitative as well as qualitative evaluation approaches were adopted. The study instrument was developed with 30 items and showed acceptable construct validity. The criterion-related validity was a Pearson correlation coefficient of .85 in 151 care facilities. The internal consistency was Cronbach's α=.95. The instrument has acceptable validity and a high degree of reliability. Staff in nursing homes can continuously improve and manage their services using the results of the evaluation instrument.

Transcultural adaptation of the Breast Cancer Awareness Measure.

PubMed

Al-Khasawneh, E M; Leocadio, M; Seshan, V; Siddiqui, S T; Khan, A N; Al-Manaseer, M M

2016-09-01

To overcome the lack of a validated and robust Arabic instrument to measure breast cancer awareness. Currently, there is no validated Arabic instrument for measuring breast cancer awareness levels. We adapted, translated and validated the Breast Cancer Awareness Measure developed by Cancer Research UK. The instrument was translated into Arabic and back-translated for validation. Validation and reliability tests were conducted using purposively sampled 972 Arab women older than 20 years, living in Oman. The adapted content was validated by a panel of medical, linguistic and cultural experts, followed by cognitive interviews (n = 10), behavioural coding (n = 30) and criterion validation (n = 646). The instrument was tested for acceptability and its subscales for internal consistency. Inter-rater reliability was estimated between two similar groups (n = 144 and n = 142) to test homogeneity. The adapted and translated instrument had a high acceptability (98.7% completed). The validation process shaped the adaptation, and resulted in strong criterion validity (R = 0.58, P < 0.01). The instrument subscales for risk factors and warning signs had high internal consistency (Cronbach's alpha 0.856 and 0.890, respectively), with all floor and ceiling effects less than 15%. The correlation measure for inter-rater reliability was 0.97 (P < 0.01). Through the incorporation of contextual characteristics and prevalent beliefs among Arab populations, the adapted Best Cancer Awareness Measure is a robust Arabic instrument for the measurement of breast cancer awareness and early detection practices among Arab women. The purposively selected sample may not be representative of the population. Improvement of awareness and early detection of breast cancer can contribute towards reducing mortality from the disease. The adapted instrument has policy implications, since measurement of awareness levels is essential towards breast health promotion policies in Arab countries. © 2016 International Council of Nurses.

Comparing the accuracy of brief versus long depression screening instruments which have been validated in low and middle income countries: a systematic review.

PubMed

Akena, Dickens; Joska, John; Obuku, Ekwaro A; Amos, Taryn; Musisi, Seggane; Stein, Dan J

2012-11-01

Given the high prevalence of depression in primary health care (PHC), the use of screening instruments has been recommended. Both brief and long depression screening instruments have been validated in low and middle income countries (LMIC), including within HIV care settings. However, it remains unknown whether the brief instruments validated in LMIC are as accurate as the long ones. We conducted a search of PUBMED, the COCHRANE library, AIDSLINE, and PSYCH-Info from their inception up to July 2011, for studies that validated depression screening instruments in LMIC. Data were extracted into tables and analyzed using RevMan 5.0 and STATA 11.2 for the presence of heterogeneity. Nineteen studies met our inclusion criteria. The reported prevalence of depression in LMIC ranged from 11.1 to 53%. The area under curve (AUC) scores of the validated instruments ranged from 0.69-0.99. Brief as well as long screening instruments showed acceptable accuracy (AUC≥0.7). Five of the 19 instruments were validated within HIV settings. There was statistically significant heterogeneity between the studies, and hence a meta-analysis could not be conducted to completion. Heterogeneity chi-squared = 189.23 (d.f. = 18) p<.001. Brief depression screening instruments in both general and HIV-PHC are as accurate as the long ones. Brief scales may have an edge over the longer instruments since they can be administered in a much shorter time. However, because the ultra brief scales do not include the whole spectrum of depression symptoms including suicide, their use should be followed by a detailed diagnostic interview.

Look--but also listen! ReQuest: an essay on a new validated scale to assess the outcome of GERD treatment.

PubMed

Bardhan, Karna D; Berghöfer, Peter

2007-01-01

The ReQuest (Reflux Questionnaire) is a new instrument: a diary developed specifically to allow patients to measure the totality of their gastroesophageal reflux disease (GERD) symptoms and to track changes each day during treatment, an increasingly important need in clinical trials. This paper reviews the background, development, testing, and validation of the instrument and shows how its flexibility allows it to be used in new ways to assess different aspects of GERD. There were four key steps. (1) A full symptom spectrum was gathered from experts, literature and, crucially, from GERD patients, and comprised 67 symptom descriptions. (2) By expert consensus, these symptom descriptions were empirically condensed into six easier-to-handle 'dimensions' (acid complaints, upper abdominal/stomach complaints, lower abdominal/digestive complaints, nausea, sleep disturbances, other complaints), to which the seventh, general well-being, was added, a key feature of the instrument. The symptom burden of each dimension is measured as frequency x intensity (general well-being: intensity only). (3) This prototype instrument was tested in PPI clinical trials involving patients with erosive and non-erosive GERD, while the data generated were used to validate the prototype. (4) Finally, the scale was refined by factor analysis, a statistical process. Detailed statistical testing validating the scale and factor analysis confirmed that empirically condensing the symptom descriptions into dimensions did not affect the measurement properties of the instrument. FURTHER APPLICATION: The structure of ReQuest and its product, which is numerical, makes the instrument highly flexible and allows for its use in other GERD areas. (1) Its subscales, ReQuest-GI and ReQuest-WSO, measure symptoms traditionally associated with reflux and with general well-being, respectively, and permit these to be quantified and tracked independently. (2) Minor degrees of reflux symptoms are common amongst the healthy. The level was determined in a large population without evidence of disease, and a 'GERD symptom threshold' calculated. Reduction below this threshold to 'background levels' is a more realistic end point in clinical trials than the rarely achieved 'complete absence'. (3) ReQuest-GI was re-scaled and integrated with the modified Los Angeles scale used to grade esophageal appearances at endoscopy. The new instrument is a matrix, the ReQuest/LA-classification, which allows both symptoms and endoscopy appearances to be expressed by a single set of numbers in individual patients and in populations. (4) This in turn allows identification of patients who on treatment achieve 'complete remission', i.e. healing and symptom relief. PPI clinical trials confirm that it takes a longer period of treatment to reach this endpoint than healing or symptom relief alone. Thus the conventional 4-8 weeks of PPI therapy may unwittingly result in under-treatment. (5) Studies are in progress to determine the 'minimum clinically important difference' (MCID). This is the minimum change measured on treatment, which is judged as being of clinical benefit, an increasingly important subject. (6) Finally, the ReQuest used in clinical trials has been simplified for application in day-to-day clinical practice. The results obtained with 'ReQuest in Practice', the simplified version, are similar to those observed with the full version, as confirmed in a large-scale study in general practice. The clinical practice version has also been validated. (1) The characteristics of ReQuest make it suitable for use as the primary endpoint in clinical trials assessing the outcome of GERD. (2) The subscales allows for closer examination on the nature of GERD and response to treatment. (3) A simplified version has proven suitable for use in daily practice. Copyright 2007 S. Karger AG, Basel.

Recommendations on the most suitable quality-of-life measurement instruments for bariatric and body contouring surgery: a systematic review.

PubMed

de Vries, C E E; Kalff, M C; Prinsen, C A C; Coulman, K D; den Haan, C; Welbourn, R; Blazeby, J M; Morton, J M; van Wagensveld, B A

2018-06-08

The objective of this study is to systematically assess the quality of existing patient-reported outcome measures developed and/or validated for Quality of Life measurement in bariatric surgery (BS) and body contouring surgery (BCS). We conducted a systematic literature search in PubMed, EMBASE, PsycINFO, CINAHL, Cochrane Database Systematic Reviews and CENTRAL identifying studies on measurement properties of BS and BCS Quality of Life instruments. For all eligible studies, we evaluated the methodological quality of the studies by using the COnsensus-based Standards for the selection of health Measurement INstruments checklist and the quality of the measurement instruments by applying quality criteria. Four degrees of recommendation were assigned to validated instruments (A-D). Out of 4,354 articles, a total of 26 articles describing 24 instruments were included. No instrument met all requirements (category A). Seven instruments have the potential to be recommended depending on further validation studies (category B). Of these seven, the BODY-Q has the strongest evidence for content validity in BS and BCS. Two instruments had poor quality in at least one required quality criterion (category C). Fifteen instruments were minimally validated (category D). The BODY-Q, developed for BS and BCS, possessed the strongest evidence for quality of measurement properties and has the potential to be recommended in future clinical trials. © 2018 The Authors. Obesity Reviews published by John Wiley & Sons Ltd on behalf of World Obesity Federation.

Construction and Validation of a Questionnaire about Heart Failure Patients' Knowledge of Their Disease

PubMed Central

Bonin, Christiani Decker Batista; dos Santos, Rafaella Zulianello; Ghisi, Gabriela Lima de Melo; Vieira, Ariany Marques; Amboni, Ricardo; Benetti, Magnus

2014-01-01

Background The lack of tools to measure heart failure patients' knowledge about their syndrome when participating in rehabilitation programs demonstrates the need for specific recommendations regarding the amount or content of information required. Objectives To develop and validate a questionnaire to assess heart failure patients' knowledge about their syndrome when participating in cardiac rehabilitation programs. Methods The tool was developed based on the Coronary Artery Disease Education Questionnaire and applied to 96 patients with heart failure, with a mean age of 60.22 ± 11.6 years, 64% being men. Reproducibility was obtained via the intraclass correlation coefficient, using the test-retest method. Internal consistency was assessed by use of Cronbach's alpha, and construct validity, by use of exploratory factor analysis. Results The final version of the tool had 19 questions arranged in ten areas of importance for patient education. The proposed questionnaire had a clarity index of 8.94 ± 0.83. The intraclass correlation coefficient was 0.856, and Cronbach's alpha, 0.749. Factor analysis revealed five factors associated with the knowledge areas. Comparing the final scores with the characteristics of the population evidenced that low educational level and low income are significantly associated with low levels of knowledge. Conclusion The instrument has satisfactory clarity and validity indices, and can be used to assess the heart failure patients' knowledge about their syndrome when participating in cardiac rehabilitation programs. PMID:24652054

The cultural adaptation and validation of the "Burn Specific Health Scale-Revised" (BSHS-R): version for Brazilian burn victims.

PubMed

Ferreira, Eneas; Dantas, Rosana Aparecida Spadoti; Rossi, Lidia Aparecida; Ciol, Marcia Aparecida

2008-11-01

The Burns Specific Health Scale-Revised (BSHS-R) is of easy application, can be self-administered, and it is considered a good scale to evaluate various important life aspects of burn victims. To translate and culturally adapt the BSHS-R into the Brazilian-Portuguese language and to evaluate the internal consistency and convergent validity of the translated BSHS-R. The cultural adaptation of the BSHS-R included translation and back-translation, discussions with professionals and patients to ensure conceptual equivalence, semantic evaluation, and pre-test of the instrument. The Final Brazilian-Portuguese Version (FBPV) of the BSHS-R was tested on a group of 115 burn patients for internal consistency and validity of construct (using the Rosenberg Self-Esteem Scale (RSES) and the Beck Depression Inventory (BDI)). All values of Cronbach's alpha were greater than .8, demonstrating that the internal consistency of the FBPV was very high. Self-esteem was highly correlated with affect and body image (r=.59, p<.001), and with interpersonal relationships (r=.51, p<.001). Correlations between the domains of the FBPV and the BDI were all negative but larger in magnitude than the correlations with RSES. Depression was highly correlated with affect and body image (r=-.77, p<.001), and with interpersonal relationships (r=-.67, p<.001). The results showed that the adapted version of the BSHS-R into Brazilian-Portuguese fulfills the validity and reliability criteria required from an instrument of health status assessment for burn patients.

Developing and testing instruments for improving cooperation and patient's participation in mental health care.

PubMed

Latvala, E; Saranto, K; Pekkala, E

2004-10-01

The main purpose of the project was to develop computerized instruments that could be used by nurses and patients to assess their cooperation and mutual contributions to care. This paper presents a part of the project: the reliability and validity testing phase of a process of instrument development. To test the validity and reliability of the instruments, data were collected with questionnaires from nurses (n = 146) and patients (n = 286). The validity evaluated as construct validity and the reliability evaluated as internal consistency of the instruments were quite good. Construct validity was tested by factor analysis, and internal consistency was tested by Cronbach's alpha coefficient, which varied from 0.69 to 0.79. The instruments, which consisted of a software application that can be operated in a www environment, were meant to be used as tools in the psychiatric nursing context for assessing the cooperation between the nurses and patients and the patient's participation in his/her care. Furthermore, the computer programme can be used as a tool for developing and assessing the patient orientation in nursing.

Exploring the validity and reliability of a questionnaire for evaluating veterinary clinical teachers' supervisory skills during clinical rotations.

PubMed

Boerboom, T B B; Dolmans, D H J M; Jaarsma, A D C; Muijtjens, A M M; Van Beukelen, P; Scherpbier, A J J A

2011-01-01

Feedback to aid teachers in improving their teaching requires validated evaluation instruments. When implementing an evaluation instrument in a different context, it is important to collect validity evidence from multiple sources. We examined the validity and reliability of the Maastricht Clinical Teaching Questionnaire (MCTQ) as an instrument to evaluate individual clinical teachers during short clinical rotations in veterinary education. We examined four sources of validity evidence: (1) Content was examined based on theory of effective learning. (2) Response process was explored in a pilot study. (3) Internal structure was assessed by confirmatory factor analysis using 1086 student evaluations and reliability was examined utilizing generalizability analysis. (4) Relations with other relevant variables were examined by comparing factor scores with other outcomes. Content validity was supported by theory underlying the cognitive apprenticeship model on which the instrument is based. The pilot study resulted in an additional question about supervision time. A five-factor model showed a good fit with the data. Acceptable reliability was achievable with 10-12 questionnaires per teacher. Correlations between the factors and overall teacher judgement were strong. The MCTQ appears to be a valid and reliable instrument to evaluate clinical teachers' performance during short rotations.

Body Dysmorphic Disorder in aesthetic rhinoplasty: Validating a new screening tool.

PubMed

Lekakis, Garyfalia; Picavet, Valerie A; Gabriëls, Loes; Grietens, Jente; Hellings, Peter W

2016-08-01

To validate a new screening tool for body dysmorphic disorder (BDD) in patients seeking aesthetic rhinoplasty. We performed a prospective instrument validation study in an academic rhinology clinic. The Body Dysmorphic Disorder Questionnaire-Aesthetic Surgery (BDDQ-AS) is a seven-item short questionnaire validated in 116 patients undergoing aesthetic rhinoplasty. Screening was positive if the patient acknowledged on the BDDQ-AS that he/she was concerned about their appearance (question 1 = yes) AND preoccupied with these concerns (question 2 = yes) AND that these concerns caused at least moderate distress or impairment in different domains of daily life (question 3 or 4 or 5 or 6 ≥ 3 or question 7 = yes). Construct validity was assessed by comparing the BDDQ-AS to the Sheehan Disability Scale and the Derriford Appearance Scale-59. To determine concurrent validity, the BDDQ-AS was compared to the Yale-Brown Obsessive Compulsive Scale Modified for BDD. Finally, the predictive value of the BDDQ-AS on satisfaction 12 months after rhinoplasty was evaluated using a visual analogue scale and the Rhinoplasty Outcome Evaluation. Reliability of the BDDQ-AS was adequate, with Cronbach alpha = .83 for rhinoplasty patients and .84 for controls. Sensitivity was 89.6% and specificity 81.4%. BDDQ-AS-positive patients (n = 55) were more impaired in daily life and experienced more appearance-related distress and dysfunction compared to BDDQ-AS-negative patients. Moreover, they had more severe BDD symptoms. Finally, BDDQ-AS-positive patients were less satisfied after surgery compared to BDDQ-AS-negative patients. We hereby validated a new screening tool for BDD in an aesthetic rhinoplasty population. 3b. Laryngoscope, 126:1739-1745, 2016. © 2016 The American Laryngological, Rhinological and Otological Society, Inc.

[Validating an instrument for measuring the perceived quality of services received by people using hospitals in Colombia].

PubMed

Cabrera-Arana, Gustavo A; Londoño-Pimienta, Jaime L; Bello-Parías, León D

2008-01-01

Validating an instrument for measuring the perceived quality of services received by people using hospitals forming part of the Colombian Ministry of Social Protection's restructuring, redesigning and modernisation programme for health-service providing networks. Sánchez and Echeverri's guidelines for validating health quality measurement scales were followed due to the lack of a valid instrument for doing this in Colombia. Conceptual synthesis led to identifying a structure of constituent indicators, domains and sub-domains regarding the perception of health service quality. A list of reactions (having a scale for categorising the replies) was analysed according to the validity of appearance, construct, criteria and utility as criteria for sensitivity and usefulness. Successive revisions and three rounds of field-trials led to producing PECASUSS, an acronym given to the instrument for measuring users' perception of health service quality (Percepción de Calidad Según Usuarios de Servicios de Salud). The guidelines effectively orientated the validation of the instrument required for measuring the perceived quality of health services received by people using hospitals forming part of the programme.

Measuring leprosy-related stigma - a pilot study to validate a toolkit of instruments.

PubMed

Rensen, Carin; Bandyopadhyay, Sudhakar; Gopal, Pala K; Van Brakel, Wim H

2011-01-01

Stigma negatively affects the quality of life of leprosy-affected people. Instruments are needed to assess levels of stigma and to monitor and evaluate stigma reduction interventions. We conducted a validation study of such instruments in Tamil Nadu and West Bengal, India. Four instruments were tested in a 'Community Based Rehabilitation' (CBR) setting, the Participation Scale, Internalised Scale of Mental Illness (ISMI) adapted for leprosy-affected persons, Explanatory Model Interview Catalogue (EMIC) for leprosy-affected and non-affected persons and the General Self-Efficacy (GSE) Scale. We evaluated the following components of validity, construct validity, internal consistency, test-retest reproducibility and reliability to distinguish between groups. Construct validity was tested by correlating instrument scores and by triangulating quantitative and qualitative findings. Reliability was evaluated by comparing levels of stigma among people affected by leprosy and community controls, and among affected people living in CBR project areas and those in non-CBR areas. For the Participation, ISMI and EMIC scores significant differences were observed between those affected by leprosy and those not affected (p = 0.0001), and between affected persons in the CBR and Control group (p < 0.05). The internal consistency of the instruments measured with Cronbach's α ranged from 0.83 to 0.96 and was very good for all instruments. Test-retest reproducibility coefficients were 0.80 for the Participation score, 0.70 for the EMIC score, 0.62 for the ISMI score and 0.50 for the GSE score. The construct validity of all instruments was confirmed. The Participation and EMIC Scales met all validity criteria, but test-retest reproducibility of the ISMI and GSE Scales needs further evaluation with a shorter test-retest interval and longer training and additional adaptations for the latter.

The quality of instruments to assess the process of shared decision making: A systematic review.

PubMed

Gärtner, Fania R; Bomhof-Roordink, Hanna; Smith, Ian P; Scholl, Isabelle; Stiggelbout, Anne M; Pieterse, Arwen H

2018-01-01

To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument's content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations.

Instrumental variable methods in comparative safety and effectiveness research†

PubMed Central

Brookhart, M. Alan; Rassen, Jeremy A.; Schneeweiss, Sebastian

2010-01-01

Summary Instrumental variable (IV) methods have been proposed as a potential approach to the common problem of uncontrolled confounding in comparative studies of medical interventions, but IV methods are unfamiliar to many researchers. The goal of this article is to provide a non-technical, practical introduction to IV methods for comparative safety and effectiveness research. We outline the principles and basic assumptions necessary for valid IV estimation, discuss how to interpret the results of an IV study, provide a review of instruments that have been used in comparative effectiveness research, and suggest some minimal reporting standards for an IV analysis. Finally, we offer our perspective of the role of IV estimation vis-à-vis more traditional approaches based on statistical modeling of the exposure or outcome. We anticipate that IV methods will be often underpowered for drug safety studies of very rare outcomes, but may be potentially useful in studies of intended effects where uncontrolled confounding may be substantial. PMID:20354968

Development of a student-centered instrument to assess middle school students' conceptual understanding of sound

NASA Astrophysics Data System (ADS)

Eshach, Haim

2014-06-01

This article describes the development and field test of the Sound Concept Inventory Instrument (SCII), designed to measure middle school students' concepts of sound. The instrument was designed based on known students' difficulties in understanding sound and the history of science related to sound and focuses on two main aspects of sound: sound has material properties, and sound has process properties. The final SCII consists of 71 statements that respondents rate as either true or false and also indicate their confidence on a five-point scale. Administration to 355 middle school students resulted in a Cronbach alpha of 0.906, suggesting a high reliability. In addition, the average percentage of students' answers to statements that associate sound with material properties is significantly higher than the average percentage of statements associating sound with process properties (p <0.001). The SCII is a valid and reliable tool that can be used to determine students' conceptions of sound.

QuickPol: Fast calculation of effective beam matrices for CMB polarization

NASA Astrophysics Data System (ADS)

Hivon, Eric; Mottet, Sylvain; Ponthieu, Nicolas

2017-02-01

Current and planned observations of the cosmic microwave background (CMB) polarization anisotropies, with their ever increasing number of detectors, have reached a potential accuracy that requires a very demanding control of systematic effects. While some of these systematics can be reduced in the design of the instruments, others will have to be modeled and hopefully accounted for or corrected a posteriori. We propose QuickPol, a quick and accurate calculation of the full effective beam transfer function and of temperature to polarization leakage at the power spectra level, as induced by beam imperfections and mismatches between detector optical and electronic responses. All the observation details such as exact scanning strategy, imperfect polarization measurements, and flagged samples are accounted for. Our results are validated on Planck high frequency instrument (HFI) simulations. We show how the pipeline can be used to propagate instrumental uncertainties up to the final science products, and could be applied to experiments with rotating half-wave plates.

Health Sciences-Evidence Based Practice questionnaire (HS-EBP) for measuring transprofessional evidence-based practice: Creation, development and psychometric validation

PubMed Central

Fernández-Domínguez, Juan Carlos; de Pedro-Gómez, Joan Ernest; Morales-Asencio, José Miguel; Sastre-Fullana, Pedro; Sesé-Abad, Albert

2017-01-01

Introduction Most of the EBP measuring instruments available to date present limitations both in the operationalisation of the construct and also in the rigour of their psychometric development, as revealed in the literature review performed. The aim of this paper is to provide rigorous and adequate reliability and validity evidence of the scores of a new transdisciplinary psychometric tool, the Health Sciences Evidence-Based Practice (HS-EBP), for measuring the construct EBP in Health Sciences professionals. Methods A pilot study and a subsequent two-stage validation test sample were conducted to progressively refine the instrument until a reduced 60-item version with a five-factor latent structure. Reliability was analysed through both Cronbach’s alpha coefficient and intraclass correlations (ICC). Latent structure was contrasted using confirmatory factor analysis (CFA) following a model comparison aproach. Evidence of criterion validity of the scores obtained was achieved by considering attitudinal resistance to change, burnout, and quality of professional life as criterion variables; while convergent validity was assessed using the Spanish version of the Evidence-Based Practice Questionnaire (EBPQ-19). Results Adequate evidence of both reliability and ICC was obtained for the five dimensions of the questionnaire. According to the CFA model comparison, the best fit corresponded to the five-factor model (RMSEA = 0.049; CI 90% RMSEA = [0.047; 0.050]; CFI = 0.99). Adequate criterion and convergent validity evidence was also provided. Finally, the HS-EBP showed the capability to find differences between EBP training levels as an important evidence of decision validity. Conclusions Reliability and validity evidence obtained regarding the HS-EBP confirm the adequate operationalisation of the EBP construct as a process put into practice to respond to every clinical situation arising in the daily practice of professionals in health sciences (transprofessional). The tool could be useful for EBP individual assessment and for evaluating the impact of specific interventions to improve EBP. PMID:28486533

Health Sciences-Evidence Based Practice questionnaire (HS-EBP) for measuring transprofessional evidence-based practice: Creation, development and psychometric validation.

PubMed

Fernández-Domínguez, Juan Carlos; de Pedro-Gómez, Joan Ernest; Morales-Asencio, José Miguel; Bennasar-Veny, Miquel; Sastre-Fullana, Pedro; Sesé-Abad, Albert

2017-01-01

Most of the EBP measuring instruments available to date present limitations both in the operationalisation of the construct and also in the rigour of their psychometric development, as revealed in the literature review performed. The aim of this paper is to provide rigorous and adequate reliability and validity evidence of the scores of a new transdisciplinary psychometric tool, the Health Sciences Evidence-Based Practice (HS-EBP), for measuring the construct EBP in Health Sciences professionals. A pilot study and a subsequent two-stage validation test sample were conducted to progressively refine the instrument until a reduced 60-item version with a five-factor latent structure. Reliability was analysed through both Cronbach's alpha coefficient and intraclass correlations (ICC). Latent structure was contrasted using confirmatory factor analysis (CFA) following a model comparison aproach. Evidence of criterion validity of the scores obtained was achieved by considering attitudinal resistance to change, burnout, and quality of professional life as criterion variables; while convergent validity was assessed using the Spanish version of the Evidence-Based Practice Questionnaire (EBPQ-19). Adequate evidence of both reliability and ICC was obtained for the five dimensions of the questionnaire. According to the CFA model comparison, the best fit corresponded to the five-factor model (RMSEA = 0.049; CI 90% RMSEA = [0.047; 0.050]; CFI = 0.99). Adequate criterion and convergent validity evidence was also provided. Finally, the HS-EBP showed the capability to find differences between EBP training levels as an important evidence of decision validity. Reliability and validity evidence obtained regarding the HS-EBP confirm the adequate operationalisation of the EBP construct as a process put into practice to respond to every clinical situation arising in the daily practice of professionals in health sciences (transprofessional). The tool could be useful for EBP individual assessment and for evaluating the impact of specific interventions to improve EBP.

On Using Simulations to Inform Decision Making during Instrument Development

ERIC Educational Resources Information Center

Morgan, Grant B.; Moore, Courtney A.; Floyd, Harlee S.

2018-01-01

Although content validity--how well each item of an instrument represents the construct being measured--is foundational in the development of an instrument, statistical validity is also important to the decisions that are made based on the instrument. The primary purpose of this study is to demonstrate how simulation studies can be used to assist…

Applying the APA/AERA/NCME "Standards": Evidence for the Validity and Reliability of Three Statewide Teaching Assessment Instruments.

ERIC Educational Resources Information Center

Rothenberg, Lori; Hessling, Peter A.

The statewide teaching performance assessment instruments being used in Georgia, North Carolina, and Florida were examined. Forty-one reliability and validity studies regarding the instruments in use in each state were collected from state departments and universities. Georgia uses the Georgia Teacher Performance Assessment Instrument. North…

Portable digital lock-in instrument to determine chemical constituents with single-color absorption measurements for Global Health Initiatives

NASA Astrophysics Data System (ADS)

Vacas-Jacques, Paulino; Linnes, Jacqueline; Young, Anna; Gerrard, Victoria; Gomez-Marquez, Jose

2014-03-01

Innovations in international health require the use of state-of-the-art technology to enable clinical chemistry for diagnostics of bodily fluids. We propose the implementation of a portable and affordable lock-in amplifier-based instrument that employs digital technology to perform biochemical diagnostics on blood, urine, and other fluids. The digital instrument is composed of light source and optoelectronic sensor, lock-in detection electronics, microcontroller unit, and user interface components working with either power supply or batteries. The instrument performs lock-in detection provided that three conditions are met. First, the optoelectronic signal of interest needs be encoded in the envelope of an amplitude-modulated waveform. Second, the reference signal required in the demodulation channel has to be frequency and phase locked with respect to the optoelectronic carrier signal. Third, the reference signal should be conditioned appropriately. We present three approaches to condition the signal appropriately: high-pass filtering the reference signal, precise offset tuning the reference level by low-pass filtering, and by using a voltage divider network. We assess the performance of the lock-in instrument by comparing it to a benchmark device and by determining protein concentration with single-color absorption measurements. We validate the concentration values obtained with the proposed instrument using chemical concentration measurements. Finally, we demonstrate that accurate retrieval of phase information can be achieved by using the same instrument.

The development of an integrated assessment instrument for measuring analytical thinking and science process skills

NASA Astrophysics Data System (ADS)

Irwanto, Rohaeti, Eli; LFX, Endang Widjajanti; Suyanta

2017-05-01

This research aims to develop instrument and determine the characteristics of an integrated assessment instrument. This research uses 4-D model, which includes define, design, develop, and disseminate. The primary product is validated by expert judgment, tested it's readability by students, and assessed it's feasibility by chemistry teachers. This research involved 246 students of grade XI of four senior high schools in Yogyakarta, Indonesia. Data collection techniques include interview, questionnaire, and test. Data collection instruments include interview guideline, item validation sheet, users' response questionnaire, instrument readability questionnaire, and essay test. The results show that the integrated assessment instrument has Aiken validity value of 0.95. Item reliability was 0.99 and person reliability was 0.69. Teachers' response to the integrated assessment instrument is very good. Therefore, the integrated assessment instrument is feasible to be applied to measure the students' analytical thinking and science process skills.

Initial Validation of a Comprehensive Assessment Instrument for Bereavement-Related Grief Symptoms and Risk of Complications: The Indicator of Bereavement Adaptation—Cruse Scotland (IBACS)

PubMed Central

Schut, Henk; Stroebe, Margaret S.; Wilson, Stewart; Birrell, John

2016-01-01

Objective This study assessed the validity of the Indicator of Bereavement Adaptation Cruse Scotland (IBACS). Designed for use in clinical and non-clinical settings, the IBACS measures severity of grief symptoms and risk of developing complications. Method N = 196 (44 male, 152 female) help-seeking, bereaved Scottish adults participated at two timepoints: T1 (baseline) and T2 (after 18 months). Four validated assessment instruments were administered: CORE-R, ICG-R, IES-R, SCL-90-R. Discriminative ability was assessed using ROC curve analysis. Concurrent validity was tested through correlation analysis at T1. Predictive validity was assessed using correlation analyses and ROC curve analysis. Optimal IBACS cutoff values were obtained by calculating a maximal Youden index J in ROC curve analysis. Clinical implications were compared across instruments. Results ROC curve analysis results (AUC = .84, p < .01, 95% CI between .77 and .90) indicated the IBACS is a good diagnostic instrument for assessing complicated grief. Positive correlations (p < .01, 2-tailed) with all four instruments at T1 demonstrated the IBACS' concurrent validity, strongest with complicated grief measures (r = .82). Predictive validity was shown to be fair in T2 ROC curve analysis results (n = 67, AUC = .78, 95% CI between .65 and .92; p < .01). Predictive validity was also supported by stable positive correlations between IBACS and other instruments at T2. Clinical indications were found not to differ across instruments. Conclusions The IBACS offers effective grief symptom and risk assessment for use by non-clinicians. Indications are sufficient to support intake assessment for a stepped model of bereavement intervention. PMID:27741246

Validation of a moral distress instrument in nurses of primary health care 1

PubMed Central

Barth, Priscila Orlandi; Ramos, Flávia Regina Souza; Barlem, Edison Luiz Devos; Dalmolin, Graziele de Lima; Schneider, Dulcinéia Ghizoni

2018-01-01

ABSTRACT Objective: to validate an instrument to identify situations that trigger moral distress in relation to intensity and frequency in primary health care nurses. Method: this is a methodological study carried out with 391 nurses of primary health care, applied to the Brazilian Scale of Moral Distress in Nurses with 57 questions. Validation for primary health care was performed through expert committee evaluation, pre-test, factorial analysis, and Cronbach’s alpha. Results: there were 46 questions validated divided into six constructs: Health Policies, Working Conditions, Nurse Autonomy, Professional ethics, Disrespect to patient autonomy and Work Overload. The instrument had satisfactory internal consistency, with Cronbach’s alpha 0.98 for the instrument, and between 0.96 and 0.88 for the constructs. Conclusion: the instrument is valid and reliable to be used in the identification of the factors that trigger moral distress in primary care nurses, providing subsidies for new research in this field of professional practice. PMID:29791671

Diarrhea-predominant irritable bowel syndrome: creation of an electronic version of a patient-reported outcome instrument by conversion from a pen-and-paper version and evaluation of their equivalence.

PubMed

Delgado-Herrera, Leticia; Banderas, Benjamin; Ojo, Oluwafunke; Kothari, Ritesh; Zeiher, Bernhardt

2017-01-01

Subjects with diarrhea-predominant irritable bowel syndrome (IBS-D) experience abdominal cramping, bloating, pressure, and pain. Due to an absence of clinical biomarkers for IBS-D severity, evaluation of clinical therapy benefits depends on valid and reliable symptom assessments. A patient-reported outcome (PRO) instrument has been developed, comprising of two questionnaires - the IBS-D Daily Symptom Diary and IBS-D Symptom Event Log - suitable for clinical trials and real-world settings. This program aimed to support instrument conversion from pen-and-paper to electronic format. Digital technology (Android/iOS) and a traditional mode of administration study in the target population were used to migrate or convert the validated PRO IBS-D pen-and-paper measure to an electronic format. Equivalence interviews, conducted in three waves, each had three parts: 1) conceptual equivalence testing between formats, 2) electronic-version report-history cognitive debriefing, and 3) electronic version usability evaluation. After each inter-view wave, preliminary analyses were conducted and modifications made to the electronic version, before the next wave. Final revisions were based on a full analysis of equivalence interviews. The final analysis evaluated subjects' ability to read, understand, and provide meaningful responses to the instruments across both formats. Responses were classified according to conceptual equivalence between formats and mobile-format usability assessed with a questionnaire and open-ended probes. Equivalence interviews (n=25) demonstrated conceptual equivalence between formats. Mobile-application cognitive debriefing showed some subjects experienced difficulty with font/screen visibility and understanding or reading some report-history charts and summary screens. To address difficulties, minor revisions/modifications were made and landscape orientation and zoom-in/zoom-out features incorporated. This study indicates that the two administration modes are conceptually equivalent. Since both formats are conceptually equivalent, both are psychometrically reliable, as established in the pen-and-paper version. Subjects found both mobile applications (Android/iOS) offered many advantages over the paper version, such as real-time assessment of their experience.

Evaluation of the psychometric properties of the Nighttime Symptoms of COPD Instrument.

PubMed

Mocarski, Michelle; Zaiser, Erica; Trundell, Dylan; Make, Barry J; Hareendran, Asha

2015-01-01

Nighttime symptoms can negatively impact the quality of life of patients with chronic obstructive pulmonary disease (COPD). The Nighttime Symptoms of COPD Instrument (NiSCI) was designed to measure the occurrence and severity of nighttime symptoms in patients with COPD, the impact of symptoms on nighttime awakenings, and rescue medication use. The objective of this study was to explore item reduction, inform scoring recommendations, and evaluate the psychometric properties of the NiSCI. COPD patients participating in a Phase III clinical trial completed the NiSCI daily. Item analyses were conducted using weekly mean and single day scores. Descriptive statistics (including percentage of respondents at floor/ceiling and inter-item correlations), factor analyses, and Rasch model analyses were conducted to examine item performance and scoring. Test-retest reliability was assessed for the final instrument using the intraclass correlation coefficient (ICC). Correlations with assessments conducted during study visits were used to evaluate convergent and known-groups validity. Data from 1,663 COPD patients aged 40-93 years were analyzed. Item analyses supported the generation of four scores. A one-factor structure was confirmed with factor analysis and Rasch analysis for the symptom severity score. Test-retest reliability was confirmed for the six-item symptom severity (ICC, 0.85), number of nighttime awakenings (ICC, 0.82), and rescue medication (ICC, 0.68) scores. Convergent validity was supported by significant correlations between the NiSCI, St George's Respiratory Questionnaire, and Exacerbations of Chronic Obstructive Pulmonary Disease Tool-Respiratory Symptoms scores. The results suggest that the NiSCI can be used to determine the severity of nighttime COPD symptoms, the number of nighttime awakenings due to COPD symptoms, and the nighttime use of rescue medication. The NiSCI is a reliable and valid instrument to evaluate these concepts in COPD patients in clinical trials and clinical practice. Scoring recommendations and steps for further research are discussed.

An assessment of Chemical, Biological, Radiologic, Nuclear, and Explosive preparedness among emergency department healthcare providers in an inner city emergency department.

PubMed

Kotora, Joseph G

2015-01-01

Emergency healthcare providers are required to care for victims of Chemical, Biological, Radiologic, Nuclear, and Explosive (CBRNE) agents. However, US emergency departments are often ill prepared to manage CBRNE casualties. Most providers lack adequate knowledge or experience in the areas of patient decontamination, hospital-specific disaster protocols, interagency familiarization, and available supply of necessary medical equipment and medications. This study evaluated the CBRNE preparedness of physicians, nurses, and midlevel providers in an urban tertiary care emergency department. This retrospective observational survey study used a previously constructed questionnaire instrument. A total of 205 e-mail invitations were sent to 191 eligible providers through an online survey distribution tool (Survey Monkey®). Respondents were enrolled from February 1, 2014 to March 15, 2014. Simple frequencies of correct answers were used to determine the level of preparedness of each group. Cronbach's coefficient α was used to validate the precision of the study instrument. Finally, validity coefficients and analysis of variance ANOVA were used to determine the strength of correlation between demographic variables, as well as the variation between individual responses. Fifty-nine providers responded to the questionnaire (31.14 percent response rate). The overall frequency of correct answers was 66.26 percent, indicating a relatively poor level of CBRNE preparedness. The study instrument lacked precision and reliability (coefficient α 0.4050). Significant correlations were found between the frequency of correct answers and the respondents' gender, practice experience, and previous experience with a CBRNE incident. Significant variance exists between how providers believe casualties should be decontaminated, which drugs should be administered, and the interpretation of facility-specific protocols. Emergency care providers are inadequately prepared to manage CBRNE incidents. Furthermore, a valid and precise instrument capable of measuring preparedness needs to be developed. Standardized educational curriculums that consider healthcare providers' genders, occupations, and experience levels may assist in closing the knowledge gaps between providers and reinforce emergency departments' CBRNE preparedness.

Development of an audit instrument for nursing care plans in the patient record

PubMed Central

Bjorvell, C; Thorell-Ekstrand, I; Wredling, R

2000-01-01

Objectives—To develop, validate, and test the reliability of an audit instrument that measures the extent to which patient records describe important aspects of nursing care. Material—Twenty records from each of three hospital wards were collected and audited. The auditors were registered nurses with a knowledge of nursing documentation in accordance with the VIPS model—a model designed to structure nursing documentation. (VIPS is an acronym formed from the Swedish words for wellbeing, integrity, prevention, and security.) Methods—An audit instrument was developed by determining specific criteria to be met. The audit questions were aimed at revealing the content of the patient for nursing assessment, nursing diagnosis, planned interventions, and outcome. Each of the 60 records was reviewed by the three auditors independently and the reliability of the instrument was tested by calculating the inter-rater reliability coefficient. Content validity was tested by using an expert panel and calculating the content validity ratio. The criterion related validity was estimated by the correlation between the score of the Cat-ch-Ing instrument and the score of an earlier developed and used audit instrument. The results were then tested by using Pearson's correlation coefficient. Results—The new audit instrument, named Cat-ch-Ing, consists of 17 questions designed to judge the nursing documentation. Both quantity and quality variables are judged on a rating scale from zero to three, with a maximum score of 80. The inter-rater reliability coefficients were 0.98, 0.98, and 0.92, respectively for each group of 20 records, the content validity ratio ranged between 0.20 and 1.0 and the criterion related validity showed a significant correlation of r = 0.68 (p< 0.0001, 95% CI 0.57 to 0.76) between the two audit instruments. Conclusion—The Cat-ch-Ing instrument has proved to be a valid and reliable audit instrument for nursing records when the VIPS model is used as the basis of the documentation. (Quality in Health Care 2000;9:6–13) Key Words: audit instrument; nursing care plans; quality assurance PMID:10848373

Validation of the SETOC Instrument--Student Evaluation of Teaching in Outpatient Clinics

ERIC Educational Resources Information Center

Zuberi, Rukhsana W.; Bordage, Georges; Norman, Geoffrey R.

2007-01-01

Purpose: There is a paucity of evaluation forms specifically developed and validated for outpatient settings. The purpose of this study was to develop and validate an instrument specifically for evaluating outpatient teaching, to provide reliable and valid ratings for individual and group feedback to faculty, and to identify outstanding teachers…

Development of a monitoring instrument to assess the performance of the Swiss primary care system.

PubMed

Ebert, Sonja T; Pittet, Valérie; Cornuz, Jacques; Senn, Nicolas

2017-11-29

The Swiss health system is customer-driven with fee-for-service paiement scheme and universal coverage. It is highly performing but expensive and health information systems are scarcely implemented. The Swiss Primary Care Active Monitoring (SPAM) program aims to develop an instrument able to describe the performance and effectiveness of the Swiss PC system. Based on a Literature review we developed a conceptual framework and selected indicators according to their ability to reflect the Swiss PC system. A two round modified RAND method with 24 inter-/national experts took place to select primary/secondary indicators (validity, clarity, agreement). A limited set of priority indicators was selected (importance, priority) in a third round. A conceptual framework covering three domains (structure, process, outcome) subdivided into twelve sections (funding, access, organisation/ workflow of resources, (Para-)Medical training, management of knowledge, clinical-/interpersonal care, health status, satisfaction of PC providers/ consumers, equity) was generated. 365 indicators were pre-selected and 335 were finally retained. 56 were kept as priority indicators.- Among the remaining, 199 were identified as primary and 80 as secondary indicators. All domains and sections are represented. The development of the SPAM program allowed the construction of a consensual instrument in a traditionally unregulated health system through a modified RAND method. The selected 56 priority indicators render the SPAM instrument a comprehensive tool supporting a better understanding of the Swiss PC system's performance and effectiveness as well as in identifying potential ways to improve quality of care. Further challenges will be to update indicators regularly and to assess validity and sensitivity-to-change over time.

[Can Psychometric Tests Predict Success in the Selection Interview for Medical School? A Cross-Sectional Study at One German Medical School].

PubMed

Kötter, T; Obst, K U; Brüheim, L; Eisemann, N; Voltmer, E; Katalinic, A

2017-07-01

Background The final exam grade is the main selection criterion for medical school application in Germany. For academic success, it seems to be a reliable predictor. Its use as the only selection criterion is, however, criticised. At some universities, personal interviews are part of the selection process. However, these are very time consuming and are of doubtful validity. The (additional) use of appropriate psychometric instruments could reduce the cost and increase the validity. This study investigates the extent to which psychometric instruments can predict the outcome of a personal selection interview. Methods This is a cross-sectional study on the correlation of the results of psychometric instruments with those of the personal selection interview as part of the application process. As the outcome, the score of the selection interview was used. The NEO - Five Factor Inventory, the Hospital Anxiety and Depression Scale (HADS) and the questionnaire to identify work-related behaviour and experience patterns (AVEM) were used as psychometric interviews. Results There was a statistically significant correlation with the results of the personal selection interview for the sum score of the depression scale from the HADS and the sum score for the dimension of life satisfaction of the AVEM. In addition, those participants who did not previously complete an application training achieved a better result in the selection interview. Conclusion The instruments used measure different aspects than the interviews and cannot replace them. It remains to be seen whether the selected parameters are able to predict academic success. © Georg Thieme Verlag KG Stuttgart · New York.

The development of a test of biodiversity knowledge of high school students

NASA Astrophysics Data System (ADS)

Ajayi, Olabisi Modupe

2002-09-01

The primary purpose of this study was to develop a valid and reliable test of the knowledge of biodiversity of high school students. The test differentiated students' knowledge on three levels of biodiversity: species, ecosystem and genetics. A secondary purpose was to examine how biodiversity scores were affected by gender, grade point average, and families' socioeconomic status. The initial phase of the instrument development involved the construction of 60 dichotomous items (true/false). To establish content validity, a panel of biodiversity experts reviewed the items for appropriateness and clarity. The items were checked for readability using Flesch-Kincaid Readability Index and the readability was at the fifth grade level. The instrument was subjected to factor analysis. As a result, the final instrument was compiled and named the Ajayi Biodiversity Instrument (ABI). The reliability of ABI was .87. The mean score on the 25-item test was 79%. No significant difference at >0.05 was found in the score of students on each of the three subtests for genetics, species, and ecosystem. No significant difference was found in the score of students relative to their family's socioeconomic status. There was a significant correlation between grade point average and participation in extracurricular activities that related to biodiversity concepts and scores on ABI. Gender differences emerged at the ecosystem level, females scoring higher than males. Differences among ethnic groups also emerged. Anglo-Americans scored significantly higher on the test of knowledge of biodiversity for high school students than the rest of the ethnic groups combined.

Systematic review of the psychometric properties and theoretical grounding of instruments evaluating self-care in people with type 2 diabetes mellitus.

PubMed

Caro-Bautista, Jorge; Martín-Santos, Francisco Javier; Morales-Asencio, Jose Miguel

2014-06-01

To determine the psychometric properties and theoretical grounding of instruments that evaluate self-care behaviour or barriers in people with type 2 diabetes. There are many instruments designed to evaluate self-care behaviour or barriers in this population, but knowledge about their psychometric validation processes is lacking. Systematic review. We conducted a search for psychometric or validation studies published between January 1990-December 2012. We carried out searches in Pubmed, CINAHL, PsycINFO, ProQuolid, BibliPRO and Google SCHOLAR to identify instruments that evaluated self-care behaviours or barriers to diabetes self-care. We conducted a systematic review with the following inclusion criteria: Psychometric or clinimetric validation studies that included patients with type 2 diabetes (exclusively or partially) and which analysed self-care behaviour or barriers to self-care and proxies like self-efficacy or empowerment, from a multidimensional approach. Language: Spanish or English. Two authors independently assessed the quality of the studies and extracted data using Terwee's proposed criteria: psychometrics properties, dimensionality, theoretical ground and population used for validation through each included instrument. Sixteen instruments achieved the inclusion criteria for the review. We detected important methodological flaws in many of the selected instruments. Only the Self-management Profile for Type 2 Diabetes and Problem Areas in Diabetes Scale met half of Terwee's quality criteria. There are no instruments for identifying self-care behaviours or barriers elaborated with a strong validation process. Further research should be carried out to provide patients, clinicians and researchers with valid and reliable instruments that are methodologically solid and theoretically grounded. © 2013 John Wiley & Sons Ltd.

Physical activity measurement instruments for children with cerebral palsy: a systematic review.

PubMed

Capio, Catherine M; Sit, Cindy H P; Abernethy, Bruce; Rotor, Esmerita R

2010-10-01

this paper is a systematic review of physical activity measurement instruments for field-based studies involving children with cerebral palsy (CP). database searches using PubMed Central, MEDLINE, CINAHL Plus, PsycINFO, EMBASE, Cochrane Library, and PEDro located 12 research papers, identifying seven instruments that met the inclusion criteria of (1) having been developed for children aged 0 to 18 years, (2) having been used to evaluate a physical activity dimension, and (3) having been used in a field-based study involving children with CP. The instruments reviewed were the Activities Scale for Kids - Performance version (ASKp), the Canada Fitness Survey, the Children's Assessment of Participation and Enjoyment/Preferences for Activities of Children (CAPE/PAC), the Compendium of Physical Activities, the Physical Activity Questionnaire - Adolescents (PAQ-A), StepWatch, and the Uptimer. Second-round searches yielded 11 more papers, providing reliability and validity evidence for the instruments. the instruments measure physical activity frequency, mode, domain, and duration. Although most instruments demonstrated adequate reliability and validity, only the ASKp and CAPE/PAC have established reliability and validity for children with physical disabilities; the Uptimer has established concurrent validity. No instrument measuring intensity in free-living has been validated or found reliable for children with CP. the findings suggest that further studies are needed to examine the methodological properties of physical activity measurement in children with CP. Combining subjective and objective instruments is recommended to achieve better understanding of physical activity participation.

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20)

PubMed Central

2017-01-01

Objectives Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. Methods After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Results Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). Conclusions A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability. PMID:28173686

Health-Related Resource-Use Measurement Instruments for Intersectoral Costs and Benefits in the Education and Criminal Justice Sectors.

PubMed

Mayer, Susanne; Paulus, Aggie T G; Łaszewska, Agata; Simon, Judit; Drost, Ruben M W A; Ruwaard, Dirk; Evers, Silvia M A A

2017-09-01

Intersectoral costs and benefits (ICBs), i.e. costs and benefits of healthcare interventions outside the healthcare sector, can be a crucial component in economic evaluations from the societal perspective. Pivotal to their estimation is the existence of sound resource-use measurement (RUM) instruments; however, RUM instruments for ICBs in the education or criminal justice sectors have not yet been systematically collated or their psychometric quality assessed. This review aims to fill this gap. To identify relevant instruments, the Database of Instruments for Resource Use Measurement (DIRUM) was searched. Additionally, a systematic literature review was conducted in seven electronic databases to detect instruments containing ICB items used in economic evaluations. Finally, studies evaluating the psychometric quality of these instruments were searched. Twenty-six unique instruments were included. Most frequently, ICB items measured school absenteeism, tutoring, classroom assistance or contacts with legal representatives, police custody/prison detainment and court appearances, with the highest number of items listed in the Client Service Receipt Inventory/Client Sociodemographic and Service Receipt Inventory/Client Service Receipt Inventory-Children's Version (CSRI/CSSRI/CSRI-C), Studying the Scope of Parental Expenditures (SCOPE) and Self-Harm Intervention, Family Therapy (SHIFT) instruments. ICBs in the education sector were especially relevant for age-related developmental disorders and chronic diseases, while criminal justice resource use seems more important in mental health, including alcohol-related disorders or substance abuse. Evidence on the validity or reliability of ICB items was published for two instruments only. With a heterogeneous variety of ICBs found to be relevant for several disease areas but many ICB instruments applied in one study only (21/26 instruments), setting-up an international task force to, for example, develop an internationally adaptable instrument is recommended.

Pain assessment in children: theoretical and empirical validity.

PubMed

Villarruel, A M; Denyes, M J

1991-12-01

Valid assessment of pain in children is foundational for both the nursing practice and research domains, yet few validated methods of pain measurement are currently available for young children. This article describes an innovative research approach used in the development of photographic instruments to measure pain intensity in young African-American and Hispanic children. The instruments were designed to enable children to participate actively in their own care and to do so in ways that are congruent with their developmental and cultural heritage. Conceptualization of the instruments, methodological development, and validation processes grounded in Orem's Self-Care Deficit Theory of Nursing are described. The authors discuss the ways in which the gaps between nursing theory, research, and practice are narrowed when development of instruments to measure clinical nursing phenomena are grounded in nursing theory, validated through research and utilized in practice settings.

The adolescent child health and illness profile. A population-based measure of health.

PubMed

Starfield, B; Riley, A W; Green, B F; Ensminger, M E; Ryan, S A; Kelleher, K; Kim-Harris, S; Johnston, D; Vogel, K

1995-05-01

This study was designed to test the reliability and validity of an instrument to assess adolescent health status. Reliability and validity were examined by administration to adolescents (ages 11-17 years) in eight schools in two urban areas, one area in Appalachia, and one area in the rural South. Integrity of the domains and subdomains and construct validity were tested in all areas. Test/retest stability, criterion validity, and convergent and discriminant validity were tested in the two urban areas. Iterative testing has resulted in the final form of the CHIP-AE (Child Health and Illness Profile-Adolescent Edition) having 6 domains with 20 subdomains. The domains are Discomfort, Disorders, Satisfaction with Health, Achievement (of age-appropriate social roles), Risks, and Resilience. Tested aspects of reliability and validity have achieved acceptable levels for all retained subdomains. The CHIP-AE in its current form is suitable for assessing the health status of populations and subpopulations of adolescents. Evidence from test-retest stability analyses suggests that the CHIP-AE also can be used to assess changes occurring over time or in response to health services interventions targeted at groups of adolescents.

Validity and reliability of the Turkish version of the pressure ulcer prevention knowledge assessment instrument.

PubMed

Tulek, Zeliha; Polat, Cansu; Ozkan, Ilknur; Theofanidis, Dimitris; Togrol, Rifat Erdem

2016-11-01

Sound knowledge of pressure ulcers is important to enable good prevention. There are limited instruments assessing pressure ulcer knowledge. The Pressure Ulcer Prevention Knowledge Assessment Instrument is among the scales of which psychometric properties have been studied rigorously and reflects the latest evidence. This study aimed to evaluate the validity and reliability of the Turkish version of the Pressure Ulcer Prevention Knowledge Assessment Instrument (PUPKAI-T), an instrument that assesses knowledge of pressure ulcer prevention by using multiple-choice questions. Linguistic validity was verified through front-to-back translation. Psychometric properties of the instrument were studied on a sample of 150 nurses working in a tertiary hospital in Istanbul, Turkey. The content validity index of the translated instrument was 0.94, intra-class correlation coefficients were between 0.37 and 0.80, item difficulty indices were between 0.21 and 0.88, discrimination indices were 0.20-0.78, and the Kuder Richardson for the internal consistency was 0.803. The PUPKAI-T was found to be a valid and reliable tool to evaluate nurses' knowledge on pressure ulcer prevention. The PUPKAI-T may be a useful tool for determining educational needs of nurses on pressure ulcer prevention. Copyright © 2016 Tissue Viability Society. Published by Elsevier Ltd. All rights reserved.

Developing self-concept instrument for pre-service mathematics teachers

NASA Astrophysics Data System (ADS)

Afgani, M. W.; Suryadi, D.; Dahlan, J. A.

2018-01-01

This study aimed to develop self-concept instrument for undergraduate students of mathematics education in Palembang, Indonesia. Type of this study was development research of non-test instrument in questionnaire form. A Validity test of the instrument was performed with construct validity test by using Pearson product moment and factor analysis, while reliability test used Cronbach’s alpha. The instrument was tested by 65 undergraduate students of mathematics education in one of the universities at Palembang, Indonesia. The instrument consisted of 43 items with 7 aspects of self-concept, that were the individual concern, social identity, individual personality, view of the future, the influence of others who become role models, the influence of the environment inside or outside the classroom, and view of the mathematics. The result of validity test showed there was one invalid item because the value of Pearson’s r was 0.107 less than the critical value (0.244; α = 0.05). The item was included in social identity aspect. After the invalid item was removed, Construct validity test with factor analysis generated only one factor. The Kaiser-Meyer-Olkin (KMO) coefficient was 0.846 and reliability coefficient was 0.91. From that result, we concluded that the self-concept instrument for undergraduate students of mathematics education in Palembang, Indonesia was valid and reliable with 42 items.

Development of the evaluation instrument use CIPP on the implementation of project assessment topic optik

NASA Astrophysics Data System (ADS)

Asfaroh, Jati Aurum; Rosana, Dadan; Supahar

2017-08-01

This research aims to develop an evaluation instrument models CIPP valid and reliable as well as determine the feasibility and practicality of an evaluation instrument models CIPP. An evaluation instrument models CIPP to evaluate the implementation of the project assessment topic optik to measure problem-solving skills of junior high school class VIII in the Yogyakarta region. This research is a model of development that uses 4-D. Subject of product trials are students in class VIII SMP N 1 Galur and SMP N 1 Sleman. Data collection techniques in this research using non-test techniques include interviews, questionnaires and observations. Validity in this research was analyzed using V'Aikens. Reliability analyzed using ICC. This research uses 7 raters are derived from two lecturers expert (expert judgment), two practitioners (science teacher) and three colleagues. The results of this research is the evaluation's instrument model of CIPP is used to evaluate the implementation of the implementation of the project assessment instruments. The validity result of evaluation instrument have V'Aikens values between 0.86 to 1, which means a valid and 0.836 reliability values into categories so well that it has been worth used as an evaluation instrument.

Measuring Primary Teachers' Attitudes Toward Teaching Science: Development of the Dimensions of Attitude Toward Science (DAS) Instrument

NASA Astrophysics Data System (ADS)

van Aalderen-Smeets, Sandra; Walma van der Molen, Juliette

2013-03-01

In this article, we present a valid and reliable instrument which measures the attitude of in-service and pre-service primary teachers toward teaching science, called the Dimensions of Attitude Toward Science (DAS) Instrument. Attention to the attitudes of primary teachers toward teaching science is of fundamental importance to the professionalization of these teachers in the field of primary science education. With the development of this instrument, we sought to fulfill the need for a statistically and theoretically valid and reliable instrument to measure pre-service and in-service teachers' attitudes. The DAS Instrument is based on a comprehensive theoretical framework for attitude toward (teaching) science. After pilot testing, the DAS was revised and subsequently validated using a large group of respondents (pre-service and in-service primary teachers) (N = 556). The theoretical underpinning of the DAS combined with the statistical data indicate that the DAS possesses good construct validity and that it proves to be a promising instrument that can be utilized for research purposes, and also as a teacher training and coaching tool. This instrument can therefore make a valuable contribution to progress within the field of science education.

Validation of Reverse-Engineered and Additive-Manufactured Microsurgical Instrument Prototype.

PubMed

Singh, Ramandeep; Suri, Ashish; Anand, Sneh; Baby, Britty

2016-12-01

With advancements in imaging techniques, neurosurgical procedures are becoming highly precise and minimally invasive, thus demanding development of new ergonomically aesthetic instruments. Conventionally, neurosurgical instruments are manufactured using subtractive manufacturing methods. Such a process is complex, time-consuming, and impractical for prototype development and validation of new designs. Therefore, an alternative design process has been used utilizing blue light scanning, computer-aided designing, and additive manufacturing direct metal laser sintering (DMLS) for microsurgical instrument prototype development. Deviations of DMLS-fabricated instrument were studied by superimposing scan data of fabricated instrument with the computer-aided designing model. Content and concurrent validity of the fabricated prototypes was done by a group of 15 neurosurgeons by performing sciatic nerve anastomosis in small laboratory animals. Comparative scoring was obtained for the control and study instrument. T test was applied to the individual parameters and P values for force (P < .0001) and surface roughness (P < .01) were found to be statistically significant. These 2 parameters were further analyzed using objective measures. Results depicts that additive manufacturing by DMLS provides an effective method for prototype development. However, direct application of these additive-manufactured instruments in the operating room requires further validation. © The Author(s) 2016.

Body surface posture evaluation: construction, validation and protocol of the SPGAP system (Posture evaluation rotating platform system).

PubMed

Schwertner, Debora Soccal; Oliveira, Raul; Mazo, Giovana Zarpellon; Gioda, Fabiane Rosa; Kelber, Christian Roberto; Swarowsky, Alessandra

2016-05-04

Several posture evaluation devices have been used to detect deviations of the vertebral column. However it has been observed that the instruments present measurement errors related to the equipment, environment or measurement protocol. This study aimed to build, validate, analyze the reliability and describe a measurement protocol for the use of the Posture Evaluation Rotating Platform System (SPGAP, Brazilian abbreviation). The posture evaluation system comprises a Posture Evaluation Rotating Platform, video camera, calibration support and measurement software. Two pilot studies were carried out with 102 elderly individuals (average age 69 years old, SD = ±7.3) to establish a protocol for SPGAP, controlling the measurement errors related to the environment, equipment and the person under evaluation. Content validation was completed with input from judges with expertise in posture measurement. The variation coefficient method was used to validate the measurement by the instrument of an object with known dimensions. Finally, reliability was established using repeated measurements of the known object. Expert content judges gave the system excellent ratings for content validity (mean 9.4 out of 10; SD 1.13). The measurement of an object with known dimensions indicated excellent validity (all measurement errors <1 %) and test-retest reliability. A total of 26 images were needed to stabilize the system. Participants in the pilot studies indicated that they felt comfortable throughout the assessment. The use of only one image can offer measurements that underestimate or overestimate the reality. To verify the images of objects with known dimensions the values for the width and height were, respectively, CV 0.88 (width) and 2.33 (height), SD 0.22 (width) and 0.35 (height), minimum and maximum values 24.83-25.2 (width) and 14.56 - 15.75 (height). In the analysis of different images (similar) of an individual, greater discrepancies were observed in the values found. The cervical index, for example, presented minimum and maximum values of 15.38 and 37.5, a coefficient of variation of 0.29 and a standard deviation of 6.78. The SPGAP was shown to be a valid and reliable instrument for the quantitative analysis of body posture with applicability and clinical use, since it managed to reduce several measurement errors, amongst which parallax distortion.

Measurement properties of quality-of-life measurement instruments for infants, children and adolescents with eczema: a systematic review.

PubMed

Heinl, D; Prinsen, C A C; Sach, T; Drucker, A M; Ofenloch, R; Flohr, C; Apfelbacher, C

2017-04-01

Quality of life (QoL) is one of the core outcome domains identified by the Harmonising Outcome Measures for Eczema (HOME) initiative to be assessed in every eczema trial. There is uncertainty about the most appropriate QoL instrument to measure this domain in infants, children and adolescents. To systematically evaluate the measurement properties of existing measurement instruments developed and/or validated for the measurement of QoL in infants, children and adolescents with eczema. A systematic literature search in PubMed and Embase, complemented by a thorough hand search of reference lists, retrieved studies on measurement properties of eczema QoL instruments for infants, children and adolescents. For all eligible studies, we judged the adequacy of the measurement properties and the methodological study quality with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Results from different studies were summarized in a best-evidence synthesis and formed the basis to assign four degrees of recommendation. Seventeen articles, three of which were found by hand search, were included. These 17 articles reported on 24 instruments. No instrument can be recommended for use in all eczema trials because none fulfilled all required adequacy criteria. With adequate internal consistency, reliability and hypothesis testing, the U.S. version of the Childhood Atopic Dermatitis Impact Scale (CADIS), a proxy-reported instrument, has the potential to be recommended depending on the results of further validation studies. All other instruments, including all self-reported ones, lacked significant validation data. Currently, no QoL instrument for infants, children and adolescents with eczema can be highly recommended. Future validation research should primarily focus on the CADIS, but also attempt to broaden the evidence base for the validity of self-reported instruments. © 2016 British Association of Dermatologists.

Development and psychometric testing of a trans-professional evidence-based practice profile questionnaire.

PubMed

McEvoy, Maureen Patricia; Williams, Marie T; Olds, Timothy Stephen

2010-01-01

Previous survey tools operationalising knowledge, attitudes or beliefs about evidence-based practice (EBP) have shortcomings in content, psychometric properties and target audience. This study developed and psychometrically assessed a self-report trans-professional questionnaire to describe an EBP profile. Sixty-six items were collated from existing EBP questionnaires and administered to 526 academics and students from health and non-health backgrounds. Principal component factor analysis revealed the presence of five factors (Relevance, Terminology, Confidence, Practice and Sympathy). Following expert panel review and pilot testing, the 58-item final questionnaire was disseminated to 105 subjects on two occasions. Test-retest and internal reliability were quantified using intra-class correlation coefficients (ICCs) and Cronbach's alpha, convergent validity against a commonly used EBP questionnaire by Pearson's correlation coefficient and discriminative validity via analysis of variance (ANOVA) based on exposure to EBP training. The final questionnaire demonstrated acceptable internal consistency (Cronbach's alpha 0.96), test-retest reliability (ICCs range 0.77-0.94) and convergent validity (Practice 0.66, Confidence 0.80 and Sympathy 0.54). Three factors (Relevance, Terminology and Confidence) distinguished EBP exposure groups (ANOVA p < 0.001-0.004). The evidence-based practice profile (EBP(2)) questionnaire is a reliable instrument with the ability to discriminate for three factors, between respondents with differing EBP exposures.

Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations.

PubMed

Gjersing, Linn; Caplehorn, John R M; Clausen, Thomas

2010-02-10

Research questionnaires are not always translated appropriately before they are used in new temporal, cultural or linguistic settings. The results based on such instruments may therefore not accurately reflect what they are supposed to measure. This paper aims to illustrate the process and required steps involved in the cross-cultural adaptation of a research instrument using the adaptation process of an attitudinal instrument as an example. A questionnaire was needed for the implementation of a study in Norway 2007. There was no appropriate instruments available in Norwegian, thus an Australian-English instrument was cross-culturally adapted. The adaptation process included investigation of conceptual and item equivalence. Two forward and two back-translations were synthesized and compared by an expert committee. Thereafter the instrument was pretested and adjusted accordingly. The final questionnaire was administered to opioid maintenance treatment staff (n=140) and harm reduction staff (n=180). The overall response rate was 84%. The original instrument failed confirmatory analysis. Instead a new two-factor scale was identified and found valid in the new setting. The failure of the original scale highlights the importance of adapting instruments to current research settings. It also emphasizes the importance of ensuring that concepts within an instrument are equal between the original and target language, time and context. If the described stages in the cross-cultural adaptation process had been omitted, the findings would have been misleading, even if presented with apparent precision. Thus, it is important to consider possible barriers when making a direct comparison between different nations, cultures and times.

Validation of Special Sensor Ultraviolet Limb Imager (SSULI) Ionospheric Tomography using ALTAIR Incoherent Scatter Radar Measurements

NASA Astrophysics Data System (ADS)

Dymond, K.; Nicholas, A. C.; Budzien, S. A.; Stephan, A. W.; Coker, C.; Hei, M. A.; Groves, K. M.

2015-12-01

The Special Sensor Ultraviolet Limb Imager (SSULI) instruments are ultraviolet limb scanning sensors flying on the Defense Meteorological Satellite Program (DMSP) satellites. The SSULIs observe the 80-170 nanometer wavelength range covering emissions at 91 and 136 nm, which are produced by radiative recombination of the ionosphere. We invert these emissions tomographically using newly developed algorithms that include optical depth effects due to pure absorption and resonant scattering. We present the details of our approach including how the optimal altitude and along-track sampling were determined and the newly developed approach we are using for regularizing the SSULI tomographic inversions. Finally, we conclude with validations of the SSULI inversions against ALTAIR incoherent scatter radar measurements and demonstrate excellent agreement between the measurements.

A New Method to Cross Calibrate and Validate TOMS, SBUV/2, and SCIAMACHY Measurements

NASA Technical Reports Server (NTRS)

Ahmad, Ziauddin; Hilsenrath, Ernest; Einaudi, Franco (Technical Monitor)

2001-01-01

A unique method to validate back scattered ultraviolet (buv) type satellite data that complements the measurements from existing ground networks is proposed. The method involves comparing the zenith sky radiance measurements from the ground to the nadir radiance measurements taken from space. Since the measurements are compared directly, the proposed method is superior to any other method that involves comparing derived products (for example, ozone), because comparison of derived products involve inversion algorithms which are susceptible to several type of errors. Forward radiative transfer (RT) calculations show that for an aerosol free atmosphere, the ground-based zenith sky radiance measurement and the satellite nadir radiance measurements can be predicted with an accuracy of better than 1 percent. The RT computations also show that for certain values of the solar zenith angles, the radiance comparisons could be better than half a percent. This accuracy is practically independent of ozone amount and aerosols in the atmosphere. Experiences with the Shuttle Solar Backscatter Ultraviolet (SSBUV) program show that the accuracy of the ground-based zenith sky radiance measuring instrument can be maintained at a level of a few tenth of a percent. This implies that the zenith sky radiance measurements can be used to validate Total Ozone Mapping Spectrometer (TOMS), Solar Backscatter Ultraviolet (SBUV/2), and The SCanning Imaging Absorption SpectroMeter for Atmospheric CHartographY (SCIAMACHY) radiance data. Also, this method will help improve the long term precision of the measurements for better trend detection and the accuracy of other BUV products such as tropospheric ozone and aerosols. Finally, in the long term, this method is a good candidate to inter-calibrate and validate long term observations of upcoming operational instruments such as Global Ozone Monitoring Experiment (GOME-2), Ozone Mapping Instrument (OMI), Ozone Dynamics Ultraviolet Spectrometer (ODUS), and Ozone Mapping and Profiler Suite (OMPS).

Psychometrics of the scale of attitudes toward physician-pharmacist collaboration: a study with medical students.

PubMed

Hojat, Mohammadreza; Spandorfer, John; Isenberg, Gerald A; Vergare, Michael J; Fassihi, Reza; Gonnella, Joseph S

2012-01-01

Despite the emphasis placed on interdisciplinary education and interprofessional collaboration between physicians and pharmacologists, no psychometrically sound instrument is available to measure attitudes toward collaborative relationships. This study was designed to examine psychometrics of an instrument for measuring attitudes toward physician-pharmacist collaborative relationships for administration to students in medical and pharmacy schools and to physicians and pharmacists. The Scale of Attitudes Toward Physician-Pharmacist Collaboration was completed by 210 students at Jefferson Medical College. Factor analysis and correlational methods were used to examine psychometrics of the instrument. Consistent with the conceptual framework of interprofessional collaboration, three underlying constructs, namely "responsibility and accountability;" "shared authority;" and "interdisciplinary education" emerged from the factor analysis of the instrument providing support for its construct validity. The reliability coefficient alpha for the instrument was 0.90. The instrument's criterion-related validity coefficient with scores of a validated instrument (Jefferson Scale of Attitudes Toward Physician-Nurse Collaboration) was 0.70. Findings provide support for the validity and reliability of the instrument for medical students. The instrument has the potential to be used for the evaluation of interdisciplinary education in medical and pharmacy schools, and for the evaluation of patient outcomes resulting from collaborative physician-pharmacist relationships.

Misclassification due to age grouping in measures of child development.

PubMed

Veldhuizen, Scott; Rodriguez, Christine; Wade, Terrance J; Cairney, John

2015-03-01

Screens for developmental delay generally provide a set of norms for different age groups. Development varies continuously with age, however, and applying a single criterion for an age range will inevitably produce misclassifications. In this report, we estimate the resulting error rate for one example: the cognitive subscale of the Bayley Scales of Infant and Toddler Development (BSID-III). Data come from a general population sample of 594 children (305 male) aged 1 month to 42.5 months who received the BSID-III as part of a validation study. We used regression models to estimate the mean and variance of the cognitive subscale as a function of age. We then used these results to generate a dataset of one million simulated participants and compared their status before and after division into age groups. Finally, we applied broader age bands used in two other instruments and explored likely validity limitations when different instruments are compared. When BSID-III age groups are used, 15% of cases are missed and 15% of apparent cases are false positives. Wider age groups produced error rates from 27% to 46%. Comparison of different age groups suggests that sensitivity in validation studies would be limited, under certain assumptions, to 70% or less. The use of age groups produces a large number of misclassifications. Although affected children will usually be close to the threshold, this may lead to misreferrals. Results may help to explain the poor measured agreement of development screens. Scoring methods that treat child age as continuous would improve instrument accuracy. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Protective Nursing Advocacy: Translation and Psychometric Evaluation of an Instrument and a Descriptive Study of Swedish Registered Nurse Anesthetists' Beliefs and Actions.

PubMed

Sundqvist, Ann-Sofie; Anderzén-Carlsson, Agneta; Nilsson, Ulrica; Holmefur, Marie

2018-02-01

To translate and adapt the Protective Nursing Advocacy Scale (PNAS) into a Swedish version (PNAS-Swe), evaluate its psychometric properties, and describe registered nurse anesthetists' (RNAs) advocacy beliefs and actions from a protective perspective. A cross-sectional design was used. First, the PNAS was translated into Swedish. Next, the content and construct validity of the PNAS four subscales was evaluated. Finally, the PNAS-Swe was used to describe Swedish RNA beliefs and actions regarding protective nursing advocacy. The final PNAS-Swe has 29 items in four subscales. The RNAs reported that they feel that they should provide protective nursing advocacy for their patients. There were no differences in gender, or associations with age, or work experience regarding their advocacy beliefs or actions. The PNAS-Swe is valid for use in a Swedish context. Protective nursing advocacy is important to the RNAs, which is in congruence with earlier qualitative studies. Copyright © 2016 American Society of PeriAnesthesia Nurses. Published by Elsevier Inc. All rights reserved.

Development and validation of an instrument to measure nurse educator perceived confidence in clinical teaching.

PubMed

Nguyen, Van N B; Forbes, Helen; Mohebbi, Mohammadreza; Duke, Maxine

2017-12-01

Teaching nursing in clinical environments is considered complex and multi-faceted. Little is known about the role of the clinical nurse educator, specifically the challenges related to transition from clinician, or in some cases, from newly-graduated nurse to that of clinical nurse educator, as occurs in developing countries. Confidence in the clinical educator role has been associated with successful transition and the development of role competence. There is currently no valid and reliable instrument to measure clinical nurse educator confidence. This study was conducted to develop and psychometrically test an instrument to measure perceived confidence among clinical nurse educators. A multi-phase, multi-setting survey design was used. A total of 468 surveys were distributed, and 363 were returned. Data were analyzed using exploratory and confirmatory factor analyses. The instrument was successfully tested and modified in phase 1, and factorial validity was subsequently confirmed in phase 2. There was strong evidence of internal consistency, reliability, content, and convergent validity of the Clinical Nurse Educator Skill Acquisition Assessment instrument. The resulting instrument is applicable in similar contexts due to its rigorous development and validation process. © 2017 The Authors. Nursing & Health Sciences published by John Wiley & Sons Australia, Ltd.

Quality of Work: Validation of a New Instrument in Three Languages

PubMed Central

Steffgen, Georges; Kohl, Diane; Reese, Gerhard; Happ, Christian; Sischka, Philipp

2015-01-01

Introduction and objective: A new instrument to measure quality of work was developed in three languages (German, French and Luxembourgish) and validated in a study of employees working in Luxembourg. Methods and results: A representative sample (n = 1529) was taken and exploratory factor analysis revealed a six-factor solution for the 21-item instrument (satisfaction and respect, mobbing, mental strain at work, cooperation, communication and feedback, and appraisal). Reliability analysis showed satisfying reliability for all six factors and the total questionnaire. In order to examine the construct validity of the new instrument, regression analyses were conducted to test whether the instrument predicted work characteristics’ influence on three components of well-being—burnout, psychological stress and maladaptive coping behaviors. Conclusion: The present validation offers a trilingual inventory for measuring quality of work that may be used, for example, as an assessment tool or for testing the effectiveness of interventions. PMID:26703634

Quality of Work: Validation of a New Instrument in Three Languages.

PubMed

Steffgen, Georges; Kohl, Diane; Reese, Gerhard; Happ, Christian; Sischka, Philipp

2015-11-26

A new instrument to measure quality of work was developed in three languages (German, French and Luxembourgish) and validated in a study of employees working in Luxembourg. A representative sample (n = 1529) was taken and exploratory factor analysis revealed a six-factor solution for the 21-item instrument (satisfaction and respect, mobbing, mental strain at work, cooperation, communication and feedback, and appraisal). Reliability analysis showed satisfying reliability for all six factors and the total questionnaire. In order to examine the construct validity of the new instrument, regression analyses were conducted to test whether the instrument predicted work characteristics’ influence on three components of well-being -- burnout, psychological stress and maladaptive coping behaviors. The present validation offers a trilingual inventory for measuring quality of work that may be used, for example, as an assessment tool or for testing the effectiveness of interventions.

Ship Air Wake Detection Using a Small Fixed Wing Unmanned Aerial Vehicle

NASA Astrophysics Data System (ADS)

Phelps, David M.

A ship's air wake is dynamically detected using an airborne inertial measurement unit (IMU) and global positioning system (GPS) attached to a fixed wing unmanned aerial system. A fixed wing unmanned aerial system (UAS) was flown through the air wake created by an underway 108 ft (32.9m) long research vessel in pre designated flight paths. The instrumented aircraft was used to validate computational fluid dynamic (CFD) simulations of naval ship air wakes. Computer models of the research ship and the fixed wing UAS were generated and gridded using NASA's TetrUSS software. Simulations were run using Kestrel, a Department of Defense CFD software to validate the physical experimental data collection method. Air wake simulations were run at various relative wind angles and speeds. The fixed wing UAS was subjected to extensive wind tunnel testing to generate a table of aerodynamic coefficients as a function of control surface deflections, angle of attack and sideslip. The wind tunnel experimental data was compared against similarly structured CFD experiments to validate the grid and model of fixed wing UAS. Finally, a CFD simulation of the fixed wing UAV flying through the generated wake was completed. Forces on the instrumented aircraft were calculated from the data collected by the IMU. Comparison of experimental and simulation data showed that the fixed wing UAS could detect interactions with the ship air wake.

Interview protocols and ergonomics checklist for analysing overexertion back accidents among nursing personnel.

PubMed

Engkvist, I L; Hagberg, M; Wigaeus-Hjelm, E; Menckel, E; Ekenvall, L

1995-06-01

No documented strategy, including preventive strategies, for systematic investigation of overexertion back accidents among nursing personnel has yet been published. One aim of the present study was to develop standardized instruments for the systematic investigation of back accidents among nursing personnel in order to develop preventive strategies. Another aim was to produce a screening tool that could easily be used for identifying potential overexertion back accident hazards. Two structured interview protocols were developed, one for the injured person and one for the supervisor. An ergonomics checklist was designed for the most important spaces according to accident statistics: patient's room, corridor, toilet, and also one for 'other space', eg X-ray and treatment rooms. The instruments were developed by frequent discussions and adjustments in a task force of researchers and occupational health personnel. The protocols were tested in two steps before a final version was established. The construct validity and interobserver reliability of the checklist were tested by ten ergonomists, who checked a patient's room, a toilet and a corridor with some known hazards. The constructed validity agreement was 90% in 19 of 26 items in the checklist. The interobserver reliability had the same figures as the validity for all items in the checklist. The interview protocols and checklist appear to be suitable for systematic investigation of overexertion back accidents.

Adaptation and Validation of the Arabic Version of the Infant Breastfeeding Knowledge Questionnaire among Lebanese Women.

PubMed

Tamim, Hani; Ghandour, Lilian A; Shamsedine, Lama; Charafeddine, Lama; Nasser, Fatima; Khalil, Yvette; Nabulsi, Mona

2016-11-01

Valid instruments that can reliably assess maternal breastfeeding knowledge in Arabic-speaking populations are nonexistent. The availability of such an instrument is essential for investigators working in this field. This study aimed to describe the adaptation and validation of the Arabic Breastfeeding Knowledge Questionnaire (BFK-A) from the original 20-item English version. A translated version of the 20-item BFK was validated among 417 Lebanese women after pilot testing for clarity, comprehension, length, and cultural appropriateness. Exploratory factor analysis was run to examine dimensionality of the instrument and Kuder-Richardson-20 (KR-20) was used to assess its internal consistency. The BFK-A is a unidimensional scale with acceptable internal consistency reliability (KR-20 = 0.652) after the exclusion of 4 items. Higher breastfeeding knowledge levels were strongly and statistically significantly associated with higher mean scores for the validated Arabic Iowa Infant Feeding Attitude Scale ( P < .001), thus confirming its construct validity. The Arabic 16-item BFK-A has an acceptable reliability, similar to the original instrument. Further studies are encouraged to confirm the validity of the 16-item BFK-A among other Arab populations. There is also a need to develop more reliable instruments to use in lactation research in this context.

Computer aided statistical process control for on-line instrumentation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Meils, D.E.

1995-01-01

On-line chemical process instrumentation historically has been used for trending. Recent technological advances in on-line instrumentation have improved the accuracy and reliability of on-line instrumentation. However, little attention has been given to validating and verifying on-line instrumentation. This paper presents two practical approaches for validating instrument performance by comparison of on-line instrument response to either another portable instrument or another bench instrument. Because the comparison of two instruments` performance to each other requires somewhat complex statistical calculations, a computer code (Lab Stats Pack{reg_sign}) is used to simplify the calculations. Lab Stats Pack{reg_sign} also develops control charts that may be usedmore » for continuous verification of on-line instrument performance.« less

Psychometric Validation of the Academic Motivation Scale in a Dental Student Sample.

PubMed

Orsini, Cesar; Binnie, Vivian; Evans, Phillip; Ledezma, Priscilla; Fuentes, Fernando; Villegas, Maria J

2015-08-01

The Academic Motivation Scale is one of the most frequently used instruments to assess academic motivation. It relies on the self-determination theory of human motivation. However, motivation has been understudied in dental education. Therefore, to address the lack of valid instruments to assess academic motivation in dental education and contribute to future research in the field, the aim of this study was to analyze the psychometric properties of this instrument in a sample of dental students. Participants were 989 Chilean undergraduate dental students (86% response rate) who completed a survey containing a Chilean face-valid version of the Spanish Academic Motivation Scale and three other motivation-related instruments to assess the survey's construct and criterion validity. Later, 76 of the students (out of 100 invited) took the survey again to assess its test-retest stability. The instrument's construct validity was supported by the superior goodness of fit of the seven-subscale Academic Motivation Scale over competing models through confirmatory factor analysis and by the expected correlations among its subscales. The concurrent criterion validity was supported by the confirmation of correlations between its subscales and external criteria. Adequate internal consistency and test-retest correlations were also found. The evidence from this study suggests that the Academic Motivation Scale is a preliminarily valid and reliable instrument to assess motivation in the predoctoral dental context. Future research in this area is needed to confirm or refute these results.

Planck 2015 results: XII. Full focal plane simulations

DOE PAGES

Ade, P. A. R.; Aghanim, N.; Arnaud, M.; ...

2016-09-20

In this paper, we present the 8th full focal plane simulation set (FFP8), deployed in support of the Planck 2015 results. FFP8 consists of 10 fiducial mission realizations reduced to 18 144 maps, together with the most massive suite of Monte Carlo realizations of instrument noise and CMB ever generated, comprising 10 4 mission realizations reduced to about 10 6 maps. The resulting maps incorporate the dominant instrumental, scanning, and data analysis effects, and the remaining subdominant effects will be included in future updates. Finally, generated at a cost of some 25 million CPU-hours spread across multiple high-performance-computing (HPC) platforms,more » FFP8 is used to validate and verify analysis algorithms and their implementations, and to remove biases from and quantify uncertainties in the results of analyses of the real data.« less

A systematic review of instruments to assess organizational readiness for knowledge translation in health care.

PubMed

Gagnon, Marie-Pierre; Attieh, Randa; Ghandour, El Kebir; Légaré, France; Ouimet, Mathieu; Estabrooks, Carole A; Grimshaw, Jeremy

2014-01-01

The translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments. We searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments. We found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69%) of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University -ORC (TCU-ORC) scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University - Director version (TCU-ORC-D), reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19%) instruments. Our findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could provide more knowledge on its relevance to diverse clinical contexts.

A Systematic Review of Instruments to Assess Organizational Readiness for Knowledge Translation in Health Care

PubMed Central

Gagnon, Marie-Pierre; Attieh, Randa; Ghandour, El Kebir; Légaré, France; Ouimet, Mathieu; Estabrooks, Carole A.; Grimshaw, Jeremy

2014-01-01

Background The translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments. Methods We searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments. Findings We found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69%) of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University –ORC (TCU-ORC) scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University – Director version (TCU-ORC-D), reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19%) instruments. Conclusion Our findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could provide more knowledge on its relevance to diverse clinical contexts. PMID:25474622

Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1--eliciting concepts for a new PRO instrument.

PubMed

Patrick, Donald L; Burke, Laurie B; Gwaltney, Chad J; Leidy, Nancy Kline; Martin, Mona L; Molsen, Elizabeth; Ring, Lena

2011-12-01

The importance of content validity in developing patient reported outcomes (PRO) instruments is stressed by both the US Food and Drug Administration and the European Medicines Agency. Content validity is the extent to which an instrument measures the important aspects of concepts that developers or users purport it to assess. A PRO instrument measures the concepts most significant and relevant to a patient's condition and its treatment. For PRO instruments, items and domains as reflected in the scores of an instrument should be important to the target population and comprehensive with respect to patient concerns. Documentation of target population input in item generation, as well as evaluation of patient understanding through cognitive interviewing, can provide the evidence for content validity. Developing content for, and assessing respondent understanding of, newly developed PRO instruments for medical product evaluation will be discussed in this two-part ISPOR PRO Good Research Practices Task Force Report. Topics include the methods for generating items, documenting item development, coding of qualitative data from item generation, cognitive interviewing, and tracking item development through the various stages of research and preparing this tracking for submission to regulatory agencies. Part 1 covers elicitation of key concepts using qualitative focus groups and/or interviews to inform content and structure of a new PRO instrument. Part 2 covers the instrument development process, the assessment of patient understanding of the draft instrument using cognitive interviews and steps for instrument revision. The two parts are meant to be read together. They are intended to offer suggestions for good practices in planning, executing, and documenting qualitative studies that are used to support the content validity of PRO instruments to be used in medical product evaluation. Copyright © 2011 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Clinical practice guidelines for the management of pregnancy in women with autoimmune rheumatic diseases of the Mexican College of Rheumatology. Part I.

PubMed

Saavedra Salinas, Miguel Ángel; Barrera Cruz, Antonio; Cabral Castañeda, Antonio Rafael; Jara Quezada, Luis Javier; Arce-Salinas, C Alejandro; Álvarez Nemegyei, José; Fraga Mouret, Antonio; Orozco Alcalá, Javier; Salazar Páramo, Mario; Cruz Reyes, Claudia Verónica; Andrade Ortega, Lilia; Vera Lastra, Olga Lidia; Mendoza Pinto, Claudia; Sánchez González, Antonio; Cruz Cruz, Polita Del Rocío; Morales Hernández, Sara; Portela Hernández, Margarita; Pérez Cristóbal, Mario; Medina García, Gabriela; Hernández Romero, Noé; Velarde Ochoa, María Del Carmen; Navarro Zarza, José Eduardo; Portillo Díaz, Verónica; Vargas Guerrero, Angélica; Goycochea Robles, María Victoria; García Figueroa, José Luis; Barreira Mercado, Eduardo; Amigo Castañeda, Mary Carmen

2015-01-01

Pregnancy in women with autoimmune rheumatic diseases is associated with several maternal and fetal complications. The development of clinical practice guidelines with the best available scientific evidence may help standardize the care of these patients. To provide recommendations regarding prenatal care, treatment, and a more effective monitoring of pregnancy in women with lupus erythematosus (SLE), rheumatoid arthritis (RA) and antiphospholipid antibody syndrome (APS). Nominal panels were formed for consensus, systematic search of information, development of clinical questions, processing and grading of recommendations, internal validation by peers, and external validation of the final document. The quality criteria of the AGREE II instrument were followed. The various panels answered the 37 questions related to maternal and fetal care in SLE, RA, and APS, as well as to the use of antirheumatic drugs during pregnancy and lactation. The recommendations were discussed and integrated into a final manuscript. Finally, the corresponding algorithms were developed. We present the recommendations for pregnant women with SLE in this first part. We believe that the Mexican clinical practice guidelines for the management of pregnancy in women with SLE integrate the best available evidence for the treatment and follow-up of patients with these conditions. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

Development and validation of a patient-reported outcome measure for stroke patients.

PubMed

Luo, Yanhong; Yang, Jie; Zhang, Yanbo

2015-05-08

Family support and patient satisfaction with treatment are crucial for aiding in the recovery from stroke. However, current validated stroke-specific questionnaires may not adequately capture the impact of these two variables on patients undergoing clinical trials of new drugs. Therefore, the aim of this study was to develop and evaluate a new stroke patient-reported outcome measure (Stroke-PROM) instrument for capturing more comprehensive effects of stroke on patients participating in clinical trials of new drugs. A conceptual framework and a pool of items for the preliminary Stroke-PROM were generated by consulting the relevant literature and other questionnaires created in China and other countries, and interviewing 20 patients and 4 experts to ensure that all germane parameters were included. During the first item-selection phase, classical test theory and item response theory were applied to an initial scale completed by 133 patients with stroke. During the item-revaluation phase, classical test theory and item response theory were used again, this time with 475 patients with stroke and 104 healthy participants. During the scale assessment phase, confirmatory factor analysis was applied to the final scale of the Stroke-PROM using the same study population as in the second item-selection phase. Reliability, validity, responsiveness and feasibility of the final scale were tested. The final scale of Stroke-PROM contained 46 items describing four domains (physiology, psychology, society and treatment). These four domains were subdivided into 10 subdomains. Cronbach's α coefficients for the four domains ranged from 0.861 to 0.908. Confirmatory factor analysis supported the validity of the final scale, and the model fit index satisfied the criterion. Differences in the Stroke-PROM mean scores were significant between patients with stroke and healthy participants in nine subdomains (P < 0.001), indicating that the scale showed good responsiveness. The Stroke-PROM is a patient-reported outcome multidimensional questionnaire developed especially for clinical trials of new drugs and is focused on issues of family support and patient satisfaction with treatment. Extensive data analyses supported the validity, reliability and responsiveness of the Stroke-PROM.

Self-management in chronic conditions: partners in health scale instrument validation.

PubMed

Peñarrieta-de Córdova, Isabel; Barrios, Flores Florabel; Gutierrez-Gomes, Tranquilina; Piñonez-Martinez, Ma del Socorro; Quintero-Valle, Luz Maria; Castañeda-Hidalgo, Hortensia

2014-03-01

This article describes a study that aimed to validate the Self-care in Chronic Conditions Partners in Health Scale instrument in the Mexican population. The instrument has been validated in Australia for use as a screening tool by primary healthcare professionals to assess the self-care skills and abilities of people with a chronic illness. Validation was conducted using baseline data for 552 people with diabetes, hypertension and cancer aged 18 or older who were users of healthcare centres in Tampico, Tamaulipas, Mexico. Results show high reliability and validity of the instrument and three themes were identified: knowledge, adherence, and dealing with and managing side effects. The findings suggest the scale is useful as a generic self-rated clinical tool for assessing self-management in a range of chronic conditions, and provides an outcome measure for comparing populations and change in patient self-management knowledge and behaviour. The authors recommend validating the scale in other Latin-American settings with more research into the effect of gender on self- management.

Reliability and validity: Part II.

PubMed

Davis, Debora Winders

2004-01-01

Determining measurement reliability and validity involves complex processes. There is usually room for argument about most instruments. It is important that the researcher clearly describes the processes upon which she made the decision to use a particular instrument, and presents the evidence available showing that the instrument is reliable and valid for the current purposes. In some cases, the researcher may need to conduct pilot studies to obtain evidence upon which to decide whether the instrument is valid for a new population or a different setting. In all cases, the researcher must present a clear and complete explanation for the choices, she has made regarding reliability and validity. The consumer must then judge the degree to which the researcher has provided adequate and theoretically sound rationale. Although I have tried to touch on most of the important concepts related to measurement reliability and validity, it is beyond the scope of this column to be exhaustive. There are textbooks devoted entirely to specific measurement issues if readers require more in-depth knowledge.

Socially supportive activity inventory: reliability and validity of a social activity instrument for long-term care institutions.

PubMed

Hsu, Ya-Chuan

2011-09-01

: Diverse social and recreational activities in elder care institutions have been provided to enrich a person's mental well-being amidst what is a relatively monotonous life. However, few instruments that measure the social activities of long-term care residents are available. : This study was designed to develop a culturally sensitive instrument (Socially Supportive Activity Inventory, SSAI) to assess quantity and quality of social activities for long-term care institutions and validate the instrument's psychometric properties. : The SSAI was developed on the basis of the social support theory, a synthesis of literature, and Taiwanese cultural mores. The instrument was rigorously subjected to a two-stage process to evaluate its reliability and validity. In Stage 1, six experts from diverse backgrounds were recruited to evaluate instrument items and estimate the content validity of the instrument using a content validity questionnaire. Items were modified and refined on the basis of the responses of the expert panel and a set of criteria. After obtaining approval from a university institutional review board, in the second stage of evaluating test-retest reliability, a convenience sample of 10 Taiwanese institutionalized elders in a pilot study, recruited from a nursing home, completed the revised instrument at two separate times over 2 weeks. : Results showed a content validity of .96. Test-retest reliability from a sample of 10 participants yielded stability coefficients of .76-1.00. The stability coefficient was 1.00 for the component of frequency, .76-1.00 for the component of meaningfulness, and .78-1.00 for the component of enjoyment. : The SSAI is a highly relevant and reliable culturally based instrument that can measure social activity in long-term care facilities. Because of the pilot nature of this study, future directions include further exploration of the SSAI instrument's psychometric properties. This should be done by enlarging the sample size to include more long-term care facilities and individual participants. Future studies can utilize diverse measures of social activity for comparison and validation of the SSAI.

Development and psychometric testing of the Attitudes, Subjective Norms, Perceived Behavioural Control, and Intention to Pursue a Career in Mental Health Nursing scale.

PubMed

Wilbourn, Mark; Salamonson, Yenna; Ramjan, Lucie; Chang, Sungwon

2018-02-01

The aim of the present study was to develop and test the psychometric properties of the Attitudes, Subjective Norms, Perceived Behavioural Control, and Intention to Pursue a Career in Mental Health Nursing (ASPIRE) scale, an instrument to assess nursing students' intention to work in mental health nursing. Understanding the factors influencing undergraduate nursing students' career intentions might lead to improved recruitment strategies. However, there are no standardized tools to measure and assess students' intention to pursue a career in mental health nursing. The present study used a cross-sectional survey design undertaken at a large tertiary institution in Western Sydney (Australia) between May and August 2013. It comprised three distinct and sequential phases: (i) items were generated representing the four dimensions of the theory of planned behaviour; (ii) face and content validity were tested by a representative reference group and panel of experts; and (iii) survey data from 1109 first- and second-year and 619 third-year students were used in exploratory and confirmatory factor analyses to test the factorial validity of the scale. Internal consistency was measured using Cronbach's alpha. Items generated for the ASPIRE scale were subject to face and content validity testing. Results showed good factorial validity and reliability for the final 14-item scale. Principal axis factoring revealed a one-factor solution, the hypothesized model being supported by confirmatory factor analysis. The ASPIRE scale is a valid and reliable instrument for measuring intention to pursue a career in mental health nursing among Bachelor of Nursing students. © 2017 Australian College of Mental Health Nurses Inc.

Translation and validation of Pediatric Quality of Life Inventory™ 3.0 Diabetes Module (PedsQL™ 3.0 Diabetes Module) in Brazil-Portuguese language.

PubMed

Garcia, Leila F Dos S; Manna, Thais Della; Passone, Caroline de Gouveia Buff; Oliveira, Lygia Spassapan de

2017-11-14

The aim of the present study was to create a translated version of the Pediatric Quality of Life Inventory™ 3.0 Diabetes Module (PedsQL™ 3.0 Diabetes Module) in Brazilian Portuguese that was conceptually equivalent to the original American English version and to linguistically validate it in a Brazilian pediatric population with type 1 diabetes mellitus and their parents or caregivers. The instrument was translated, back-translated, and then administered to 83 children/adolescents (5-18 years) with type 1 diabetes mellitus and their family members and to 25 parents/caregivers of patients aged between 2 and 4 years. The final translated version was tested for reliability by analyzing internal consistency, intraobserver (test-retest) reliability, and concurrent validity. Cronbach's alpha coefficient for the total score of the questionnaires of children/adolescents (α=0.85) and their parents (α=0.82) was above the recommended minimum of 0.70 for group comparisons. Intraobserver reliability and concurrent validity exhibited a significant positive correlation (p<0.001), indicating the reliability of the translated instrument. A moderate but significant positive correlation (r=0.40; p<0.001) was demonstrated between the total scores of patient self-report and parent proxy-report scales. There was no significant correlation between glycated hemoglobin (HbA1c) levels and the respective scores in the questionnaires answered by patients and their parents/caregivers. The analysis of the translated version of the PedsQL™ 3.0 Diabetes Module revealed adequate psychometric characteristics with respect to reliability and validity following administration to a sample of Brazilian children/adolescents with type 1 diabetes mellitus and their caregivers. Copyright © 2017. Published by Elsevier Editora Ltda.

Validity and reliability of Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments in Osteoarthritis

PubMed Central

Broderick, Joan E.; Schneider, Stefan; Junghaenel, Doerte U.; Schwartz, Joseph E.; Stone, Arthur A.

2013-01-01

Objective Evaluation of known group validity, ecological validity, and test-retest reliability of four domain instruments from the Patient Reported Outcomes Measurement System (PROMIS) in osteoarthritis (OA) patients. Methods Recruitment of an osteoarthritis sample and a comparison general population (GP) through an Internet survey panel. Pain intensity, pain interference, physical functioning, and fatigue were assessed for 4 consecutive weeks with PROMIS short forms on a daily basis and compared with same-domain Computer Adaptive Test (CAT) instruments that use a 7-day recall. Known group validity (comparison of OA and GP), ecological validity (comparison of aggregated daily measures with CATs), and test-retest reliability were evaluated. Results The recruited samples matched (age, sex, race, ethnicity) the demographic characteristics of the U.S. sample for arthritis and the 2009 Census for the GP. Compliance with repeated measurements was excellent: > 95%. Known group validity for CATs was demonstrated with large effect sizes (pain intensity: 1.42, pain interference: 1.25, and fatigue: .85). Ecological validity was also established through high correlations between aggregated daily measures and weekly CATs (≥ .86). Test-retest validity (7-day) was very good (≥ .80). Conclusion PROMIS CAT instruments demonstrated known group and ecological validity in a comparison of osteoarthritis patients with a general population sample. Adequate test-retest reliability was also observed. These data provide encouraging initial data on the utility of these PROMIS instruments for clinical and research outcomes in osteoarthritis patients. PMID:23592494

Older adult mistreatment risk screening: contribution to the validation of a screening tool in a domestic setting.

PubMed

Lindenbach, Jeannette M; Larocque, Sylvie; Lavoie, Anne-Marise; Garceau, Marie-Luce

2012-06-01

ABSTRACTThe hidden nature of older adult mistreatment renders its detection in the domestic setting particularly challenging. A validated screening instrument that can provide a systematic assessment of risk factors can facilitate this detection. One such instrument, the "expanded Indicators of Abuse" tool, has been previously validated in the Hebrew language in a hospital setting. The present study has contributed to the validation of the "e-IOA" in an English-speaking community setting in Ontario, Canada. It consisted of two phases: (a) a content validity review and adaptation of the instrument by experts throughout Ontario, and (b) an inter-rater reliability assessment by home visiting nurses. The adaptation, the "Mistreatment of Older Adult Risk Factors" tool, offers a comprehensive tool for screening in the home setting. This instrument is significant to professional practice as practitioners working with older adults will be better equipped to assess for risk of mistreatment.

Instructional Interactions of Kindergarten Mathematics Classrooms: Validating a Direct Observation Instrument

ERIC Educational Resources Information Center

Doabler, Christian; Smolkowski, Keith; Fien, Hank; Kosty, Derek B.; Cary, Mari Strand

2010-01-01

In this paper, the authors report research focused directly on the validation of the Coding of Academic Teacher-Student interactions (CATS) direct observation instrument. They use classroom information gathered by the CATS instrument to better understand the potential mediating variables hypothesized to influence student achievement. Their study's…

Multitrait-Multimethod Analyses of Two Self-Concept Instruments.

ERIC Educational Resources Information Center

Marsh, Herbert W.; Smith, Ian D.

1982-01-01

The multidimensionality of self-concept and the use of factor analysis in the development of self-concept instruments are supported in multitrait-multimethod analyses of the Sears and Coopersmith instruments. Convergent validity and discriminate validity of subscales in factor analysis and multitrait-multimethod analysis of longitudinal data are…

Nursing Intensive-Care Satisfaction Scale [NICSS]: Development and validation of a patient-centred instrument.

PubMed

Romero-García, Marta; de la Cueva-Ariza, Laura; Benito-Aracil, Llucia; Lluch-Canut, Teresa; Trujols-Albet, Joan; Martínez-Momblan, Maria Antonia; Juvé-Udina, Maria-Eulàlia; Delgado-Hito, Pilar

2018-06-01

The aim of this study was to develop and validate the Nursing Intensive-Care Satisfaction Scale to measures satisfaction with nursing care from the critical care patient's perspective. Instruments that measure satisfaction with nursing cares have been designed and validated without taking the patient's perspective into consideration. Despite the benefits and advances in measuring satisfaction with nursing care, none instrument is specifically designed to assess satisfaction in intensive care units. Instrument development. The population were all discharged patients (January 2013 - January 2015) from three Intensive Care Units of a third level hospital (N = 200). All assessment instruments were given to discharged patients and 48 hours later, to analyse the temporal stability, only the questionnaire was given again. The validation process of the scale included the analysis of internal consistency, temporal stability; validity of construct through a confirmatory factor analysis; and criterion validity. Reliability was 0.95. The intraclass correlation coefficient for the total scale was 0.83 indicating a good temporal stability. Construct validity showed an acceptable fit and factorial structure with four factors, in accordance with the theoretical model, being Consequences factor the best correlated with other factors. Criterion validity, presented a correlation between low and high (range: 0.42-0.68). The scale has been designed and validated incorporating the perspective of critical care patients. Thanks to its reliability and validity, this questionnaire can be used both in research and in clinical practice. The scale offers a possibility to assess and develop interventions to improve patient satisfaction with nursing care. © 2018 John Wiley & Sons Ltd.

Development and validation of the Simulation Learning Effectiveness Scale for nursing students.

PubMed

Pai, Hsiang-Chu

2016-11-01

To develop and validate the Simulation Learning Effectiveness Scale, which is based on Bandura's social cognitive theory. A simulation programme is a significant teaching strategy for nursing students. Nevertheless, there are few evidence-based instruments that validate the effectiveness of simulation learning in Taiwan. This is a quantitative descriptive design. In Study 1, a nonprobability convenience sample of 151 student nurses completed the Simulation Learning Effectiveness Scale. Exploratory factor analysis was used to examine the factor structure of the instrument. In Study 2, which involved 365 student nurses, confirmatory factor analysis and structural equation modelling were used to analyse the construct validity of the Simulation Learning Effectiveness Scale. In Study 1, exploratory factor analysis yielded three components: self-regulation, self-efficacy and self-motivation. The three factors explained 29·09, 27·74 and 19·32% of the variance, respectively. The final 12-item instrument with the three factors explained 76·15% of variance. Cronbach's alpha was 0·94. In Study 2, confirmatory factor analysis identified a second-order factor termed Simulation Learning Effectiveness Scale. Goodness-of-fit indices showed an acceptable fit overall with the full model (χ 2 /df (51) = 3·54, comparative fit index = 0·96, Tucker-Lewis index = 0·95 and standardised root-mean-square residual = 0·035). In addition, teacher's competence was found to encourage learning, and self-reflection and insight were significantly and positively associated with Simulation Learning Effectiveness Scale. Teacher's competence in encouraging learning also was significantly and positively associated with self-reflection and insight. Overall, theses variable explained 21·9% of the variance in the student's learning effectiveness. The Simulation Learning Effectiveness Scale is a reliable and valid means to assess simulation learning effectiveness for nursing students. The Simulation Learning Effectiveness Scale can be used to examine nursing students' learning effectiveness and serve as a basis to improve student's learning efficiency through simulation programmes. Future implementation research that focuses on the relationship between learning effectiveness and nursing competence in nursing students is recommended. © 2016 John Wiley & Sons Ltd.

Modification and Evaluation of a Velopharyngeal Insufficiency Quality of Life Instrument

PubMed Central

Skirko, Jonathan R.; Weaver, Edward M; Perkins, Jonathan; Kinter, Sara; Sie, Kathleen C.Y.

2018-01-01

Objective Modify the existing 45-item velopharyngeal insufficiency (VPI) quality of life (QOL) instrument (VPIQL), assess the modified instrument for reliability and provide further validation. There are patient and parent versions of the instrument. Design Validation convenience sample from a previously conducted pilot study. Setting Two academic tertiary referral medical centers. Participants De-identified data were used from 29 subjects with VPI and 29 control subjects age 5–17 years, and parents. Outcome measures Subjects and parents completed VPIQL and a generic pediatric QOL instrument (PedsQL4-0). Data Analysis Twenty-two items were removed from the VPIQL for ceiling effects, floor effects, and redundancy, to produce the modified instrument, VPI Effects on Life Outcomes (VELO) instrument. VELO was tested for internal consistency (Chronbach’s alpha), discriminant validity (paired t-test with control subjects), and concurrent validity (Pearson correlation with the PedsQL4-0). These analyses were also completed for parents. Results The 45-item VPIQL instrument was reduced to the 23-item VELO instrument. The VELO had excellent internal consistency (Chronbach’s alpha 0.96 for parents and 0.95 for VPI subjects). The VELO discriminated well between VPI and control subjects, with mean score (SD) was significantly lower (worse) for VPI subjects (67.6 [23.9]) than for control subjects (97.0 [5.2]) (p<0.0001). The VELO total score was significantly correlated with the PedsQL4.0 (r=0.73) among subjects with VPI. Similar results were seen in parent responses. Conclusions The VELO is a 23-item QOL instrument that was designed to measure and follow QOL in subjects with VPI, with less burden than the original VPIQL. VELO demonstrates internal consistency, disciminant validty, and concurrent validity with the PedsQL4-0. PMID:23069823

Reliability and validity in a nutshell.

PubMed

Bannigan, Katrina; Watson, Roger

2009-12-01

To explore and explain the different concepts of reliability and validity as they are related to measurement instruments in social science and health care. There are different concepts contained in the terms reliability and validity and these are often explained poorly and there is often confusion between them. To develop some clarity about reliability and validity a conceptual framework was built based on the existing literature. The concepts of reliability, validity and utility are explored and explained. Reliability contains the concepts of internal consistency and stability and equivalence. Validity contains the concepts of content, face, criterion, concurrent, predictive, construct, convergent (and divergent), factorial and discriminant. In addition, for clinical practice and research, it is essential to establish the utility of a measurement instrument. To use measurement instruments appropriately in clinical practice, the extent to which they are reliable, valid and usable must be established.

[Some critical remarks on standardised assessment instruments in nursing].

PubMed

Bartholomeyczik, Sabine

2007-08-01

The use of standardised instruments in nursing has rapidly grown and can be seen as a symptom of the necessary comprehensive nursing diagnostics. However, these instruments comprise the risk of misuse, if they are not critically evaluated. Published statements about tests of reliability and validity of an instrument are insufficient. First, the critical evaluation has to ask for the instrument's theoretical and content base: Is the instrument relevant for nursing, suitable for practice and leading to nursing actions? Two examples of well known instruments and different kinds of their utilization in nursing are discussed. Next, the instruments have to be questioned as "bodies with numbers". Studies on reliability and validity have to be as carefully evaluated as other empirical research. The sample, the suitability of agreement indicators (interraterreliability), kind and reason of tests have to be questioned. The same has to be done with tests of validity which comprise an even greater challenge. Methodological studies about these questions are missing; guidelines for test user qualifications need to be developed.

A Compact Optical Instrument with Artificial Neural Network for pH Determination

PubMed Central

Capel-Cuevas, Sonia; López-Ruiz, Nuria; Martinez-Olmos, Antonio; Cuéllar, Manuel P.; Pegalajar, Maria del Carmen; Palma, Alberto José; de Orbe-Payá, Ignacio; Capitán-Vallvey, Luis Fermin

2012-01-01

The aim of this work was the determination of pH with a sensor array-based optical portable instrument. This sensor array consists of eleven membranes with selective colour changes at different pH intervals. The method for the pH calculation is based on the implementation of artificial neural networks that use the responses of the membranes to generate a final pH value. A multi-objective algorithm was used to select the minimum number of sensing elements required to achieve an accurate pH determination from the neural network, and also to minimise the network size. This helps to minimise instrument and array development costs and save on microprocessor energy consumption. A set of artificial neural networks that fulfils these requirements is proposed using different combinations of the membranes in the sensor array, and is evaluated in terms of accuracy and reliability. In the end, the network including the response of the eleven membranes in the sensor was selected for validation in the instrument prototype because of its high accuracy. The performance of the instrument was evaluated by measuring the pH of a large set of real samples, showing that high precision can be obtained in the full range. PMID:22778668

Levels at gaging stations

USGS Publications Warehouse

Kenney, Terry A.

2010-01-01

Operational procedures at U.S. Geological Survey gaging stations include periodic leveling checks to ensure that gages are accurately set to the established gage datum. Differential leveling techniques are used to determine elevations for reference marks, reference points, all gages, and the water surface. The techniques presented in this manual provide guidance on instruments and methods that ensure gaging-station levels are run to both a high precision and accuracy. Levels are run at gaging stations whenever differences in gage readings are unresolved, stations may have been damaged, or according to a pre-determined frequency. Engineer's levels, both optical levels and electronic digital levels, are commonly used for gaging-station levels. Collimation tests should be run at least once a week for any week that levels are run, and the absolute value of the collimation error cannot exceed 0.003 foot/100 feet (ft). An acceptable set of gaging-station levels consists of a minimum of two foresights, each from a different instrument height, taken on at least two independent reference marks, all reference points, all gages, and the water surface. The initial instrument height is determined from another independent reference mark, known as the origin, or base reference mark. The absolute value of the closure error of a leveling circuit must be less than or equal to ft, where n is the total number of instrument setups, and may not exceed |0.015| ft regardless of the number of instrument setups. Closure error for a leveling circuit is distributed by instrument setup and adjusted elevations are determined. Side shots in a level circuit are assessed by examining the differences between the adjusted first and second elevations for each objective point in the circuit. The absolute value of these differences must be less than or equal to 0.005 ft. Final elevations for objective points are determined by averaging the valid adjusted first and second elevations. If final elevations indicate that the reference gage is off by |0.015| ft or more, it must be reset.

Selecting relevant and feasible measurement instruments for the revised Dutch clinical practice guideline for physical therapy in patients after stroke.

PubMed

Otterman, Nicoline; Veerbeek, Janne; Schiemanck, Sven; van der Wees, Philip; Nollet, Frans; Kwakkel, Gert

2017-07-01

To select relevant and feasible instruments for the revision of the Dutch clinical practice guideline for physical therapy in patients with stroke. In this implementation study a comprehensive proposal for ICF categories and matching instruments was developed, based on reliability and validity. Relevant instruments were then selected in a consensus round by 11 knowledge brokers who were responsible for the implementation of the selected instruments. The feasibility of the selected instruments was tested by 36 physical therapists at different work settings within stroke services. Finally, instruments that were deemed relevant and feasible were included in the revised guideline. A total of 28 instruments were recommended for inclusion in the revised guideline. Nineteen instruments were retained from the previous guideline. Ten new instruments were tested in clinical practice, seven of which were found feasible. Two more instruments were added after critical appraisal of the set of the measurement instruments. The revised guideline contains 28 relevant and feasible instrument selected and tested in clinical practice by physical therapists. Further education and implementation is needed to integrate instruments in clinical practice. Further research is proposed for developing and implementing a core set of measurement instruments to be used at fixed time points to establish data registries that allow for continuous improvement of rehabilitation for stroke patients. Implications for Rehabilitation The revised Dutch Stroke Physical Therapy Guideline recommends a total of 28 instruments, that are relevant and feasible for clinical practice of physical therapist in the different settings of stroke rehabilitation. The selection of instrument in daily practice should be part of the clinical reasoning process of PTs and be tailored to individual patients' needs and the degree of priority of the affected ICF category. Suggested education strategies for further integration of instruments in of the daily practice of PTs in Stroke Rehabilitation are: 'Training on the job' and 'peer assessment in clinical situations'.

[A new instrument to measure quality of life in older people: The French version of the WHOQOL-OLD].

PubMed

Leplège, A; Perret-Guillaume, C; Ecosse, E; Hervy, M-P; Ankri, J; von Steinbüchel, N

2013-02-01

We present the validation data of the French version of a new quality of life questionnaire, specifically developed for use with older adults (>60 years old): the WHOQOL-OLD module. This questionnaire, which contains 24 items in six domains, is a complementary module of the WHOQOL-BREF quality of life questionnaire. It was internationally developed by a World Health Organization (WHO) group. The first development and pilot studies led to a first questionnaire applied in field studies in 20 centers all over the world. They were done in 5566 subjects and allowed the validation of the final form of the WHOQOL-OLD questionnaire. For its French version, 281 subjects, with a mean age of 74 years, were recruited in three centers (Paris, Nancy and Geneva). The results of the psychometric properties of the questionnaire, particularly the multitrait analysis, are compatible with the assumptions underlying the construction of scores. Otherwise, scores present a sufficient accuracy to use this instrument in group comparisons. The WHOQOL-OLD questionnaire can be used in older people in health services, clinical research and epidemiologic studies. Copyright © 2012. Published by Elsevier SAS.