Assessing the Validity of an Annual Survey for Measuring the Enacted Literacy Curriculum

ERIC Educational Resources Information Center

Camburn, Eric M.; Han, Seong Won; Sebastian, James

2017-01-01

Surveys are frequently used to inform consequential decisions about teachers, policies, and programs. Consequently, it is important to understand the validity of these instruments. This study assesses the validity of measures of instruction captured by an annual survey by comparing survey data with those of a validated daily log. The two…

Validation of Yoon's Critical Thinking Disposition Instrument.

PubMed

Shin, Hyunsook; Park, Chang Gi; Kim, Hyojin

2015-12-01

The lack of reliable and valid evaluation tools targeting Korean nursing students' critical thinking (CT) abilities has been reported as one of the barriers to instructing and evaluating students in undergraduate programs. Yoon's Critical Thinking Disposition (YCTD) instrument was developed for Korean nursing students, but few studies have assessed its validity. This study aimed to validate the YCTD. Specifically, the YCTD was assessed to identify its cross-sectional and longitudinal measurement invariance. This was a validation study in which a cross-sectional and longitudinal (prenursing and postnursing practicum) survey was used to validate the YCTD using 345 nursing students at three universities in Seoul, Korea. The participants' CT abilities were assessed using the YCTD before and after completing an established pediatric nursing practicum. The validity of the YCTD was estimated and then group invariance test using multigroup confirmatory factor analysis was performed to confirm the measurement compatibility of multigroups. A test of the seven-factor model showed that the YCTD demonstrated good construct validity. Multigroup confirmatory factor analysis findings for the measurement invariance suggested that this model structure demonstrated strong invariance between groups (i.e., configural, factor loading, and intercept combined) but weak invariance within a group (i.e., configural and factor loading combined). In general, traditional methods for assessing instrument validity have been less than thorough. In this study, multigroup confirmatory factor analysis using cross-sectional and longitudinal measurement data allowed validation of the YCTD. This study concluded that the YCTD can be used for evaluating Korean nursing students' CT abilities. Copyright © 2015. Published by Elsevier B.V.

Development and validation of an instrument to measure nurse educator perceived confidence in clinical teaching.

PubMed

Nguyen, Van N B; Forbes, Helen; Mohebbi, Mohammadreza; Duke, Maxine

2017-12-01

Teaching nursing in clinical environments is considered complex and multi-faceted. Little is known about the role of the clinical nurse educator, specifically the challenges related to transition from clinician, or in some cases, from newly-graduated nurse to that of clinical nurse educator, as occurs in developing countries. Confidence in the clinical educator role has been associated with successful transition and the development of role competence. There is currently no valid and reliable instrument to measure clinical nurse educator confidence. This study was conducted to develop and psychometrically test an instrument to measure perceived confidence among clinical nurse educators. A multi-phase, multi-setting survey design was used. A total of 468 surveys were distributed, and 363 were returned. Data were analyzed using exploratory and confirmatory factor analyses. The instrument was successfully tested and modified in phase 1, and factorial validity was subsequently confirmed in phase 2. There was strong evidence of internal consistency, reliability, content, and convergent validity of the Clinical Nurse Educator Skill Acquisition Assessment instrument. The resulting instrument is applicable in similar contexts due to its rigorous development and validation process. © 2017 The Authors. Nursing & Health Sciences published by John Wiley & Sons Australia, Ltd.

Empirical Validation and Application of the Computing Attitudes Survey

ERIC Educational Resources Information Center

Dorn, Brian; Elliott Tew, Allison

2015-01-01

Student attitudes play an important role in shaping learning experiences. However, few validated instruments exist for measuring student attitude development in a discipline-specific way. In this paper, we present the design, development, and validation of the computing attitudes survey (CAS). The CAS is an extension of the Colorado Learning…

Validation of an instrument for mathematics enhancement teaching efficacy of Pacific Northwest agricultural educators

NASA Astrophysics Data System (ADS)

Jansen, Daniel J.

Teacher efficacy continues to be an important area of study in educational research. This study tested an instrument designed to assess the perceived efficacy of agricultural education teachers when engaged in lessons involving mathematics instruction. The study population of Oregon and Washington agricultural educators utilized in the validation of the instrument revealed important demographic findings and specific results related to teacher efficacy for the study population. An instrument was developed from the assimilation of three scales previously used and validated in efficacy research. Participants' mathematics teaching efficacy was assessed using a portion of the Mathematics Teaching Efficacy Beliefs Instrument (MTEBI), and personal mathematics efficacy was evaluated by the mathematics self-belief instrument which was derived from the Betz and Hackett's Mathematics Self-Efficacy Scale. The final scale, the Teachers' Sense of Efficacy Scale (TSES) created by Tschannen-Moran and Woolfolk Hoy, examined perceived personal teaching efficacy. Structural equation modeling was used as the statistical analyses tool to validate the instrument and examine correlations between efficacy constructs used to determine potential professional development needs of the survey population. As part of the data required for validation of the Mathematics Enhancement Teaching Efficacy instrument, demographic information defining the population of Oregon and Washington agricultural educators was obtained and reported. A hypothetical model derived from teacher efficacy literature was found to be an acceptable model to verify construct validity and determine strength of correlations between the scales that defined the instrument. The instrument produced an alpha coefficient of .905 for reliability. Both exploratory and confirmatory factor analyses were used to verify construct and discriminate validity. Specifics results related to the survey population of agricultural educators

The Online Student Connectedness Survey: Evidence of Initial Construct Validity

ERIC Educational Resources Information Center

Zimmerman, Tekeisha; Nimon, Kim

2017-01-01

The Online Student Connectedness Survey (OSCS) was introduced to the academic community in 2012 as an instrument designed to measure feelings of connectedness between students participating in online degree and certification programs. The purpose of this study was to examine data from the instrument for initial evidence of validity and reliability…

Development and Validation of the Educational Technologist Multimedia Competency Survey

ERIC Educational Resources Information Center

Ritzhaupt, Albert D.; Martin, Florence

2014-01-01

The purpose of this research study was to identify the multimedia competencies of an educational technologist by creating a valid and reliable survey instrument to administer to educational technology professionals. The educational technology multimedia competency survey developed through this research is based on a conceptual framework that…

The Trojan Lifetime Champions Health Survey: development, validity, and reliability.

PubMed

Sorenson, Shawn C; Romano, Russell; Scholefield, Robin M; Schroeder, E Todd; Azen, Stanley P; Salem, George J

2015-04-01

Self-report questionnaires are an important method of evaluating lifespan health, exercise, and health-related quality of life (HRQL) outcomes among elite, competitive athletes. Few instruments, however, have undergone formal characterization of their psychometric properties within this population. To evaluate the validity and reliability of a novel health and exercise questionnaire, the Trojan Lifetime Champions (TLC) Health Survey. Descriptive laboratory study. A large National Collegiate Athletic Association Division I university. A total of 63 university alumni (age range, 24 to 84 years), including former varsity collegiate athletes and a control group of nonathletes. Participants completed the TLC Health Survey twice at a mean interval of 23 days with randomization to the paper or electronic version of the instrument. Content validity, feasibility of administration, test-retest reliability, parallel-form reliability between paper and electronic forms, and estimates of systematic and typical error versus differences of clinical interest were assessed across a broad range of health, exercise, and HRQL measures. Correlation coefficients, including intraclass correlation coefficients (ICCs) for continuous variables and κ agreement statistics for ordinal variables, for test-retest reliability averaged 0.86, 0.90, 0.80, and 0.74 for HRQL, lifetime health, recent health, and exercise variables, respectively. Correlation coefficients, again ICCs and κ, for parallel-form reliability (ie, equivalence) between paper and electronic versions averaged 0.90, 0.85, 0.85, and 0.81 for HRQL, lifetime health, recent health, and exercise variables, respectively. Typical measurement error was less than the a priori thresholds of clinical interest, and we found minimal evidence of systematic test-retest error. We found strong evidence of content validity, convergent construct validity with the Short-Form 12 Version 2 HRQL instrument, and feasibility of administration in an elite

Validation of "Teaching and Learning Guiding Principles Instrument" for Malaysian Higher Learning Institutions

ERIC Educational Resources Information Center

Rahman, Nurulhuda Abd; Masuwai, Azwani; Tajudin, Nor'ain Mohd; Tek, Ong Eng; Adnan, Mazlini

2016-01-01

Purpose: This study was aimed at establishing, through the validation of the "Teaching and Learning Guiding Principles Instrument" (TLGPI), the validity and reliability of the underlying factor structure of the Teaching and Learning Guiding Principles (TLGP) generated by a previous study. Method: A survey method was used to collect data…

The Development and Preliminary Validation of the Behavior, Environment, and Changeability Survey (BECS)

ERIC Educational Resources Information Center

Walsh, Jennifer R.; Hebert, Angel; Byrd-Bredbenner, Carol; Carey, Gale; Colby, Sarah; Brown-Esters, Onikia N.; Greene, Geoffrey; Hoerr, Sharon; Horacek, Tanya; Kattelmann, Kendra; Kidd, Tandalayo; Koenings, Mallory; Phillips, Beatrice; Shelnutt, Karla P.; White, Adrienne A.

2012-01-01

Objective: To develop and test the validity of the Behavior, Environment, and Changeability Survey (BECS) for identifying the importance and changeability of nutrition, exercise, and stress management behavior and related aspects of the environment. Design: A cross-sectional, online survey of the BECS and selected validated instruments. Setting:…

The Community of Inquiry Instrument: Validation and Results in Online Health Care Disciplines

ERIC Educational Resources Information Center

Carlon, S.; Bennett-Woods, D.; Berg, B.; Claywell, L.; LeDuc, K.; Marcisz, N.; Mulhall, M.; Noteboom, T.; Snedden, T.; Whalen, K.; Zenoni, L.

2012-01-01

This descriptive study using survey design sought to establish the efficacy of the Community of Inquiry instrument utilized in a study published by Shea and Bidjerano in 2009 exploring an online community of business students in a multi-institutional study. The current study sought to validate the instrument with a population of students in three…

Organizational member involvement in physical activity coalitions across the United States: development and testing of a novel survey instrument for assessing coalition functioning.

PubMed

Bornstein, Daniel B; Pate, Russell R; Beets, Michael W; Saunders, Ruth P; Blair, Steven N

2015-06-01

Coalitions are often composed of member organizations. Member involvement is thought to be associated with coalition success. No instrument currently exists for evaluating organizational member involvement in physical activity coalitions. This study aimed to develop a survey instrument for evaluating organizational member involvement in physical activity coalitions. The study was carried out in three phases: (a) developing a draft survey, (b) assessing the content validity of the draft survey, and (c) assessing the underlying factor structure, reliability, and validity of the survey. A cross-sectional design was employed. In Phase 1, a team of experts in survey development produced a draft survey. In Phase 2, the content validity of the draft survey was evaluated by a panel of individuals with expertise in physical activity coalitions. In Phase 3, the survey was administered to 120 individuals on local-, state-, and national-level physical activity coalitions. Responses were subjected to an exploratory factor analysis in order to determine the survey's underlying factor structure, reliability, and validity. Phases 1 and 2yielded a survey instrument with demonstrated content validity. Phase 3 yielded a three-factor model with three subscales: Strategic Alignment, Organizational Alignment, and Providing Input. Each subscale demonstrated high internal consistency reliability and construct validity. The survey instrument developed here demonstrated sound psychometric properties and provides new insight into organizational member involvement in physical activity coalitions. This instrument may be an important tool in developing a more complete picture of coalition functioning in physical activity coalitions specifically and health-based coalitions overall. © 2014 Society for Public Health Education.

Development and Validation of an Assessment Instrument for Course Experience in a General Education Integrated Science Course

ERIC Educational Resources Information Center

Liu, Juhong Christie; St. John, Kristen; Courtier, Anna M. Bishop

2017-01-01

Identifying instruments and surveys to address geoscience education research (GER) questions is among the high-ranked needs in a 2016 survey of the GER community (St. John et al., 2016). The purpose of this study was to develop and validate a student-centered assessment instrument to measure course experience in a general education integrated…

Construct and Concurrent Validity of a Prototype Questionnaire to Survey Public Attitudes toward Stuttering

ERIC Educational Resources Information Center

St. Louis, Kenneth O.; Reichel, Isabella K.; Yaruss, J. Scott; Lubker, Bobbie Boyd

2009-01-01

Purpose: Construct validity and concurrent validity were investigated in a prototype survey instrument, the "Public Opinion Survey of Human Attributes-Experimental Edition" (POSHA-E). The POSHA-E was designed to measure public attitudes toward stuttering within the context of eight other attributes, or "anchors," assumed to range from negative…

The Trojan Lifetime Champions Health Survey: Development, Validity, and Reliability

PubMed Central

Sorenson, Shawn C.; Romano, Russell; Scholefield, Robin M.; Schroeder, E. Todd; Azen, Stanley P.; Salem, George J.

2015-01-01

Context Self-report questionnaires are an important method of evaluating lifespan health, exercise, and health-related quality of life (HRQL) outcomes among elite, competitive athletes. Few instruments, however, have undergone formal characterization of their psychometric properties within this population. Objective To evaluate the validity and reliability of a novel health and exercise questionnaire, the Trojan Lifetime Champions (TLC) Health Survey. Design Descriptive laboratory study. Setting A large National Collegiate Athletic Association Division I university. Patients or Other Participants A total of 63 university alumni (age range, 24 to 84 years), including former varsity collegiate athletes and a control group of nonathletes. Intervention(s) Participants completed the TLC Health Survey twice at a mean interval of 23 days with randomization to the paper or electronic version of the instrument. Main Outcome Measure(s) Content validity, feasibility of administration, test-retest reliability, parallel-form reliability between paper and electronic forms, and estimates of systematic and typical error versus differences of clinical interest were assessed across a broad range of health, exercise, and HRQL measures. Results Correlation coefficients, including intraclass correlation coefficients (ICCs) for continuous variables and κ agreement statistics for ordinal variables, for test-retest reliability averaged 0.86, 0.90, 0.80, and 0.74 for HRQL, lifetime health, recent health, and exercise variables, respectively. Correlation coefficients, again ICCs and κ, for parallel-form reliability (ie, equivalence) between paper and electronic versions averaged 0.90, 0.85, 0.85, and 0.81 for HRQL, lifetime health, recent health, and exercise variables, respectively. Typical measurement error was less than the a priori thresholds of clinical interest, and we found minimal evidence of systematic test-retest error. We found strong evidence of content validity, convergent

Design and validation of instruments to measure knowledge.

PubMed

Elliott, T E; Regal, R R; Elliott, B A; Renier, C M

2001-01-01

Measuring health care providers' learning after they have participated in educational interventions that use experimental designs requires valid, reliable, and practical instruments. A literature review was conducted. In addition, experience gained from designing and validating instruments for measuring the effect of an educational intervention informed this process. The eight main steps for designing, validating, and testing the reliability of instruments for measuring learning outcomes are presented. The key considerations and rationale for this process are discussed. Methods for critiquing and adapting existent instruments and creating new ones are offered. This study may help other investigators in developing valid, reliable, and practical instruments for measuring the outcomes of educational activities.

Measuring patient trust in telemedicine services: Development of a survey instrument and its validation for an anticoagulation web-service.

PubMed

Velsen, Lex van; Tabak, Monique; Hermens, Hermie

2017-01-01

For many eServices, end-user trust is a crucial prerequisite for use. For the telemedicine context however, knowledge about the coming about and measurement of end-user trust is scarce. To develop and validate the PAtient Trust Assessment Tool (PATAT): a survey instrument to quantitatively assess patient trust in a telemedicine service. Informed by focus groups, we developed a survey that includes measurement scales for the following factors: trust in the care organization, care professional, treatment, and technology, as well as a scale that assesses a holistic view on trust in the telemedicine service. The survey was completed by 795 patients that use a telemedicine application to manage their anticoagulation treatment. Data were analyzed by means of Partial Least Squares Structural Equation Modeling (PLS-SEM). The measurement model yielded good to excellent quality measures, after the removal of one item. The causal model resulted in high explained variance (R 2 =0.68). Trust in healthcare professionals and the treatment had a small effect on overall trust, while trust in the technology displayed a large effect. Trust in the care organization did not result in a significant effect on overall trust. The PATAT is a valid means to assess patient trust in a telemedicine service and can be used to benchmark such a service or to elicit redesign input. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Content validity of governing in Building Information Modelling (BIM) implementation assessment instrument

NASA Astrophysics Data System (ADS)

Hadzaman, N. A. H.; Takim, R.; Nawawi, A. H.; Mohamad Yusuwan, N.

2018-04-01

BIM governance assessment instrument is a process of analysing the importance in developing BIM governance solution to tackle the existing problems during team collaboration in BIM-based projects. Despite the deployment of integrative technologies in construction industry particularly BIM, it is still insufficient compare to other sectors. Several studies have been established the requirements of BIM implementation concerning all technical and non-technical BIM adoption issues. However, the data are regarded as inadequate to develop a BIM governance framework. Hence, the objective of the paper is to evaluate the content validity of the BIM governance instrument prior to the main data collection. Two methods were employed in the form of literature review and questionnaire survey. Based on the literature review, 273 items with six main constructs are suggested to be incorporated in the BIM governance instrument. The Content Validity Ratio (CVR) scores revealed that 202 out of 273 items are considered as the utmost critical by the content experts. The findings for Item Level Content Validity Index (I-CVI) and Modified Kappa Coefficient however revealed that 257 items in BIM governance instrument are appropriate and excellent. The instrument is highly reliable for future strategies and the development of BIM projects in Malaysia.

10 CFR 34.25 - Radiation survey instruments.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 1 2010-01-01 2010-01-01 false Radiation survey instruments. 34.25 Section 34.25 Energy... INDUSTRIAL RADIOGRAPHIC OPERATIONS Equipment § 34.25 Radiation survey instruments. (a) The licensee shall keep sufficient calibrated and operable radiation survey instruments at each location where radioactive...

10 CFR 34.25 - Radiation survey instruments.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 1 2012-01-01 2012-01-01 false Radiation survey instruments. 34.25 Section 34.25 Energy... INDUSTRIAL RADIOGRAPHIC OPERATIONS Equipment § 34.25 Radiation survey instruments. (a) The licensee shall keep sufficient calibrated and operable radiation survey instruments at each location where radioactive...

10 CFR 34.25 - Radiation survey instruments.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 10 Energy 1 2013-01-01 2013-01-01 false Radiation survey instruments. 34.25 Section 34.25 Energy... INDUSTRIAL RADIOGRAPHIC OPERATIONS Equipment § 34.25 Radiation survey instruments. (a) The licensee shall keep sufficient calibrated and operable radiation survey instruments at each location where radioactive...

10 CFR 34.25 - Radiation survey instruments.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 1 2011-01-01 2011-01-01 false Radiation survey instruments. 34.25 Section 34.25 Energy... INDUSTRIAL RADIOGRAPHIC OPERATIONS Equipment § 34.25 Radiation survey instruments. (a) The licensee shall keep sufficient calibrated and operable radiation survey instruments at each location where radioactive...

Approach and Instrument Placement Validation

NASA Technical Reports Server (NTRS)

Ator, Danielle

2005-01-01

The Mars Exploration Rovers (MER) from the 2003 flight mission represents the state of the art technology for target approach and instrument placement on Mars. It currently takes 3 sols (Martian days) for the rover to place an instrument on a designated rock target that is about 10 to 20 m away. The objective of this project is to provide an experimentally validated single-sol instrument placement capability to future Mars missions. After completing numerous test runs on the Rocky8 rover under various test conditions, it has been observed that lighting conditions, shadow effects, target features and the initial target distance have an effect on the performance and reliability of the tracking software. Additional software validation testing will be conducted in the months to come.

10 CFR 35.61 - Calibration of survey instruments.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 1 2011-01-01 2011-01-01 false Calibration of survey instruments. 35.61 Section 35.61... § 35.61 Calibration of survey instruments. (a) A licensee shall calibrate the survey instruments used... of calibration. (b) A licensee may not use survey instruments if the difference between the indicated...

10 CFR 35.61 - Calibration of survey instruments.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 1 2012-01-01 2012-01-01 false Calibration of survey instruments. 35.61 Section 35.61... § 35.61 Calibration of survey instruments. (a) A licensee shall calibrate the survey instruments used... of calibration. (b) A licensee may not use survey instruments if the difference between the indicated...

10 CFR 35.61 - Calibration of survey instruments.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 10 Energy 1 2013-01-01 2013-01-01 false Calibration of survey instruments. 35.61 Section 35.61... § 35.61 Calibration of survey instruments. (a) A licensee shall calibrate the survey instruments used... of calibration. (b) A licensee may not use survey instruments if the difference between the indicated...

10 CFR 35.61 - Calibration of survey instruments.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 1 2010-01-01 2010-01-01 false Calibration of survey instruments. 35.61 Section 35.61... § 35.61 Calibration of survey instruments. (a) A licensee shall calibrate the survey instruments used... of calibration. (b) A licensee may not use survey instruments if the difference between the indicated...

Validation of the National Institutes of Health Patient-Reported Outcomes Measurement Information System Survey as a Quality-of-Life Instrument for Patients with Malignant Brain Tumors and Their Caregivers.

PubMed

Romero, Melissa M; Flood, Lisa Sue; Gasiewicz, Nanci K; Rovin, Richard; Conklin, Samantha

2015-12-01

At present there is a lack of well-validated surveys used to measure quality of life in patients with malignant brain tumors and their caregivers. The main objective of this pilot study was to validate the National Institutes of Health Patient-Reported Outcomes Measurement Information System (NIH PROMIS) survey for use as a quality-of-life measure in this population. This article presents the rationale for using the NIH PROMIS instrument as a quality-of-life measure for patients with malignant brain tumors and their caregivers. Copyright © 2015 Elsevier Inc. All rights reserved.

Designing, Testing, and Validating an Attitudinal Survey on an Environmental Topic: A Groundwater Pollution Survey Instrument for Secondary School Students

ERIC Educational Resources Information Center

Lacosta-Gabari, Idoya; Fernandez-Manzanal, Rosario; Sanchez-Gonzalez, Dolores

2009-01-01

Research in environmental attitudes' assessment has significantly increased in recent years. The development of specific attitude scales for specific environmental problems has often been proposed. This paper describes the Groundwater Pollution Test (GPT), a 19-item survey instrument using a Likert-type scale. The survey has been used with…

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20)

PubMed Central

2017-01-01

Objectives Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. Methods After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Results Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). Conclusions A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability. PMID:28173686

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20).

PubMed

Jo, Min-Woo; Lee, Hyeon-Jeong; Kim, Soo Young; Kim, Seon-Ha; Chang, Hyejung; Ahn, Jeonghoon; Ock, Minsu

2017-01-01

Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability.

Validation of a quality-of-life instrument for patients with nonmelanoma skin cancer.

PubMed

Rhee, John S; Matthews, B Alex; Neuburg, Marcy; Logan, Brent R; Burzynski, Mary; Nattinger, Ann B

2006-01-01

To validate a disease-specific quality-of-life instrument--the Skin Cancer Index--intended to measure quality-of-life issues relevant to patients with nonmelanoma skin cancer. Internal reliability, convergent and divergent validity with existing scales, and factor analyses were performed in a cross-sectional study of 211 patients presenting with cervicofacial nonmelanoma skin cancer to a dermatologic surgery clinic. Factor analyses of the Skin Cancer Index confirmed a multidimensional scale with 3 distinct subscales-emotional, social, and appearance. Excellent internal validity of the 3 subscales was demonstrated. Substantial evidence was observed for convergent validity with the Dermatology Life Quality Index, Rosenberg Self-Esteem Scale, Lerman's Cancer Worry Scale, and Medical Outcomes Survey Short-Form 12 domains for vitality, emotion, social function, and mental health. These findings validate a new disease-specific quality-of-life instrument for patients with cervicofacial nonmelanoma skin cancer. Studies on the responsiveness of the Skin Cancer Index to clinical intervention are currently under way.

Developing instruments concerning scientific epistemic beliefs and goal orientations in learning science: a validation study

NASA Astrophysics Data System (ADS)

Lin, Tzung-Jin; Tsai, Chin-Chung

2017-11-01

The purpose of this study was to develop and validate two survey instruments to evaluate high school students' scientific epistemic beliefs and goal orientations in learning science. The initial relationships between the sampled students' scientific epistemic beliefs and goal orientations in learning science were also investigated. A final valid sample of 600 volunteer Taiwanese high school students participated in this survey by responding to the Scientific Epistemic Beliefs Instrument (SEBI) and the Goal Orientations in Learning Science Instrument (GOLSI). Through both exploratory and confirmatory factor analyses, the SEBI and GOLSI were proven to be valid and reliable for assessing the participants' scientific epistemic beliefs and goal orientations in learning science. The path analysis results indicated that, by and large, the students with more sophisticated epistemic beliefs in various dimensions such as Development of Knowledge, Justification for Knowing, and Purpose of Knowing tended to adopt both Mastery-approach and Mastery-avoidance goals. Some interesting results were also found. For example, the students tended to set a learning goal to outperform others or merely demonstrate competence (Performance-approach) if they had more informed epistemic beliefs in the dimensions of Multiplicity of Knowledge, Uncertainty of Knowledge, and Purpose of Knowing.

Validity and reliability of Patient-Reported Outcomes Measurement Information System (PROMIS) Instruments in Osteoarthritis

PubMed Central

Broderick, Joan E.; Schneider, Stefan; Junghaenel, Doerte U.; Schwartz, Joseph E.; Stone, Arthur A.

2013-01-01

Objective Evaluation of known group validity, ecological validity, and test-retest reliability of four domain instruments from the Patient Reported Outcomes Measurement System (PROMIS) in osteoarthritis (OA) patients. Methods Recruitment of an osteoarthritis sample and a comparison general population (GP) through an Internet survey panel. Pain intensity, pain interference, physical functioning, and fatigue were assessed for 4 consecutive weeks with PROMIS short forms on a daily basis and compared with same-domain Computer Adaptive Test (CAT) instruments that use a 7-day recall. Known group validity (comparison of OA and GP), ecological validity (comparison of aggregated daily measures with CATs), and test-retest reliability were evaluated. Results The recruited samples matched (age, sex, race, ethnicity) the demographic characteristics of the U.S. sample for arthritis and the 2009 Census for the GP. Compliance with repeated measurements was excellent: > 95%. Known group validity for CATs was demonstrated with large effect sizes (pain intensity: 1.42, pain interference: 1.25, and fatigue: .85). Ecological validity was also established through high correlations between aggregated daily measures and weekly CATs (≥ .86). Test-retest validity (7-day) was very good (≥ .80). Conclusion PROMIS CAT instruments demonstrated known group and ecological validity in a comparison of osteoarthritis patients with a general population sample. Adequate test-retest reliability was also observed. These data provide encouraging initial data on the utility of these PROMIS instruments for clinical and research outcomes in osteoarthritis patients. PMID:23592494

A Systematic Review of Primary Care Safety Climate Survey Instruments: Their Origins, Psychometric Properties, Quality, and Usage.

PubMed

Curran, Ciara; Lydon, Sinéad; Kelly, Maureen; Murphy, Andrew; Walsh, Chloe; OʼConnor, Paul

2018-06-01

Safety climate (SC) measurement is a common and feasible method of proactive safety assessment in primary care. However, there is no consensus on which instrument is "best" to use. The aim of the study was to identify the origins, psychometric properties, quality, and SC domains measured by survey instruments used to assess SC in primary care settings. Systematic searches were conducted using Medline, Embase, CINAHL, and PsycInfo in February 2016. English-language, peer-reviewed studies that reported the development and/or use of a SC survey in a primary care setting were included. Two reviewers independently extracted data (survey characteristics, origins, and psychometric properties) from studies and applied the Quality Assessment Tool for Studies with Diverse Designs to assess methodological rigour. Safety climate domains within surveys were deductively analyzed and categorized into common healthcare SC themes. Seventeen SC surveys were identified, of which 16 had been adapted from 2 main U.S. hospital-based surveys. Only 1 survey was developed de novo for a primary care setting. The quantity and quality of psychometric testing varied considerably across the surveys. Management commitment to safety was the most frequently measured SC theme (87.5%). Workload was infrequently measured (25%). Valid and reliable instruments, which are context specific to the healthcare environment for intentional use, are essential to accurately assess SC. Key recommendations include further establishing the construct and criterion-related validity of existing instruments as opposed to developing additional surveys.

Validity and reliability of the Self-Reported Physical Fitness (SRFit) survey.

PubMed

Keith, NiCole R; Clark, Daniel O; Stump, Timothy E; Miller, Douglas K; Callahan, Christopher M

2014-05-01

An accurate physical fitness survey could be useful in research and clinical care. To estimate the validity and reliability of a Self-Reported Fitness (SRFit) survey; an instrument that estimates muscular fitness, flexibility, cardiovascular endurance, BMI, and body composition (BC) in adults ≥ 40 years of age. 201 participants completed the SF-36 Physical Function Subscale, International Physical Activity Questionnaire (IPAQ), Older Adults' Desire for Physical Competence Scale (Rejeski), the SRFit survey, and the Rikli and Jones Senior Fitness Test. BC, height and weight were measured. SRFit survey items described BC, BMI, and Senior Fitness Test movements. Correlations between the Senior Fitness Test and the SRFit survey assessed concurrent validity. Cronbach's Alpha measured internal consistency within each SRFit domain. SRFit domain scores were compared with SF-36, IPAQ, and Rejeski survey scores to assess construct validity. Intraclass correlations evaluated test-retest reliability. Correlations between SRFit and the Senior Fitness Test domains ranged from 0.35 to 0.79. Cronbach's Alpha scores were .75 to .85. Correlations between SRFit and other survey scores were -0.23 to 0.72 and in the expected direction. Intraclass correlation coefficients were 0.79 to 0.93. All P-values were 0.001. Initial evaluation supports the SRFit survey's validity and reliability.

The Perinatal Palliative Care Perceptions and Barriers Scale Instrument©: development and validation.

PubMed

Wool, Charlotte; Northam, Sally

2011-12-01

To devise and test an instrument measuring clinician perceptions of perinatal palliative care (PPC) and barriers to care delivery. PPC was theorized to involve the care of pregnant women and their families after prenatal testing resulted in a life-limiting fetal diagnosis. Both giving birth to a child with a life-limiting condition or termination of pregnancy for fetal anomaly can be emotionally traumatic life events. Clinicians were thought to face ethical dilemmas that involved approaches to care for this population. The ethical dilemmas were measured on a perceptions scale using items about informed consent, justice, beneficence, and autonomy. Barriers were theorized as obstacles to delivering quality PPC and included insufficient education, personal discomfort, and difficulty garnering team or administrative support for care. Licensed clinicians practicing in the perinatal field. Stage 1 entailed instrument development and validation, which was achieved through a Delphi study involving 11 expert panelists. The devised instrument included 64 six-point Likert items. In stage 2, a computer survey gathered data from a multidisciplinary, clinician group. A total of 264 clinicians completed the survey. Exploratory factor analysis with varimax rotation was used to validate the instrument, evaluate the factors, and summarize the explained variance achieved by sum scores of the perceptions and barriers scales. The perceptions scale was reduced to 23 items with a 6-factor solution explaining 67% of the variance with a good internal consistency reliability of 0.77 (Cronbach α). The 22-item barriers scale had a 6-factor solution explaining 71% of the variance with an alpha reliability of 0.83. The Perinatal Palliative Care Perceptions and Practice Barriers Scale instrument is a valid and reliable measure of PPC perceptions and barriers for measuring the attitudes of physicians and nurses. Use of this instrument can foster educational programs and hospital planning for PPC

Validation of the ENVISAT atmospheric chemistry instruments

NASA Astrophysics Data System (ADS)

Snoeij, P.; Koopman, R.; Attema, E.; Zehner, C.; Wursteisen, P.; Dehn, A.; de Laurentius, M.; Frerick, J.; Mantovani, R.; Saavedra de Miguel, L.

Three atmospheric-chemistry sensors form part of the ENVISAT payload that has been placed into orbit in March 2002. This paper presents the ENVISAT mission status and data policy, and reviews the end-to-end performance of the GOMOS, MIPAS and SCIAMACHY observation systems and will discuss the validation aspects of these instruments. In particular, for each instrument, the review addresses mission planning, in-orbit performance, calibration, data processor algorithms and configuration, reprocessing strategy, and product quality control assessment. An important part of the quality assessment is the Geophysical Validation. At the ACVT Validation workshop held in Frascati, Italy, from 3-7 May 2004, scientists and engineers presented analyses of the exhaustive series of tests that have been run on each of ENVISAT atmospheric chemistry sensors since the spacecraft was launched in March 2002. On the basis of workshop results it was decided that most of the data products provided by the ENVISAT atmospheric chemistry instruments are ready for operational delivery. Although the main validation phase for the atmospheric instruments of ENVISAT will be completed soon, ongoing validation products will continue throughout the lifetime of the ENVISAT mission. The long-term validation phase will: Provide assurance of data quality and accuracy for applications such as climate change research Investigate the fully representative range of geophysical conditions Investigate the fully representative range of seasonal cycles Perform long term monitoring for instrumental drifts and other artefacts Validate new products. This paper will also discuss the general status of the validation activities for GOMOS, MIPAS and SCIAMACHY. The main and long-term geophysical validation programme will be presented. The flight and ground-segment planning, configuration and performance characterization will be discussed. The evolution of each of the observation systems has been distinct during the mission

Revision and Validation of the Revised Teacher Beliefs Survey.

ERIC Educational Resources Information Center

Benjamin, Jane

This study revised the Teacher Beliefs Survey (S. Wooley and A. Wooley, 1999; TBS), an instrument to assess teachers beliefs related to constructivist and behaviorist theories of learning, and then studied the validity of the revised TBS. Drawing on a literature review, researchers added items for the existing constructs of the TBS and added a new…

EOS-Aura's Ozone Monitoring Instrument (OMI): Validation Requirements

NASA Technical Reports Server (NTRS)

Brinksma, E. J.; McPeters, R.; deHaan, J. F.; Levelt, P. F.; Hilsenrath, E.; Bhartia, P. K.

2003-01-01

OMI is an advanced hyperspectral instrument that measures backscattered radiation in the UV and visible. It will be flown as part of the EOS Aura mission and provide data on atmospheric chemistry that is highly synergistic with other Aura instruments HIRDLS, MLS, and TES. OMI is designed to measure total ozone, aerosols, cloud information, and UV irradiances, continuing the TOMS series of global mapped products but with higher spatial resolution. In addition its hyperspectral capability enables measurements of trace gases such as SO2, NO2, HCHO, BrO, and OClO. A plan for validation of the various OM1 products is now being formulated. Validation of the total column and UVB products will rely heavily on existing networks of instruments, like NDSC. NASA and its European partners are planning aircraft missions for the validation of Aura instruments. New instruments and techniques (DOAS systems for example) will need to be developed, both ground and aircraft based. Lidar systems are needed for validation of the vertical distributions of ozone, aerosols, NO2 and possibly SO2. The validation emphasis will be on the retrieval of these products under polluted conditions. This is challenging because they often depend on the tropospheric profiles of the product in question, and because of large spatial variations in the troposphere. Most existing ground stations are located in, and equipped for, pristine environments. This is also true for almost all NDSC stations. OMI validation will need ground based sites in polluted environments and specially developed instruments, complementing the existing instrumentation.

Improving the Validity and Reliability of a Health Promotion Survey for Physical Therapists

PubMed Central

Stephens, Jaca L.; Lowman, John D.; Graham, Cecilia L.; Morris, David M.; Kohler, Connie L.; Waugh, Jonathan B.

2013-01-01

Purpose Physical therapists (PTs) have a unique opportunity to intervene in the area of health promotion. However, no instrument has been validated to measure PTs’ views on health promotion in physical therapy practice. The purpose of this study was to evaluate the content validity and test-retest reliability of a health promotion survey designed for PTs. Methods An expert panel of PTs assessed the content validity of “The Role of Health Promotion in Physical Therapy Survey” and provided suggestions for revision. Item content validity was assessed using the content validity ratio (CVR) as well as the modified kappa statistic. Therapists then participated in the test-retest reliability assessment of the revised health promotion survey, which was assessed using a weighted kappa statistic. Results Based on feedback from the expert panelists, significant revisions were made to the original survey. The expert panel reached at least a majority consensus agreement for all items in the revised survey and the survey-CVR improved from 0.44 to 0.66. Only one item on the revised survey had substantial test-retest agreement, with 55% of the items having moderate agreement and 43% poor agreement. Conclusions All items on the revised health promotion survey demonstrated at least fair validity, but few items had reasonable test-retest reliability. Further modifications should be made to strengthen the validity and improve the reliability of this survey. PMID:23754935

Register of Validated Short Dietary Assessment Instruments

Cancer.gov

The register contains descriptive information about the instruments identified (over 135) along with any associated validation studies and publications, and copies of the instruments themselves when available.

Corporate Entrepreneurship Assessment Instrument (CEAI): Systematic Validation of a Measure

DTIC Science & Technology

2006-03-01

CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE THESIS...the United States Government. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION...DISTRIBUTION UNLIMITED. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE

Moral Distress Scale for Occupational Therapists: Part 1. Instrument Development and Content Validity.

PubMed

Penny, Neil H; Bires, Samantha J; Bonn, Elizabeth A; Dockery, Alisha N; Pettit, Nicole L

2016-01-01

We describe the development of an instrument to measure moral distress experienced by occupational therapists and show how its content validity was established. Written comments (n = 78) from a previous survey using the Moral Distress Scale-Revised-Other Health Provider Adult were used to modify that instrument and create the Moral Distress Scale-Revised-Occupational Therapy-Adult Settings (MDS-R-OT[A]). The MDS-R-OT[A] was distributed to a nationwide random sample of 400 occupational therapists who rated the relevance of each item to their clinical practice. A scale content validity index of 81.8% was found (geriatric = 81.5%, physical disability = 80.8%, combination of the two = 85.7%). The MDS-R-OT[A] possesses acceptable content validity and is appropriate for use with occupational therapists working in geriatric or physical disability settings. Copyright © 2016 by the American Occupational Therapy Association, Inc.

The knowledge, efficacy, and practices instrument for oral health providers: a validity study with dental students.

PubMed

Behar-Horenstein, Linda S; Garvan, Cyndi W; Moore, Thomas E; Catalanotto, Frank A

2013-08-01

Valid and reliable instruments to measure and assess cultural competence for oral health care providers are scarce in the literature, and most published scales have been contested due to a lack of item analysis and internal estimates of reliability. The purposes of this study were, first, to develop a standardized instrument to measure dental students' knowledge of diversity, skills in culturally competent patient-centered communication, and use of culture-centered practices in patient care and, second, to provide preliminary validity support for this instrument. The initial instrument used in this study was a thirty-six-item Likert-scale survey entitled the Knowledge, Efficacy, and Practices Instrument for Oral Health Providers (KEPI-OHP). This instrument is an adaption of an initially thirty-three-item version of the Multicultural Awareness, Knowledge, and Skills Scale-Counselor Edition (MAKSS-CE), a scale that assesses factors related to social justice, cultural differences among clients, and cross-cultural client management. After the authors conducted cognitive and expert interviews, focus groups, pilot testing, and item analysis, their initial instrument was reduced to twenty-eight items. The KEPI-OHP was then distributed to 916 dental students (response rate=48.6 percent) across the United States to measure its reliability and assess its validity. Both exploratory and confirmatory factor analyses were conducted to test the scale's validity. The modification of the survey into a sensible instrument with a relatively clear factor structure using factor analysis resulted in twenty items. A scree test suggested three expressive factors, which were retained for rotation. Bentler's comparative fit and Bentler and Bonnett's non-normed indices were 0.95 and 0.92, respectively. A three-factor solution, including efficacy of assessment, knowledge of diversity, and culture-centered practice subscales, comprised of twenty-items was identified. The KEPI-OHP was found to

Psychometric instrumentation: reliability and validity of instruments used for clinical practice, evidence-based practice projects and research studies.

PubMed

Mayo, Ann M

2015-01-01

It is important for CNSs and other APNs to consider the reliability and validity of instruments chosen for clinical practice, evidence-based practice projects, or research studies. Psychometric testing uses specific research methods to evaluate the amount of error associated with any particular instrument. Reliability estimates explain more about how well the instrument is designed, whereas validity estimates explain more about scores that are produced by the instrument. An instrument may be architecturally sound overall (reliable), but the same instrument may not be valid. For example, if a specific group does not understand certain well-constructed items, then the instrument does not produce valid scores when used with that group. Many instrument developers may conduct reliability testing only once, yet continue validity testing in different populations over many years. All CNSs should be advocating for the use of reliable instruments that produce valid results. Clinical nurse specialists may find themselves in situations where reliability and validity estimates for some instruments that are being utilized are unknown. In such cases, CNSs should engage key stakeholders to sponsor nursing researchers to pursue this most important work.

The Validation of a Software Evaluation Instrument.

ERIC Educational Resources Information Center

Schmitt, Dorren Rafael

This study, conducted at six southern universities, analyzed the validity and reliability of a researcher developed instrument designed to evaluate educational software in secondary mathematics. The instrument called the Instrument for Software Evaluation for Educators uses measurement scales, presents a summary section of the evaluation, and…

Validation of the Care-Related Quality of Life Instrument in different study settings: findings from The Older Persons and Informal Caregivers Survey Minimum DataSet (TOPICS-MDS).

PubMed

Lutomski, J E; van Exel, N J A; Kempen, G I J M; Moll van Charante, E P; den Elzen, W P J; Jansen, A P D; Krabbe, P F M; Steunenberg, B; Steyerberg, E W; Olde Rikkert, M G M; Melis, R J F

2015-05-01

Validity is a contextual aspect of a scale which may differ across sample populations and study protocols. The objective of our study was to validate the Care-Related Quality of Life Instrument (CarerQol) across two different study design features, sampling framework (general population vs. different care settings) and survey mode (interview vs. written questionnaire). Data were extracted from The Older Persons and Informal Caregivers Minimum DataSet (TOPICS-MDS, www.topics-mds.eu ), a pooled public-access data set with information on >3,000 informal caregivers throughout the Netherlands. Meta-correlations and linear mixed models between the CarerQol's seven dimensions (CarerQol-7D) and caregiver's level of happiness (CarerQol-VAS) and self-rated burden (SRB) were performed. The CarerQol-7D dimensions were correlated to the CarerQol-VAS and SRB in the pooled data set and the subgroups. The strength of correlations between CarerQol-7D dimensions and SRB was weaker among caregivers who were interviewed versus those who completed a written questionnaire. The directionality of associations between the CarerQol-VAS, SRB and the CarerQol-7D dimensions in the multivariate model supported the construct validity of the CarerQol in the pooled population. Significant interaction terms were observed in several dimensions of the CarerQol-7D across sampling frame and survey mode, suggesting meaningful differences in reporting levels. Although good scientific practice emphasises the importance of re-evaluating instrument properties in individual research studies, our findings support the validity and applicability of the CarerQol instrument in a variety of settings. Due to minor differential reporting, pooling CarerQol data collected using mixed administration modes should be interpreted with caution; for TOPICS-MDS, meta-analytic techniques may be warranted.

Integrating Validity Theory with Use of Measurement Instruments in Clinical Settings

PubMed Central

Kelly, P Adam; O'Malley, Kimberly J; Kallen, Michael A; Ford, Marvella E

2005-01-01

Objective To present validity concepts in a conceptual framework useful for research in clinical settings. Principal Findings We present a three-level decision rubric for validating measurement instruments, to guide health services researchers step-by-step in gathering and evaluating validity evidence within their specific situation. We address construct precision, the capacity of an instrument to measure constructs it purports to measure and differentiate from other, unrelated constructs; quantification precision, the reliability of the instrument; and translation precision, the ability to generalize scores from an instrument across subjects from the same or similar populations. We illustrate with specific examples, such as an approach to validating a measurement instrument for veterans when prior evidence of instrument validity for this population does not exist. Conclusions Validity should be viewed as a property of the interpretations and uses of scores from an instrument, not of the instrument itself: how scores are used and the consequences of this use are integral to validity. Our advice is to liken validation to building a court case, including discovering evidence, weighing the evidence, and recognizing when the evidence is weak and more evidence is needed. PMID:16178998

Development and validation of the primary care team dynamics survey.

PubMed

Song, Hummy; Chien, Alyna T; Fisher, Josephine; Martin, Julia; Peters, Antoinette S; Hacker, Karen; Rosenthal, Meredith B; Singer, Sara J

2015-06-01

To develop and validate a survey instrument designed to measure team dynamics in primary care. We studied 1,080 physician and nonphysician health care professionals working at 18 primary care practices participating in a learning collaborative aimed at improving team-based care. We developed a conceptual model and administered a cross-sectional survey addressing team dynamics, and we assessed reliability and discriminant validity of survey factors and the overall survey's goodness-of-fit using structural equation modeling. We administered the survey between September 2012 and March 2013. Overall response rate was 68 percent (732 respondents). Results support a seven-factor model of team dynamics, suggesting that conditions for team effectiveness, shared understanding, and three supportive processes are associated with acting and feeling like a team and, in turn, perceived team effectiveness. This model demonstrated adequate fit (goodness-of-fit index: 0.91), scale reliability (Cronbach's alphas: 0.71-0.91), and discriminant validity (average factor correlations: 0.49). It is possible to measure primary care team dynamics reliably using a 29-item survey. This survey may be used in ambulatory settings to study teamwork and explore the effect of efforts to improve team-based care. Future studies should demonstrate the importance of team dynamics for markers of team effectiveness (e.g., work satisfaction, care quality, clinical outcomes). © Health Research and Educational Trust.

Student mathematical imagination instruments: construction, cultural adaptation and validity

NASA Astrophysics Data System (ADS)

Dwijayanti, I.; Budayasa, I. K.; Siswono, T. Y. E.

2018-03-01

Imagination has an important role as the center of sensorimotor activity of the students. The purpose of this research is to construct the instrument of students’ mathematical imagination in understanding concept of algebraic expression. The researcher performs validity using questionnaire and test technique and data analysis using descriptive method. Stages performed include: 1) the construction of the embodiment of the imagination; 2) determine the learning style questionnaire; 3) construct instruments; 4) translate to Indonesian as well as adaptation of learning style questionnaire content to student culture; 5) perform content validation. The results stated that the constructed instrument is valid by content validation and empirical validation so that it can be used with revisions. Content validation involves Indonesian linguists, english linguists and mathematics material experts. Empirical validation is done through a legibility test (10 students) and shows that in general the language used can be understood. In addition, a questionnaire test (86 students) was analyzed using a biserial point correlation technique resulting in 16 valid items with a reliability test using KR 20 with medium reability criteria. While the test instrument test (32 students) to find all items are valid and reliability test using KR 21 with reability is 0,62.

10 CFR 34.25 - Radiation survey instruments.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 10 Energy 1 2014-01-01 2014-01-01 false Radiation survey instruments. 34.25 Section 34.25 Energy NUCLEAR REGULATORY COMMISSION LICENSES FOR INDUSTRIAL RADIOGRAPHY AND RADIATION SAFETY REQUIREMENTS FOR INDUSTRIAL RADIOGRAPHIC OPERATIONS Equipment § 34.25 Radiation survey instruments. (a) The licensee shall...

Validity and Reliability of Turkish Male Breast Self-Examination Instrument.

PubMed

Erkin, Özüm; Göl, İlknur

2018-04-01

This study aims to measure the validity and reliability of Turkish male breast self-examination (MBSE) instrument. The methodological study was performed in 2016 at Ege University, Faculty of Nursing, İzmir, Turkey. The MBSE includes ten steps. For validity studies, face validity, content validity, and construct validity (exploratory factor analysis) were done. For reliability study, Kuder Richardson was calculated. The content validity index was found to be 0.94. Kendall W coefficient was 0.80 (p=0.551). The total variance explained by the two factors was found to be 63.24%. Kuder Richardson 21 was done for reliability study and found to be 0.97 for the instrument. The final instrument included 10 steps and two stages. The Turkish version of MBSE is a valid and reliable instrument for early diagnose. The MBSE can be used in Turkish speaking countries and cultures with two stages and 10 steps.

Borehole survey instrument

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sharp, H.E.; Lin, J.W. III; Macha, E.S.

1984-12-04

A borehole survey instrument is provided having a meniscus type floating compass member with indicia thereon for indicating azimuth and inclination. A light source is disposed below the indicia for illuminating the indicia upward through the liquid through which the meniscus type floating compass member floats. A lens system is provided for focusing the image of the illuminated compass member upon a film disposed below the compass member. This arrangement permits the centering post for the compass member to be of minimum diameter consistent with rigidity requirements and permits a high angle compass member to indicate angles of inclination approachingmore » ninety degrees. A multiple light bulb light source is utilized and each light bulb is mounted in a manner which permits a single light bulb to illuminate the entire compass member. A hand-held programming and diagnostic unit is provided which may be momentarily electrically mated with the borehole survey tool to input a programmed timed delay and diagnostically test both the condition of the light bulbs utilized as the illumination source and the state of the batteries within the instrument. This hand-held programmable unit eliminates all the mechanical programming switches and permits the instrument to be completely sealed from the pressure, fluids and contaminants normally found in a well bore.« less

Developing Instruments Concerning Scientific Epistemic Beliefs and Goal Orientations in Learning Science: A Validation Study

ERIC Educational Resources Information Center

Lin, Tzung-Jin; Tsai, Chin-Chung

2017-01-01

The purpose of this study was to develop and validate two survey instruments to evaluate high school students' scientific epistemic beliefs and goal orientations in learning science. The initial relationships between the sampled students' scientific epistemic beliefs and goal orientations in learning science were also investigated. A final valid…

Development and validation of a survey to measure features of clinical networks.

PubMed

Brown, Bernadette Bea; Haines, Mary; Middleton, Sandy; Paul, Christine; D'Este, Catherine; Klineberg, Emily; Elliott, Elizabeth

2016-09-30

Networks of clinical experts are increasingly being implemented as a strategy to improve health care processes and outcomes and achieve change in the health system. Few are ever formally evaluated and, when this is done, not all networks are equally successful in their efforts. There is a need to formatively assess the strategic and operational management and leadership of networks to identify where functioning could be improved to maximise impact. This paper outlines the development and psychometric evaluation of an Internet survey to measure features of clinical networks and provides descriptive results from a sample of members of 19 diverse clinical networks responsible for evidence-based quality improvement across a large geographical region. Instrument development was based on: a review of published and grey literature; a qualitative study of clinical network members; a program logic framework; and consultation with stakeholders. The resulting domain structure was validated for a sample of 592 clinical network members using confirmatory factor analysis. Scale reliability was assessed using Cronbach's alpha. A summary score was calculated for each domain and aggregate level means and ranges are reported. The instrument was shown to have good construct validity across seven domains as demonstrated by a high level of internal consistency, and all Cronbach's α coefficients were equal to or above 0.75. In the survey sample of network members there was strong reported commitment and belief in network-led quality improvement initiatives, which were perceived to have improved quality of care (72.8 %) and patient outcomes (63.2 %). Network managers were perceived to be effective leaders and clinical co-chairs were perceived as champions for change. Perceived external support had the lowest summary score across the seven domains. This survey, which has good construct validity and internal reliability, provides a valid instrument to use in future research related to

Development and Validation of the Primary Care Team Dynamics Survey

PubMed Central

Song, Hummy; Chien, Alyna T; Fisher, Josephine; Martin, Julia; Peters, Antoinette S; Hacker, Karen; Rosenthal, Meredith B; Singer, Sara J

2015-01-01

Objective To develop and validate a survey instrument designed to measure team dynamics in primary care. Data Sources/Study Setting We studied 1,080 physician and nonphysician health care professionals working at 18 primary care practices participating in a learning collaborative aimed at improving team-based care. Study Design We developed a conceptual model and administered a cross-sectional survey addressing team dynamics, and we assessed reliability and discriminant validity of survey factors and the overall survey's goodness-of-fit using structural equation modeling. Data Collection We administered the survey between September 2012 and March 2013. Principal Findings Overall response rate was 68 percent (732 respondents). Results support a seven-factor model of team dynamics, suggesting that conditions for team effectiveness, shared understanding, and three supportive processes are associated with acting and feeling like a team and, in turn, perceived team effectiveness. This model demonstrated adequate fit (goodness-of-fit index: 0.91), scale reliability (Cronbach's alphas: 0.71–0.91), and discriminant validity (average factor correlations: 0.49). Conclusions It is possible to measure primary care team dynamics reliably using a 29-item survey. This survey may be used in ambulatory settings to study teamwork and explore the effect of efforts to improve team-based care. Future studies should demonstrate the importance of team dynamics for markers of team effectiveness (e.g., work satisfaction, care quality, clinical outcomes). PMID:25423886

Validation of the organizational culture assessment instrument.

PubMed

Heritage, Brody; Pollock, Clare; Roberts, Lynne

2014-01-01

Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI) has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102) Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged.

Validation of the Organizational Culture Assessment Instrument

PubMed Central

Heritage, Brody; Pollock, Clare; Roberts, Lynne

2014-01-01

Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI) has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102) Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged. PMID:24667839

Development and Validation of an Instrument to Measure Students' Motivation and Self-Regulation in Science Learning

NASA Astrophysics Data System (ADS)

Velayutham, Sunitadevi; Aldridge, Jill; Fraser, Barry

2011-10-01

Students' motivational beliefs and self-regulatory practices have been identified as instrumental in influencing the engagement of students in the learning process. An important aim of science education is to empower students by nurturing the belief that they can succeed in science learning and to cultivate the adaptive learning strategies required to help to bring about that success. This article reports the development and validation of an instrument to measure salient factors related to the motivation and self-regulation of students in lower secondary science classrooms. The development of the instrument involved identifying key determinants of students' motivation and self-regulation in science learning based on theoretical and research underpinnings. Once the instrument was developed, a pilot study involving 52 students from two Grade 8 science classes was undertaken. Quantitative data were collected from 1,360 students in 78 classes across Grades 8, 9, and 10, in addition to in-depth qualitative information gathered from 10 experienced science teachers and 12 Grade 8 students. Analyses of the data suggest that the survey has strong construct validity when used with lower secondary students. This survey could be practically valuable as a tool for gathering information that may guide classroom teachers in refocusing their teaching practices and help to evaluate the effectiveness of intervention programmes.

PACIC Instrument: disentangling dimensions using published validation models.

PubMed

Iglesias, K; Burnand, B; Peytremann-Bridevaux, I

2014-06-01

To better understand the structure of the Patient Assessment of Chronic Illness Care (PACIC) instrument. More specifically to test all published validation models, using one single data set and appropriate statistical tools. Validation study using data from cross-sectional survey. A population-based sample of non-institutionalized adults with diabetes residing in Switzerland (canton of Vaud). French version of the 20-items PACIC instrument (5-point response scale). We conducted validation analyses using confirmatory factor analysis (CFA). The original five-dimension model and other published models were tested with three types of CFA: based on (i) a Pearson estimator of variance-covariance matrix, (ii) a polychoric correlation matrix and (iii) a likelihood estimation with a multinomial distribution for the manifest variables. All models were assessed using loadings and goodness-of-fit measures. The analytical sample included 406 patients. Mean age was 64.4 years and 59% were men. Median of item responses varied between 1 and 4 (range 1-5), and range of missing values was between 5.7 and 12.3%. Strong floor and ceiling effects were present. Even though loadings of the tested models were relatively high, the only model showing acceptable fit was the 11-item single-dimension model. PACIC was associated with the expected variables of the field. Our results showed that the model considering 11 items in a single dimension exhibited the best fit for our data. A single score, in complement to the consideration of single-item results, might be used instead of the five dimensions usually described. © The Author 2014. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Measuring determinants of career satisfaction of anesthesiologists: validation of a survey instrument.

PubMed

Afonso, Anoushka M; Diaz, James H; Scher, Corey S; Beyl, Robbie A; Nair, Singh R; Kaye, Alan David

2013-06-01

To measure the parameter of job satisfaction among anesthesiologists. Survey instrument. Academic anesthesiology departments in the United States. 320 anesthesiologists who attended the annual meeting of the ASA in 2009 (95% response rate). The anonymous 50-item survey collected information on 26 independent demographic variables and 24 dependent ranked variables of career satisfaction among practicing anesthesiologists. Mean survey scores were calculated for each demographic variable and tested for statistically significant differences by analysis of variance. Questions within each domain that were internally consistent with each other within domains were identified by Cronbach's alpha ≥ 0.7. P-values ≤ 0.05 were considered statistically significant. Cronbach's alpha analysis showed strong internal consistency for 10 dependent outcome questions in the practice factor-related domain (α = 0.72), 6 dependent outcome questions in the peer factor-related domain (α = 0.71), and 8 dependent outcome questions in the personal factor-related domain (α = 0.81). Although age was not a variable, full-time status, early satisfaction within the first 5 years of practice, working with respected peers, and personal choice factors were all significantly associated with anesthesiologist job satisfaction. Improvements in factors related to job satisfaction among anesthesiologists may lead to higher early and current career satisfaction. Copyright © 2013 Elsevier Inc. All rights reserved.

Assessing the Learning Environment for Medical Students: An Evaluation of a Novel Survey Instrument in Four Medical Schools.

PubMed

Pololi, Linda H; Evans, Arthur T; Nickell, Leslie; Reboli, Annette C; Coplit, Lisa D; Stuber, Margaret L; Vasiliou, Vasilia; Civian, Janet T; Brennan, Robert T

2017-06-01

A practical, reliable, and valid instrument is needed to measure the impact of the learning environment on medical students' well-being and educational experience and to meet medical school accreditation requirements. From 2012 to 2015, medical students were surveyed at the end of their first, second, and third year of studies at four medical schools. The survey assessed students' perceptions of the following nine dimensions of the school culture: vitality, self-efficacy, institutional support, relationships/inclusion, values alignment, ethical/moral distress, work-life integration, gender equity, and ethnic minority equity. The internal reliability of each of the nine dimensions was measured. Construct validity was evaluated by assessing relationships predicted by our conceptual model and prior research. Assessment was made of whether the measurements were sensitive to differences over time and across institutions. Six hundred and eighty-six students completed the survey (49 % women; 9 % underrepresented minorities), with a response rate of 89 % (range over the student cohorts 72-100 %). Internal consistency of each dimension was high (Cronbach's α 0.71-0.86). The instrument was able to detect significant differences in the learning environment across institutions and over time. Construct validity was supported by demonstrating several relationships predicted by our conceptual model. The C-Change Medical Student Survey is a practical, reliable, and valid instrument for assessing the learning environment of medical students. Because it is sensitive to changes over time and differences across institution, results could potentially be used to facilitate and monitor improvements in the learning environment of medical students.

[MISSCARE Survey - Italian Version: findings from an Italian validation study].

PubMed

Sist, Luisa; Contini, Carla; Bandini, Anna; Bandini, Stefania; Massa, Licia; Zanin, Roberta; Maricchio, Rita; Gianesini, Gloria; Bassi, Erika; Tartaglini, Daniela; Palese, Alvisa; Ferraresi, Annamaria

2017-01-01

The Missed Nursing Care (MNC) refers to nursing interventions that are not completed, partially completed, or postponed. Despite the relevance of MNC, no assessment tools are available in the Italian context, and no data regarding the occurrence of this phenomenon has been documented on a large scale to date. The study aims were: (1) to validate the Italian version of the MISSCARE Survey tool; (2) to measure the prevalence of missed interventions and reasons for missed care as perceived by clinical nurses working in Italian health care settings. After having conducted the forward and backward translation, pre-pilot and pilot phases were developed to ensure face and content validity as well as semantic and conceptual equivalence of the Italian version with the original version. The MISSCARE survey questionnaire was then distributed to 1,233 clinical nurses of whom 1,003 completed the questionnaire. Overall, 979 questionnaires were analysed. The questionnaires were completed from January to March 2012, by nurses working in medical and surgical hospital departments in the Emilia Romagna region of Italy. Construct validity and internal consistency of the instrument were assessed. The face and content validity were ascertained by a group of experts. The instrument acceptability was good given that 79.4% of respondents replied to all items. Construct validity was investigated by an Exploratory Factor Analysis. Four factors explaining 64.18% of variance emerged: communication, lack of facilities/supplies, lack of staff, and unexpected events. Internal consistency, evaluated with Cronbach a, was 0.94. The nursing interventions omitted with greater frequency were, in order: ambulation (74.8%), passive mobilization (69.6%) and oral care (51.3%). The three main reasons for missed interventions were: an unexpected increase in the number of patients (90.5%), increased instability of the clinical condition (86.1%) and insufficient human resources (85.5%). The Italian version of

The Design and Validation of the Colorado Learning Attitudes about Science Survey

NASA Astrophysics Data System (ADS)

Adams, W. K.; Perkins, K. K.; Dubson, M.; Finkelstein, N. D.; Wieman, C. E.

2005-09-01

The Colorado Learning Attitudes about Science Survey (CLASS) is a new instrument designed to measure various facets of student attitudes and beliefs about learning physics. This instrument extends previous work by probing additional facets of student attitudes and beliefs. It has been written to be suitably worded for students in a variety of different courses. This paper introduces the CLASS and its design and validation studies, which include analyzing results from over 2400 students, interviews and factor analyses. Methodology used to determine categories and how to analyze the robustness of categories for probing various facets of student learning are also described. This paper serves as the foundation for the results and conclusions from the analysis of our survey data.

Validation of the Hospital Ethical Climate Survey for older people care.

PubMed

Suhonen, Riitta; Stolt, Minna; Katajisto, Jouko; Charalambous, Andreas; Olson, Linda L

2015-08-01

The exploration of the ethical climate in the care settings for older people is highlighted in the literature, and it has been associated with various aspects of clinical practice and nurses' jobs. However, ethical climate is seldom studied in the older people care context. Valid, reliable, feasible measures are needed for the measurement of ethical climate. This study aimed to test the reliability, validity, and sensitivity of the Hospital Ethical Climate Survey in healthcare settings for older people. A non-experimental cross-sectional study design was employed, and a survey using questionnaires, including the Hospital Ethical Climate Survey was used for data collection. Data were analyzed using descriptive statistics, inferential statistics, and multivariable methods. Survey data were collected from a sample of nurses working in the care settings for older people in Finland (N = 1513, n = 874, response rate = 58%) in 2011. This study was conducted according to good scientific inquiry guidelines, and ethical approval was obtained from the university ethics committee. The mean score for the Hospital Ethical Climate Survey total was 3.85 (standard deviation = 0.56). Cronbach's alpha was 0.92. Principal component analysis provided evidence for factorial validity. LISREL provided evidence for construct validity based on goodness-of-fit statistics. Pearson's correlations of 0.68-0.90 were found between the sub-scales and the Hospital Ethical Climate Survey. The Hospital Ethical Climate Survey was found able to reveal discrimination across care settings and proved to be a valid and reliable tool for measuring ethical climate in care settings for older people and sensitive enough to reveal variations across various clinical settings. The Finnish version of the Hospital Ethical Climate Survey, used mainly in the hospital settings previously, proved to be a valid instrument to be used in the care settings for older people. Further studies are due to analyze the factor

A Follow-Up Study of "Teacher Beliefs Survey": A Psychometric Investigation of the Instrument and Its Educational Implications.

ERIC Educational Resources Information Center

Benjamin, Jane; Petersen, Naomi Jeffery; Sink, Chris; Walker, Brenda

The construct validity of the revised Teacher Beliefs Survey (TBS) (S. Woolley and A. Woolley, 1999) was examined, and the populations that can use this instrument reliably were explored in this study. The TBS was designed to identify the dimensions of classroom practices. The revised instrument, which contained additional subscale items, was…

An Attitude Scale on Individual Instrument and Individual Instrument Course: Validity-Reliability Research

ERIC Educational Resources Information Center

Kuçukosmanoglu, Hayrettin Onur

2015-01-01

The main purpose of this study is to develop a scale to determine students' attitude levels on individual instruments and individual instrument courses in instrument training, which is an important dimension of music education, and to conduct a validity-reliability research of the scale that has been developed. The scale consists of 16 items. The…

Head and neck cancer-specific quality of life: instrument validation.

PubMed

Terrell, J E; Nanavati, K A; Esclamado, R M; Bishop, J K; Bradford, C R; Wolf, G T

1997-10-01

The disfigurement and dysfunction associated with head and neck cancer affect emotional well-being and some of the most basic functions of life. Most cancer-specific quality-of-life assessments give a single composite score for head and neck cancer-related quality of life. To develop and evaluate an improved multidimensional instrument to assess head and neck cancer-related functional status and well-being. The item selection process included literature review, interviews with health care workers, and patient surveys. A survey with 37 disease-specific questions and the SF-12 survey were administered to 253 patients in 3 large medical centers. Factor analysis was performed to identify disease-specific domains. Domain scores were calculated as the standardized score of the component items. These domains were assessed for construct validity based on clinical hypotheses and test-retest reliability. Four relevant domains were identified: Eating (6 items), Communication (4 items), Pain (4 items), and Emotion (6 items). Each had an internal consistency (Cronbach alpha value) of greater than 0.80. Construct validity was demonstrated by moderate correlations with the SF-12 Physical and Mental component scores (r=0.43-0.60). Test-retest reliability for each domain demonstrated strong reliability between the 2 time points. Correlations were strong for each individual question, ranging from 0.53 to 0.93. Construct validity testing demonstrated that the direction of differences for each domain were as hypothesized. The Head and Neck Quality of Life questionnaire is a promising multidimensional tool with which to assess head and neck cancer-specific quality of life.

Validation study of the Colorado Learning Attitudes about Science Survey at a Hispanic-serving institution

NASA Astrophysics Data System (ADS)

Sawtelle, Vashti; Brewe, Eric; Kramer, Laird

2009-12-01

The Colorado Learning Attitudes about Science Survey (CLASS) has been widely acknowledged as a useful measure of student cognitive attitudes about science and learning. The initial University of Colorado validation study included only 20% non-Caucasian student populations. In this Brief Report we extend their validation to include a predominately under-represented minority population. We validated the CLASS instrument at Florida International University, a Hispanic-serving institution, by interviewing students in introductory physics classes using a semistructured protocol, examining students’ responses on the CLASS item statements, and comparing them to the items’ intended meaning. We find that in our predominately Hispanic population, 94% of the students’ interview responses indicate that the students interpret the CLASS items correctly, and thus the CLASS is a valid instrument. We also identify one potentially problematic item in the instrument which one third of the students interviewed consistently misinterpreted.

Validation of an instrument to measure moral distress within the Australian residential and community care environments.

PubMed

Burston, Adam; Eley, Robert; Parker, Deborah; Tuckett, Anthony

2017-06-01

The aim of this study was to gain insight into the experience of moral distress within the aged care workforce. The objective of this study was to use and validate an existing instrument to measure moral distress within the aged care setting. Moral distress, a phenomenon associated with worker satisfaction and retention, is common within nursing. Instruments to measure moral distress exist; however, there are no validated instruments to measure moral distress within an aged care setting. An existing instrument, the Moral Distress Scale (Revised) was identified and amended. Amendments were subject to expert review for face and content validity. Data were collected from aged care nurses working in residential and community aged care, in Australia. Reliability was assessed using Cronbach's alpha with exploratory factor analysis undertaken for construct validity. 106 participants completed the survey, 93 (87.7%) identified as female and 13 (12.3%) male. Participants ranged in age from 21 to 73 years, with a mean time working in nursing of 20.6 years. The frequency component of the instrument demonstrated an alpha of 0.89, the intensity component 0.95 and the instrument as a whole 0.94. Three factors were identified and labelled as: Quality of Care, Capacity of Team and Professional Practice. Mean scores indicate a low occurrence of moral distress, but this distress, when experienced, was felt with a moderate level of intensity. Primary causes of moral distress were insufficient staff competency levels, poor quality care because of poor communication and delays in implementing palliation. The instrument demonstrates validity and reliability within the Australian aged care setting. Further analysis with larger populations is required to support these findings. Australian aged care workers do experience moral distress. They suffer adverse consequences of this distress and quality of care is negatively impacted. This newly validated instrument can be used to quantify the

The Servant Leadership Survey: Development and Validation of a Multidimensional Measure.

PubMed

van Dierendonck, Dirk; Nuijten, Inge

2011-09-01

PURPOSE: The purpose of this paper is to describe the development and validation of a multi-dimensional instrument to measure servant leadership. DESIGN/METHODOLOGY/APPROACH: Based on an extensive literature review and expert judgment, 99 items were formulated. In three steps, using eight samples totaling 1571 persons from The Netherlands and the UK with a diverse occupational background, a combined exploratory and confirmatory factor analysis approach was used. This was followed by an analysis of the criterion-related validity. FINDINGS: The final result is an eight-dimensional measure of 30 items: the eight dimensions being: standing back, forgiveness, courage, empowerment, accountability, authenticity, humility, and stewardship. The internal consistency of the subscales is good. The results show that the Servant Leadership Survey (SLS) has convergent validity with other leadership measures, and also adds unique elements to the leadership field. Evidence for criterion-related validity came from studies relating the eight dimensions to well-being and performance. IMPLICATIONS: With this survey, a valid and reliable instrument to measure the essential elements of servant leadership has been introduced. ORIGINALITY/VALUE: The SLS is the first measure where the underlying factor structure was developed and confirmed across several field studies in two countries. It can be used in future studies to test the underlying premises of servant leadership theory. The SLS provides a clear picture of the key servant leadership qualities and shows where improvements can be made on the individual and organizational level; as such, it may also offer a valuable starting point for training and leadership development.

42 CFR 488.7 - Validation survey.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 42 Public Health 5 2014-10-01 2014-10-01 false Validation survey. 488.7 Section 488.7 Public...) STANDARDS AND CERTIFICATION SURVEY, CERTIFICATION, AND ENFORCEMENT PROCEDURES General Provisions § 488.7 Validation survey. (a) Basis for survey. CMS may require a survey of an accredited provider or supplier to...

42 CFR 488.7 - Validation survey.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 42 Public Health 5 2012-10-01 2012-10-01 false Validation survey. 488.7 Section 488.7 Public...) STANDARDS AND CERTIFICATION SURVEY, CERTIFICATION, AND ENFORCEMENT PROCEDURES General Provisions § 488.7 Validation survey. (a) Basis for survey. CMS may require a survey of an accredited provider or supplier to...

42 CFR 488.7 - Validation survey.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 42 Public Health 5 2013-10-01 2013-10-01 false Validation survey. 488.7 Section 488.7 Public...) STANDARDS AND CERTIFICATION SURVEY, CERTIFICATION, AND ENFORCEMENT PROCEDURES General Provisions § 488.7 Validation survey. (a) Basis for survey. CMS may require a survey of an accredited provider or supplier to...

42 CFR 488.7 - Validation survey.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 5 2010-10-01 2010-10-01 false Validation survey. 488.7 Section 488.7 Public...) STANDARDS AND CERTIFICATION SURVEY, CERTIFICATION, AND ENFORCEMENT PROCEDURES General Provisions § 488.7 Validation survey. (a) Basis for survey. CMS may require a survey of an accredited provider or supplier to...

42 CFR 488.7 - Validation survey.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 42 Public Health 5 2011-10-01 2011-10-01 false Validation survey. 488.7 Section 488.7 Public...) STANDARDS AND CERTIFICATION SURVEY, CERTIFICATION, AND ENFORCEMENT PROCEDURES General Provisions § 488.7 Validation survey. (a) Basis for survey. CMS may require a survey of an accredited provider or supplier to...

10 CFR 35.2061 - Records of radiation survey instrument calibrations.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 1 2012-01-01 2012-01-01 false Records of radiation survey instrument calibrations. 35... § 35.2061 Records of radiation survey instrument calibrations. A licensee shall maintain a record of radiation survey instrument calibrations required by § 35.61 for 3 years. The record must include the model...

10 CFR 35.2061 - Records of radiation survey instrument calibrations.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 1 2010-01-01 2010-01-01 false Records of radiation survey instrument calibrations. 35... § 35.2061 Records of radiation survey instrument calibrations. A licensee shall maintain a record of radiation survey instrument calibrations required by § 35.61 for 3 years. The record must include the model...

10 CFR 35.2061 - Records of radiation survey instrument calibrations.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 10 Energy 1 2013-01-01 2013-01-01 false Records of radiation survey instrument calibrations. 35... § 35.2061 Records of radiation survey instrument calibrations. A licensee shall maintain a record of radiation survey instrument calibrations required by § 35.61 for 3 years. The record must include the model...

10 CFR 35.2061 - Records of radiation survey instrument calibrations.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 1 2011-01-01 2011-01-01 false Records of radiation survey instrument calibrations. 35... § 35.2061 Records of radiation survey instrument calibrations. A licensee shall maintain a record of radiation survey instrument calibrations required by § 35.61 for 3 years. The record must include the model...

10 CFR 35.2061 - Records of radiation survey instrument calibrations.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 10 Energy 1 2014-01-01 2014-01-01 false Records of radiation survey instrument calibrations. 35... § 35.2061 Records of radiation survey instrument calibrations. A licensee shall maintain a record of radiation survey instrument calibrations required by § 35.61 for 3 years. The record must include the model...

Validation of an instrument to measure older adults' expectations regarding movement (ERM).

PubMed

Dahodwala, Nabila; Karlawish, Jason; Shea, Judy A; Zubritsky, Cynthia; Stern, Matthew; Mandell, David S

2012-01-01

Many individuals with Parkinson's disease are not diagnosed and treated. Attitudes about aging and related help-seeking may affect the timely diagnosis of Parkinson's disease. Our objectives were to develop measures of older adults' expectations regarding movement with aging, specifically related to parkinsonism, and their beliefs about seeking healthcare for the diagnosis and treatment of parkinsonism. We established content and face validity from interviews with experts, review of the literature, and pre-testing with key informants. Two 9-item instruments resulted: Expectations Regarding Movement (ERM) and Healthcare Seeking Beliefs for parkinsonism (HSB). These instruments were administered to 210 older adults at senior centers to investigate internal consistency and construct validity. 192 (91%) of the older adults completed more than 90% of the survey. The mean age was 76; 17 (9%) reported parkinsonism. Both scales demonstrated good internal consistency (α = 0.90). Factor analysis supported construct validity of the ERM and HSB scores. Older age, lower education, worse self-reported health and African American race each were associated with lower ERM scores, but not HSB scores. The ERM, a brief measure of expectations regarding movement with aging, shows reliability and validity. This scale may be useful in identifying older adults at increased risk for under-identification of Parkinson's disease. Further work is needed to measure healthcare seeking for parkinsonism.

Development and Validation of the Biobanking Attitudes and Knowledge Survey (BANKS)

PubMed Central

Wells, Kristen J.; Arevalo, Mariana; Meade, Cathy D.; Gwede, Clement K.; Quinn, Gwendolyn P.; Luque, John S.; Miguel, Gloria San; Watson, Dale; Phillips, Rebecca; Reyes, Carmen; Romo, Margarita; West, Jim; Jacobsen, Paul B.

2014-01-01

Background No validated multi-scale instruments exist that measure community members’ views on biobanking and biospecimen donation. This study describes the development and psychometric properties of the English-language BANKS (Biobanking Attitudes aNd Knowledge Survey). Methods The BANKS was created by item generation through review of scientific literature, focus groups with community members, and input from a community advisory board. Items were refined through cognitive interviews. Content validity was assessed through an expert panel review. Psychometric properties of the BANKS were assessed in a sample of 85 community members. Results The final BANKS includes 3 scales: Attitudes, Knowledge, and Self-Efficacy; as well as 3 single items, which evaluated receptivity and intention to donate a biospecimen for research. Cronbach's alpha coefficients for two scales that use Likert response format indicated high internal consistency (Attitudes: α=.88; Self-Efficacy: α=.95). Content validity indices were moderate, ranging from 0.69 to 0.89. Intention to donate blood and intention to donate urine were positively correlated with attitudes, knowledge, self-efficacy, and receptivity to learning more about biobanking (p's range from .029 to <.001). Conclusions The final BANKS shows evidence of satisfactory reliability and validity, is easy to administer, and is a promising tool to inform biospecimen research. Additional studies should be conducted with larger samples considering biospecimen donation to further assess the instrument's reliability and validity. Impact A valid and reliable instrument measuring community members’ views about biobanking may help researchers evaluate relevant communication interventions to enhance understanding, intention, and actual biospecimen donation. A Spanish-language BANKS is under development. PMID:24609846

Calendar Instruments in Retrospective Web Surveys

ERIC Educational Resources Information Center

Glasner, Tina; van der Vaart, Wander; Dijkstra, Wil

2015-01-01

Calendar instruments incorporate aided recall techniques such as temporal landmarks and visual time lines that aim to reduce response error in retrospective surveys. Those calendar instruments have been used extensively in off-line research (e.g., computer-aided telephone interviews, computer assisted personal interviewing, and paper and pen…

Validation of the "Quality of Life in School" instrument in Canadian elementary school students.

PubMed

Ghotra, Satvinder; McIsaac, Jessie-Lee D; Kirk, Sara F L; Kuhle, Stefan

2016-01-01

Background. School is an integral component of the life of a child, and thus quality of school life is an important part of the overall quality of life experienced by a child. There are a few instruments available to measure the quality of school life but they are often not available in English, or they are not appropriate for use alongside other instruments in a survey of young children. The Quality of Life in School (QoLS) instrument is a short, self-report measure to assess elementary school students' perception of their quality of school life in four domains. The instrument was developed in Israel and has been validated among Hebrew-speaking children. The aim of the current study was to evaluate the psychometric properties of the QoLS measure in Canadian elementary school children. Methods. A total of 629 children attending grades 4-6 were recruited in a population-based cross-sectional study. The QoLS measure was administered to participating children by trained research assistants. In addition, their socio-demographic details and academic data were also obtained. The psychometric testing included exploratory factor analysis and reliability estimation using internal consistency (Cronbach's Alpha). Construct validity was investigated using the known groups comparisons for discriminative validity and via convergent validity. Results. A four-factor structure was generated explaining 39% of the total variance in the model. The results showed good internal consistency and acceptable floor and ceiling effects. Cronbach's Alpha ranged from 0.75 to 0.93. Known groups comparisons showed that the QoLS measure discriminated well between subgroups on the basis of gender, grade, and academic achievement, thus providing evidence of construct validity. The convergent validity was also appropriate with all the four domains demonstrating moderate to strong correlations to each other and to the total QoLS score. Conclusions. QoLS appears to be a valid and reliable measure for

Instrument development and validation of a quality scale for historical research papers (QSHRP): a pilot study.

PubMed

Kelly, Jacinta; Watson, Roger

2014-12-01

To report a pilot study for the development and validation of an instrument to measure quality in historical research papers. There are no set criteria to assess historical papers published in nursing journals. A three phase mixed method sequential confirmatory design. In 2012, we used a three-phase approach to item generation and content evaluation. In phase 1, we consulted nursing historians using an online survey comprising three open-ended questions and revised the items. In phase 2, we evaluated the revised items for relevance with expert historians using a 4-point Likert scale and Content Validity Index calculation. In phase 3, we conducted reliability testing of the instrument using a 3-point Likert scale. In phase 1, 121 responses were generated via the online survey and revised to 40 interrogatively phrased items. In phase 2, five items with an Item Content Validity Index score of ≥0·7 remained. In phase 3, responses from historians resulted in 100% agreement to questions 1, 2 and 4 and 89% and 78%, respectively, to questions 3 and 5. Items for the QSHRP have been identified, content validated and reliability tested. This scale improves on previous scales, which over-emphasized source criticism. However, a full-scale study is needed with nursing historians to increase its robustness. © 2014 John Wiley & Sons Ltd.

Validation of an instrument to evaluate health promotion at schools

PubMed Central

Pinto, Raquel Oliveira; Pattussi, Marcos Pascoal; Fontoura, Larissa do Prado; Poletto, Simone; Grapiglia, Valenca Lemes; Balbinot, Alexandre Didó; Teixeira, Vanessa Andina; Horta, Rogério Lessa

2016-01-01

ABSTRACT OBJECTIVE To validate an instrument designed to assess health promotion in the school environment. METHODS A questionnaire, based on guidelines from the World Health Organization and in line with the Brazilian school health context, was developed to validate the research instrument. There were 60 items in the instrument that included 40 questions for the school manager and 20 items with direct observations made by the interviewer. The items’ content validation was performed using the Delphi technique, with the instrument being applied in 53 schools from two medium-sized cities in the South region of Brazil. Reliability (Cronbach’s alpha and split-half) and validity (principal component analysis) analyses were performed. RESULTS The final instrument remained composed of 28 items, distributed into three dimensions: pedagogical, structural and relational. The resulting components showed good factorial loads (> 0.4) and acceptable reliability (> 0.6) for most items. The pedagogical dimension identifies educational activities regarding drugs and sexuality, violence and prejudice, auto care and peace and quality of life. The structural dimension is comprised of access, sanitary structure, and conservation and equipment. The relational dimension includes relationships within the school and with the community. CONCLUSIONS The proposed instrument presents satisfactory validity and reliability values, which include aspects relevant to promote health in schools. Its use allows the description of the health promotion conditions to which students from each educational institution are exposed. Because this instrument includes items directly observed by the investigator, it should only be used during periods when there are full and regular activities at the school in question. PMID:26982958

Creation and use of a survey instrument for comparing mobile computing devices.

PubMed

Macri, Jennifer M; Lee, Paul P; Silvey, Garry M; Lobach, David F

2005-01-01

Both personal digital assistants (PDAs) and tablet computers have emerged to facilitate data collection at the point of care. However, little research has been reported comparing these mobile computing devices in specific care settings. In this study we present an approach for comparing functionally identical applications on a Palm operating system-based PDA and a Windows-based tablet computer for point-of-care documentation of clinical observations by eye care professionals when caring for patients with diabetes. Eye-care professionals compared the devices through focus group sessions and through validated usability surveys. This poster describes the development and use of the survey instrument used for comparing mobile computing devices.

Actual curriculum development practices instrument: Testing for factorial validity

NASA Astrophysics Data System (ADS)

Foi, Liew Yon; Bakar, Kamariah Abu; Hamzah, Mohd Sahandri Gani; Alwi, Nor Hayati

2014-09-01

The Actual Curriculum Development Practices Instrument (ACDP-I) was developed and the factorial validity of the ACDP-I was tested (n = 107) using exploratory factor analysis procedures in the earlier work of [1]. Despite the ACDP-I appears to be content and construct valid instrument with very high internal reliability qualities for using in Malaysia, the accumulated evidences are still needed to provide a sound scientific basis for the proposed score interpretations. Therefore, the present study addresses this concern by utilising the confirmatory factor analysis to further confirm the theoretical structure of the variable Actual Curriculum Development Practices (ACDP) and enrich the psychometrical properties of ACDP-I. Results of this study have practical implication to both researchers and educators whose concerns focus on teachers' classroom practices and the instrument development and validation process.

Assessing quality of maternity care in Hungary: expert validation and testing of the mother-centered prenatal care (MCPC) survey instrument.

PubMed

Rubashkin, Nicholas; Szebik, Imre; Baji, Petra; Szántó, Zsuzsa; Susánszky, Éva; Vedam, Saraswathi

2017-11-16

Instruments to assess quality of maternity care in Central and Eastern European (CEE) region are scarce, despite reports of poor doctor-patient communication, non-evidence-based care, and informal cash payments. We validated and tested an online questionnaire to study maternity care experiences among Hungarian women. Following literature review, we collated validated items and scales from two previous English-language surveys and adapted them to the Hungarian context. An expert panel assessed items for clarity and relevance on a 4-point ordinal scale. We calculated item-level Content Validation Index (CVI) scores. We designed 9 new items concerning informal cash payments, as well as 7 new "model of care" categories based on mode of payment. The final questionnaire (N = 111 items) was tested in two samples of Hungarian women, representative (N = 600) and convenience (N = 657). We conducted bivariate analysis and thematic analysis of open-ended responses. Experts rated pre-existing English-language items as clear and relevant to Hungarian women's maternity care experiences with an average CVI for included questions of 0.97. Significant differences emerged across the model of care categories in terms of informal payments, informed consent practices, and women's perceptions of autonomy. Thematic analysis (N = 1015) of women's responses identified 13 priority areas of the maternity care experience, 9 of which were addressed by the questionnaire. We developed and validated a comprehensive questionnaire that can be used to evaluate respectful maternity care, evidence-based practice, and informal cash payments in CEE region and beyond.

The creation and validation of an instrument to measure school STEM Culture

NASA Astrophysics Data System (ADS)

White, Christopher

Although current research exists on school culture, there is a gap in the literature on specialized aspects of culture such as STEM Culture defined as the beliefs, values, practices, resources, and challenges in STEM fields (Science, Technology, Engineering and Mathematics) within a school. The objective of this study was to create a valid and reliable instrument, the STEM Culture Assessment Tool (STEM-CAT), that measures this cultural aspect based on a survey of stakeholder groups within the school community and use empirical data to support the use of this instrument to measure STEM Culture. Items were created and face validity was determined through a focus group and expert review before a pilot study was conducted to determine reliability of the items. Once items were determined reliable, the survey was given to eight high schools and results were correlated to the percentage of seniors who self-reported whether they intend to pursue STEM fields upon graduation. The results of this study indicate further need for research to determine how the STEM-CAT correlates to STEM culture due to some inconsistencies with the dependent variable in this study. Future research could be done correlating the results of the STEM-CAT with participation in Advanced Placement science and mathematics, SAT/ACT scores in science and mathematics or the number of students who actually pursue STEM fields rather than a prediction halfway through the 12th grade.

New Faculty Survey Instrument.

ERIC Educational Resources Information Center

National Center on Postsecondary Teaching, Learning, and Assessment, University Park, PA.

This publication is a survey to be used by institutions of higher education in the United States in creating a profile of new faculty. An introduction notes that this instrument was administered at 5 schools (2 liberal arts colleges, a community college, a comprehensive university, and a research university) and that 53 percent of the respondents…

Content validity of the Geriatric Health Assessment Instrument

PubMed Central

Pedreira, Rhaine Borges Santos; Rocha, Saulo Vasconcelos; dos Santos, Clarice Alves; Vasconcelos, Lélia Renata Carneiro; Reis, Martha Cerqueira

2016-01-01

ABSTRACT Objective Assess the content validity of the Elderly Health Assessment Tool with low education. Methods The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as “not valid”, “somewhat valid” or “valid”, using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. Results The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. Conclusion The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly. PMID:27462889

Development and validation of instrument for ergonomic evaluation of tablet arm chairs

PubMed Central

Tirloni, Adriana Seára; dos Reis, Diogo Cunha; Bornia, Antonio Cezar; de Andrade, Dalton Francisco; Borgatto, Adriano Ferreti; Moro, Antônio Renato Pereira

2016-01-01

The purpose of this study was to develop and validate an evaluation instrument for tablet arm chairs based on ergonomic requirements, focused on user perceptions and using Item Response Theory (IRT). This exploratory study involved 1,633 participants (university students and professors) in four steps: a pilot study (n=26), semantic validation (n=430), content validation (n=11) and construct validation (n=1,166). Samejima's graded response model was applied to validate the instrument. The results showed that all the steps (theoretical and practical) of the instrument's development and validation processes were successful and that the group of remaining items (n=45) had a high consistency (0.95). This instrument can be used in the furniture industry by engineers and product designers and in the purchasing process of tablet arm chairs for schools, universities and auditoriums. PMID:28337099

Reliability and validity of a Tutorial Group Effectiveness Instrument.

PubMed

Singaram, Veena S; Van Der Vleuten, Cees P M; Van Berkel, Henk; Dolmans, Diana H J M

2010-01-01

Tutorial group effectiveness is essential for the success of learning in problem-based learning (PBL). Less effective and dysfunctional groups compromise the quality of students learning in PBL. This article aims to report on the reliability and validity of an instrument aimed at measuring tutorial group effectiveness in PBL. The items within the instrument are clustered around motivational and cognitive factors based on Slavin's theoretical framework. A confirmatory factor analysis (CFA) was carried out to estimate the validity of the instrument. Furthermore, generalizability studies were conducted and alpha coefficients were computed to determine the reliability and homogeneity of each factor. The CFA indicated that a three-factor model comprising 19 items showed a good fit with the data. Alpha coefficients per factor were high. The findings of the generalizability studies indicated that at least 9-10 student responses are needed in order to obtain reliable data at the tutorial group level. The instrument validated in this study has the potential to provide faculty and students with diagnostic information and feedback about student behaviors that enhance and hinder tutorial group effectiveness.

Assessing the Culture of Residency Using the C - Change Resident Survey: Validity Evidence in 34 U.S. Residency Programs.

PubMed

Pololi, Linda H; Evans, Arthur T; Civian, Janet T; Shea, Sandy; Brennan, Robert T

2017-07-01

A practical instrument is needed to reliably measure the clinical learning environment and professionalism for residents. To develop and present evidence of validity of an instrument to assess the culture of residency programs and the clinical learning environment. During 2014-2015, we surveyed residents using the C - Change Resident Survey to assess residents' perceptions of the culture in their programs. Residents in all years of training in 34 programs in internal medicine, pediatrics, and general surgery in 14 geographically diverse public and private academic health systems. The C - Change Resident Survey assessed residents' perceptions of 13 dimensions of the culture: Vitality, Self-Efficacy, Institutional Support, Relationships/Inclusion, Values Alignment, Ethical/Moral Distress, Respect, Mentoring, Work-Life Integration, Gender Equity, Racial/Ethnic Minority Equity, and self-assessed Competencies. We measured the internal reliability of each of the 13 dimensions and evaluated response process, content validity, and construct-related evidence validity by assessing relationships predicted by our conceptual model and prior research. We also assessed whether the measurements were sensitive to differences in specialty and across institutions. A total of 1708 residents completed the survey [internal medicine: n = 956, pediatrics: n = 411, general surgery: n = 311 (51% women; 16% underrepresented in medicine minority)], with a response rate of 70% (range across programs, 51-87%). Internal consistency of each dimension was high (Cronbach α: 0.73-0.90). The instrument was able to detect significant differences in the learning environment across programs and sites. Evidence of validity was supported by a good response process and the demonstration of several relationships predicted by our conceptual model. The C - Change Resident Survey assesses the clinical learning environment for residents, and we encourage further study of validity in different

Validation of the Family Inpatient Communication Survey.

PubMed

Torke, Alexia M; Monahan, Patrick; Callahan, Christopher M; Helft, Paul R; Sachs, Greg A; Wocial, Lucia D; Slaven, James E; Montz, Kianna; Inger, Lev; Burke, Emily S

2017-01-01

Although many family members who make surrogate decisions report problems with communication, there is no validated instrument to accurately measure surrogate/clinician communication for older adults in the acute hospital setting. The objective of this study was to validate a survey of surrogate-rated communication quality in the hospital that would be useful to clinicians, researchers, and health systems. After expert review and cognitive interviewing (n = 10 surrogates), we enrolled 350 surrogates (250 development sample and 100 validation sample) of hospitalized adults aged 65 years and older from three hospitals in one metropolitan area. The communication survey and a measure of decision quality were administered within hospital days 3 and 10. Mental health and satisfaction measures were administered six to eight weeks later. Factor analysis showed support for both one-factor (Total Communication) and two-factor models (Information and Emotional Support). Item reduction led to a final 30-item scale. For the validation sample, internal reliability (Cronbach's alpha) was 0.96 (total), 0.94 (Information), and 0.90 (Emotional Support). Confirmatory factor analysis fit statistics were adequate (one-factor model, comparative fit index = 0.981, root mean square error of approximation = 0.62, weighted root mean square residual = 1.011; two-factor model comparative fit index = 0.984, root mean square error of approximation = 0.055, weighted root mean square residual = 0.930). Total score and subscales showed significant associations with the Decision Conflict Scale (Pearson correlation -0.43, P < 0.001 for total score). Emotional Support was associated with improved mental health outcomes at six to eight weeks, such as anxiety (-0.19 P < 0.001), and Information was associated with satisfaction with the hospital stay (0.49, P < 0.001). The survey shows high reliability and validity in measuring communication experiences for hospital surrogates. The

The Need, Development, and Validation of the Innovation Test Instrument

ERIC Educational Resources Information Center

Wheadon, Jacob; Wright, Geoff A.; West, Richard E.; Skaggs, Paul

2017-01-01

This study discusses the need, development, and validation of the Innovation Test Instrument (ITI). This article outlines how the researchers identified the content domain of the assessment and created test items. Then, it describes initial validation testing of the instrument. The findings suggest that the ITI is a good first step in creating an…

Validation of Reverse-Engineered and Additive-Manufactured Microsurgical Instrument Prototype.

PubMed

Singh, Ramandeep; Suri, Ashish; Anand, Sneh; Baby, Britty

2016-12-01

With advancements in imaging techniques, neurosurgical procedures are becoming highly precise and minimally invasive, thus demanding development of new ergonomically aesthetic instruments. Conventionally, neurosurgical instruments are manufactured using subtractive manufacturing methods. Such a process is complex, time-consuming, and impractical for prototype development and validation of new designs. Therefore, an alternative design process has been used utilizing blue light scanning, computer-aided designing, and additive manufacturing direct metal laser sintering (DMLS) for microsurgical instrument prototype development. Deviations of DMLS-fabricated instrument were studied by superimposing scan data of fabricated instrument with the computer-aided designing model. Content and concurrent validity of the fabricated prototypes was done by a group of 15 neurosurgeons by performing sciatic nerve anastomosis in small laboratory animals. Comparative scoring was obtained for the control and study instrument. T test was applied to the individual parameters and P values for force (P < .0001) and surface roughness (P < .01) were found to be statistically significant. These 2 parameters were further analyzed using objective measures. Results depicts that additive manufacturing by DMLS provides an effective method for prototype development. However, direct application of these additive-manufactured instruments in the operating room requires further validation. © The Author(s) 2016.

Validation of problem drinking screening instruments for DWI offenders

DOT National Transportation Integrated Search

1999-05-01

This document summarizes the results of a validation study for five adult screening instruments in use for preliminary screening of driving while intoxicated (DWI) offenders for problem drinking. The instruments were the Driver Risk Inventory (DRI), ...

Translation, validation, and cultural adaptation of the Rhinosinusitis Disability Index and the Chronic Sinusitis Survey into Arabic.

PubMed

Aldrees, Turki; Almubarak, Zaid; Hassouneh, Basil; Albosaily, Ahamed; Aloulah, Mohammad; Almasoud, Mai; Alsaleh, Saad

2018-01-01

Disease-specific quality of life instruments assess the impact of chronic rhinosinusitis on patients' quality of life (QoL). To the extent of our knowledge, there are no Arabic versions of two instruments-the Rhinosinusitis Disability Index (RSDI) and the Chronic Sinusitis Survey (CSS). Develop an Arabic-validated version of both instruments, thus allowing its use among the Arabic population. Prospective cross-sectional study for instrument validation. Tertiary university hospital. This study was conducted between September 2015 and October 2016. We followed the international comprehensive guidelines for translation and cross-cultural adaptation of QoL instruments. Test-retest reliability, discriminant validity, and responsiveness ability of both the RSDI and CSS Arabic versions. 124. The sample comprised 75 patients diagnosed with chronic rhinosinusitis and 49 healthy control subjects. The Arabic version of both instruments showed high internal consistency (Cronbach's alpha: RSDI=0.97, CSS=.88) and the ability to differentiate between diseased and healthy volunteers (P less than .0001). The translated versions also detected significant change in response to an intervention (P less than .0001). These Arabic validated versions of the RSDI and CSS can be used for both clinical and research purposes. This study was performed in only one tertiary hospital. None.

Do College Student Surveys Have Any Validity?

ERIC Educational Resources Information Center

Porter, Stephen R.

2011-01-01

Using standards established for validation research, I review the theory and evidence underlying the validity argument of the National Survey of Student Engagement (NSSE). I use the NSSE because it is the preeminent survey of college students, arguing that if it lacks validity, then so do almost all other college student surveys. I find that it…

Addressing Participant Validity in a Small Internet Health Survey (The Restore Study): Protocol and Recommendations for Survey Response Validation

PubMed Central

Dewitt, James; Capistrant, Benjamin; Kohli, Nidhi; Mitteldorf, Darryl; Merengwa, Enyinnaya; West, William

2018-01-01

Background While deduplication and cross-validation protocols have been recommended for large Web-based studies, protocols for survey response validation of smaller studies have not been published. Objective This paper reports the challenges of survey validation inherent in a small Web-based health survey research. Methods The subject population was North American, gay and bisexual, prostate cancer survivors, who represent an under-researched, hidden, difficult-to-recruit, minority-within-a-minority population. In 2015-2016, advertising on a large Web-based cancer survivor support network, using email and social media, yielded 478 completed surveys. Results Our manual deduplication and cross-validation protocol identified 289 survey submissions (289/478, 60.4%) as likely spam, most stemming from advertising on social media. The basic components of this deduplication and validation protocol are detailed. An unexpected challenge encountered was invalid survey responses evolving across the study period. This necessitated the static detection protocol be augmented with a dynamic one. Conclusions Five recommendations for validation of Web-based samples, especially with smaller difficult-to-recruit populations, are detailed. PMID:29691203

Measuring stakeholder participation in evaluation: an empirical validation of the Participatory Evaluation Measurement Instrument (PEMI).

PubMed

Daigneault, Pierre-Marc; Jacob, Steve; Tremblay, Joël

2012-08-01

Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. This study consists of a first empirical validation of a measurement instrument that fully covers the content of participation, namely the Participatory Evaluation Measurement Instrument (PEMI). It specifically examines (1) the intercoder reliability of scores derived by two research assistants on published evaluation cases; (2) the convergence between the scores of coders and those of key respondents (i.e., authors); and (3) the convergence between the authors' scores on the PEMI and the Evaluation Involvement Scale (EIS). A purposive sample of 40 cases drawn from the evaluation literature was used to assess reliability. One author per case in this sample was then invited to participate in a survey; 25 fully usable questionnaires were received. Stakeholder participation was measured on nominal and ordinal scales. Cohen's κ, the intraclass correlation coefficient, and Spearman's ρ were used to assess reliability and convergence. Reliability results ranged from fair to excellent. Convergence between coders' and authors' scores ranged from poor to good. Scores derived from the PEMI and the EIS were moderately associated. Evidence from this study is strong in the case of intercoder reliability and ranges from weak to strong in the case of convergent validation. Globally, this suggests that the PEMI can produce scores that are both reliable and valid.

Validation of a Spanish Version of the Distance Education Learning Environments Survey (DELES) in Spain

ERIC Educational Resources Information Center

Fernández-Pascual, Maria Dolores; Ferrer-Cascales, Rosario; Reig-Ferrer, Abilio; Albaladejo-Blázquez, Natalia; Walker, Scott L.

2015-01-01

The aim of this study was to examine the validity of the Spanish version of the Distance Education Learning Environments Survey (Sp-DELES). This instrument assesses students' perceptions of virtual learning environments using six scales: Instructor Support, Student Interaction and Collaboration, Personal Relevance, Authentic Learning, Active…

[The Basel Screening Instrument for Psychosis (BSIP): development, structure, reliability and validity].

PubMed

Riecher-Rössler, A; Aston, J; Ventura, J; Merlo, M; Borgwardt, S; Gschwandtner, U; Stieglitz, R-D

2008-04-01

Early detection of psychosis is of growing clinical importance. So far there is, however, no screening instrument for detecting individuals with beginning psychosis in the atypical early stages of the disease with sufficient validity. We have therefore developed the Basel Screening Instrument for Psychosis (BSIP) and tested its feasibility, interrater-reliability and validity. Aim of this paper is to describe the development and structure of the instrument, as well as to report the results of the studies on reliability and validity. The instrument was developed based on a comprehensive search of literature on the most important risk factors and early signs of schizophrenic psychoses. The interraterreliability study was conducted on 24 psychiatric cases. Validity was tested based on 206 individuals referred to our early detection clinic from 3/1/2000 until 2/28/2003. We identified seven categories of relevance for early detection of psychosis and used them to construct a semistructured interview. Interrater-reliability for high risk individuals was high (Kappa .87). Predictive validity was comparable to other, more comprehensive instruments: 16 (32 %) of 50 individuals classified as being at risk for psychosis by the BSIP have in fact developed frank psychosis within an follow-up period of two to five years. The BSIP is the first screening instrument for the early detection of psychosis which has been validated based on transition to psychosis. The BSIP is easy to use by experienced psychiatrists and has a very good interrater-reliability and predictive validity.

Development, validity and reliability of the short multidimensional positive mental health instrument.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Abdin, Edimansyah; Picco, Louisa; Chua, Boon Yiang; Eng, Goi Khia; Sambasivam, Rajeswari; Shafie, Saleha; Zhang, Yunjue; Chong, Siow Ann

2014-06-01

The 47-item positive mental health (PMH) instrument measures the level of PMH in multiethnic adult Asian populations. This study aimed to (1) develop a short PMH instrument and (2) establish its validity and reliability among the adult Singapore population. Two separate studies were conducted among adult community-dwelling Singapore residents of Chinese, Malay or Indian ethnicity where participants completed self-administered questionnaires. In the first study, secondary data analysis was conducted using confirmatory factor analysis (CFA) to shorten the PMH instrument. In the second study, the newly developed short PMH instrument and other scales were administered to 201 residents to establish its factor structure, validity and reliability. A 20-item short PMH instrument fulfilling a higher-order six-factor structure was developed following secondary analysis. The mean age of the participants in the second study was 41 years and about 53% were women. One item with poor factor loading was further removed to generate a 19-item version of the PMH instrument. CFA demonstrated a first-order six-factor model of the short PMH instrument. The PMH-19 instrument and its subscales fulfilled criterion validity hypotheses. Internal consistency and test-retest reliability of the PMH-19 instrument were high (Cronbach's α coefficient = 0.87; intraclass correlation coefficient = 0.93, respectively). The 19-item PMH instrument is multidimensional, valid and reliable, and most importantly, with its reduced administration time, the short PMH instrument can be used to measure and evaluate PMH in Asian communities.

The Eastland Prostate Cancer Survey: instrument development and psychometric testing.

PubMed

Eastland, Taryn Y; Dancy, Barbara L

2013-03-01

African-American (AA) women could be instrumental in communicating positive prostate screening behavior to the significant males in their lives. However, little is known about AA women's prostate cancer attitudes, perceived behavioral control, subjective norms, intentions, behaviors, and knowledge regarding prostate cancer screening. This study describes the development and psychometric testing of the Eastland Prostate Cancer Survey (EPCS). A nonexperimental, correlational study with 200 AA women was used to test the psychometric properties of the six-subscale EPCS with 66 items. Construct validity, internal consistency, and test-retest reliability for the EPCS were acceptable and resulted in an eight-subscale EPCS with 56 items. Cronbach's alphas for the subscales ranged from 0.69 to 0.92. The EPCS is a culturally sensitive, gender-relevant instrument that could be used by community health providers to develop community health programs aimed at engaging AA women in the promotion of prostate cancer screening for AA men.

[Validity of an instrument for assessing food consumption, food habits and cooking skills in 8-11 years old students].

PubMed

Lera, Lydia; Fretes, Gabriela; González, Carmen Gloria; Salinas, Judith; Vio del Rio, Fernando

2015-05-01

An instrument to measure food knowledge, food consumption, cooking skills, food habits and food expenses at school is necessary to assess changes in food practices. To validate an instrument to measure changes in food knowledge, food consumption, cooking skills, food habits and food expenses in Chilean school children 8 - 11 years from third to fifth grade. A validation of a questionnaire with 42 questions was conducted in two stages: the first to assess temporal stability, concordance and internal consistency in 45 children. The second one to apply the survey, modified with the results of the first stage, in 90 children assessing internal consistency. The first survey with 42 questions showed a reasonable temporal stability, concordance and internal consistency for cooking skills, habits and food expenditure at school. Internal consistency was good for food consumption, but not so good for food knowledge. In the final validation with 90 children, there was good consistency for food consumption but bad for food knowledge. Besides, children with cooking skills ate more healthy food and those who expended more money at school, consumed less healthy food. Food knowledge questions were eliminated from the instrument, which was elaborated with 28 questions about food consumption, cooking skills, food habits and food expenses at school. This instrument is useful to assess changes in food and nutrition education interventions in 8 -11 years children, in particular to measure cooking skills and food expenses at school. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

Addressing Participant Validity in a Small Internet Health Survey (The Restore Study): Protocol and Recommendations for Survey Response Validation.

PubMed

Dewitt, James; Capistrant, Benjamin; Kohli, Nidhi; Rosser, B R Simon; Mitteldorf, Darryl; Merengwa, Enyinnaya; West, William

2018-04-24

While deduplication and cross-validation protocols have been recommended for large Web-based studies, protocols for survey response validation of smaller studies have not been published. This paper reports the challenges of survey validation inherent in a small Web-based health survey research. The subject population was North American, gay and bisexual, prostate cancer survivors, who represent an under-researched, hidden, difficult-to-recruit, minority-within-a-minority population. In 2015-2016, advertising on a large Web-based cancer survivor support network, using email and social media, yielded 478 completed surveys. Our manual deduplication and cross-validation protocol identified 289 survey submissions (289/478, 60.4%) as likely spam, most stemming from advertising on social media. The basic components of this deduplication and validation protocol are detailed. An unexpected challenge encountered was invalid survey responses evolving across the study period. This necessitated the static detection protocol be augmented with a dynamic one. Five recommendations for validation of Web-based samples, especially with smaller difficult-to-recruit populations, are detailed. ©James Dewitt, Benjamin Capistrant, Nidhi Kohli, B R Simon Rosser, Darryl Mitteldorf, Enyinnaya Merengwa, William West. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 24.04.2018.

[Reliability and construct validity of an instrument to asses the Self-perception of Family Health Status].

PubMed

Lima Rodríguez, Joaquín Salvador; Lima Serrano, Marta; Jiménez Picón, Nerea; Domínguez Sánchez, Isabel

2012-10-01

Family health determines and it is determined by family´s capacity to function effectively as a biosocial unit in a given culture and society. The main of study has been to test reliability and construct validity of an instrument to asses the Self-perception of Family Health Status. We validated its content by an on-line Dephi panel with experts. We surveyed 258 families in them homes or in primary health centres from Seville, Spain. We administered the instrument that has five Likert scales: Family climate, Family integrity, Family functioning, and Family resistance. We tested reliability by Cronbach Alpha and construct validity by exploratory factor analysis. The five scales obtained values α between 0.73 for the Family Climate and 0.89 for Family Integrity. They showed evidence of one-dimensional interpretation after factor analysis, a) all items got weights r>0.30 in first factor before rotations, b) the first factor explained a significant proportion of variance before rotations, and c) the total variance explained by the main factors extracted was greater than 50%. The scales showed their reliability and validity. They could be employed to assess the self-perception of family health status.

Development and Initial Validation of an Instrument for Human Capital Planning

ERIC Educational Resources Information Center

Zula, Kenneth J.; Chermack, Thomas J.

2008-01-01

This article reports on development and validation of an instrument for use in human capital approaches for organizational planning. The article describes use of a team of subject matter experts in developing a measure of human capital planning, and use of exploratory factor analysis techniques to validate the resulting instrument. These data were…

Quality of Work: Validation of a New Instrument in Three Languages.

PubMed

Steffgen, Georges; Kohl, Diane; Reese, Gerhard; Happ, Christian; Sischka, Philipp

2015-11-26

A new instrument to measure quality of work was developed in three languages (German, French and Luxembourgish) and validated in a study of employees working in Luxembourg. A representative sample (n = 1529) was taken and exploratory factor analysis revealed a six-factor solution for the 21-item instrument (satisfaction and respect, mobbing, mental strain at work, cooperation, communication and feedback, and appraisal). Reliability analysis showed satisfying reliability for all six factors and the total questionnaire. In order to examine the construct validity of the new instrument, regression analyses were conducted to test whether the instrument predicted work characteristics’ influence on three components of well-being -- burnout, psychological stress and maladaptive coping behaviors. The present validation offers a trilingual inventory for measuring quality of work that may be used, for example, as an assessment tool or for testing the effectiveness of interventions.

Hopes and Cautions for Instrument-Based Evaluation of Consent Capacity: Results of a Construct Validity Study of Three Instruments

PubMed Central

Moye, Jennifer; Azar, Annin R.; Karel, Michele J.; Gurrera, Ronald J.

2016-01-01

Does instrument based evaluation of consent capacity increase the precision and validity of competency assessment or does ostensible precision provide a false sense of confidence without in fact improving validity? In this paper we critically examine the evidence for construct validity of three instruments for measuring four functional abilities important in consent capacity: understanding, appreciation, reasoning, and expressing a choice. Instrument based assessment of these abilities is compared through investigation of a multi-trait multi-method matrix in 88 older adults with mild to moderate dementia. Results find variable support for validity. There appears to be strong evidence for good hetero-method validity for the measurement of understanding, mixed evidence for validity in the measurement of reasoning, and strong evidence for poor hetero-method validity for the concepts of appreciation and expressing a choice, although the latter is likely due to extreme range restrictions. The development of empirically based tools for use in capacity evaluation should ultimately enhance the reliability and validity of assessment, yet clearly more research is needed to define and measure the constructs of decisional capacity. We would also emphasize that instrument based assessment of capacity is only one part of a comprehensive evaluation of competency which includes consideration of diagnosis, psychiatric and/or cognitive symptomatology, risk involved in the situation, and individual and cultural differences. PMID:27330455

Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication

PubMed Central

Zamanzadeh, Vahid; Ghahramanian, Akram; Rassouli, Maryam; Abbaszadeh, Abbas; Alavi-Majd, Hamid; Nikanfar, Ali-Reza

2015-01-01

Introduction: The importance of content validity in the instrument psychometric and its relevance with reliability, have made it an essential step in the instrument development. This article attempts to give an overview of the content validity process and to explain the complexity of this process by introducing an example. Methods: We carried out a methodological study conducted to examine the content validity of the patient-centered communication instrument through a two-step process (development and judgment). At the first step, domain determination, sampling (item generation) and instrument formation and at the second step, content validity ratio, content validity index and modified kappa statistic was performed. Suggestions of expert panel and item impact scores are used to examine the instrument face validity. Results: From a set of 188 items, content validity process identified seven dimensions includes trust building (eight items), informational support (seven items), emotional support (five items), problem solving (seven items), patient activation (10 items), intimacy/friendship (six items) and spirituality strengthening (14 items). Content validity study revealed that this instrument enjoys an appropriate level of content validity. The overall content validity index of the instrument using universal agreement approach was low; however, it can be advocated with respect to the high number of content experts that makes consensus difficult and high value of the S-CVI with the average approach, which was equal to 0.93. Conclusion: This article illustrates acceptable quantities indices for content validity a new instrument and outlines them during design and psychometrics of patient-centered communication measuring instrument. PMID:26161370

Reliability and Validity of the Turkish Version of the Job Performance Scale Instrument.

PubMed

Harmanci Seren, Arzu Kader; Tuna, Rujnan; Eskin Bacaksiz, Feride

2018-02-01

Objective measurement of the job performance of nursing staff using valid and reliable instruments is important in the evaluation of healthcare quality. A current, valid, and reliable instrument that specifically measures the performance of nurses is required for this purpose. The aim of this study was to determine the validity and reliability of the Turkish version of the Job Performance Instrument. This study used a methodological design and a sample of 240 nurses working at different units in four hospitals in Istanbul, Turkey. A descriptive data form, the Job Performance Scale, and the Employee Performance Scale were used to collect data. Data were analyzed using IBM SPSS Statistics Version 21.0 and LISREL Version 8.51. On the basis of the data analysis, the instrument was revised. Some items were deleted, and subscales were combined. The Turkish version of the Job Performance Instrument was determined to be valid and reliable to measure the performance of nurses. The instrument is suitable for evaluating current nursing roles.

Diagnosing paratonia in the demented elderly: reliability and validity of the Paratonia Assessment Instrument (PAI).

PubMed

Hobbelen, Johannes S M; Koopmans, Raymond T C M; Verhey, Frans R J; Habraken, Kitty M; de Bie, Rob A

2008-08-01

Paratonia is one of the associated movement disorders characteristic of dementia. The aim of this study was to develop an assessment tool (the Paratonia Assessment Instrument, PAI), based on the new consensus definition of paratonia. An additional aim was to investigate the reliability and validity of the PAI. A three-phase cross-sectional survey was conducted. In the first two phases, the PAI was developed and validated. In the third phase, the inter-observer reliability and feasibility of the instrument was tested. The original PAI consisted of five criteria that all needed to be met in order to make the diagnosis. On the basis of a qualitative analysis, one criterion was reformulated and another was removed. Following this, inter-observer reliability between the two assessors resulted in an improvement of Cohen's kappa from 0.532 in the initial phase to 0.677 in the second phase. This improvement was substantiated in the third phase by two independent assessors with Cohen's kappa ranging from 0.625 to 1. The PAI is a reliable and valid assessment tool for diagnosing paratonia in elderly people with dementia that can be applied easily in daily practice.

Impact of Children’s Feeding/Swallowing Problems: Validation of a New Caregiver Instrument

PubMed Central

Okelo, Sande O.; Wright, Jennifer M.; Collaco, Joseph M.; McGrath-Morrow, Sharon A.; Eakin, Michelle N.

2015-01-01

The impact of caring for children with deglutition disorders is poorly understood and tools to measure the unique concerns of these caregivers are lacking. The aims of this investigation were to develop and validate The Feeding/Swallowing Impact Survey (FS-IS) as an instrument designed to measure and improve understanding of caregiver issues. Demographic, economic, and dysphagic data were provided by the primary caregivers of 164 children (median age: 14 months, male: 78, female: 86) presenting for initial outpatient feeding/swallowing evaluations. Caregivers completed the PEDS-QL™ Family Impact Module (PEDS-QL™ FIM) and the FS-IS. A principal component analysis was conducted on the FS-IS to identify appropriate subscales. Concurrent validity was assessed by examining correlations between the FS-IS and PEDS-QL™ FIM. Caring for children with feeding/swallowing problems adversely impacted the Health-Related Quality of Life (HRQoL) of their caregivers. The FS-IS had a strong 3-factor solution to indicate 3 subscales: Daily Activities, Worry, and Feeding Difficulties. All three sub-scales and total score of the FS-IS correlated with PEDS-QL™ FIM. The FS-IS was validated as an instrument that may help clinicians detect specific factors that influence caregiver HRQoL, identify caregivers who might benefit from additional support, and ultimately improve the care of their children with feeding/swallowing disorders. PMID:25159316

Adaptation and Validation of a Nutrition Environment Measures Survey for University Grab-and-Go Establishments.

PubMed

Lo, Brian K C; Minaker, Leia; Chan, Alicia N T; Hrgetic, Jessica; Mah, Catherine L

2016-03-01

To adapt and validate a survey instrument to assess the nutrition environment of grab-and-go establishments at a university campus. A version of the Nutrition Environment Measures Survey for grab-and-go establishments (NEMS-GG) was adapted from existing NEMS instruments and tested for reliability and validity through a cross-sectional assessment of the grab-and-go establishments at the University of Toronto. Product availability, price, and presence of nutrition information were evaluated. Cohen's kappa coefficient and intra-class correlation coefficients (ICC) were assessed for inter-rater reliability, and construct validity was assessed using the known-groups comparison method (via store scores). Fifteen grab-and-go establishments were assessed. Inter-rater reliability was high with an almost perfect agreement for availability (mean κ = 0.995) and store scores (ICC = 0.999). The tool demonstrated good face and construct validity. About half of the venues carried fruit and vegetables (46.7% and 53.3%, respectively). Regular and healthier entrée items were generally the same price. Healthier grains were cheaper than regular options. Six establishments displayed nutrition information. Establishments operated by the university's Food Services consistently scored the highest across all food premise types for nutrition signage, availability, and cost of healthier options. Health promotion strategies are needed to address availability and variety of healthier grab-and-go options in university settings.

Quality of Work: Validation of a New Instrument in Three Languages

PubMed Central

Steffgen, Georges; Kohl, Diane; Reese, Gerhard; Happ, Christian; Sischka, Philipp

2015-01-01

Introduction and objective: A new instrument to measure quality of work was developed in three languages (German, French and Luxembourgish) and validated in a study of employees working in Luxembourg. Methods and results: A representative sample (n = 1529) was taken and exploratory factor analysis revealed a six-factor solution for the 21-item instrument (satisfaction and respect, mobbing, mental strain at work, cooperation, communication and feedback, and appraisal). Reliability analysis showed satisfying reliability for all six factors and the total questionnaire. In order to examine the construct validity of the new instrument, regression analyses were conducted to test whether the instrument predicted work characteristics’ influence on three components of well-being—burnout, psychological stress and maladaptive coping behaviors. Conclusion: The present validation offers a trilingual inventory for measuring quality of work that may be used, for example, as an assessment tool or for testing the effectiveness of interventions. PMID:26703634

Development and Validation of an Instrument to Measure University Students' Biotechnology Attitude

NASA Astrophysics Data System (ADS)

Erdogan, Mehmet; Özel, Murat; Uşak, Muhammet; Prokop, Pavol

2009-06-01

The impact of biotechnologies on peoples' everyday lives continuously increases. Measuring young peoples' attitudes toward biotechnologies is therefore very important and its results are useful not only for science curriculum developers and policy makers, but also for producers and distributors of genetically modified products. Despite of substantial number of instruments which focused on measuring student attitudes toward biotechnology, a majority of them were not rigorously validated. This study deals with the development and validation of an attitude questionnaire toward biotechnology. Detailed information on development and validation process of the instrument is provided. Data gathered from 326 university students provided evidence for the validity and reliability of the new instrument which consists of 28 attitude items on a five point likert type scale. It is believed that the instrument will serve as a valuable tool for both instructors and researchers in science education to assess students' biotechnology attitudes.

A review of health-related workplace productivity loss instruments.

PubMed

Lofland, Jennifer H; Pizzi, Laura; Frick, Kevin D

2004-01-01

The objective of this review was to identify health-related workplace productivity loss survey instruments, with particular emphasis on those that capture a metric suitable for direct translation into a monetary figure. A literature search using Medline, HealthSTAR, PsycINFO and Econlit databases between 1966 and 2002, and a telephone-administered survey of business leaders and researchers, were conducted to identify health-related workplace productivity measurement survey instruments. This review was conducted from the societal perspective. Each identified instrument was reviewed for the following: (i). reliability; (ii). content validity; (iii). construct validity; (iv). criterion validity; (v). productivity metric(s); (vi). instrument scoring technique; (vii). suitability for direct translation into a monetary figure; (viii). number of items; (ix). mode(s) of administration; and (x). disease state(s) in which it had been tested. Reliability and validity testing have been performed for 8 of the 11 identified surveys. Of the 11 instruments identified, six captured metrics that are suitable for direct translation into a monetary figure. Of those six, one instrument measured absenteeism, while the other five measured both absenteeism and presenteeism. All of the identified instruments except for one were available as paper, self-administered questionnaires and many were available in languages other than English. This review provides a comprehensive overview of the published, peer-reviewed survey instruments available to measure health-related workplace productivity loss. As the field of productivity measurement matures, tools may be developed that will allow researchers to accurately calculate lost productivity costs when performing cost-effectiveness and cost-benefit analyses. Using data captured by these instruments, society and healthcare decision makers will be able to make better informed decisions concerning the value of the medications, disease management and

Validation of the MISSCARE-BRASIL survey - A tool to assess missed nursing care.

PubMed

Siqueira, Lillian Dias Castilho; Caliri, Maria Helena Larcher; Haas, Vanderlei José; Kalisch, Beatrice; Dantas, Rosana Aparecida Spadoti

2017-12-21

to analyze the metric validity and reliability properties of the MISSCARE-BRASIL survey. methodological research conducted by assessing construct validity and reliability via confirmatory factor analysis, known-groups validation, convergent construct validation, analysis of internal consistency and test-retest reliability. The sample consisted of 330 nursing professionals, of whom 86 participated in the retest phase. of the 330 participants, 39.7% were aides, 33% technicians, 20.9% nurses, and 6.4% nurses with administrative roles. Confirmatory factorial analysis demonstrated that the Brazilian Portuguese version of the instrument is adequately adjusted to the dimensional structure the scale authors originally proposed. The correlation between "satisfaction with position/role" and "satisfaction with teamwork" and the survey's missed care variables was moderate (Spearman's coefficient =0.35; p<0.001). The results of the Student's t-test indicated known-group validity. Professionals from closed units reported lower levels of missed care in comparison with the other units. The reliability showed a strong correlation, with the exception of "institutional management/leadership style" (intraclass correlation coefficient (ICC)=0.15; p=0.04). The internal consistency was adequate (Cronbach's alpha was greater than 0.70). the MISSCARE-BRASIL was valid and reliable in the group studied. The application of the MISSCARE-BRASIL can contribute to identifying solutions for missed nursing care.

An integrated assessment instrument: Developing and validating instrument for facilitating critical thinking abilities and science process skills on electrolyte and nonelectrolyte solution matter

NASA Astrophysics Data System (ADS)

Astuti, Sri Rejeki Dwi; Suyanta, LFX, Endang Widjajanti; Rohaeti, Eli

2017-05-01

The demanding of assessment in learning process was impact by policy changes. Nowadays, assessment is not only emphasizing knowledge, but also skills and attitudes. However, in reality there are many obstacles in measuring them. This paper aimed to describe how to develop integrated assessment instrument and to verify instruments' validity such as content validity and construct validity. This instrument development used test development model by McIntire. Development process data was acquired based on development test step. Initial product was observed by three peer reviewer and six expert judgments (two subject matter experts, two evaluation experts and two chemistry teachers) to acquire content validity. This research involved 376 first grade students of two Senior High Schools in Bantul Regency to acquire construct validity. Content validity was analyzed used Aiken's formula. The verifying of construct validity was analyzed by exploratory factor analysis using SPSS ver 16.0. The result show that all constructs in integrated assessment instrument are asserted valid according to content validity and construct validity. Therefore, the integrated assessment instrument is suitable for measuring critical thinking abilities and science process skills of senior high school students on electrolyte solution matter.

Reliability and concurrent validity of the Dutch hip and knee replacement expectations surveys

PubMed Central

2010-01-01

Background Preoperative expectations of outcome of total hip and knee arthroplasty are important determinants of patients' satisfaction and functional outcome. Aims of the study were (1) to translate the Hospital for Special Surgery Hip Replacement Expectations Survey and Knee Replacement Expectations Survey into Dutch and (2) to study test-retest reliability and concurrent validity. Methods Patients scheduled for total hip (N = 112) or knee replacement (N = 101) were sent the Dutch Expectations Surveys twice with a 2 week interval to determine test-retest reliability. To determine concurrent validity, the Expectation WOMAC was sent. Results The results for the Dutch Hip Replacement Expectations Survey revealed good test-retest reliability (ICC 0.87), no bias and good internal consistency (alpha 0.86) (N = 72). The correlation between the Hip Expectations Score and the Expectation WOMAC score was 0.59 (N = 86). The results for the Dutch Knee Replacement Expectations Survey revealed good test-retest reliability (ICC 0.79), no bias and good internal consistency (alpha 0.91) (N = 46). The correlation with the Expectation WOMAC score was 0.52 (N = 57). Conclusions Both Dutch Expectations Surveys are reliable instruments to determine patients' expectations before total hip or knee arthroplasty. As for concurrent validity, the correlation between both surveys and the Expectation WOMAC was moderate confirming that the same construct was determined. However, patients scored systematically lower on the Expectation WOMAC compared to the Dutch Expectation Surveys. Research on patients' expectations before total hip and knee replacement has only been performed in a limited amount of countries. With the Dutch Expectations Surveys it is now possible to determine patients' expectations in another culture and healthcare setting. PMID:20958990

Reliability and concurrent validity of the Dutch hip and knee replacement expectations surveys.

PubMed

van den Akker-Scheek, Inge; van Raay, Jos J A M; Reininga, Inge H F; Bulstra, Sjoerd K; Zijlstra, Wiebren; Stevens, Martin

2010-10-19

Preoperative expectations of outcome of total hip and knee arthroplasty are important determinants of patients' satisfaction and functional outcome. Aims of the study were (1) to translate the Hospital for Special Surgery Hip Replacement Expectations Survey and Knee Replacement Expectations Survey into Dutch and (2) to study test-retest reliability and concurrent validity. Patients scheduled for total hip (N = 112) or knee replacement (N = 101) were sent the Dutch Expectations Surveys twice with a 2 week interval to determine test-retest reliability. To determine concurrent validity, the Expectation WOMAC was sent. The results for the Dutch Hip Replacement Expectations Survey revealed good test-retest reliability (ICC 0.87), no bias and good internal consistency (alpha 0.86) (N = 72). The correlation between the Hip Expectations Score and the Expectation WOMAC score was 0.59 (N = 86). The results for the Dutch Knee Replacement Expectations Survey revealed good test-retest reliability (ICC 0.79), no bias and good internal consistency (alpha 0.91) (N = 46). The correlation with the Expectation WOMAC score was 0.52 (N = 57). Both Dutch Expectations Surveys are reliable instruments to determine patients' expectations before total hip or knee arthroplasty. As for concurrent validity, the correlation between both surveys and the Expectation WOMAC was moderate confirming that the same construct was determined. However, patients scored systematically lower on the Expectation WOMAC compared to the Dutch Expectation Surveys. Research on patients' expectations before total hip and knee replacement has only been performed in a limited amount of countries. With the Dutch Expectations Surveys it is now possible to determine patients' expectations in another culture and healthcare setting.

Provider Attitudes toward Pay-for-Performance Programs: Development and Validation of a Measurement Instrument

PubMed Central

Meterko, Mark; Young, Gary J; White, Bert; Bokhour, Barbara G; Burgess, James F; Berlowitz, Dan; Guldin, Matthew R; Nealon Seibert, Marjorie

2006-01-01

Objective To develop an instrument for assessing physician attitudes toward quality incentive programs, and to assess its reliability and validity. Data Sources Study involved primary data collection. A 40-item paper and pencil survey of primary care physicians in Rochester, New York, and Massachusetts was conducted between May 2004 and December 2004. Seven-hundred and ninety-eight completed questionnaires were received, representing a response rate of 32 percent (798/2,497). Study Design Based on an extensive review of the literature and discussions with experts in the field, we developed a conceptual framework representing the features of pay-for-performance (P4P) programs hypothesized to affect physician behavior in that context. A draft questionnaire was developed based on that conceptual model and pilot tested in three groups of physicians. The questionnaire was modified based on the physician feedback, and the revised version was distributed to 2,497 primary care physicians affiliated with two of the seven sites participating in Rewarding Results, a national evaluation of quality target and financial incentive programs. Data Collection Respondents were randomly divided into a derivation and a validation sample. Exploratory factor analysis was applied to the responses of the derivation sample. Those results were used to create scales in the validation sample, and these were then subjected to multitrait analysis (MTA). One scale representing physicians' perception of the impact of P4P on their clinical practice was regressed on the other scales as a test of construct validity. Principal Findings Seven constructs were identified and demonstrated substantial convergent and discriminant validity in the MTA: awareness and understanding, clinical relevance, cooperation, unintended consequences, control, financial salience, and impact. Internal consistency reliabilities (Cronbach's α coefficients) ranged from 0.50 to 0.80. A statistically significant 25 percent of

Workforce perceptions of hospital safety culture: development and validation of the patient safety climate in healthcare organizations survey.

PubMed

Singer, Sara; Meterko, Mark; Baker, Laurence; Gaba, David; Falwell, Alyson; Rosen, Amy

2007-10-01

To describe the development of an instrument for assessing workforce perceptions of hospital safety culture and to assess its reliability and validity. Primary data collected between March 2004 and May 2005. Personnel from 105 U.S. hospitals completed a 38-item paper and pencil survey. We received 21,496 completed questionnaires, representing a 51 percent response rate. Based on review of existing safety climate surveys, we developed a list of key topics pertinent to maintaining a culture of safety in high-reliability organizations. We developed a draft questionnaire to address these topics and pilot tested it in four preliminary studies of hospital personnel. We modified the questionnaire based on experience and respondent feedback, and distributed the revised version to 42,249 hospital workers. We randomly divided respondents into derivation and validation samples. We applied exploratory factor analysis to responses in the derivation sample. We used those results to create scales in the validation sample, which we subjected to multitrait analysis (MTA). We identified nine constructs, three organizational factors, two unit factors, three individual factors, and one additional factor. Constructs demonstrated substantial convergent and discriminant validity in the MTA. Cronbach's alpha coefficients ranged from 0.50 to 0.89. It is possible to measure key salient features of hospital safety climate using a valid and reliable 38-item survey and appropriate hospital sample sizes. This instrument may be used in further studies to better understand the impact of safety climate on patient safety outcomes.

Rethinking Traditional Methods of Survey Validation

ERIC Educational Resources Information Center

Maul, Andrew

2017-01-01

It is commonly believed that self-report, survey-based instruments can be used to measure a wide range of psychological attributes, such as self-control, growth mindsets, and grit. Increasingly, such instruments are being used not only for basic research but also for supporting decisions regarding educational policy and accountability. The…

Self-management in chronic conditions: partners in health scale instrument validation.

PubMed

Peñarrieta-de Córdova, Isabel; Barrios, Flores Florabel; Gutierrez-Gomes, Tranquilina; Piñonez-Martinez, Ma del Socorro; Quintero-Valle, Luz Maria; Castañeda-Hidalgo, Hortensia

2014-03-01

This article describes a study that aimed to validate the Self-care in Chronic Conditions Partners in Health Scale instrument in the Mexican population. The instrument has been validated in Australia for use as a screening tool by primary healthcare professionals to assess the self-care skills and abilities of people with a chronic illness. Validation was conducted using baseline data for 552 people with diabetes, hypertension and cancer aged 18 or older who were users of healthcare centres in Tampico, Tamaulipas, Mexico. Results show high reliability and validity of the instrument and three themes were identified: knowledge, adherence, and dealing with and managing side effects. The findings suggest the scale is useful as a generic self-rated clinical tool for assessing self-management in a range of chronic conditions, and provides an outcome measure for comparing populations and change in patient self-management knowledge and behaviour. The authors recommend validating the scale in other Latin-American settings with more research into the effect of gender on self- management.

[Valuating public health in some zoos in Colombia. Phase 1: designing and validating instruments].

PubMed

Agudelo-Suárez, Angela N; Villamil-Jiménez, Luis C

2009-10-01

Designing and validating instruments for identifying public health problems in some zoological parks in Colombia, thereby allowing them to be evaluated. Four instruments were designed and validated along with the participation of five zoos. The instruments were validated regarding appearance, content, sensitivity to change, reliability tests and determining the tools' usefulness. An evaluation scale was created which assigned a maximum of 400 points, having the following evaluation intervals: 350-400 points meant good public health management, 100-349 points for regular management and 0-99 points for deficient management. The instruments were applied to the five zoos as part of the validation, forming a base-line for future evaluation of public health in them. Four valid and useful instruments were obtained for evaluating public health in zoos in Colombia. The five zoos presented regular public health management. The base-line obtained when validating the instruments led to identifying strengths and weaknesses regarding public health management in the zoos. The instruments obtained generally and specifically evaluated public health management; they led to diagnosing, identifying, quantifying and scoring zoos in Colombia in terms of public health. The base-line provided a starting point for making comparisons and enabling future follow-up of public health in Colombian zoos.

Development of an Instrument for Measuring Clinicians’ Power Perceptions in the Workplace

PubMed Central

Bartos, Christa E.; Fridsma, Douglas B.; Butler, Brian S.; Penrod, Louis E.; Becich, Michael J.; Crowley, Rebecca S.

2008-01-01

We report on the development of an instrument to measure clinicians’ perceptions of their personal power in the workplace in relation to resistance to computerized physician order entry (CPOE). The instrument is based on French and Raven’s six bases of social power and uses a semantic differential methodology. A measurement study was conducted to determine the reliability and validity of the survey. The survey was administered online and distributed via a URL by email to 19 physicians, nurses, and health unit coordinators from a university hospital. Acceptable reliability was achieved by removing or moving some semantic differential word pairs used to represent the six power bases (alpha range from 0.76–0.89). The Semantic Differential Power Perception (SDPP) survey validity was tested against an already validated instrument and found to be acceptable (correlation range from 0.51–0.81). The SDPP survey instrument was determined to be both reliable and valid. PMID:18375189

Instrument and Survey Analysis Technical Report: Program Implementation Survey. Technical Report #1112

ERIC Educational Resources Information Center

Alonzo, Julie; Tindal, Gerald

2011-01-01

This technical document provides guidance to educators on the creation and interpretation of survey instruments, particularly as they relate to an analysis of program implementation. Illustrative examples are drawn from a survey of educators related to the use of the easyCBM learning system. This document includes specific sections on…

Development and validation of the Survey of Organizational Research Climate (SORC).

PubMed

Martinson, Brian C; Thrush, Carol R; Lauren Crain, A

2013-09-01

Development and targeting efforts by academic organizations to effectively promote research integrity can be enhanced if they are able to collect reliable data to benchmark baseline conditions, to assess areas needing improvement, and to subsequently assess the impact of specific initiatives. To date, no standardized and validated tool has existed to serve this need. A web- and mail-based survey was administered in the second half of 2009 to 2,837 randomly selected biomedical and social science faculty and postdoctoral fellows at 40 academic health centers in top-tier research universities in the United States. Measures included the Survey of Organizational Research Climate (SORC) as well as measures of perceptions of organizational justice. Exploratory and confirmatory factor analyses yielded seven subscales of organizational research climate, all of which demonstrated acceptable internal consistency (Cronbach's α ranging from 0.81 to 0.87) and adequate test-retest reliability (Pearson r ranging from 0.72 to 0.83). A broad range of correlations between the seven subscales and five measures of organizational justice (unadjusted regression coefficients ranging from 0.13 to 0.95) document both construct and discriminant validity of the instrument. The SORC demonstrates good internal (alpha) and external reliability (test-retest) as well as both construct and discriminant validity.

Development and Validation of the Survey of Organizational Research Climate (SORC)

PubMed Central

Martinson, Brian C.; Thrush, Carol R.; Crain, A. Lauren

2012-01-01

Background Development and targeting efforts by academic organizations to effectively promote research integrity can be enhanced if they are able to collect reliable data to benchmark baseline conditions, to assess areas needing improvement, and to subsequently assess the impact of specific initiatives. To date, no standardized and validated tool has existed to serve this need. Methods A web- and mail-based survey was administered in the second half of 2009 to 2,837 randomly selected biomedical and social science faculty and postdoctoral fellows at 40 academic health centers in top-tier research universities in the United States. Measures included the Survey of Organizational Research Climate (SORC) as well as measures of perceptions of organizational justice. Results Exploratory and confirmatory factor analyses yielded seven subscales of organizational research climate, all of which demonstrated acceptable internal consistency (Cronbach’s α ranging from 0.81 to 0.87) and adequate test-retest reliability (Pearson r ranging from 0.72 to 0.83). A broad range of correlations between the seven subscales and five measures of organizational justice (unadjusted regression coefficients ranging from .13 to .95) document both construct and discriminant validity of the instrument. Conclusions The SORC demonstrates good internal (alpha) and external reliability (test-retest) as well as both construct and discriminant validity. PMID:23096775

Perception of competence in middle school physical education: instrument development and validation.

PubMed

Scrabis-Fletcher, Kristin; Silverman, Stephen

2010-03-01

Perception of Competence (POC) has been studied extensively in physical activity (PA) research with similar instruments adapted for physical education (PE) research. Such instruments do not account for the unique PE learning environment. Therefore, an instrument was developed and the scores validated to measure POC in middle school PE. A multiphase design was used consisting of an intensive theoretical review, elicitation study, prepilot study, pilot study, content validation study, and final validation study (N=1281). Data analysis included a multistep iterative process to identify the best model fit. A three-factor model for POC was tested and resulted in root mean square error of approximation = .09, root mean square residual = .07, goodness offit index = .90, and adjusted goodness offit index = .86 values in the acceptable range (Hu & Bentler, 1999). A two-factor model was also tested and resulted in a good fit (two-factor fit indexes values = .05, .03, .98, .97, respectively). The results of this study suggest that an instrument using a three- or two-factor model provides reliable and valid scores ofPOC measurement in middle school PE.

Assessing Sleep Disturbance in Low Back Pain: The Validity of Portable Instruments

PubMed Central

Alsaadi, Saad M.; McAuley, James H.; Hush, Julia M.; Bartlett, Delwyn J.; McKeough, Zoe M.; Grunstein, Ronald R.; Dungan, George C.; Maher, Chris G.

2014-01-01

Although portable instruments have been used in the assessment of sleep disturbance for patients with low back pain (LBP), the accuracy of the instruments in detecting sleep/wake episodes for this population is unknown. This study investigated the criterion validity of two portable instruments (Armband and Actiwatch) for assessing sleep disturbance in patients with LBP. 50 patients with LBP performed simultaneous overnight sleep recordings in a university sleep laboratory. All 50 participants were assessed by Polysomnography (PSG) and the Armband and a subgroup of 33 participants wore an Actiwatch. Criterion validity was determined by calculating epoch-by-epoch agreement, sensitivity, specificity and prevalence and bias- adjusted kappa (PABAK) for sleep versus wake between each instrument and PSG. The relationship between PSG and the two instruments was assessed using intraclass correlation coefficients (ICC 2, 1). The study participants showed symptoms of sub-threshold insomnia (mean ISI = 13.2, 95% CI = 6.36) and poor sleep quality (mean PSQI = 9.20, 95% CI = 4.27). Observed agreement with PSG was 85% and 88% for the Armband and Actiwatch. Sensitivity was 0.90 for both instruments and specificity was 0.54 and 0.67 and PABAK of 0.69 and 0.77 for the Armband and Actiwatch respectively. The ICC (95%CI) was 0.76 (0.61 to 0.86) and 0.80 (0.46 to 0.92) for total sleep time, 0.52 (0.29 to 0.70) and 0.55 (0.14 to 0.77) for sleep efficiency, 0.64 (0.45 to 0.78) and 0.52 (0.23 to 0.73) for wake after sleep onset and 0.13 (−0.15 to 0.39) and 0.33 (−0.05 to 0.63) for sleep onset latency, for the Armband and Actiwatch, respectively. The findings showed that both instruments have varied criterion validity across the sleep parameters from excellent validity for measures of total sleep time, good validity for measures of sleep efficiency and wake after onset to poor validity for sleep onset latency. PMID:24763506

Assessing sleep disturbance in low back pain: the validity of portable instruments.

PubMed

Alsaadi, Saad M; McAuley, James H; Hush, Julia M; Bartlett, Delwyn J; McKeough, Zoe M; Grunstein, Ronald R; Dungan, George C; Maher, Chris G

2014-01-01

Although portable instruments have been used in the assessment of sleep disturbance for patients with low back pain (LBP), the accuracy of the instruments in detecting sleep/wake episodes for this population is unknown. This study investigated the criterion validity of two portable instruments (Armband and Actiwatch) for assessing sleep disturbance in patients with LBP. 50 patients with LBP performed simultaneous overnight sleep recordings in a university sleep laboratory. All 50 participants were assessed by Polysomnography (PSG) and the Armband and a subgroup of 33 participants wore an Actiwatch. Criterion validity was determined by calculating epoch-by-epoch agreement, sensitivity, specificity and prevalence and bias- adjusted kappa (PABAK) for sleep versus wake between each instrument and PSG. The relationship between PSG and the two instruments was assessed using intraclass correlation coefficients (ICC 2, 1). The study participants showed symptoms of sub-threshold insomnia (mean ISI = 13.2, 95% CI = 6.36) and poor sleep quality (mean PSQI = 9.20, 95% CI = 4.27). Observed agreement with PSG was 85% and 88% for the Armband and Actiwatch. Sensitivity was 0.90 for both instruments and specificity was 0.54 and 0.67 and PABAK of 0.69 and 0.77 for the Armband and Actiwatch respectively. The ICC (95%CI) was 0.76 (0.61 to 0.86) and 0.80 (0.46 to 0.92) for total sleep time, 0.52 (0.29 to 0.70) and 0.55 (0.14 to 0.77) for sleep efficiency, 0.64 (0.45 to 0.78) and 0.52 (0.23 to 0.73) for wake after sleep onset and 0.13 (-0.15 to 0.39) and 0.33 (-0.05 to 0.63) for sleep onset latency, for the Armband and Actiwatch, respectively. The findings showed that both instruments have varied criterion validity across the sleep parameters from excellent validity for measures of total sleep time, good validity for measures of sleep efficiency and wake after onset to poor validity for sleep onset latency.

Students' Initial Knowledge State and Test Design: Towards a Valid and Reliable Test Instrument

ERIC Educational Resources Information Center

CoPo, Antonio Roland I.

2015-01-01

Designing a good test instrument involves specifications, test construction, validation, try-out, analysis and revision. The initial knowledge state of forty (40) tertiary students enrolled in Business Statistics course was determined and the same test instrument undergoes validation. The designed test instrument did not only reveal the baseline…

Validation of a new international quality-of-life instrument specific to cosmetics and physical appearance: BeautyQoL questionnaire.

PubMed

Beresniak, Ariel; de Linares, Yolaine; Krueger, Gerald G; Talarico, Sergio; Tsutani, Kiichiro; Duru, Gérard; Berger, Geneviève

2012-11-01

To develop a new quality-of-life (QoL) instrument with international validity that specifically assesses cosmetic products and physical appearance. In the first phase, semidirected interviews involved 309 subjects. In the second stage, an acceptability study was performed on 874 subjects. Thereafter, we recruited a total of 3231 subjects, each of whom completed the BeautyQoL questionnaire, a clinical checklist for the skin, the generic QoL 36-Item Short Form Health Survey, and a sociodemographic questionnaire. A retest was performed 8 days later on a subgroup of 652 subjects. Populations in France, the United Kingdom, Germany, Spain, Sweden, Italy, Russia, the United States, Brazil, Japan, India, China, and South Africa, representing 16 languages. The general adult healthy population, including women and men. Psychometric properties, construct validity, reproducibility, and internal and external consistency. General acceptability was very good in the 16 languages, with a very low rate of no answers. The validation phase reduced the questionnaire to 42 questions structured in the following 5 dimensions that explained 76.7% of the total variance: social life, self-confidence, mood, energy, and attractiveness. Internal consistency was high (Cronbach α coefficients, 0.93-0.98). Reproducibility at 8 days was satisfactory in all dimensions. Results of external validity testing revealed that BeautyQoL scores correlated significantly with all 36-Item Short Form Health Survey scores except for physical function. These results demonstrate the validity and reliability of the BeautyQoL questionnaire as the very first international instrument specific to cosmetic products and physical appearance.

The Hydrologic Instrumentation Facility of the U.S. Geological Survey

USGS Publications Warehouse

Wagner, C.R.; Jeffers, Sharon

1984-01-01

The U.S. Geological Survey Water Resources Division has improved support to the agencies field offices by the consolidation of all instrumentation support services in a single facility. This facility known as the Hydrologic Instrumentation Facility (HIF) is located at the National Space Technology Laboratory, Mississippi, about 50 miles east of New Orleans, Louisiana. The HIF is responsible for design and development, testing, evaluation, procurement, warehousing, distribution and repair of a variety of specialized hydrologic instrumentation. The centralization has resulted in more efficient and effective support of the Survey 's hydrologic programs. (USGS)

Workforce Perceptions of Hospital Safety Culture: Development and Validation of the Patient Safety Climate in Healthcare Organizations Survey

PubMed Central

Singer, Sara; Meterko, Mark; Baker, Laurence; Gaba, David; Falwell, Alyson; Rosen, Amy

2007-01-01

Objective To describe the development of an instrument for assessing workforce perceptions of hospital safety culture and to assess its reliability and validity. Data Sources/Study Setting Primary data collected between March 2004 and May 2005. Personnel from 105 U.S. hospitals completed a 38-item paper and pencil survey. We received 21,496 completed questionnaires, representing a 51 percent response rate. Study Design Based on review of existing safety climate surveys, we developed a list of key topics pertinent to maintaining a culture of safety in high-reliability organizations. We developed a draft questionnaire to address these topics and pilot tested it in four preliminary studies of hospital personnel. We modified the questionnaire based on experience and respondent feedback, and distributed the revised version to 42,249 hospital workers. Data Collection We randomly divided respondents into derivation and validation samples. We applied exploratory factor analysis to responses in the derivation sample. We used those results to create scales in the validation sample, which we subjected to multitrait analysis (MTA). Principal Findings We identified nine constructs, three organizational factors, two unit factors, three individual factors, and one additional factor. Constructs demonstrated substantial convergent and discriminant validity in the MTA. Cronbach's α coefficients ranged from 0.50 to 0.89. Conclusions It is possible to measure key salient features of hospital safety climate using a valid and reliable 38-item survey and appropriate hospital sample sizes. This instrument may be used in further studies to better understand the impact of safety climate on patient safety outcomes. PMID:17850530

Current Status of the Validation of the Atmospheric Chemistry Instruments on Envisat

NASA Astrophysics Data System (ADS)

Lecomte, P.; Koopman, R.; Zehner, C.; Laur, H.; Attema, E.; Wursteisen, P.; Snoeij, P.

2003-04-01

Envisat is ESA's advanced Earth observing satellite launched in March 2002 and is designed to provide measurements of the atmosphere, ocean, land and ice over a five-year period. After the launch and the switch-on period, a six-month commissioning phase has taken place for instrument calibration and geophysical validation, concluded with the Envisat Calibration Review held in September 2002. In addition to ESA and its industrial partners in the Envisat consortium, many other companies and research institutes have contributed to the calibration and validation programme under ESA contract as expert support laboratories (ESLs). A major contribution has also been made by the Principal Investigators of approved proposals submitted to ESA in response to a worldwide "Announcement of Opportunity for the Exploitation of the Envisat Data Products" in 1998. Working teams have been formed in which the different participants worked side by side to achieve the objectives of the calibration and validation programme. Validation is a comparison of Envisat level-2 data products and estimates of the different geophysical variables obtained by independent means, the validation instruments. Validation is closely linked to calibration because inconsistencies discovered in the comparison of Envisat Level 2 data products to well-known external instruments can have many different sources, including inaccuracies of the Envisat instrument calibration and the data calibration algorithms. Therefore, initial validation of the geophysical variables has provided feedback to calibration, de-bugging and algorithm improvement. The initial validation phase ended in December 2002 with the Envisat Validation Workshop at which, for a number of products, a final quality statement was given. Full validation of all data products available from the Atmospheric Chemistry Instruments on Envisat (MIPAS, GOMOS and SCIAMACHY) is quite a challenge and therefore it has been decided to adopt a step-wise approach

Random Qualitative Validation: A Mixed-Methods Approach to Survey Validation

ERIC Educational Resources Information Center

Van Duzer, Eric

2012-01-01

The purpose of this paper is to introduce the process and value of Random Qualitative Validation (RQV) in the development and interpretation of survey data. RQV is a method of gathering clarifying qualitative data that improves the validity of the quantitative analysis. This paper is concerned with validity in relation to the participants'…

An Instrument to Measure Maturity of Integrated Care: A First Validation Study

PubMed Central

2018-01-01

Introduction: Lessons captured from interviews with 12 European regions are represented in a new instrument, the B3-Maturity Model (B3-MM). B3-MM aims to assess maturity along 12 dimensions reflecting the various aspects that need to be managed in order to deliver integrated care. The objective of the study was to test the content validity of B3-MM as part of SCIROCCO (Scaling Integrated Care into Context), a European Union funded project. Methods: A literature review was conducted to compare B3-MM’s 12 dimensions and their measurement scales with existing measures and instruments that focus on assessing the development of integrated care. Subsequently, a three-round survey conducted through a Delphi study with international experts in the field of integrated care was performed to test the relevance of: 1) the dimensions, 2) the maturity indicators and 3) the assessment scale used in B3-MM. Results: The 11 articles included in the literature review confirmed all the dimensions described in the original version of B3-MM. The Delphi study rounds resulted in various phrasing amendments of indicators and assessment scale. Full agreement among the experts on the relevance of the 12 B3-MM dimensions, their indicators, and assessment scale was reached after the third Delphi round. Conclusion and discussion: The B3-MM dimensions, maturity indicators and assessment scale showed satisfactory content validity. While the B3-MM is a unique instrument based on existing knowledge and experiences of regions in integrated care, further testing is needed to explore other measurement properties of B3-MM. PMID:29588644

Validation of an Adapted Instrument to Measure Students' Attitude towards Science

ERIC Educational Resources Information Center

Chin, Sook Fui; Lim, Hooi Lian

2016-01-01

Attitude towards science (ATS) is a major concern in science education. Although many ATS instruments have been developed, they are based on different cultural systems and having some limitations. This study aims to validate an instrument for measuring students' ATS in Malaysia context. The instrument was adapted from Test of Science-Related…

Survey of instrumentation for environmental monitoring: major update. Volume 3. Radiation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1979-09-01

This is the third volume of a four-volume (seven-part) series, the culmination of a comprehensive survey of instrumentation for environmental monitoring. Consideration is given to instruments and techniques presently in use and to those developed for other purposes but having possible applications to radiation monitoring. The results of the survey are given as descriptions of the physical and operating characteristics of available instruments, critical comparisons among instrumentation methods, and recommendations of promising methodology and development of new instrumentation. Information is also given regarding the pollutants to be monitored, their characteristics and forms, their sources and pathways, their effects on themore » ecosystem, and the means of controlling them through process and regulatory controls. The discussion is presented under sections entitled radiation sources; instrumentation: by type of radiation or instrument type; and, instrumentation for specific radionuclides. (JGB)« less

Validation and Application of the Constructivist Learning Environment Survey in English Language Teacher Education Classrooms in Iran

ERIC Educational Resources Information Center

Ebrahimi, Nabi. A.

2015-01-01

This article reports the validation and application of an English language teacher education (LTE) version of the Constructivist Learning Environment Survey (CLES). The instrument, called the CLES-LTE, was field tested with a sample of 622 Iranian English language student teachers in 28 classes. When principal components analysis led to the…

Validation of the HIV/AIDS Stigma Instrument - PLWA (HASI-P).

PubMed

Holzemer, William L; Uys, Leana R; Chirwa, Maureen L; Greeff, Minrie; Makoae, Lucia N; Kohi, Thecla W; Dlamini, Priscilla S; Stewart, Anita L; Mullan, Joseph; Phetlhu, René D; Wantland, Dean; Durrheim, Kevin

2007-09-01

This article describes the development and testing of a quantitative measure of HIV/AIDS stigma as experienced by people living with HIV/AIDS. This instrument is designed to measure perceived stigma, create a baseline from which to measure changes in stigma over time, and track potential progress towards reducing stigma. It was developed in three phases from 2003-2006: generating items based on results of focus group discussions; pilot testing and reducing the original list of items; and validating the instrument. Data for all phases were collected from five African countries: Lesotho, Malawi, South Africa, Swaziland and Tanzania. The instrument was validated with a sample of 1,477 persons living with HIV/AIDS from all of the five countries. The sample had a mean age of 36.1 years and 74.1% was female. The participants reported they knew they were HIV positive for an average of 3.4 years and 46% of the sample was taking antiretroviral medications. A six factor solution with 33 items explained 60.72% of the variance. Scale alpha reliabilities were examined and items that did not contribute to scale reliability were dropped. The factors included: Verbal Abuse (8 items, alpha=0.886); Negative Self-Perception (5 items, alpha=0.906); Health Care Neglect (7 items, alpha=0.832); Social Isolation (5 items, alpha=0.890); Fear of Contagion (6 items, alpha=0.795); and Workplace Stigma (2 items, alpha=0.758). This article reports on the development and validation of a new measure of stigma, HIV/AIDS Stigma Instrument - PLWA (HASI-P) providing evidence that supports adequate content and construct validity, modest concurrent validity, and acceptable internal consistency reliability for each of the six subscales and total score. The scale is available is several African languages.

Trainees' Perceptions of Feedback: Validity Evidence for Two FEEDME (Feedback in Medical Education) Instruments.

PubMed

Bing-You, Robert; Ramesh, Saradha; Hayes, Victoria; Varaklis, Kalli; Ward, Denham; Blanco, Maria

2018-01-01

Construct: Medical educators consider feedback a core component of the educational process. Effective feedback allows learners to acquire new skills, knowledge, and attitudes. Learners' perceptions of feedback are an important aspect to assess with valid methods in order to improve the feedback skills of educators and the feedback culture. Although guidelines for delivering effective feedback have existed for several decades, medical students and residents often indicate that they receive little feedback. A recent scoping review on feedback in medical education did not reveal any validity evidence on instruments to assess learner's perceptions of feedback. The purpose of our study was to gather validity evidence on two novel FEEDME (Feedback in Medical Education) instruments to assess medical students' and residents' perceptions of the feedback that they receive. After the authors developed an initial instrument with 54 items, cognitive interviews with medical students and residents suggested that 2 separate instruments were needed, one focused on the feedback culture (FEEDME-Culture) and the other on the provider of feedback (FEEDME-Provider). A Delphi study with 17 medical education experts and faculty members assessed content validity. The response process was explored involving 31 medical students and residents at 2 academic institutions. Exploratory factor analysis and reliability analyses were performed on completed instruments. Two Delphi consultation rounds refined the wording of items and eliminated several items. Learners found both instruments easy and quick to answer; it took them less than 5 minutes to complete. Learners preferred an electronic format of the instruments over paper. Factor analysis revealed a two- and three-factor solution for the FEEDME-Culture and FEEDME-Provider instruments, respectively. Cronbach's alpha was greater than 0.80 for all factors. Items on both instruments were moderately to highly correlated (range, r = .3-.7). Our

A Valid and Reliable Instrument for Cognitive Complexity Rating Assignment of Chemistry Exam Items

ERIC Educational Resources Information Center

Knaus, Karen; Murphy, Kristen; Blecking, Anja; Holme, Thomas

2011-01-01

The design and use of a valid and reliable instrument for the assignment of cognitive complexity ratings to chemistry exam items is described in this paper. Use of such an instrument provides a simple method to quantify the cognitive demands of chemistry exam items. Instrument validity was established in two different ways: statistically…

Concurrent validation of two key health literacy instruments in a South Eastern European population.

PubMed

Toçi, Ervin; Burazeri, Genc; Sørensen, Kristine; Kamberi, Haxhi; Brand, Helmut

2015-06-01

Public health practice has come to increasing recognition of health promotion and the central role of knowledge, attitude, beliefs and practices in achieving health promotion. Health literacy (HL) is an under-explored topic in South Eastern European countries. There are no HL reports from Albania to date. The aim of this study was to assess the concurrent validity of the European Health Literacy Survey Questionnaire (HLS-EU-Q) and the Test of Functional Health Literacy in Adults (TOFHLA) in a population-based sample of adults in Albania. A cross-sectional study was conducted in 2013 in Tirana, Albania, including 239 individuals aged ≥ 18 years (61% women; 87% response). A structured interviewer-administered questionnaire was applied twice (test and retest procedure after 2 weeks) including HLS-EU-Q and TOFHLA instruments. The internal consistency was high for both instruments (Cronbach's alpha for the test procedure was 0.92 for TOFHLA and 0.98 for HLS-EU-Q). Both tools exhibited a high stability over time (Spearman's rho: 0.88 for TOFHLA and 0.87 for HLS-EU). Mean values of both instruments were similar in men and women (mean score for TOFHLA: 76.0 vs. 76.5, P = 0.83; mean score for HLS-EU-Q: 32.2 vs. 32.6, P = 0.63). For both instruments, higher HL scores were significantly associated with younger age, higher educational and economic level and lower body mass index. Our study provides valuable novel evidence on concurrent validation of two major HL instruments in a South Eastern European population-based sample. Future studies should be conducted in order to confirm and expand our findings. © The Author 2014. Published by Oxford University Press on behalf of the European Public Health Association. All rights reserved.

Measuring leprosy-related stigma - a pilot study to validate a toolkit of instruments.

PubMed

Rensen, Carin; Bandyopadhyay, Sudhakar; Gopal, Pala K; Van Brakel, Wim H

2011-01-01

Stigma negatively affects the quality of life of leprosy-affected people. Instruments are needed to assess levels of stigma and to monitor and evaluate stigma reduction interventions. We conducted a validation study of such instruments in Tamil Nadu and West Bengal, India. Four instruments were tested in a 'Community Based Rehabilitation' (CBR) setting, the Participation Scale, Internalised Scale of Mental Illness (ISMI) adapted for leprosy-affected persons, Explanatory Model Interview Catalogue (EMIC) for leprosy-affected and non-affected persons and the General Self-Efficacy (GSE) Scale. We evaluated the following components of validity, construct validity, internal consistency, test-retest reproducibility and reliability to distinguish between groups. Construct validity was tested by correlating instrument scores and by triangulating quantitative and qualitative findings. Reliability was evaluated by comparing levels of stigma among people affected by leprosy and community controls, and among affected people living in CBR project areas and those in non-CBR areas. For the Participation, ISMI and EMIC scores significant differences were observed between those affected by leprosy and those not affected (p = 0.0001), and between affected persons in the CBR and Control group (p < 0.05). The internal consistency of the instruments measured with Cronbach's α ranged from 0.83 to 0.96 and was very good for all instruments. Test-retest reproducibility coefficients were 0.80 for the Participation score, 0.70 for the EMIC score, 0.62 for the ISMI score and 0.50 for the GSE score. The construct validity of all instruments was confirmed. The Participation and EMIC Scales met all validity criteria, but test-retest reproducibility of the ISMI and GSE Scales needs further evaluation with a shorter test-retest interval and longer training and additional adaptations for the latter.

Survey of beam instrumentation used in SLC

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ecklund, S.D.

A survey of beam instruments used at SLAC in the SLC machine is presented. The basic utility and operation of each device is briefly described. The various beam instruments used at the Stanford Linear Collider (SLC), can be classified by the function they perform. Beam intensity, position and size are typical of the parameters of beam which are measured. Each type of parameter is important for adjusting or tuning the machine in order to achieve optimum performance. 39 refs.

The Spiritual Needs Assessment for Patients (SNAP): development and validation of a comprehensive instrument to assess unmet spiritual needs.

PubMed

Sharma, Rashmi K; Astrow, Alan B; Texeira, Kenneth; Sulmasy, Daniel P

2012-07-01

Unmet spiritual needs have been associated with decreased patient ratings of quality of care, satisfaction, and quality of life. There is a need for a well-validated, psychometrically sound instrument to describe and measure spiritual needs. To develop a valid and reliable instrument to assess patients' spiritual needs. Instrument development was based on a literature review, clinical and pastoral evaluation, and cognitive pretesting (n=15 ambulatory cancer patients). Forty-seven ambulatory cancer patients completed cross-sectional and longitudinal surveys to test instrument validity and reliability. Internal reliability was assessed by Cronbach's α, test-retest reliability by Spearman's correlation coefficients, and construct validity by comparing instrument scores to a previously used single-item spiritual needs question. The Spiritual Needs Assessment for Patients (SNAP) comprises a total of 23 items in three domains: psychosocial (n=5), spiritual (n=13), and religious (n=5). Sixty percent of participants were white, 21% black, 13% Hispanic, and 6% Asian or other. Fifty-eight percent were Catholic, 13% Jewish, 11% Protestant, 2% Buddhist, 2% Muslim, and 2% Hindu. Sixty-eight percent described themselves as spiritual but not religious; 15% reported unmet spiritual needs; 19% wanted help meeting their spiritual needs. Cronbach's α for the total SNAP was 0.95, and for the subscales was psychosocial=0.74, spiritual=0.93, and religious needs=0.86. Test-retest correlation coefficients were total SNAP=0.69, psychosocial needs=0.51, spiritual needs=0.70, and religious needs=0.65. Participants reporting unmet spiritual needs had significantly higher mean scores on the total SNAP (66.3 vs. 49.4, P=0.03) and on the spiritual needs subscale (39.0 vs. 28.3, P=0.02). The results provide preliminary evidence that the SNAP is a valid and reliable instrument for measuring spiritual needs in a diverse patient population. Copyright © 2012 U.S. Cancer Pain Relief Committee

[Design and validation of an instrument to assess families at risk for health problems].

PubMed

Puschel, Klaus; Repetto, Paula; Solar, María Olga; Soto, Gabriela; González, Karla

2012-04-01

There is a paucity of screening instruments with a high clinical predictive value to identify families at risk and therefore, develop focused interventions in primary care. To develop an easy to apply screening instrument with a high clinical predictive value to identify families with a higher health vulnerability. In the first stage of the study an instrument with a high content validity was designed through a review of existent instruments, qualitative interviews with families and expert opinions following a Delphi approach of three rounds. In the second stage, concurrent validity was tested through a comparative analysis between the pilot instrument and a family clinical interview conducted to 300 families randomly selected from a population registered at a primary care clinic in Santiago. The sampling was blocked based on the presence of diabetes, depression, child asthma, behavioral disorders, presence of an older person or the lack of previous conditions among family members. The third stage, was directed to test the clinical predictive validity of the instrument by comparing the baseline vulnerability obtained by the instrument and the change in clinical status and health related quality of life perceptions of the family members after nine months of follow-up. The final SALUFAM instrument included 13 items and had a high internal consistency (Cronbach's alpha: 0.821), high test re-test reproducibility (Pearson correlation: 0.84) and a high clinical predictive value for clinical deterioration (Odds ratio: 1.826; 95% confidence intervals: 1.101-3.029). SALUFAM instrument is applicable, replicable, has a high content validity, concurrent validity and clinical predictive value.

Development and initial validation of the Pharmacist Frequency of Interprofessional Collaboration Instrument (FICI-P) in primary care.

PubMed

Van, Connie; Costa, Daniel; Mitchell, Bernadette; Abbott, Penny; Krass, Ines

2012-01-01

Existing validated measures of pharmacist-physician collaboration focus on measuring attitudes toward collaboration and do not measure frequency of collaborative interactions. To develop and validate an instrument to measure the frequency of collaboration between pharmacists and general practitioners (GPs) from the pharmacist's perspective. An 11-item Pharmacist Frequency of Interprofessional Collaboration Instrument (FICI-P) was developed and administered to 586 pharmacists in 8 divisions of general practice in New South Wales, Australia. The initial items were informed by a review of the literature in addition to interviews of pharmacists and GPs. Items were subjected to principal component and Rasch analyses to determine each item's and the overall measure's psychometric properties and for any needed refinements. Two hundred and twenty four (38%) of pharmacist surveys were completed and returned. Principal component analysis suggested removal of 1 item for a final 1-factor solution. The refined 10-item FICI-P demonstrated internal consistency reliability at Cronbach's alpha=0.90. After collapsing the original 5-point response scale to a 4-point response scale, the refined FICI-P demonstrated fit to the Rasch model. Criterion validity of the FICI-P was supported by the correlation of FICI-P scores with scores on a previously validated Physician-Pharmacist Collaboration Instrument. Validity was also supported by predicted differences in FICI-P scores between subgroups of respondents stratified on age, colocation with GPs, and interactions during the intern-training period. The refined 10-item FICI-P was shown to have good internal consistency, criterion validity, and fit to the Rasch model. The creation of such a tool may allow for the measure of impact in the evaluation of interventions designed to improve interprofessional collaboration between GPs and pharmacists. Copyright © 2012 Elsevier Inc. All rights reserved.

Validation of a moral distress instrument in nurses of primary health care 1

PubMed Central

Barth, Priscila Orlandi; Ramos, Flávia Regina Souza; Barlem, Edison Luiz Devos; Dalmolin, Graziele de Lima; Schneider, Dulcinéia Ghizoni

2018-01-01

ABSTRACT Objective: to validate an instrument to identify situations that trigger moral distress in relation to intensity and frequency in primary health care nurses. Method: this is a methodological study carried out with 391 nurses of primary health care, applied to the Brazilian Scale of Moral Distress in Nurses with 57 questions. Validation for primary health care was performed through expert committee evaluation, pre-test, factorial analysis, and Cronbach’s alpha. Results: there were 46 questions validated divided into six constructs: Health Policies, Working Conditions, Nurse Autonomy, Professional ethics, Disrespect to patient autonomy and Work Overload. The instrument had satisfactory internal consistency, with Cronbach’s alpha 0.98 for the instrument, and between 0.96 and 0.88 for the constructs. Conclusion: the instrument is valid and reliable to be used in the identification of the factors that trigger moral distress in primary care nurses, providing subsidies for new research in this field of professional practice. PMID:29791671

Further validation and definition of the psychometric properties of the Asthma Impact Survey.

PubMed

Schatz, Michael; Zeiger, Robert S; Yang, Su-Jau; Chen, Wansu; Kosinski, Mark

2011-07-01

The Asthma Impact Survey (AIS-6) is a brief disease-specific quality-of-life instrument with limited published validation data. To obtain additional validation data and psychometric properties of the AIS-6. In November, 2007, patients with persistent asthma were mailed a survey that included the AIS-6, the mini-Asthma Quality of Life Questionnaire (mAQLQ), and the Asthma Control Test (ACT). Follow-up surveys were sent in April, July, and October 2008. Year 2008 exacerbations and short-acting β-agonist (SABA) dispensings were captured from administrative data. A total of 2680 patients had complete baseline survey data. Criterion validity was demonstrated by the strong correlations of the AIS-6 with the mAQLQ (r = -0.84 to -0.86); construct validity by significant relationships (P < .0001) of the AIS-6 with mAQLQ domain scores, ACT score, and history of exacerbations; and predictive validity by significant relationships (P < .0001) between AIS-6 scores at the end of 2007 and year 2008 exacerbations and high SABA dispensings. Responsiveness was demonstrated by significant (P < .0001) correlations (r = -0.39 to -0.58) between changes in AIS-6 scores and changes in mAQLQ and ACT scores over time. A preliminary minimally important difference (MID) in AIS-6 was estimated to be 4 by using the mAQLQ MID as an anchor. Excellent internal consistency (α = 0.94) and test-retest reliability (intraclass correlation coefficient = 0.86-0.91) were also demonstrated. The AIS-6 demonstrated good psychometric properties in a large independent sample and could be used to assess asthma-specific quality of life in clinical practice and clinical research. Copyright © 2011 American Academy of Allergy, Asthma & Immunology. Published by Mosby, Inc. All rights reserved.

Translation, Validation, and Reliability of the Dutch Late-Life Function and Disability Instrument Computer Adaptive Test.

PubMed

Arensman, Remco M; Pisters, Martijn F; de Man-van Ginkel, Janneke M; Schuurmans, Marieke J; Jette, Alan M; de Bie, Rob A

2016-09-01

Adequate and user-friendly instruments for assessing physical function and disability in older adults are vital for estimating and predicting health care needs in clinical practice. The Late-Life Function and Disability Instrument Computer Adaptive Test (LLFDI-CAT) is a promising instrument for assessing physical function and disability in gerontology research and clinical practice. The aims of this study were: (1) to translate the LLFDI-CAT to the Dutch language and (2) to investigate its validity and reliability in a sample of older adults who spoke Dutch and dwelled in the community. For the assessment of validity of the LLFDI-CAT, a cross-sectional design was used. To assess reliability, measurement of the LLFDI-CAT was repeated in the same sample. The item bank of the LLFDI-CAT was translated with a forward-backward procedure. A sample of 54 older adults completed the LLFDI-CAT, World Health Organization Disability Assessment Schedule 2.0, RAND 36-Item Short-Form Health Survey physical functioning scale (10 items), and 10-Meter Walk Test. The LLFDI-CAT was repeated in 2 to 8 days (mean=4.5 days). Pearson's r and the intraclass correlation coefficient (ICC) (2,1) were calculated to assess validity, group-level reliability, and participant-level reliability. A correlation of .74 for the LLFDI-CAT function scale and the RAND 36-Item Short-Form Health Survey physical functioning scale (10 items) was found. The correlations of the LLFDI-CAT disability scale with the World Health Organization Disability Assessment Schedule 2.0 and the 10-Meter Walk Test were -.57 and -.53, respectively. The ICC (2,1) of the LLFDI-CAT function scale was .84, with a group-level reliability score of .85. The ICC (2,1) of the LLFDI-CAT disability scale was .76, with a group-level reliability score of .81. The high percentage of women in the study and the exclusion of older adults with recent joint replacement or hospitalization limit the generalizability of the results. The Dutch LLFDI

Reliability and validity of the instrument used in BRFSS to assess physical activity.

PubMed

Yore, Michelle M; Ham, Sandra A; Ainsworth, Barbara E; Kruger, Judy; Reis, Jared P; Kohl, Harold W; Macera, Caroline A

2007-08-01

State-level statistics of adherence to the physical activity objectives in Healthy People 2010 are derived from the Behavioral Risk Factor Surveillance System (BRFSS) data. BRFSS physical activity questions were updated in 2001 to include domains of leisure time, household, and transportation-related activity of moderate- and vigorous intensity, and walking questions. This article reports the reliability and validity of these questions. The BRFSS Physical Activity Study (BPAS) was conducted from September 2000 to May 2001 in Columbia, SC. Sixty participants were followed for 22 d; they answered the physical activity questions three times via telephone, wore a pedometer and accelerometer, and completed a daily physical activity log for 1 wk. Measures for moderate, vigorous, recommended (i.e., met the criteria for moderate or vigorous), and strengthening activities were created according to Healthy People 2010 operational definitions. Reliability and validity were assessed using Cohen's kappa (kappa) and Pearson correlation coefficients. Seventy-three percent of participants met the recommended activity criteria compared with 45% in the total U.S. population. Test-retest reliability (kappa) was 0.35-0.53 for moderate activity, 0.80-0.86 for vigorous activity, 0.67-0.84 for recommended activity, and 0.85-0.92 for strengthening. Validity (kappa) of the survey (using the accelerometer as the standard) was 0.17-0.22 for recommended activity. Validity (kappa) of the survey (using the physical activity log as the standard) was 0.40-0.52 for recommended activity. The validity and reliability of the BRFSS physical activity questions suggests that this instrument can classify groups of adults into the levels of recommended and vigorous activity as defined by Healthy People 2010. Repeated administration of these questions over time will help to identify trends in physical activity.

Evaluation of Measurement Instrument Criterion Validity in Finite Mixture Settings

ERIC Educational Resources Information Center

Raykov, Tenko; Marcoulides, George A.; Li, Tenglong

2016-01-01

A method for evaluating the validity of multicomponent measurement instruments in heterogeneous populations is discussed. The procedure can be used for point and interval estimation of criterion validity of linear composites in populations representing mixtures of an unknown number of latent classes. The approach permits also the evaluation of…

The development and preliminary validation of the behavior, environment, and changeability survey (BECS).

PubMed

Walsh, Jennifer R; Hebert, Angel; Byrd-Bredbenner, Carol; Carey, Gale; Colby, Sarah; Brown-Esters, Onikia N; Greene, Geoffrey; Hoerr, Sharon; Horacek, Tanya; Kattelmann, Kendra; Kidd, Tandalayo; Koenings, Mallory; Phillips, Beatrice; Shelnutt, Karla P; White, Adrienne A

2012-01-01

To develop and test the validity of the Behavior, Environment, and Changeability Survey (BECS) for identifying the importance and changeability of nutrition, exercise, and stress management behavior and related aspects of the environment. A cross-sectional, online survey of the BECS and selected validated instruments. Ten state universities. A convenience sample of college students (n = 1,283), ages 18-24 years. Principal component analysis was used to confirm a 6-component structure of the BECS in 2 independent samples for the purpose of cross-validation. Internal consistency was measured and construct and criterion-related analyses were conducted to test the reliability and validity of the BECS subscales. Six components representing 34 BECS items were revealed from the original 69 items and explained 64% of the total variance. Six scales were retained, and internal consistency of each ranged from α = .82 to .93. BECS Nutrition Behavior and Nutrition Changeability scale scores were highest for participants in action/maintenance Stages of Change for fruit and vegetable intake. There is strong support for the use of the BECS when planning health programs to gain insight into behavior that young adults are willing to improve, specifically related to nutrition, exercise, and sleep. Copyright © 2012 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Initial Validation of an Instrument Measuring Psychology-Specific Epistemological Beliefs

ERIC Educational Resources Information Center

Renken, Maggie D.; McMahan, Ethan A.; Nitkova, Martina

2015-01-01

Psychology-specific epistemological beliefs (EBs) are believed to influence students' approach to and performance in psychology courses. However, empirical research on this topic is limited due in part to a lack of well-validated instruments measuring this construct. The primary objective of this research was to develop and validate the…

Risk Engagement and Protection Survey (REPS): developing and validating a survey tool on fathers' attitudes towards child injury protection and risk engagement.

PubMed

Olsen, Lise L; Ishikawa, Takuro; Mâsse, Louise C; Chan, Grace; Brussoni, Mariana

2018-04-01

Fathers play a unique role in keeping children safe from injury yet understanding of their views and attitudes towards protecting children from injury and allowing them to engage in risks is limited. The purpose of this study was to develop and validate an instrument to measure fathers' attitudes towards these two constructs. An instrument was developed that used prior qualitative research to inform item generation. The questions were assessed for content validity with experts, then pilot-tested with fathers. The survey was completed by 302 fathers attending hospital with their child for an injury or non-injury reason. Results of confirmatory factor analysis identified eight items relating to the protection from injury factor and six items relating to the risk engagement factor. Correlation between the two factors was low, suggesting these are two independent constructs. The Risk Engagement and Protection Survey offers a tool for measuring attitudes and assisting with intervention strategy development in ways that reflect fathers' views and promotes a balanced view of children's needs for safety with their needs for engaging in active, healthy risk-taking. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

The positive mental health instrument: development and validation of a culturally relevant scale in a multi-ethnic Asian population.

PubMed

Vaingankar, Janhavi Ajit; Subramaniam, Mythily; Chong, Siow Ann; Abdin, Edimansyah; Orlando Edelen, Maria; Picco, Louisa; Lim, Yee Wei; Phua, Mei Yen; Chua, Boon Yiang; Tee, Joseph Y S; Sherbourne, Cathy

2011-10-31

Instruments to measure mental health and well-being are largely developed and often used within Western populations and this compromises their validity in other cultures. A previous qualitative study in Singapore demonstrated the relevance of spiritual and religious practices to mental health, a dimension currently not included in exiting multi-dimensional measures. The objective of this study was to develop a self-administered measure that covers all key and culturally appropriate domains of mental health, which can be applied to compare levels of mental health across different age, gender and ethnic groups. We present the item reduction and validation of the Positive Mental Health (PMH) instrument in a community-based adult sample in Singapore. Surveys were conducted among adult (21-65 years) residents belonging to Chinese, Malay and Indian ethnicities. Exploratory and confirmatory factor analysis (EFA, CFA) were conducted and items were reduced using item response theory tests (IRT). The final version of the PMH instrument was tested for internal consistency and criterion validity. Items were tested for differential item functioning (DIF) to check if items functioned in the same way across all subgroups. EFA and CFA identified six first-order factor structure (General coping, Personal growth and autonomy, Spirituality, Interpersonal skills, Emotional support, and Global affect) under one higher-order dimension of Positive Mental Health (RMSEA=0.05, CFI=0.96, TLI=0.96). A 47-item self-administered multi-dimensional instrument with a six-point Likert response scale was constructed. The slope estimates and strength of the relation to the theta for all items in each six PMH subscales were high (range:1.39 to 5.69), suggesting good discrimination properties. The threshold estimates for the instrument ranged from -3.45 to 1.61 indicating that the instrument covers entire spectrums for the six dimensions. The instrument demonstrated high internal consistency and had

Validity evidence and reliability of a simulated patient feedback instrument

PubMed Central

2012-01-01

Background In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Methods Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. Results All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. Conclusions The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients. PMID:22284898

Validity evidence and reliability of a simulated patient feedback instrument.

PubMed

Schlegel, Claudia; Woermann, Ulrich; Rethans, Jan-Joost; van der Vleuten, Cees

2012-01-27

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Development and Validation of Scores from an Instrument Measuring Student Test-Taking Motivation

ERIC Educational Resources Information Center

Eklof, Hanna

2006-01-01

Using the expectancy-value model of achievement motivation as a basis, this study's purpose is to develop, apply, and validate scores from a self-report instrument measuring student test-taking motivation. Sampled evidence of construct validity for the present sample indicates that a number of the items in the instrument could be used as an…

Development and Validation of an Instrument for Assessing Climate Change Knowledge and Perceptions: The Climate Stewardship Survey (CSS)

ERIC Educational Resources Information Center

Walker, Scott L.; McNeal, Karen S.

2013-01-01

The Climate Stewardship Survey (CSS) was developed to measure knowledge and perceptions of global climate change, while also considering information sources that respondents 'trust.' The CSS was drafted using a three-stage approach: development of salient scales, writing individual items, and field testing and analyses. Construct validity and…

The development and validation of the speech quality instrument.

PubMed

Chen, Stephanie Y; Griffin, Brianna M; Mancuso, Dean; Shiau, Stephanie; DiMattia, Michelle; Cellum, Ilana; Harvey Boyd, Kelly; Prevoteau, Charlotte; Kohlberg, Gavriel D; Spitzer, Jaclyn B; Lalwani, Anil K

2017-12-08

Although speech perception tests are available to evaluate hearing, there is no standardized validated tool to quantify speech quality. The objective of this study is to develop a validated tool to measure quality of speech heard. Prospective instrument validation study of 35 normal hearing adults recruited at a tertiary referral center. Participants listened to 44 speech clips of male/female voices reciting the Rainbow Passage. Speech clips included original and manipulated excerpts capturing goal qualities such as mechanical and garbled. Listeners rated clips on a 10-point visual analog scale (VAS) of 18 characteristics (e.g. cartoonish, garbled). Skewed distribution analysis identified mean ratings in the upper and lower 2-point limits of the VAS (ratings of 8-10, 0-2, respectively); items with inconsistent responses were eliminated. The test was pruned to a final instrument of nine speech clips that clearly define qualities of interest: speech-like, male/female, cartoonish, echo-y, garbled, tinny, mechanical, rough, breathy, soothing, hoarse, like, pleasant, natural. Mean ratings were highest for original female clips (8.8) and lowest for not-speech manipulation (2.1). Factor analysis identified two subsets of characteristics: internal consistency demonstrated Cronbach's alpha of 0.95 and 0.82 per subset. Test-retest reliability of total scores was high, with an intraclass correlation coefficient of 0.76. The Speech Quality Instrument (SQI) is a concise, valid tool for assessing speech quality as an indicator for hearing performance. SQI may be a valuable outcome measure for cochlear implant recipients who, despite achieving excellent speech perception, often experience poor speech quality. 2b. Laryngoscope, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

Instrument for assessing mobile technology acceptability in diabetes self-management: a validation and reliability study.

PubMed

Frandes, Mirela; Deiac, Anca V; Timar, Bogdan; Lungeanu, Diana

2017-01-01

Nowadays, mobile technologies are part of everyday life, but the lack of instruments to assess their acceptability for the management of chronic diseases makes their actual adoption for this purpose slow. The objective of this study was to develop a survey instrument for assessing patients' attitude toward and intention to use mobile technology for diabetes mellitus (DM) self-management, as well as to identify sociodemographic characteristics and quality of life factors that affect them. We first conducted the documentation and instrument design phases, which were subsequently followed by the pilot study and instrument validation. Afterward, the instrument was administered 103 patients (median age: 37 years; range: 18-65 years) diagnosed with type 1 or type 2 DM, who accepted to participate in the study. The reliability and construct validity were assessed by computing Cronbach's alpha and using factor analysis, respectively. The instrument included statements about the actual use of electronic devices for DM management, interaction between patient and physician, attitude toward using mobile technology, and quality of life evaluation. Cronbach's alpha was 0.9 for attitude toward using mobile technology and 0.97 for attitude toward using mobile device applications for DM self-management. Younger patients (Spearman's ρ =-0.429; P <0.001) with better glycemic control (Spearman's ρ =-0.322; P <0.001) and higher education level (Kendall's τ =0.51; P <0.001) had significantly more favorable attitude toward using mobile assistive applications for DM control. Moreover, patients with a higher quality of life presented a significantly more positive attitude toward using modern technology (Spearman's ρ =0.466; P <0.001). The instrument showed good reliability and internal consistency, making it suitable for measuring the acceptability of mobile technology for DM self-management. Additionally, we found that even if most of the patients showed positive attitude toward

Instrument for assessing mobile technology acceptability in diabetes self-management: a validation and reliability study

PubMed Central

Frandes, Mirela; Deiac, Anca V; Timar, Bogdan; Lungeanu, Diana

2017-01-01

Background Nowadays, mobile technologies are part of everyday life, but the lack of instruments to assess their acceptability for the management of chronic diseases makes their actual adoption for this purpose slow. Objective The objective of this study was to develop a survey instrument for assessing patients’ attitude toward and intention to use mobile technology for diabetes mellitus (DM) self-management, as well as to identify sociodemographic characteristics and quality of life factors that affect them. Methods We first conducted the documentation and instrument design phases, which were subsequently followed by the pilot study and instrument validation. Afterward, the instrument was administered 103 patients (median age: 37 years; range: 18–65 years) diagnosed with type 1 or type 2 DM, who accepted to participate in the study. The reliability and construct validity were assessed by computing Cronbach’s alpha and using factor analysis, respectively. Results The instrument included statements about the actual use of electronic devices for DM management, interaction between patient and physician, attitude toward using mobile technology, and quality of life evaluation. Cronbach’s alpha was 0.9 for attitude toward using mobile technology and 0.97 for attitude toward using mobile device applications for DM self-management. Younger patients (Spearman’s ρ=−0.429; P<0.001) with better glycemic control (Spearman’s ρ=−0.322; P<0.001) and higher education level (Kendall’s τ=0.51; P<0.001) had significantly more favorable attitude toward using mobile assistive applications for DM control. Moreover, patients with a higher quality of life presented a significantly more positive attitude toward using modern technology (Spearman’s ρ=0.466; P<0.001). Conclusion The instrument showed good reliability and internal consistency, making it suitable for measuring the acceptability of mobile technology for DM self-management. Additionally, we found that even

Web-based dynamic Delphi: a new survey instrument

NASA Astrophysics Data System (ADS)

Yao, JingTao; Liu, Wei-Ning

2006-04-01

We present a mathematical model for a dynamic Delphi survey method which takes advantages of Web technology. A comparative study on the performance of the conventional Delphi method and the dynamic Delphi instrument is conducted. It is suggested that a dynamic Delphi survey may form a consensus quickly. However, the result may not be robust due to the judgement leaking issues.

Validation of fibromyalgia survey questionnaire and polysymptomatic distress scale in a Persian population.

PubMed

Bidari, Ali; Ghavidel-Parsa, Banafsheh; Amir Maafi, Alireza; Montazeri, Ali; Ghalehbaghi, Babak; Hassankhani, Amir; Aarabi, Yasaman; Haghdoost, Afrooz

2015-12-01

The aim of this study was to assess validity of the fibromyalgia survey questionnaire (FSQ) and polysymptomatic distress scale (PSD) in an Iranian population. We also sought to classify the severity levels of fibromyalgia (FM) symptoms according to the PSD scale. Participants were divided into FM and non-FM chronic pain disorder groups according to expert physician diagnosis. Patients in both groups answered to Persian-translated version of FSQ, fibromyalgia impact questionnaire (FIQ) and Short-Form-12 (SF-12). Both 1990 ACR criteria and FSDC were assessed in participates of two groups. Internal consistency and construct validity were evaluated. There was good internal consistency measured by Cronbach's alpha (0.814 for FSQ). FSQ and its subscales correlated significantly with FIQ scores and SF-12 subscales, indicating acceptable construct validity. The concordance rates of FSQ with 1990 ACR criteria and expert diagnosis were 61.2 and 75.7, respectively (convergence validity). The mean score of PSD and its components in FM group were significantly more than in control groups (discriminative validity). Using lower PSD score cutoff (≥8.5) for the diagnosis of fibromyalgia appeared to be the most effective approach in our population. ROC analysis of the PSD scores revealed 8.5-11.5, 11.5-15 and more than 15, respectively, as a mild, moderate and severe FM. Persian version of FSQ was a valid instrument for application in survey research among Iranian patients with chronic pain disorders. The current study revealed that PSD could be used as a valid tool for assessment of symptoms intensity regardless of fibromyalgia diagnosis.

Perception of Competence in Middle School Physical Education: Instrument Development and Validation

ERIC Educational Resources Information Center

Scrabis-Fletcher, Kristin; Silverman, Stephen

2010-01-01

Perception of Competence (POC) has been studied extensively in physical activity (PA) research with similar instruments adapted for physical education (PE) research. Such instruments do not account for the unique PE learning environment. Therefore, an instrument was developed and the scores validated to measure POC in middle school PE. A…

Field calibration and validation of remote-sensing surveys

USGS Publications Warehouse

Pe'eri, Shachak; McLeod, Andy; Lavoie, Paul; Ackerman, Seth D.; Gardner, James; Parrish, Christopher

2013-01-01

The Optical Collection Suite (OCS) is a ground-truth sampling system designed to perform in situ measurements that help calibrate and validate optical remote-sensing and swath-sonar surveys for mapping and monitoring coastal ecosystems and ocean planning. The OCS system enables researchers to collect underwater imagery with real-time feedback, measure the spectral response, and quantify the water clarity with simple and relatively inexpensive instruments that can be hand-deployed from a small vessel. This article reviews the design and performance of the system, based on operational and logistical considerations, as well as the data requirements to support a number of coastal science and management projects. The OCS system has been operational since 2009 and has been used in several ground-truth missions that overlapped with airborne lidar bathymetry (ALB), hyperspectral imagery (HSI), and swath-sonar bathymetric surveys in the Gulf of Maine, southwest Alaska, and the US Virgin Islands (USVI). Research projects that have used the system include a comparison of backscatter intensity derived from acoustic (multibeam/interferometric sonars) versus active optical (ALB) sensors, ALB bottom detection, and seafloor characterization using HSI and ALB.

Validation of instruments to measure students' mathematical knowledge

NASA Astrophysics Data System (ADS)

Khatimin, Nuraini; Zaharim, Azami; Aziz, Azrilah Abd

2015-02-01

This paper describes instruments' validation process to identify the suitability and accuracy of the final examination questions for engineering mathematics. As a compulsory subject for second year students from 4 departments in Faculty of Engineering and Built Environment Universiti Kebangsaan Malaysia, the Differential Equations 1 course (KKKQ2124) was considered in this study. The data used in this study consists of the raw marks for final examination of semester 2, 2012/2013 session. The data then will be run and analyzed using the Rasch measurement model. Rasch model can also examine the ability of students and redundancy of instrument constructs.

Development and Validation of a Multicultural Consciousness Instrument

ERIC Educational Resources Information Center

Dean, Shannon R.

2017-01-01

Developing multiculturally competent citizens is at the forefront of the espoused mission of higher education. The purpose of this study was to develop and validate a self-report instrument to measure traditional-age (18-to 24-year-old) college students' multicultural consciousness (e.g., awareness of self, knowledge of difference, and…

Linguistic Validation and Cultural Adaptation of Bulgarian Version of Hospital Survey on Patient Safety Culture (HSOPSC).

PubMed

Stoyanova, Rumyana; Dimova, Rositsa; Tarnovska, Miglena; Boeva, Tatyana

2018-05-20

Patient safety (PS) is one of the essential elements of health care quality and a priority of healthcare systems in most countries. Thus the creation of validated instruments and the implementation of systems that measure patient safety are considered to be of great importance worldwide. The present paper aims to illustrate the process of linguistic validation, cross-cultural verification and adaptation of the Bulgarian version of the Hospital Survey on Patient Safety Culture (B-HSOPSC) and its test-retest reliability. The study design is cross-sectional. The HSOPSC questionnaire consists of 42 questions, grouped in 12 different subscales that measure patient safety culture. Internal con-sistency was assessed using Cronbach's alpha. The Wilcoxon signed-rank test and the split-half method were used; the Spear-man-Brown coefficient was calculated. The overall Cronbach's alpha for B-HSOPSC is 0.918. Subscales 7 Staffing and 12 Overall perceptions of safety had the lowest coefficients. The high reliability of the instrument was confirmed by the Split-half method (0.97) and ICC-coefficient (0.95). The lowest values of Spearmen-Broun coefficients were found in items A13 and A14. The study offers an analysis of the results of the linguistic validation of the B-HSOPSC and its test-retest reliability. The psychometric characteristics of the questions revealed good validity and reliability, except two questions. In the future, the instrument will be administered to the target population in the main study so that the psychometric properties of the instrument can be verified.

Pancreatitis Quality of Life Instrument: Development of a new instrument

PubMed Central

Bova, Carol; Barton, Bruce; Hartigan, Celia

2014-01-01

Objectives: The goal of this project was to develop the first disease-specific instrument for the evaluation of quality of life in chronic pancreatitis. Methods: Focus groups and interview sessions were conducted, with chronic pancreatitis patients, to identify items felt to impact quality of life which were subsequently formatted into a paper-and-pencil instrument. This instrument was used to conduct an online survey by an expert panel of pancreatologists to evaluate its content validity. Finally, the modified instrument was presented to patients during precognitive testing interviews to evaluate its clarity and appropriateness. Results: In total, 10 patients were enrolled in the focus groups and interview sessions where they identified 50 items. Once redundant items were removed, the 40 remaining items were made into a paper-and-pencil instrument referred to as the Pancreatitis Quality of Life Instrument. Through the processes of content validation and precognitive testing, the number of items in the instrument was reduced to 24. Conclusions: This marks the development of the first disease-specific instrument to evaluate quality of life in chronic pancreatitis. It includes unique features not found in generic instruments (economic factors, stigma, and spiritual factors). Although this marks a giant step forward, psychometric evaluation is still needed prior to its clinical use. PMID:26770703

Higher Education and Students with Orthopedic Disabilities: A Survey Instrument.

ERIC Educational Resources Information Center

Singh, Delar K.

A survey instrument is presented that was used in a national survey of 160 colleges and universities to explore facilities and services to students with orthopedic disabilities. The survey contains 33 items that focus on the following areas: structural accessibility, academic accessibility, dorm-living, and recreational opportunities. The total…

Instructional Interactions of Kindergarten Mathematics Classrooms: Validating a Direct Observation Instrument

ERIC Educational Resources Information Center

Doabler, Christian; Smolkowski, Keith; Fien, Hank; Kosty, Derek B.; Cary, Mari Strand

2010-01-01

In this paper, the authors report research focused directly on the validation of the Coding of Academic Teacher-Student interactions (CATS) direct observation instrument. They use classroom information gathered by the CATS instrument to better understand the potential mediating variables hypothesized to influence student achievement. Their study's…

An Exploratory Survey of Information Requirements for Instrument Approach Charts

DOT National Transportation Integrated Search

1995-03-01

This report documents a user centered survey and interview effort conducted to analyze the information content of : current Instrument Approach Plates (IAP). In the pilot opinion survey of approach chart information requirements, : respondents indica...

International Energy Agency instrumented facilities survey for solar assisted low energy dwellings

DOE Office of Scientific and Technical Information (OSTI.GOV)

None

1982-02-01

Compiled are surveys outlining the instrumentation of 38 active and passive solar projects in 9 countries (Denmark, Italy, Japan, Netherlands, Sweden, Switzerland, United Kingdom, United States, and West Germany). After the surveys themselves are presented, the data are rearranged to compare answers from similar survey questions for each of the projects. These questions address building, solar system and instrumentation descriptions and meteorological, solar system and building system instrumentatation capabilities. (LEW)

Validation of the Fibromyalgia Survey Questionnaire within a Cross-Sectional Survey

PubMed Central

Häuser, Winfried; Jung, Eva; Erbslöh-Möller, Brigitte; Gesmann, Mechthild; Kühn-Becker, Hedi; Petermann, Franz; Langhorst, Jost; Weiss, Thomas; Winkelmann, Andreas; Wolfe, Frederick

2012-01-01

The Fibromyalgia Survey Questionnaire (FSQ) assesses the key symptoms of fibromyalgia syndrome. The FSQ can be administrated in survey research and settings where the use of interviews to evaluate the number of pain sites and extent of somatic symptom intensity and tender point examination would be difficult. We validated the FSQ in a cross-sectional survey with FMS patients. In a cross-sectional survey, participants with physician diagnosis of FMS were recruited by FMS-self help organisations and nine clinical institutions of different levels of care. Participants answered the FSQ (composed by the Widespread Pain Index [WPI] and the Somatic Severity Score [SSS]) assessing the Fibromyalgia Survey Diagnostic Criteria (FSDC) and the Patient Health Questionnaire PHQ 4. American College of Rheumatology 1990 classification criteria were assessed in a subgroup of participants. 1,651 persons diagnosed with FMS were included into analysis. The acceptance of the FSQ-items ranged between 78.9 to 98.1% completed items. The internal consistency of the items of the SSS ranged between 0.75–0.82. 85.5% of the study participants met the FSDC. The concordance rate of the FSDC and ACR 1990 criteria was 72.7% in a subsample of 128 patients. The Pearson correlation of the SSS with the PHQ 4 depression score was 0.52 (p<0.0001) and with the PHQ anxiety score was 0.51 (p<0.0001) (convergent validity). 64/202 (31.7%) of the participants not meeting the FSDC criteria and 152/1283 (11.8%) of the participants meeting the FSDC criteria reported an improvement (slightly too very much better) in their health status since FMS-diagnosis (Chi2 = 55, p<0.0001) (discriminant validity). The study demonstrated the feasibility of the FSQ in a cross-sectional survey with FMS-patients. The reliability, convergent and discriminant validity of the FSQ were good. Further validation studies of the FSQ in clinical and general population settings are necessary. PMID:22662163

Evaluation of an immunosuppressant side effect instrument.

PubMed

Winsett, Rebecca P; Arheart, Kris; Stratta, Robert J; Alloway, Rita; Wicks, Mona N; Gaber, A Osama; Hathaway, Donna K

2004-09-01

Clinicians continue to be compelled to evaluate the impact of immunosuppressive medication side effects on the quality of life of transplant recipients. We Were asked to develop an instrument to measure side effects in immunosuppressed transplant recipients. To construct an instrument that measures the impact and severity of side effects of immunosuppressive medications used in transplantation and to assess the reliability and validity of the newly developed instrument called the Memphis Survey. The instrument was constructed by a panel of physicians, nurses, and pharmacists with experience in treating transplant recipients. A small group of kidney transplant recipients (n= 13) provided pilot data for refining and testing the instrument. A national sample of kidney, liver, and heart transplant recipients (n = 505) provided data that were used to further develop the instrument. Factor analysis was used to determine the psychological dimensions underlying the instrument and to guide the construction of scales from the survey items. The instrument scales were then computed from the dataset of 505 transplant recipients to quantify the impact of immunosuppressant side effects on the quality of life of transplant recipients. Analyses showed the final instrument scales to be valid and reliable. Exploratory analysis suggests the need for further testing of the instrument to determine gender differences.

Study Abroad Survey Instruments: A Comparison of Survey Types and Experiences

ERIC Educational Resources Information Center

Durrant, Marie Bradshaw; Dorius, Cassandra Rasmussen

2007-01-01

This study examines different survey instruments used to assess the experiences of U.S. study abroad participants. The intended audience is international and area study practitioners interested in assessing study abroad programs through postprogram interviews. An interview with the top 20 universities for number of students sent on study abroad…

Development and Validation of a Practical Instrument for Injury Prevention: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT).

PubMed

Sun, Yi; Arning, Martin; Bochmann, Frank; Börger, Jutta; Heitmann, Thomas

2018-06-01

The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT) is a practical instrument that is currently used in the German woodworking and metalworking industries to monitor safety conditions at workplaces. The 12-item scoring system has three subscales rating technical, organizational, and personnel-related conditions in a company. Each item has a rating value ranging from 1 to 9, with higher values indicating higher standard of safety conditions. The reliability of this instrument was evaluated in a cross-sectional survey among 128 companies and its validity among 30,514 companies. The inter-rater reliability of the instrument was examined independently and simultaneously by two well-trained safety engineers. Agreement between the double ratings was quantified by the intraclass correlation coefficient and absolute agreement of the rating values. The content validity of the OSH-MAT was evaluated by quantifying the association between OSH-MAT values and 5-year average injury rates by Poisson regression analysis adjusted for the size of the companies and industrial sectors. The construct validity of OSH-MAT was examined by principle component factor analysis. Our analysis indicated good to very good inter-rater reliability (intraclass correlation coefficient = 0.64-0.74) of OSH-MAT values with an absolute agreement of between 72% and 81%. Factor analysis identified three component subscales that met exactly the structure theory of this instrument. The Poisson regression analysis demonstrated a statistically significant exposure-response relationship between OSH-MAT values and the 5-year average injury rates. These analyses indicate that OSH-MAT is a valid and reliable instrument that can be used effectively to monitor safety conditions at workplaces.

Validity-Supporting Evidence of the Self-Efficacy for Teaching Mathematics Instrument

ERIC Educational Resources Information Center

McGee, Jennifer R.; Wang, Chuang

2014-01-01

The purpose of this study is to provide evidence of reliability and validity of the Self-Efficacy for Teaching Mathematics Instrument (SETMI). Self-efficacy, as defined by Bandura, was the theoretical framework for the development of the instrument. The complex belief systems of mathematics teachers, as touted by Ernest provided insights into the…

Nursing Intensive-Care Satisfaction Scale [NICSS]: Development and validation of a patient-centred instrument.

PubMed

Romero-García, Marta; de la Cueva-Ariza, Laura; Benito-Aracil, Llucia; Lluch-Canut, Teresa; Trujols-Albet, Joan; Martínez-Momblan, Maria Antonia; Juvé-Udina, Maria-Eulàlia; Delgado-Hito, Pilar

2018-06-01

The aim of this study was to develop and validate the Nursing Intensive-Care Satisfaction Scale to measures satisfaction with nursing care from the critical care patient's perspective. Instruments that measure satisfaction with nursing cares have been designed and validated without taking the patient's perspective into consideration. Despite the benefits and advances in measuring satisfaction with nursing care, none instrument is specifically designed to assess satisfaction in intensive care units. Instrument development. The population were all discharged patients (January 2013 - January 2015) from three Intensive Care Units of a third level hospital (N = 200). All assessment instruments were given to discharged patients and 48 hours later, to analyse the temporal stability, only the questionnaire was given again. The validation process of the scale included the analysis of internal consistency, temporal stability; validity of construct through a confirmatory factor analysis; and criterion validity. Reliability was 0.95. The intraclass correlation coefficient for the total scale was 0.83 indicating a good temporal stability. Construct validity showed an acceptable fit and factorial structure with four factors, in accordance with the theoretical model, being Consequences factor the best correlated with other factors. Criterion validity, presented a correlation between low and high (range: 0.42-0.68). The scale has been designed and validated incorporating the perspective of critical care patients. Thanks to its reliability and validity, this questionnaire can be used both in research and in clinical practice. The scale offers a possibility to assess and develop interventions to improve patient satisfaction with nursing care. © 2018 John Wiley & Sons Ltd.

Validation of the SETOC Instrument--Student Evaluation of Teaching in Outpatient Clinics

ERIC Educational Resources Information Center

Zuberi, Rukhsana W.; Bordage, Georges; Norman, Geoffrey R.

2007-01-01

Purpose: There is a paucity of evaluation forms specifically developed and validated for outpatient settings. The purpose of this study was to develop and validate an instrument specifically for evaluating outpatient teaching, to provide reliable and valid ratings for individual and group feedback to faculty, and to identify outstanding teachers…

Validation of the diabetes, hypertension and hyperlipidemia (DHL) knowledge instrument in Malaysia

PubMed Central

2012-01-01

Background Patient's knowledge on diabetes, hypertension and hyperlipidaemia and its medications can be used as one of the outcome measures to assess the effectiveness of educational intervention. To date, no such instrument has been validated in Malaysia. Therefore, the aim of this study was to evaluate the validity and reliability of the Diabetes, Hypertension and Hyperlipidemia (DHL) knowledge instrument for assessing the knowledge of patients with type 2 diabetes in Malaysia. Methods A 28-item instrument which comprised of 5 domains: diabetes, hypertension, hyperlipidemia, medications and general issues was designed and tested. One point was given for every correct answer, whilst zero was given for incorrect answers. Scores ranged from 0 to 28, which were then converted into percentage. This was administered to 77 patients with type 2 diabetes in a tertiary hospital, who were on medication(s) for diabetes and who could understand English (patient group), and to 40 pharmacists (professional group). The DHL knowledge instrument was administered again to the patient group after one month. Excluded were patients less than 18 years old. Results Flesch reading ease was 60, which is satisfactory, while the mean difficulty factor(SD) was 0.74(0.21), indicating that DHL knowledge instrument was moderately easy. Internal consistency of the instrument was good, with Cronbach's α = 0.791. The test-retest scores showed no significant difference for 26 out of the 28 items, indicating that the questionnaire has achieved stable reliability. The overall mean(SD) knowledge scores was significantly different between the patient and professional groups [74.35(14.88) versus 93.84(6.47), p < 0.001]. This means that the DHL knowledge instrument could differentiate the knowledge levels of participants. The DHL knowledge instrument shows similar psychometric properties as other validated questionnaires. Conclusions The DHL knowledge instrument shows good promise to be adopted as an

Validation of an instrument to measure inter-organisational linkages in general practice.

PubMed

Amoroso, Cheryl; Proudfoot, Judith; Bubner, Tanya; Jayasinghe, Upali W; Holton, Christine; Winstanley, Julie; Beilby, Justin; Harris, Mark F

2007-12-03

Linkages between general medical practices and external services are important for high quality chronic disease care. The purpose of this research is to describe the development, evaluation and use of a brief tool that measures the comprehensiveness and quality of a general practice's linkages with external providers for the management of patients with chronic disease. In this study, clinical linkages are defined as the communication, support, and referral arrangements between services for the care and assistance of patients with chronic disease. An interview to measure surgery-level (rather than individual clinician-level) clinical linkages was developed, piloted, reviewed, and evaluated with 97 Australian general practices. Two validated survey instruments were posted to patients, and a survey of locally available services was developed and posted to participating Divisions of General Practice (support organisations). Hypotheses regarding internal validity, association with local services, and patient satisfaction were tested using factor analysis, logistic regression and multilevel regression models. The resulting General Practice Clinical Linkages Interview (GP-CLI) is a nine-item tool with three underlying factors: referral and advice linkages, shared care and care planning linkages, and community access and awareness linkages. Local availability of chronic disease services has no affect on the comprehensiveness of services with which practices link, however, comprehensiveness of clinical linkages has an association with patient assessment of access, receptionist services, and of continuity of care in their general practice. The GP-CLI may be useful to researchers examining comparable health care systems for measuring the comprehensiveness and quality of linkages at a general practice-level with related services, possessing both internal and external validity. The tool can be used with large samples exploring the impact, outcomes, and facilitators of high

The Ostomy-Q: Development and Psychometric Validation of an Instrument to Evaluate Outcomes Associated with Ostomy Appliances.

PubMed

Nafees, Beenish; Rasmussen, Mikkel; LLoyd, Andrew

2017-01-01

Using an ostomy appliance can affect many aspects of a person's health-related quality of life (HRQL). A 2-part, descrip- tive study was designed to develop and validate an instrument to assess quality-of-life outcomes related to ostomy ap- pliance use. Study inclusion/exclusion criteria stipulated participants should be 18 to 85 years of age, have an ileostomy or colostomy, used an appliance for a minimum of 3 months without assistance, and able to complete an online survey. All participants provided sociodemographic and clinical information. In phase 1, a literature search was conducted and existing instruments used to measure HRQL in persons with an ostomy were assessed. Subsequently, the Ostomy-Q, a 23-item, Likert-response type questionnaire, divided into 4 domains (Discreetness, Comfort, Confidence, and Social Life), was developed based on published evidence and existing ostomy-related HRQL tools. Seven (7) participants re- cruited from a manufacturer user panel took part in exploratory/cognitive qualitative interviews to refine the new quality- of-life questionnaire. In phase 2, the instrument was tested to assess item variability and conceptual structure, item-total correlation, internal consistency, test-retest reliability, sensitivity, and minimal important difference (MID) in an online validation study among 200 participants from the manufacturer's user panel (equally divided by gender, 125 [62.5%] >50 years old, 128 [64%] with an ileostomy). This exercise also included completion of the Stoma Quality of Life Question- naire and 2 domains from the Ostomy Adjustment Inventory-23 to assess convergent validity. Eighty-two (82) participants recompleted these study instruments 2 weeks later to assess test-retest reliability. Sociodemographic and clinical data were assessed using descriptive statistics; Cronbach's alpha was used for internal consistency (minimum 0.70), principle component analysis for item variability/conceptual structure, and item

New Mobile Atmospheric Lidar Systems for Spaceborne Instrument Validation

NASA Astrophysics Data System (ADS)

Chazette, P.; Raut, J.-C.; Sanak, J.; Berthier, S.; Dulac, F.; Kim, S. W.; Royer, P.

2009-04-01

We present an overview of our different approaches using lidar systems as a tool to validate and develop the new generation of spaceborne missions. We have developed several mini-lidars in order to study the vertical structure, the clouds and the particulate composition of the atmosphere from mobile platforms. Here we focus on three mobile instrumental platforms including a backscatter lidar instrument developed for validation of the Cloud-Aerosol LIdar with Orthogonal Polarization (CALIOP) onboard CALIPSO and of the Interféromètre Atmosphérique de Sondage Infrarouge (IASI) onboard METOP. The first system is operated onboard an ultra-light aircraft (ULA) (Chazette et al., Environ. Sci. Technol., 2007). The second one is operated onboard a stratospheric balloon to study the interest of the measurement synergy with the Infrared Atmospheric Sounding Interferometer (IASI). The third one is part of a truck/car mobile station to be positioned close to the satellite ground-track (e.g. CALIPSO) or inside the area delimitated by the instrumental swath (e.g. IASI). CALIPSO was inserted in the A-Train constellation behind Aqua on 28 April, 2006 (http://www-calipso.larc.nasa.gov/about/atrain.php). One of the main objectives of the scientific mission is the study of atmospheric aerosols. Before the CALIOP lidar profiles could be used in an operational way, it has been necessary to validate both the raw and geophysical data of the instrument. For this purpose, we carried out an experiment in south-eastern France in summer 2007 to validate the aerosol product of CALIOP by operating both the ground-based and the airborne mobile lidars in coincidence with CALIOP. The synergy between the new generation of spaceborne passive and active instruments is promising to assess the concentration of main pollutants as aerosol, O3 and CO, and greenhouse gases as CO2 and CH4 within the planetary boundary layer (PBL) and to increase the accuracy on the vertical profile of temperature. IASI is

Validation of Radiometric Standards for the Laboratory Calibration of Reflected-Solar Earth Observing Satellite Instruments

NASA Technical Reports Server (NTRS)

Butler, James J.; Johnson, B. Carol; Rice, Joseph P.; Brown, Steven W.; Barnes, Robert A.

2007-01-01

Historically, the traceability of the laboratory calibration of Earth-observing satellite instruments to a primary radiometric reference scale (SI units) is the responsibility of each instrument builder. For the NASA Earth Observing System (EOS), a program has been developed using laboratory transfer radiometers, each with its own traceability to the primary radiance scale of a national metrology laboratory, to independently validate the radiances assigned to the laboratory sources of the instrument builders. The EOS Project Science Office also developed a validation program for the measurement of onboard diffuse reflecting plaques, which are also used as radiometric standards for Earth-observing satellite instruments. Summarized results of these validation campaigns, with an emphasis on the current state-of-the-art uncertainties in laboratory radiometric standards, will be presented. Future mission uncertainty requirements, and possible enhancements to the EOS validation program to ensure that those uncertainties can be met, will be presented.

Translation, cross-cultural adaptation and validation of an HIV/AIDS knowledge and attitudinal instrument.

PubMed

Zometa, Carlos S; Dedrick, Robert; Knox, Michael D; Westhoff, Wayne; Siri, Rodrigo Simán; Debaldo, Ann

2007-06-01

An instrument developed in the United States by the Centers for Disease Control and Prevention to assess HIV/AIDS knowledge and four attitudinal dimensions (Peer Pressure, Abstinence, Drug Use, and Threat of HIV Infection) and an instrument developed by Basen-Engquist et al. (1999) to measure abstinence and condom use were translated, cross-culturally adapted, and validated for use with Spanish-speaking high school students in El Salvador. A back-translation of the English version was cross-culturally adapted using two different review panels and pilot-tested with Salvadorian students. An expert panel established content validity, and confirmatory factor analysis provided support for construct validity. Results indicated that the methodology was successful in cross-culturally adapting the instrument developed by the Centers for Disease Control and Prevention and the instrument developed by Basen-Engquist et al. The psychometric properties of the knowledge section were acceptable and there was partial support for the four-factor attitudinal model underlying the CDC instrument and the two-factor model underlying the Basen-Engquist et al. instrument. Additional studies with Spanish-speaking populations (either in the United States or Latin America) are needed to evaluate the generalizability of the present results.

The validity of the SF-12 and SF-6D instruments in people living with HIV/AIDS in Kenya.

PubMed

Patel, Anik R; Lester, Richard T; Marra, Carlo A; van der Kop, Mia L; Ritvo, Paul; Engel, Lidia; Karanja, Sarah; Lynd, Larry D

2017-07-17

Health-related quality of life (HRQoL) and health state utility value (HSUV) measurements are vital components of healthcare clinical and economic evaluations. Accurate measurement of HSUV and HRQoL require validated instruments. The 12-item Short-Form Health Survey (SF-12) is one of few instruments that can evaluate both HRQoL and HSUV, but its validity has not been assessed in people living with HIV/AIDS (PLWHA) in east Africa, where the burden of HIV is high. This cross-sectional study used baseline data from a randomized trial involving PLWHA in Kenya. Data included responses from a translated and adapted SF-12 survey as well as key demographic and clinical data. Construct validity of the survey was examined by testing the SF-12's ability to distinguish between groups known in advance to have differences in their health based on their disease severity. We classified disease severity based on established definitions from the US Center for Disease Control (CDC) and WHO, as well as a previously studied viral load threshold. T-tests and ANOVA were used to test for differences in HRQoL and HSUV scores. Area under the receive operator curve (AUC) was used to test the discriminative ability of the HRQoL and HSUV instruments. Differences in physical component scores met the minimum clinically important difference among participants with more advanced HIV when defined by CD4 count (4.3 units) and WHO criteria (compared to stage 1, stages 2, 3 and 4 were 2.0, 7.2 and 9.8 units lower respectively). Mental score differences met the minimum clinically important difference between WHO stage 1 and stage 4 patients (4.4). Differences in the HSUV were statistically lower in more advanced HIV by all three definitions of severity. The AUC showed poor to weak discriminatory ability in most analyses, but had fair discriminatory ability between WHO clinical stage 1 and clinical stage 4 individuals (AUC = 0.71). Our findings suggest that the Kiswahili translated and adapted

Psychometric Analysis and Qualitative Review of an Outpatient Radiology-Specific Patient Satisfaction Survey: A Call for Collaboration in Validating a Survey Instrument.

PubMed

Dibble, Elizabeth H; Baird, Grayson L; Swenson, David W; Healey, Terrance T

2017-10-01

The aim of this study was to perform a psychometric analysis of the constructs and reliability of an outpatient radiology-specific patient satisfaction survey and identify factors that drive patient experience so that radiology practices can improve the quality of their diagnostic imaging services. This retrospective study examined responses to eight patient satisfaction questions from a survey originally developed by a nascent marketing team and then administered at five outpatient imaging centers from January 7, 2013, to November 11, 2015. Patients' responses were reviewed to identify factors that affected patient experience, and a psychometric analysis of the survey instrument itself was performed, including exploratory factor analyses and reliability testing. Patient responses were compared among sites, examination types, and questions. Free-text comments were qualitatively categorized and compared by examination type. In total, 6,512 surveys were completed among 137,059 patient encounters. Using exploratory factor analyses of the eight survey questions, three relevant patient experience constructs were derived: (1) front office experience, (2) intake experience, and (3) examination experience. Overall, good scale reliability was observed. Perceived quality of care had the most positive ratings; wait time had the most nonpositive ratings. Of 2,024 free-text comments, 1,859 were positive (most pertaining to staff), and 155 were negative (most pertaining to convenience). MRI patients were most likely to share negative comments, typically regarding the examination experience itself. Psychometric analysis of a patient survey derived three core patient experience constructs: front office experience, intake experience, and examination experience. The survey indicates the need to decrease wait times, streamline the registration process, and improve patient comfort during MRI examinations. Copyright © 2017 American College of Radiology. Published by Elsevier Inc. All

Inter-calibration and validation of observations from SAPHIR and ATMS instruments

NASA Astrophysics Data System (ADS)

Moradi, I.; Ferraro, R. R.

2015-12-01

We present the results of evaluating observations from microwave instruments aboard the Suomi National Polar-orbiting Partnership (NPP, ATMS instrument) and Megha-Tropiques (SAPHIR instrument) satellites. The study includes inter-comparison and inter-calibration of observations of similar channels from the two instruments, evaluation of the satellite data using high-quality radiosonde data from Atmospheric Radiation Measurement Program and GPS Radio Occultaion Observations from COSMIC mission, as well as geolocation error correction. The results of this study are valuable for generating climate data records from these instruments as well as for extending current climate data records from similar instruments such as AMSU-B and MHS to the ATMS and SAPHIR instruments. Reference: Moradi et al., Intercalibration and Validation of Observations From ATMS and SAPHIR Microwave Sounders. IEEE Transactions on Geoscience and Remote Sensing. 01/2015; DOI: 10.1109/TGRS.2015.2427165

Validity and reliability of the Turkish version of the pressure ulcer prevention knowledge assessment instrument.

PubMed

Tulek, Zeliha; Polat, Cansu; Ozkan, Ilknur; Theofanidis, Dimitris; Togrol, Rifat Erdem

2016-11-01

Sound knowledge of pressure ulcers is important to enable good prevention. There are limited instruments assessing pressure ulcer knowledge. The Pressure Ulcer Prevention Knowledge Assessment Instrument is among the scales of which psychometric properties have been studied rigorously and reflects the latest evidence. This study aimed to evaluate the validity and reliability of the Turkish version of the Pressure Ulcer Prevention Knowledge Assessment Instrument (PUPKAI-T), an instrument that assesses knowledge of pressure ulcer prevention by using multiple-choice questions. Linguistic validity was verified through front-to-back translation. Psychometric properties of the instrument were studied on a sample of 150 nurses working in a tertiary hospital in Istanbul, Turkey. The content validity index of the translated instrument was 0.94, intra-class correlation coefficients were between 0.37 and 0.80, item difficulty indices were between 0.21 and 0.88, discrimination indices were 0.20-0.78, and the Kuder Richardson for the internal consistency was 0.803. The PUPKAI-T was found to be a valid and reliable tool to evaluate nurses' knowledge on pressure ulcer prevention. The PUPKAI-T may be a useful tool for determining educational needs of nurses on pressure ulcer prevention. Copyright © 2016 Tissue Viability Society. Published by Elsevier Ltd. All rights reserved.

Using Lunar Observations to Validate In-Flight Calibrations of Clouds and Earth Radiant Energy System Instruments

NASA Technical Reports Server (NTRS)

Daniels, Janet L.; Smith, G. Louis; Priestley, Kory J.; Thomas, Susan

2014-01-01

The validation of in-orbit instrument performance requires stability in both instrument and calibration source. This paper describes a method of validation using lunar observations scanning near full moon by the Clouds and Earth Radiant Energy System (CERES) instruments. Unlike internal calibrations, the Moon offers an external source whose signal variance is predictable and non-degrading. From 2006 to present, in-orbit observations have become standardized and compiled for the Flight Models-1 and -2 aboard the Terra satellite, for Flight Models-3 and -4 aboard the Aqua satellite, and beginning 2012, for Flight Model-5 aboard Suomi-NPP. Instrument performance parameters which can be gleaned are detector gain, pointing accuracy and static detector point response function validation. Lunar observations are used to examine the stability of all three detectors on each of these instruments from 2006 to present. This validation method has yielded results showing trends per CERES data channel of 1.2% per decade or less.

Validity of the language development survey in infants born preterm.

PubMed

Beaulieu-Poulin, Camille; Simard, Marie-Noëlle; Babakissa, Hélène; Lefebvre, Francine; Luu, Thuy Mai

2016-07-01

Preterm infants are at greater risk of language delay. Early identification of language delay is essential to improve functional outcome in these children. To examine the concurrent validity of Rescorla's Language Development Survey and the Bayley Scales of Infant and Toddler Development (Bayley-III) at 18months corrected age in preterm infants. Test accuracy study. 189 preterm infants born <29weeks were assessed at 18months. The Language Development Survey, a parent-reported screening instrument, was administered in French concurrently with the Language Scales of the Bayley-III. Receiver-Operating-Characteristics curves were used to determine optimal cut-off score on the Language Development Survey to identify Bayley-III score <85. Sensitivity, specificity, positive and negative predictive values, and κ coefficient were calculated. Using Rescorla's original cut-off scores of ≤10 words for boys and ≤24 for girls, sensitivity was 76% and 88% for boys and girls, respectively, and specificity was 73% and 52% for boys and girls, respectively, in identifying language delay as per the Bayley-III. The optimal threshold was ≤10 words for both boys and girls. In girls, lowering the cut-off score decreased sensitivity (79%), but improved specificity (82%), thus lowering the number of false-positives. Our findings support using the Language Development Survey as an expressive language screener in preterm infants. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Content validity of the Geriatric Health Assessment Instrument.

PubMed

Pedreira, Rhaine Borges Santos; Rocha, Saulo Vasconcelos; Santos, Clarice Alves Dos; Vasconcelos, Lélia Renata Carneiro; Reis, Martha Cerqueira

2016-01-01

Assess the content validity of the Elderly Health Assessment Tool with low education. The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as "not valid", "somewhat valid" or "valid", using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly. Avaliar a validade de conteúdo do Instrumento de Avaliação da Saúde do Idoso com baixa escolaridade. Após a elaboração do instrumento de coleta de dados, o questionário foi submetido à avaliação de um comitê de especialistas, formado por quatro profissionais da área da saúde com experiência em pesquisas da epidemiologia do envelhecimento. Os especialistas puderam sugerir questões a serem incluídas/excluídas do instrumento, e avaliar cada bloco do questionário, observando se as dimensões a serem avaliadas foram abrangidas pelos itens do instrumento, em escala intervalar, como "não válida", "pouco válida" e "válida". Como medidas para avaliar o grau de concordância do instrumento, foram utilizados o porcentual de concordância e o Índice de Validade de Conteúdo. Considerou-se uma taxa aceitável de concordância o valor de

Developing and validating an instrument for measuring mobile computing self-efficacy.

PubMed

Wang, Yi-Shun; Wang, Hsiu-Yuan

2008-08-01

IT-related self-efficacy has been found to have a critical influence on system use. However, traditional measures of computer self-efficacy and Internet-related self-efficacy are perceived to be inapplicable in the context of mobile computing and commerce because they are targeted primarily at either desktop computer or wire-based technology contexts. Based on previous research, this study develops and validates a multidimensional instrument for measuring mobile computing self-efficacy (MCSE). This empirically validated instrument will be useful to researchers in developing and testing the theories of mobile user behavior, and to practitioners in assessing the mobile computing self-efficacy of users and promoting the use of mobile commerce systems.

Development of a survey instrument to measure connectivity to evaluate national public health preparedness and response performance.

PubMed

Dorn, Barry C; Savoia, Elena; Testa, Marcia A; Stoto, Michael A; Marcus, Leonard J

2007-01-01

Survey instruments for evaluating public health preparedness have focused on measuring the structure and capacity of local, state, and federal agencies, rather than linkages among structure, process, and outcomes. To focus evaluation on the latter, we evaluated the linkages among individuals, organizations, and systems using the construct of "connectivity" and developed a measurement instrument. Results from focus groups of emergency preparedness first responders generated 62 items used in the development sample of 187 respondents. Item reduction and factors analyses were conducted to confirm the scale's components. The 62 items were reduced to 28. Five scales explained 70% of the total variance (number of items, percent variance explained, Cronbach's alpha) including connectivity with the system (8, 45%, 0.94), coworkers (7, 7%, 0.91), organization (7, 12%, 0.93), and perceptions (6, 6%, 0.90). Discriminant validity was found to be consistent with the factor structure. We developed a Connectivity Measurement Tool for the public health workforce consisting of a 34-item questionnaire found to be a reliable measure of connectivity with preliminary evidence of construct validity.

[Data validation methods and discussion on Chinese materia medica resource survey].

PubMed

Zhang, Yue; Ma, Wei-Feng; Zhang, Xiao-Bo; Zhu, Shou-Dong; Guo, Lan-Ping; Wang, Xing-Xing

2013-07-01

From the beginning of the fourth national survey of the Chinese materia medica resources, there were 22 provinces have conducted pilots. The survey teams have reported immense data, it put forward the very high request to the database system construction. In order to ensure the quality, it is necessary to check and validate the data in database system. Data validation is important methods to ensure the validity, integrity and accuracy of census data. This paper comprehensively introduce the data validation system of the fourth national survey of the Chinese materia medica resources database system, and further improve the design idea and programs of data validation. The purpose of this study is to promote the survey work smoothly.

Translation and validation of the Arab version of the Late-Life Function and Disability Instrument: a cross sectional study.

PubMed

Elboim-Gabyzon, Michal; Agmon, Maayan; Azaiza, Faisal; Laufer, Yocheved

2015-04-24

The Late-Life Function and Disability Instrument (LLFDI) provides a comprehensive, reliable, and valid assessment of physical function and disability in community-dwelling adults. There does not appear to be a validated, comprehensive instrument for assessing function and disability in Arabic. The objective of the present study was to translate and culturally adapt the LLFDI to Arabic, and to determine its test-retest reliability and validity. The LLFDI was translated to Arabic through a forward and backward translation process, and approved by a bilingual committee of experts. Sixty-one (26 male and 35 female) Arabic speaking, healthy, older adults, ages 65-88, living in northern Israel participated in the study. To determine test-retest reliability, the questionnaire was administered twice to 41 subjects with a 6 to 8day interval. Construct validity was examined by correlating the LLFDI responses with the 10-item physical function (PF-10) subscales of the General Health Survey (SF-36), with the physical component of SF-36 (SF-36 PCS), and with two performance measures, the Berg Balance Scale (BBS) and Time Up and Go (TUG) test. Additionally, gender and fall related differences in the LLFDI were also examined. Internal consistency (Cronbach's alpha) was good to excellent (0.77 to 0.97). Test-retest agreement was good to very good (function component: 0.86-0.93, disability component: 0.77-0.93). Correlation with the SF-36 PCS and PF-10 was moderate to strong for both LLFDI components (function, r = 0.53-0.65 and r = 0.57-0.63, and LLFDI disability, r = 0.57-0.76 and 0.53-0.73, respectively). Significant, moderate-to-strong correlations between the LLFDI and BBS (r = 0.73-0.87) and a significant, moderate, negative correlation between LLFDI and TUG test (r = -0.59- -0.68) were noted. The standard error of measure was 6-12%, and the smallest real difference was 18-33%. Discriminative validity for both gender and fall status were also demonstrated. The Arabic version

Fitness to plead: Development and validation of a standardised assessment instrument

PubMed Central

Stahl, Daniel; Appiah-Kusi, Elizabeth; Brewer, Rebecca; Watts, Michael; Peay, Jill; Blackwood, Nigel

2018-01-01

The ability of an individual to participate in courtroom proceedings is assessed by clinicians using legal ‘fitness to plead’ criteria. Findings of ‘unfitness’ are so rare that there is considerable professional unease concerning the utility of the current subjective assessment process. As a result, mentally disordered defendants may be subjected unfairly to criminal trials. The Law Commission in England and Wales has proposed legal reform, as well as the utilisation of a defined psychiatric instrument to assist in fitness to plead assessments. Similar legal reforms are occurring in other jurisdictions. Our objective was to produce and validate a standardised assessment instrument of fitness to plead employing a filmed vignette of criminal proceedings. The instrument was developed in consultation with legal and clinical professionals, and was refined using standard item reduction methods in two initial rounds of testing (n = 212). The factorial structure, test-retest reliability and convergent validity of the resultant instrument were assessed in a further round (n = 160). As a result of this iterative process a 25-item scale was produced, with an underlying two-factor structure representing the foundational and decision-making abilities underpinning fitness to plead. The sub-scales demonstrate good internal consistency (factor 1: 0·76; factor 2: 0·65) and test-retest stability (0·7) as well as excellent convergent validity with scores of intelligence, executive function and mentalising abilities (p≤0·01 in all domains). Overall the standardised Fitness to Plead Assessment instrument has good psychometric properties. It has the potential to ensure that the significant numbers of mentally ill and cognitively impaired individuals who face trial are objectively assessed, and the courtroom process critically informed. PMID:29698396

Measuring Stakeholder Participation in Evaluation: An Empirical Validation of the Participatory Evaluation Measurement Instrument (PEMI)

ERIC Educational Resources Information Center

Daigneault, Pierre-Marc; Jacob, Steve; Tremblay, Joel

2012-01-01

Background: Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. Objectives: This study consists of a first empirical validation of a measurement instrument that…

Validation of a School Environment Survey among Colombian Teachers

ERIC Educational Resources Information Center

Román-Calderón, Juan Pablo; Ospina-Londoño, Mónica Patricia; Garcés-Ceballos, José David

2017-01-01

The article explores the validity and reliability of an instrument for measuring for the School Environment (SE) among 3610 teachers in Medellín, Colombia during 2011. A multilevel exploratory factorial analysis established through 20 items that the instrument identifies four dimensions of SE on an individual level: communication between school…

The N2N instrument to evaluate healthy work environments: an Italian validation.

PubMed

Palese, Alvisa; Dante, Angelo; Tonzar, Laura; Balboni, Bernardo

2014-02-01

The aims of the study were to (a) validate N2N Healthy Work Environment tool, (b) assess the healthiness of work environments as perceived by nurses themselves and (c) identify the factors associated with Italian nurses' perception of work environment healthiness. The linguistic and cultural adaptation of USA-N2N Healthy Work Environments was achieved through a process of forward/backward translation. Content validity was assessed by three expert nurses. The stability of the instrument was checked with a test/retest evaluation. The instrument psychometric properties, the confirmatory factor analysis as well the healthiness of the work environment and its determinant factors were evaluated with a sample of 294 nurses. The content and face validity of the N2N Healthy Work Environment instrument was confirmed. The instrument demonstrated good internal consistency (α of 0.82), excellent stability values (ρ > 0.70) and high levels of acceptability (response rate: 96.4 %). The confirmatory factor analysis has corroborated the existence of two factors as documented in the original instrument (Mays et al. in J Nurs Manag 19:18-26, 2011). Eighty-seven (29.6 %) nurses perceived the work environment where they work as "healthy". Working under a functional model of care delivery (χ(2) 24.856, p 0.000) and being responsible for one project or more (χ(2) 5.256, p 0.021) were associated with healthy environments. The instrument--valid and reliable, short in the number of items, easy to understand and based on international standards--allows a systematic assessment of the healthiness of the environment and might provide not only the opportunity to evaluate the effects of new organizational models and interventions, but also the possibility to activate a process of self-analysis and a process of ongoing review. The instrument can be used to systematically check the healthiness of Italian working environments, allowing for organizational diagnosis, targeted interventions and

The Nutrition Literacy Assessment Instrument is a Valid and Reliable Measure of Nutrition Literacy in Adults with Chronic Disease.

PubMed

Gibbs, Heather D; Ellerbeck, Edward F; Gajewski, Byron; Zhang, Chuanwu; Sullivan, Debra K

2018-03-01

To test the reliability and validity of the Nutrition Literacy Assessment Instrument (NLit) in adult primary care and identify the relationship between nutrition literacy and diet quality. This instrument validation study included a cross-sectional sample participating in up to 2 visits 1 month apart. A total of 429 adults with nutrition-related chronic disease were recruited from clinics and a patient registry affiliated with a Midwestern university medical center. Nutrition literacy was measured by the NLit, which was composed of 6 subscales: nutrition and health, energy sources in food, food label and numeracy, household food measurement, food groups, and consumer skills. Diet quality was measured by Healthy Eating Index-2010 with nutrient data from Diet History Questionnaire II surveys. The researchers measured factor validity and reliability by using binary confirmatory factor analysis; test-retest reliability was measured by Pearson r and the intraclass correlation coefficient, and relationships between nutrition literacy and diet quality were analyzed by linear regression. The NLit demonstrated substantial factor validity and reliability (0.97; confidence interval, 0.96-0.98) and test-retest reliability (0.88; confidence interval, 0.85-0.90). Nutrition literacy was the most significant predictor of diet quality (β = .17; multivariate coefficient = 0.10; P < .001). The NLit is a valid and reliable tool for measuring nutrition literacy in adult primary care patients. Copyright © 2017 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Development and Validation of a Quality-of-Life Instrument for Infantile Hemangiomas.

PubMed

Chamlin, Sarah L; Mancini, Anthony J; Lai, Jin-Shei; Beaumont, Jennifer L; Cella, David; Adams, Denise; Drolet, Beth; Baselga, Eulalia; Frieden, Ilona J; Garzon, Maria; Holland, Kristin; Horii, Kimberly A; Lucky, Anne W; McCuaig, Catherine; Metry, Denise; Morel, Kimberly D; Newell, Brandon D; Nopper, Amy J; Powell, Julie; Siegel, Dawn; Haggstrom, Anita N

2015-06-01

Infantile hemangiomas (IH) are common tumors for which there is no validated disease-specific instrument to measure the quality of life in infants and their parents/caregivers during the critical first months of life. This study prospectively developed and validated a quality-of-life instrument for patients with IH and their parents/caregivers and correlated demographic and clinical features to the effects on the quality of life. A total of 220 parents/caregivers completed the 35-item Infantile Hemangioma Quality-of-Life (IH-QoL) instrument and provided demographic information. The dimensionality of the items was evaluated using factor analysis, with results suggesting four factors: child physical symptoms, child social interactions, parent emotional functioning, and parent psychosocial functioning. Each factor fit the Rasch measurement model with acceptable fit index (mean square <1.4) and demonstrated excellent internal consistency, with alpha ranging from 0.76 to 0.88. The final instrument consists of four scales with a total of 29 items. Content validity was verified by analyzing parents' responses to an open-ended question. Test-retest reliability at a 48-hour interval was supported by a total IH-QoL intraclass correlation coefficient of 0.84. Certain clinical characteristics of hemangioma, including those located on the head and neck, in the proliferative stage, and requiring treatment, are associated with a greater impact on QoL.

Comparing NICU teamwork and safety climate across two commonly used survey instruments

PubMed Central

Profit, Jochen; Lee, Henry C; Sharek, Paul J; Kan, Peggy; Nisbet, Courtney C; Thomas, Eric J; Etchegaray, Jason M; Sexton, Bryan

2016-01-01

Background and objectives Measurement and our understanding of safety culture are still evolving. The objectives of this study were to assess variation in safety and teamwork climate and in the neonatal intensive care unit (NICU) setting, and compare measurement of safety culture scales using two different instruments (Safety Attitudes Questionnaire (SAQ) and Hospital Survey on Patient Safety Culture (HSOPSC)). Methods Cross-sectional survey study of a voluntary sample of 2073 (response rate 62.9%) health professionals in 44 NICUs. To compare survey instruments, we used Spearman's rank correlation coefficients. We also compared similar scales and items across the instruments using t tests and changes in quartile-level performance. Results We found significant variation across NICUs in safety and teamwork climate scales of SAQ and HSOPSC (p<0.001). Safety scales (safety climate and overall perception of safety) and teamwork scales (teamwork climate and teamwork within units) of the two instruments correlated strongly (safety r=0.72, p<0.001; teamwork r=0.67, p<0.001). However, the means and per cent agreements for all scale scores and even seemingly similar item scores were significantly different. In addition, comparisons of scale score quartiles between the two instruments revealed that half of the NICUs fell into different quartiles when translating between the instruments. Conclusions Large variation and opportunities for improvement in patient safety culture exist across NICUs. Important systematic differences exist between SAQ and HSOPSC such that these instruments should not be used interchangeably. PMID:26700545

Validation of an Instructional Observation Instrument for Teaching English as a Foreign Language in Spain

ERIC Educational Resources Information Center

Gomez-Garcia, Maria

2011-01-01

The design and validation of a classroom observation instrument to provide formative feedback for teachers of EFL in Spain is the overarching purpose of this study. This study proposes that a valid and reliable classroom observation instrument, based on effective practice in teaching EFL, can be developed and used in Spain to enable teachers to…

Patient experiences questionnaire for interdisciplinary treatment for substance dependence (PEQ-ITSD): reliability and validity following a national survey in Norway.

PubMed

Haugum, Mona; Iversen, Hilde Hestad; Bjertnaes, Oyvind; Lindahl, Anne Karin

2017-02-20

Patient experiences are an important aspect of health care quality, but there is a lack of validated instruments for their measurement in the substance dependence literature. A new questionnaire to measure inpatients' experiences of interdisciplinary treatment for substance dependence has been developed in Norway. The aim of this study was to psychometrically test the new questionnaire, using data from a national survey in 2013. The questionnaire was developed based on a literature review, qualitative interviews with patients, expert group discussions and pretesting. Data were collected in a national survey covering all residential facilities with inpatients in treatment for substance dependence in 2013. Data quality and psychometric properties were assessed, including ceiling effects, item missing, exploratory factor analysis, and tests of internal consistency reliability, test-retest reliability and construct validity. The sample included 978 inpatients present at 98 residential institutions. After correcting for excluded patients (n = 175), the response rate was 91.4%. 28 out of 33 items had less than 20.5% of missing data or replies in the "not applicable" category. All but one item met the ceiling effect criterion of less than 50.0% of the responses in the most favorable category. Exploratory factor analysis resulted in three scales: "treatment and personnel", "milieu" and "outcome". All scales showed satisfactory internal consistency reliability (Cronbach's alpha ranged from 0.75-0.91) and test-retest reliability (ICC ranged from 0.82-0.85). 17 of 18 significant associations between single variables and the scales supported construct validity of the PEQ-ITSD. The content validity of the PEQ-ITSD was secured by a literature review, consultations with an expert group and qualitative interviews with patients. The PEQ-ITSD was used in a national survey in Norway in 2013 and psychometric testing showed that the instrument had satisfactory internal consistency

Development of the Human Factors Skills for Healthcare Instrument: a valid and reliable tool for assessing interprofessional learning across healthcare practice settings.

PubMed

Reedy, Gabriel B; Lavelle, Mary; Simpson, Thomas; Anderson, Janet E

2017-10-01

A central feature of clinical simulation training is human factors skills, providing staff with the social and cognitive skills to cope with demanding clinical situations. Although these skills are critical to safe patient care, assessing their learning is challenging. This study aimed to develop, pilot and evaluate a valid and reliable structured instrument to assess human factors skills, which can be used pre- and post-simulation training, and is relevant across a range of healthcare professions. Through consultation with a multi-professional expert group, we developed and piloted a 39-item survey with 272 healthcare professionals attending training courses across two large simulation centres in London, one specialising in acute care and one in mental health, both serving healthcare professionals working across acute and community settings. Following psychometric evaluation, the final 12-item instrument was evaluated with a second sample of 711 trainees. Exploratory factor analysis revealed a 12-item, one-factor solution with good internal consistency (α=0.92). The instrument had discriminant validity, with newly qualified trainees scoring significantly lower than experienced trainees ( t (98)=4.88, p<0.001) and was sensitive to change following training in acute and mental health settings, across professional groups (p<0.001). Confirmatory factor analysis revealed an adequate model fit (RMSEA=0.066). The Human Factors Skills for Healthcare Instrument provides a reliable and valid method of assessing trainees' human factors skills self-efficacy across acute and mental health settings. This instrument has the potential to improve the assessment and evaluation of human factors skills learning in both uniprofessional and interprofessional clinical simulation training.

Student engagement in mathematics: Development of instrument and validation of construct

NASA Astrophysics Data System (ADS)

Kong, Qi-Ping; Wong, Ngai-Ying; Lam, Chi-Chung

2003-05-01

Universal education has aggravated the problems of students' disengagement in learning, highlighting in particular, a greater range of motivations to learn and wider diversification in students' interests. Students' engagement with curriculum has become a crucial element in classroom learning. How we cultivate their involvement in the curriculum may be seen as being far more important than the epistemological consideration in the design of the school curriculum. Though aspects of behavioural, affective and cognitive engagements have been revealed in literature, we are still in need of a validated instrument that measures student engagement for further research. In the present study, an instrument of student engagement in the subject area of mathematics was developed through grounded research. Its validity was established by statistical methods

A Survey Instrument: General Educators and Students with Physical Disabilities.

ERIC Educational Resources Information Center

Singh, Delar K.

A survey instrument is presented that is designed to explore the in-service training needs of general elementary and secondary teachers as they relate to learners with physical disabilities. It contains 75 items and takes 20-25 minutes to complete. The survey includes questions about the educator's teaching experience, teacher training in special…

Validity evidence of non-technical skills assessment instruments in simulated anaesthesia crisis management.

PubMed

Jirativanont, T; Raksamani, K; Aroonpruksakul, N; Apidechakul, P; Suraseranivongse, S

2017-07-01

We sought to evaluate the validity of two non-technical skills evaluation instruments, the Anaesthetists' Non-Technical Skills (ANTS) behavioural marker system and the Ottawa Global Rating Scale (GRS), to apply them to anaesthesia training. The content validity, response process, internal structure, relations with other variables and consequences were described for validity evidence. Simulated crisis management sessions were initiated during which two trained raters evaluated the performance of postgraduate first-, second- and third-year (PGY-1, PGY-2 and PGY-3) anaesthesia residents. The study included 70 participants, composed of 24 PGY-1, 24 PGY-2 and 22 PGY-3 residents. Both instruments differentiated the non-technical skills of PGY-1 from PGY-3 residents ( P <0.05). Inter-rater agreement was measured using the intraclass correlation coefficient (ICC). For the ANTS instrument, the intraclass correlation coefficients for task management, team-working, situation awareness and decision-making were 0.79, 0.34, 0.81 and 0.70, respectively. For the Ottawa GRS, the intraclass correlation coefficients for overall performance, leadership, problem-solving, situation awareness, resource utilisation and communication skills were 0.86, 0.83, 0.84, 0.87, 0.80 and 0.86, respectively. The Cronbach's alpha for internal consistency of the ANTS instrument was 0.93, and was 0.96 for the Ottawa GRS. There was a high correlation between the ANTS and Ottawa GRS. The raters reported the ease of use of the Ottawa GRS compared to the ANTS. We found sufficient evidence of validity in the ANTS instrument and the Ottawa GRS for the evaluation of non-technical skills in a simulated anaesthesia setting, but the Ottawa GRS was more practical and had higher reliability.

An instrument measuring prospective mathematics teacher self-regulated learning: validity and reliability

NASA Astrophysics Data System (ADS)

Nugroho, A. A.; Juniati, D.; Siswono, T. Y. E.

2018-03-01

Self Regulated Learning (SRL) is an individual's ability to achieve academic goals by controlling behavior, motivate yourself and use cognitive in learning, so it is important for a teacher especially teachers of mathematics related to the ability of management, design, implementation of learning and evaluation of learning outcomes. The purpose of the research is to develop an instrument to describe the SRL of a prospective mathematics teacher. Data were collected by (1) the study of the theory of SRL produced the indicator SRL used to design the questionnaire SRL; (2) analysis of the questionnaire SRL obtained from several References; and (3) development stage of the SRL questionnaire through validity test of content and empirical validation. The study involved 2 content experts in mathematics, 1 linguist, and 92 prospective mathematics teachers. The results of the research on content validity test based on Indonesian expert and 2 content experts indicate that the content can assess the indicator of the SRL and feasible to be used, in the test of legibility of two prospective mathematics teacher concluded that the instrument has a language that can be understood by the prospective teacher of mathematics and on empirical validation involving 92 prospective mathematics teacher generate data that of 65 statements there are 3 invalid statements. Reliability calculation shows high category that values 0,93. The conclusion is the SRL instrument developed for the prospective mathematics teacher.

Validation of an instrument to measure students' motivation and self-regulation towards technology learning

NASA Astrophysics Data System (ADS)

Liou, Pey-Yan; Kuo, Pei-Jung

2014-05-01

Background:Few studies have examined students' attitudinal perceptions of technology. There is no appropriate instrument to measure senior high school students' motivation and self-regulation toward technology learning among the current existing instruments in the field of technology education. Purpose:The present study is to validate an instrument for assessing senior high school students' motivation and self-regulation towards technology learning. Sample:A total of 1822 Taiwanese senior high school students (1020 males and 802 females) responded to the newly developed instrument. Design and method:The Motivation and Self-regulation towards Technology Learning (MSRTL) instrument was developed based on the previous instruments measuring students' motivation and self-regulation towards science learning. Exploratory and confirmatory factor analyses were utilized to investigate the structure of the items. Cronbach's alpha was applied for measuring the internal consistency of each scale. Furthermore, multivariate analysis of variance was used to examine gender differences. Results:Seven scales, including 'Technology learning self-efficacy,' 'Technology learning value,' 'Technology active learning strategies,' 'Technology learning environment stimulation,' 'Technology learning goal-orientation,' 'Technology learning self-regulation-triggering,' and 'Technology learning self-regulation-implementing' were confirmed for the MSRTL instrument. Moreover, the results also showed that male and female students did not present the same degree of preference in all of the scales. Conclusions:The MSRTL instrument composed of seven scales corresponding to 39 items was shown to be valid based on validity and reliability analyses. While male students tended to express more positive and active performance in the motivation scales, no gender differences were found in the self-regulation scales.

A Reliability and Validity of an Instrument to Evaluate the School-Based Assessment System: A Pilot Study

ERIC Educational Resources Information Center

Ghazali, Nor Hasnida Md

2016-01-01

A valid, reliable and practical instrument is needed to evaluate the implementation of the school-based assessment (SBA) system. The aim of this study is to develop and assess the validity and reliability of an instrument to measure the perception of teachers towards the SBA implementation in schools. The instrument is developed based on a…

The Mathematics Attitudes and Perceptions Survey: an instrument to assess expert-like views and dispositions among undergraduate mathematics students

NASA Astrophysics Data System (ADS)

Code, Warren; Merchant, Sandra; Maciejewski, Wes; Thomas, Matthew; Lo, Joseph

2016-08-01

One goal of an undergraduate education in mathematics is to help students develop a productive disposition towards mathematics. A way of conceiving of this is as helping mathematical novices transition to more expert-like perceptions of mathematics. This conceptualization creates a need for a way to characterize students' perceptions of mathematics in authentic educational settings. This article presents a survey, the Mathematics Attitudes and Perceptions Survey (MAPS), designed to address this need. We present the development of the MAPS instrument and its validation on a large (N = 3411) set of student data. Results from various MAPS implementations corroborate results from analogous instruments in other STEM disciplines. We present these results and highlight some in particular: MAPS scores correlate with course grades; students tend to move away from expert-like orientations over a semester or year of taking a mathematics course; and interactive-engagement type lectures have less of a negative impact, but no positive impact, on students' overall orientations than traditional lecturing. We include the MAPS instrument in this article and suggest ways in which it may deepen our understanding of undergraduate mathematics education.

Validation of an instrument to assess barriers to care-seeking for accidental bowel leakage in women: the BCABL questionnaire

PubMed Central

Brown, Heidi Wendell; Wise, Meg E.; Westenberg, Danielle; Schmuhl, Nicholas B.; Brezoczky, Kelly Lewis; Rogers, Rebecca G.; Constantine, Melissa L.

2017-01-01

Introduction and hypothesis Fewer than 30% of women with accidental bowel leakage (ABL) seek care, despite the existence of effective, minimally invasive therapies. We developed and validated a condition-specific instrument to assess barriers to care-seeking for ABL in women. Methods Adult women with ABL completed an electronic survey about condition severity, patient activation, previous care-seeking, and demographics. The Barriers to Care-seeking for Accidental Bowel Leakage (BCABL) instrument contained 42 potential items completed at baseline and again 2 weeks later. Paired t tests evaluated test–retest reliability. Factor analysis evaluated factor structure and guided item retention. Cronbach’s alpha evaluated internal consistency. Within and across factor item means generated a summary BCABL score used to evaluate scale validity with six external criterion measures. Results Among 1,677 click-throughs, 736 (44%) entered the survey; 95% of eligible female respondents (427 out of 458) provided complete data. Fifty-three percent of respondents had previously sought care for their ABL; median age was 62 years (range 27–89); mean Vaizey score was 12.8 (SD = 5.0), indicating moderate to severe ABL. Test–retest reliability was excellent for all items. Factor extraction via oblique rotation resulted in the final structure of 16 items in six domains, within which internal consistency was high. All six external criterion measures correlated significantly with BCABL score. Conclusions The BCABL questionnaire, with 16 items mapping to six domains, has excellent criterion validity and test–retest reliability when administered electronically in women with ABL. The BCABL can be used to identify care-seeking barriers for ABL in different populations, inform targeted interventions, and measure their effectiveness. PMID:28236039

Psychometric validation of the PROQOL-HIV questionnaire, a new health-related quality of life instrument-specific to HIV disease.

PubMed

Duracinsky, Martin; Lalanne, Christophe; Le Coeur, Sophie; Herrmann, Susan; Berzins, Baiba; Armstrong, Andrew Richard; Lau, Joseph Tak Fai; Fournier, Isabelle; Chassany, Olivier

2012-04-15

This study reports the psychometric validation of a new HIV/AIDS-specific health-related quality of life (HRQL) questionnaire, the Patient Reported Outcomes Quality of Life-HIV. The instrument was developed simultaneously across Europe, North and South America, Africa, Asia, and Australia to assess multidimensional quality of life impairments in the era of highly active antiretroviral therapy. A cross-sectional study was performed in 8 countries. The pilot 70-item questionnaire was co-administered with the HIV symptoms index, the EQ-5D and Medical Outcomes Study-HIV questionnaires. Demographic and biomedical data were collected. After item analysis and reduction, convergent discriminant concurrent validity and known-group validity were examined. Internal consistency and reliability scores were assessed using Cronbach alpha and intraclass correlation. The final sample of 791 patients was composed of 64% males (median age: 41 years, HIV diagnosis = 5 years), 13.8% were treatment naive. Item reduction yielded a 43-item form surveying 8 dimensions and 1 global health item that showed good convergent and discriminant validity and reliability (98% scaling success; Cronbach alphas 0.77-0.89). Correlations with EQ-5D and Medical Outcomes Study-HIV complied with concurrent validity expectations; likewise, correlations against the number of self-reported symptoms and depression showed good support for criterion validity. A test-retest study on French patients (n = 34) showed temporal stability (intraclass correlation coefficient = 0.86). Significant and meaningful differences of HRQL scores between countries were found. The Patient Reported Outcomes Quality of Life-HIV questionnaire is a valid and reliable instrument for assessing HRQL specific to HIV disease in different cultures and healthcare systems.

[A survey instrument for evaluating psychological variables and risky sexual behavior among young adults at two university centers in Mexico].

PubMed

Piña López, Julio A; Robles Montijo, Susana; Rivera Icedo, Blanca M

2007-11-01

To measure the psychometric attributes of a survey instrument designed to evaluate historical and context variables that lead to high-risk sexual behaviors among a sample of university students in Mexico. Cross-sectional study of a sample of 1 346 university students in Mexico: 784 from the Sonora State Center for Higher Education in Hermosillo, Sonora, or 33.2% of its total enrollment; and 562 from the National Autonomous University of Mexico, at Tlalnepantla campus in Mexico State, or 23.5% of its total enrollment. The study took place in Hermosillo during the month of October 2006 and in Tlalnepantla from January to March 2006. The survey had 11 questions on sociodemographics, 7 on risky sexual behaviors, 22 on related motives, 8 on social context, and 6 on physical status prior to sexual relations. The survey was evaluated in terms of how well the questions were understood, its conceptual validity, and reliability. The final version of the survey instrument was composed of 44 questions. The reliability analysis produced an overall Cronbach alpha value of 0.821, taking into account all the variables combined and grouped by factor. Three factors were found that together accounted for 38.36% of the total variance: reasons for not using a condom in the first sexual relationship or throughout life, reasons for inconsistent use of a condom with a casual sex partner, and willingness to become sexually active and to engage in casual sex. The psychometric attributes of this survey instrument were found to be satisfactory. Those interested in using this instrument should become familiar with the theoretical model on which it is based, since understanding the results depends on properly defining the historical and context variables, and their interaction.

Predicting child maltreatment: A meta-analysis of the predictive validity of risk assessment instruments.

PubMed

van der Put, Claudia E; Assink, Mark; Boekhout van Solinge, Noëlle F

2017-11-01

Risk assessment is crucial in preventing child maltreatment since it can identify high-risk cases in need of child protection intervention. Despite widespread use of risk assessment instruments in child welfare, it is unknown how well these instruments predict maltreatment and what instrument characteristics are associated with higher levels of predictive validity. Therefore, a multilevel meta-analysis was conducted to examine the predictive accuracy of (characteristics of) risk assessment instruments. A literature search yielded 30 independent studies (N=87,329) examining the predictive validity of 27 different risk assessment instruments. From these studies, 67 effect sizes could be extracted. Overall, a medium significant effect was found (AUC=0.681), indicating a moderate predictive accuracy. Moderator analyses revealed that onset of maltreatment can be better predicted than recurrence of maltreatment, which is a promising finding for early detection and prevention of child maltreatment. In addition, actuarial instruments were found to outperform clinical instruments. To bring risk and needs assessment in child welfare to a higher level, actuarial instruments should be further developed and strengthened by distinguishing risk assessment from needs assessment and by integrating risk assessment with case management. Copyright © 2017 Elsevier Ltd. All rights reserved.

Development and Large-Scale Validation of an Instrument to Assess Arabic-Speaking Students' Attitudes Toward Science

NASA Astrophysics Data System (ADS)

Abd-El-Khalick, Fouad; Summers, Ryan; Said, Ziad; Wang, Shuai; Culbertson, Michael

2015-11-01

This study is part of a large-scale project focused on 'Qatari students' Interest in, and Attitudes toward, Science' (QIAS). QIAS aimed to gauge Qatari student attitudes toward science in grades 3-12, examine factors that impact these attitudes, and assess the relationship between student attitudes and prevailing modes of science teaching in Qatari schools. This report details the development and validation of the 'Arabic-Speaking Students' Attitudes toward Science Survey' (ASSASS), which was specifically developed for the purposes of the QIAS project. The theories of reasoned action and planned behavior (TRAPB) [Ajzen, I., & Fishbein, M. (2005). The influence of attitudes on behavior. In D. Albarracín, B. T. Johnson, & M. P. Zanna (Eds.), The handbook of attitudes (pp. 173-221). Mahwah, NJ: Erlbaum] guided the instrument development. Development and validation of the ASSASS proceeded in 3 phases. First, a 10-member expert panel examined an initial pool of 74 items, which were revised and consolidated into a 60-item version of the instrument. This version was piloted with 369 Qatari students from the target schools and grade levels. Analyses of pilot data resulted in a refined version of the ASSASS, which was administered to a national probability sample of 3027 participants representing all students enrolled in grades 3-12 in the various types of schools in Qatar. Of the latter, 1978 students completed the Arabic version of the instrument. Analyses supported a robust, 5-factor model for the instrument, which is consistent with the TRAPB framework. The factors were: Attitudes toward science and school science, unfavorable outlook on science, control beliefs about ability in science, behavioral beliefs about the consequences of engaging with science, and intentions to pursue science.

Behaviors in Advance Care Planning and ACtions Survey (BACPACS): development and validation part 1.

PubMed

Kassam, Aliya; Douglas, Maureen L; Simon, Jessica; Cunningham, Shannon; Fassbender, Konrad; Shaw, Marta; Davison, Sara N

2017-11-22

Although advance care planning (ACP) is fairly well understood, significant barriers to patient participation remain. As a result, tools to assess patient behaviour are required. The objective of this study was to improve the measurement of patient engagement in ACP by detecting existing survey design issues and establishing content and response process validity for a new survey entitled Behaviours in Advance Care Planning and ACtions Survey (BACPACS). We based our new tool on that of an existing ACP engagement survey. Initial item reduction was carried out using behavior change theories by content and design experts to help reduce response burden and clarify questions. Thirty-two patients with chronic diseases (cancer, heart failure or renal failure) were recruited for the think aloud cognitive interviewing with the new, shortened survey evaluating patient engagement with ACP. Of these, n = 27 had data eligible for analysis (n = 8 in round 1 and n = 19 in rounds 2 and 3). Interviews were audio-recorded and analyzed using the constant comparison method. Three reviewers independently listened to the interviews, summarized findings and discussed discrepancies until consensus was achieved. Item reduction from key content expert review and conversation analysis helped decrease number of items from 116 in the original ACP Engagement Survey to 24-38 in the new BACPACS depending on branching of responses. For the think aloud study, three rounds of interviews were needed until saturation for patient clarity was achieved. The understanding of ACP as a construct, survey response options, instructions and terminology pertaining to patient engagement in ACP warranted further clarification. Conversation analysis, content expert review and think aloud cognitive interviewing were useful in refining the new survey instrument entitled BACPACS. We found evidence for both content and response process validity for this new tool.

Validation of the Dementia Care Assessment Packet-Instrumental Activities of Daily Living

PubMed Central

Lee, Seok Bum; Park, Jeong Ran; Yoo, Jeong-Hwa; Park, Joon Hyuk; Lee, Jung Jae; Yoon, Jong Chul; Jhoo, Jin Hyeong; Lee, Dong Young; Woo, Jong Inn; Han, Ji Won; Huh, Yoonseok; Kim, Tae Hui

2013-01-01

Objective We aimed to evaluate the psychometric properties of the IADL measure included in the Dementia Care Assessment Packet (DCAP-IADL) in dementia patients. Methods The study involved 112 dementia patients and 546 controls. The DCAP-IADL was scored in two ways: observed score (OS) and predicted score (PS). The reliability of the DCAP-IADL was evaluated by testing its internal consistency, inter-rater reliability and test-retest reliability. Discriminant validity was evaluated by comparing the mean OS and PS between dementia patients and controls by ANCOVA. Pearson or Spearman correlation analysis was performed with other instruments to assess concurrent validity. Receiver operating characteristics curve analysis was performed to examine diagnostic accuracy. Results Chronbach's α coefficients of the DCAP-IADL were above 0.7. The values in dementia patients were much higher (OS=0.917, PS=0.927), indicating excellent degrees of internal consistency. Inter-rater reliabilities and test-retest reliabilities were statistically significant (p<0.05). PS exhibited higher reliabilities than OS. The mean OS and PS of dementia patients were significantly higher than those of the non-demented group after controlling for age, sex and education level. The DCAP-IADL was significantly correlated with other IADL instruments and MMSE-KC (p<0.001). Areas under the curves of the DCAP-IADL were above 0.9. Conclusion The DCAP-IADL is a reliable and valid instrument for evaluating instrumental ability of daily living for the elderly, and may also be useful for screening dementia. Moreover, administering PS may enable the DCAP-IADL to overcome the differences in gender, culture and life style that hinders accurate evaluation of the elderly in previous IADL instruments. PMID:24302946

Psychometric Validation of the Academic Motivation Scale in a Dental Student Sample.

PubMed

Orsini, Cesar; Binnie, Vivian; Evans, Phillip; Ledezma, Priscilla; Fuentes, Fernando; Villegas, Maria J

2015-08-01

The Academic Motivation Scale is one of the most frequently used instruments to assess academic motivation. It relies on the self-determination theory of human motivation. However, motivation has been understudied in dental education. Therefore, to address the lack of valid instruments to assess academic motivation in dental education and contribute to future research in the field, the aim of this study was to analyze the psychometric properties of this instrument in a sample of dental students. Participants were 989 Chilean undergraduate dental students (86% response rate) who completed a survey containing a Chilean face-valid version of the Spanish Academic Motivation Scale and three other motivation-related instruments to assess the survey's construct and criterion validity. Later, 76 of the students (out of 100 invited) took the survey again to assess its test-retest stability. The instrument's construct validity was supported by the superior goodness of fit of the seven-subscale Academic Motivation Scale over competing models through confirmatory factor analysis and by the expected correlations among its subscales. The concurrent criterion validity was supported by the confirmation of correlations between its subscales and external criteria. Adequate internal consistency and test-retest correlations were also found. The evidence from this study suggests that the Academic Motivation Scale is a preliminarily valid and reliable instrument to assess motivation in the predoctoral dental context. Future research in this area is needed to confirm or refute these results.

[Development and validation of an instrument for initial nursing assessment].

PubMed

Fernández-Sola, Cayetano; Granero-Molina, José; Mollinedo-Mallea, Judith; de Gonzales, María Hilda Peredo; Aguilera-Manrique, Gabriel; Ponce, Mara Luna

2012-12-01

The objective of this study, conducted in Bolivia from April to July of 2008, is the design and validation of an initial nursing assessment instrument to be used in clinical and educational environments in Santa Cruz (Bolivia). Twelve Bolivian nurses participated; both document analysis as well as consensus techniques were used to determine the categories and criteria to be assessed. Categories included in the nursing assessment instrument are a physical assessment and the eleven Gordon's Functional Health Patterns. The nursing assessment instrument stands out as being concise, easy to complete and utilizing a nursing approach. It does not include items for advanced nursing assessment. However, it incorporates items regarding lifestyle and the patient's autonomy. The nursing assessment instrument contributes to improving the quality of clinical records, supports the nursing diagnosis and implementation of the nursing process, promotes the nurse's role and helps to standardize practice.

Validation of the Neonatal Satisfaction Survey (NSS-8) in six Norwegian neonatal intensive care units: a quantitative cross-sectional study.

PubMed

Hagen, Inger Hilde; Svindseth, Marit Følsvik; Nesset, Erik; Orner, Roderick; Iversen, Valentina Cabral

2018-03-27

quality of care in NICU. Statistical analysis confirms the instrument's capacity to gauge parents' experiences of NICU. Further research is indicated to validate the survey questionnaire in other Nordic countries and beyond.

Measuring the Sensitivity and Construct Validity of 6 Utility Instruments in 7 Disease Areas.

PubMed

Richardson, Jeff; Iezzi, Angelo; Khan, Munir A; Chen, Gang; Maxwell, Aimee

2016-02-01

Health services that affect quality of life (QoL) are increasingly evaluated using cost utility analyses (CUA). These commonly employ one of a small number of multiattribute utility instruments (MAUI) to assess the effects of the health service on utility. However, the MAUI differ significantly, and the choice of instrument may alter the outcome of an evaluation. The present article has 2 objectives: 1) to compare the results of 3 measures of the sensitivity of 6 MAUI and the results of 6 tests of construct validity in 7 disease areas and 2) to rank the MAUI by each of the test results in each disease area and by an overall composite index constructed from the tests. Patients and the general public were administered a battery of instruments, which included the 6 MAUI, disease-specific QoL instruments (DSI), and 6 other comparator instruments. In each disease area, instrument sensitivity was measured 3 ways: by the unadjusted mean difference in utility between public and patient groups, by the value of the effect size, and by the correlation between MAUI and DSI scores. Content and convergent validity were tested by comparison of MAUI utilities and scores from the 6 comparator instruments. These included 2 measures of health state preferences, measures of subjective well-being and capabilities, and generic measures of physical and mental QoL derived from the SF-36. The apparent sensitivity of instruments varied significantly with the measurement method and by disease area. Validation test results varied with the comparator instruments. Notwithstanding this variability, the 15D, AQoL-8D, and the SF-6D generally achieved better test results than the QWB and EQ-5D-5L. © The Author(s) 2015.

New instrument for measuring student beliefs about physics and learning physics: The Colorado Learning Attitudes about Science Survey

NASA Astrophysics Data System (ADS)

Adams, W. K.; Perkins, K. K.; Podolefsky, N. S.; Dubson, M.; Finkelstein, N. D.; Wieman, C. E.

2006-06-01

The Colorado Learning Attitudes about Science Survey (CLASS) is a new instrument designed to measure student beliefs about physics and about learning physics. This instrument extends previous work by probing additional aspects of student beliefs and by using wording suitable for students in a wide variety of physics courses. The CLASS has been validated using interviews, reliability studies, and extensive statistical analyses of responses from over 5000 students. In addition, a new methodology for determining useful and statistically robust categories of student beliefs has been developed. This paper serves as the foundation for an extensive study of how student beliefs impact and are impacted by their educational experiences. For example, this survey measures the following: that most teaching practices cause substantial drops in student scores; that a student’s likelihood of becoming a physics major correlates with their “Personal Interest” score; and that, for a majority of student populations, women’s scores in some categories, including “Personal Interest” and “Real World Connections,” are significantly different from men’s scores.

Validity and test-retest reliability of an at-work production loss instrument.

PubMed

Aboagye, E; Jensen, I; Bergström, G; Hagberg, J; Axén, I; Lohela-Karlsson, M

2016-07-01

Besides causing ill health, a poor work environment may contribute to production loss. Production loss assessment instruments emphasize health-related consequences but there is no instrument to measure reduced work performance related to the work environment. To examine convergent validity and test-retest reliability of health-related production loss (HRPL) and work environment-related production loss (WRPL) against a valid comparable instrument, the Health and Work Performance Questionnaire (HPQ). Cross-sectional study of employees, not on sick leave, who were asked to self-rate their work performance and production losses. Using the Pearson correlation and Bland and Altman's Test of Agreement, convergent validity was examined. Subgroup analyses were performed for employees recording problem-specific reduced work performance. Consistency of pairs of HRPL and WRPL for samples responding to both assessments was expressed using Intraclass Correlation Coefficient (ICC) and tests of repeatability. A total of 88 employees participated and 44 responded to both assessments. Test of agreement between measurements estimates a mean difference of 0.34 for HRPL and -0.03 for WRPL compared with work performance. This indicates that the production loss questions are valid and moderately associated with work performance for the total sample and subgroups. ICC for paired HRPL assessments was 0.90 and 0.91 for WRPL, i.e. the test-retest reliability was good and suggests stability in the instrument. HRPL and WRPL can be used to measure production loss due to health-related and work environment-related problems. These results may have implications for advancing methods of assessing production loss, which represents an important cost to employers. © The Author 2016. Published by Oxford University Press on behalf of the Society of Occupational Medicine. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

The modified patient enablement instrument: a Portuguese cross-cultural adaptation, validity and reliability study.

PubMed

Remelhe, Mafalda; Teixeira, Pedro M; Lopes, Irene; Silva, Luís; Correia de Sousa, Jaime

2017-01-12

Enabling patients with asthma to obtain the knowledge, confidence and skills they need in order to assume a major role in the management of their disease is cost effective. It should be an integral part of any plan for long-term control of asthma. The modified Patient Enablement Instrument (mPEI) is an easily administered questionnaire that was adapted in the United Kingdom to measure patient enablement in asthma, but its applicability in Portugal is not known. Validity and reliability of questionnaires should be tested before use in settings different from those of the original version. The purpose of this study was to test the applicability of the mPEI to Portuguese asthma patients after translation and cross-cultural adaptation, and to verify the structural validity, internal consistency and reproducibility of the instrument. The mPEI was translated to Portuguese and back translated to English. Its content validity was assessed by a debriefing interview with 10 asthma patients. The translated instrument was then administered to a random sample of 142 patients with persistent asthma. Structural validity and internal consistency were assessed. For reproducibility analysis, 86 patients completed the instrument again 7 days later. Item-scale correlations and exploratory factor analysis were used to assess structural validity. Cronbach's alpha was used to test internal consistency, and the intra-class correlation coefficient was used for the analysis of reproducibility. All items of the Portuguese version of the mPEI were found to be equivalent to the original English version. There were strong item-scale correlations that confirmed construct validity, with a one component structure and good internal consistency (Cronbach's alpha >0.8) as well as high test-retest reliability (ICC=0.85). The mPEI showed sound psychometric properties for the evaluation of enablement in patients with asthma making it a reliable instrument for use in research and clinical practice in

Development and Validation of an Instrument to Evaluate Perceived Wellbeing Associated with the Ingestion of Water: The Water Ingestion-Related Wellbeing Instrument (WIRWI).

PubMed

Espinosa-Montero, Juan; Monterrubio-Flores, Eric A; Sanchez-Estrada, Marcela; Buendia-Jimenez, Inmaculada; Lieberman, Harris R; Allaert, François-Andre; Barquera, Simon

2016-01-01

Ingestion of water has been associated with general wellbeing. When water intake is insufficient, symptoms such as thirst, fatigue and impaired memory result. Currently there are no instruments to assess water consumption associated with wellbeing. The objective of our study was to develop and validate such an instrument in urban, low socioeconomic, adult Mexican population. To construct the Water Ingestion-Related Wellbeing Instrument (WIRWI), a qualitative study in which wellbeing related to everyday practices and experiences in water consumption were investigated. To validate the WIRWI a formal, five-process procedure was used. Face and content validation were addressed, consistency was assessed by exploratory and confirmatory psychometric factor analyses, repeatability, reproducibility and concurrent validity were assessed by conducting correlation tests with other measures of wellbeing such as a quality of life instrument, the SF-36, and objective parameters such as urine osmolality, 24-hour urine total volume and others. The final WIRWI is composed of 17 items assessing physical and mental dimensions. Items were selected based on their content and face validity. Exploratory and confirmatory factor analyses yielded Cronbach's alpha of 0.87 and 0.86, respectively. The final confirmatory factor analysis demonstrated that the model estimates were satisfactory for the constructs. Statistically significant correlations with the SF-36, total liquid consumption and simple water consumption were observed. The resulting WIRWI is a reliable tool for assessing wellbeing associated with consumption of plain water in Mexican adults and could be useful for similar groups.

The Open Curriculum and Selection of Qualified Staff: Instrument Validation.

ERIC Educational Resources Information Center

Greene, John F.; And Others

The impact of open education on today's curriculum has been extensive. Of the many requests for research in this area, none is more important than instrument validation. This study examines the internal structure of Barth's Assumptions about Learning and Knowledge scale and explores its relationship to established "progressivism" and…

Establishing Validity of the Thai Mathematics Teaching Efficacy Beliefs Instrument

ERIC Educational Resources Information Center

Matney, Gabriel; Jackson, Jack L., II.; Panarach, Yupadee

2016-01-01

This article presents our work in translating the Mathematics Teaching Efficacy Beliefs Instrument (MTEBI) from English to Thai and our resulting investigation of validity with Thai preservice teachers. The translation process occurred over several meetings between two U.S. mathematics educators and one Thai mathematics educator. To check for…

Socially supportive activity inventory: reliability and validity of a social activity instrument for long-term care institutions.

PubMed

Hsu, Ya-Chuan

2011-09-01

: Diverse social and recreational activities in elder care institutions have been provided to enrich a person's mental well-being amidst what is a relatively monotonous life. However, few instruments that measure the social activities of long-term care residents are available. : This study was designed to develop a culturally sensitive instrument (Socially Supportive Activity Inventory, SSAI) to assess quantity and quality of social activities for long-term care institutions and validate the instrument's psychometric properties. : The SSAI was developed on the basis of the social support theory, a synthesis of literature, and Taiwanese cultural mores. The instrument was rigorously subjected to a two-stage process to evaluate its reliability and validity. In Stage 1, six experts from diverse backgrounds were recruited to evaluate instrument items and estimate the content validity of the instrument using a content validity questionnaire. Items were modified and refined on the basis of the responses of the expert panel and a set of criteria. After obtaining approval from a university institutional review board, in the second stage of evaluating test-retest reliability, a convenience sample of 10 Taiwanese institutionalized elders in a pilot study, recruited from a nursing home, completed the revised instrument at two separate times over 2 weeks. : Results showed a content validity of .96. Test-retest reliability from a sample of 10 participants yielded stability coefficients of .76-1.00. The stability coefficient was 1.00 for the component of frequency, .76-1.00 for the component of meaningfulness, and .78-1.00 for the component of enjoyment. : The SSAI is a highly relevant and reliable culturally based instrument that can measure social activity in long-term care facilities. Because of the pilot nature of this study, future directions include further exploration of the SSAI instrument's psychometric properties. This should be done by enlarging the sample size to

Development of an instrument to measure medical students' perceptions of the assessment environment: initial validation.

PubMed

Sim, Joong Hiong; Tong, Wen Ting; Hong, Wei-Han; Vadivelu, Jamuna; Hassan, Hamimah

2015-01-01

Assessment environment, synonymous with climate or atmosphere, is multifaceted. Although there are valid and reliable instruments for measuring the educational environment, there is no validated instrument for measuring the assessment environment in medical programs. This study aimed to develop an instrument for measuring students' perceptions of the assessment environment in an undergraduate medical program and to examine the psychometric properties of the new instrument. The Assessment Environment Questionnaire (AEQ), a 40-item, four-point (1=Strongly Disagree to 4=Strongly Agree) Likert scale instrument designed by the authors, was administered to medical undergraduates from the authors' institution. The response rate was 626/794 (78.84%). To establish construct validity, exploratory factor analysis (EFA) with principal component analysis and varimax rotation was conducted. To examine the internal consistency reliability of the instrument, Cronbach's α was computed. Mean scores for the entire AEQ and for each factor/subscale were calculated. Mean AEQ scores of students from different academic years and sex were examined. Six hundred and eleven completed questionnaires were analysed. EFA extracted four factors: feedback mechanism (seven items), learning and performance (five items), information on assessment (five items), and assessment system/procedure (three items), which together explained 56.72% of the variance. Based on the four extracted factors/subscales, the AEQ was reduced to 20 items. Cronbach's α for the 20-item AEQ was 0.89, whereas Cronbach's α for the four factors/subscales ranged from 0.71 to 0.87. Mean score for the AEQ was 2.68/4.00. The factor/subscale of 'feedback mechanism' recorded the lowest mean (2.39/4.00), whereas the factor/subscale of 'assessment system/procedure' scored the highest mean (2.92/4.00). Significant differences were found among the AEQ scores of students from different academic years. The AEQ is a valid and reliable

Measuring decision quality: psychometric evaluation of a new instrument for breast cancer surgery

PubMed Central

2012-01-01

Background The purpose of this paper is to examine the acceptability, feasibility, reliability and validity of a new decision quality instrument that assesses the extent to which patients are informed and receive treatments that match their goals. Methods Cross-sectional mail survey of recent breast cancer survivors, providers and healthy controls and a retest survey of survivors. The decision quality instrument includes knowledge questions and a set of goals, and results in two scores: a breast cancer surgery knowledge score and a concordance score, which reflects the percentage of patients who received treatments that match their goals. Hypotheses related to acceptability, feasibility, discriminant validity, content validity, predictive validity and retest reliability of the survey instrument were examined. Results We had responses from 440 eligible patients, 88 providers and 35 healthy controls. The decision quality instrument was feasible to implement in this study, with low missing data. The knowledge score had good retest reliability (intraclass correlation coefficient = 0.70) and discriminated between providers and patients (mean difference 35%, p < 0.001). The majority of providers felt that the knowledge items covered content that was essential for the decision. Five of the 6 treatment goals met targets for content validity. The five goals had moderate to strong retest reliability (0.64 to 0.87). The concordance score was 89%, indicating that a majority had treatments concordant with that predicted by their goals. Patients who had concordant treatment had similar levels of confidence and regret as those who did not. Conclusions The decision quality instrument met the criteria of feasibility, reliability, discriminant and content validity in this sample. Additional research to examine performance of the instrument in prospective studies and more diverse populations is needed. PMID:22681763

Comparing NICU teamwork and safety climate across two commonly used survey instruments.

PubMed

Profit, Jochen; Lee, Henry C; Sharek, Paul J; Kan, Peggy; Nisbet, Courtney C; Thomas, Eric J; Etchegaray, Jason M; Sexton, Bryan

2016-12-01

Measurement and our understanding of safety culture are still evolving. The objectives of this study were to assess variation in safety and teamwork climate and in the neonatal intensive care unit (NICU) setting, and compare measurement of safety culture scales using two different instruments (Safety Attitudes Questionnaire (SAQ) and Hospital Survey on Patient Safety Culture (HSOPSC)). Cross-sectional survey study of a voluntary sample of 2073 (response rate 62.9%) health professionals in 44 NICUs. To compare survey instruments, we used Spearman's rank correlation coefficients. We also compared similar scales and items across the instruments using t tests and changes in quartile-level performance. We found significant variation across NICUs in safety and teamwork climate scales of SAQ and HSOPSC (p<0.001). Safety scales (safety climate and overall perception of safety) and teamwork scales (teamwork climate and teamwork within units) of the two instruments correlated strongly (safety r=0.72, p<0.001; teamwork r=0.67, p<0.001). However, the means and per cent agreements for all scale scores and even seemingly similar item scores were significantly different. In addition, comparisons of scale score quartiles between the two instruments revealed that half of the NICUs fell into different quartiles when translating between the instruments. Large variation and opportunities for improvement in patient safety culture exist across NICUs. Important systematic differences exist between SAQ and HSOPSC such that these instruments should not be used interchangeably. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Development and testing of the Youth Alcohol Norms Survey (YANS) instrument to measure youth alcohol norms and psychosocial influences

PubMed Central

Maycock, Bruce; Hildebrand, Janina; Zhao, Yun; Allsop, Steve; Lobo, Roanna; Howat, Peter

2018-01-01

Objectives This study aimed to develop and validate an online instrument to: (1) identify common alcohol-related social influences, norms and beliefs among adolescents; (2) clarify the process and pathways through which proalcohol norms are transmitted to adolescents; (3) describe the characteristics of social connections that contribute to the transmission of alcohol norms; and (4) identify the influence of alcohol marketing on adolescent norm development. Setting The online Youth Alcohol Norms Survey (YANS) was administered in secondary schools in Western Australia Participants Using a 2-week test–retest format, the YANS was administered to secondary school students (n=481, age=13–17 years, female 309, 64.2%). Primary and secondary outcome measures The development of the YANS was guided by social cognitive theory and comprised a systematic multistage process including evaluation of content and face validity. A 2-week test–retest format was employed. Exploratory factor analysis was conducted to determine the underlying factor structure of the instrument. Test–retest reliability was examined using intraclass correlation coefficient (ICC) and Cohen’s kappa. Results A five-factor structure with meaningful components and robust factorial loads was identified, and the five factors were labelled as ‘individual attitudes and beliefs’, ‘peer and community identity’, ‘sibling influences’, ‘school and community connectedness’ and ‘injunctive norms’, respectively. The instrument demonstrated stability across the test–retest procedure (ICC=0.68–0.88, Cohen’s kappa coefficient=0.69) for most variables. Conclusions The results support the reliability and factorial validity of this instrument. The YANS presents a promising tool, which enables comprehensive assessment of reciprocal individual, behavioural and environmental factors that influence alcohol-related norms among adolescents. PMID:29764872

Establishing Content Validity for a Literacy Coach Performance Appraisal Instrument

ERIC Educational Resources Information Center

Lane, Mae; Robbins, Mary; Price, Debra

2013-01-01

This study's purpose was to determine whether or not the Literacy Coach Appraisal Instrument developed for use in evaluating literacy coaches had content validity. The study, a fully mixed concurrent equal status design conducted from a pragmatist philosophy, collected qualitative and quantitative data from literacy experts about the elements of…

Development and Validation of the Basketball Offensive Game Performance Instrument

ERIC Educational Resources Information Center

Chen, Weiyun; Hendricks, Kristin; Zhu, Weimo

2013-01-01

The purpose of this study was to design and validate the Basketball Offensive Game Performance Instrument (BOGPI) that assesses an individual player's offensive game performance competency in basketball. Twelve physical education teacher education (PETE) students playing two 10-minute, 3 vs. 3 basketball games were videotaped at end of a…

Adaptation and Validation of a Burnout Inventory in a Survey of the Staff of a Correctional Institution in Bulgaria.

PubMed

Harizanova, Stanislava N; Mateva, Nonka G; Tarnovska, Tanya Ch

2016-12-01

Burnout syndrome is a phenomenon that seems to be studied globally in relation to all types of populations. The staff in the system of correctional institutions in Bulgaria, however, is oddly left out of this tendency. There is no standardized model in Bulgaria that can be used to detect possible susceptibility to professional burnout. The methods available at present only register the irreversible changes that have already set in the functioning of the individual. V. Boyko's method for burnout assessment allows clinicians to use individual approach to patients and affords easy comparability of results with data from other psychodiagnostic instruments. Adaptation of the assessment instruments to fit the specificities of a study population (linguistic, ethno-cultural, etc.) is obligatory so that the instrument could be correctly used and yield valid results. Validation is one of the most frequently used technique to achieve this. The aim of the present study was to adapt and validate V. Boyko's burnout inventory for diagnosing burnout and assessment of the severity of the burnout syndrome in correctional officers. We conducted a pilot study with 50 officers working in the Plovdiv Regional Correction Facility by test-retest survey performed at an interval of 2 to 4 months. All participants completed the adapted questionnaire translated into Bulgarian voluntarily and anonymously. Statistical analysis was performed using SPSS v.17. We found a mild-to-strong statistically significant correlation (P<0.01) across all subscales between the most frequently used questionnaire for assessing the burnout syndrome, the Maslach Burnout Inventory, and the tool we propose here. The high Cronbach's α coefficient (α=0.94) and Spearman-Brown coefficient (rsb=0.86), and the low mean between-item correlation (r=0.30) demonstrated the instrument's good reliability and validity. With the validation herein presented we offer a highly reliable Bulgarian variant of Boyko's method for

[Validating an instrument for measuring the perceived quality of services received by people using hospitals in Colombia].

PubMed

Cabrera-Arana, Gustavo A; Londoño-Pimienta, Jaime L; Bello-Parías, León D

2008-01-01

Validating an instrument for measuring the perceived quality of services received by people using hospitals forming part of the Colombian Ministry of Social Protection's restructuring, redesigning and modernisation programme for health-service providing networks. Sánchez and Echeverri's guidelines for validating health quality measurement scales were followed due to the lack of a valid instrument for doing this in Colombia. Conceptual synthesis led to identifying a structure of constituent indicators, domains and sub-domains regarding the perception of health service quality. A list of reactions (having a scale for categorising the replies) was analysed according to the validity of appearance, construct, criteria and utility as criteria for sensitivity and usefulness. Successive revisions and three rounds of field-trials led to producing PECASUSS, an acronym given to the instrument for measuring users' perception of health service quality (Percepción de Calidad Según Usuarios de Servicios de Salud). The guidelines effectively orientated the validation of the instrument required for measuring the perceived quality of health services received by people using hospitals forming part of the programme.

Development of a survey instrument to investigate the primary care factors related to differences in cancer diagnosis between international jurisdictions

PubMed Central

2014-01-01

Background Survival rates following a diagnosis of cancer vary between countries. The International Cancer Benchmarking Partnership (ICBP), a collaboration between six countries with primary care led health services, was set up in 2009 to investigate the causes of these differences. Module 3 of this collaboration hypothesised that an association exists between the readiness of primary care physicians (PCP) to investigate for cancer – the ‘threshold’ risk level at which they investigate or refer to a specialist for consideration of possible cancer – and survival for that cancer (lung, colorectal and ovarian). We describe the development of an international survey instrument to test this hypothesis. Methods The work was led by an academic steering group in England. They agreed that an online survey was the most pragmatic way of identifying differences between the jurisdictions. Research questions were identified through clinical experience and expert knowledge of the relevant literature. A survey comprising a set of direct questions and five clinical scenarios was developed to investigate the hypothesis. The survey content was discussed and refined concurrently and repeatedly with international partners. The survey was validated using an iterative process in England. Following validation the survey was adapted to be relevant to the health systems operating in other jurisdictions and translated into Danish, Norwegian and Swedish, and into Canadian and Australian English. Results This work has produced a survey with face, content and cross cultural validity that will be circulated in all six countries. It could also form a benchmark for similar surveys in countries with similar health care systems. Conclusions The vignettes could also be used as educational resources. This study is likely to impact on healthcare policy and practice in participating countries. PMID:24938306

10 CFR 34.65 - Records of radiation survey instruments.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 1 2010-01-01 2010-01-01 false Records of radiation survey instruments. 34.65 Section 34.65 Energy NUCLEAR REGULATORY COMMISSION LICENSES FOR INDUSTRIAL RADIOGRAPHY AND RADIATION SAFETY REQUIREMENTS FOR INDUSTRIAL RADIOGRAPHIC OPERATIONS Recordkeeping Requirements § 34.65 Records of radiation...

10 CFR 34.65 - Records of radiation survey instruments.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 10 Energy 1 2014-01-01 2014-01-01 false Records of radiation survey instruments. 34.65 Section 34.65 Energy NUCLEAR REGULATORY COMMISSION LICENSES FOR INDUSTRIAL RADIOGRAPHY AND RADIATION SAFETY REQUIREMENTS FOR INDUSTRIAL RADIOGRAPHIC OPERATIONS Recordkeeping Requirements § 34.65 Records of radiation...

10 CFR 34.65 - Records of radiation survey instruments.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 1 2011-01-01 2011-01-01 false Records of radiation survey instruments. 34.65 Section 34.65 Energy NUCLEAR REGULATORY COMMISSION LICENSES FOR INDUSTRIAL RADIOGRAPHY AND RADIATION SAFETY REQUIREMENTS FOR INDUSTRIAL RADIOGRAPHIC OPERATIONS Recordkeeping Requirements § 34.65 Records of radiation...

10 CFR 34.65 - Records of radiation survey instruments.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 10 Energy 1 2013-01-01 2013-01-01 false Records of radiation survey instruments. 34.65 Section 34.65 Energy NUCLEAR REGULATORY COMMISSION LICENSES FOR INDUSTRIAL RADIOGRAPHY AND RADIATION SAFETY REQUIREMENTS FOR INDUSTRIAL RADIOGRAPHIC OPERATIONS Recordkeeping Requirements § 34.65 Records of radiation...

10 CFR 34.65 - Records of radiation survey instruments.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 1 2012-01-01 2012-01-01 false Records of radiation survey instruments. 34.65 Section 34.65 Energy NUCLEAR REGULATORY COMMISSION LICENSES FOR INDUSTRIAL RADIOGRAPHY AND RADIATION SAFETY REQUIREMENTS FOR INDUSTRIAL RADIOGRAPHIC OPERATIONS Recordkeeping Requirements § 34.65 Records of radiation...

Development and validation of Neonatal Satisfaction Survey--NSS-13.

PubMed

Hagen, Inger H; Vadset, Tove B; Barstad, Johan; Svindseth, Marit F

2015-06-01

The purpose of this study was to develop and validate a survey to investigate parents' satisfaction with neonatal wards in a population of parents of children with a gestation age of ≥24 weeks to 3 months after full-term birth. We explored the literature and conducted three focus groups: two with expert health personnel and one with parents. We tested the survey in a parent population (N = 105) and report the different stages in the validation process along with the full survey, the Neonatal Satisfaction Survey - 13 categories (NSS-13). We found 13 subcategories in the Neonatal Satisfaction Survey. The subcategories measure parents' satisfaction with neonatal units based on staff, admission, nurses, anxiety, siblings (parents' perceptions of caring for the siblings of the newborn), information, timeout, doctors, facilities, nutrition, preparation for discharge, trust and visitors. Each subcategory showed acceptable internal consistency. The full version of the Neonatal Satisfaction Survey presents 69 items, and each subcategory contains two to eleven items. The Neonatal Satisfaction Survey seems suitable to measure parents' satisfaction with neonatal units and can be used in full, but it can also measure subcategories. Parents' satisfaction with neonatal units can be used to improve the quality in such wards. We consider this study as the first in a series to validate the NSS-13. The full survey with subcategories is presented in this paper. © 2014 Nordic College of Caring Science.

Development and testing of the Survey of Family Environment (SFE): a novel instrument to measure family functioning and needs for family support.

PubMed

Hohashi, Naohiro; Honda, Junko

2012-01-01

Hohashi's Concentric Sphere Family Environment Model (CSFEM; Hohashi & Honda, 2011) is a newly proposed family nursing theory for holistically understanding the family environment that acts on family well-being. The purpose of this article is to develop and psychometrically test the Japanese version of the Survey of Family Environment (SFE-J), grounded in the CSFEM, for measuring family's perceived family functioning and family's perceived needs for family support. The SFE-J is a 30-item self-administered instrument that assesses five domains (suprasystem, macrosystem, microsystem, family internal environment system, and chronosystem) and has been subjected to rigorous reliability and validity investigations among paired partners in child-rearing families (N of family = 1,990). Internal consistency reliability was high as measured by Cronbach's alpha coefficients. Temporal stability over a 2-week interval was supported by high (substantial or perfect) and significant intraclass correlation coefficients. The total score for the SFE-J was significantly correlated with the Japanese version of the Feetham Family Functioning Survey (FFFS-J), indicating an acceptable concurrent validity. Construct validity was supported by a confirmatory factor analysis that evaluated the five-factor structure to measure the concept of CSFEM. Results also demonstrate that the SFE-J family functioning scores show no significant differences between paired partners. The SFE-J is a reliable and valid instrument to assess not only intrafamily functioning but also interfamily functioning and, by identifying items/domains with high requirements for family support, serves to facilitate the providing of appropriate support to families.

The Development and Validation of a Concise Instrument for Formative Assessment of Team Leader Performance During Simulated Pediatric Resuscitations.

PubMed

Nadkarni, Lindsay D; Roskind, Cindy G; Auerbach, Marc A; Calhoun, Aaron W; Adler, Mark D; Kessler, David O

2018-04-01

The aim of this study was to assess the validity of a formative feedback instrument for leaders of simulated resuscitations. This is a prospective validation study with a fully crossed (person × scenario × rater) study design. The Concise Assessment of Leader Management (CALM) instrument was designed by pediatric emergency medicine and graduate medical education experts to be used off the shelf to evaluate and provide formative feedback to resuscitation leaders. Four experts reviewed 16 videos of in situ simulated pediatric resuscitations and scored resuscitation leader performance using the CALM instrument. The videos consisted of 4 pediatric emergency department resuscitation teams each performing in 4 pediatric resuscitation scenarios (cardiac arrest, respiratory arrest, seizure, and sepsis). We report on content and internal structure (reliability) validity of the CALM instrument. Content validity was supported by the instrument development process that involved professional experience, expert consensus, focused literature review, and pilot testing. Internal structure validity (reliability) was supported by the generalizability analysis. The main component that contributed to score variability was the person (33%), meaning that individual leaders performed differently. The rater component had almost zero (0%) contribution to variance, which implies that raters were in agreement and argues for high interrater reliability. These results provide initial evidence to support the validity of the CALM instrument as a reliable assessment instrument that can facilitate formative feedback to leaders of pediatric simulated resuscitations.

Development and Validation of an Instrument to Evaluate Perceived Wellbeing Associated with the Ingestion of Water: The Water Ingestion-Related Wellbeing Instrument (WIRWI)

PubMed Central

Espinosa-Montero, Juan; Monterrubio-Flores, Eric A.; Sanchez-Estrada, Marcela; Buendia-Jimenez, Inmaculada; Lieberman, Harris R.; Allaert, François-Andre; Barquera, Simon

2016-01-01

Background Ingestion of water has been associated with general wellbeing. When water intake is insufficient, symptoms such as thirst, fatigue and impaired memory result. Currently there are no instruments to assess water consumption associated with wellbeing. The objective of our study was to develop and validate such an instrument in urban, low socioeconomic, adult Mexican population. Methods To construct the Water Ingestion-Related Wellbeing Instrument (WIRWI), a qualitative study in which wellbeing related to everyday practices and experiences in water consumption were investigated. To validate the WIRWI a formal, five-process procedure was used. Face and content validation were addressed, consistency was assessed by exploratory and confirmatory psychometric factor analyses, repeatability, reproducibility and concurrent validity were assessed by conducting correlation tests with other measures of wellbeing such as a quality of life instrument, the SF-36, and objective parameters such as urine osmolality, 24-hour urine total volume and others. Results The final WIRWI is composed of 17 items assessing physical and mental dimensions. Items were selected based on their content and face validity. Exploratory and confirmatory factor analyses yielded Cronbach's alpha of 0.87 and 0.86, respectively. The final confirmatory factor analysis demonstrated that the model estimates were satisfactory for the constructs. Statistically significant correlations with the SF-36, total liquid consumption and simple water consumption were observed. Conclusion The resulting WIRWI is a reliable tool for assessing wellbeing associated with consumption of plain water in Mexican adults and could be useful for similar groups. PMID:27388902

Development and validation of a trustworthy multisource feedback instrument to support nurse appraisals.

PubMed

Crossley, James G M

2015-01-01

Nurse appraisal is well established in the Western world because of its obvious educational advantages. Appraisal works best with many sources of information on performance. Multisource feedback (MSF) is widely used in business and in other clinical disciplines to provide such information. It has also been incorporated into nursing appraisals, but, so far, none of the instruments in use for nurses has been validated. We set out to develop an instrument aligned with the UK Knowledge and Skills Framework (KSF) and to evaluate its reliability and feasibility across a wide hospital-based nursing population. The KSF framework provided a content template. Focus groups developed an instrument based on consensus. The instrument was administered to all the nursing staff in 2 large NHS hospitals forming a single trust in London, England. We used generalizability analysis to estimate reliability, response rates and unstructured interviews to evaluate feasibility, and factor structure and correlation studies to evaluate validity. On a voluntary basis the response rate was moderate (60%). A failure to engage with information technology and employment-related concerns were commonly cited as reasons for not responding. In this population, 11 responses provided a profile with sufficient reliability to inform appraisal (G = 0.7). Performance on the instrument was closely and significantly correlated with performance on a KSF questionnaire. This is the first contemporary psychometric evaluation of an MSF instrument for nurses. MSF appears to be as valid and reliable as an assessment method to inform appraisal in nurses as it is in other health professional groups. © 2015 The Alliance for Continuing Education in the Health Professions, the Society for Academic Continuing Medical Education, and the Council on Continuing Medical Education, Association for Hospital Medical Education.

Development and validation of a primary sclerosing cholangitis-specific patient-reported outcomes instrument: The PSC PRO.

PubMed

Younossi, Zobair M; Afendy, Arian; Stepanova, Maria; Racila, Andrei; Nader, Fatema; Gomel, Rachel; Safer, Ricky; Lenderking, William R; Skalicky, Anne; Kleinman, Leah; Myers, Robert P; Subramanian, G Mani; McHutchison, John G; Levy, Cynthia; Bowlus, Christopher L; Kowdley, Kris; Muir, Andrew J

2017-11-20

Primary sclerosing cholangitis (PSC) is a chronic liver disease associated with inflammation and biliary fibrosis that leads to cholangitis, cirrhosis, and impaired quality of life. Our objective was to develop and validate a PSC-specific patient-reported outcome (PRO) instrument. We developed a 42-item PSC PRO instrument that contains two modules (Symptoms and Impact of Symptoms) and conducted an external validation. Reliability and validity were evaluated using clinical data and a battery of other validated instruments. Test-retest reliability was assessed in a subgroup of patients who repeated the PSC PRO after the first administration. One hundred two PSC subjects (44 ± 13 years; 32% male, 74% employed, 39% with cirrhosis, 14% with a history of decompensated cirrhosis, 38% history of depression, and 68% with inflammatory bowel disease [IBD]) completed PSC PRO and other PRO instruments (Short Form 36 V2 [SF-36], Chronic Liver Disease Questionnaire [CLDQ], Primary Biliary Cholangitis - 40 [PBC-40], and five dimensions [5-D Itch]). PSC PRO demonstrated excellent internal consistency (Cronbach alphas, 0.84-0.94) and discriminant validity (41 of 42 items had the highest correlations with their own domains). There were good correlations between PSC PRO domains and relevant domains of SF-36, CLDQ, and PBC-40 (R = 0.69-0.90; all P < 0.0001), but lower (R = 0.31-0.60; P < 0.001) with 5-D Itch. Construct validity showed that PSC PRO can differentiate patients according to the presence and severity of cirrhosis and history of depression (P < 0.05), but not by IBD (P > 0.05). Test-retest reliability was assessed in 53 subjects who repeated PSC PRO within a median (interquartile range) of 37 (27-47) days. There was excellent reliability for most domains with intraclass correlations (0.71-0.88; all P < 0.001). PSC PRO is a self-administered disease-specific instrument developed according to U.S. Food and Drug Administration guidelines. This preliminary validation study

Is Validation Always Valid? Cross-Cultural Complexities of Standard-Based Instruments Migrating out of Their Context

ERIC Educational Resources Information Center

Pastori, Giulia; Pagani, Valentina

2017-01-01

The international application of standard-based measures to assess ECEC quality raises crucial questions concerning the cultural complexities and the problematic validity of instruments migrating out of their cultural cradle; nevertheless the topic has received only marginal attention in the literature. This paper, which aims to address this gap,…

Unexpected but Most Welcome: Mixed Methods for the Validation and Revision of the Participatory Evaluation Measurement Instrument

ERIC Educational Resources Information Center

Daigneault, Pierre-Marc; Jacob, Steve

2014-01-01

Although combining methods is nothing new, more contributions about why and how to mix methods for validation purposes are needed. This article presents a case of validating the inferences drawn from the Participatory Evaluation Measurement Instrument, an instrument that purports to measure stakeholder participation in evaluation. Although the…

[Validation of National College Health Risk Behavior Survey to be use with Brazilian college students].

PubMed

Franca, Carolina da; Colares, Viviane

2010-06-01

The objective of this article is to translate, to adapt and to validate the National College Health Risk Behavior Survey to apply at Brazilian college students. 208 college students from the Federal University of Pernambuco (UFPE) and University of Pernambuco (UPE) participated in the study. The validation was carried through in five stages: (1) translation; (2) retrotranslation; (3) correction and semantic adaptation (cultural adaptation); (4) face validation; (5) test-retest. Adaptations were done to deal with any semantic disagreements found between translation and retrotranslation. After face validation, the questionnaire was reduced from 96 to 52 questions. From the 11 items analyzed, the majority presented good and perfect Kappa: security and violence (Kappa=0.89); suicide (Kappa=1.00); use of the tobacco (Kappa=0.90); drinking consumption (Kappa=0.78); cocaine and other drugs consumption (Kappa=0.70); sexual behavior (Kappa=0,88) and corporal weight (Kappa=0.89). Only the item about feeding presented weak Inter-examiner Kappa (Kappa = 0.26) and the topic on health information presented moderate Kappa (Kappa=0.56). The average Kappa for all items was good (0.76). The instrument may be considered validated in the Portuguese language in Brazil with acceptable reproducibility.

Validation of a Visionary Leadership Attitude Instrument Using Factor Analysis.

ERIC Educational Resources Information Center

LeSourd, Sandra J.; And Others

Findings from a study to develop and validate an instrument for the measurement of principals' attitudes toward visionary leadership are presented in this paper. Two leadership styles--visionary and managerial--were measured by a 35-item five-point Likert attitude scale. Questionnaires mailed to a random sample of 250 K-12 Nebraska and 250…

The statistical validity of nursing home survey findings.

PubMed

Woolley, Douglas C

2011-11-01

The Medicare nursing home survey is a high-stakes process whose findings greatly affect nursing homes, their current and potential residents, and the communities they serve. Therefore, survey findings must achieve high validity. This study looked at the validity of one key assessment made during a nursing home survey: the observation of the rate of errors in administration of medications to residents (med-pass). Statistical analysis of the case under study and of alternative hypothetical cases. A skilled nursing home affiliated with a local medical school. The nursing home administrators and the medical director. Observational study. The probability that state nursing home surveyors make a Type I or Type II error in observing med-pass error rates, based on the current case and on a series of postulated med-pass error rates. In the common situation such as our case, where med-pass errors occur at slightly above a 5% rate after 50 observations, and therefore trigger a citation, the chance that the true rate remains above 5% after a large number of observations is just above 50%. If the true med-pass error rate were as high as 10%, and the survey team wished to achieve 75% accuracy in determining that a citation was appropriate, they would have to make more than 200 med-pass observations. In the more common situation where med pass errors are closer to 5%, the team would have to observe more than 2000 med-passes to achieve even a modest 75% accuracy in their determinations. In settings where error rates are low, large numbers of observations of an activity must be made to reach acceptable validity of estimates for the true rates of errors. In observing key nursing home functions with current methodology, the State Medicare nursing home survey process does not adhere to well-known principles of valid error determination. Alternate approaches in survey methodology are discussed. Copyright © 2011 American Medical Directors Association. Published by Elsevier Inc. All

Design and validation of the INICIARE instrument, for the assessment of dependency level in acutely ill hospitalised patients.

PubMed

Morales-Asencio, José Miguel; Porcel-Gálvez, Ana María; Oliveros-Valenzuela, Rosa; Rodríguez-Gómez, Susana; Sánchez-Extremera, Lucrecia; Serrano-López, Francisco Andrés; Aranda-Gallardo, Marta; Canca-Sánchez, José Carlos; Barrientos-Trigo, Sergio

2015-03-01

The aim of this study was to establish the validity and reliability of an instrument (Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería) used to assess the dependency level in acutely hospitalised patients. This instrument is novel, and it is based on the Nursing Outcomes Classification. Multiple existing instruments for needs assessment have been poorly validated and based predominately on interventions. Standardised Nursing Languages offer an ideal framework to develop nursing sensitive instruments. A cross-sectional validation study in two acute care hospitals in Spain. This study was implemented in two phases. First, the research team developed the instrument to be validated. In the second phase, the validation process was performed by experts, and the data analysis was conducted to establish the psychometric properties of the instrument. Seven hundred and sixty-one patient ratings performed by nurses were collected during the course of the research study. Data analysis yielded a Cronbach's alpha of 0·91. An exploratory factorial analysis identified three factors (Physiological, Instrumental and Cognitive-behavioural), which explained 74% of the variance. Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería was demonstrated to be a valid and reliable instrument based on its use in acutely hospitalised patients to assess the level of dependency. Inventario del NIvel de Cuidados mediante IndicAdores de clasificación de Resultados de Enfermería can be used as an assessment tool in hospitalised patients during the nursing process throughout the entire hospitalisation period. It contributes information to support decisions on nursing diagnoses, interventions and outcomes. It also enables data codification in large databases. © 2014 John Wiley & Sons Ltd.

Validation of a Performance Assessment Instrument in Problem-Based Learning Tutorials Using Two Cohorts of Medical Students

ERIC Educational Resources Information Center

Lee, Ming; Wimmers, Paul F.

2016-01-01

Although problem-based learning (PBL) has been widely used in medical schools, few studies have attended to the assessment of PBL processes using validated instruments. This study examined reliability and validity for an instrument assessing PBL performance in four domains: Problem Solving, Use of Information, Group Process, and Professionalism.…

Development and Validation of the Work-Related Well-Being Index: Analysis of the Federal Employee Viewpoint Survey.

PubMed

Eaton, Jennifer L; Mohr, David C; Hodgson, Michael J; McPhaul, Kathleen M

2018-02-01

To describe development and validation of the work-related well-being (WRWB) index. Principal components analysis was performed using Federal Employee Viewpoint Survey (FEVS) data (N = 392,752) to extract variables representing worker well-being constructs. Confirmatory factor analysis was performed to verify factor structure. To validate the WRWB index, we used multiple regression analysis to examine relationships with burnout associated outcomes. Principal Components Analysis identified three positive psychology constructs: "Work Positivity", "Co-worker Relationships", and "Work Mastery". An 11 item index explaining 63.5% of variance was achieved. The structural equation model provided a very good fit to the data. Higher WRWB scores were positively associated with all three employee experience measures examined in regression models. The new WRWB index shows promise as a valid and widely accessible instrument to assess worker well-being.

Development and validation of an objective instrument to measure surgical performance at tonsillectomy.

PubMed

Roberson, David W; Kentala, Erna; Forbes, Peter

2005-12-01

The goals of this project were 1) to develop and validate an objective instrument to measure surgical performance at tonsillectomy, 2) to assess its interobserver and interobservation reliability and construct validity, and 3) to select those items with best reliability and most independent information to design a simplified form suitable for routine use in otolaryngology surgical evaluation. Prospective, observational data collection for an educational quality improvement project. The evaluation instrument was based on previous instruments developed in general surgery with input from attending otolaryngologic surgeons and experts in medical education. It was pilot tested and subjected to iterative improvements. After the instrument was finalized, a total of 55 tonsillectomies were observed and scored during academic year 2002 to 2003: 45 cases by residents at different points during their rotation, 5 by fellows, and 5 by faculty. Results were assessed for interobserver reliability, interobservation reliability, and construct validity. Factor analysis was used to identify items with independent information. Interobserver and interobservation reliability was high. On technical items, faculty substantially outperformed fellows, who in turn outperformed residents (P < .0001 for both comparisons). On the "global" scale (overall assessment), residents improved an average of 1 full point (on a 5 point scale) during a 3 month rotation (P = .01). In the subscale of "patient care," results were less clear cut: fellows outperformed residents, who in turn outperformed faculty, but only the fellows to faculty comparison was statistically significant (P = .04), and residents did not clearly improve over time (P = .36). Factor analysis demonstrated that technical items and patient care items factor separately and thus represent separate skill domains in surgery. It is possible to objectively measure surgical skill at tonsillectomy with high reliability and good construct

The Development and Validation of a Transformational Leadership Survey for Substance Use Treatment Programs

PubMed Central

Edwards, Jennifer R.; Knight, Danica K.; Broome, Kirk M.; Flynn, Patrick M.

2014-01-01

Directors in substance use treatment programs are increasingly required to respond to external economic and socio-political pressures. Leadership practices that promote innovation can help offset these challenges. Using focus groups, factor analysis, and validation instruments, the current study developed and established psychometrics for the Survey of Transformational Leadership. In 2008, clinical directors were evaluated on leadership practices by 214 counselors within 57 programs in four U.S. regions. Nine themes emerged: integrity, sensible risk, demonstrates innovation, encourages innovation, inspirational motivation, supports others, develops others, delegates tasks, and expects excellence. Study implications, limitations and suggested future directions are discussed. Funding from NIDA. PMID:20509734

The construction and validation of an instrument for the assessment of graduates of undergraduate nursing courses 1

PubMed Central

Vieira, Maria Aparecida; Ohara, Conceição Vieira da Silva; de Domenico, Edvane Birelo Lopes

2016-01-01

Abstract Objective: to construct an instrument for the assessment of graduates of undergraduate nursing courses and to validate this instrument through the consensus of specialists. Method: methodological study. In order to elaborate the instrument, documental analysis and a literature review were undertaken. Validation took place through use of the Delphi Conference, between September 2012 and September 2013, in which 36 specialists from Brazilian Nursing participated. In order to analyze reliability, the Cronbach alpha coefficient, the item/total correlation, and the Pearson correlation coefficient were calculated. Results: the instrument was constructed with the participation of specialist nurses representing all regions of Brazil, with experience in lecturing and research. The first Delphi round led to changes in the first instrument, which was restructured and submitted to another round, with a response rate of 94.44%. In the second round, the instrument was validated with a Cronbach alpha of 0.75. Conclusion: the final instrument possessed three dimensions related to the characterization of the graduate, insertion in the job market, and evaluation of the professional training process. This instrument may be used across the territory of Brazil as it is based on the curricular guidelines and contributes to the process of regulation of the quality of the undergraduate courses in Nursing. PMID:27305184

Validation of an Instrument to Measure Students' Motivation and Self-Regulation towards Technology Learning

ERIC Educational Resources Information Center

Liou, Pey-Yan; Kuo, Pei-Jung

2014-01-01

Background: Few studies have examined students' attitudinal perceptions of technology. There is no appropriate instrument to measure senior high school students' motivation and self-regulation toward technology learning among the current existing instruments in the field of technology education. Purpose: The present study is to validate an…

'Mechanical restraint-confounders, risk, alliance score': testing the clinical validity of a new risk assessment instrument.

PubMed

Deichmann Nielsen, Lea; Bech, Per; Hounsgaard, Lise; Alkier Gildberg, Frederik

2017-08-01

Unstructured risk assessment, as well as confounders (underlying reasons for the patient's risk behaviour and alliance), risk behaviour, and parameters of alliance, have been identified as factors that prolong the duration of mechanical restraint among forensic mental health inpatients. To clinically validate a new, structured short-term risk assessment instrument called the Mechanical Restraint-Confounders, Risk, Alliance Score (MR-CRAS), with the intended purpose of supporting the clinicians' observation and assessment of the patient's readiness to be released from mechanical restraint. The content and layout of MR-CRAS and its user manual were evaluated using face validation by forensic mental health clinicians, content validation by an expert panel, and pilot testing within two, closed forensic mental health inpatient units. The three sub-scales (Confounders, Risk, and a parameter of Alliance) showed excellent content validity. The clinical validations also showed that MR-CRAS was perceived and experienced as a comprehensible, relevant, comprehensive, and useable risk assessment instrument. MR-CRAS contains 18 clinically valid items, and the instrument can be used to support the clinical decision-making regarding the possibility of releasing the patient from mechanical restraint. The present three studies have clinically validated a short MR-CRAS scale that is currently being psychometrically tested in a larger study.

Development and Validation of the Work-Related Well-Being Index: Analysis of the Federal Employee Viewpoint Survey (FEVS).

PubMed

Eaton, Jennifer L; Mohr, David C; Hodgson, Michael J; McPhaul, Kathleen M

2017-10-11

To describe development and validation of the Work-Related Well-Being (WRWB) Index. Principal Components Analysis was performed using Federal Employee Viewpoint Survey (FEVS) data (N = 392,752) to extract variables representing worker well-being constructs. Confirmatory factor analysis was performed to verify factor structure. To validate the WRWB index, we used multiple regression analysis to examine relationships with burnout associated outcomes. PCA identified three positive psychology constructs: "Work Positivity", "Co-worker Relationships", and "Work Mastery". An 11 item index explaining 63.5% of variance was achieved. The structural equation model provided a very good fit to the data. Higher WRWB scores were positively associated with all 3 employee experience measures examined in regression models. The new WRWB index shows promise as a valid and widely accessible instrument to assess worker well-being.

Creating and validating an instrument to identify the workload at an oncology and hematology outpatient service

PubMed Central

Martin, Lelia Gonçalves Rocha; Gaidzinski, Raquel Rapone

2014-01-01

Objective Construct and to validate an instrument for measuring the time spent by nursing staff in the interventions/activities in Outpatient Oncology and Hematology, interventions based on Nursing Interventions Classification (NIC), for key areas of Pediatric Oncology and Oncology Nursing. Methods Cross-sectional study divided into two steps: (1) construction of an instrument to measure the interventions/Nursing activities and (2) validation of this instrument. Results We selected 32 essential interventions from NIC for Pediatric Oncology and Oncology Nursing areas. The judges agreed with removing 13 and including 6 interventions in the instrument, beyond personal activity. Conclusion The choice of essential interventions from NIC is justified by the gain time on research. PMID:25295454

Space-borne survey instrument operations: lessons learned and new concepts for the Euclid NISP instrument

NASA Astrophysics Data System (ADS)

Valenziano, L.; Gregorio, A.; Butler, R. C.; Amiaux, J.; Bonoli, C.; Bortoletto, F.; Burigana, C.; Corcione, L.; Ealet, A.; Frailis, M.; Jahnke, K.; Ligori, S.; Maiorano, E.; Morgante, G.; Nicastro, L.; Pasian, F.; Riva, M.; Scaramella, R.; Schiavone, F.; Tavagnacco, D.; Toledo-Moreo, R.; Trifoglio, M.; Zacchei, A.; Zerbi, F. M.; Maciaszek, T.

2012-09-01

Euclid is the future ESA mission, mainly devoted to Cosmology. Like WMAP and Planck, it is a survey mission, to be launched in 2019 and injected in orbit far away from the Earth, for a nominal lifetime of 7 years. Euclid has two instruments on-board, the Visible Imager (VIS) and the Near- Infrared Spectro-Photometer (NISP). The NISP instrument includes cryogenic mechanisms, active thermal control, high-performance Data Processing Unit and requires periodic in-flight calibrations and instrument parameters monitoring. To fully exploit the capability of the NISP, a careful control of systematic effects is required. From previous experiments, we have built the concept of an integrated instrument development and verification approach, where the scientific, instrument and ground-segment expertise have strong interactions from the early phases of the project. In particular, we discuss the strong integration of test and calibration activities with the Ground Segment, starting from early pre-launch verification activities. We want to report here the expertise acquired by the Euclid team in previous missions, only citing the literature for detailed reference, and indicate how it is applied in the Euclid mission framework.

Evidence on the validity and reliability of the German, French and Italian nursing home version of the Basel Extent of Rationing of Nursing Care instrument.

PubMed

Zúñiga, Franziska; Schubert, Maria; Hamers, Jan P H; Simon, Michael; Schwendimann, René; Engberg, Sandra; Ausserhofer, Dietmar

2016-08-01

To develop and test psychometrically the Basel Extent of Rationing of Nursing Care for Nursing Homes instrument, providing initial evidence on the validity and reliability of the German, French and Italian-language versions. In the hospital setting, implicit rationing of nursing care is defined as the withholding of nursing activities due to lack of resources, such as staffing or time. No instrument existed to measure this concept in nursing homes. Cross-sectional study. We developed the instrument in three phases: (1) adaption and translation; (2) content validity testing; and (3) initial validity and reliability testing. For phase 3, we analysed survey data from 4748 care workers collected between May 2012-April 2013 from a randomly selected sample of 162 nursing homes in the German-, French- and Italian-speaking regions of Switzerland to provide evidence from response processes (e.g. missing), internal structure (exploratory factor analysis), inter-item inconsistencies (e.g. Cronbach's alpha) and interscorer differences (e.g. within-group agreement). Exploratory factor analysis revealed a four-factor structure with good fit statistics. Rationing of nursing care was structured in four domains: (1) activities of daily living; (2) caring, rehabilitation and monitoring; (3) documentation; and (4) social care. Items of the social care subscale showed lower content validity and more missing values than items of other subscales. First evidence indicates that the new instrument can be recommended for research and practice to measure implicit rationing of nursing care in nursing homes. Further refinements of single items are needed. © 2016 John Wiley & Sons Ltd.

Validation of an Instrument to Measure High School Students' Attitudes toward Fitness Testing

ERIC Educational Resources Information Center

Mercier, Kevin; Silverman, Stephen

2014-01-01

Purpose: The purpose of this investigation was to develop an instrument that has scores that are valid and reliable for measuring students' attitudes toward fitness testing. Method: The method involved the following steps: (a) an elicitation study, (b) item development, (c) a pilot study, and (d) a validation study. The pilot study included 427…

Development and testing of the Youth Alcohol Norms Survey (YANS) instrument to measure youth alcohol norms and psychosocial influences.

PubMed

Burns, Sharyn K; Maycock, Bruce; Hildebrand, Janina; Zhao, Yun; Allsop, Steve; Lobo, Roanna; Howat, Peter

2018-05-14

This study aimed to develop and validate an online instrument to: (1) identify common alcohol-related social influences, norms and beliefs among adolescents; (2) clarify the process and pathways through which proalcohol norms are transmitted to adolescents; (3) describe the characteristics of social connections that contribute to the transmission of alcohol norms; and (4) identify the influence of alcohol marketing on adolescent norm development. The online Youth Alcohol Norms Survey (YANS) was administered in secondary schools in Western Australia PARTICIPANTS: Using a 2-week test-retest format, the YANS was administered to secondary school students (n=481, age=13-17 years, female 309, 64.2%). The development of the YANS was guided by social cognitive theory and comprised a systematic multistage process including evaluation of content and face validity. A 2-week test-retest format was employed. Exploratory factor analysis was conducted to determine the underlying factor structure of the instrument. Test-retest reliability was examined using intraclass correlation coefficient (ICC) and Cohen's kappa. A five-factor structure with meaningful components and robust factorial loads was identified, and the five factors were labelled as 'individual attitudes and beliefs', 'peer and community identity', 'sibling influences', 'school and community connectedness' and 'injunctive norms', respectively. The instrument demonstrated stability across the test-retest procedure (ICC=0.68-0.88, Cohen's kappa coefficient=0.69) for most variables. The results support the reliability and factorial validity of this instrument. The YANS presents a promising tool, which enables comprehensive assessment of reciprocal individual, behavioural and environmental factors that influence alcohol-related norms among adolescents. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise

Screening for frailty in community-dwelling elderly subjects: Predictive validity of the modified SEGA instrument.

PubMed

Oubaya, N; Dramé, M; Novella, J-L; Quignard, E; Cunin, C; Jolly, D; Mahmoudi, R

2017-11-01

To study the capacity of the SEGAm instrument to predict loss of independence among elderly community-dwelling subjects. The study was performed in four French departments (Ardennes, Marne, Meurthe-et-Moselle, Meuse). Subjects aged 65 years or more, living at home, who could read and understand French, with a degree of autonomy corresponding to groups 5 or 6 in the AGGIR autonomy evaluation scale were included. Assessment included demographic characteristics, comprehensive geriatric assessment, and the SEGAm instrument at baseline. Subjects had follow-up visits at home at 6 and 12 months. During follow-up, vital status and level of independence were recorded. Logistic regression was used to study predictive validity of the SEGAm instrument. Among the 116 subjects with complete follow-up, 84 (72.4%) were classed as not very frail at baseline, 23 (19.8%) as frail, and 9 (7.8%) as very frail; 63 (54.3%) suffered loss of at least one ADL or IADL at 12 months. By multivariable analysis, frailty status at baseline was significantly associated with loss of independence during the 12 months of follow-up (OR=4.52, 95% CI=1.40-14.68; p=0.01). We previously validated the SEGAm instrument in terms of feasibility, acceptability, internal structure validity, reliability, and discriminant validity. This instrument appears to be a suitable tool for screening frailty among community-dwelling elderly subjects, and could be used as a basis to plan early targeted interventions for subjects at risk of adverse outcome. Copyright © 2017 Elsevier B.V. All rights reserved.

Reference Proteome Extracts for Mass Spec Instrument Performance Validation and Method Development

PubMed Central

Rosenblatt, Mike; Urh, Marjeta; Saveliev, Sergei

2014-01-01

Biological samples of high complexity are required to test protein mass spec sample preparation procedures and validate mass spec instrument performance. Total cell protein extracts provide the needed sample complexity. However, to be compatible with mass spec applications, such extracts should meet a number of design requirements: compatibility with LC/MS (free of detergents, etc.)high protein integrity (minimal level of protein degradation and non-biological PTMs)compatibility with common sample preparation methods such as proteolysis, PTM enrichment and mass-tag labelingLot-to-lot reproducibility Here we describe total protein extracts from yeast and human cells that meet the above criteria. Two extract formats have been developed: Intact protein extracts with primary use for sample preparation method development and optimizationPre-digested extracts (peptides) with primary use for instrument validation and performance monitoring

The Development of a Survey Instrument to Measure Transactional Distance in Secondary Blended Learning Environments

ERIC Educational Resources Information Center

Lane, Dennis Glenn

2017-01-01

The goal of this study was to develop a survey instrument to measure transactional distance in secondary blended learning environments. This study resulted in a 35-item survey instrument, the Blended Learning Assessment Scale of Transactional Distance (BLASTD), which was tested using a convenience sample of secondary students (n = 222) at a…

Assessing the Validity and Reliability of the Peristomal Skin Lesion Assessment Instrument Adapted for Use in Turkey.

PubMed

Ay, Ali; Bulut, Hulya

2015-08-01

Many ostomy patients experience peristomal skin lesions. A descriptive study was conducted to assess the validity, usability, and reliability of the Peristomal Skin Lesions Assessment instrument (SACS instrument) adapted to Turkish from English. The SACS Instrument consists of 2 main assessments: lesion type (utilizing definitions and photographs) and lesion area by location around the ostomy. The study was performed in 2 stages: 1) the SACS language was changed and its content validity established; and 2) the instrument\\'92s content validity and inter-observer agreement (consistency) were determined among pairs of nurses who used the tool to assess peristomal skin lesions. Patients (included if they were >18 years old and receiving treatment/observation at 1 of the 4 participating stomatherapy units) and 8 stomatherapy nurses also completed appropriate sociodemographic questionnaires. Of the 393 patients screened during the 7-month study, 100 (average age 56.74 \\'b1 14.03 years, 55 men) participated; most (79) had a planned operation. A little more than half (59) of the patients had colorectal cancer and 28 had their stoma site marked preoperatively by a stomatherapy nurse. The most common peristomal skin lesion risk factors were having an ileostomy and unplanned surgery. The content validity index of the entire Turkish SACS instrument was 1, and the inter-observer agreement Kappa statistic was very good (K = 0.90, 95% CI 0.80- 0.99). Individual SACS item K values ranged from K = 0.84 (95% CI 0.63\\'961) to K = 1 (95% CI 1). Most (62.5%) nurses found the terms and pictures used in the SACS classification adequate and suitable, and 50% believed the Turkish version of the SACS instrument was a valid and suitable assessment tool for use by Turkish stomatherapy nurses. Validity and reliability studies involving larger and more diverse patient and nurse samples are warranted.

Validation of a psychometric instrument to assess motivation in veterinary bachelor students.

PubMed

Vandeweerd, Jean-Michel; Dugdale, Alexandra; Romainville, Marc

2014-01-01

There are indications that motivation correlates with better performance for those studying veterinary medicine. To assess objectively whether motivation profiles influence both veterinary students' attitudes towards educational interventions and their academic success and whether changes in curriculum can affect students' motivation, there is need for an instrument that can provide a valid measurement of the strength of motivation for the study of veterinary medicine. Our objectives were to design and validate a questionnaire that can be used as a psychometric scale to capture the motivation profiles of veterinary students. Question items were obtained from semi-structured interviews with students and from a review of the relevant literature. Each item was scored on a 5-point scale. The preliminary instrument was trialed on a cohort of 450 students. Responses were subjected to reliability and principal component analysis. A 14-item scale was designed, within which two factors explained 53.4% of the variance among the items. The scale had good face, content, and construct validities as well as a good internal consistency (Cronbach's alpha=.88).

Patient Experience and Satisfaction with Inpatient Service: Development of Short Form Survey Instrument Measuring the Core Aspect of Inpatient Experience

PubMed Central

Wong, Eliza L. Y.; Coulter, Angela; Hewitson, Paul; Cheung, Annie W. L.; Yam, Carrie H. K.; Lui, Siu fai; Tam, Wilson W. S.; Yeoh, Eng-kiong

2015-01-01

Patient experience reflects quality of care from the patients’ perspective; therefore, patients’ experiences are important data in the evaluation of the quality of health services. The development of an abbreviated, reliable and valid instrument for measuring inpatients’ experience would reflect the key aspect of inpatient care from patients’ perspective as well as facilitate quality improvement by cultivating patient engagement and allow the trends in patient satisfaction and experience to be measured regularly. The study developed a short-form inpatient instrument and tested its ability to capture a core set of inpatients’ experiences. The Hong Kong Inpatient Experience Questionnaire (HKIEQ) was established in 2010; it is an adaptation of the General Inpatient Questionnaire of the Care Quality Commission created by the Picker Institute in United Kingdom. This study used a consensus conference and a cross-sectional validation survey to create and validate a short-form of the Hong Kong Inpatient Experience Questionnaire (SF-HKIEQ). The short-form, the SF-HKIEQ, consisted of 18 items derived from the HKIEQ. The 18 items mainly covered relational aspects of care under four dimensions of the patient’s journey: hospital staff, patient care and treatment, information on leaving the hospital, and overall impression. The SF-HKIEQ had a high degree of face validity, construct validity and internal reliability. The validated SF-HKIEQ reflects the relevant core aspects of inpatients’ experience in a hospital setting. It provides a quick reference tool for quality improvement purposes and a platform that allows both healthcare staff and patients to monitor the quality of hospital care over time. PMID:25860775

Principles of survey development for telemedicine applications.

PubMed

Demiris, George

2006-01-01

Surveys can be used in the evaluation of telemedicine applications but they must be properly designed, consistent and accurate. The purpose of the survey and the resources available will determine the extent of testing that a survey instrument should undergo prior to its use. The validity of an instrument is the correspondence between what is being measured and what was intended to be measured. The reliability of an instrument describes the 'consistency' or 'repeatability' of the measurements made with it. Survey instruments should be designed and tested following basic principles of survey development. The actual survey administration also requires consideration, for example data collection and processing, as well as the interpretation of the findings. Surveys are of two different types. Either they are self-administered, or they are administered by interview. In the latter case, they may be administered by telephone or in a face-to-face meeting. It is important to design a survey instrument based on a detailed definition of what it intends to measure and to test it before administering it to the larger sample.

Developing a Survey Instrument for Evaluating the Effectiveness of Data Management Training Materials

NASA Astrophysics Data System (ADS)

Hou, C. Y.; Soyka, H.; Hutchison, V.; Budden, A. E.

2016-12-01

Education and training resources that focus on best practices and guidelines for working with data such as: data management, data sharing, quality metadata creation, and maintenance for reuse, have vital importance not only to the users of Data Observation Network for Earth (DataONE), but also to the broader scientific, research, and academic communities. However, creating and maintaining relevant training/educational materials that remain sensitive and responsive to community needs is dependent upon careful evaluations of the current landscape in order to promote and support thoughtful development of new resources. Using DataONE's existing training/educational resources as the basis for this project, the authors have worked to develop an evaluation instrument that can be used to evaluate the effectiveness of data management training/education resources. The evaluation instrument is in the form of a digital questionnaire/survey. The evaluation instrument also includes the structure and content as recommended by the best practices/guidelines of questionnaire/survey design, based on a review of the literature. Additionally, the evaluation instrument can be customized to evaluate various training/education modalities and be implemented using a web-based questionnaire/survey platform. Finally, the evaluation instrument can be used for site-wide evaluation of DataONE teaching materials and resources, and once made publicly available and openly accessible, other organizations may also utilize the instrument. One key outcome of developing the evaluation instrument is to help in increasing the effectiveness of data management training/education resources across the Earth/Geoscience community. Through this presentation, the authors will provide the full background and motivations for creating an instrument for evaluating the effectiveness of data management training/education resources. The presentation will also discuss in detail the process and results of the current

Development and validation of an instrument to assess job satisfaction in eye-care personnel.

PubMed

Paudel, Prakash; Cronjé, Sonja; O'Connor, Patricia M; Khadka, Jyoti; Rao, Gullapalli N; Holden, Brien A

2017-11-01

The aim was to develop and validate an instrument to measure job satisfaction in eye-care personnel and assess the job satisfaction of one-year trained vision technicians in India. A pilot instrument for assessing job satisfaction was developed, based on a literature review and input from a public health expert panel. Rasch analysis was used to assess psychometric properties and to undertake an iterative item reduction. The instrument was then administered to vision technicians in vision centres of Andhra Pradesh in India. Associations between vision technicians' job satisfaction and factors such as age, gender and experience were analysed using t-test and one-way analysis of variance. Rasch analysis confirmed that the 15-item job satisfaction in eye-care personnel (JSEP) was a unidimensional instrument with good fit statistics, measurement precisions and absence of differential item functioning. Overall, vision technicians reported high rates of job satisfaction (0.46 logits). Age, gender and experience were not associated with high job satisfaction score. Item score analysis showed non-financial incentives, salary and workload were the most important determinants of job satisfaction. The 15-item JSEP instrument is a valid instrument for assessing job satisfaction among eye-care personnel. Overall, vision technicians in India demonstrated high rates of job satisfaction. © 2016 Optometry Australia.

Design and Validation of the Quantum Mechanics Conceptual Survey

ERIC Educational Resources Information Center

McKagan, S. B.; Perkins, K. K.; Wieman, C. E.

2010-01-01

The Quantum Mechanics Conceptual Survey (QMCS) is a 12-question survey of students' conceptual understanding of quantum mechanics. It is intended to be used to measure the relative effectiveness of different instructional methods in modern physics courses. In this paper, we describe the design and validation of the survey, a process that included…

Development and Validation of Teaching Practice Evaluation Instrument for Assessing Chemistry Students' Teaching Skills

ERIC Educational Resources Information Center

Ezeudu, F. O.; Chiaha, G. T. U.; Eze, J. U.

2013-01-01

The study was designed to develop and factorially validate an instrument for measuring teaching practice skills of chemistry student-teachers in University of Nigeria, Nsukka. Two research questions guided the study. The design of the study was instrumentation. All the chemistry student-teachers in the Department of Science Education, University…

Validity and Reliability of a New Instrument to Measure Cancer-Related Fatigue in Adolescents

PubMed Central

Hinds, Pamela S.; Hockenberry, Marilyn; Tong, Xin; Rai, Shesh N.; Gattuso, Jamie S.; McCarthy, Kathleen; Pui, Ching-Hon; Srivastava, Deo Kumar

2008-01-01

Adolescents undergoing treatment for cancer rate fatigue as their most prevalent and intense cancer- and treatment-related effect. Parents and staff rate it similarly. Despite its reported prevalence, intensity, and distressing effects, cancer-related fatigue in adolescents is not routinely assessed during or after cancer treatment. We contend that the insufficient clinical attention is primarily due to the lack of a reliable and valid self-report instrument with which adolescent cancer-related fatigue can be measured. Our aim was to determine the reliability and construct validity of a new instrument and its ability to measure change in fatigue over time. Initial testing involved 64 adolescents undergoing curative treatment of cancer who completed the Fatigue Scale-Adolescent (FS-A) at two to four key points in treatment in one of four studies. Internal consistency estimates ranged from 0.67 to 0.95. Validity estimates involving the FS-A with the parent version ranged from 0.13 to 0.76; estimates involving the staff version and the Reynolds Depression Scale were 0.27 and 0.87 respectively. Additional validity findings included significant fatigue differences between anemic and non-anemic patients (P = 0.042) and the emergence of four factors in an exploratory factor analysis. Findings further indicate that the FS-A can be used to measure change over time (t = 2.55, P <0.01). In summary, the FS-A has moderate to strong reliability and impressive validity coefficients for a new research instrument. PMID:17629669

Two-Tiered Violence Risk Estimates: a validation study of an integrated-actuarial risk assessment instrument.

PubMed

Mills, Jeremy F; Gray, Andrew L

2013-11-01

This study is an initial validation study of the Two-Tiered Violence Risk Estimates instrument (TTV), a violence risk appraisal instrument designed to support an integrated-actuarial approach to violence risk assessment. The TTV was scored retrospectively from file information on a sample of violent offenders. Construct validity was examined by comparing the TTV with instruments that have shown utility to predict violence that were prospectively scored: The Historical-Clinical-Risk Management-20 (HCR-20) and Lifestyle Criminality Screening Form (LCSF). Predictive validity was examined through a long-term follow-up of 12.4 years with a sample of 78 incarcerated offenders. Results show the TTV to be highly correlated with the HCR-20 and LCSF. The base rate for violence over the follow-up period was 47.4%, and the TTV was equally predictive of violent recidivism relative to the HCR-20 and LCSF. Discussion centers on the advantages of an integrated-actuarial approach to the assessment of violence risk.

Applying the Mixed Methods Instrument Development and Construct Validation Process: the Transformative Experience Questionnaire

ERIC Educational Resources Information Center

Koskey, Kristin L. K.; Sondergeld, Toni A.; Stewart, Victoria C.; Pugh, Kevin J.

2018-01-01

Onwuegbuzie and colleagues proposed the Instrument Development and Construct Validation (IDCV) process as a mixed methods framework for creating and validating measures. Examples applying IDCV are lacking. We provide an illustrative case integrating the Rasch model and cognitive interviews applied to the development of the Transformative…

Single-Item Screening for Agoraphobic Symptoms: Validation of a Web-Based Audiovisual Screening Instrument

PubMed Central

van Ballegooijen, Wouter; Riper, Heleen; Donker, Tara; Martin Abello, Katherina; Marks, Isaac; Cuijpers, Pim

2012-01-01

The advent of web-based treatments for anxiety disorders creates a need for quick and valid online screening instruments, suitable for a range of social groups. This study validates a single-item multimedia screening instrument for agoraphobia, part of the Visual Screener for Common Mental Disorders (VS-CMD), and compares it with the text-based agoraphobia items of the PDSS-SR. The study concerned 85 subjects in an RCT of the effects of web-based therapy for panic symptoms. The VS-CMD item and items 4 and 5 of the PDSS-SR were validated by comparing scores to the outcomes of the CIDI diagnostic interview. Screening for agoraphobia was found moderately valid for both the multimedia item (sensitivity.81, specificity.66, AUC.734) and the text-based items (AUC.607–.697). Single-item multimedia screening for anxiety disorders should be further developed and tested in the general population and in patient, illiterate and immigrant samples. PMID:22844391

The Early Development Instrument: An Examination of Convergent and Discriminant Validity

ERIC Educational Resources Information Center

Hymel, Shelley; LeMare, Lucy; McKee, William

2011-01-01

The convergent and discriminant validity of the Early Development Instrument (EDI), a teacher-rated assessment of children's "school readiness", was investigated in a multicultural sample of 267 kindergarteners (53% male). Teachers evaluations on the EDI, both overall and in five domains (physical health/well-being, social competence,…

Validating an Asthma Case Detection Instrument in a Head Start Sample

ERIC Educational Resources Information Center

Bonner, Sebastian; Matte, Thomas; Rubin, Mitchell; Sheares, Beverley J.; Fagan, Joanne K.; Evans, David; Mellins, Robert B.

2006-01-01

Although specific tests screen children in preschool programs for vision, hearing, and dental conditions, there are no published validated instruments to detect preschool-age children with asthma, one of the most common pediatric chronic conditions affecting children in economically disadvantaged communities of color. As part of an asthma…

Reliability and validity of generalizable skills instruments for students who are deaf, blind, or visually impaired.

PubMed

Loeding, B L; Greenan, J P

1998-12-01

The study examined the validity and reliability of four assessments, with three instruments per domain. Domains included generalizable mathematics, communication, interpersonal relations, and reasoning skills. Participants were deaf, legally blind, or visually impaired students enrolled in vocational classes at residential secondary schools. The researchers estimated the internal consistency reliability, test-retest reliability, and construct validity correlations of three subinstruments: student self-ratings, teacher ratings, and performance assessments. The data suggest that these instruments are highly internally consistent measures of generalizable vocational skills. Four performance assessments have high-to-moderate test-retest reliability estimates, and were generally considered to possess acceptable validity and reliability.

Nearest Neighbor Averaging and its Effect on the Critical Level and Minimum Detectable Concentration for Scanning Radiological Survey Instruments that Perform Facility Release Surveys.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fournier, Sean Donovan; Beall, Patrick S; Miller, Mark L

2014-08-01

Through the SNL New Mexico Small Business Assistance (NMSBA) program, several Sandia engineers worked with the Environmental Restoration Group (ERG) Inc. to verify and validate a novel algorithm used to determine the scanning Critical Level (L c ) and Minimum Detectable Concentration (MDC) (or Minimum Detectable Areal Activity) for the 102F scanning system. Through the use of Monte Carlo statistical simulations the algorithm mathematically demonstrates accuracy in determining the L c and MDC when a nearest-neighbor averaging (NNA) technique was used. To empirically validate this approach, SNL prepared several spiked sources and ran a test with the ERG 102F instrumentmore » on a bare concrete floor known to have no radiological contamination other than background naturally occurring radioactive material (NORM). The tests conclude that the NNA technique increases the sensitivity (decreases the L c and MDC) for high-density data maps that are obtained by scanning radiological survey instruments.« less

Measuring Participants' Attitudes Toward Mobile Device Conference Applications in Continuing Medical Education: Validation of an Instrument.

PubMed

Wittich, Christopher M; Wang, Amy T; Fiala, Justin A; Mauck, Karen F; Mandrekar, Jayawant N; Ratelle, John T; Beckman, Thomas J

2016-01-01

Mobile device applications (apps) may enhance live CME courses. We aimed to (1) validate a measure of participant attitudes toward using a conference app and (2) determine associations between participant characteristics and attitudes toward CME apps with conference app usage. We conducted a cross-sectional validation study of participants at the Mayo Clinic Selected Topics in Internal Medicine Course. A conference app was developed that included presentation slides, note-taking features, search functions, social networking with other attendees, and access to presenter information. The CME app attitudes survey instrument (CMEAPP-10) was designed to determine participant attitudes toward conference apps. Of the 602 participants, 498 (82.7%) returned surveys. Factor analysis revealed a two-dimensional model for CMEAPP-10 scores (Cronbach α, 0.97). Mean (SD) CMEAPP-10 scores (maximum possible score of five) were higher for women than for men (4.06 [0.91] versus 3.85 [0.92]; P = .04). CMEAPP-10 scores (mean [SD]) were significantly associated (P = .02) with previous app usage as follows: less than once per month, 3.73 (1.05); monthly, 3.41 (1.16); weekly, 4.03 (0.69); and daily or more, 4.06 (0.89). Scores were unrelated to participant age, specialty, practice characteristics, or previous app use. This is the first validated measure of attitudes toward CME apps among course participants. App usage was higher among younger participants who had previously used educational or professional apps. Additionally, attitudes were more favorable among women and those who had previously used apps. These findings have important implications regarding efforts to engage participants with portable and accessible technology.

Development and Validation of a Consumer Quality Assessment Instrument for Dentistry.

ERIC Educational Resources Information Center

Johnson, Jeffrey D.; And Others

1990-01-01

This paper reviews the literature on consumer involvement in dental quality assessment, argues for inclusion of this information in quality assessment measures, outlines a conceptual model for measuring dental consumer quality assessment, and presents data relating to the development and validation of an instrument based on the conceptual model.…

Convergent and Divergent Validity of the Grammaticality and Utterance Length Instrument

ERIC Educational Resources Information Center

Castilla-Earls, Anny; Fulcher-Rood, Katrina

2018-01-01

Purpose: This feasibility study examines the convergent and divergent validity of the Grammaticality and Utterance Length Instrument (GLi), a tool designed to assess the grammaticality and average utterance length of a child's prerecorded story retell. Method: Three raters used the GLi to rate audio-recorded story retells from 100 English-speaking…

Validation of behaviour measurement instrument of patients with diabetes mellitus and hypertension

NASA Astrophysics Data System (ADS)

Saputri, G. Z.; Akrom; Dini, S. M.

2017-11-01

Non-adherence to the treatment of chronic diseases such as hypertension and Diabetes Mellitus (DM) is a major obstacle in achieving patient therapy targets and quality of life of patients. A comprehensive approach involving pharmacists counselling has shown influences on changes in health behaviour and patient compliance. Behaviour changes in patients are one of the parameters to assess the effectiveness of counselling and education by pharmacists. Therefore, it is necessary to develop questionnaires of behaviour change measurement in DM-hypertension patients. This study aims to develop a measurement instrument in the form of questionnaires in assessing the behaviour change of DM-hypertension patients. Preparation of question items from the questionnaire research instrument refers to some guidelines and previous research references. Test of questionnaire instrument valid was done with expert validation, followed by pilot testing on 10 healthy respondents, and 10 DM-hypertension patients included in the inclusion criteria. Furthermore, field validation test was conducted on 37 patients who had undergone outpatient care at the PKU Muhammadiyah Yogyakarta City Hospital and The Gading Clinic in Yogyakarta. The inclusion criteria were male and female patients, aged 18-65, diagnosed with type 2 diabetes with hypertension who received oral antidiabetic drugs and antihypertensives, and who were not illiterate and co-operative. The data were collected by questionnaire interviews by a standardized pharmacist. The result of validation test using Person correlation shows the value of 0.33. The results of the questionnaire validation test on 37 patients showed 5 items of invalid questions with the value of r <0.33, e: questions 2, 3, 6, 10 and 11, while the other 10 questions show the value of Pearson correlation > 0.33. The reliability value is shown from the Cronbach's alpha value of 0.722 (> 0.6), implying that the questionnaire is reliable for DM-hypertension patients. This

Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report.

PubMed

Rothman, Margaret; Burke, Laurie; Erickson, Pennifer; Leidy, Nancy Kline; Patrick, Donald L; Petrie, Charles D

2009-01-01

Patient-reported outcome (PRO) instruments are used to evaluate the effect of medical products on how patients feel or function. This article presents the results of an ISPOR task force convened to address good clinical research practices for the use of existing or modified PRO instruments to support medical product labeling claims. The focus of the article is on content validity, with specific reference to existing or modified PRO instruments, because of the importance of content validity in selecting or modifying an existing PRO instrument and the lack of consensus in the research community regarding best practices for establishing and documenting this measurement property. Topics addressed in the article include: definition and general description of content validity; PRO concept identification as the important first step in establishing content validity; instrument identification and the initial review process; key issues in qualitative methodology; and potential threats to content validity, with three case examples used to illustrate types of threats and how they might be resolved. A table of steps used to identify and evaluate an existing PRO instrument is provided, and figures are used to illustrate the meaning of content validity in relationship to instrument development and evaluation. RESULTS & RECOMMENDATIONS: Four important threats to content validity are identified: unclear conceptual match between the PRO instrument and the intended claim, lack of direct patient input into PRO item content from the target population in which the claim is desired, no evidence that the most relevant and important item content is contained in the instrument, and lack of documentation to support modifications to the PRO instrument. In some cases, careful review of the threats to content validity in a specific application may be reduced through additional well documented qualitative studies that specifically address the issue of concern. Published evidence of the content

Development and Validation of a Novice Teacher and Supervisor Survey

ERIC Educational Resources Information Center

Finster, Matthew

2017-01-01

This brief presents initial evidence about the reliability and validity of a novice teacher survey and a novice teacher supervisor survey. The novice teacher and novice teacher supervisor surveys assess how well prepared novice teachers are to meet the job requirements of teaching. The surveys are designed to provide educator preparation programs…

Domestic violence on children: development and validation of an instrument to evaluate knowledge of health professionals 1

PubMed Central

Oliveira, Lanuza Borges; Soares, Fernanda Amaral; Silveira, Marise Fagundes; de Pinho, Lucinéia; Caldeira, Antônio Prates; Leite, Maísa Tavares de Souza

2016-01-01

ABSTRACT Objective: to develop and validate an instrument to evaluate the knowledge of health professionals about domestic violence on children. Method: this was a study conducted with 194 physicians, nurses and dentists. A literature review was performed for preparation of the items and identification of the dimensions. Apparent and content validation was performed using analysis of three experts and 27 professors of the pediatric health discipline. For construct validation, Cronbach's alpha was used, and the Kappa test was applied to verify reproducibility. The criterion validation was conducted using the Student's t-test. Results: the final instrument included 56 items; the Cronbach alpha was 0.734, the Kappa test showed a correlation greater than 0.6 for most items, and the Student t-test showed a statistically significant value to the level of 5% for the two selected variables: years of education and using the Family Health Strategy. Conclusion: the instrument is valid and can be used as a promising tool to develop or direct actions in public health and evaluate knowledge about domestic violence on children. PMID:27556878

Reliability and Validity of Modified Service Quality Instrument (SERVQUAL) in Patients’ Motivation to Adhere to Insulin Therapy

PubMed Central

Jakupovic, Vedran; Solakovic, Suajb; Celebic, Nedim; Kulovic, Dzenan

2018-01-01

Introduction: Diabetes is progressive condition which requires various ways of treatment. Adequate therapy prescribed in the right time helps patient to postpone development of complications. Adherence to complicated therapy is challenge for both patients and HCPs and is subject of research in many disciplines. Improvement in communication between HCP and patients is very important in patient’s adherence to therapy. Aim: Aim of this research was to explore validity and reliability of modified SERVQUAL instrument in attempt to explore ways of motivating diabetic patient to accept prescribed insulin therapy. Material and Methods: We used modified SERVQUAL questionnaire as instrument in the research. It was necessary to check validity and reliability of the new modified instrument. Results: Results show that modified Servqual instrument has excellent reliability (α=0.908), so we could say that it measures precisely Expectations, Perceptions and Motivation at patients. Factor analysis (EFA method) with Varimax rotation extracted 4 factors which together explain 52.902% variance of the results on this subscale. Bifactorial solution could be seen on Scree-plot diagram (break at second factor). Conclusion: Results in this research show that modified Servqual instrument which is created in order to measure expectations and perceptions of the patients is valid and reliable. Reliability and validity are proven indeed in additional dimension which was created originally for this research - motivation to accept insulin therapy. PMID:29670478

Reliability and Validity of Modified Service Quality Instrument (SERVQUAL) in Patients' Motivation to Adhere to Insulin Therapy.

PubMed

Jakupovic, Vedran; Solakovic, Suajb; Celebic, Nedim; Kulovic, Dzenan

2018-03-01

Diabetes is progressive condition which requires various ways of treatment. Adequate therapy prescribed in the right time helps patient to postpone development of complications. Adherence to complicated therapy is challenge for both patients and HCPs and is subject of research in many disciplines. Improvement in communication between HCP and patients is very important in patient's adherence to therapy. Aim of this research was to explore validity and reliability of modified SERVQUAL instrument in attempt to explore ways of motivating diabetic patient to accept prescribed insulin therapy. We used modified SERVQUAL questionnaire as instrument in the research. It was necessary to check validity and reliability of the new modified instrument. Results show that modified Servqual instrument has excellent reliability (α=0.908), so we could say that it measures precisely Expectations, Perceptions and Motivation at patients. Factor analysis (EFA method) with Varimax rotation extracted 4 factors which together explain 52.902% variance of the results on this subscale. Bifactorial solution could be seen on Scree-plot diagram (break at second factor). Results in this research show that modified Servqual instrument which is created in order to measure expectations and perceptions of the patients is valid and reliable. Reliability and validity are proven indeed in additional dimension which was created originally for this research - motivation to accept insulin therapy.

The Development and Validation of an Instrument That Measures Student Perceptions of Teacher Credibility.

ERIC Educational Resources Information Center

Lapan, Stephen D.

The purpose of this study was to develop and validate an instrument to collect student judgments regarding their teacher's credibility. Items were developed and evidence of content validity generated. A pilot sample and a final sample of high school students were administered the Source Credibility Measure (SCM) so that actual response data could…

Attributional Bias Instrument (ABI): Validation of a Measure to Assess Ability and Effort Explanations for Math Performance

ERIC Educational Resources Information Center

Espinoza, Penelope P.; Quezada, Stephanie A.; Rincones, Rodolfo; Strobach, E. Natalia; Gutierrez, Maria Armida Estrada

2012-01-01

The present work investigates the validation of a newly developed instrument, the attributional bias instrument, based on achievement attribution theories that distinguish between effort and ability explanations of behavior. The instrument further incorporates the distinction between explanations for success versus failure in academic performance.…

Concurrent validation of CHIRP, a new instrument for measuring healthcare student attitudes towards interdisciplinary teamwork.

PubMed

Hollar, David; Hobgood, Cherri; Foster, Beverly; Aleman, Marco; Sawning, Susan

2012-01-01

Positive attitudes towards teamwork among health care professionals are critical to patient safety. The purpose of this study is to describe the development and concurrent validation of a new instrument to measure attitudes towards healthcare teamwork that is generalizable across various populations of healthcare students. The Collaborative Healthcare Interdisciplinary Planning (CHIRP) scale was validated against the Readiness for Inter-Professional Learning Scale (RIPLS). Analyses included student (n = 266) demographics, ANOVA, internal consistency, factor analysis, and Rasch analysis. The two instruments correlated at r = .582. The CHIRP showed a multifactorial structure having excellent internal consistency (alpha = .850), with 25 of the 36 scale items loading onto a single Teamwork Attitudes factor. The RIPLS likewise had strong internal consistency (alpha = .796) and a three-factor structure, supporting previous studies of the instrument. However, Rasch analyses showed 14 (38.9%) of the 36 CHIRP items, but only four (21.1%) of the 19 RIPLS items remaining within the satisfactory standardized OUTFIT zone of 2.0 standard deviation units. We propose the 14 fitting items as a new, validated teamwork attitudes scale.

Student Climate Survey, Spring 1998.

ERIC Educational Resources Information Center

Truckee Meadows Community Coll., Sparks, NV.

Every three years, Truckee Meadows Community College (Nevada) administers a student climate survey that measures the attitudes, perceptions, and opinions of its student population. The instrument used to survey the student body was designed with three basic objectives in mind: (1) validate the institutional mission; (2) obtain input regarding the…

Design, validation, and use of an evaluation instrument for monitoring systemic reform

NASA Astrophysics Data System (ADS)

Scantlebury, Kathryn; Boone, William; Butler Kahle, Jane; Fraser, Barry J.

2001-08-01

Over the past decade, state and national policymakers have promoted systemic reform as a way to achieve high-quality science education for all students. However, few instruments are available to measure changes in key dimensions relevant to systemic reform such as teaching practices, student attitudes, or home and peer support. Furthermore, Rasch methods of analysis are needed to permit valid comparison of different cohorts of students during different years of a reform effort. This article describes the design, development, validation, and use of an instrument that measures student attitudes and several environment dimensions (standards-based teaching, home support, and peer support) using a three-step process that incorporated expert opinion, factor analysis, and item response theory. The instrument was validated with over 8,000 science and mathematics students, taught by more than 1,000 teachers in over 200 schools as part of a comprehensive assessment of the effectiveness of Ohio's systemic reform initiative. When the new four-factor, 20-item questionnaire was used to explore the relative influence of the class, home, and peer environment on student achievement and attitudes, findings were remarkably consistent across 3 years and different units and methods of analysis. All three environments accounted for unique variance in student attitudes, but only the environment of the class accounted for unique variance in student achievement. However, the class environment (standards-based teaching practices) was the strongest independent predictor of both achievement and attitude, and appreciable amounts of the total variance in attitudes were common to the three environments.

Weak Lensing from Space I: Instrumentation and Survey Strategy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rhodes, Jason; Refregier, Alexandre; Massey, Richard

A wide field space-based imaging telescope is necessary to fully exploit the technique of observing dark matter via weak gravitational lensing. This first paper in a three part series outlines the survey strategies and relevant instrumental parameters for such a mission. As a concrete example of hardware design, we consider the proposed Supernova/Acceleration Probe (SNAP). Using SNAP engineering models, we quantify the major contributions to this telescope's Point Spread Function (PSF). These PSF contributions are relevant to any similar wide field space telescope. We further show that the PSF of SNAP or a similar telescope will be smaller than currentmore » ground-based PSFs, and more isotropic and stable over time than the PSF of the Hubble Space Telescope. We outline survey strategies for two different regimes - a ''wide'' 300 square degree survey and a ''deep'' 15 square degree survey that will accomplish various weak lensing goals including statistical studies and dark matter mapping.« less

Development and Score Validation of a Chemistry Laboratory Anxiety Instrument (CLAI) for College Chemistry Students.

ERIC Educational Resources Information Center

Bowen, Craig W.

1999-01-01

Reports the development and score validation of an instrument for measuring anxieties students experience in college chemistry laboratories. Factor analysis of scores from 361 college students shows that the developed Chemistry Laboratory Anxiety Instrument measures five constructs. Results from a second sample of 598 students show that scores on…

Development and Validation of the Poverty Attributions Survey

ERIC Educational Resources Information Center

Bennett, Robert M.; Raiz, Lisa; Davis, Tamara S.

2016-01-01

This article describes the process of developing and testing the Poverty Attribution Survey (PAS), a measure of poverty attributions. The PAS is theory based and includes original items as well as items from previously tested poverty attribution instruments. The PAS was electronically administered to a sample of state-licensed professional social…

Development and validation of EMP-3: an instrument to measure physician's attitudes toward ethnic minority patients.

PubMed

De Maesschalck, Stephanie; Willems, Sara; De Maeseneer, Jan; Deveugele, Myriam

2010-04-01

The growing diversity of patient populations challenges health care providers. Physicians' attitudes and perceptions toward cultural diversity in health care could be partly contributing to difficulties in communication between physicians and ethnic minority patients. To evaluate these attitudes and perceptions, an instrument was developed and validated. A preliminary version of the instrument was developed through literature research and expert consultation and completed by 112 family physicians. Factor analysis was performed and reliability and construct validity tested. The instrument revealed three factors that were interpreted as: (1) physicians' task perception and ideas on cultural differences in health and health care, (2) physicians' attitudes toward physician-patient communication with minority patients, and (3) physicians' perception of minority patients' needs in communication. Moderate but significant correlations were found between factors of the EMP-3 and practice organization, practice location, and physicians' gender. Several factors of the Jefferson Empathy Scale, the Patient Practitioner Orientation Scale, and the Health Beliefs and Attitude Scale related to the first two factors of the EMP-3. This instrument, designed specifically to measure physicians' attitudes toward cultural diversity, showed moderate validity and reliability results. Further adaptations and evaluation could be useful.

An instrument to assess subjective task value beliefs regarding the decision to pursue postgraduate training.

PubMed

Hagemeier, Nicholas E; Murawski, Matthew M

2014-02-12

To develop and validate an instrument to assess subjective ratings of the perceived value of various postgraduate training paths followed using expectancy-value as a theoretical framework; and to explore differences in value beliefs across type of postgraduate training pursued and type of pharmacy training completed prior to postgraduate training. A survey instrument was developed to sample 4 theoretical domains of subjective task value: intrinsic value, attainment value, utility value, and perceived cost. Retrospective self-report methodology was employed to examine respondents' (N=1,148) subjective task value beliefs specific to their highest level of postgraduate training completed. Exploratory and confirmatory factor analytic techniques were used to evaluate and validate value belief constructs. Intrinsic, attainment, utility, cost, and financial value constructs resulted from exploratory factor analysis. Cross-validation resulted in a 26-item instrument that demonstrated good model fit. Differences in value beliefs were noted across type of postgraduate training pursued and pharmacy training characteristics. The Postgraduate Training Value Instrument demonstrated evidence of reliability and construct validity. The survey instrument can be used to assess value beliefs regarding multiple postgraduate training options in pharmacy and potentially inform targeted recruiting of individuals to those paths best matching their own value beliefs.

Accessible laparoscopic instrument tracking ("InsTrac"): construct validity in a take-home box simulator.

PubMed

Partridge, Roland W; Hughes, Mark A; Brennan, Paul M; Hennessey, Iain A M

2014-08-01

Objective performance feedback has potential to maximize the training benefit of laparoscopic simulators. Instrument movement metrics are, however, currently the preserve of complex and expensive systems. We aimed to develop and validate affordable, user-ready software that provides objective feedback by tracking instrument movement in a "take-home" laparoscopic simulator. Computer-vision processing tracks the movement of colored bands placed around the distal instrument shafts. The position of each instrument is logged from the simulator camera feed and movement metrics calculated in real time. Ten novices (junior doctors) and 13 general surgery trainees (StR) (training years 3-7) performed a standardized task (threading string through hoops) on the eoSim (eoSurgical™ Ltd., Edinburgh, Scotland, United Kingdom) take-home laparoscopic simulator. Statistical analysis was performed using unpaired t tests with Welch's correction. The software was able to track the instrument tips reliably and effectively. Significant differences between the two groups were observed in time to complete task (StR versus novice, 2 minutes 33 seconds versus 9 minutes 53 seconds; P=.01), total distance traveled by instruments (3.29 m versus 11.38 m, respectively; P=.01), average instrument motion smoothness (0.15 mm/second(3) versus 0.06 mm/second(3), respectively; P<.01), and handedness (mean difference between dominant and nondominant hand) (0.55 m versus 2.43 m, respectively; P=.03). There was no significant difference seen in the distance between instrument tips, acceleration, speed of instruments, or time off-screen. We have developed software that brings objective performance feedback to the portable laparoscopic box simulator. Construct validity has been demonstrated. Removing the need for additional motion-tracking hardware makes it affordable and accessible. It is user-ready and has the potential to enhance the training benefit of portable simulators both in the

Construction and Validation of a Measurement Instrument for Attitudes towards Teamwork

PubMed Central

Mendo-Lázaro, Santiago; Polo-del-Río, María I.; Iglesias-Gallego, Damián; Felipe-Castaño, Elena; León-del-Barco, Benito

2017-01-01

Cooperative, collaborative learning and other forms of group learning methods are increasingly used in classrooms. Knowing students’ attitudes toward teamwork has great value since they influence the students’ learning results as well as their social development. So it is necessary to have robust instruments to provide a better understanding of these attitudes and preferences concerning teamwork. Such instruments also help to identify the factors that promote positive or negative attitudes within the context of group activities. Using a sample of 750 first and second year university students studying a degree in Kindergarten, Primary and Social Education, an instrument measuring attitudes toward team learning has been developed. Two distinct factors were obtained through various factorial analyses and structural equations: Academic attitudes and Social and emotional attitudes. Our study reveals that the instrument is both valid and reliable. Its application is both simple and fast and it has important implications for planning teaching and learning activities that contribute to an improvement in attitudes as well as the practice of teaching in the context of learning through teamwork. PMID:28676775

Construction and Validation of a Measurement Instrument for Attitudes towards Teamwork.

PubMed

Mendo-Lázaro, Santiago; Polo-Del-Río, María I; Iglesias-Gallego, Damián; Felipe-Castaño, Elena; León-Del-Barco, Benito

2017-01-01

Cooperative, collaborative learning and other forms of group learning methods are increasingly used in classrooms. Knowing students' attitudes toward teamwork has great value since they influence the students' learning results as well as their social development. So it is necessary to have robust instruments to provide a better understanding of these attitudes and preferences concerning teamwork. Such instruments also help to identify the factors that promote positive or negative attitudes within the context of group activities. Using a sample of 750 first and second year university students studying a degree in Kindergarten, Primary and Social Education, an instrument measuring attitudes toward team learning has been developed. Two distinct factors were obtained through various factorial analyses and structural equations: Academic attitudes and Social and emotional attitudes . Our study reveals that the instrument is both valid and reliable. Its application is both simple and fast and it has important implications for planning teaching and learning activities that contribute to an improvement in attitudes as well as the practice of teaching in the context of learning through teamwork.

Reliability and construct validity of the Participation in Life Activities Scale for children and adolescents with asthma: an instrument evaluation study.

PubMed

Kintner, Eileen K; Sikorskii, Alla

2008-06-04

The purpose of this study was to evaluate the reliability and construct validity of the Participation in Life Activities Scale, an instrument designed to measure older school-age child and early adolescent level of involvement in chosen pursuits. A cross-sectional design was used. The convenience sample consisted of 313 school-age children and early adolescents with asthma, ages 9-15 years. The self-report summative scale of interest is a 3-indicator survey. Higher scores are reflective of higher levels of participation. Internal consistency reliability and construct validity for the entire sample and sub groups of the sample were evaluated. The instrument was deemed sound for the entire sample as well as sub groups based on sex, race, age, socioeconomic status, and severity of illness. Cronbach's alpha coefficient for internal consistency reliability for the entire sample was .74. Exploratory factor analysis indicated a single component solution (loadings .79-.85) accounting for 66% of the explained variance. Construct validity was established by testing the posed relationship between participation in life activities scores and severity of illness. Confirmatory factor analysis revealed a good fit between the data and specified model, chi2(10, n = 302) = 8.074, p = .62. This instrument could be used (a) in clinical settings to diagnose restricted participation in desired activities, guide decision-making about treatment plans to increase participation, and motivate behavioral change in the management of asthma; and (b) in research settings to explore factors influencing and consequences of restricted and unrestricted participation, and as an outcome measure to evaluate the effectiveness of programs designed to foster child and early adolescent management of asthma.

Design, Validation, and Use of an Evaluation Instrument for Monitoring Systemic Reform.

ERIC Educational Resources Information Center

Scantlebury, Kathryn; Boone, William; Kahle, Jane Butler; Fraser, Barry J.

2001-01-01

Describes the design, development, validation, and use of an instrument that measures student attitudes and several environmental dimensions (i.e., standards-based teaching, home support, and peer support). Indicates that the classroom environment (standards-based teaching practices) was the strongest independent predictor of both achievement and…

A Comparative Study of Adolescent Risk Assessment Instruments: Predictive and Incremental Validity

ERIC Educational Resources Information Center

Welsh, Jennifer L.; Schmidt, Fred; McKinnon, Lauren; Chattha, H. K.; Meyers, Joanna R.

2008-01-01

Promising new adolescent risk assessment tools are being incorporated into clinical practice but currently possess limited evidence of predictive validity regarding their individual and/or combined use in risk assessments. The current study compares three structured adolescent risk instruments, Youth Level of Service/Case Management Inventory…

Development and Validation of the College Tobacco Survey.

ERIC Educational Resources Information Center

Ott, Carol H.; Cashin, Susan E.; Altekruse, Michael

2005-01-01

The authors report on the development and assessment of an instrument to measure baseline campus cigarette use and outcomes from prevention programs, including those using a social norms approach combined with environmental policy change. They administered the 37-item College Tobacco Survey (CTS) to a convenience sample of 1,279 college students…

Developing, testing, and implementing a survey of scientist mentoring teachers as part of an RET: The GABI RET mentor survey.

NASA Astrophysics Data System (ADS)

Davey, B.

2017-12-01

The impacts of mentoring in education have been well established. Mentors have a large impact on their mentees and have been show to affect mentee attitudes towards learning, interest in subjects, future success, and more. While mentoring has a well-documented impact on the mentees, mentoring also has an impact on the mentors themselves. However, little has been studied empirically about these impacts. When we looked for a validated instrument that measured the impact of mentoring on the scientists working with the teachers, we found many anecdotal reports but no instruments that meet our specific needs. To this end, we developed, tested, and implemented our own instrument for measuring the impacts of mentoring on our scientist mentors. Our instrument contained both quantitative and qualitative items designed to reveal the effects of mentoring in two areas: 1) cognitive domain (mentoring, teaching, understanding K-12) and 2) affective domain (professional, personal, participation). We first shared our survey with experts in survey development and mentoring, gathered their feedback, and incorporated their suggestions into our instrument. We then had a subsection of our mentors complete the survey and then complete it again three to four days later (test-retest). Our survey has a high correlation for the test-retest quantitative items (0.93) and a high correlation (0.90) between the three reviewers of the qualitative items. From our findings, we feel we have a validated instrument (face, content, and contruct validity) that answers our research questions reliably. Our contribution to the study of mentoring of science teachers reveals a broad range of impacts on the mentors themselves including an improved understanding of the challenges of classroom teaching, a recognition of the importance of scientists working with science teachers, an enhanced ability to communicate their research and findings, and an increased interest and excitement for their own work.

Validation of a Teachers' Achievement Goal Instrument for Teaching Physical Education

ERIC Educational Resources Information Center

Wang, Jian; Shen, Bo; Luo, Xiaobin; Hu, Qingshan; Garn, Alex C.

2018-01-01

Purpose: Using Butler's teacher achievement goal orientation as a conceptual framework, we developed this study to validate a teachers' achievement goal instrument for teaching physical education. Methods: A sample of 322 Chinese physical education teachers participated in this study and completed measures of achievement goal orientations and job…

Development and validation of an instrument for evaluating inquiry-based tasks in science textbooks

NASA Astrophysics Data System (ADS)

Yang, Wenyuan; Liu, Enshan

2016-12-01

This article describes the development and validation of an instrument that can be used for content analysis of inquiry-based tasks. According to the theories of educational evaluation and qualities of inquiry, four essential functions that inquiry-based tasks should serve are defined: (1) assisting in the construction of understandings about scientific concepts, (2) providing students opportunities to use inquiry process skills, (3) being conducive to establishing understandings about scientific inquiry, and (4) giving students opportunities to develop higher order thinking skills. An instrument - the Inquiry-Based Tasks Analysis Inventory (ITAI) - was developed to judge whether inquiry-based tasks perform these functions well. To test the reliability and validity of the ITAI, 4 faculty members were invited to use the ITAI to collect data from 53 inquiry-based tasks in the 3 most widely adopted senior secondary biology textbooks in Mainland China. The results indicate that (1) the inter-rater reliability reached 87.7%, (2) the grading criteria have high discriminant validity, (3) the items possess high convergent validity, and (4) the Cronbach's alpha reliability coefficient reached 0.792. The study concludes that the ITAI is valid and reliable. Because of its solid foundations in theoretical and empirical argumentation, the ITAI is trustworthy.

Evaluating instruments for quality: testing convergent validity of the consumer emergency care satisfaction scale.

PubMed

Davis, Barbara A; Kiesel, Cynthia K; McFarland, Julie; Collard, Adressa; Coston, Kyle; Keeton, Ada

2005-01-01

Having reliable and valid instruments is a necessity for nurses and others measuring concepts such as patient satisfaction. The purpose of this article is to describe the use of convergence to test the construct validity of the Davis Consumer Emergency Care Satisfaction Scale (CECSS). Results indicate convergence of the CECSS with the Risser Patient Satisfaction Scale and 2 single-item visual analogue scales, therefore supporting construct validity. Persons measuring patient satisfaction with nurse behaviors in the emergency department can confidently use the CECSS.

A Validation Study of the School Attitude Assessment Survey.

ERIC Educational Resources Information Center

McCoach, D. Betsy

2002-01-01

This article describes the development of the School Attitude Assessment Survey (SAAS), an instrument that measures self-concept, self-motivation and self-regulation, attitude toward school, and peer attitudes to predict the academic achievement of adolescents. (Contains 43 references and 5 tables.) (Author)

Design, testing and validation of an innovative web-based instrument to evaluate school meal quality.

PubMed

Patterson, Emma; Quetel, Anna-Karin; Lilja, Karin; Simma, Marit; Olsson, Linnea; Elinder, Liselotte Schäfer

2013-06-01

To develop a feasible, valid, reliable web-based instrument to objectively evaluate school meal quality in Swedish primary schools. The construct 'school meal quality' was operationalized by an expert panel into six domains, one of which was nutritional quality. An instrument was drafted and pilot-tested. Face validity was evaluated by the panel. Feasibility was established via a large national study. Food-based criteria to predict the nutritional adequacy of school meals in terms of fat quality, iron, vitamin D and fibre content were developed. Predictive validity was evaluated by comparing the nutritional adequacy of school menus based on these criteria with the results from a nutritional analysis. Inter-rater reliability was also assessed. The instrument was developed between 2010 and 2012. It is designed for use in all primary schools by school catering and/or management representatives. A pilot-test of eighty schools in Stockholm (autumn 2010) and a further test of feasibility in 191 schools nationally (spring 2011). The four nutrient-specific food-based criteria predicted nutritional adequacy with sensitivity ranging from 0.85 to 1.0, specificity from 0.45 to 1.0 and accuracy from 0.67 to 1.0. The sample in the national study was statistically representative and the majority of users rated the questionnaire positively, suggesting the instrument is feasible. The inter-rater reliability was fair to almost perfect for continuous variables and agreement was ≥ 67 % for categorical variables. An innovative web-based system to comprehensively monitor school meal quality across several domains, with validated questions in the nutritional domain, is available in Sweden for the first time.

Validity and reliability of a health care service evaluation instrument for tuberculosis

PubMed Central

Scatena, Lucia Marina; Wysocki, Anneliese Domingues; Beraldo, Aline Ale; Magnabosco, Gabriela Tavares; Brunello, Maria Eugênia Firmino; Netto, Antonio Ruffino; Nogueira, Jordana de Almeida; Silva, Reinaldo Antonio; Brito, Ewerton William Gomes; Alexandre, Patricia Borges Dias; Monroe, Aline Aparecida; Villa, Tereza Cristina Scatena

2015-01-01

OBJECTIVE To evaluate the validity and reliability of an instrument that evaluates the structure of primary health care units for the treatment of tuberculosis. METHODS This cross-sectional study used simple random sampling and evaluated 1,037 health care professionals from five Brazilian municipalities (Natal, state of Rio Grande do Norte; Cabedelo, state of Paraíba; Foz do Iguaçu, state of Parana; Sao José do Rio Preto, state of Sao Paulo, and Uberaba, state of Minas Gerais) in 2011. Structural indicators were identified and validated, considering different methods of organization of the health care system in the municipalities of different population sizes. Each structure represented the organization of health care services and contained the resources available for the execution of health care services: physical resources (equipment, consumables, and facilities); human resources (number and qualification); and resources for maintenance of the existing infrastructure and technology (deemed as the organization of health care services). The statistical analyses used in the validation process included reliability analysis, exploratory factor analysis, and confirmatory factor analysis. RESULTS The validation process indicated the retention of five factors, with 85.9% of the total variance explained, internal consistency between 0.6460 and 0.7802, and quality of fit of the confirmatory factor analysis of 0.995 using the goodness-of-fit index. The retained factors comprised five structural indicators: professionals involved in the care of tuberculosis patients, training, access to recording instruments, availability of supplies, and coordination of health care services with other levels of care. Availability of supplies had the best performance and the lowest coefficient of variation among the services evaluated. The indicators of assessment of human resources and coordination with other levels of care had satisfactory performance, but the latter showed the highest

The Public Opinion Survey of Human Attributes-Stuttering (POSHA-S) and Bipolar Adjective Scale (BAS): aspects of validity.

PubMed

St Louis, Kenneth O; Williams, Mandy J; Ware, Mercedes B; Guendouzi, Jacqueline; Reichel, Isabella K

2014-01-01

In order to estimate instrument validity, attitudes toward stuttering measured by the newly developed Public Opinion Survey of Human Attributes-Stuttering (POSHA-S) and the Woods and Williams (1976) semantic differential scale (referred to herein as the Bipolar Adjective Scale [BAS]) are compared in college students on one occasion as well as before and after coursework on fluency disorders. Undergraduate and graduate students (n=321) from four universities filled out online versions of the POSHA-S and BAS. Two-thirds were speech-language pathology (SLP) majors; one-third were students in other majors. A subset of the SLP students (n=35) filled out the two instruments again after 8-13 weeks of coursework on fluency disorders. Correlations between all ratings of the POSHA-S and BAS were run for the 321 students. Only 26% of the correlations were statistically significant (R ≥ ± 0.129), and the large majority of these reflected small relationships. POSHA-S ratings were correlated with up to 77% of the items of the BAS while BAS items were correlated with up to 45% of the POSHA-S ratings. After coursework on stuttering, students' attitudes improved on both instruments, but more on the POSHA-S than the BAS. Greater evidence of discriminant validity than convergent validity characterized the POSHA-S and BAS. Both measures showed improved attitudes after fluency disorders coursework, but more so for the POSHA-S, confirming previous reports of construct validity. The POSHA-S taps relevant constructs not included in the BAS, which provide advantages for intracultural, international, and other comparisons of public attitudes toward stuttering. The reader will be able to: (1) describe differentiating characteristics of the POSHA-S and BAS as measures of public attitudes toward stuttering, (2) describe the overlap and lack of overlap in the constructs measured by POSHA-S and BAS, (3) describe discriminant versus convergent validity and (4) describe advantages of the POSHA

Design and validation of a three-instrument toolkit for the assessment of competence in electrocardiogram rhythm recognition.

PubMed

Hernández-Padilla, José M; Granero-Molina, José; Márquez-Hernández, Verónica V; Suthers, Fiona; López-Entrambasaguas, Olga M; Fernández-Sola, Cayetano

2017-06-01

Rapid and accurate interpretation of cardiac arrhythmias by nurses has been linked with safe practice and positive patient outcomes. Although training in electrocardiogram rhythm recognition is part of most undergraduate nursing programmes, research continues to suggest that nurses and nursing students lack competence in recognising cardiac rhythms. In order to promote patient safety, nursing educators must develop valid and reliable assessment tools that allow the rigorous assessment of this competence before nursing students are allowed to practise without supervision. The aim of this study was to develop and psychometrically evaluate a toolkit to holistically assess competence in electrocardiogram rhythm recognition. Following a convenience sampling technique, 293 nursing students from a nursing faculty in a Spanish university were recruited for the study. The following three instruments were developed and psychometrically tested: an electrocardiogram knowledge assessment tool (ECG-KAT), an electrocardiogram skills assessment tool (ECG-SAT) and an electrocardiogram self-efficacy assessment tool (ECG-SES). Reliability and validity (content, criterion and construct) of these tools were meticulously examined. A high Cronbach's alpha coefficient demonstrated the excellent reliability of the instruments (ECG-KAT=0.89; ECG-SAT=0.93; ECG-SES=0.98). An excellent context validity index (scales' average content validity index>0.94) and very good criterion validity were evidenced for all the tools. Regarding construct validity, principal component analysis revealed that all items comprising the instruments contributed to measure knowledge, skills or self-efficacy in electrocardiogram rhythm recognition. Moreover, known-groups analysis showed the tools' ability to detect expected differences in competence between groups with different training experiences. The three-instrument toolkit developed showed excellent psychometric properties for measuring competence in

Developing a theoretical model and questionnaire survey instrument to measure the success of electronic health records in residential aged care.

PubMed

Yu, Ping; Qian, Siyu

2018-01-01

Electronic health records (EHR) are introduced into healthcare organizations worldwide to improve patient safety, healthcare quality and efficiency. A rigorous evaluation of this technology is important to reduce potential negative effects on patient and staff, to provide decision makers with accurate information for system improvement and to ensure return on investment. Therefore, this study develops a theoretical model and questionnaire survey instrument to assess the success of organizational EHR in routine use from the viewpoint of nursing staff in residential aged care homes. The proposed research model incorporates six variables in the reformulated DeLone and McLean information systems success model: system quality, information quality, service quality, use, user satisfaction and net benefits. Two variables training and self-efficacy were also incorporated into the model. A questionnaire survey instrument was designed to measure the eight variables in the model. After a pilot test, the measurement scale was used to collect data from 243 nursing staff members in 10 residential aged care homes belonging to three management groups in Australia. Partial least squares path modeling was conducted to validate the model. The validated EHR systems success model predicts the impact of the four antecedent variables-training, self-efficacy, system quality and information quality-on the net benefits, the indicator of EHR systems success, through the intermittent variables use and user satisfaction. A 24-item measurement scale was developed to quantitatively evaluate the performance of an EHR system. The parsimonious EHR systems success model and the measurement scale can be used to benchmark EHR systems success across organizations and units and over time.

Development and validation of climate change system thinking instrument (CCSTI) for measuring system thinking on climate change content

NASA Astrophysics Data System (ADS)

Meilinda; Rustaman, N. Y.; Firman, H.; Tjasyono, B.

2018-05-01

The Climate Change System Thinking Instrument (CCSTI) is developed to measure a system thinking ability in the concept of climate change. CCSTI is developed in four phase’s development including instrument draft development, validation and evaluation including readable material test, expert validation, and field test. The result of field test is analyzed by looking at the readability score in Cronbach’s alpha test. Draft instrument is tested on college students majoring in Biology Education, Physics Education, and Chemistry Education randomly with a total number of 80 college students. Score of Content Validation Index at 0.86, which means that the CCSTI developed are categorized as very appropriate with question indicators and Cronbach’s alpha about 0.605 which mean categorized undesirable to minimal acceptable. From 45 questions of system thinking, there are 37 valid questions spread in four indicators of system thinking, which are system thinking phase I (pre-requirement), system thinking phase II (basic), system thinking phase III (intermediate), and system thinking phase IV (coherent expert).

Validation of an Instrument and Testing Protocol for Measuring the Combinatorial Analysis Schema.

ERIC Educational Resources Information Center

Staver, John R.; Harty, Harold

1979-01-01

Designs a testing situation to examine the presence of combinatorial analysis, to establish construct validity in the use of an instrument, Combinatorial Analysis Behavior Observation Scheme (CABOS), and to investigate the presence of the schema in young adolescents. (Author/GA)

Construction and Validation of an Instrument to Measure Taiwanese Elementary Students' Attitudes toward Their Science Class

NASA Astrophysics Data System (ADS)

Wang, Tzu-Ling; Berlin, Donna

2010-12-01

The main purpose of this study is to develop a valid and reliable instrument for measuring the attitudes toward science class of fourth- and fifth-grade students in an Asian school culture. Specifically, the development focused on three science attitude constructs-science enjoyment, science confidence, and importance of science as related to science class experiences. A total of 265 elementary school students in Taiwan responded to the instrument developed. Data analysis indicated that the instrument exhibited satisfactory validity and reliability with the Taiwan population used. The Cronbach's alpha coefficient was 0.93 for the entire instrument indicating a satisfactory level of internal consistency. However, both principal component analysis and parallel analysis showed that the three attitude scales were not unique and should be combined and used as a general "attitudes toward science class" scale. The analysis also showed that there were no gender or grade-level differences in students' overall attitudes toward science class.

Ethical issues in palliative care for nursing homes: Development and testing of a survey instrument.

PubMed

Preshaw, Deborah Hl; McLaughlin, Dorry; Brazil, Kevin

2018-02-01

To develop and psychometrically assess a survey instrument identifying ethical issues during palliative care provision in nursing homes. Registered nurses and healthcare assistants have reported ethical issues in everyday palliative care provision. Identifying these issues provides evidence to inform practice development to support healthcare workers. Cross-sectional survey of Registered nurses and healthcare assistants in nursing homes in one region of the UK. A survey instrument, "Ethical issues in Palliative Care for Nursing homes", was developed through the findings of qualitative interviews with Registered nurses and healthcare assistants in nursing homes and a literature review. It was reviewed by an expert panel and piloted prior to implementation in a survey in 2015 with a convenience sample of 596 Registered nurses and healthcare assistants. Descriptive and exploratory factor analyses were used to assess the underlying structure of the Frequency and Distress Scales within the instrument. Analysis of 201 responses (response rate = 33.7%) revealed four factors for the Frequency Scale and five factors for the Distress Scale that comprise the Ethical issues in Palliative Care for Nursing homes. Factors common to both scales included "Processes of care," "Resident autonomy" and "Burdensome treatment." Additionally, the Frequency Scale included "Competency," and the Distress Scale included "Quality of care" and "Communication." The Ethical issues in Palliative Care for Nursing homes instrument has added to the palliative care knowledge base by considering the ethical issues experienced specifically by Registered nurses and healthcare assistants within the nursing home. This research offers preliminary evidence of the psychometric properties of the Ethical issues in Palliative Care for Nursing homes survey instrument. The two largest factors highlight the need to address the organisational aspects of caring and provide training in negotiating conflicting

A validation study of the Keyboard Personal Computer Style instrument (K-PeCS) for use with children.

PubMed

Green, Dido; Meroz, Anat; Margalit, Adi Edit; Ratzon, Navah Z

2012-11-01

This study examines a potential instrument for measurement of typing postures of children. This paper describes inter-rater, test-retest reliability and concurrent validity of the Keyboard Personal Computer Style instrument (K-PeCS), an observational measurement of postures and movements during keyboarding, for use with children. Two trained raters independently rated videos of 24 children (aged 7-10 years). Six children returned one week later for identifying test-retest reliability. Concurrent validity was assessed by comparing ratings obtained using the K-PECS to scores from a 3D motion analysis system. Inter-rater reliability was moderate to high for 12 out of 16 items (Kappa: 0.46 to 1.00; correlation coefficients: 0.77-0.95) and test-retest reliability varied across items (Kappa: 0.25 to 0.67; correlation coefficients: r = 0.20 to r = 0.95). Concurrent validity compared favourably across arm pathlength, wrist extension and ulnar deviation. In light of the limitations of other tools the K-PeCS offers a fairly affordable, reliable and valid instrument to address the gap for measurement of typing styles of children, despite the shortcomings of some items. However further research is required to refine the instrument for use in evaluating typing among children. Copyright © 2012 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Investigating Socioscientific Issues via Scientific Habits of Mind: Development and validation of the Scientific Habits of Mind Survey

NASA Astrophysics Data System (ADS)

Çalik, Muammer; Coll, Richard Kevin

2012-08-01

In this paper, we describe the Scientific Habits of Mind Survey (SHOMS) developed to explore public, science teachers', and scientists' understanding of habits of mind (HoM). The instrument contained 59 items, and captures the seven SHOM identified by Gauld. The SHOM was validated by administration to two cohorts of pre-service science teachers: primary science teachers with little science background or interest (n = 145), and secondary school science teachers (who also were science graduates) with stronger science knowledge (n = 145). Face validity was confirmed by the use of a panel of experts and a pilot study employing participants similar in demographics to the intended sample. To confirm convergent and discriminant validity, confirmatory factor analysis and evaluation of the reliability were calculated. Statistical data and other data gathered from interviews suggest that the SHOMS will prove to be a useful tool for educators and researchers who wish to investigate HoM for a variety of participants.

Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students: Pilot study.

PubMed

Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh

2015-05-01

The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.

The development of an instrument for evaluating clinical teachers: involving stakeholders to determine content validity.

PubMed

Stalmeijer, Renée E; Dolmans, Diana H J M; Wolfhagen, Ineke H A P; Muijtjens, Arno M M; Scherpbier, Albert J J A

2008-01-01

Research indicates that the quality of supervision strongly influences the learning of medical students in clinical practice. Clinical teachers need feedback to improve their supervisory skills. The available instruments either lack a clear theoretical framework or are not suitable for providing feedback to individual teachers. We developed an evaluation instrument based on the 'cognitive apprenticeship model'. The aim was to estimate the content validity of the developed instrument. Item relevance was rated on a five-point scale (1 = highly irrelevant, 5 = highly relevant) by three groups of stakeholders in undergraduate clinical teaching: educationalists (N = 12), doctors (N = 16) and students (N = 12). Additionally, stakeholders commented on content, wording and omission of items. The items were generally rated as very relevant (Mean = 4.3, SD = 0.38, response = 95%) and any differences between the stakeholder groups were small. The results led to elimination of 4 items, rewording of 13 items and addition of 1 item. The cognitive apprenticeship model appears to offer a useful framework for the development of an evaluation instrument aimed at providing feedback to individual clinical teachers on the quality of student supervision. Further studies in larger populations will have to establish the instrument's statistical validity and generalizability.

Construction of a survey to assess workload and fatigue among AMT operators in Mexico.

PubMed

Hernández Arellano, Juan Luis; Ibarra Mejía, Gabriel; Serratos Pérez, J Nieves; García Alcaraz, Jorge Luis; Brunette, María Julia

2012-01-01

Operators of machinery classified as Advanced Manufacturing Technology (AMT) are exposed to high levels of workload and fatigue. However, only few studies have been conducted on this topic in Hispanic-American countries workers. Several instruments be used to assess workload and fatigue; however, only few of them have been adapted to Spanish language. This paper reports on the development and validity testing of a survey instrument in Spanish, aiming to subjectively assess workload and fatigue among AMT operators in Mexico. After an exhaustive literature review in search of already available measurement instruments, they were adapted for content and later translated into Spanish; a pilot test was conducted to evaluate validity and reliability; afterwards appropriate modifications were made to the testing instruments. Final version of the instrument was applied to a group of 121 operators of CNC lathes. Reliability was analyzed using KMO and Cronbach alpha indices. For the assessment of workload, both NASA-TLX and ISTAS 21 methods were incorporated to the survey instrument. As for fatigue assessment tools, these were SOFI-S, FAS and OFER questionnaires. RESULTS show KMO value and Cronbach alpha above 0.6.Conclusions. The survey instrument as designed, allows the collection of reliable and valid data regarding workload and fatigue among AMT operators in Mexico.

Validation of an instrument for assessing teacher knowledge of basic language constructs of literacy.

PubMed

Binks-Cantrell, Emily; Joshi, R Malatesha; Washburn, Erin K

2012-10-01

Recent national reports have stressed the importance of teacher knowledge in teaching reading. However, in the past, teachers' knowledge of language and literacy constructs has typically been assessed with instruments that are not fully tested for validity. In the present study, an instrument was developed; and its reliability, item difficulty, and item discrimination were computed and examined to identify model fit by applying exploratory factor analysis. Such analyses showed that the instrument demonstrated adequate estimates of reliability in assessing teachers' knowledge of language constructs. The implications for professional development of in-service teachers as well as preservice teacher education are also discussed.

Development and Validation of Nature of Science Instrument for Elementary School Students

ERIC Educational Resources Information Center

Hacieminoglu, Esme; Yilmaz-Tüzün, Özgül; Ertepinar, Hamide

2014-01-01

The purposes of this study were to develop and validate an instrument for assessing elementary students' nature of science (NOS) views and to explain the elementary school students' NOS views, in terms of varying grade levels and gender. The sample included 782 students enrolled in sixth, seventh, and eighth grades. Exploratory factor analysis…

Validation of online psychometric instruments for common mental health disorders: a systematic review.

PubMed

van Ballegooijen, Wouter; Riper, Heleen; Cuijpers, Pim; van Oppen, Patricia; Smit, Johannes H

2016-02-25

Online questionnaires for measuring common mental health disorders such as depression and anxiety disorders are increasingly used. The psychometrics of several pen-and-paper questionnaires have been re-examined for online use and new online instruments have been developed and tested for validity as well. This study aims to review and synthesise the literature on this subject and provide a framework for future research. We searched Medline and PsycINFO for psychometric studies on online instruments for common mental health disorders and extracted the psychometric data. Studies were coded and assessed for quality by independent raters. We included 56 studies on 62 online instruments. For common instruments such as the CES-D, MADRS-S and HADS there is mounting evidence for adequate psychometric properties. Further results are scattered over different instruments and different psychometric characteristics. Few studies included patient populations. We found at least one online measure for each of the included mental health disorders and symptoms. A small number of online questionnaires have been studied thoroughly. This study provides an overview of online instruments to refer to when choosing an instrument for assessing common mental health disorders online, and can structure future psychometric research.

Applying the APA/AERA/NCME "Standards": Evidence for the Validity and Reliability of Three Statewide Teaching Assessment Instruments.

ERIC Educational Resources Information Center

Rothenberg, Lori; Hessling, Peter A.

The statewide teaching performance assessment instruments being used in Georgia, North Carolina, and Florida were examined. Forty-one reliability and validity studies regarding the instruments in use in each state were collected from state departments and universities. Georgia uses the Georgia Teacher Performance Assessment Instrument. North…

Large/Complex Antenna Performance Validation for Spaceborne Radar/Radiometeric Instruments

NASA Technical Reports Server (NTRS)

Focardi, Paolo; Harrell, Jefferson; Vacchione, Joseph

2013-01-01

Over the past decade, Earth observing missions which employ spaceborne combined radar & radiometric instruments have been developed and implemented. These instruments include the use of large and complex deployable antennas whose radiation characteristics need to be accurately determined over 4 pisteradians. Given the size and complexity of these antennas, the performance of the flight units cannot be readily measured. In addition, the radiation performance is impacted by the presence of the instrument's service platform which cannot easily be included in any measurement campaign. In order to meet the system performance knowledge requirements, a two pronged approach has been employed. The first is to use modeling tools to characterize the system and the second is to build a scale model of the system and use RF measurements to validate the results of the modeling tools. This paper demonstrates the resulting level of agreement between scale model and numerical modeling for two recent missions: (1) the earlier Aquarius instrument currently in Earth orbit and (2) the upcoming Soil Moisture Active Passive (SMAP) mission. The results from two modeling approaches, Ansoft's High Frequency Structure Simulator (HFSS) and TICRA's General RF Applications Software Package (GRASP), were compared with measurements of approximately 1/10th scale models of the Aquarius and SMAP systems. Generally good agreement was found between the three methods but each approach had its shortcomings as will be detailed in this paper.

Development and Validation of an Instrument to Assess the Implementation of Family-Centred Care in Traditional Open Bay Neonatal Intensive Care Units

ERIC Educational Resources Information Center

Al-Motlaq, Mohammad A.; Abuidhail, Jamila; Salameh, Taghreed; Awwad, Wesam

2017-01-01

Objective: To develop an instrument to study family-centred care (FCC) in traditional open bay Neonatal Intensive Care Units (NICUs). Methods: The development process involved constructing instrument's items, establishing content validity by an expert panel and testing the instrument for validity and reliability with a convenience sample of 25…

Concurrent validity and reliability of wireless instrumented insoles measuring postural balance and temporal gait parameters.

PubMed

Oerbekke, Michiel S; Stukstette, Mirelle J; Schütte, Kurt; de Bie, Rob A; Pisters, Martijn F; Vanwanseele, Benedicte

2017-01-01

The OpenGo seems promising to take gait analysis out of laboratory settings due to its capability of long-term measurements and mobility. However, the OpenGo's concurrent validity and reliability need to be assessed to determine if the instrument is suitable for validation in patient samples. Twenty healthy volunteers participated. Center of pressure data were collected under eyes open and closed conditions with participants performing unilateral stance trials on the gold standard (AMTI OR6-7 force plate) while wearing the OpenGo. Temporal gait data (stance time, gait cycle time, and cadence) were collected at a self-selected comfortable walking speed with participants performing test-retest trials on an instrumented treadmill while wearing the OpenGo. Validity was assessed using Bland-Altman plots. Reliability was assessed with Intraclass Correlation Coefficient (2,1) and smallest detectable changes were calculated. Negative means of differences were found in all measured parameters, illustrating lower scores for the OpenGo on average. The OpenGo showed negative upper limits of agreement in center of pressure parameters on the mediolateral axis. Temporal reliability ICCs ranged from 0.90-0.93. Smallest detectable changes for both stance times were 0.04 (left) and 0.05 (right) seconds, for gait cycle time 0.08s, and for cadence 4.5 steps per minute. The OpenGo is valid and reliable for the measurement of temporal gait parameters during walking. Measurements of center of pressure parameters during unilateral stance are not considered valid. The OpenGo seems a promising instrument for clinically screening and monitoring temporal gait parameters in patients, however validation in patient populations is needed. Copyright © 2016 Elsevier B.V. All rights reserved.

Validation of the malaysian versions of parents and children health survey for asthma by using rasch-model.

PubMed

Hussein, Maryam Se; Akram, Waqas; Mamat, Mohd Nor; Majeed, Abu Bakar Abdul; Ismail, Nahlah Elkudssiah Binti

2015-04-01

In recent years, health-related quality of life (HRQOL) has become an important outcome measure in epidemiologic studies and clinical trials. For patients with asthma there are many instruments but most of them have been developed in English. With the increase in research project, researchers working in other languages have two options; either to develop a new measure or to translate an already developed measure. Children Health Survey for Asthma is developed by American Academy of Paediatrics which has two versions one for the parents (CHSA) and the other for the child (CHSA-C). However, there is no Malay version of the CHSA or the CHSA-C. The aim of this study was to translate and determine the validity and reliability of the Malaysian versions of Parent and Children Health Survey for Asthma. Questionnaires were translated to Bahasa Malayu using previously established guidelines, data from 180 respondents (asthmatic children and their parent) were analysed using Rasch-Model; as, it is an approach that has been increasingly used in health field and also it explores the performance of each item rather than total set score. The internal consistency was high for the parent questionnaire (CHSA) (reliability score for persons = 0.88 and for items was 0.97), and good for child questionnaire (CHSA-C) (reliability score for persons = 0.83 and for items was 0.94). Also, this study shows that all items measure for both questionnaires (CHSA and CHSA-C) are fitted to Rasch-Model. This study produced questionnaires that are conceptually equivalent to the original, easy to understand for the children and their parents, and good in terms of internal consistency. Because of the questionnaire has two versions one for the child and the other for the parents, they could be used in clinical practice to measure the effect of asthma on the child and their families. This current research had translated two instruments to other language (BahasaMalayu) and evaluated their reliability and

A neuropsychological instrument measuring age-related cerebral decline in older drivers: development, reliability, and validity of MedDrive

PubMed Central

Vaucher, Paul; Cardoso, Isabel; Veldstra, Janet L.; Herzig, Daniela; Herzog, Michael; Mangin, Patrice; Favrat, Bernard

2014-01-01

When facing age-related cerebral decline, older adults are unequally affected by cognitive impairment without us knowing why. To explore underlying mechanisms and find possible solutions to maintain life-space mobility, there is a need for a standardized behavioral test that relates to behaviors in natural environments. The aim of the project described in this paper was therefore to provide a free, reliable, transparent, computer-based instrument capable of detecting age-related changes on visual processing and cortical functions for the purposes of research into human behavior in computational transportation science. After obtaining content validity, exploring psychometric properties of the developed tasks, we derived (Study 1) the scoring method for measuring cerebral decline on 106 older drivers aged ≥70 years attending a driving refresher course organized by the Swiss Automobile Association to test the instrument's validity against on-road driving performance (106 older drivers). We then validated the derived method on a new sample of 182 drivers (Study 2). We then measured the instrument's reliability having 17 healthy, young volunteers repeat all tests included in the instrument five times (Study 3) and explored the instrument's psychophysical underlying functions on 47 older drivers (Study 4). Finally, we tested the instrument's responsiveness to alcohol and effects on performance on a driving simulator in a randomized, double-blinded, placebo, crossover, dose-response, validation trial including 20 healthy, young volunteers (Study 5). The developed instrument revealed good psychometric properties related to processing speed. It was reliable (ICC = 0.853) and showed reasonable association to driving performance (R2 = 0.053), and responded to blood alcohol concentrations of 0.5 g/L (p = 0.008). Our results suggest that MedDrive is capable of detecting age-related changes that affect processing speed. These changes nevertheless do not necessarily affect

Physical activity measurement instruments for children with cerebral palsy: a systematic review.

PubMed

Capio, Catherine M; Sit, Cindy H P; Abernethy, Bruce; Rotor, Esmerita R

2010-10-01

this paper is a systematic review of physical activity measurement instruments for field-based studies involving children with cerebral palsy (CP). database searches using PubMed Central, MEDLINE, CINAHL Plus, PsycINFO, EMBASE, Cochrane Library, and PEDro located 12 research papers, identifying seven instruments that met the inclusion criteria of (1) having been developed for children aged 0 to 18 years, (2) having been used to evaluate a physical activity dimension, and (3) having been used in a field-based study involving children with CP. The instruments reviewed were the Activities Scale for Kids - Performance version (ASKp), the Canada Fitness Survey, the Children's Assessment of Participation and Enjoyment/Preferences for Activities of Children (CAPE/PAC), the Compendium of Physical Activities, the Physical Activity Questionnaire - Adolescents (PAQ-A), StepWatch, and the Uptimer. Second-round searches yielded 11 more papers, providing reliability and validity evidence for the instruments. the instruments measure physical activity frequency, mode, domain, and duration. Although most instruments demonstrated adequate reliability and validity, only the ASKp and CAPE/PAC have established reliability and validity for children with physical disabilities; the Uptimer has established concurrent validity. No instrument measuring intensity in free-living has been validated or found reliable for children with CP. the findings suggest that further studies are needed to examine the methodological properties of physical activity measurement in children with CP. Combining subjective and objective instruments is recommended to achieve better understanding of physical activity participation.

The Toronto outcome measure for craniofacial prosthetics: reliability and validity of a condition-specific quality-of-life instrument.

PubMed

Anderson, James D; Johnston, Dennis A; Haugh, Gil S; Kiat-Amnuay, Sudarat; Gettleman, Lawrence

2013-01-01

The purpose of this study was to refine the Toronto Outcome Measure for Craniofacial Prosthetics (TOMCP), present evidence for its reliability and validity, and use the instrument to explore differences in quality of life between prostheses made with chlorinated polyethylene (CPE) (experimental) and silicone (control). As part of a multicenter prospective controlled randomized double-blind single-crossover clinical trial of the two materials, the TOMCP was administered at the start and end of two 4-month study arms, during which 42 patients wore prostheses made from one material then the other. Reliability was assessed at the crossover. To determine validity of the TOMCP, the Linear Analogue Self-Assessment (LASA-12) and the Short-Form 8 (SF-8) were also administered with the TOMCP. The TOMCP was reduced by removing items that were unreliable, had poorly distributed answers, showed increased internal consistency after their removal, or were too highly correlated with more than one other item. The tests of reliability and validity were then repeated. Finally, the reduced instrument was used to test for differences in quality of life between prostheses made of the two materials. The item reduction tactics pared the 52-item instrument down to 27 items. The correlations of both TOMCP versions with the LASA-12 and the SF-8 were found to be statistically significant, providing evidence of the validity of the TOMCP. The instrument revealed significantly better quality of life with silicone rather than CPE prostheses. Both versions of the TOMCP were found to be reliable and valid. The instrument was able to show differences in quality of life between two materials.

A Parsimonious Instrument for Predicting Students' Intent to Pursue a Sales Career: Scale Development and Validation

ERIC Educational Resources Information Center

Peltier, James W.; Cummins, Shannon; Pomirleanu, Nadia; Cross, James; Simon, Rob

2014-01-01

Students' desire and intention to pursue a career in sales continue to lag behind industry demand for sales professionals. This article develops and validates a reliable and parsimonious scale for measuring and predicting student intention to pursue a selling career. The instrument advances previous scales in three ways. The instrument is…

Development and Validation of an Instrument to Measure Indonesian Pre-Service Teachers' Conceptions of Statistics

ERIC Educational Resources Information Center

Idris, Khairiani; Yang, Kai-Lin

2017-01-01

This article reports the results of a mixed-methods approach to develop and validate an instrument to measure Indonesian pre-service teachers' conceptions of statistics. First, a phenomenographic study involving a sample of 44 participants uncovered six categories of conceptions of statistics. Second, an instrument of conceptions of statistics was…

Development and preliminary validation of a leadership competency instrument for existing and emerging allied health professional leaders.

PubMed

Ang, Hui-Gek; Koh, Jeremy Meng-Yeow; Lee, Jeffrey; Pua, Yong-Hao

2016-02-19

No instruments, to our knowledge, exist to assess leadership competency in existing and emerging allied health professional (AHP) leaders. This paper describes the development and preliminary exploration of the psychometric properties of a leadership competency instrument for existing and emerging AHP leaders and examines (i) its factor structure, (ii) its convergent validity with the Leadership Practices Inventory (LPI), and (iii) its discriminative validity in AHPs with different grades. During development, we included 25 items in the AHEAD (Aspiring leaders in Healthcare-Empowering individuals, Achieving excellence, Developing talents) instrument. A cross-sectional study was then conducted in 106 high-potential AHPs from Singapore General Hospital (34 men and 72 women) of different professional grades (49 principal-grade AHPs, 41 senior-grade AHPs, and 16 junior-grade AHPs) who completed both AHEAD and LPI instruments. Exploratory factor analysis was used to test the theoretical structure of AHEAD. Spearman correlation analysis was performed to evaluate the convergent validity of AHEAD with LPI. Using proportional odds regression models, we evaluated the association of grades of AHPs with AHEAD and LPI. To assess discriminative validity, the c-statistics - a measure of discrimination - were derived from these ordinal models. As theorized, factor analysis suggested a two-factor solution, where "skills" and "values" formed separate factors. Internal consistency of AHEAD was excellent (α-values > 0.88). Total and component AHEAD and LPI scores correlated moderately (Spearman ρ-values, 0.37 to 0.58). The c-index for discriminating between AHP grades was higher for AHEAD than for the LPI (0.76 vs. 0.65). The factorial structure of AHEAD was generally supported in our study. AHEAD showed convergent validity with the LPI and outperformed the LPI in terms of discriminative validity. These results provide initial evidence for the use of AHEAD to assess leadership

Evolution and validation of a personal form of an instrument for assessing science laboratory classroom environments

NASA Astrophysics Data System (ADS)

Fraser, Barry J.; Giddings, Geoffrey J.; McRobbie, Campbell J.

The research reported in this article makes two distinctive contributions to the field of classroom environment research. First, because existing instruments are unsuitable for science laboratory classes, the Science Laboratory Environment Inventory (SLEI) was developed and validated. Second, a new Personal form of the SLEI (involving a student's perceptions of his or her own role within the class) was developed and validated in conjunction with the conventional Class form (involving a student's perceptions of the class as a whole), and its usefulness was investigated. The instrument was cross-nationally fieldtested with 5,447 students in 269 senior high school and university classes in six countries, and cross-validated with 1,594 senior high school students in 92 classes in Australia. Each SLEI scale exhibited satisfactory internal consistency reliability, discriminant validity, and factorial validity, and differentiated between the perceptions of students in different classes. A variety of applications with the new instrument furnished evidence about its usefulness and revealed that science laboratory classes are dominated by closed-ended activities; mean scores obtained on the Class form were consistently somewhat more favorable than on the corresponding Personal form; females generally held more favorable perceptions than males, but these differences were somewhat larger for the Personal form than the Class form; associations existed between attitudinal outcomes and laboratory environment dimensions; and the Class and Personal forms of the SLEI each accounted for unique variance in student outcomes which was independent of that accounted for by the other form.

The Hospice Environmental Survey (HES): Pilot Test of a New Measurement Instrument.

ERIC Educational Resources Information Center

Taylor, Jean H.; Perrill, Norman K.

1988-01-01

Describes development of the Hospice Environmental Survey (HES) to measure user's perception of the homelike atmosphere provided by a hospital inpatient unit called Hospice House. Presents the HES instrument, methodology, and pilot study data. (Author/NB)

A survey of mass analyzers. [characteristics and features of various instruments and techniques

NASA Technical Reports Server (NTRS)

Moore, W. W., Jr.; Tashbar, P. W.

1973-01-01

With the increasing applications of mass spectrometry technology to diverse services areas, a need has developed for a consolidated survey of the essential characteristics and features of the various instruments and techniques. This report is one approach to satisfying this need. Information has been collected and consolidated into a format which includes for each approach: (1) a general technique description, (2) instrument features information, and (3) a summary of pertinent advantages and disadvantages. With this information, the potential mass spectrometer user should be able to more efficiently select the most appropriate instrument.

An Interactive Whiteboard Student Survey: Development, Validity and Reliability

ERIC Educational Resources Information Center

Turel, Yalin Kilic

2011-01-01

The interactive whiteboard (IWB) has become a popular technology for instructors over the last decade. Though research asserts that the IWBs facilitate learning in different ways, there is a lack of studies examining actual IWB use in classroom settings based on learners' perspectives by means of valid instruments. The purpose of this study is to…

Development and Validation of the Numeracy Understanding in Medicine Instrument Short Form

PubMed Central

Schapira, Marilyn M.; Walker, Cindy M.; Miller, Tamara; Fletcher, Kathlyn A; Ganschow, Pamela G.; Jacobs, Elizabeth A; Imbert, Diana; O'Connell, Maria; Neuner, Joan M.

2014-01-01

Background Health numeracy can be defined as the ability to understand and use numeric information and quantitative concepts in the context of health. We previously reported the development of the Numeracy Understanding in Medicine Instrument (NUMi); a 20-item test developed using item response theory. We now report the development and validation of a short form of the NUMi. Methods Item statistics were used to identify a subset of 8-items representing a range of difficulty and content areas. Internal reliability was evaluated with Cronbach's alpha. Divergent and convergent validity was assessed by comparing scores of the S-NUMI with existing measures of education, print and numeric health literacy, mathematic achievement, cognitive reasoning, and the original NUMi. Results The 8-item scale had adequate reliability (Cronbach's alpha: 0.72) and was strongly correlated to the 20-item NUMi (0.92). The S-NUMi scores were strongly correlated with the Lipkus numeracy test (0.62), Wide Range of Achievement Test-Mathematics (WRAT-M) (0.72), and Wonderlic cognitive reasoning test (0.76). Moderate correlation was found with education level (0.58) and print literacy as measured by the TOFHLA (0.49). Conclusion The short Numeracy Understanding in Medicine Instrument is a reliable and valid measure of health numeracy feasible for use in clinical and research settings. PMID:25315596

Initial Validation of the Teacher/Coach Role Conflict Scale