Hablamos juntos (together we speak): a brief patient-reported measure of the quality of interpretation.

PubMed

Talamantes, Efrain; Moreno, Gerardo; Guerrero, Lourdes R; Mangione, Carol M; Morales, Leo S

2014-01-01

This study evaluates the psychometric properties of three newly developed items assessing the quality of interpretation from the patient's perspective among Spanish-speaking limited English proficient Latino patients. The authors examined the psychometric properties of a patient-reported measure of quality of interpretation using a cross-sectional survey study of 1,590 adult Spanish-speaking limited English proficient Latinos in the United States. Quality of interpretation, doctor communication, and satisfaction with care were assessed using a three survey-item, an independent multiple-item measure, and a single-item measure, respectively. Sixty-nine percent (1,104) of patients surveyed used interpreters. Cronbach's alpha for the three items assessing interpreter quality was 0.31, while dropping item three resulted in an alpha of 0.56. Items one and two were moderately correlated with doctor communication (r=0.39) and satisfaction with care scores (r=0.21) supporting construct validity. Two out of three survey items can be scaled to measure quality of interpretation from the patient's perspective. Quality of interpretation reported by patients is moderately associated with doctor communication and satisfaction with care.

Factors affecting study efficiency and item non-response in health surveys in developing countries: the Jamaica national healthy lifestyle survey.

PubMed

Wilks, Rainford; Younger, Novie; Mullings, Jasneth; Zohoori, Namvar; Figueroa, Peter; Tulloch-Reid, Marshall; Ferguson, Trevor; Walters, Christine; Bennett, Franklyn; Forrester, Terrence; Ward, Elizabeth; Ashley, Deanna

2007-02-28

Health surveys provide important information on the burden and secular trends of risk factors and disease. Several factors including survey and item non-response can affect data quality. There are few reports on efficiency, validity and the impact of item non-response, from developing countries. This report examines factors associated with item non-response and study efficiency in a national health survey in a developing Caribbean island. A national sample of participants aged 15-74 years was selected in a multi-stage sampling design accounting for 4 health regions and 14 parishes using enumeration districts as primary sampling units. Means and proportions of the variables of interest were compared between various categories. Non-response was defined as failure to provide an analyzable response. Linear and logistic regression models accounting for sample design and post-stratification weighting were used to identify independent correlates of recruitment efficiency and item non-response. We recruited 2012 15-74 year-olds (66.2% females) at a response rate of 87.6% with significant variation between regions (80.9% to 97.6%; p < 0.0001). Females outnumbered males in all parishes. The majority of subjects were recruited in a single visit, 39.1% required multiple visits varying significantly by region (27.0% to 49.8% [p < 0.0001]). Average interview time was 44.3 minutes with no variation between health regions, urban-rural residence, educational level, gender and SES; but increased significantly with older age category from 42.9 minutes in the youngest to 46.0 minutes in the oldest age category. Between 15.8% and 26.8% of persons did not provide responses for the number of sexual partners in the last year. Women and urban residents provided less data than their counterparts. Highest item non-response related to income at 30% with no gender difference but independently related to educational level, employment status, age group and health region. Characteristics of non-responders vary with types of questions. Informative health surveys are possible in developing countries. While survey response rates may be satisfactory, item non-response was high in respect of income and sexual practice. In contrast to developed countries, non-response to questions on income is higher and has different correlates. These findings can inform future surveys.

[Development of knowledge, attitude and practice questionnaire on prevention and control of occupational diseases].

PubMed

Gao, Yuan; Feng, Yuchao; Wang, Min; Su, Yiwei; Li, Yanhua; Wang, Zhi; Tang, Shihao

2015-04-01

To develop the knowledge, attitude and practice questionnaire on the prevention and control of occupational diseases for occupational groups, and to provide a convenient and effective tool for the survey of knowledge, attitude, and behavior on the prevention and control of occupational diseases in occupational groups and the evaluation of intervention effect. The initial questionnaire which was evaluated by the experts was used to carry out a pre-survey in Guangzhou, China. The survey results were statistically analyzed by t test, identification index method, correlation analysis, and Cronbach's a coefficient method. And then the questionnaire was further modified, and the content of the questionnaire was determined finally. After modification, there were 18 items on knowledge, 16 items on attitude, and 12 items on behavior in the "Knowledge, attitude and practice questionnaire on the prevention and control of occupational diseases for enterprise managers"; there were 19 items on knowledge, 10 items on attitude, and 11 items on behavior in the "Knowledge, attitude and practice questionnaire on the prevention and control of occupational diseases for workers". The knowledge, attitude and practice questionnaire on the prevention and control of occupational diseases for occupational groups is developed successfully, and it is a convenient and effective tool for the survey of knowledge, attitude, and behavior on the prevention and control of occupational diseases in occupational groups and the evaluation of intervention effect.

Development and evaluation of CAHPS survey items assessing how well healthcare providers address health literacy.

PubMed

Weidmer, Beverly A; Brach, Cindy; Hays, Ron D

2012-09-01

The complexity of health information often exceeds patients' skills to understand and use it. To develop survey items assessing how well healthcare providers communicate health information. Domains and items for the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Item Set for Addressing Health Literacy were identified through an environmental scan and input from stakeholders. The draft item set was translated into Spanish and pretested in both English and Spanish. The revised item set was field tested with a randomly selected sample of adult patients from 2 sites using mail and telephonic data collection. Item-scale correlations, confirmatory factor analysis, and internal consistency reliability estimates were estimated to assess how well the survey items performed and identify composite measures. Finally, we regressed the CAHPS global rating of the provider item on the CAHPS core communication composite and the new health literacy composites. A total of 601 completed surveys were obtained (52% response rate). Two composite measures were identified: (1) Communication to Improve Health Literacy (16 items); and (2) How Well Providers Communicate About Medicines (6 items). These 2 composites were significantly uniquely associated with the global rating of the provider (communication to improve health literacy: P<0.001, b=0.28; and communication about medicines composite: P=0.02, b=0.04). The 2 composites and the CAHPS core communication composite accounted for 51% of the variance in the global rating of the provider. A 5-item subset of the Communication to Improve Health Literacy composite accounted for 90% of the variance of the original 16-item composite. This study provides support for reliability and validity of the CAHPS Item Set for Addressing Health Literacy. These items can serve to assess whether healthcare providers have communicated effectively with their patients and as a tool for quality improvement.

Reduced-Item Food Audits Based on the Nutrition Environment Measures Surveys.

PubMed

Partington, Susan N; Menzies, Tim J; Colburn, Trina A; Saelens, Brian E; Glanz, Karen

2015-10-01

The community food environment may contribute to obesity by influencing food choice. Store and restaurant audits are increasingly common methods for assessing food environments, but are time consuming and costly. A valid, reliable brief measurement tool is needed. The purpose of this study was to develop and validate reduced-item food environment audit tools for stores and restaurants. Nutrition Environment Measures Surveys for stores (NEMS-S) and restaurants (NEMS-R) were completed in 820 stores and 1,795 restaurants in West Virginia, San Diego, and Seattle. Data mining techniques (correlation-based feature selection and linear regression) were used to identify survey items highly correlated to total survey scores and produce reduced-item audit tools that were subsequently validated against full NEMS surveys. Regression coefficients were used as weights that were applied to reduced-item tool items to generate comparable scores to full NEMS surveys. Data were collected and analyzed in 2008-2013. The reduced-item tools included eight items for grocery, ten for convenience, seven for variety, and five for other stores; and 16 items for sit-down, 14 for fast casual, 19 for fast food, and 13 for specialty restaurants-10% of the full NEMS-S and 25% of the full NEMS-R. There were no significant differences in median scores for varying types of retail food outlets when compared to the full survey scores. Median in-store audit time was reduced 25%-50%. Reduced-item audit tools can reduce the burden and complexity of large-scale or repeated assessments of the retail food environment without compromising measurement quality. Copyright © 2015 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.

A Study of General Education Astronomy Students' Understandings of Cosmology. Part III. Evaluating Four Conceptual Cosmology Surveys: An Item Response Theory Approach

ERIC Educational Resources Information Center

Wallace, Colin S.; Prather, Edward E.; Duncan, Douglas K.

2012-01-01

This is the third of five papers detailing our national study of general education astronomy students' conceptual and reasoning difficulties with cosmology. In this paper, we use item response theory to analyze students' responses to three out of the four conceptual cosmology surveys we developed. The specific item response theory model we use is…

Communicative Access Measures for Stroke: Development and Evaluation of a Quality Improvement Tool.

PubMed

Kagan, Aura; Simmons-Mackie, Nina; Victor, J Charles; Chan, Melodie T

2017-11-01

To (1) develop a systems-level quality improvement tool targeting communicative access to information and decision-making for stroke patients with language disorders; and (2) evaluate the resulting tool-the Communicative Access Measures for Stroke (CAMS). Survey development and evaluation was in line with accepted guidelines and included item generation and reduction, survey formatting and composition, pretesting, pilot testing, and reliability assessment. Development and evaluation were carried out in hospital and community agency settings. The project used a convenience sample of 31 participants for the survey development, and 63 participants for the CAMS reliability study (broken down into 6 administrators/managers, 32 frontline staff, 25 participants with aphasia). Eligible participants invited to the reliability study included individuals from 45 community-based organizations in Ontario as well as 4400 individuals from communities of practice. Not applicable. Data were analyzed using kappa statistics and intraclass correlations for each item score on all surveys. A tool, the CAMS, comprising 3 surveys, was developed for health facilities from the perspectives of (1) administrators/policymakers, (2) staff/frontline health care providers, and (3) patients with aphasia (using a communicatively accessible version). Reliability for items on the CAMS-Administrator and CAMS-Staff surveys was moderate to high (kappa/intraclass correlation coefficients [ICCs], .54-1.00). As expected, reliability was lower for the CAMS-Patient survey, with most items having ICCs between 0.4 and 0.6. These findings suggest that CAMS may provide useful quality improvement information for health care facilities with an interest in improving care for patients with stroke and aphasia. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

The GP Patient Survey for use in primary care in the National Health Service in the UK--development and psychometric characteristics.

PubMed

Campbell, John; Smith, Patten; Nissen, Sonja; Bower, Peter; Elliott, Marc; Roland, Martin

2009-08-22

The UK National GP Patient Survey is one of the largest ever survey programmes of patients registered to receive primary health care, inviting five million respondents to report their experience of NHS primary healthcare. The third such annual survey (2008/9) involved the development of a new survey instrument. We describe the process of that development, and the findings of an extensive pilot survey in UK primary healthcare. The survey was developed following recognised guidelines and involved expert and stakeholder advice, cognitive testing of early versions of the survey instrument, and piloting of the questionnaire in a cross sectional pilot survey of 1,500 randomly selected individuals from the UK electoral register with two reminders to non-respondents. The questionnaire comprises 66 items addressing a range of aspects of UK primary healthcare. A response rate of 590/1500 (39.3%) was obtained. Non response to individual items ranged from 0.8% to 15.3% (median 5.2%). Participants did not always follow internal branching instructions in the questionnaire although electronic controls allow for correction of this problem in analysis. There was marked skew in the distribution of responses to a number of items indicating an overall favourable impression of care. Principal components analysis of 23 items offering evaluation of various aspects of primary care identified three components (relating to doctor or nurse care, or addressing access to care) accounting for 68.3% of the variance in the sample. The GP Patient Survey has been carefully developed and pilot-tested. Survey findings, aggregated at practice level, will be used to inform the distribution of pound sterling 65 million ($107 million) of UK NHS resource in 2008/9 and this offers the opportunity for NHS service planners and providers to take account of users' experiences of health care in planning and delivering primary healthcare in the UK.

Why we love or hate our cars: A qualitative approach to the development of a quantitative user experience survey.

PubMed

Tonetto, Leandro Miletto; Desmet, Pieter M A

2016-09-01

This paper presents a more ecologically valid way of developing theory-based item questionnaires for measuring user experience. In this novel approach, items were generated using natural and domain-specific language of the research population, what seems to have made the survey much more sensitive to real experiences than theory-based ones. The approach was applied in a survey that measured car experience. Ten in-depth interviews were conducted with drivers inside their cars. The resulting transcripts were analysed with the aim of capturing their natural utterances for expressing their car experience. This analysis resulted in 71 categories of answers. For each category, one sentence was selected to serve as a survey-item. In an online platform, 538 respondents answered the survey. Data reliability, tested with Cronbach alpha index, was 0.94, suggesting a survey with highly reliable results to measure drivers' appraisals of their cars. Copyright © 2016 Elsevier Ltd. All rights reserved.

The International Confederation of Midwives: Global Standards for Midwifery Education (2010) with companion guidelines.

PubMed

Thompson, Joyce B; Fullerton, Judith T; Sawyer, Angela J

2011-08-01

a 2-year study was conducted to develop Global Standards for Midwifery Education in keeping with core documents of the International Confederation of Midwives. Elements of the standards were based on evidence available in the published and unpublished literature. Companion Guidelines to assist in implementing the standards were also developed. a modified Delphi survey process was conducted in two rounds following item validation by a panel of midwifery education experts. a global survey conducted in 88 countries. midwifery educators and clinicians associated with midwifery education located in any of the ICM member association countries. Additional participants included an Expert Midwifery Resource Group, other Key Stakeholders, midwifery regulators and policy makers. A total of 241 individuals from 46 ICM member association countries and ten non-member countries responded to one or both of the survey rounds. survey respondents expressed an opinion on whether to retain or to delete any of the proposed components of the standards. Version one had 109 proposed components and version two had 111 items for consideration. a majority consensus of .80 was required to accept an item without further deliberation. The Education Standards Task Force (expert panel) made final decisions in the four instances where this level of consensus was not reached, retaining all four items. The panel also amended the wording of selected items or added new items based on feedback received from survey respondents. The final document contains 10 Preface items, 35 glossary terms, and 37 discrete standards with 27 sub-sections. Copyright © 2011 Elsevier Ltd. All rights reserved.

Developing a Questionnaire to Evaluate College Students' Knowledge, Attitude, Behavior, Self-efficacy, and Environmental Factors Related to Canned Foods.

PubMed

Richards, Rickelle; Brown, Lora Beth; Williams, D Pauline; Eggett, Dennis L

2017-02-01

Develop a questionnaire to measure students' knowledge, attitude, behavior, self-efficacy, and environmental factors related to the use of canned foods. The Knowledge-Attitude-Behavior Model, Social Cognitive Theory, and Canned Foods Alliance survey were used as frameworks for questionnaire development. Cognitive interviews were conducted with college students (n = 8). Nutrition and survey experts assessed content validity. Reliability was measured via Cronbach α and 2 rounds (1, n = 81; 2, n = 65) of test-retest statistics. Means and frequencies were used. The 65-item questionnaire had a test-retest reliability of .69. Cronbach α scores were .87 for knowledge (9 items), .86 for attitude (30 items), .80 for self-efficacy (12 items), .68 for canned foods use (8 items), and .30 for environment (6 items). A reliable questionnaire was developed to measure perceptions and use of canned foods. Nutrition educators may find this questionnaire useful to evaluate pretest-posttest changes from canned foods-based interventions among college students. Copyright © 2016 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Hip Preservation Surgery Expectations Survey: A New Method to Measure Patients' Preoperative Expectations.

PubMed

Mancuso, Carol A; Wentzel, Catherine H; Ghomrawi, Hassan M K; Kelly, Bryan T

2017-05-01

To develop a patient-derived expectations survey for hip preservation surgery. Patients were eligible if they were undergoing primary hip surgery and were recruited in person or by telephone. The survey was developed in 3 phases. During phase 1, 64 patients were interviewed preoperatively and asked open-ended questions about their expectations of surgery; a draft survey was assembled by categorizing responses. During phase 2, the survey was administered twice to another group of 50 patients preoperatively to assess test-retest reliability and concordance was measured with weighted kappa values and intraclass correlations. All patients also completed valid standard hip surveys electronically. During phase 3, final items were selected, factor analysis was performed, and a scoring system was developed. In phase 1, 509 expectations were volunteered from which 21 distinct categories were discerned and became the items for the draft survey. In phase 2, the draft survey was completed twice, 4 days apart. In phase 3, all 21 items were retained for the final survey addressing pain, mobility, sports, resumption of active lifestyles, future function, and psychological well-being. An overall score is calculated from the number of items expected and the amount of improvement expected, and ranges from 0 to 100; higher is more expectations. For phase 2 patients, mean scores for both administrations were 82, Cronbach alpha coefficients were 0.88 and 0.91, and the intraclass correlation was 0.92. A higher score (i.e., greater expectations) was associated with worse hip condition measured by standard hip surveys (P ≤ .05). We developed a patient-derived survey that is valid, reliable, and addresses a spectrum of expectations. The survey generates an overall score that is easy to calculate and interpret and offers a practical and comprehensive way to record patients' preoperative expectations. Level II, prognostic study, prospective sample. Copyright © 2016 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Developing an Experiential Definition of Recovery: Participatory Research with Recovering Substance Abusers from Multiple Pathways

PubMed Central

Borkman, Thomasina J.; Stunz, Aina; Kaskutas, Lee Ann

2016-01-01

Background The What is Recovery? (WIR) study identified specific elements of a recovery definition that people in substance abuse recovery from multiple pathways would endorse. Objectives To explain how participatory research contributed to the development of a comprehensive pool of items defining recovery; and to identify the commonality between the specific items endorsed by participants as defining recovery and the abstract components of recovery found in four important broad recovery definitions Methods A four-step, mixed-methods, iterative process was used to develop and pretest items (August 2010 to February 2012). Online survey recruitment (n=238) was done via email lists of individuals in recovery and electronic advertisements; 54 were selected for in-depth telephone interviews. Analyses using experientially-based and survey research criteria resulted in a revised item pool of 47 refined and specific items. The WIR items were matched with the components of four important definitions. Results Recovering participants (1) proposed and validated new items; (2) developed an alternative response category to the Likert; (3) suggested criteria for eliminating items irrelevant to recovery. The matching of WIR items with the components of important abstract definitions revealed extensive commonality. Conclusions, importance The WIR items define recovery as ways of being, as a growth and learning process involving internal values and self-awareness with moral dimensions. This is the first wide-scale research identifying specific items defining recovery, which can be used to guide service provision in Recovery-Oriented Systems of Care. PMID:27159851

Developing an Experiential Definition of Recovery: Participatory Research With Recovering Substance Abusers From Multiple Pathways.

PubMed

Borkman, Thomasina Jo; Stunz, Aina; Kaskutas, Lee Ann

2016-07-28

The What is Recovery? (WIR) study identified specific elements of a recovery definition that people in substance abuse recovery from multiple pathways would endorse. To explain how participatory research contributed to the development of a comprehensive pool of items defining recovery; and to identify the commonality between the specific items endorsed by participants as defining recovery and the abstract components of recovery found in four important broad recovery definitions. A four-step, mixed-methods, iterative process was used to develop and pretest items (August 2010 to February 2012). Online survey recruitment (n = 238) was done via email lists of individuals in recovery and electronic advertisements; 54 were selected for in-depth telephone interviews. Analyses using experientially-based and survey research criteria resulted in a revised item pool of 47 refined and specific items. The WIR items were matched with the components of four important definitions. Recovering participants (1) proposed and validated new items; (2) developed an alternative response category to the Likert; (3) suggested criteria for eliminating items irrelevant to recovery. The matching of WIR items with the components of important abstract definitions revealed extensive commonality. The WIR items define recovery as ways of being, as a growth and learning process involving internal values and self-awareness with moral dimensions. This is the first wide-scale research identifying specific items defining recovery, which can be used to guide service provision in Recovery-Oriented Systems of Care.

Developing and testing new smoking measures for the Health Plan Employer Data and Information Set.

PubMed

Pbert, Lori; Vuckovic, Nancy; Ockene, Judith K; Hollis, Jack F; Riedlinger, Karen

2003-04-01

To develop and test items for the Health Plan Employee Data and Information Set (HEDIS) that assess delivery of the full range of provider-delivered tobacco interventions. The authors identified potential items via literature review; items were reviewed by national experts. Face validity of candidate items was tested in focus groups. The final survey was sent to a random sample of 1711 adult primary care patients; the re-test survey was sent to self-identified smokers. The process identified reliable items to capture provider assessment of motivation and provision of assistance and follow-up. One can reliably assess patient self-report of provider delivery of the full range of brief tobacco interventions. Such assessment and feedback to health plans and providers may increase use of evidence-based brief interventions.

Attitudes to mesalamine questionnaire: a novel tool to predict mesalamine nonadherence in patients with IBD.

PubMed

Moss, Alan C; Lillis, Yvonne; Edwards George, Jessica B; Choudhry, Niteesh K; Berg, Anders H; Cheifetz, Adam S; Horowitz, Gary; Leffler, Dan A

2014-12-01

Poor adherence to mesalamine is common and driven by a combination of lifestyle and behavioral factors, as well as health beliefs. We sought to develop a valid tool to identify barriers to patient adherence and predict those at risk for future nonadherence. A 10-item survey was developed from patient-reported barriers to adherence. The survey was administered to 106 patients with ulcerative colitis who were prescribed mesalamine, and correlated with prospectively collected 12-month pharmacy refills (medication possession ratio (MPR)), urine levels of salicylates, and self-reported adherence (Morisky Medication Adherence Scale (MMAS)-8). From the initial 10-item survey, 8 items correlated highly with the MMAS-8 score at enrollment. Computer-generated randomization produced a derivation cohort of 60 subjects and a validation cohort of 46 subjects to assess the survey items in their ability to predict future adherence. Two items from the patient survey correlated with objective measures of long-term adherence: their belief in the importance of maintenance mesalamine even when in remission and their concerns about side effects. The additive score based on these two items correlated with 12-month MPR in both the derivation and validation cohorts (P<0.05). Scores on these two items were associated with a higher risk of being nonadherent over the subsequent 12 months (relative risk (RR) =2.2, 95% confidence interval=1.5-3.5, P=0.04). The area under the curve for the performance of this 2-item tool was greater than that of the 10-item MMAS-8 score for predicting MPR scores over 12 months (area under the curve 0.7 vs. 0.5). Patients' beliefs about the need for maintenance mesalamine and their concerns about side effects influence their adherence to mesalamine over time. These concerns could easily be raised in practice to identify patients at risk of nonadherence (Clinical Trial number NCT01349504).

Introducing the Postsecondary Instructional Practices Survey (PIPS): A Concise, Interdisciplinary, and Easy-to-Score Survey

PubMed Central

Walter, Emily M.; Henderson, Charles R.; Beach, Andrea L.; Williams, Cody T.

2016-01-01

Researchers, administrators, and policy makers need valid and reliable information about teaching practices. The Postsecondary Instructional Practices Survey (PIPS) is designed to measure the instructional practices of postsecondary instructors from any discipline. The PIPS has 24 instructional practice statements and nine demographic questions. Users calculate PIPS scores by an intuitive proportion-based scoring convention. Factor analyses from 72 departments at four institutions (N = 891) support a 2- or 5-factor solution for the PIPS; both models include all 24 instructional practice items and have good model fit statistics. Factors in the 2-factor model include (a) instructor-centered practices, nine items; and (b) student-centered practices, 13 items. Factors in the 5-factor model include (a) student–student interactions, six items; (b) content delivery, four items; (c) formative assessment, five items; (d) student-content engagement, five items; and (e) summative assessment, four items. In this article, we describe our development and validation processes, provide scoring conventions and outputs for results, and describe wider applications of the instrument. PMID:27810868

Environmental Knowledge and Beliefs among Grade 10 Students in Australia.

ERIC Educational Resources Information Center

Eyers, Vivian George

To develop environmental education in Australia, a survey of tenth-grade students was undertaken. Thirty knowledge items and ten belief items were constructed. A panel of environmentalists and educators identified best responses for the knowledge items, and a common reference point, preservation of homo sapiens, for the belief items, so a…

Guideline appraisal with AGREE II: online survey of the potential influence of AGREE II items on overall assessment of guideline quality and recommendation for use.

PubMed

Hoffmann-Eßer, Wiebke; Siering, Ulrich; Neugebauer, Edmund A M; Brockhaus, Anne Catharina; McGauran, Natalie; Eikermann, Michaela

2018-02-27

The AGREE II instrument is the most commonly used guideline appraisal tool. It includes 23 appraisal criteria (items) organized within six domains. AGREE II also includes two overall assessments (overall guideline quality, recommendation for use). Our aim was to investigate how strongly the 23 AGREE II items influence the two overall assessments. An online survey of authors of publications on guideline appraisals with AGREE II and guideline users from a German scientific network was conducted between 10th February 2015 and 30th March 2015. Participants were asked to rate the influence of the AGREE II items on a Likert scale (0 = no influence to 5 = very strong influence). The frequencies of responses and their dispersion were presented descriptively. Fifty-eight of the 376 persons contacted (15.4%) participated in the survey and the data of the 51 respondents with prior knowledge of AGREE II were analysed. Items 7-12 of Domain 3 (rigour of development) and both items of Domain 6 (editorial independence) had the strongest influence on the two overall assessments. In addition, Items 15-17 (clarity of presentation) had a strong influence on the recommendation for use. Great variations were shown for the other items. The main limitation of the survey is the low response rate. In guideline appraisals using AGREE II, items representing rigour of guideline development and editorial independence seem to have the strongest influence on the two overall assessments. In order to ensure a transparent approach to reaching the overall assessments, we suggest the inclusion of a recommendation in the AGREE II user manual on how to consider item and domain scores. For instance, the manual could include an a-priori weighting of those items and domains that should have the strongest influence on the two overall assessments. The relevance of these assessments within AGREE II could thereby be further specified.

Study deviance-type scale in the development of Korean elder.

PubMed

Cho, Gun-Sang; Yi, Eun-Surk; Hwang, Hee-Jeong

2015-12-01

This research aims to develop a questionnaire of deviant behavior for the Korean elderly people which may make a big contribution to the examination of deviance behavior of the elderly people and may play an important role in providing a methodological basis. In order to accomplish the purpose of the this study, there were three different stages; (a) making preliminary question items, (b) refining the items of the scale through a plot study, and (c) finalizing question items by a main survey. In the first stage, 43 question items were developed using the open-ended questionnaire and structural inquiry of succession from 137 elderly people who are over 65 yr. In the second phase, based on data collected by the 200 elderly people pilot testing was performed through exploratory factor analysis and reliability test. The scale is a 27-item self-report questionnaire. In the main survey conducted by 184 elderly people, 21 items, which consisted of four subfactors, were finalized in order to measure deviance behaviors of the Korean elderly people: social deviance (n=8), economic deviance (n=5), psychological deviance (n=5), and physical deviance (n=3).

A Delphi survey to determine how educational interventions for evidence-based practice should be reported: Stage 2 of the development of a reporting guideline

PubMed Central

2014-01-01

Background Undertaking a Delphi exercise is recommended during the second stage in the development process for a reporting guideline. To continue the development for the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) a Delphi survey was undertaken to determine the consensus opinion of researchers, journal editors and educators in evidence-based practice (EBP) regarding the information items that should be reported when describing an educational intervention for EBP. Methods A four round online Delphi survey was conducted from October 2012 to March 2013. The Delphi panel comprised international researchers, educators and journal editors in EBP. Commencing with an open-ended question, participants were invited to volunteer information considered important when reporting educational interventions for EBP. Over three subsequent rounds participants were invited to rate the importance of each of the Delphi items using an 11 point Likert rating scale (low 0 to 4, moderate 5 to 6, high 7 to 8 and very high >8). Consensus agreement was set a priori as at least 80 per cent participant agreement. Consensus agreement was initially calculated within the four categories of importance (low to very high), prior to these four categories being merged into two (<7 and ≥7). Descriptive statistics for each item were computed including the mean Likert scores, standard deviation (SD), range and median participant scores. Mean absolute deviation from the median (MAD-M) was also calculated as a measure of participant disagreement. Results Thirty-six experts agreed to participate and 27 (79%) participants completed all four rounds. A total of 76 information items were generated across the four survey rounds. Thirty-nine items (51%) were specific to describing the intervention (as opposed to other elements of study design) and consensus agreement was achieved for two of these items (5%). When the four rating categories were merged into two (<7 and ≥7), 18 intervention items achieved consensus agreement. Conclusion This Delphi survey has identified 39 items for describing an educational intervention for EBP. These Delphi intervention items will provide the groundwork for the subsequent consensus discussion to determine the final inclusion of items in the GREET, the first reporting guideline for educational interventions in EBP. PMID:25081371

Comparison of Self-Reported Telephone Interviewing and Web-Based Survey Responses: Findings From the Second Australian Young and Well National Survey

PubMed Central

Davenport, Tracey A; Burns, Jane M; Hickie, Ian B

2017-01-01

Background Web-based self-report surveying has increased in popularity, as it can rapidly yield large samples at a low cost. Despite this increase in popularity, in the area of youth mental health, there is a distinct lack of research comparing the results of Web-based self-report surveys with the more traditional and widely accepted computer-assisted telephone interviewing (CATI). Objective The Second Australian Young and Well National Survey 2014 sought to compare differences in respondent response patterns using matched items on CATI versus a Web-based self-report survey. The aim of this study was to examine whether responses varied as a result of item sensitivity, that is, the item’s susceptibility to exaggeration on underreporting and to assess whether certain subgroups demonstrated this effect to a greater extent. Methods A subsample of young people aged 16 to 25 years (N=101), recruited through the Second Australian Young and Well National Survey 2014, completed the identical items on two occasions: via CATI and via Web-based self-report survey. Respondents also rated perceived item sensitivity. Results When comparing CATI with the Web-based self-report survey, a Wilcoxon signed-rank analysis showed that respondents answered 14 of the 42 matched items in a significantly different way. Significant variation in responses (CATI vs Web-based) was more frequent if the item was also rated by the respondents as highly sensitive in nature. Specifically, 63% (5/8) of the high sensitivity items, 43% (3/7) of the neutral sensitivity items, and 0% (0/4) of the low sensitivity items were answered in a significantly different manner by respondents when comparing their matched CATI and Web-based question responses. The items that were perceived as highly sensitive by respondents and demonstrated response variability included the following: sexting activities, body image concerns, experience of diagnosis, and suicidal ideation. For high sensitivity items, a regression analysis showed respondents who were male (beta=−.19, P=.048) or who were not in employment, education, or training (NEET; beta=−.32, P=.001) were significantly more likely to provide different responses on matched items when responding in the CATI as compared with the Web-based self-report survey. The Web-based self-report survey, however, demonstrated some evidence of avidity and attrition bias. Conclusions Compared with CATI, Web-based self-report surveys are highly cost-effective and had higher rates of self-disclosure on sensitive items, particularly for respondents who identify as male and NEET. A drawback to Web-based surveying methodologies, however, includes the limited control over avidity bias and the greater incidence of attrition bias. These findings have important implications for further development of survey methods in the area of health and well-being, especially when considering research topics (in this case diagnosis, suicidal ideation, sexting, and body image) and groups that are being recruited (young people, males, and NEET). PMID:28951382

Identifying the contents of a type 1 diabetes outpatient care program based on the self-adjustment of insulin using the Delphi method.

PubMed

Kubota, Mutsuko; Shindo, Yukari; Kawaharada, Mariko

2014-10-01

The objective of this study is to identify the items necessary for an outpatient care program based on the self-adjustment of insulin for type 1 diabetes patients. Two surveys based on the Delphi method were conducted. The survey participants were 41 certified diabetes nurses in Japan. An outpatient care program based on the self-adjustment of insulin was developed based on pertinent published work and expert opinions. There were a total of 87 survey items in the questionnaire, which was developed based on the care program mentioned earlier, covering matters such as the establishment of prerequisites and a cooperative relationship, the basics of blood glucose pattern management, learning and practice sessions for the self-adjustment of insulin, the implementation of the self-adjustment of insulin, and feedback. The participants' approval on items in the questionnaires was defined at 70%. Participants agreed on all of the items in the first survey. Four new parameters were added to make a total of 91 items for the second survey and participants agreed on the inclusion of 84 of them. Items necessary for a type 1 diabetes outpatient care program based on self-adjustment of insulin were subsequently selected. It is believed that this care program received a fairly strong approval from certified diabetes nurses; however, it will be necessary to have the program further evaluated in conjunction with intervention studies in the future. © 2014 The Authors. Japan Journal of Nursing Science © 2014 Japan Academy of Nursing Science.

Marine Attitude Survey

ERIC Educational Resources Information Center

Hounshell, Paul B.; Hampton, Carolyn

This 22-item Marine Attitude Survey was developed for use in elementary/middle schools to measure students' attitudes about various aspects of marine science. Students are asked if they agree, are not sure, or disagree with such items as: (1) the seashore is a fun place to visit; (2) if all sharks were killed, the world would be a better place;…

Psychometric Support for an Abbreviated Version of the California School Climate and Safety Survey

ERIC Educational Resources Information Center

Rebelez, Jennica L.; Furlong, Michael J.

2013-01-01

The California School Climate and Safety Survey-Short Form (CSCSS-SF) was developed as a streamlined version (54 items) of the original CSCSS (102 items) for school safety teams to gather information regarding student perceptions of campus climate, safety, and experience of victimization. Using a longitudinal dataset, this study implemented…

Development of a survey instrument to measure connectivity to evaluate national public health preparedness and response performance.

PubMed

Dorn, Barry C; Savoia, Elena; Testa, Marcia A; Stoto, Michael A; Marcus, Leonard J

2007-01-01

Survey instruments for evaluating public health preparedness have focused on measuring the structure and capacity of local, state, and federal agencies, rather than linkages among structure, process, and outcomes. To focus evaluation on the latter, we evaluated the linkages among individuals, organizations, and systems using the construct of "connectivity" and developed a measurement instrument. Results from focus groups of emergency preparedness first responders generated 62 items used in the development sample of 187 respondents. Item reduction and factors analyses were conducted to confirm the scale's components. The 62 items were reduced to 28. Five scales explained 70% of the total variance (number of items, percent variance explained, Cronbach's alpha) including connectivity with the system (8, 45%, 0.94), coworkers (7, 7%, 0.91), organization (7, 12%, 0.93), and perceptions (6, 6%, 0.90). Discriminant validity was found to be consistent with the factor structure. We developed a Connectivity Measurement Tool for the public health workforce consisting of a 34-item questionnaire found to be a reliable measure of connectivity with preliminary evidence of construct validity.

An evaluation of computerized adaptive testing for general psychological distress: combining GHQ-12 and Affectometer-2 in an item bank for public mental health research.

PubMed

Stochl, Jan; Böhnke, Jan R; Pickett, Kate E; Croudace, Tim J

2016-05-20

Recent developments in psychometric modeling and technology allow pooling well-validated items from existing instruments into larger item banks and their deployment through methods of computerized adaptive testing (CAT). Use of item response theory-based bifactor methods and integrative data analysis overcomes barriers in cross-instrument comparison. This paper presents the joint calibration of an item bank for researchers keen to investigate population variations in general psychological distress (GPD). Multidimensional item response theory was used on existing health survey data from the Scottish Health Education Population Survey (n = 766) to calibrate an item bank consisting of pooled items from the short common mental disorder screen (GHQ-12) and the Affectometer-2 (a measure of "general happiness"). Computer simulation was used to evaluate usefulness and efficacy of its adaptive administration. A bifactor model capturing variation across a continuum of population distress (while controlling for artefacts due to item wording) was supported. The numbers of items for different required reliabilities in adaptive administration demonstrated promising efficacy of the proposed item bank. Psychometric modeling of the common dimension captured by more than one instrument offers the potential of adaptive testing for GPD using individually sequenced combinations of existing survey items. The potential for linking other item sets with alternative candidate measures of positive mental health is discussed since an optimal item bank may require even more items than these.

Comparison of Self-Reported Telephone Interviewing and Web-Based Survey Responses: Findings From the Second Australian Young and Well National Survey.

PubMed

Milton, Alyssa C; Ellis, Louise A; Davenport, Tracey A; Burns, Jane M; Hickie, Ian B

2017-09-26

Web-based self-report surveying has increased in popularity, as it can rapidly yield large samples at a low cost. Despite this increase in popularity, in the area of youth mental health, there is a distinct lack of research comparing the results of Web-based self-report surveys with the more traditional and widely accepted computer-assisted telephone interviewing (CATI). The Second Australian Young and Well National Survey 2014 sought to compare differences in respondent response patterns using matched items on CATI versus a Web-based self-report survey. The aim of this study was to examine whether responses varied as a result of item sensitivity, that is, the item's susceptibility to exaggeration on underreporting and to assess whether certain subgroups demonstrated this effect to a greater extent. A subsample of young people aged 16 to 25 years (N=101), recruited through the Second Australian Young and Well National Survey 2014, completed the identical items on two occasions: via CATI and via Web-based self-report survey. Respondents also rated perceived item sensitivity. When comparing CATI with the Web-based self-report survey, a Wilcoxon signed-rank analysis showed that respondents answered 14 of the 42 matched items in a significantly different way. Significant variation in responses (CATI vs Web-based) was more frequent if the item was also rated by the respondents as highly sensitive in nature. Specifically, 63% (5/8) of the high sensitivity items, 43% (3/7) of the neutral sensitivity items, and 0% (0/4) of the low sensitivity items were answered in a significantly different manner by respondents when comparing their matched CATI and Web-based question responses. The items that were perceived as highly sensitive by respondents and demonstrated response variability included the following: sexting activities, body image concerns, experience of diagnosis, and suicidal ideation. For high sensitivity items, a regression analysis showed respondents who were male (beta=-.19, P=.048) or who were not in employment, education, or training (NEET; beta=-.32, P=.001) were significantly more likely to provide different responses on matched items when responding in the CATI as compared with the Web-based self-report survey. The Web-based self-report survey, however, demonstrated some evidence of avidity and attrition bias. Compared with CATI, Web-based self-report surveys are highly cost-effective and had higher rates of self-disclosure on sensitive items, particularly for respondents who identify as male and NEET. A drawback to Web-based surveying methodologies, however, includes the limited control over avidity bias and the greater incidence of attrition bias. These findings have important implications for further development of survey methods in the area of health and well-being, especially when considering research topics (in this case diagnosis, suicidal ideation, sexting, and body image) and groups that are being recruited (young people, males, and NEET). ©Alyssa C Milton, Louise A Ellis, Tracey A Davenport, Jane M Burns, Ian B Hickie. Originally published in JMIR Mental Health (http://mental.jmir.org), 26.09.2017.

Development of a frequent heartburn index.

PubMed

Stull, Donald E; van Hanswijck de Jonge, Patricia; Houghton, Katherine; Kocun, Christopher; Sandor, David W

2011-09-01

The aim of this study is to develop and validate a brief instrument for the measurement of overall psychosocial impact of frequent heartburn (heartburn experienced 2+ times weekly) in the general U.S. population, yielding a single, composite score. Item reduction and psychometric analyses of an existing Frequent Heartburn (FHB) Survey, a 52-item, 13-domain, patient-reported outcomes (PRO) survey assessing the impact of frequent heartburn on psychosocial quality of life. Item reduction resulted in 9 items from the original FHB Survey measuring all domains. All retained items in this full Frequent Heartburn Index (FHBI-Full) had moderate to strong factor loadings on the underlying factor (range: 0.66-0.85) and acceptable overall model fit (CFI = 0.93, SRMR = 0.04). Coefficient alpha was 0.92. A shorter FHBI (FHBI-Brief) was created that excludes the two employment-related items. The FHBI-Brief had a coefficient alpha of 0.90. Both FHBI versions have good psychometric properties and capture a full range of psychosocial effects of frequent heartburn. Normed national scores for the FHBI are available against which an individual can compare their own FHBI score. The FHBI-Full and FHBI-Brief show promise as PRO instruments that may help individuals and clinicians better understand the effect of frequent heartburn on psychosocial functioning.

Communicating Ocean & Climate Science: Promoting Knowledge, Responsible Decision-making and Interest in Geoscience Careers

NASA Astrophysics Data System (ADS)

Bruno, B. C.; Hsia, M.; Wiener, C.

2012-12-01

Climate change is not just an atmospheric phenomenon. It has serious impacts on the ocean, such as sea level rise, ocean acidification, and coral bleaching. Ocean FEST (Families Exploring Science Together) aims to educate participants about how increasing carbon dioxide is affecting our oceans, and to inspire students to pursue ocean, earth and environmental science careers. Throughout the program, participants examine their everyday decisions and the impact of their choices on the planet's climate and oceans. Ocean FEST is a two-hour program that explores the ocean and relevant environmental topics through six hands-on science activities. Activities are designed so students can see how globally important issues (e.g., climate change and ocean acidification) have local effects (e.g., sea level rise, coastal erosion, coral bleaching). The program ends with a career component, drawing parallels between the program activities and the activities done by "real scientists" in their jobs. Over the past three years, we have conducted over 60 Ocean FEST events. Evaluations are conducted at selected events using electronic surveys, which students and parents complete immediately prior to (pre-survey) and following (post-survey) the program. Survey items were developed and cognitively tested in collaboration with professional evaluators from the American Institute of Research. The nine-item survey includes items on science content knowledge, personal responsibility, and career interest. For each survey item, participants are asked to indicate agreement (coded as 2.0), disagreement (1.0) or don't know (1.5). By comparing the pre- and post-survey results, we can evaluate program efficacy. For example, one survey item is: "I can do something every day to help fight global climate change." Student mean data moved from 1.78 pre-survey to 1.89 post-survey, which is a statistically significant gain at p<.000. Mean parent data for this same item moved from 1.90 pre-survey to 1.96 post-survey, which is again a statistically significant gain at p<.000. In summary, we have found positive statistically significant gains on all survey items for students, and on all but one survey item for parents. These results strongly indicate program efficacy. For more information, please visit our web site: oceanfest.soest.hawaii.edu

A Survey to Evaluate Facilitators and Barriers to Quality Measurement and Improvement: Adapting Tools for Implementation Research in Palliative Care Programs.

PubMed

Dy, Sydney M; Al Hamayel, Nebras Abu; Hannum, Susan M; Sharma, Ritu; Isenberg, Sarina R; Kuchinad, Kamini; Zhu, Junya; Smith, Katherine; Lorenz, Karl A; Kamal, Arif H; Walling, Anne M; Weaver, Sallie J

2017-12-01

Although critical for improving patient outcomes, palliative care quality indicators are not yet widely used. Better understanding of facilitators and barriers to palliative care quality measurement and improvement might improve their use and program quality. Development of a survey tool to assess palliative care team perspectives on facilitators and barriers to quality measurement and improvement in palliative care programs. We used the adapted Consolidated Framework for Implementation Research to define domains and constructs to select instruments. We assembled a draft survey and assessed content validity through pilot testing and cognitive interviews with experts and frontline practitioners for key items. We analyzed responses using a constant comparative process to assess survey item issues and potential solutions. We developed a final survey using these results. The survey includes five published instruments and two additional item sets. Domains include organizational characteristics, individual and team characteristics, intervention characteristics, and process of implementation. Survey modules include Quality Improvement in Palliative Care, Implementing Quality Improvement in the Palliative Care Program, Teamwork and Communication, Measuring the Quality of Palliative Care, and Palliative Care Quality in Your Program. Key refinements from cognitive interviews included item wording on palliative care team members, programs, and quality issues. This novel, adaptable instrument assesses palliative care team perspectives on barriers and facilitators for quality measurement and improvement in palliative care programs. Next steps include evaluation of the survey's construct validity and how survey results correlate with findings from program quality initiatives. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

Developing and investigating the use of single-item measures in organizational research.

PubMed

Fisher, Gwenith G; Matthews, Russell A; Gibbons, Alyssa Mitchell

2016-01-01

The validity of organizational research relies on strong research methods, which include effective measurement of psychological constructs. The general consensus is that multiple item measures have better psychometric properties than single-item measures. However, due to practical constraints (e.g., survey length, respondent burden) there are situations in which certain single items may be useful for capturing information about constructs that might otherwise go unmeasured. We evaluated 37 items, including 18 newly developed items as well as 19 single items selected from existing multiple-item scales based on psychometric characteristics, to assess 18 constructs frequently measured in organizational and occupational health psychology research. We examined evidence of reliability; convergent, discriminant, and content validity assessments; and test-retest reliabilities at 1- and 3-month time lags for single-item measures using a multistage and multisource validation strategy across 3 studies, including data from N = 17 occupational health subject matter experts and N = 1,634 survey respondents across 2 samples. Items selected from existing scales generally demonstrated better internal consistency reliability and convergent validity, whereas these particular new items generally had higher levels of content validity. We offer recommendations regarding when use of single items may be more or less appropriate, as well as 11 items that seem acceptable, 14 items with mixed results that might be used with caution due to mixed results, and 12 items we do not recommend using as single-item measures. Although multiple-item measures are preferable from a psychometric standpoint, in some circumstances single-item measures can provide useful information. (c) 2016 APA, all rights reserved).

The School Counselor Leadership Survey: Instrument Development and Exploratory Factor Analysis

ERIC Educational Resources Information Center

Young, Anita; Bryan, Julia

2015-01-01

This study examined the factor structure of the School Counselor Leadership Survey (SCLS). Survey development was a threefold process that resulted in a 39-item survey of 801 school counselors and school counselor supervisors. The exploratory factor analysis indicated a five-factor structure that revealed five key dimensions of school counselor…

Development and validation of a new survey: Perceptions of Teaching as a Profession (PTaP)

NASA Astrophysics Data System (ADS)

Adams, Wendy

2017-01-01

To better understand the impact of efforts to train more science teachers such as the PhysTEC Project and to help with early identification of future teachers, we are developing the survey of Perceptions of Teaching as a Profession (PTaP) to measure students' views of teaching as a career, their interest in teaching and the perceived climate of physics departments towards teaching as a profession. The instrument consists of a series of statements which require a response using a 5-point Likert-scale and can be easily administered online. The survey items were drafted by a team of researchers and physics teacher candidates and then reviewed by an advisory committee of 20 physics teacher educators and practicing teachers. We conducted 27 interviews with both teacher candidates and non-teaching STEM majors. The survey was refined through an iterative process of student interviews and item clarification until all items were interpreted consistently and answered for consistent reasons. In this presentation the preliminary results from the student interviews as well as the results of item analysis and a factor analysis on 900 student responses will be shared.

Assessing the prevalence of non-medical prescription opioid use in the Canadian general adult population: evidence of large variation depending on survey questions used

PubMed Central

2013-01-01

Background Morbidity and mortality related to Prescription Opioid Analgesics (POAs) have been rising sharply in North America. Non-Medical Prescription Opioid Use (NMPOU) in the general population is a key indicator of POA-related harm, yet the role of question item design for best NMPOU prevalence estimates in general population surveys is unclear, and existing NMPOU survey data for Canada are limited. Methods We tested the impact of different NMPOU question items by comparing an item in the 2008 and 2009 (N = 2,017) samples of the CAMH Monitor surveys – an Ontario adult general population survey – with a newly developed item used in the 2010 (N = 2,015) samples of the Centre for Addiction and Mental Health (CAMH) Monitor surveys. To control for a potential difference in the population demographics between surveys, we adjusted for gender, age, region, income, prescription opioid use, cigarette smoking, weekly binge drinking, cannabis use in the past three months, and psychological distress in our analyses. Results The prevalence of NMPOU as measured by the 2008 and 2009 CAMH monitor (2.0% [95% CI: 1.2% to 2.8%]) was significantly different when compared to the prevalence of NMPOU as measured by the 2010 CAMH monitor (7.7% [95% CI: 6.3% to 9.2%]) (p < 0.001). This difference was also found when stratifying our analysis by sex (p < 0.001) and when adjusting for all potential confounding covariates. Conclusion It is highly unlikely that the extensive NMPOU prevalence differences observed from the different survey items reflect an actual increase of NMPOU or changes in NMPOU determinants, but rather point to measurement effects. It appears that we currently do not have accurate estimates of NMPOU in the Canadian general population, even though these estimates are needed to guide and implement targeted interventions. Given the current substantial morbidity and mortality impact of NMPOU, there is an urgent need to systematically develop, validate and standardize NMPOU items for future general population surveys in Canada. PMID:23286378

Development and Preliminary Validation of Refugee Trauma History Checklist (RTHC)—A Brief Checklist for Survey Studies

PubMed Central

Gottvall, Maria; Vaez, Marjan

2017-01-01

A high proportion of refugees have been subjected to potentially traumatic experiences (PTEs), including torture. PTEs, and torture in particular, are powerful predictors of mental ill health. This paper reports the development and preliminary validation of a brief refugee trauma checklist applicable for survey studies. Methods: A pool of 232 items was generated based on pre-existing instruments. Conceptualization, item selection and item refinement was conducted based on existing literature and in collaboration with experts. Ten cognitive interviews using a Think Aloud Protocol (TAP) were performed in a clinical setting, and field testing of the proposed checklist was performed in a total sample of n = 137 asylum seekers from Syria. Results: The proposed refugee trauma history checklist (RTHC) consists of 2 × 8 items, concerning PTEs that occurred before and during the respondents’ flight, respectively. Results show low item non-response and adequate psychometric properties Conclusions: RTHC is a usable tool for providing self-report data on refugee trauma history surveys of community samples. The core set of included events can be augmented and slight modifications can be applied to RTHC for use also in other refugee populations and settings. PMID:28976937

Development and Preliminary Testing of the Food Choice Priorities Survey (FCPS): Assessing the Importance of Multiple Factors on College Students' Food Choices.

PubMed

Vilaro, Melissa J; Zhou, Wenjun; Colby, Sarah E; Byrd-Bredbenner, Carol; Riggsbee, Kristin; Olfert, Melissa D; Barnett, Tracey E; Mathews, Anne E

2017-12-01

Understanding factors that influence food choice may help improve diet quality. Factors that commonly affect adults' food choices have been described, but measures that identify and assess food choice factors specific to college students are lacking. This study developed and tested the Food Choice Priorities Survey (FCPS) among college students. Thirty-seven undergraduates participated in two focus groups ( n = 19; 11 in the male-only group, 8 in the female-only group) and interviews ( n = 18) regarding typical influences on food choice. Qualitative data informed the development of survey items with a 5-point Likert-type scale (1 = not important, 5 = extremely important). An expert panel rated FCPS items for clarity, relevance, representativeness, and coverage using a content validity form. To establish test-retest reliability, 109 first-year college students completed the 14-item FCPS at two time points, 0-48 days apart ( M = 13.99, SD = 7.44). Using Cohen's weighted κ for responses within 20 days, 11 items demonstrated moderate agreement and 3 items had substantial agreement. Factor analysis revealed a three-factor structure (9 items). The FCPS is designed for college students and provides a way to determine the factors of greatest importance regarding food choices among this population. From a public health perspective, practical applications include using the FCPS to tailor health communications and behavior change interventions to factors most salient for food choices of college students.

Emotional intelligence in medical laboratory science

NASA Astrophysics Data System (ADS)

Price, Travis

The purpose of this study was to explore the role of emotional intelligence (EI) in medical laboratory science, as perceived by laboratory administrators. To collect and evaluate these perceptions, a survey was developed and distributed to over 1,400 medical laboratory administrators throughout the U.S. during January and February of 2013. In addition to demographic-based questions, the survey contained a list of 16 items, three skills traditionally considered important for successful work in the medical laboratory as well as 13 EI-related items. Laboratory administrators were asked to rate each item for its importance for job performance, their satisfaction with the item's demonstration among currently working medical laboratory scientists (MLS) and the amount of responsibility college-based medical laboratory science programs should assume for the development of each skill or attribute. Participants were also asked about EI training in their laboratories and were given the opportunity to express any thoughts or opinions about EI as it related to medical laboratory science. This study revealed that each EI item, as well as each of the three other items, was considered to be very or extremely important for successful job performance. Administrators conveyed that they were satisfied overall, but indicated room for improvement in all areas, especially those related to EI. Those surveyed emphasized that medical laboratory science programs should continue to carry the bulk of the responsibility for the development of technical skills and theoretical knowledge and expressed support for increased attention to EI concepts at the individual, laboratory, and program levels.

Study deviance-type scale in the development of Korean elder

PubMed Central

Cho, Gun-Sang; Yi, Eun-Surk; Hwang, Hee-Jeong

2015-01-01

This research aims to develop a questionnaire of deviant behavior for the Korean elderly people which may make a big contribution to the examination of deviance behavior of the elderly people and may play an important role in providing a methodological basis. In order to accomplish the purpose of the this study, there were three different stages; (a) making preliminary question items, (b) refining the items of the scale through a plot study, and (c) finalizing question items by a main survey. In the first stage, 43 question items were developed using the open-ended questionnaire and structural inquiry of succession from 137 elderly people who are over 65 yr. In the second phase, based on data collected by the 200 elderly people pilot testing was performed through exploratory factor analysis and reliability test. The scale is a 27-item self-report questionnaire. In the main survey conducted by 184 elderly people, 21 items, which consisted of four subfactors, were finalized in order to measure deviance behaviors of the Korean elderly people: social deviance (n=8), economic deviance (n=5), psychological deviance (n=5), and physical deviance (n=3). PMID:26730382

Health Information National Trends Survey in American Sign Language (HINTS-ASL): Protocol for the Cultural Adaptation and Linguistic Validation of a National Survey.

PubMed

Kushalnagar, Poorna; Harris, Raychelle; Paludneviciene, Raylene; Hoglind, TraciAnn

2017-09-13

The Health Information National Trends Survey (HINTS) collects nationally representative data about the American's public use of health-related information. This survey is available in English and Spanish, but not in American Sign Language (ASL). Thus, the exclusion of ASL users from these national health information survey studies has led to a significant gap in knowledge of Internet usage for health information access in this underserved and understudied population. The objectives of this study are (1) to culturally adapt and linguistically translate the HINTS items to ASL (HINTS-ASL); and (2) to gather information about deaf people's health information seeking behaviors across technology-mediated platforms. We modified the standard procedures developed at the US National Center for Health Statistics Cognitive Survey Laboratory to culturally adapt and translate HINTS items to ASL. Cognitive interviews were conducted to assess clarity and delivery of these HINTS-ASL items. Final ASL video items were uploaded to a protected online survey website. The HINTS-ASL online survey has been administered to over 1350 deaf adults (ages 18 to 90 and up) who use ASL. Data collection is ongoing and includes deaf adult signers across the United States. Some items from HINTS item bank required cultural adaptation for use with deaf people who use accessible services or technology. A separate item bank for deaf-related experiences was created, reflecting deaf-specific technology such as sharing health-related ASL videos through social network sites and using video remote interpreting services in health settings. After data collection is complete, we will conduct a series of analyses on deaf people's health information seeking behaviors across technology-mediated platforms. HINTS-ASL is an accessible health information national trends survey, which includes a culturally appropriate set of items that are relevant to the experiences of deaf people who use ASL. The final HINTS-ASL product will be available for public use upon completion of this study. ©Poorna Kushalnagar. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 13.09.2017.

Variation in the Readability of Items Within Surveys

PubMed Central

Calderón, José L.; Morales, Leo S.; Liu, Honghu; Hays, Ron D.

2006-01-01

The objective of this study was to estimate the variation in the readability of survey items within 2 widely used health-related quality-of-life surveys: the National Eye Institute Visual Functioning Questionnaire–25 (VFQ-25) and the Short Form Health Survey, version 2 (SF-36v2). Flesch-Kincaid and Flesch Reading Ease formulas were used to estimate readability. Individual survey item scores and descriptive statistics for each survey were calculated. Variation of individual item scores from the mean survey score was graphically depicted for each survey. The mean reading grade level and reading ease estimates for the VFQ-25 and SF-36v2 were 7.8 (fairly easy) and 6.4 (easy), respectively. Both surveys had notable variation in item readability; individual item readability scores ranged from 3.7 to 12.0 (very easy to difficult) for the VFQ-25 and 2.2 to 12.0 (very easy to difficult) for the SF-36v2. Because survey respondents may not comprehend items with readability scores that exceed their reading ability, estimating the readability of each survey item is an important component of evaluating survey readability. Standards for measuring the readability of surveys are needed. PMID:16401705

Evaluating Changes in Climate Literacy among Middle and High School Students who Participate in Climate Change Education Modules

NASA Astrophysics Data System (ADS)

DeWaters, J.; Powers, S.; Dhaniyala, S.; Small, M.

2012-12-01

Middle school (MS) and high school (HS) teachers have developed and taught instructional modules that were created through their participation in Clarkson University's NASA-funded Project-Based Global Climate Change Education project. A quantitative survey was developed to help evaluate the project's impact on students' climate literacy, which includes content knowledge as well as affective and behavioral attributes. Content objectives were guided primarily by the 2009 document, Climate Literacy: The Essential Principles of Climate Sciences. The survey was developed according to established psychometric principles and methodologies in the sociological and educational sciences which involved developing and evaluating a pool of survey items, adapted primarily from existing climate surveys and questionnaires; preparing, administering, and evaluating two rounds of pilot tests; and preparing a final instrument with revisions informed by both pilot assessments. The resulting survey contains three separate subscales: cognitive, affective, and behavioral, with five self-efficacy items embedded within the affective subscale. Cognitive items use a multiple choice format with one correct response; non-cognitive items use a 5-point Likert-type scale with options generally ranging from "strongly agree" to "strongly disagree" (affective), or "almost always" to "hardly ever" (behavioral). Three versions of the survey were developed and administered using an on-line Zoomerang™ platform to college students/adults; HS students; and MS students, respectively. Instrument validity was supported by using items drawn from existing surveys, by reviewing/applying prior research in climate literacy, and through comparative age-group analysis. The internal consistency reliability of each subscale, as measured by Cronbach's alpha, ranges from 0.78-0.86 (cognitive), 0.87-0.89 (affective) and 0.84-0.85 (behavioral), all satisfying generally accepted criteria for internal reliability of educational surveys. MS and HS students completed the on-line survey prior to and at least 3 weeks following participation in one of the newly developed project-based climate change modules. Surveys were completed anonymously. In all, 9 HS and 3 MS teachers successfully completed the educational programming and assessment protocol in AY2012, yielding 200 HS and 227 MS matched pre/post climate literacy surveys. Both groups of students demonstrated significant gains in climate-related content knowledge (p<<0.001) and affect (p<0.01). MS students also experienced significant gains in their climate-related self-efficacy (p=0.03), with no significant change in self-efficacy for HS students and no change in either group on the behavioral subscale. Post-scores were remarkably similar for the two groups of students; reported as percent of maximum attainable score for HS/MS students: 59%/58%, knowledge; 65%/64%, affect; 71%/72%, self-efficacy, and 63%/62%, behavior. The presentation will include a description of the development and content of the climate literacy survey used in this research, as well the interpretation of specific pre/post changes in participating MS and HS students relative to the content of and approach used in the project-based modules.

Core Items for a Standardized Resource Use Measure: Expert Delphi Consensus Survey.

PubMed

Thorn, Joanna C; Brookes, Sara T; Ridyard, Colin; Riley, Ruth; Hughes, Dyfrig A; Wordsworth, Sarah; Noble, Sian M; Thornton, Gail; Hollingworth, William

2018-06-01

Resource use measurement by patient recall is characterized by inconsistent methods and a lack of validation. A validated standardized resource use measure could increase data quality, improve comparability between studies, and reduce research burden. To identify a minimum set of core resource use items that should be included in a standardized adult instrument for UK health economic evaluation from a provider perspective. Health economists with experience of UK-based economic evaluations were recruited to participate in an electronic Delphi survey. Respondents were asked to rate 60 resource use items (e.g., medication names) on a scale of 1 to 9 according to the importance of the item in a generic context. Items considered less important according to predefined consensus criteria were dropped and a second survey was developed. In the second round, respondents received the median score and their own score from round 1 for each item alongside summarized comments and were asked to rerate items. A final project team meeting was held to determine the recommended core set. Forty-five participants completed round 1. Twenty-six items were considered less important and were dropped, 34 items were retained for the second round, and no new items were added. Forty-two respondents (93.3%) completed round 2, and greater consensus was observed. After the final meeting, 10 core items were selected, with further items identified as suitable for "bolt-on" questionnaire modules. The consensus on 10 items considered important in a generic context suggests that a standardized instrument for core resource use items is feasible. Copyright © 2018. Published by Elsevier Inc.

Measuring Advance Care Planning: Optimizing the Advance Care Planning Engagement Survey.

PubMed

Sudore, Rebecca L; Heyland, Daren K; Barnes, Deborah E; Howard, Michelle; Fassbender, Konrad; Robinson, Carole A; Boscardin, John; You, John J

2017-04-01

A validated 82-item Advance Care Planning (ACP) Engagement Survey measures a broad range of behaviors. However, concise surveys are needed. The objective of this study was to validate shorter versions of the survey. The survey included 57 process (e.g., readiness) and 25 action items (e.g., discussions). For item reduction, we systematically eliminated questions based on face validity, item nonresponse, redundancy, ceiling effects, and factor analysis. We assessed internal consistency (Cronbach's alpha) and construct validity with cross-sectional correlations and the ability of the progressively shorter survey versions to detect change one week after exposure to an ACP intervention (Pearson correlation coefficients). Five hundred one participants (four Canadian and three US sites) were included in item reduction (mean age 69 years [±10], 41% nonwhite). Because of high correlations between readiness and action items, all action items were removed. Because of high correlations and ceiling effects, two process items were removed. Successive factor analysis then created 55-, 34-, 15-, nine-, and four-item versions; 664 participants (from three US ACP clinical trials) were included in validity analysis (age 65 years [±8], 72% nonwhite, 34% Spanish speaking). Cronbach's alphas were high for all versions (four items 0.84-55 items 0.97). Compared with the original survey, cross-sectional correlations were high (four items 0.85; 55 items 0.97) as were delta correlations (four items 0.68; 55 items 0.93). Shorter versions of the ACP Engagement Survey are valid, internally consistent, and able to detect change across a broad range of ACP behaviors for English and Spanish speakers. Shorter ACP surveys can efficiently measure broad ACP behaviors in research and clinical settings. Published by Elsevier Inc.

The Development and Validation of a Teacher Preparation Program: Follow-Up Survey

ERIC Educational Resources Information Center

Schulte, Laura E.

2008-01-01

Students in my applied advanced statistics course for educational administration doctoral students developed a follow-up survey for teacher preparation programs, using the following scale development processes: adopting a framework; developing items; providing evidence of content validity; conducting a pilot test; and analyzing data. The students…

Design and development of a meal system for the elderly. [public health - nutrition/diet

NASA Technical Reports Server (NTRS)

1975-01-01

Food preference surveys (taste tests) were performed for 95 food items (which were selected from an original list of 150 items), and 21 menus were developed from the survey results. Each menu contains an entree, two side dishes, dessert, and a beverage. Food manufacturing specifications for freeze dried foods, frozen foods, and beverages are examined, and product labeling and packaging requirements are discussed. The nutritional value of the various foods is listed in tabular form, and sample product labels are shown. Cost estimates per serving are also included.

Development of an instrument to measure the use of behaviors taught in the American Physical Therapy Association Clinical Instructor Education and Credentialing Program (APTA CIECP): a pilot study.

PubMed

Bridges, Patricia H; Carter, Vincent; Rehm, Stephanie; Tintl, Sara Bowers; Halperin, Rebecca; Kniesly, Elizabeth; Pelino, Soni

2013-01-01

Conduct a pilot study to establish the reliability and validity of a survey instrument that directly measures the objectives and content of the APTA CIECP; and measure the self-reported frequency of use of the behaviors taught in the APTA CIECP. Eighteen (18) APTA credentialed CIs. Develop a web-based survey consisting of 58 items representative of the behaviors taught in the APTA CIECP and 8 demographic characteristics. Establish the content validity and reliability of the survey instrument. Conduct a descriptive analysis of the frequency of self-reported use of the behaviors. The APTA Clinical Instructor Education Board (CIEB) reviewed the items and determined that the items matched the objectives and content of the APTA CIECP, thereby establishing content validity. Cronbach's alpha coefficients ranging from 0.79-0.90 confirmed the reliability. The overall mean for all items on a 1-6 scale was 4.81. The content validity and reliability of the survey instrument were established. The outcomes of this pilot study suggest that when measured by a valid and reliable instrument that is representative of the objectives and content of the CIECP, the behaviors taught in the CIECP are being applied in the clinical setting by APTA credentialed clinical instructors.

Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education.

PubMed

Aldekhayel, Salah A; Alselaim, Nahar A; Magzoub, Mohi Eldin; Al-Qattan, Mohammad M; Al-Namlah, Abdullah M; Tamim, Hani; Al-Khayal, Abdullah; Al-Habdan, Sultan I; Zamakhshary, Mohammed F

2012-10-24

Script Concordance Test (SCT) is a new assessment tool that reliably assesses clinical reasoning skills. Previous descriptions of developing SCT-question banks were merely subjective. This study addresses two gaps in the literature: 1) conducting the first phase of a multistep validation process of SCT in Plastic Surgery, and 2) providing an objective methodology to construct a question bank based on SCT. After developing a test blueprint, 52 test items were written. Five validation questions were developed and a validation survey was established online. Seven reviewers were asked to answer this survey. They were recruited from two countries, Saudi Arabia and Canada, to improve the test's external validity. Their ratings were transformed into percentages. Analysis was performed to compare reviewers' ratings by looking at correlations, ranges, means, medians, and overall scores. Scores of reviewers' ratings were between 76% and 95% (mean 86% ± 5). We found poor correlations between reviewers (Pearson's: +0.38 to -0.22). Ratings of individual validation questions ranged between 0 and 4 (on a scale 1-5). Means and medians of these ranges were computed for each test item (mean: 0.8 to 2.4; median: 1 to 3). A subset of test items comprising 27 items was generated based on a set of inclusion and exclusion criteria. This study proposes an objective methodology for validation of SCT-question bank. Analysis of validation survey is done from all angles, i.e., reviewers, validation questions, and test items. Finally, a subset of test items is generated based on a set of criteria.

Guide to an Assessment of Consumer Skills.

ERIC Educational Resources Information Center

Education Commission of the States, Denver, CO.

This guide is intended to assist those interested in developing and/or assessing consumer skills. It is an accompanyment to a separate collection of survey items (mostly in a multiple choice format) designed to assess seventeen-year-olds' consumer skills. It is suggested that the items can be used as part of an item pool, as an instructional tool,…

The Psychometric Properties and the Development of the Indicators of Quality Nursing Work Environments in Taiwan.

PubMed

Lin, Chiou-Fen; Lu, Meei-Shiow; Huang, Hsiu-Ying

2016-03-01

The nursing shortage in medical institutions in Taiwan averaged 9% in 2012, considerably higher than the 5% indicated in the literature. As a result, many hospitals have been forced to close wards or reduce beds. Despite the acute need, the percentage of registered nurses who are employed as nurses in Taiwan (60.4%) is considerably lower than those in Canada or the United States. This low rate may be because of the poor working environment for nurses in Taiwan. This study aimed to develop a set of nursing work environment quality indicators for Taiwan and to test the reliability and validity of the resulting survey tool. Multiple methods were used in this study. In Phase 1, we organized an expert panel, reviewed the literature, and conducted seven rounds of expert panel discussion and six focus group discussions with nursing directors. The goal was to draft indicators representing a quality nursing work environment to fit current conditions in Taiwan. In Phase 2, we conducted an expert review for content validity, held three public hearings, and conducted a survey. Four hundred twenty-seven questionnaires were sent out, with 381 returned. The goal was to test the content validity, construct validity, and internal consistency reliability. The study produced a set of indicators of a quality nursing work environment with eight dimensions and 65 items. The content validity index for importance and suitability dimensions were 1.0, whereas the internal consistency was 0.91. The eight dimensions were safe practice environment (16 items), quality and quantity of staff (four items), salary and welfare (seven items), professional specialization and teamwork (seven items), work simplification (five items), informatics (five items), career development (nine items), and support and caring (12 items). The overall load for the indicators was 77.57%. The developed indicators may be used to evaluate the quality of nursing work environments. Furthermore, the indicators may be used in hospital surveys to establish baseline conditions and for outcome research that measures improvement in nursing work environments after interventions.

Using Delphi methodology in the development of a new patient-reported outcome measure for stroke survivors with visual impairment.

PubMed

Hepworth, Lauren R; Rowe, Fiona J

2018-02-01

The aim of this study was to ascertain what items stroke survivors and stroke care professionals think are important when assessing quality of life for stroke survivors with visual impairment for inclusion in the new patient-reported outcome measure. A reactive Delphi process was used in a three-round electronic-based survey. The items presented consisted of 62 items originally sourced from a systematic review of existing vision-related quality of life instruments and stroke survivor interviews, reduced and refined following a ranking exercise and pilot with stroke survivors with visual impairment. Stakeholders (stroke survivors/clinicians) were invited to take part in the process. A consensus definition of ≥70% was decided a priori. Participants were asked to rank importance on a 9-point scale and categorize the items by relevance to types of visual impairment following stroke or not relevant. Analysis of consensus, stability, and agreement was conducted. In total, 113 participants registered for the Delphi survey of which 47 (41.6%) completed all three rounds. Response rates to the three rounds were 78/113 (69.0%), 61/76 (81.3%), and 49/64 (76.6%), respectively. The participants included orthoptists (45.4%), occupational therapists (44.3%), and stroke survivors (10.3%). Consensus was reached on 56.5% of items in the three-round process, all for inclusion. A consensus was reached for 83.8% in the categorization of items. The majority (82.6%) of consensus were for relevant to 'all visual impairment following stroke'; two items were deemed 'not relevant'. The lack of item reduction achieved by this Delphi process highlights the need for additional methods of item reduction in the development of a new PROM for visual impairment following stroke. These results will be considered alongside Rasch analysis to achieve further item reduction. However, the Delphi survey remains important as it provides clinical and patient insight into each item rather than purely relying on the psychometric data.

Risk Engagement and Protection Survey (REPS): developing and validating a survey tool on fathers' attitudes towards child injury protection and risk engagement.

PubMed

Olsen, Lise L; Ishikawa, Takuro; Mâsse, Louise C; Chan, Grace; Brussoni, Mariana

2018-04-01

Fathers play a unique role in keeping children safe from injury yet understanding of their views and attitudes towards protecting children from injury and allowing them to engage in risks is limited. The purpose of this study was to develop and validate an instrument to measure fathers' attitudes towards these two constructs. An instrument was developed that used prior qualitative research to inform item generation. The questions were assessed for content validity with experts, then pilot-tested with fathers. The survey was completed by 302 fathers attending hospital with their child for an injury or non-injury reason. Results of confirmatory factor analysis identified eight items relating to the protection from injury factor and six items relating to the risk engagement factor. Correlation between the two factors was low, suggesting these are two independent constructs. The Risk Engagement and Protection Survey offers a tool for measuring attitudes and assisting with intervention strategy development in ways that reflect fathers' views and promotes a balanced view of children's needs for safety with their needs for engaging in active, healthy risk-taking. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20).

PubMed

Jo, Min-Woo; Lee, Hyeon-Jeong; Kim, Soo Young; Kim, Seon-Ha; Chang, Hyejung; Ahn, Jeonghoon; Ock, Minsu

2017-01-01

Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability.

Development of a Research Participants’ Perception Survey to Improve Clinical Research

PubMed Central

Yessis, Jennifer L.; Kost, Rhonda G.; Lee, Laura M.; Coller, Barry S.; Henderson, David K.

2012-01-01

Abstract Introduction: Clinical research participants’ perceptions regarding their experiences during research protocols provide outcome‐based insights into the effectiveness of efforts to protect rights and safety, and opportunities to enhance participants’ clinical research experiences. Use of validated surveys measuring patient‐centered outcomes is standard in hospitals, yet no instruments exist to assess outcomes of clinical research processes. Methods: We derived survey questions from data obtained from focus groups comprised of research participants and professionals. We assessed the survey for face/content validity, and privacy/confidentiality protections and fielded it to research participants at 15 centers. We conducted analyses of response rates, sample characteristics, and psychometrics, including survey and item completion and analysis, internal consistency, item internal consistency, criterion‐related validity, and item usefulness. Responses were tested for fit into existing patient‐centered dimensions of care and new clinical research dimensions using Cronbach's alpha coefficient. Results: Surveys were mailed to 18,890 individuals; 4,961 were returned (29%). Survey completion was 89% overall; completion rates exceeded 90% for 88 of 93 evaluable items. Questions fit into three dimensions of patient‐centered care and two novel clinical research dimensions (Cronbach's alpha for dimensions: 0.69–0.85). Conclusions: The validated survey offers a new method for assessing and improving outcomes of clinical research processes. Clin Trans Sci 2012; Volume 5: 452–460 PMID:23253666

Developing and testing a web-based survey to assess educational needs of palliative and end-of-life health care professionals in Connecticut.

PubMed

Schulman-Green, Dena; Ercolano, Elizabeth; Lacoursiere, Sheryl; Ma, Tony; Lazenby, Mark; McCorkle, Ruth

2011-06-01

Institute of Medicine reports have identified gaps in health care professionals' knowledge of palliative and end-of-life care, recommending improved education. Our purpose was to develop and administer a Web-based survey to identify the educational needs of multidisciplinary health care professionals who provide this care in Connecticut to inform educational initiatives. We developed an 80-item survey and recruited participants through the Internet and in person. Descriptive and correlational statistics were calculated on 602 surveys. Disciplines reported greater agreement on items related to their routine tasks. Reported needs included dealing with cultural and spiritual matters and having supportive resources at work. Focus groups confirmed results that are consistent with National Consensus Project guidelines for quality palliative care and indicate the End-of-Life Nursing Education Consortium modules for education.

Inconsistent survey reporting in anesthesia journals.

PubMed

Story, David A; Gin, Veronica; na Ranong, Vanida; Poustie, Stephanie; Jones, Daryl

2011-09-01

As with other types of research, there are concerns about reporting of survey research in anesthesia journals. We hypothesized that use of survey reporting items would be inconsistent in survey research reported in anesthesia journals. After a literature review we constructed a 17-item reporting list for a limited systematic review of survey reporting in 6 anesthesia journals. We identified survey reports by MEDLINE (PubMed) search for January 2000 to April 2009. The initial search identified 347 publications. Of these, we excluded 107 because they were not questionnaire surveys (often audits), were reviews, or were letters. We therefore identified 240 surveys published as full survey reports. From the 17-item reporting list, the median number of items recorded was 9 (interquartile range: 7 to 10; range 2 to 15). The number (and percentage) of surveys reporting specific items ranged widely for different items: from 9 surveys (4%; 95% confidence interval [CI]: 2% to 7%) for sample size to 240 surveys (100%; 95% CI: 98% to 100%) for response rate. In addition to sample size, the 5 least frequently reported items included the following: reporting confidence intervals, 21 surveys (9%; 95% CI: 6% to 13%); stating a hypothesis, 23 of 240 surveys (10%; 95% CI: 7% to 14%); accounting for nonresponders, 61 surveys (25%; 95% CI: 20% to 31%); and survey design, 67 surveys (28%; 95% CI: 33% to 34%). Inconsistent reporting may compromise the transparency and reproducibility of survey reports.

Why we eat what we eat. The Eating Motivation Survey (TEMS).

PubMed

Renner, Britta; Sproesser, Gudrun; Strohbach, Stefanie; Schupp, Harald T

2012-08-01

Understanding why people select certain food items in everyday life is crucial for the creation of interventions to promote normal eating and to prevent the development of obesity and eating disorders. The Eating Motivation Survey (TEMS) was developed within a frame of three different studies. In Study 1, a total of 331 motives for eating behavior were generated on the basis of different data sources (previous research, nutritionist interviews, and expert discussions). In Study 2, 1250 respondents were provided with a set of motives from Study 1 and the Eating Motivation Survey was finalized. In Study 3, a sample of 1040 participants filled in the Eating Motivation Survey. Confirmatory factor analysis with fifteen factors for food choice yielded a satisfactory model fit for a full (78 items) and brief survey version (45 items) with RMSEA .048 and .037, 90% CI .047-.049 and .035-.039, respectively. Factor structure was generally invariant across random selected groups, gender, and BMI, which indicates a high stability for the Eating Motivation Survey. On the mean level, however, significant differences in motivation for food choice associated with gender, age, and BMI emerged. Implications of the fifteen distinct motivations to choose foods in everyday life are discussed. Copyright © 2012 Elsevier Ltd. All rights reserved.

Developing Teaching Strategies in the EHR Era: A Survey of GME Experts.

PubMed

Atwater, Amber R; Rudd, Mariah; Brown, Audrey; Wiener, John S; Benjamin, Robert; Lee, W Robert; Rosdahl, Jullia A

2016-10-01

There is limited information on the impact of widespread adoption of the electronic health record (EHR) on graduate medical education (GME). To identify areas of consensus by education experts, where the use of EHR impacts GME, with the goal of developing strategies and tools to enhance GME teaching and learning in the EHR environment. Information was solicited from experienced US physician educators who use EPIC EHR following 3 steps: 2 rounds of online surveys using the Delphi technique, followed by telephone interviews. The survey contained 3 stem questions and 52 items with Likert-scale responses. Consensus was defined by predetermined cutoffs. A second survey reassessed items for which consensus was not initially achieved. Common themes to improve GME in settings with an EHR were compiled from the telephone interviews. The panel included 19 physicians in 15 states in Round 1, 12 in Round 2, and 10 for the interviews. Ten items were found important for teaching and learning: balancing focus on EHR documentation with patient engagement achieved 100% consensus. Other items achieving consensus included adequate learning time, balancing EHR data with verbal history and physical examination, communicating clinical thought processes, hands-on EHR practice, minimizing data repetition, and development of shortcuts and templates. Teaching strategies incorporating both online software and face-to-face solutions were identified during the interviews. New strategies are needed for effective teaching and learning of residents and fellows, capitalizing on the potential of the EHR, while minimizing any unintended negative impact on medical education.

Development of a Comprehensive Assessment of Food Parenting Practices: The Home Self-Administered Tool for Environmental Assessment of Activity and Diet Family Food Practices Survey.

PubMed

Vaughn, Amber E; Dearth-Wesley, Tracy; Tabak, Rachel G; Bryant, Maria; Ward, Dianne S

2017-02-01

Parents' food parenting practices influence children's dietary intake and risk for obesity and chronic disease. Understanding the influence and interactions between parents' practices and children's behavior is limited by a lack of development and psychometric testing and/or limited scope of current measures. The Home Self-Administered Tool for Environmental Assessment of Activity and Diet (HomeSTEAD) was created to address this gap. This article describes development and psychometric testing of the HomeSTEAD family food practices survey. Between August 2010 and May 2011, a convenience sample of 129 parents of children aged 3 to 12 years were recruited from central North Carolina and completed the self-administered HomeSTEAD survey on three occasions during a 12- to 18-day window. Demographic characteristics and child diet were assessed at Time 1. Child height and weight were measured during the in-home observations (following Time 1 survey). Exploratory factor analysis with Time 1 data was used to identify potential scales. Scales with more than three items were examined for scale reduction. Following this, mean scores were calculated at each time point. Construct validity was assessed by examining Spearman rank correlations between mean scores (Time 1) and children's diet (fruits and vegetables, sugar-sweetened beverages, snacks, sweets) and body mass index (BMI) z scores. Repeated measures analysis of variance was used to examine differences in mean scores between time points, and single-measure intraclass correlations were calculated to examine test-retest reliability between time points. Exploratory factor analysis identified 24 factors and retained 124 items; however, scale reduction narrowed items to 86. The final instrument captures five coercive control practices (16 items), seven autonomy support practices (24 items), and 12 structure practices (46 items). All scales demonstrated good internal reliability (α>.62), 18 factors demonstrated construct validity (significant association with child diet, P<0.05), and 22 demonstrated good reliability (intraclass correlation coefficient>0.61). The HomeSTEAD family food practices survey provides a brief, yet comprehensive and psychometrically sound assessment of food parenting practices. Copyright © 2017 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

The Children’s Behavior Questionnaire very short scale: Psychometric properties and development of a one-item temperament scale

USDA-ARS?s Scientific Manuscript database

Little research has been conducted on the psychometrics of the very short scale (36 items) of the Children’s Behavior Questionnaire, and no one-item temperament scale has been tested for use in applied work. In this study, 237 United States caregivers completed a survey to define their child’s behav...

Reliability and Validity of a Shorter Chinese Version for Ryff's Psychological Well-Being Scale

ERIC Educational Resources Information Center

Li, Ren-Hau

2014-01-01

Objective: The aim of this study was to develop a new and shorter Chinese version of Ryff's psychological well-being scale. Design: Cross-sectional survey. Setting: In recent years there have been several versions of this scale, including 84-item, 54-item and 18-item versions. Researchers in different countries have built on Ryff's version to…

Web-based computer adaptive assessment of individual perceptions of job satisfaction for hospital workplace employees

PubMed Central

2011-01-01

Background To develop a web-based computer adaptive testing (CAT) application for efficiently collecting data regarding workers' perceptions of job satisfaction, we examined whether a 37-item Job Content Questionnaire (JCQ-37) could evaluate the job satisfaction of individual employees as a single construct. Methods The JCQ-37 makes data collection via CAT on the internet easy, viable and fast. A Rasch rating scale model was applied to analyze data from 300 randomly selected hospital employees who participated in job-satisfaction surveys in 2008 and 2009 via non-adaptive and computer-adaptive testing, respectively. Results Of the 37 items on the questionnaire, 24 items fit the model fairly well. Person-separation reliability for the 2008 surveys was 0.88. Measures from both years and item-8 job satisfaction for groups were successfully evaluated through item-by-item analyses by using t-test. Workers aged 26 - 35 felt that job satisfaction was significantly worse in 2009 than in 2008. Conclusions A Web-CAT developed in the present paper was shown to be more efficient than traditional computer-based or pen-and-paper assessments at collecting data regarding workers' perceptions of job content. PMID:21496311

The Development of a Survey Instrument to Measure Transactional Distance in Secondary Blended Learning Environments

ERIC Educational Resources Information Center

Lane, Dennis Glenn

2017-01-01

The goal of this study was to develop a survey instrument to measure transactional distance in secondary blended learning environments. This study resulted in a 35-item survey instrument, the Blended Learning Assessment Scale of Transactional Distance (BLASTD), which was tested using a convenience sample of secondary students (n = 222) at a…

A Spanish-Language Risk Perception Survey for Developing Diabetes: Translation Process and Assessment of Psychometric Properties.

PubMed

Joiner, Kevin L; Sternberg, Rosa Maria; Kennedy, Christine; Chen, Jyu-Lin; Fukuoka, Yoshimi; Janson, Susan L

2016-12-01

Create a Spanish-language version of the Risk Perception Survey for Developing Diabetes (RPS-DD) and assess psychometric properties. The Spanish-language version was created through translation, harmonization, and presentation to the tool's original author. It was field tested in a foreignborn Latino sample and properties evaluated in principal components analysis. Personal Control, Optimistic Bias, and Worry multi-item Likert subscale responses did not cluster together. A clean solution was obtained after removing two Personal Control subscale items. Neither the Personal Disease Risk scale nor the Environmental Health Risk scale responses loaded onto single factors. Reliabilities ranged from .54 to .88. Test of knowledge performance varied by item. This study contributes to evidence of validation of a Spanish-language RPS-DD in foreign-born Latinos.

Introducing the Postsecondary Instructional Practices Survey (PIPS): A Concise, Interdisciplinary, and Easy-to-Score Survey.

PubMed

Walter, Emily M; Henderson, Charles R; Beach, Andrea L; Williams, Cody T

Researchers, administrators, and policy makers need valid and reliable information about teaching practices. The Postsecondary Instructional Practices Survey (PIPS) is designed to measure the instructional practices of postsecondary instructors from any discipline. The PIPS has 24 instructional practice statements and nine demographic questions. Users calculate PIPS scores by an intuitive proportion-based scoring convention. Factor analyses from 72 departments at four institutions (N = 891) support a 2- or 5-factor solution for the PIPS; both models include all 24 instructional practice items and have good model fit statistics. Factors in the 2-factor model include (a) instructor-centered practices, nine items; and (b) student-centered practices, 13 items. Factors in the 5-factor model include (a) student-student interactions, six items; (b) content delivery, four items; (c) formative assessment, five items; (d) student-content engagement, five items; and (e) summative assessment, four items. In this article, we describe our development and validation processes, provide scoring conventions and outputs for results, and describe wider applications of the instrument. © 2016 E. M. Walter et al. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Teaching Psychometrics in South Korea through a Reunification Attitude Scale Class Project.

ERIC Educational Resources Information Center

Webster, Sandra K.

The introduction of a team term project into a Korean psychometrics class is described. Students developed an item pool of attitude statements regarding the reunification of South Korea and North Korea. Then teams of students used the item pool to develop attitude questionnaires, survey other students, analyze the results, and recommend which…

Assessing the invariance of a culturally competent multi-lingual unmet needs survey for immigrant and Australian-born cancer patients: a Rasch analysis.

PubMed

McGrane, J A; Butow, P N; Sze, M; Eisenbruch, M; Goldstein, D; King, M T

2014-12-01

The purpose of this study was to assess the invariance of a culturally competent multi-lingual unmet needs survey. A cross-sectional study was conducted among immigrants of Arabic-, Chinese- and Greek-speaking backgrounds, and Anglo-Australian-born controls, recruited through Cancer Registries (n = 591) and oncology clinics (n = 900). The survey included four subscales, with newly developed items addressing unmet need in culturally competent health information and patient support (CCHIPS), and items adapted from existing questionnaires addressing physical and daily living (PDL), sexuality (SEX) and survivorship (SURV) unmet need. The survey was translated into Arabic, Chinese and Greek. Rasch analysis was carried out on the four domains. Whilst many items were mistargeted to less prevalent areas of unmet need, causing substantial floor effects in person estimates, reliability indices were acceptable. The CCHIPS domain showed differential item functioning (DIF) for cultural background and language, and the PDL domain showed DIF for treatment phase and gender. The results for SEX and SURV domains were limited by floor effects and missing responses. All domains showed adequate fit to the model after DIF was resolved and a small number of items were deleted. The study highlights the intricacies in designing a culturally competent survey that can be applied to culturally and linguistically diverse groups across different treatment contexts. Overall, the results demonstrate that this survey is somewhat invariant with respect to these factors. Future refinements are suggested to enhance the survey's cultural competence and general validity.

Harmonizing Measures of Cognitive Performance Across International Surveys of Aging Using Item Response Theory.

PubMed

Chan, Kitty S; Gross, Alden L; Pezzin, Liliana E; Brandt, Jason; Kasper, Judith D

2015-12-01

To harmonize measures of cognitive performance using item response theory (IRT) across two international aging studies. Data for persons ≥65 years from the Health and Retirement Study (HRS, N = 9,471) and the English Longitudinal Study of Aging (ELSA, N = 5,444). Cognitive performance measures varied (HRS fielded 25, ELSA 13); 9 were in common. Measurement precision was examined for IRT scores based on (a) common items, (b) common items adjusted for differential item functioning (DIF), and (c) DIF-adjusted all items. Three common items (day of date, immediate word recall, and delayed word recall) demonstrated DIF by survey. Adding survey-specific items improved precision but mainly for HRS respondents at lower cognitive levels. IRT offers a feasible strategy for harmonizing cognitive performance measures across other surveys and for other multi-item constructs of interest in studies of aging. Practical implications depend on sample distribution and the difficulty mix of in-common and survey-specific items. © The Author(s) 2015.

The Development of a Survey Instrument on South Dakota's School District Leadership Climate as Related to Deming's Fourteen Points.

ERIC Educational Resources Information Center

Holmes, Lawrence W. O.; And Others

Development of an instrument to measure baseline levels of applied Total Quality Management (TQM) practices in South Dakota before the introduction and dissemination of TQM theory to the state's educational leaders is described. Using the interpretation of Deming's 14 points that was developed by J. J. Bonstigl, a 115-item initial item pool was…

Planning and development of the Better Bites program: a pricing manipulation strategy to improve healthy eating in a hospital cafeteria.

PubMed

Liebert, Mina L; Patsch, Amy J; Smith, Jennifer Howard; Behrens, Timothy K; Charles, Tami; Bailey, Taryn R

2013-07-01

The Better Bites program, a hospital cafeteria nutrition intervention strategy, was developed by combining evidence-based practices with hospital-specific formative research, including key informant interviews, the Nutrition Environment Measures Study in Restaurants, hospital employee surveys, and nutrition services staff surveys. The primary program components are pricing manipulation and marketing to promote delicious, affordable, and healthy foods to hospital employees and other cafeteria patrons. The pricing manipulation component includes decreasing the price of the healthy items and increasing the price of the unhealthy items using a 35% price differential. Point-of-purchase marketing highlights taste, cost, and health benefits of the healthy items. The program aims to increase purchases of healthy foods and decrease purchases of unhealthy foods, while maintaining revenue neutrality. This article addresses the formative research, planning, and development that informed the Better Bites program.

Measuring sexual orientation in adolescent health surveys: evaluation of eight school-based surveys.

PubMed

Saewyc, Elizabeth M; Bauer, Greta R; Skay, Carol L; Bearinger, Linda H; Resnick, Michael D; Reis, Elizabeth; Murphy, Aileen

2004-10-01

To examine the performance of various items measuring sexual orientation within 8 school-based adolescent health surveys in the United States and Canada from 1986 through 1999. Analyses examined nonresponse and unsure responses to sexual orientation items compared with other survey items, demographic differences in responses, tests for response set bias, and congruence of responses to multiple orientation items; analytical methods included frequencies, contingency tables with Chi-square, and ANOVA with least significant differences (LSD)post hoc tests; all analyses were conducted separately by gender. In all surveys, nonresponse rates for orientation questions were similar to other sexual questions, but not higher; younger students, immigrants, and students with learning disabilities were more likely to skip items or select "unsure." Sexual behavior items had the lowest nonresponse, but fewer than half of all students reported sexual behavior, limiting its usefulness for indicating orientation. Item placement in the survey, wording, and response set bias all appeared to influence nonresponse and unsure rates. Specific recommendations include standardizing wording across future surveys, and pilot testing items with diverse ages and ethnic groups of teens before use. All three dimensions of orientation should be assessed where possible; when limited to single items, sexual attraction may be the best choice. Specific wording suggestions are offered for future surveys.

How item banks and their application can influence measurement practice in rehabilitation medicine: a PROMIS fatigue item bank example.

PubMed

Lai, Jin-Shei; Cella, David; Choi, Seung; Junghaenel, Doerte U; Christodoulou, Christopher; Gershon, Richard; Stone, Arthur

2011-10-01

To illustrate how measurement practices can be advanced by using as an example the fatigue item bank (FIB) and its applications (short forms and computerized adaptive testing [CAT]) that were developed through the National Institutes of Health Patient Reported Outcomes Measurement Information System (PROMIS) Cooperative Group. Psychometric analysis of data collected by an Internet survey company using item response theory-related techniques. A U.S. general population representative sample collected through the Internet. Respondents used for dimensionality evaluation of the PROMIS FIB (N=603) and item calibrations (N=14,931). Not applicable. Fatigue items (112) developed by the PROMIS fatigue domain working group, 13-item Functional Assessment of Chronic Illness Therapy-Fatigue, and 4-item Medical Outcomes Study 36-Item Short Form Health Survey Vitality scale. The PROMIS FIB version 1, which consists of 95 items, showed acceptable psychometric properties. CAT showed consistently better precision than short forms. However, all 3 short forms showed good precision for most participants in that more than 95% of the sample could be measured precisely with reliability greater than 0.9. Measurement practice can be advanced by using a psychometrically sound measurement tool and its applications. This example shows that CAT and short forms derived from the PROMIS FIB can reliably estimate fatigue reported by the U.S. general population. Evaluation in clinical populations is warranted before the item bank can be used for clinical trials. Copyright © 2011 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

The patient safety climate in healthcare organizations (PSCHO) survey: Short-form development.

PubMed

Benzer, Justin K; Meterko, Mark; Singer, Sara J

2017-08-01

Measures of safety climate are increasingly used to guide safety improvement initiatives. However, cost and respondent burden may limit the use of safety climate surveys. The purpose of this study was to develop a 15- to 20-item safety climate survey based on the Patient Safety Climate in Healthcare Organizations survey, a well-validated 38-item measure of safety climate. The Patient Safety Climate in Healthcare Organizations was administered to all senior managers, all physicians, and a 10% random sample of all other hospital personnel in 69 private sector hospitals and 30 Veterans Health Administration hospitals. Both samples were randomly divided into a derivation sample to identify a short-form subset and a confirmation sample to assess the psychometric properties of the proposed short form. The short form consists of 15 items represented 3 overarching domains in the long-form scale-organization, work unit, and interpersonal. The proposed short form efficiently captures 3 important sources of variance in safety climate: organizational, work-unit, and interpersonal. The short-form development process was a practical method that can be applied to other safety climate surveys. This safety climate short form may increase response rates in studies that involve busy clinicians or repeated measures. Published 2017. This article is a U.S. Government work and is in the public domain in the USA.

Development and reliability testing of the Worksite and Energy Balance Survey.

PubMed

Hoehner, Christine M; Budd, Elizabeth L; Marx, Christine M; Dodson, Elizabeth A; Brownson, Ross C

2013-01-01

Worksites represent important venues for health promotion. Development of psychometrically sound measures of worksite environments and policy supports for physical activity and healthy eating are needed for use in public health research and practice. Assess the test-retest reliability of the Worksite and Energy Balance Survey (WEBS), a self-report instrument for assessing perceptions of worksite supports for physical activity and healthy eating. The WEBS included items adapted from existing surveys or new items on the basis of a review of the literature and expert review. Cognitive interviews among 12 individuals were used to test the clarity of items and further refine the instrument. A targeted random-digit-dial telephone survey was administered on 2 occasions to assess test-retest reliability (mean days between time periods = 8; minimum = 5; maximum = 14). Five Missouri census tracts that varied by racial-ethnic composition and walkability. Respondents included 104 employed adults (67% white, 64% women, mean age = 48.6 years). Sixty-three percent were employed at worksites with less than 100 employees, approximately one-third supervised other people, and the majority worked a regular daytime shift (75%). Test-retest reliability was assessed using Spearman correlations for continuous variables, Cohen's κ statistics for nonordinal categorical variables, and 1-way random intraclass correlation coefficients for ordinal categorical variables. Test-retest coefficients ranged from 0.41 to 0.97, with 80% of items having reliability coefficients of more than 0.6. Items that assessed participation in or use of worksite programs/facilities tended to have lower reliability. Reliability of some items varied by gender, obesity status, and worksite size. Test-retest reliability and internal consistency for the 5 scales ranged from 0.84 to 0.94 and 0.63 to 0.84, respectively. The WEBS items and scales exhibited sound test-retest reliability and may be useful for research and surveillance. Further evaluation is needed to document the validity of the WEBS and associations with energy balance outcomes.

Household Food Security in Isfahan Based on Current Population Survey Adapted Questionnaire

PubMed Central

Rafiei, Morteza; Rastegari, Hosein Ali; Ghiasi, Mojdeh; Shahsanaie, Vahid

2013-01-01

Background: Food security is a state in which all people at every time have physical and economic access to adequate food to obviate nutritional needs and live a healthy and active life. Therefore, this study was performed to quantitatively evaluate the household food security in Esfahan using the localized version of US Household Food Security Survey Module (US HFSSM). Methods: This descriptive cross-sectional study was performed in year 2006 on 3000 households of Esfahan. The study instrument used in this work is 18-item US food security module, which is developed into a localized 15-item questionnaire. This study is performed in two stages of families with no children (under 18 years old) and families with children over 18 years old. Results: The results showed that item severity coefficient, ratio of responses given by households and item infit and outfit coefficient in adult's and children's questionnaire respectively. According to obtained data, scale score of +3 in adults group is described as determination limit of slight food insecurity and +6 is stated as the limit for severe food insecurity. For children's group, scale score of +2 is defined to be the limit of slight food insecurity and +5 is the determination limit of severe food insecurity. Conclusions: The main hypothesis of this survey analysis is based on the raw scale score of USFSSM The item of “lack of enough money for buying food” (item 2) and the item of “lack of balanced meal” (3rd item) have the lowest severity coefficient. Then, the ascending rate of item severity continues in first item, 4th item and keeps increasing into 10th item. PMID:24498498

Development of life story experience (LSE) scales for migrant dentists in Australia: a sequential qualitative-quantitative study.

PubMed

Balasubramanian, M; Spencer, A J; Short, S D; Watkins, K; Chrisopoulos, S; Brennan, D S

2016-09-01

The integration of qualitative and quantitative approaches introduces new avenues to bridge strengths, and address weaknesses of both methods. To develop measure(s) for migrant dentist experiences in Australia through a mixed methods approach. The sequential qualitative-quantitative design involved first the harvesting of data items from qualitative study, followed by a national survey of migrant dentists in Australia. Statements representing unique experiences in migrant dentists' life stories were deployed the survey questionnaire, using a five-point Likert scale. Factor analysis was used to examine component factors. Eighty-two statements from 51 participants were harvested from the qualitative analysis. A total of 1,022 of 1,977 migrant dentists (response rate 54.5%) returned completed questionnaires. Factor analysis supported an initial eight-factor solution; further scale development and reliability analysis led to five scales with a final list of 38 life story experience (LSE) items. Three scales were based on home country events: health system and general lifestyle concerns (LSE1; 10 items), society and culture (LSE4; 4 items) and career development (LSE5; 4 items). Two scales included migrant experiences in Australia: appreciation towards Australian way of life (LSE2; 13 items) and settlement concerns (LSE3; 7 items). The five life story experience scales provided necessary conceptual clarity and empirical grounding to explore migrant dentist experiences in Australia. Being based on original migrant dentist narrations, these scales have the potential to offer in-depth insights for policy makers and support future research on dentist migration. Copyright© 2016 Dennis Barber Ltd

Psychometric evaluation of the Nurse Practitioner Satisfaction Survey (NPSS).

PubMed

Agosta, Lucie J

2009-01-01

The purpose of this study was to identify and define underlying latent constructs within the concept of patient satisfaction with nurse practitioner delivered primary health care. The Nurse Practitioner Satisfaction Survey (NPSS), a 28-item, Likert-type, researcher developed instrument was completed by 300 clients presenting for primary health care visits in a hospital outpatient clinic. Factor analysis with promax rotation resulted in a three factor model explaining 70.77% of the variance. Eighteen items loaded on general satisfaction. Six items loaded on communication, and four items loaded on accessibility and convenience. Cronbach's alpha internal consistency reliability coefficients were .98, .83, and .76 for the three factors, respectively. The NPSS was found to be reliable and valid for measuring patient satisfaction with nurse practitioner delivered primary health care services.

Personal Opinion Survey.

ERIC Educational Resources Information Center

Harvard Univ., Cambridge, MA. Harvard Project Physics.

This questionnaire, developed for use in evaluation of the Harvard Project Physics curriculum, consists of 90 Likert scale items selected to measure seven psychological variables: (1) dogmatism, (2) authoritarianism, (3) rigidity, (4) need-achievement, (5) order, (6) affiliation, and (7) change. Items were taken (with permission) from other scales…

Measuring organisational readiness for patient engagement (MORE): an international online Delphi consensus study.

PubMed

Oostendorp, Linda J M; Durand, Marie-Anne; Lloyd, Amy; Elwyn, Glyn

2015-02-14

Widespread implementation of patient engagement by organisations and clinical teams is not a reality yet. The aim of this study is to develop a measure of organisational readiness for patient engagement designed to monitor and facilitate a healthcare organisation's willingness and ability to effectively implement patient engagement in healthcare. The development of the MORE (Measuring Organisational Readiness for patient Engagement) scale was guided by Weiner's theory of organisational readiness for change. Weiner postulates that an organisation's readiness is determined by both the willingness and ability to implement the change (i.e. in this context: patient engagement). A first version of the scale was developed based on a literature search and evaluation of pre-existing tools. We invited multi-disciplinary stakeholders to participate in a two-round online Delphi survey. Respondents were asked to rate the importance of each proposed item, and to comment on the proposed domains and items. Second round participants received feedback from the first round and were asked to re-rate the importance of the revised, new and unchanged items, and to provide comments. The first version of the scale contained 51 items divided into three domains: (1) Respondents' characteristics; (2) the organisation's willingness to implement patient engagement; and (3) the organisation's ability to implement patient engagement. 131 respondents from 16 countries (health care managers, policy makers, clinicians, patients and patient representatives, researchers, and other stakeholders) completed the first survey, and 72 of them also completed the second survey. During the Delphi process, 34 items were reworded, 8 new items were added, 5 items were removed, and 18 were combined. The scale's instructions were revised. The final version of MORE totalled 38 items; 5 on stakeholders, 13 on an organisation's willingness to implement, and 20 on an organisation's ability to implement patient engagement in healthcare. The Delphi technique was successfully used to refine the scale's instructions, domains and items, using input from a broad range of international stakeholders, hoping that MORE can be applied in a variety of healthcare contexts worldwide. Further assessment is needed to determine the psychometric properties of the scale.

Adolescent Healthful Foods Inventory: Development of an Instrument to Assess Adolescents' Willingness to Consume Healthful Foods

ERIC Educational Resources Information Center

McGuerty, Amber B.; Cater, Melissa; Prinyawiwatkul, Witoon; Tuuri, Georgianna

2016-01-01

Interventions to increase adolescents' healthful food and beverage consumption often fail to demonstrate change. An alternative is to measure a shift in willingness to consume these items as an indicator of movement toward change. A survey was developed to estimate willingness to consume a variety of foods and beverages. Twenty items were…

Development and psychometric validation of the general practice nurse satisfaction scale.

PubMed

Halcomb, Elizabeth J; Caldwell, Belinda; Salamonson, Yenna; Davidson, Patricia M

2011-09-01

To develop an instrument to assess consumer satisfaction with nursing in general practice to provide feedback to nurses about consumers' perceptions of their performance. Prospective psychometric instrument validation study. A literature review was conducted to generate items for an instrument to measure consumer satisfaction with nursing in general practice. Face and content validity were evaluated by an expert panel, which had extensive experience in general practice nursing and research. Included in the questionnaire battery was the 27-item General Practice Nurse Satisfaction (GPNS) scale, as well as demographic and health status items. This survey was distributed to 739 consumers following intervention administered by a practice nurse in 16 general practices across metropolitan, rural, and regional Australia. Participants had the option of completing the survey online or receiving a hard copy of the survey form at the time of their visit. These data were collected between June and August 2009. Satisfaction data from 739 consumers were collected following their consultation with a general practice nurse. From the initial 27-item GPNS scale, a 21-item instrument was developed. Two factors, "confidence and credibility" and "interpersonal and communication" were extracted using principal axis factoring and varimax rotation. These two factors explained 71.9% of the variance. Cronbach's α was 0.97. The GPNS scale has demonstrated acceptable psychometric properties and can be used both in research and clinical practice for evaluating consumer satisfaction with general practice nurses. Assessing consumer satisfaction is important for developing and evaluating nursing roles. The GPNS scale is a valid and reliable tool that can be utilized to assess consumer satisfaction with general practice nurses and can assist in performance management and improving the quality of nursing services. © 2011 Sigma Theta Tau International.

Recommended core items to assess e-cigarette use in population-based surveys.

PubMed

Pearson, Jennifer L; Hitchman, Sara C; Brose, Leonie S; Bauld, Linda; Glasser, Allison M; Villanti, Andrea C; McNeill, Ann; Abrams, David B; Cohen, Joanna E

2018-05-01

A consistent approach using standardised items to assess e-cigarette use in both youth and adult populations will aid cross-survey and cross-national comparisons of the effect of e-cigarette (and tobacco) policies and improve our understanding of the population health impact of e-cigarette use. Focusing on adult behaviour, we propose a set of e-cigarette use items, discuss their utility and potential adaptation, and highlight e-cigarette constructs that researchers should avoid without further item development. Reliable and valid items will strengthen the emerging science and inform knowledge synthesis for policy-making. Building on informal discussions at a series of international meetings of 65 experts from 15 countries, the authors provide recommendations for assessing e-cigarette use behaviour, relative perceived harm, device type, presence of nicotine, flavours and reasons for use. We recommend items assessing eight core constructs: e-cigarette ever use, frequency of use and former daily use; relative perceived harm; device type; primary flavour preference; presence of nicotine; and primary reason for use. These items should be standardised or minimally adapted for the policy context and target population. Researchers should be prepared to update items as e-cigarette device characteristics change. A minimum set of e-cigarette items is proposed to encourage consensus around items to allow for cross-survey and cross-jurisdictional comparisons of e-cigarette use behaviour. These proposed items are a starting point. We recognise room for continued improvement, and welcome input from e-cigarette users and scientific colleagues. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Development of six PROMIS pediatrics proxy-report item banks

PubMed Central

2012-01-01

Background Pediatric self-report should be considered the standard for measuring patient reported outcomes (PRO) among children. However, circumstances exist when the child is too young, cognitively impaired, or too ill to complete a PRO instrument and a proxy-report is needed. This paper describes the development process including the proxy cognitive interviews and large-field-test survey methods and sample characteristics employed to produce item parameters for the Patient Reported Outcomes Measurement Information System (PROMIS) pediatric proxy-report item banks. Methods The PROMIS pediatric self-report items were converted into proxy-report items before undergoing cognitive interviews. These items covered six domains (physical function, emotional distress, social peer relationships, fatigue, pain interference, and asthma impact). Caregivers (n = 25) of children ages of 5 and 17 years provided qualitative feedback on proxy-report items to assess any major issues with these items. From May 2008 to March 2009, the large-scale survey enrolled children ages 8-17 years to complete the self-report version and caregivers to complete the proxy-report version of the survey (n = 1548 dyads). Caregivers of children ages 5 to 7 years completed the proxy report survey (n = 432). In addition, caregivers completed other proxy instruments, PedsQL™ 4.0 Generic Core Scales Parent Proxy-Report version, PedsQL™ Asthma Module Parent Proxy-Report version, and KIDSCREEN Parent-Proxy-52. Results Item content was well understood by proxies and did not require item revisions but some proxies clearly noted that determining an answer on behalf of their child was difficult for some items. Dyads and caregivers of children ages 5-17 years old were enrolled in the large-scale testing. The majority were female (85%), married (70%), Caucasian (64%) and had at least a high school education (94%). Approximately 50% had children with a chronic health condition, primarily asthma, which was diagnosed or treated within 6 months prior to the interview. The PROMIS proxy sample scored similar or better on the other proxy instruments compared to normative samples. Conclusions The initial calibration data was provided by a diverse set of caregivers of children with a variety of common chronic illnesses and racial/ethnic backgrounds. The PROMIS pediatric proxy-report item banks include physical function (mobility n = 23; upper extremity n = 29), emotional distress (anxiety n = 15; depressive symptoms n = 14; anger n = 5), social peer relationships (n = 15), fatigue (n = 34), pain interference (n = 13), and asthma impact (n = 17). PMID:22357192

Preschool Gifted Education: Perceived Challenges Associated with Program Development

ERIC Educational Resources Information Center

Kettler, Todd; Oveross, Mattie E.; Salman, Rania C.

2017-01-01

This descriptive study investigated the challenges related to implementing gifted education services in preschool centers. Participants were 254 licensed preschool center directors in a southern state. Participants completed a researcher-created survey including both selected response items and constructed response items to examine the perceived…

Analysis of Supermarket Research.

ERIC Educational Resources Information Center

Keil, Beverly J.; Ferris, E. Linda

1996-01-01

Volunteers priced grocery items twice per month for three months in eight rural Ohio stores, examined advertising flyers, and surveyed stores weekly for a month to track pricing trends. Advice for consumers on choice of stores and items as well as food budgeting was developed based on the results. (SK)

Development and evaluation of a thermochemistry concept inventory for college-level general chemistry

NASA Astrophysics Data System (ADS)

Wren, David A.

The research presented in this dissertation culminated in a 10-item Thermochemistry Concept Inventory (TCI). The development of the TCI can be divided into two main phases: qualitative studies and quantitative studies. Both phases focused on the primary stakeholders of the TCI, college-level general chemistry instructors and students. Each phase was designed to collect evidence for the validity of the interpretations and uses of TCI testing data. A central use of TCI testing data is to identify student conceptual misunderstandings, which are represented as incorrect options of multiple-choice TCI items. Therefore, quantitative and qualitative studies focused heavily on collecting evidence at the item-level, where important interpretations may be made by TCI users. Qualitative studies included student interviews (N = 28) and online expert surveys (N = 30). Think-aloud student interviews (N = 12) were used to identify conceptual misunderstandings used by students. Novice response process validity interviews (N = 16) helped provide information on how students interpreted and answered TCI items and were the basis of item revisions. Practicing general chemistry instructors (N = 18), or experts, defined boundaries of thermochemistry content included on the TCI. Once TCI items were in the later stages of development, an online version of the TCI was used in expert response process validity survey (N = 12), to provide expert feedback on item content, format and consensus of the correct answer for each item. Quantitative studies included three phases: beta testing of TCI items (N = 280), pilot testing of the a 12-item TCI (N = 485), and a large data collection using a 10-item TCI ( N = 1331). In addition to traditional classical test theory analysis, Rasch model analysis was also used for evaluation of testing data at the test and item level. The TCI was administered in both formative assessment (beta and pilot testing) and summative assessment (large data collection), with items performing well in both. One item, item K, did not have acceptable psychometric properties when the TCI was used as a quiz (summative assessment), but was retained in the final version of the TCI based on the acceptable psychometric properties displayed in pilot testing (formative assessment).

Development of an instrument designed to measure employees' perceptions of workplace breastfeeding support.

PubMed

Greene, Sally W; Olson, Beth H

2008-09-01

Breastfeeding rates remain low in the United States, especially among working women. Unfortunately, no quantitative instrument exists to facilitate the examination of why women who return to work discontinue breastfeeding sooner than the general population. The objective of this study was to develop an instrument to measure female employees' perceptions of breastfeeding support in the workplace, which would be suitable for piloting with the target population. Examination of the literature, reviews with experts, and one-on-one interviews with women who had experience combining breastfeeding and work were used to create the instrument subscales and items. Examination of the literature was used to develop four subscales: company policies/work culture, manager support, co-worker support, and workflow. Expert review resulted in the addition of a fifth subscale, the physical environment of the breastfeeding space. One-on-one interviews were used to ensure that the item wording was appropriate for the target population. Eighteen items were added, and 15 were reworded based on comments from the expert review and from the interviews. The resulting survey contained 54 items that required either categorical yes/no or Likert scale responses. Results from this process indicate the survey subscales and items adequately reflect women's perceptions of breastfeeding support in the workplace and the instrument is appropriate for piloting with new mother employees.

Development and Validation of an Instrument for Assessing Climate Change Knowledge and Perceptions: The Climate Stewardship Survey (CSS)

ERIC Educational Resources Information Center

Walker, Scott L.; McNeal, Karen S.

2013-01-01

The Climate Stewardship Survey (CSS) was developed to measure knowledge and perceptions of global climate change, while also considering information sources that respondents 'trust.' The CSS was drafted using a three-stage approach: development of salient scales, writing individual items, and field testing and analyses. Construct validity and…

Transgender-inclusive measures of sex/gender for population surveys: Mixed-methods evaluation and recommendations.

PubMed

Bauer, Greta R; Braimoh, Jessica; Scheim, Ayden I; Dharma, Christoffer

2017-01-01

Given that an estimated 0.6% of the U.S. population is transgender (trans) and that large health disparities for this population have been documented, government and research organizations are increasingly expanding measures of sex/gender to be trans inclusive. Options suggested for trans community surveys, such as expansive check-all-that-apply gender identity lists and write-in options that offer maximum flexibility, are generally not appropriate for broad population surveys. These require limited questions and a small number of categories for analysis. Limited evaluation has been undertaken of trans-inclusive population survey measures for sex/gender, including those currently in use. Using an internet survey and follow-up of 311 participants, and cognitive interviews from a maximum-diversity sub-sample (n = 79), we conducted a mixed-methods evaluation of two existing measures: a two-step question developed in the United States and a multidimensional measure developed in Canada. We found very low levels of item missingness, and no indicators of confusion on the part of cisgender (non-trans) participants for both measures. However, a majority of interview participants indicated problems with each question item set. Agreement between the two measures in assessment of gender identity was very high (K = 0.9081), but gender identity was a poor proxy for other dimensions of sex or gender among trans participants. Issues to inform measure development or adaptation that emerged from analysis included dimensions of sex/gender measured, whether non-binary identities were trans, Indigenous and cultural identities, proxy reporting, temporality concerns, and the inability of a single item to provide a valid measure of sex/gender. Based on this evaluation, we recommend that population surveys meant for multi-purpose analysis consider a new Multidimensional Sex/Gender Measure for testing that includes three simple items (one asked only of a small sub-group) to assess gender identity and lived gender, with optional additions. We provide considerations for adaptation of this measure to different contexts.

Transgender-inclusive measures of sex/gender for population surveys: Mixed-methods evaluation and recommendations

PubMed Central

Bauer, Greta R.; Braimoh, Jessica; Scheim, Ayden I.; Dharma, Christoffer

2017-01-01

Given that an estimated 0.6% of the U.S. population is transgender (trans) and that large health disparities for this population have been documented, government and research organizations are increasingly expanding measures of sex/gender to be trans inclusive. Options suggested for trans community surveys, such as expansive check-all-that-apply gender identity lists and write-in options that offer maximum flexibility, are generally not appropriate for broad population surveys. These require limited questions and a small number of categories for analysis. Limited evaluation has been undertaken of trans-inclusive population survey measures for sex/gender, including those currently in use. Using an internet survey and follow-up of 311 participants, and cognitive interviews from a maximum-diversity sub-sample (n = 79), we conducted a mixed-methods evaluation of two existing measures: a two-step question developed in the United States and a multidimensional measure developed in Canada. We found very low levels of item missingness, and no indicators of confusion on the part of cisgender (non-trans) participants for both measures. However, a majority of interview participants indicated problems with each question item set. Agreement between the two measures in assessment of gender identity was very high (K = 0.9081), but gender identity was a poor proxy for other dimensions of sex or gender among trans participants. Issues to inform measure development or adaptation that emerged from analysis included dimensions of sex/gender measured, whether non-binary identities were trans, Indigenous and cultural identities, proxy reporting, temporality concerns, and the inability of a single item to provide a valid measure of sex/gender. Based on this evaluation, we recommend that population surveys meant for multi-purpose analysis consider a new Multidimensional Sex/Gender Measure for testing that includes three simple items (one asked only of a small sub-group) to assess gender identity and lived gender, with optional additions. We provide considerations for adaptation of this measure to different contexts. PMID:28542498

Instrument development and validation of a quality scale for historical research papers (QSHRP): a pilot study.

PubMed

Kelly, Jacinta; Watson, Roger

2014-12-01

To report a pilot study for the development and validation of an instrument to measure quality in historical research papers. There are no set criteria to assess historical papers published in nursing journals. A three phase mixed method sequential confirmatory design. In 2012, we used a three-phase approach to item generation and content evaluation. In phase 1, we consulted nursing historians using an online survey comprising three open-ended questions and revised the items. In phase 2, we evaluated the revised items for relevance with expert historians using a 4-point Likert scale and Content Validity Index calculation. In phase 3, we conducted reliability testing of the instrument using a 3-point Likert scale. In phase 1, 121 responses were generated via the online survey and revised to 40 interrogatively phrased items. In phase 2, five items with an Item Content Validity Index score of ≥0·7 remained. In phase 3, responses from historians resulted in 100% agreement to questions 1, 2 and 4 and 89% and 78%, respectively, to questions 3 and 5. Items for the QSHRP have been identified, content validated and reliability tested. This scale improves on previous scales, which over-emphasized source criticism. However, a full-scale study is needed with nursing historians to increase its robustness. © 2014 John Wiley & Sons Ltd.

Analysis of Bilingual Children’s Performance on the English and Spanish Versions of the Woodcock-Muñoz Language Survey-R (WMLS-R)

PubMed Central

Sandilos, Lia E.; Lewis, Kandia; Komaroff, Eugene; Hammer, Carol Scheffner; Scarpino, Shelley E.; Lopez, Lisa; Rodriguez, Barbara; Goldstein, Brian

2015-01-01

The purpose of this study was to investigate the way in which items on the Woodcock-Muñoz Language Survey Revised (WMLS-R) Spanish and English versions function for bilingual children from different ethnic subgroups who speak different dialects of Spanish. Using data from a sample of 324 bilingual Hispanic families and their children living on the United States mainland, differential item functioning (DIF) was conducted to determine if test items in English and Spanish functioned differently for Mexican, Cuban, and Puerto Rican bilingual children. Data on child and parent language characteristics and children’s scores on Picture Vocabulary and Story Recall subtests in English and Spanish were collected. DIF was not detected for items on the Spanish subtests. Results revealed that some items on English subtests displayed statistically and practically significant DIF. The findings indicate that there are differences in the difficulty level of WMLS-R English-form test items depending on the examinees’ ethnic subgroup membership. This outcome suggests that test developers need to be mindful of potential differences in performance based on ethnic subgroup and dialect when developing standardized language assessments that may be administered to bilingual students. PMID:26705400

[Wing 1 radiation survey and contamination report]. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Olsen, K.

We have completed the 5480.11 survey for Wing 1. All area(s)/item(s) requested by the 5480.11 committee have been thoroughly surveyed and documented. Decontamination/disposal of contaminated items has been accomplished. The wing 1 survey was started on 8/13/90 and completed 9/18/90. However, the follow-up surveys were not completed until 2/18/91. We received the final set of smear samples for wing 1 on 1/13/91. A total of 5,495 smears were taken from wing 1 and total of 465 smears were taken during the follow-up surveys. There were a total 122 items found to have fixed contamination and 4 items with smearable contaminationmore » in excess of the limits specified in DOE ORDER 5480.11 (AR 3-7). The following area(s)/item(s) were not included in the 5480.11 survey: Hallways, Access panels, Men`s and women`s change rooms, Janitor closets, Wall lockers and item(s) stored in wing 1 hallways and room 1116. If our contract is renewed, we will include those areas in our survey according to your request of April 15, 1991.« less

Preschool Teacher Survey, 1999-2000: A Report of the Detroit Public Schools.

ERIC Educational Resources Information Center

Washington, Joyce A.

The Preschool Teacher Survey was designed to gather information on the experience of preschool teachers in the Detroit Public Schools (DPS) and their perceptions of program effectiveness regarding student cognitive development, school readiness, parent involvement, and stability of classroom enrollment. The 12-item survey was distributed,…

Measuring Nurses' Value, Implementation, and Knowledge of Evidence-Based Practice: Further Psychometric Testing of the Quick-EBP-VIK Survey.

PubMed

Connor, Linda; Paul, Fiona; McCabe, Margaret; Ziniel, Sonja

2017-02-01

The Quick-EBP-VIK is a new instrument for measuring nurses' value, implementation, and knowledge of EBP. Psychometric testing was conducted in two parts. Part 1 describes the tool development and validity testing which resulted in the development of a 25-item survey after receiving ≥0.80 Item-Level Content Validity Index for both clarity and relevance. Part 2 describes psychometric testing was necessary to assess additional types of validity and reliability. The purpose of this paper is to further describe the psychometric testing of the Quick-EBP-VIK survey instrument. This descriptive study was designed to assess test-retest reliability, internal consistency and construct validity via a web-based survey. The survey instrument was e-mailed to all nurses at the study hospital. Nurses who responded to the first survey (Wave 1) received another e-mail invitation to complete the survey instrument again (Wave 2) for the purpose of assessing the test-retest reliability of the instrument. A total of 1,177 deliverable e-mails were sent to all nursing staff at one free standing pediatric hospital with Magnet ® designation in the northeast. A total of 382 nurses returned completed surveys, indicating a 32.5% response rate for Wave 1. A total of 131 nurses responded to Wave 2 indicating a response rate of 34.3%. The intraclass correlation coefficients for the items included in the final instrument ranged from 0.43 to 0.80 and were deemed sufficient. These represent a sufficient intraclass correlation coefficient. The Cronbach's Alpha values for each of the three domains are all higher than 0.7 indicating that the items of each of the measurement dimension are internally consistent. However, the composite reliability of the third domain was slightly lower than 0.7 when using Raykov's Rho. The Quick-EBP-VIK instrument has gone through rigorous comprehensive testing and has demonstrated good psychometric properties. © 2016 Sigma Theta Tau International.

Development and validation of a socioculturally competent trust in physician scale for a developing country setting.

PubMed

Gopichandran, Vijayaprasad; Wouters, Edwin; Chetlapalli, Satish Kumar

2015-05-03

Trust in physicians is the unwritten covenant between the patient and the physician that the physician will do what is in the best interest of the patient. This forms the undercurrent of all healthcare relationships. Several scales exist for assessment of trust in physicians in developed healthcare settings, but to our knowledge none of these have been developed in a developing country context. To develop and validate a new trust in physician scale for a developing country setting. Dimensions of trust in physicians, which were identified in a previous qualitative study in the same setting, were used to develop a scale. This scale was administered among 616 adults selected from urban and rural areas of Tamil Nadu, south India, using a multistage sampling cross sectional survey method. The individual items were analysed using a classical test approach as well as item response theory. Cronbach's α was calculated and the item to total correlation of each item was assessed. After testing for unidimensionality and absence of local dependence, a 2 parameter logistic Semajima's graded response model was fit and item characteristics assessed. Competence, assurance of treatment, respect for the physician and loyalty to the physician were important dimensions of trust. A total of 31 items were developed using these dimensions. Of these, 22 were selected for final analysis. The Cronbach's α was 0.928. The item to total correlations were acceptable for all the 22 items. The item response analysis revealed good item characteristic curves and item information for all the items. Based on the item parameters and item information, a final 12 item scale was developed. The scale performs optimally in the low to moderate trust range. The final 12 item trust in physician scale has a good construct validity and internal consistency. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Development and validation of a socioculturally competent trust in physician scale for a developing country setting

PubMed Central

Gopichandran, Vijayaprasad; Wouters, Edwin; Chetlapalli, Satish Kumar

2015-01-01

Trust in physicians is the unwritten covenant between the patient and the physician that the physician will do what is in the best interest of the patient. This forms the undercurrent of all healthcare relationships. Several scales exist for assessment of trust in physicians in developed healthcare settings, but to our knowledge none of these have been developed in a developing country context. Objectives To develop and validate a new trust in physician scale for a developing country setting. Methods Dimensions of trust in physicians, which were identified in a previous qualitative study in the same setting, were used to develop a scale. This scale was administered among 616 adults selected from urban and rural areas of Tamil Nadu, south India, using a multistage sampling cross sectional survey method. The individual items were analysed using a classical test approach as well as item response theory. Cronbach's α was calculated and the item to total correlation of each item was assessed. After testing for unidimensionality and absence of local dependence, a 2 parameter logistic Semajima's graded response model was fit and item characteristics assessed. Results Competence, assurance of treatment, respect for the physician and loyalty to the physician were important dimensions of trust. A total of 31 items were developed using these dimensions. Of these, 22 were selected for final analysis. The Cronbach's α was 0.928. The item to total correlations were acceptable for all the 22 items. The item response analysis revealed good item characteristic curves and item information for all the items. Based on the item parameters and item information, a final 12 item scale was developed. The scale performs optimally in the low to moderate trust range. Conclusions The final 12 item trust in physician scale has a good construct validity and internal consistency. PMID:25941182

Analysis of Individual "Test Of Astronomy STandards" (TOAST) Item Responses

ERIC Educational Resources Information Center

Slater, Stephanie J.; Schleigh, Sharon Price; Stork, Debra J.

2015-01-01

The development of valid and reliable strategies to efficiently determine the knowledge landscape of introductory astronomy college students is an effort of great interest to the astronomy education community. This study examines individual item response rates from a widely used conceptual understanding survey, the Test Of Astronomy Standards…

Can Assertiveness be Distinguished From Aggressiveness Using Self Report Data?

ERIC Educational Resources Information Center

Mauger, Paul A.; And Others

The differences between aggressiveness and assertiveness were examined using the Interpersonal Behavior Survey (IBS), a 136-item self-report questionnaire which was developed to distinguish between assertive and aggressive behaviors. Item level factor analysis was used in scale construction. Results indicated that: (1) the correlation between the…

Findings from a novel approach to publication guideline revision: user road testing of a draft version of SQUIRE 2.0.

PubMed

Davies, Louise; Donnelly, Kyla Z; Goodman, Daisy J; Ogrinc, Greg

2016-04-01

The Standards for Quality Improvement Reporting Excellence (SQUIRE) Guideline was published in 2008 (SQUIRE 1.0) and was the first publication guideline specifically designed to advance the science of healthcare improvement. Advances in the discipline of improvement prompted us to revise it. We adopted a novel approach to the revision by asking end-users to 'road test' a draft version of SQUIRE 2.0. The aim was to determine whether they understood and implemented the guidelines as intended by the developers. Forty-four participants were assigned a manuscript section (ie, introduction, methods, results, discussion) and asked to use the draft Guidelines to guide their writing process. They indicated the text that corresponded to each SQUIRE item used and submitted it along with a confidential survey. The survey examined usability of the Guidelines using Likert-scaled questions and participants' interpretation of key concepts in SQUIRE using open-ended questions. On the submitted text, we evaluated concordance between participants' item usage/interpretation and the developers' intended application. For the survey, the Likert-scaled responses were summarised using descriptive statistics and the open-ended questions were analysed by content analysis. Consistent with the SQUIRE Guidelines' recommendation that not every item be included, less than one-third (n=14) of participants applied every item in their section in full. Of the 85 instances when an item was partially used or was omitted, only 7 (8.2%) of these instances were due to participants not understanding the item. Usage of Guideline items was highest for items most similar to standard scientific reporting (ie, 'Specific aim of the improvement' (introduction), 'Description of the improvement' (methods) and 'Implications for further studies' (discussion)) and lowest (<20% of the time) for those unique to healthcare improvement (ie, 'Assessment methods for context factors that contributed to success or failure' and 'Costs and strategic trade-offs'). Items unique to healthcare improvement, specifically 'Evolution of the improvement', 'Context elements that influenced the improvement', 'The logic on which the improvement was based', 'Process and outcome measures', demonstrated poor concordance between participants' interpretation and developers' intended application. User testing of a draft version of SQUIRE 2.0 revealed which items have poor concordance between developer intent and author usage, which will inform final editing of the Guideline and development of supporting supplementary materials. It also identified the items that require special attention when teaching about scholarly writing in healthcare improvement. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Dimensional comparability of psychosocial working conditions as covered in European monitoring questionnaires.

PubMed

Formazin, Maren; Burr, Hermann; Aagestad, Cecilie; Tynes, Tore; Thorsen, Sannie Vester; Perkio-Makela, Merja; Díaz Aramburu, Clara Isabel; Pinilla García, Francisco Javier; Galiana Blanco, Luz; Vermeylen, Greet; Parent-Thirion, Agnes; Hooftman, Wendela; Houtman, Irene

2014-12-09

In most countries in the EU, national surveys are used to monitor working conditions and health. Since the development processes behind the various surveys are not necessarily theoretical, but certainly practical and political, the extent of similarity among the dimensions covered in these surveys has been unclear. Another interesting question is whether prominent models from scientific research on work and health are present in the surveys--bearing in mind that the primary focus of these surveys is on monitoring status and trends, not on mapping scientific models. Moreover, it is relevant to know which other scales and concepts not stemming from these models have been included in the surveys. The purpose of this paper is to determine (1) the similarity of dimensions covered in the surveys included and (2) the congruence of dimensions of scientific research and of dimensions present in the monitoring systems. Items from surveys representing six European countries and one European wide survey were classified into the dimensions they cover, using a taxonomy agreed upon among all involved partners from the six countries. The classification reveals that there is a large overlap of dimensions, albeit not in the formulation of items, covered in the seven surveys. Among the available items, the two prominent work-stress-models--job-demand-control-support-model (DCS) and effort-reward-imbalance-model (ERI)--are covered in most surveys even though this has not been the primary aim in the compilation of these surveys. In addition, a large variety of items included in the surveillance systems are not part of these models and are--at least partly--used in nearly all surveys. These additional items reflect concepts such as "restructuring", "meaning of work", "emotional demands" and "offensive behaviour/violence & harassment". The overlap of the dimensions being covered in the various questionnaires indicates that the interests of the parties deciding on the questionnaires in the different countries overlap. The large number of dimensions measured in the questionnaires and not being part of the DCS and ERI models is striking. These "new" dimensions could inspire the research community to further investigate their possible health and labour market effects.

Student Perceptions of Classroom Learning Environments: Development of the ClassMaps Survey

ERIC Educational Resources Information Center

Doll, Beth; Spies, Robert A.; LeClair, Courtney M.; Kurien, Sarah A.; Foley, Brett P.

2010-01-01

The purpose of this study was to describe the means, variability, internal consistency reliability, and structural validity evidence of the ClassMaps Survey, a measure of student perceptions of classroom learning environments. The ClassMaps Survey is a 55-item student rating scale of eight important classroom characteristics. The survey provides a…

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20)

PubMed Central

2017-01-01

Objectives Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. Methods After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Results Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). Conclusions A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability. PMID:28173686

Evaluating the content of the communication items in the CAHPS(®) clinician and group survey and supplemental items with what high-performing physicians say they do.

PubMed

Quigley, Denise D; Martino, Steven C; Brown, Julie A; Hays, Ron D

2013-01-01

A doctor's ability to communicate effectively is key to establishing and maintaining positive doctor-patient relationships. The Consumer Assessment of Healthcare Providers and System (CAHPS(®)) Clinician and Group Survey is the standard for collecting and reporting information about patients' experiences of care in the USA. To evaluate how well CAHPS(®) Clinician and Group 2.0 core and supplemental survey items (CG-CAHPS) with a 12-month reference capture doctor-patient communication. Eleven of the 40 highest-rated physicians on the CG-CAHPS survey treating patients in a Midwest commercial health plan. Data were obtained via semi-structured interviews. Specific behaviors, practices, and opinions about doctor communication were coded and compared to the CG-CAHPS items. CG-CAHPS fully captures six of the nine behaviors most commonly mentioned by high-performing physicians: employing office staff with good people skills; involving office staff in communication with patients; spending enough time with patients; listening carefully; providing clear, simple explanations; and devising an action plan with each patient. Three physician behaviors identified as key were not captured in CG-CAHPS items: use of nonverbal communication; greeting patients and introducing oneself; and tracking personal information about patients. CG-CAHPS survey items capture many of the most commonly mentioned doctor-patient communication behaviors and practices identified by high-performing physicians. Nonverbal communication, greeting patients, and tracking personal information about patients were identified as key aspects of doctor-patient communication, but are not captured by the current CG-CAHPS. We recommend further research to assess patients' perceptions of specific verbal and nonverbal behaviors (such as leaning forward in a chair, casually asking about other family members), followed by the development of new items (if needed) that aim to capture what these specific behaviors represent to patients (e.g., listens attentively, seems to care about me as a person, empathy). We also recommend including items about greeting and tracking personal information about patients in future CAHPS item sets addressing doctor-patient communication. Enriching the content of the CAHPS communication measure can help health-care organizations improve doctor-patient communication and interactions.

Development and psychometric testing of the Dogs and WalkinG Survey (DAWGS).

PubMed

Richards, Elizabeth A; McDonough, Meghan H; Edwards, Nancy E; Lyle, Roseann M; Troped, Philip J

2013-12-01

Dog owners represent 40% of the population, a promising audience to increase population levels of physical activity. The purpose of this study was to develop and test the psychometric properties of a new instrument to assess social-cognitive theory constructs related to dog walking. Dog owners (N = 431) completed the Dogs and WalkinG Survey (DAWGS). Survey items assessed dog-walking behaviors and self-efficacy, social support, outcome expectations, and outcome expectancies for dog walking. Test-retest reliability was assessed among 252 (58%) survey respondents who completed the survey twice. Factorial validity and factorial invariance by age and walking level were tested using confirmatory factor analysis. DAWGS items demonstrated moderate test-retest reliability (p = .39-.79; k = .41-.89). Acceptable model fit was found for all subscales. All subscales were invariant by age and walking level, except self-efficacy, which showed mixed evidence of invariance. The DAWGS is a psychometrically sound instrument for examining individual and interpersonal correlates of dog walking.

The discipline survey: a new measure of parental discipline.

PubMed

Socolar, Rebecca; Savage, Eric; Devellis, Robert F; Evans, Hughes

2004-01-01

To develop a new measure of parental discipline of children encompassing a broad array of types of discipline and modes of administration. Parents of 12- to 19-month-old children were interviewed using a new 45-item structured survey about discipline in general pediatric clinics in North Carolina and Alabama. Demographic data describing the population studied were linked from another study in which these families were participating. Principal component analysis and confirmatory reliability analysis were used to define subscales and determine which items were retained in the survey. One hundred eighty-two parents were interviewed about disciplinary practices. Disciplinary subscales were robust for a number of disciplinary types (monitoring, verbal communication, modeling behavior, corporal punishment, and ignoring) and modes of administration (follow-through, consistency, positive demeanor, negative demeanor). The Discipline Survey is a promising new measure of parental discipline. A survey instrument to assess disciplinary practices like the one developed fills a gap and can enhance research methodology for those interested in the effects of interventions on parental discipline.

Development of a tool to measure person-centered maternity care in developing settings: validation in a rural and urban Kenyan population.

PubMed

Afulani, Patience A; Diamond-Smith, Nadia; Golub, Ginger; Sudhinaraset, May

2017-09-22

Person-centered reproductive health care is recognized as critical to improving reproductive health outcomes. Yet, little research exists on how to operationalize it. We extend the literature in this area by developing and validating a tool to measure person-centered maternity care. We describe the process of developing the tool and present the results of psychometric analyses to assess its validity and reliability in a rural and urban setting in Kenya. We followed standard procedures for scale development. First, we reviewed the literature to define our construct and identify domains, and developed items to measure each domain. Next, we conducted expert reviews to assess content validity; and cognitive interviews with potential respondents to assess clarity, appropriateness, and relevance of the questions. The questions were then refined and administered in surveys; and survey results used to assess construct and criterion validity and reliability. The exploratory factor analysis yielded one dominant factor in both the rural and urban settings. Three factors with eigenvalues greater than one were identified for the rural sample and four factors identified for the urban sample. Thirty of the 38 items administered in the survey were retained based on the factors loadings and correlation between the items. Twenty-five items load very well onto a single factor in both the rural and urban sample, with five items loading well in either the rural or urban sample, but not in both samples. These 30 items also load on three sub-scales that we created to measure dignified and respectful care, communication and autonomy, and supportive care. The Chronbach alpha for the main scale is greater than 0.8 in both samples, and that for the sub-scales are between 0.6 and 0.8. The main scale and sub-scales are correlated with global measures of satisfaction with maternity services, suggesting criterion validity. We present a 30-item scale with three sub-scales to measure person-centered maternity care. This scale has high validity and reliability in a rural and urban setting in Kenya. Validation in additional settings is however needed. This scale will facilitate measurement to improve person-centered maternity care, and subsequently improve reproductive outcomes.

Validation of the MOS Social Support Survey 6-item (MOS-SSS-6) measure with two large population-based samples of Australian women.

PubMed

Holden, Libby; Lee, Christina; Hockey, Richard; Ware, Robert S; Dobson, Annette J

2014-12-01

This study aimed to validate a 6-item 1-factor global measure of social support developed from the Medical Outcomes Study Social Support Survey (MOS-SSS) for use in large epidemiological studies. Data were obtained from two large population-based samples of participants in the Australian Longitudinal Study on Women's Health. The two cohorts were aged 53-58 and 28-33 years at data collection (N = 10,616 and 8,977, respectively). Items selected for the 6-item 1-factor measure were derived from the factor structure obtained from unpublished work using an earlier wave of data from one of these cohorts. Descriptive statistics, including polychoric correlations, were used to describe the abbreviated scale. Cronbach's alpha was used to assess internal consistency and confirmatory factor analysis to assess scale validity. Concurrent validity was assessed using correlations between the new 6-item version and established 19-item version, and other concurrent variables. In both cohorts, the new 6-item 1-factor measure showed strong internal consistency and scale reliability. It had excellent goodness-of-fit indices, similar to those of the established 19-item measure. Both versions correlated similarly with concurrent measures. The 6-item 1-factor MOS-SSS measures global functional social support with fewer items than the established 19-item measure.

Development and Initial Validation of Military Deployment-Related TBI Quality-of-Life Item Banks.

PubMed

Toyinbo, Peter A; Vanderploeg, Rodney D; Donnell, Alison J; Mutolo, Sandra A; Cook, Karon F; Kisala, Pamela A; Tulsky, David S

2016-01-01

To investigate unique factors that affect health-related quality of life (QOL) in individuals with military deployment-related traumatic brain injury (MDR-TBI) and to develop appropriate assessment tools, consistent with the TBI-QOL/PROMIS/Neuro-QOL systems. Three focus groups from each of the 4 Veterans Administration (VA) Polytrauma Rehabilitation Centers, consisting of 20 veterans with mild to severe MDR-TBI, and 36 VA providers were involved in early stage of new item banks development. The item banks were field tested in a sample (N = 485) of veterans enrolled in VA and diagnosed with an MDR-TBI. Focus groups and survey. Developed item banks and short forms for Guilt, Posttraumatic Stress Disorder/Trauma, and Military-Related Loss. Three new item banks representing unique domains of MDR-TBI health outcomes were created: 15 new Posttraumatic Stress Disorder items plus 16 SCI-QOL legacy Trauma items, 37 new Military-Related Loss items plus 18 TBI-QOL legacy Grief/Loss items, and 33 new Guilt items. Exploratory and confirmatory factor analyses plus bifactor analysis of the items supported sufficient unidimensionality of the new item pools. Convergent and discriminant analyses results, as well as known group comparisons, provided initial support for the validity and clinical utility of the new item response theory-calibrated item banks and their short forms. This work provides a unique opportunity to identify issues specific to individuals with MDR-TBI and ensure that they are captured in QOL assessment, thus extending the existing TBI-QOL measurement system.

From Ethnography to Items: A Mixed Methods Approach to Developing a Survey to Examine Graduate Engineering Student Retention

ERIC Educational Resources Information Center

Crede, Erin; Borrego, Maura

2013-01-01

As part of a sequential exploratory mixed methods study, 9 months of ethnographically guided observations and interviews were used to develop a survey examining graduate engineering student retention. Findings from the ethnographic fieldwork yielded several themes, including international diversity, research group organization and climate,…

Development and Validation of the College Tobacco Survey.

ERIC Educational Resources Information Center

Ott, Carol H.; Cashin, Susan E.; Altekruse, Michael

2005-01-01

The authors report on the development and assessment of an instrument to measure baseline campus cigarette use and outcomes from prevention programs, including those using a social norms approach combined with environmental policy change. They administered the 37-item College Tobacco Survey (CTS) to a convenience sample of 1,279 college students…

Development and reliability testing of a self-report instrument to measure the office layout as a correlate of occupational sitting.

PubMed

Duncan, Mitch J; Rashid, Mahbub; Vandelanotte, Corneel; Cutumisu, Nicoleta; Plotnikoff, Ronald C

2013-02-04

Spatial configurations of office environments assessed by Space Syntax methodologies are related to employee movement patterns. These methods require analysis of floors plans which are not readily available in large population-based studies or otherwise unavailable. Therefore a self-report instrument to assess spatial configurations of office environments using four scales was developed. The scales are: local connectivity (16 items), overall connectivity (11 items), visibility of co-workers (10 items), and proximity of co-workers (5 items). A panel cohort (N = 1154) completed an online survey, only data from individuals employed in office-based occupations (n = 307) were used to assess scale measurement properties. To assess test-retest reliability a separate sample of 37 office-based workers completed the survey on two occasions 7.7 (±3.2) days apart. Redundant scale items were eliminated using factor analysis; Chronbach's α was used to evaluate internal consistency and test re-test reliability (retest-ICC). ANOVA was employed to examine differences between office types (Private, Shared, Open) as a measure of construct validity. Generalized Linear Models were used to examine relationships between spatial configuration scales and the duration of and frequency of breaks in occupational sitting. The number of items on all scales were reduced, Chronbach's α and ICCs indicated good scale internal consistency and test re-test reliability: local connectivity (5 items; α = 0.70; retest-ICC = 0.84), overall connectivity (6 items; α = 0.86; retest-ICC = 0.87), visibility of co-workers (4 items; α = 0.78; retest-ICC = 0.86), and proximity of co-workers (3 items; α = 0.85; retest-ICC = 0.70). Significant (p ≤ 0.001) differences, in theoretically expected directions, were observed for all scales between office types, except overall connectivity. Significant associations were observed between all scales and occupational sitting behaviour (p ≤ 0.05). All scales have good measurement properties indicating the instrument may be a useful alternative to Space Syntax to examine environmental correlates of occupational sitting in population surveys.

Development and reliability testing of a self-report instrument to measure the office layout as a correlate of occupational sitting

PubMed Central

2013-01-01

Background Spatial configurations of office environments assessed by Space Syntax methodologies are related to employee movement patterns. These methods require analysis of floors plans which are not readily available in large population-based studies or otherwise unavailable. Therefore a self-report instrument to assess spatial configurations of office environments using four scales was developed. Methods The scales are: local connectivity (16 items), overall connectivity (11 items), visibility of co-workers (10 items), and proximity of co-workers (5 items). A panel cohort (N = 1154) completed an online survey, only data from individuals employed in office-based occupations (n = 307) were used to assess scale measurement properties. To assess test-retest reliability a separate sample of 37 office-based workers completed the survey on two occasions 7.7 (±3.2) days apart. Redundant scale items were eliminated using factor analysis; Chronbach’s α was used to evaluate internal consistency and test re-test reliability (retest-ICC). ANOVA was employed to examine differences between office types (Private, Shared, Open) as a measure of construct validity. Generalized Linear Models were used to examine relationships between spatial configuration scales and the duration of and frequency of breaks in occupational sitting. Results The number of items on all scales were reduced, Chronbach’s α and ICCs indicated good scale internal consistency and test re-test reliability: local connectivity (5 items; α = 0.70; retest-ICC = 0.84), overall connectivity (6 items; α = 0.86; retest-ICC = 0.87), visibility of co-workers (4 items; α = 0.78; retest-ICC = 0.86), and proximity of co-workers (3 items; α = 0.85; retest-ICC = 0.70). Significant (p ≤ 0.001) differences, in theoretically expected directions, were observed for all scales between office types, except overall connectivity. Significant associations were observed between all scales and occupational sitting behaviour (p ≤ 0.05). Conclusion All scales have good measurement properties indicating the instrument may be a useful alternative to Space Syntax to examine environmental correlates of occupational sitting in population surveys. PMID:23379485

Variation by Gender in Abu Dhabi High School Students' Interests in Physics

NASA Astrophysics Data System (ADS)

Badri, Masood; Mazroui, Karima Al; Al Rashedi, Asma; Yang, Guang

2016-04-01

Abu Dhabi high school students' interest in physics in different contexts was investigated with a survey conducted in connection with the international project, The Relevance of Science Education (ROSE). The sample consisted of 2248 students in public and private schools. Means of most items that belong to the school physics context for both girls and boys were below the score of (3.0). The most interesting topics for both genders were connected with fantasy items. The least interesting items (particularly for girls) were connected with artifacts and technological processes. Girls assigned the highest scores for "why we dream" and "life and death." Boys assigned the highest scores for "inventions and discoveries" and "life outside of earth." The main message of the study is that new curricular approaches and textbooks can be developed through combining technological and human contexts. The implications for curriculum development, teacher professional development programs, and other education strategies in Abu Dhabi are discussed in light of the ROSE survey.

Use of the nominal group technique to identify stakeholder priorities and inform survey development: an example with informal caregivers of people with scleroderma.

PubMed

Rice, Danielle B; Cañedo-Ayala, Mara; Turner, Kimberly A; Gumuchian, Stephanie T; Malcarne, Vanessa L; Hagedoorn, Mariët; Thombs, Brett D

2018-03-02

The nominal group technique (NGT) allows stakeholders to directly generate items for needs assessment surveys. The objective was to demonstrate the use of NGT discussions to develop survey items on (1) challenges experienced by informal caregivers of people living with systemic sclerosis (SSc) and (2) preferences for support services. Three NGT groups were conducted. In each group, participants generated lists of challenges and preferred formats for support services. Participants shared items, and a master list was compiled, then reviewed by participants to remove or merge overlapping items. Once a final list of items was generated, participants independently rated challenges on a scale from 1 (not at all important) to 10 (extremely important) and support services on a scale from 1 (not at all likely to use) to 10 (very likely to use). Lists generated in the NGT discussions were subsequently reviewed and integrated into a single list by research team members. SSc patient conferences held in the USA and Canada. Informal caregivers who previously or currently were providing care for a family member or friend with SSc. A total of six men and seven women participated in the NGT discussions. Mean age was 59.8 years (SD=12.6). Participants provided care for a partner (n=8), parent (n=1), child (n=2) or friend (n=2). A list of 61 unique challenges was generated with challenges related to gaps in information, resources and support needs identified most frequently. A list of 18 unique support services was generated; most involved online or in-person delivery of emotional support and educational material about SSc. The NGT was an efficient method for obtaining survey items directly from SSc caregivers on important challenges and preferences for support services. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Cognitive interviews to test and refine questionnaires.

PubMed

García, Alexandra A

2011-01-01

Survey data are compromised when respondents do not interpret questions in the way researchers expect. Cognitive interviews are used to detect problems respondents have in understanding survey instructions and items, and in formulating answers. This paper describes methods for conducting cognitive interviews and describes the processes and lessons learned with an illustrative case study. The case study used cognitive interviews to elicit respondents' understanding and perceptions of the format, instructions, items, and responses that make up the Diabetes Symptom Self-Care Inventory (DSSCI), a questionnaire designed to measure Mexican Americans' symptoms of type 2 diabetes and their symptom management strategies. Responses to cognitive interviews formed the basis for revisions in the format, instructions, items, and translation of the DSSCI. All those who develop and revise surveys are urged to incorporate cognitive interviews into their instrumentation methods so that they may produce more reliable and valid measurements. © 2011 Wiley Periodicals, Inc.

The Self-Stigma of Depression Scale (SSDS): development and psychometric evaluation of a new instrument.

PubMed

Barney, Lisa J; Griffiths, Kathleen M; Christensen, Helen; Jorm, Anthony F

2010-12-01

Self-stigma may feature strongly and be detrimental for people with depression, but the understanding of its nature and prevalence is limited by the lack of psychometrically-validated measures. This study aimed to develop and validate a measure of self-stigma about depression. Items assessing self-stigma were developed from focus group discussions, and were tested and refined over three studies using surveys of 408 university students, 330 members of a depression Internet network, and 1312 members of the general Australian public. Evaluation involved item-level and bivariate analyses, and factor analytic procedures. Items performed consistently across the three surveys. The resulting Self-Stigma of Depression Scale (SSDS) comprised 16 items representing subscales of Shame, Self-Blame, Social Inadequacy, and Help-Seeking Inhibition. Construct validity, internal consistency and test-retest reliability were satisfactory. The SSDS distinguishes self-stigma from perceptions of stigma by others, yields in-depth information about self-stigma of depression, and possesses good psychometric properties. It is a promising tool for the measurement of self-stigma and is likely to be useful in further understanding self-stigma and evaluating stigma interventions. Copyright © 2010 John Wiley & Sons, Ltd.

Developing a Tool to Assess the Capacity of Out-of-School Time Program Providers to Implement Policy, Systems, and Environmental Change.

PubMed

Leeman, Jennifer; Blitstein, Jonathan L; Goetz, Joshua; Moore, Alexis; Tessman, Nell; Wiecha, Jean L

2016-08-11

Little is known about public health practitioners' capacity to change policies, systems, or environments (PSEs), in part due to the absence of measures. To address this need, we partnered with the Alliance for a Healthier Generation (Alliance) to develop and test a theory-derived measure of the capacity of out-of-school time program providers to improve students' level of nutrition and physical activity through changes in PSEs. The measure was developed and tested through an engaged partnership with staff working on the Alliance's Healthy Out-of-School Time (HOST) Initiative. In total, approximately 2,000 sites nationwide are engaged in the HOST Initiative, which serves predominantly high-need children and youths. We partnered with the Alliance to conduct formative work that would help develop a survey that assessed attitudes/beliefs, social norms, external resources/supports, and self-efficacy. The survey was administered to providers of out-of-school time programs who were implementing the Alliance's HOST Initiative. Survey respondents were 185 out-of-school time program providers (53% response rate). Exploratory factor analysis yielded a 4-factor model that explained 44.7% of the variance. Factors pertained to perceptions of social norms (6 items) and self-efficacy to build support and engage a team (4 items) and create (5 items) and implement (3 items) an action plan. We report initial development and factor analysis of a tool that the Alliance can use to assess the capacity of after-school time program providers, which is critical to targeting capacity-building interventions and assessing their effectiveness. Study findings also will inform the development of measures to assess individual capacity to plan and implement other PSE interventions.

Development of a measure of knowledge use by stakeholders in rehabilitation technology

PubMed Central

Nobrega, Amanda R; Lane, Joseph P; Tomita, Machiko R; Usiak, Douglas J; Lockett, Michelle M

2014-01-01

Objectives: Uptake of new knowledge by diverse and diffuse stakeholders of health-care technology innovations has been a persistent challenge, as has been measurement of this uptake. This article describes the development of the Level of Knowledge Use Survey instrument, a web-based measure of self-reported knowledge use. Methods: The Level of Knowledge Use Survey instrument was developed in the context of assessing effectiveness of knowledge communication strategies in rehabilitation technology. It was validated on samples representing five stakeholder types: researchers, manufacturers, clinician–practitioners, knowledge brokers, and consumers. Its structure is broadly based on Rogers’ stages of innovation adoption. Its item generation was initially guided by Hall et al’s Levels of Use framework. Item selection was based on content validity indices computed from expert ratings (n 1 = 4; n 2 = 3). Five representative stakeholders established usability of the web version. The version included 47 items (content validity index for individual items >0.78; content validity index for a scale or set of items >0.90) in self-reporting format. Psychometrics were then established for the version. Results: Analyses of data from small (n = 69) and large (n = 215) samples using the Level of Knowledge Use Survey instrument suggested a conceptual model of four levels of knowledge use—Non-awareness, Awareness, Interest, and Use. The levels covered eight dimensions and six user action categories. The sequential nature of levels was inconclusive due to low cell frequencies. The Level of Knowledge Use Survey instrument showed adequate content validity (≈ 0.88; n = 3) and excellent test–retest reliability (1.0; n = 69). It also demonstrated good construct validity (n = 215) for differentiating among new knowledge outputs (p < 0.001) and among stakeholder types (0.001 < p ≤ 0.013). It showed strong responsiveness to change between baseline and follow-up testing (0.001 < p ≤ 0.002; n = 215). Conclusion: The Level of Knowledge Use Survey instrument is valid and reliable for measuring uptake of innovations across diffuse stakeholders of rehabilitation technologies and therefore also for tracking changes in knowledge use. PMID:26770743

Development of a Community Readiness Survey for Coalitions to Address Prescription Opioid Misuse

ERIC Educational Resources Information Center

Trudeau, Kimberlee J.

2015-01-01

A community readiness survey for coalitions to address the growing epidemic of prescription opioid misuse was developed in this four-part study. A total of 70 coalition members participated. 1) We conducted 30-minute phone interviews with coalition members (n = 30) and a literature review to develop an item list. 2) Coalition members rated these…

Development of a Self-Report Physical Function Instrument for Disability Assessment: Item Pool Construction and Factor Analysis

PubMed Central

McDonough, Christine M.; Jette, Alan M.; Ni, Pengsheng; Bogusz, Kara; Marfeo, Elizabeth E; Brandt, Diane E; Chan, Leighton; Meterko, Mark; Haley, Stephen M.; Rasch, Elizabeth K.

2014-01-01

Objectives To build a comprehensive item pool representing work-relevant physical functioning and to test the factor structure of the item pool. These developmental steps represent initial outcomes of a broader project to develop instruments for the assessment of function within the context of Social Security Administration (SSA) disability programs. Design Comprehensive literature review; gap analysis; item generation with expert panel input; stakeholder interviews; cognitive interviews; cross-sectional survey administration; and exploratory and confirmatory factor analyses to assess item pool structure. Setting In-person and semi-structured interviews; internet and telephone surveys. Participants A sample of 1,017 SSA claimants, and a normative sample of 999 adults from the US general population. Interventions Not Applicable. Main Outcome Measure Model fit statistics Results The final item pool consisted of 139 items. Within the claimant sample 58.7% were white; 31.8% were black; 46.6% were female; and the mean age was 49.7 years. Initial factor analyses revealed a 4-factor solution which included more items and allowed separate characterization of: 1) Changing and Maintaining Body Position, 2) Whole Body Mobility, 3) Upper Body Function and 4) Upper Extremity Fine Motor. The final 4-factor model included 91 items. Confirmatory factor analyses for the 4-factor models for the claimant and the normative samples demonstrated very good fit. Fit statistics for claimant and normative samples respectively were: Comparative Fit Index = 0.93 and 0.98; Tucker-Lewis Index = 0.92 and 0.98; Root Mean Square Error Approximation = 0.05 and 0.04. Conclusions The factor structure of the Physical Function item pool closely resembled the hypothesized content model. The four scales relevant to work activities offer promise for providing reliable information about claimant physical functioning relevant to work disability. PMID:23542402

Development of a self-report physical function instrument for disability assessment: item pool construction and factor analysis.

PubMed

McDonough, Christine M; Jette, Alan M; Ni, Pengsheng; Bogusz, Kara; Marfeo, Elizabeth E; Brandt, Diane E; Chan, Leighton; Meterko, Mark; Haley, Stephen M; Rasch, Elizabeth K

2013-09-01

To build a comprehensive item pool representing work-relevant physical functioning and to test the factor structure of the item pool. These developmental steps represent initial outcomes of a broader project to develop instruments for the assessment of function within the context of Social Security Administration (SSA) disability programs. Comprehensive literature review; gap analysis; item generation with expert panel input; stakeholder interviews; cognitive interviews; cross-sectional survey administration; and exploratory and confirmatory factor analyses to assess item pool structure. In-person and semistructured interviews and Internet and telephone surveys. Sample of SSA claimants (n=1017) and a normative sample of adults from the U.S. general population (n=999). Not applicable. Model fit statistics. The final item pool consisted of 139 items. Within the claimant sample, 58.7% were white; 31.8% were black; 46.6% were women; and the mean age was 49.7 years. Initial factor analyses revealed a 4-factor solution, which included more items and allowed separate characterization of: (1) changing and maintaining body position, (2) whole body mobility, (3) upper body function, and (4) upper extremity fine motor. The final 4-factor model included 91 items. Confirmatory factor analyses for the 4-factor models for the claimant and the normative samples demonstrated very good fit. Fit statistics for claimant and normative samples, respectively, were: Comparative Fit Index=.93 and .98; Tucker-Lewis Index=.92 and .98; and root mean square error approximation=.05 and .04. The factor structure of the physical function item pool closely resembled the hypothesized content model. The 4 scales relevant to work activities offer promise for providing reliable information about claimant physical functioning relevant to work disability. Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Developing an item bank to measure economic quality of life for individuals with disabilities.

PubMed

Tulsky, David S; Kisala, Pamela A; Lai, Jin-Shei; Carlozzi, Noelle; Hammel, Joy; Heinemann, Allen W

2015-04-01

To develop and evaluate the psychometric properties of an item set measuring economic quality of life (QOL) for use by individuals with disabilities. Survey. Community settings. Individuals with disabilities completed individual interviews (n=64), participated in focus groups (n=172), and completed cognitive interviews (n=15). Inclusion criteria included the following: traumatic brain injury, spinal cord injury, or stroke; age ≥18 years; and ability to read and speak English. We calibrated the items with 305 former rehabilitation inpatients. None. Economic QOL. Confirmatory factor analysis showed acceptable fit indices (comparative fit index=.939, root mean square error of approximation=.089) for the 37 items. However, 3 items demonstrated local item dependence. Dropping 9 items improved fit and obviated local dependence. Rasch analysis of the remaining 28 items yielded a person reliability of .92, suggesting that these items discriminate about 4 economic QOL levels. We developed a 28-item bank that measures economic aspects of QOL. Preliminary confirmatory factor analysis and Rasch analysis results support the psychometric properties of this new measure. It fills a gap in health-related QOL measurement by describing the economic barriers and facilitators of community participation. Future development will make the item bank available as a computer adaptive test. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Survey Page Length and Progress Indicators: What Are Their Relationships to Item Nonresponse?

ERIC Educational Resources Information Center

Bowman, Nicholas A.; Herzog, Serge; Sarraf, Shimon; Tukibayeva, Malika

2014-01-01

The popularity of online student surveys has been associated with greater item nonresponse. This chapter presents research aimed at exploring what factors might help minimize item nonresponse, such as altering online survey page length and using progress indicators.

A Psychometric Investigation of the Multicultural and Special Education Survey: An Exploratory Factor Analysis

ERIC Educational Resources Information Center

Utley, Cheryl A.

2011-01-01

An exploratory factorial analysis of the Multicultural and Special Education Survey (MSES) evaluated the professional development training needs of general and special educators in a midwestern state. Survey items were selected from the culturally and linguistically diverse multicultural, bilingual and special education literature bases (CLD). The…

The Laboratory Course Assessment Survey: A Tool to Measure Three Dimensions of Research-Course Design

ERIC Educational Resources Information Center

Corwin, Lisa A.; Runyon, Christopher; Robinson, Aspen; Dolan, Erin L.

2015-01-01

Course-based undergraduate research experiences (CUREs) are increasingly being offered as scalable ways to involve undergraduates in research. Yet few if any design features that make CUREs effective have been identified. We developed a 17-item survey instrument, the Laboratory Course Assessment Survey (LCAS), that measures students' perceptions…

Designing, Testing, and Validating an Attitudinal Survey on an Environmental Topic: A Groundwater Pollution Survey Instrument for Secondary School Students

ERIC Educational Resources Information Center

Lacosta-Gabari, Idoya; Fernandez-Manzanal, Rosario; Sanchez-Gonzalez, Dolores

2009-01-01

Research in environmental attitudes' assessment has significantly increased in recent years. The development of specific attitude scales for specific environmental problems has often been proposed. This paper describes the Groundwater Pollution Test (GPT), a 19-item survey instrument using a Likert-type scale. The survey has been used with…

Development of a conceptually equivalent Chinese-language translation of the US Household Food Security Survey Module for Chinese immigrants to the USA.

PubMed

Kwan, Christine Ml; Napoles, Anna M; Chou, Jeyling; Seligman, Hilary K

2015-02-01

To develop a conceptually equivalent Chinese-language translation of the eighteen-item US Household Food Security Survey Module. In the current qualitative study, we (i) highlight methodological challenges which arise in developing survey instruments that will be used to make comparisons across language groups and (ii) describe the development of a Chinese-language translation of the US Household Food Security Survey Module, called the San Francisco Chinese Food Security Module. Community sites in San Francisco, CA, USA. We conducted cognitive interviews with twenty-two community members recruited from community sites hosting food pantries and with five professionals recruited from clinical settings. Development of conceptually equivalent surveys can be difficult. We highlight challenges related to dialect, education, literacy (e.g. preferences for more or less formal phrasing), English words and phrases for which there is no Chinese language equivalent (e.g. 'balanced meals' and 'eat less than you felt you should') and response formats. We selected final translations to maximize: (i) consistency of the Chinese translation with the intent of the English version; (ii) clarity; and (iii) similarities in understanding across dialects and literacy levels. Survey translation is essential for conducting research in many communities. The challenges encountered illustrate how literal translations can affect the conceptual equivalence of survey items across languages. Cognitive interview methods should be routinely used for survey translation when such non-equivalence is suspected, such as in surveys addressing highly culturally bound behaviours such as diet and eating behaviours. Literally translated surveys lacking conceptual equivalence may magnify or obscure important health inequalities.

Environmental Literacy and Attitudes among Malaysian Business Educators

ERIC Educational Resources Information Center

Joseph, Corina; Nichol, Esmie Obrin; Janggu, Tamoi; Madi, Nero

2013-01-01

Purpose: The purpose of this paper is to examine the level of environmental literacy among business lecturers in Malaysia. Design/methodology/approach: A survey, which involved a combination of newly developed items and items adopted from past studies, was used to collect data from 35 respondents (out of 70). Findings: The overall mean score for…

[Case Study] CityCenter and Cosmopolitan Construction Projects, Las Vegas, Nevada: lessons learned from the use of multiple sources and mixed methods in a safety needs assessment.

PubMed

Gittleman, Janie L; Gardner, Paige C; Haile, Elizabeth; Sampson, Julie M; Cigularov, Konstantin P; Ermann, Erica D; Stafford, Pete; Chen, Peter Y

2010-06-01

The present study describes a response to eight tragic deaths over an eighteen month times span on a fast track construction project on the largest commercial development project in U.S. history. Four versions of a survey were distributed to workers, foremen, superintendents, and senior management. In addition to standard Likert-scale safety climate scale items, an open-ended item was included at the end of the survey. Safety climate perceptions differed by job level. Specifically, management perceived a more positive safety climate as compared to workers. Content analysis of the open-ended item was used to identify important safety and health concerns which might have been overlooked with the qualitative portion of the survey. The surveys were conducted to understand workforce issues of concern with the aim of improving site safety conditions. Such efforts can require minimal investment of resources and time and result in critical feedback for developing interventions affecting organizational structure, management processes, and communication. The most important lesson learned was that gauging differences in perception about site safety can provide critical feedback at all levels of a construction organization. Implementation of multi-level organizational perception surveys can identify major safety issues of concern. Feedback, if acted upon, can potentially result in fewer injuries and fatal events. (c) 2010 Elsevier Ltd. All rights reserved.

Competitive foods available in Pennsylvania public high schools.

PubMed

Probart, Claudia; McDonnell, Elaine; Weirich, J Elaine; Hartman, Terryl; Bailey-Davis, Lisa; Prabhakher, Vaheedha

2005-08-01

This study examined the types and extent of competitive foods available in public high schools in Pennsylvania. We developed, pilot tested, and distributed surveys to school foodservice directors in a random sample of 271 high schools in Pennsylvania. Two hundred twenty-eight surveys were returned, for a response rate of 84%. Statistical analyses were performed: Descriptive statistics were used to examine the extent of competitive food sales in Pennsylvania public high schools. The survey data were analyzed using SPSS software version 11.5.1 (2002, SPSS base 11.0 for Windows, SPSS Inc, Chicago, IL). A la carte sales provide almost dollar 700/day to school foodservice programs, almost 85% of which receive no financial support from their school districts. The top-selling a la carte items are "hamburgers, pizza, and sandwiches." Ninety-four percent of respondents indicated that vending machines are accessible to students. The item most commonly offered in vending machines is bottled water (71.5%). While food items are less often available through school stores and club fund-raisers, candy is the item most commonly offered through these sources. Competitive foods are widely available in high schools. Although many of the items available are low in nutritional value, we found several of the top-selling a la carte options to be nutritious and bottled water the item most often identified as available through vending machines.

Findings from a novel approach to publication guideline revision: user road testing of a draft version of SQUIRE 2.0

PubMed Central

Davies, Louise; Donnelly, Kyla Z; Goodman, Daisy J; Ogrinc, Greg

2016-01-01

Background The Standards for Quality Improvement Reporting Excellence (SQUIRE) Guideline was published in 2008 (SQUIRE 1.0) and was the first publication guideline specifically designed to advance the science of healthcare improvement. Advances in the discipline of improvement prompted us to revise it. We adopted a novel approach to the revision by asking end-users to ‘road test’ a draft version of SQUIRE 2.0. The aim was to determine whether they understood and implemented the guidelines as intended by the developers. Methods Forty-four participants were assigned a manuscript section (ie, introduction, methods, results, discussion) and asked to use the draft Guidelines to guide their writing process. They indicated the text that corresponded to each SQUIRE item used and submitted it along with a confidential survey. The survey examined usability of the Guidelines using Likert-scaled questions and participants’ interpretation of key concepts in SQUIRE using open-ended questions. On the submitted text, we evaluated concordance between participants’ item usage/interpretation and the developers’ intended application. For the survey, the Likert-scaled responses were summarised using descriptive statistics and the open-ended questions were analysed by content analysis. Results Consistent with the SQUIRE Guidelines’ recommendation that not every item be included, less than one-third (n=14) of participants applied every item in their section in full. Of the 85 instances when an item was partially used or was omitted, only 7 (8.2%) of these instances were due to participants not understanding the item. Usage of Guideline items was highest for items most similar to standard scientific reporting (ie, ‘Specific aim of the improvement’ (introduction), ‘Description of the improvement’ (methods) and ‘Implications for further studies’ (discussion)) and lowest (<20% of the time) for those unique to healthcare improvement (ie, ‘Assessment methods for context factors that contributed to success or failure’ and ‘Costs and strategic trade-offs’). Items unique to healthcare improvement, specifically ‘Evolution of the improvement’, ‘Context elements that influenced the improvement’, ‘The logic on which the improvement was based’, ‘Process and outcome measures’, demonstrated poor concordance between participants’ interpretation and developers’ intended application. Conclusions User testing of a draft version of SQUIRE 2.0 revealed which items have poor concordance between developer intent and author usage, which will inform final editing of the Guideline and development of supporting supplementary materials. It also identified the items that require special attention when teaching about scholarly writing in healthcare improvement. PMID:26263916

Measuring attributes of health literate health care organizations from the patients' perspective: Development and validation of a questionnaire to assess health literacy-sensitive communication (HL-COM).

PubMed

Ernstmann, Nicole; Halbach, Sarah; Kowalski, Christoph; Pfaff, Holger; Ansmann, Lena

2017-04-01

Studies addressing the organizational contexts of care that may help increase the patients' ability to cope with a disease and to navigate through the health care system are still rare. Especially instruments allowing the assessment of such organizational efforts from the patients' perspective are missing. The aim of our study was to develop a survey instrument assessing organizational health literacy (HL) from the patients' perspective, i. e., health care organizations' responsiveness to patients' individual needs. A pool of 30 items was developed by a group of experts based on a literature review. The items were developed, tested and prioritized according to their importance in 11 semi-structured interviews and cognitive think-aloud interviews with cancer patients. The resulting 16 items were rated in a standardized postal survey involving a total of N=453 colon and breast cancer patients treated in cancer centers in Germany. An exploratory factor analysis, a confirmatory factor analysis and structural equation modelling were conducted. Item properties were analyzed. 83.2 % of the patients were diagnosed with breast cancer, 16.8 % had a diagnosis of colon cancer. The patients' mean age was 61 (26-88), 89.4 % were female. The most common comorbidities were hypertension (34.0 %) and cardiovascular disease (11.0 %). The final prediction model included nine items measuring the degree of health literacy-sensitivity of communication. The model showed an acceptable model fit. The nine items showed corrected item-total correlations between .622 and .762 and item difficulties between 0.77 and 0.87. Cronbach's α was .912. In a comprehensive development process, the original item pool comprising several aspects of organizational HL was reduced to a one-dimensional scale. The instrument measures an important aspect of organizational HL; i.e., the degree of health literacy-sensitivity of communication (HL-COM). HL-COM was found to impact patient enablement, mediated through the support by physicians. Future research will have to test these associations in the context of other diseases or institutions. Copyright © 2017. Published by Elsevier GmbH.

Changes in Transformational Leadership and Empirical Quality Outcomes in a Finnish Hospital over a Two-Year Period: A Longitudinal Study

PubMed Central

Mäntynen, Raija; Vehviläinen-Julkunen, Katri; Partanen, Pirjo; Turunen, Hannele; Miettinen, Merja; Kvist, Tarja

2014-01-01

This paper describes the changes in transformational leadership and quality outcomes that occurred between 2008 and 2011 in a Finnish university hospital that is aiming to meet the Magnet standards. Measurements were conducted in 2008-2009 and subsequently in 2010-2011 by surveying nursing staff and patients. Nursing staff were surveyed using web-based surveys to collect data on transformational leadership (n 1 = 499, n 2 = 498) and patient safety culture (n 1 = 234, n 2 = 512) and using both postal and web-based surveys to gather information on job satisfaction (n 1 = 1176, n 2 = 779). Questionnaires were used to collect data on care satisfaction from patients (n 1 = 678, n 2 = 867). Transformational leadership was measured using the 54-item TLS, job satisfaction with the 37-item KUHJSS, patient safety culture with the 42-item HSPSC, and patient satisfaction using the 42-item RHCS questionnaire. Transformational leadership, which was the weakest area, was at the same level between the two measurement occasions. Job satisfaction scores increased between 2008 and 2010, although they were generally excellent in 2008. The scores for nonpunitive responses to errors and events reported were also higher in the 2010-2011 surveys. The highest empirical outcome scores related to patient satisfaction. The project and the development initiatives undertaken since 2008 seem to have had positive effects on empirical quality outcomes. PMID:25009744

Core competency model for the family planning public health nurse.

PubMed

Hewitt, Caroline M; Roye, Carol; Gebbie, Kristine M

2014-01-01

A core competency model for family planning public health nurses has been developed, using a three stage Delphi Method with an expert panel of 40 family planning senior administrators, community/public health nursing faculty and seasoned family planning public health nurses. The initial survey was developed from the 2011 Title X Family Planning program priorities. The 32-item survey was distributed electronically via SurveyMonkey(®). Panelist attrition was low, and participation robust resulting in the final 28-item model, suggesting that the Delphi Method was a successful technique through which to achieve consensus. Competencies with at least 75% consensus were included in the model and those competencies were primarily related to education/counseling and administration of medications and contraceptives. The competencies identified have implications for education/training, certification and workplace performance. © 2014 Wiley Periodicals, Inc.

What constitutes patient safety culture in Chinese hospitals?

PubMed

Zhu, Junya; Li, Liping; Li, Yuxia; Shi, Meiyu; Lu, Haiying; Garnick, Deborah W; Weingart, Saul N

2012-06-01

To develop a patient safety culture instrument for use in Chinese hospitals, we assessed the appropriateness of existing safety culture questionnaires used in the USA and Japan for Chinese respondents and identified new items and domains suitable to Chinese hospitals. Focus group study. Twenty-four physicians, nurses and other health-care workers from 11 hospitals in three Chinese cities. Three focus groups were conducted in 2010 to elicit information from hospital workers about their perceptions of the appropriateness and importance of each of 97 questionnaire items, derived from a literature review and an expert panel, characterizing hospital safety culture. understood the concepts of patient safety and safety culture and identified features associated with safe care. They judged that numerous questions from existing surveys were inappropriate, including 39 items that were dropped because they were judged unimportant, semantically redundant, confusing, ambiguous or inapplicable in Chinese settings. Participants endorsed eight new items and three additional dimensions addressing staff training, mentoring of new hires, compliance with rules and procedures, equipment availability and leadership walk-rounds they judged appropriate to assessing safety culture in Chinese hospitals. This process resulted in a 66-item instrument for testing in cognitive interviews, the next stage of survey development. Focus group participants provided important insights into the refinement of existing items and the construction of new items for measuring patient safety culture in Chinese hospitals. This is a necessary first step in producing a culturally appropriate instrument applicable to specific local contexts.

The Development of an Emotional Response to Literature Measure: The Affective Response to Literature Survey

ERIC Educational Resources Information Center

Fischer, Ronald G.; Fischer, Jerome M.

2006-01-01

Based on theories of emotional intelligence, adult education, psychology of reading, and emotions and literature, this study was designed to develop and validate the Affective Response to Literature Survey (ARLS), a psychological instrument used to measure an emotional response to literature. Initially, 27 items were generated by a review of…

The Development of a Student Survey on Attitudes towards Mathematics Teaching-Learning Processes

ERIC Educational Resources Information Center

Mutohir, Toho Cholik; Lowrie, Tom; Patahuddin, Sitti Maesuri

2018-01-01

This study aimed to develop a survey instrument to measure student attitudes towards mathematics teaching-learning processes that is appropriate for the Indonesian context. This study consisted of two phases: Phase 1 (n = 320) was a pilot study to assess the suitability of the instrument items for Indonesian students. Phase 2 (n = 1001) was…

Development of Rasch-based item banks for the assessment of work performance in patients with musculoskeletal diseases.

PubMed

Mueller, Evelyn A; Bengel, Juergen; Wirtz, Markus A

2013-12-01

This study aimed to develop a self-description assessment instrument to measure work performance in patients with musculoskeletal diseases. In terms of the International Classification of Functioning, Disability and Health (ICF), work performance is defined as the degree of meeting the work demands (activities) at the actual workplace (environment). To account for the fact that work performance depends on the work demands of the job, we strived to develop item banks that allow a flexible use of item subgroups depending on the specific work demands of the patients' jobs. Item development included the collection of work tasks from literature and content validation through expert surveys and patient interviews. The resulting 122 items were answered by 621 patients with musculoskeletal diseases. Exploratory factor analysis to ascertain dimensionality and Rasch analysis (partial credit model) for each of the resulting dimensions were performed. Exploratory factor analysis resulted in four dimensions, and subsequent Rasch analysis led to the following item banks: 'impaired productivity' (15 items), 'impaired cognitive performance' (18), 'impaired coping with stress' (13) and 'impaired physical performance' (low physical workload 20 items, high physical workload 10 items). The item banks exhibited person separation indices (reliability) between 0.89 and 0.96. The assessment of work performance adds the activities component to the more commonly employed participation component of the ICF-model. The four item banks can be adapted to specific jobs where necessary without losing comparability of person measures, as the item banks are based on Rasch analysis.

The Long-Term Conditions Questionnaire: conceptual framework and item development.

PubMed

Peters, Michele; Potter, Caroline M; Kelly, Laura; Hunter, Cheryl; Gibbons, Elizabeth; Jenkinson, Crispin; Coulter, Angela; Forder, Julien; Towers, Ann-Marie; A'Court, Christine; Fitzpatrick, Ray

2016-01-01

To identify the main issues of importance when living with long-term conditions to refine a conceptual framework for informing the item development of a patient-reported outcome measure for long-term conditions. Semi-structured qualitative interviews (n=48) were conducted with people living with at least one long-term condition. Participants were recruited through primary care. The interviews were transcribed verbatim and analyzed by thematic analysis. The analysis served to refine the conceptual framework, based on reviews of the literature and stakeholder consultations, for developing candidate items for a new measure for long-term conditions. Three main organizing concepts were identified: impact of long-term conditions, experience of services and support, and self-care. The findings helped to refine a conceptual framework, leading to the development of 23 items that represent issues of importance in long-term conditions. The 23 candidate items formed the first draft of the measure, currently named the Long-Term Conditions Questionnaire. The aim of this study was to refine the conceptual framework and develop items for a patient-reported outcome measure for long-term conditions, including single and multiple morbidities and physical and mental health conditions. Qualitative interviews identified the key themes for assessing outcomes in long-term conditions, and these underpinned the development of the initial draft of the measure. These initial items will undergo cognitive testing to refine the items prior to further validation in a survey.

Differential Item Functioning in Primary Healthcare Evaluation Instruments by French/English Version, Educational Level and Urban/Rural Location

PubMed Central

Haggerty, Jeannie L.; Bouharaoui, Fatima; Santor, Darcy A.

2011-01-01

Evaluating the extent to which groups or subgroups of individuals differ with respect to primary healthcare experience depends on first ruling out the possibility of bias. Objective: To determine whether item or subscale performance differs systematically between French/English, high/low education subgroups and urban/rural residency. Method: A sample of 645 adult users balanced by French/English language (in Quebec and Nova Scotia, respectively), high/low education and urban/rural residency responded to six validated instruments: the Primary Care Assessment Survey (PCAS); the Primary Care Assessment Tool – Short Form (PCAT-S); the Components of Primary Care Index (CPCI); the first version of the EUROPEP (EUROPEP-I); the Interpersonal Processes of Care Survey, version II (IPC-II); and part of the Veterans Affairs National Outpatient Customer Satisfaction Survey (VANOCSS). We normalized subscale scores to a 0-to-10 scale and tested for between-group differences using ANOVA tests. We used a parametric item response model to test for differences between subgroups in item discriminability and item difficulty. We re-examined group differences after removing items with differential item functioning. Results: Experience of care was assessed more positively in the English-speaking (Nova Scotia) than in the French-speaking (Quebec) respondents. We found differential English/French item functioning in 48% of the 153 items: discriminability in 20% and differential difficulty in 28%. English items were more discriminating generally than the French. Removing problematic items did not change the differences in French/English assessments. Differential item functioning by high/low education status affected 27% of items, with items being generally more discriminating in high-education groups. Between-group comparisons were unchanged. In contrast, only 9% of items showed differential item functioning by geography, affecting principally the accessibility attribute. Removing problematic items reversed a previously non-significant finding, revealing poorer first-contact access in rural than in urban areas. Conclusion: Differential item functioning does not bias or invalidate French/English comparisons on subscales, but additional development is required to make French and English items equivalent. These instruments are relatively robust by educational status and geography, but results suggest potential differences in the underlying construct in low-education and rural respondents. PMID:23205035

The development and exploratory analysis of the Back Pain Attitudes Questionnaire (Back-PAQ)

PubMed Central

Darlow, Ben; Perry, Meredith; Mathieson, Fiona; Stanley, James; Melloh, Markus; Marsh, Reginald; Baxter, G David; Dowell, Anthony

2014-01-01

Objectives To develop an instrument to assess attitudes and underlying beliefs about back pain, and subsequently investigate its internal consistency and underlying structures. Design The instrument was developed by a multidisciplinary team of clinicians and researchers based on analysis of qualitative interviews with people experiencing acute and chronic back pain. Exploratory analysis was conducted using data from a population-based cross-sectional survey. Setting Qualitative interviews with community-based participants and subsequent postal survey. Participants Instrument development informed by interviews with 12 participants with acute back pain and 11 participants with chronic back pain. Data for exploratory analysis collected from New Zealand residents and citizens aged 18 years and above. 1000 participants were randomly selected from the New Zealand Electoral Roll. 602 valid responses were received. Measures The 34-item Back Pain Attitudes Questionnaire (Back-PAQ) was developed. Internal consistency was evaluated by the Cronbach α coefficient. Exploratory analysis investigated the structure of the data using Principal Component Analysis. Results The 34-item long form of the scale had acceptable internal consistency (α=0.70; 95% CI 0.66 to 0.73). Exploratory analysis identified five two-item principal components which accounted for 74% of the variance in the reduced data set: ‘vulnerability of the back’; ‘relationship between back pain and injury’; ‘activity participation while experiencing back pain’; ‘prognosis of back pain’ and ‘psychological influences on recovery’. Internal consistency was acceptable for the reduced 10-item scale (α=0.61; 95% CI 0.56 to 0.66) and the identified components (α between 0.50 and 0.78). Conclusions The 34-item long form of the scale may be appropriate for use in future cross-sectional studies. The 10-item short form may be appropriate for use as a screening tool, or an outcome assessment instrument. Further testing of the 10-item Back-PAQ's construct validity, reliability, responsiveness to change and predictive ability needs to be conducted. PMID:24860003

A novel nonparametric item response theory approach to measuring socioeconomic position: a comparison using household expenditure data from a Vietnam health survey, 2003

PubMed Central

2014-01-01

Background Measures of household socio-economic position (SEP) are widely used in health research. There exist a number of approaches to their measurement, with Principal Components Analysis (PCA) applied to a basket of household assets being one of the most common. PCA, however, carries a number of assumptions about the distribution of the data which may be untenable, and alternative, non-parametric, approaches may be preferred. Mokken scale analysis is a non-parametric, item response theory approach to scale development which appears never to have been applied to household asset data. A Mokken scale can be used to rank order items (measures of wealth) as well as households. Using data on household asset ownership from a national sample of 4,154 consenting households in the World Health Survey from Vietnam, 2003, we construct two measures of household SEP. Seventeen items asking about assets, and utility and infrastructure use were used. Mokken Scaling and PCA were applied to the data. A single item measure of total household expenditure is used as a point of contrast. Results An 11 item scale, out of the 17 items, was identified that conformed to the assumptions of a Mokken Scale. All the items in the scale were identified as strong items (Hi > .5). Two PCA measures of SEP were developed as a point of contrast. One PCA measure was developed using all 17 available asset items, the other used the reduced set of 11 items identified in the Mokken scale analaysis. The Mokken Scale measure of SEP and the 17 item PCA measure had a very high correlation (r = .98), and they both correlated moderately with total household expenditure: r = .59 and r = .57 respectively. In contrast the 11 item PCA measure correlated moderately with the Mokken scale (r = .68), and weakly with the total household expenditure (r = .18). Conclusion The Mokken scale measure of household SEP performed at least as well as PCA, and outperformed the PCA measure developed with the 11 items used in the Mokken scale. Unlike PCA, Mokken scaling carries no assumptions about the underlying shape of the distribution of the data, and can be used simultaneous to order household SEP and items. The approach, however, has not been tested with data from other countries and remains an interesting, but under researched approach. PMID:25126103

A novel nonparametric item response theory approach to measuring socioeconomic position: a comparison using household expenditure data from a Vietnam health survey, 2003.

PubMed

Reidpath, Daniel D; Ahmadi, Keivan

2014-01-01

Measures of household socio-economic position (SEP) are widely used in health research. There exist a number of approaches to their measurement, with Principal Components Analysis (PCA) applied to a basket of household assets being one of the most common. PCA, however, carries a number of assumptions about the distribution of the data which may be untenable, and alternative, non-parametric, approaches may be preferred. Mokken scale analysis is a non-parametric, item response theory approach to scale development which appears never to have been applied to household asset data. A Mokken scale can be used to rank order items (measures of wealth) as well as households. Using data on household asset ownership from a national sample of 4,154 consenting households in the World Health Survey from Vietnam, 2003, we construct two measures of household SEP. Seventeen items asking about assets, and utility and infrastructure use were used. Mokken Scaling and PCA were applied to the data. A single item measure of total household expenditure is used as a point of contrast. An 11 item scale, out of the 17 items, was identified that conformed to the assumptions of a Mokken Scale. All the items in the scale were identified as strong items (Hi > .5). Two PCA measures of SEP were developed as a point of contrast. One PCA measure was developed using all 17 available asset items, the other used the reduced set of 11 items identified in the Mokken scale analaysis. The Mokken Scale measure of SEP and the 17 item PCA measure had a very high correlation (r = .98), and they both correlated moderately with total household expenditure: r = .59 and r = .57 respectively. In contrast the 11 item PCA measure correlated moderately with the Mokken scale (r = .68), and weakly with the total household expenditure (r = .18). The Mokken scale measure of household SEP performed at least as well as PCA, and outperformed the PCA measure developed with the 11 items used in the Mokken scale. Unlike PCA, Mokken scaling carries no assumptions about the underlying shape of the distribution of the data, and can be used simultaneous to order household SEP and items. The approach, however, has not been tested with data from other countries and remains an interesting, but under researched approach.

Development and Testing of a Revised Cooking Matters for Adults Survey.

PubMed

Pinard, Courtney A; Uvena, Laura M; Quam, Julia B; Smith, Teresa M; Yaroch, Amy L

2015-11-01

The purpose of this study was to: (1) develop and psychometrically test a survey designed to assess Cooking Matters for Adults (CMA); and (2) assess changes in outcomes from pre- to post-pilot testing in English-speaking CMA classes to support the construct validity of the survey. Cognitive interviewing participants were drawn from a low-income convenience sample in Omaha, Nebraska (N = 21). The survey included items to assess dietary patterns and choices, sociodemographics, and psychosocial correlates. Analyses were conducted with SPSS and included descriptive statistics, exploratory factor analysis, Cronbach's alpha, and paired sample t-tests. Cognitive interviewing resulted in changes to survey layout and wording. Factor analysis revealed 4 actors with Cronbach alphas supporting internal consistency. Between pretest and posttest, fruit intake increased (p < .05) and non-fried potatoes decreased (p < .05). Selection of healthy dietary options (low-fat dairy and milk, sodium, lean meats; p's < .05), healthy food preparation (p < .001), and cooking confidence (p < .001) increased and perceived barriers to cooking (p < .01) decreased. The CMA Survey includes psychometrically sound items and positive self-reported changes. This survey can be a valuable resource for other similar programs.

AIPS technology survey report

NASA Technical Reports Server (NTRS)

Ogletree, Glenn (Editor)

1984-01-01

The results of a technology survey conducted for the NASA/JSC by the CSDL during Phase 1 of the NASA Advanced Information Processing System (AIPS) program at the CSDL are discussed. The purpose of the survey was to ensure that all technology relevant to the configuration, design, development, verification, implementation, and validation of an advanced information processing system, whether existing or under development and soon to be available, would be duly considered in the development of the AIPS. The emphasis in the survey was on technology items which were clearly relevant to the AIPS. Requirements were developed which guided the planning of contacts with the outside sources to be surveyed, and established practical limits on the scope and content of the Technology Survey. Subjects surveyed included architecture, software, hardware, methods for evaluation of reliability and performance, and methods for the verification of the AIPS design and the validation of the AIPS implementation. Survey requirements and survey results in each of these areas are presented, including analyses of the potential effects on the AIPS development process of using or not using the surveyed technology items. Another output of the survey was the identification of technology areas of particular relevance to the AIPS and for which further development, in some cases by the CSDL and in some cases by the NASA, would be fruitful. Appendices are provided in which are presented: (1) reports of some of the actual survey interactions with industrial and other outside information sources; (2) the literature list from the comprehensive literature survey which was conducted; (3) reduced-scale images of an excerpt ('Technology Survey' viewgraphs) from the set of viewgraphs used at the 14 April 1983 Preliminary Requirements Review by the CSDL for the NASA; and (4) reduced-scale images of the set of viewgraphs used in the AIPS Technology Survey Review presentation to the NASA monitors by the CSDL at the NASA Langley Research Center on 28 Sep. 1983.

Development of a short version of the new brief job stress questionnaire.

PubMed

Inoue, Akiomi; Kawakami, Norito; Shimomitsu, Teruichi; Tsutsumi, Akizumi; Haratani, Takashi; Yoshikawa, Toru; Shimazu, Akihito; Odagiri, Yuko

2014-01-01

This study was aimed to investigate the test-retest reliability and validity of a short version of the New Brief Job Stress Questionnaire (New BJSQ) whose scales have one item selected from a standard version. Based on the results from an anonymous web-based questionnaire of occupational health staffs and personnel/labor staffs, we selected higher-priority scales from the standard version. After selecting one item with highest item-total correlation coefficient from each scale, a 23-item questionnaire was developed. A nationally representative survey was administered to Japanese employees (n=1,633) to examine test-retest reliability and validity. Most scales (or items) showed modest but adequate levels of test-retest reliability (r>0.50). Furthermore, job demands and job resources scales (or items) were associated with mental and physical stress reactions while job resources scales (or items) were also associated with positive outcomes. These findings provided a piece of evidence that the short version of the New BJSQ is reliable and valid.

Development of a Short Version of the New Brief Job Stress Questionnaire

PubMed Central

INOUE, Akiomi; KAWAKAMI, Norito; SHIMOMITSU, Teruichi; TSUTSUMI, Akizumi; HARATANI, Takashi; YOSHIKAWA, Toru; SHIMAZU, Akihito; ODAGIRI, Yuko

2014-01-01

This study was aimed to investigate the test-retest reliability and validity of a short version of the New Brief Job Stress Questionnaire (New BJSQ) whose scales have one item selected from a standard version. Based on the results from an anonymous web-based questionnaire of occupational health staffs and personnel/labor staffs, we selected higher-priority scales from the standard version. After selecting one item with highest item-total correlation coefficient from each scale, a 23-item questionnaire was developed. A nationally representative survey was administered to Japanese employees (n=1,633) to examine test-retest reliability and validity. Most scales (or items) showed modest but adequate levels of test-retest reliability (r>0.50). Furthermore, job demands and job resources scales (or items) were associated with mental and physical stress reactions while job resources scales (or items) were also associated with positive outcomes. These findings provided a piece of evidence that the short version of the New BJSQ is reliable and valid. PMID:24975108

ARABIC TRANSLATION AND ADAPTATION OF THE HOSPITAL CONSUMER ASSESSMENT OF HEALTHCARE PROVIDERS AND SYSTEMS (HCAHPS) PATIENT SATISFACTION SURVEY INSTRUMENT.

PubMed

Dockins, James; Abuzahrieh, Ramzi; Stack, Martin

2015-01-01

To translate and adapt an effective, validated, benchmarked, and widely used patient satisfaction measurement tool for use with an Arabic-speaking population. Translation of survey's items, survey administration process development, evaluation of reliability, and international benchmarking Three hundred-bed tertiary care hospital in Jeddah, Saudi Arabia. 645 patients discharged during 2011 from the hospital's inpatient care units. INTERVENTIONS; The Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) instrument was translated into Arabic, a randomized weekly sample of patients was selected, and the survey was administered via telephone during 2011 to patients or their relatives. Scores were compiled for each of the HCAHPS questions and then for each of the six HCAHPS clinical composites, two non-clinical items, and two global items. Clinical composite scores, as well as the two non-clinical and two global items were analyzed for the 645 respondents. Clinical composites were analyzed using Spearman's correlation coefficient and Cronbach's alpha to demonstrate acceptable internal consistency for these items and scales demonstrated acceptable internal consistency for the clinical composites. (Spearman's correlation coefficient = 0.327 - 0.750, P < 0.01; Cronbach's alpha = 0.516 - 0.851) All ten HCAHPS measures were compared quarterly to US national averages with results that closely paralleled the US benchmarks. . The Arabic translation and adaptation of the HCAHPS is a valid, reliable, and feasible tool for evaluation and benchmarking of inpatient satisfaction in Arabic speaking populations.

Development of the UK Engagement Survey

ERIC Educational Resources Information Center

Kandiko Howson, Camille; Buckley, Alex

2017-01-01

Student engagement has become a key feature of UK higher education, but until recently there has been a lack of data to track, benchmark and drive enhancement. In 2015 the first full administration ran in the UK a range of survey items drawn from the US-based National Survey of Student Engagement (NSSE). This is the latest example of international…

Item Response Theory in the context of Improving Student Reasoning

NASA Astrophysics Data System (ADS)

Goddard, Chase; Davis, Jeremy; Pyper, Brian

2011-10-01

We are interested to see if Item Response Theory can help to better inform the development of reasoning ability in introductory physics. A first pass through our latest batch of data from the Heat and Temperature Conceptual Evaluation, the Lawson Classroom Test of Scientific Reasoning, and the Epistemological Beliefs About Physics Survey may help in this effort.

Operationalization of a Frame of Reference for Studying Organizational Culture in Middle Schools.

ERIC Educational Resources Information Center

Daniel, Larry G.

A frame of reference for studying culture in middle schools was developed. Items for the Middle School Description Survey (MSDS), which was designed to test elements of the ideal middle school culture, were created based on middle school advocacy literature. The items were conceptually categorized according to E. H. Schein's (1985) cultural…

Healthcare providers' knowledge and attitudes about rapid tissue donation (RTD): phase one of establishing a rapid tissue donation programme in thoracic oncology.

PubMed

Schabath, Matthew B; McIntyre, Jessica; Pratt, Christie; Gonzalez, Luis E; Munoz-Antonia, Teresita; Haura, Eric B; Quinn, Gwendolyn P

2014-02-01

In preparation for the development of a rapid tissue donation (RTD) programme, we surveyed healthcare providers (HCPs) in our institution about knowledge and attitudes related to RTD with lung cancer patients. A 31-item web based survey was developed collecting data on demographics, knowledge and attitudes about RTD. The survey contained three items measuring participants' knowledge about RTD, five items assessing attitudes towards RTD recruitment and six items assessing HCPs' level of agreement with factors influencing decisions to discuss RTD. Response options were presented on a 5-point Likert scale. Ninety-one HCPs participated in the study. 66% indicated they had never heard of RTD prior to the survey, 78% rated knowledge of RTD as none or limited and 95.6% reported not having ethical or religious concerns about discussing RTD with patients. The majority were either not comfortable (17.8%) or not sure if they felt comfortable discussing RTD with cancer patients (42.2%). 56.1% indicated their knowledge of RTD would play an integral role in their decision to discuss RTD with patients. 71.4% reported concerns with RTD discussion and the emotional state of the patient. Physicians and nurses play an important role in initiating conversations about recruitment and donation to research that can ultimately influence uptake. Increasing HCP knowledge about RTD is a necessary step towards building an RTD programme. Our study provides important information about characteristics associated with low levels of knowledge and practice related to RTD where additional education and training may be warranted.

Towards global consensus on core outcomes for hidradenitis suppurativa research: an update from the HISTORIC consensus meetings I and II*

PubMed Central

Thorlacius, L.; Garg, A.; Ingram, J.R.; Villumsen, B.; Riis, P. Theut; Gottlieb, A.B.; Merola, J.F.; Dellavalle, R.; Ardon, C.; Baba, R.; Bechara, F.G.; Cohen, A.D.; Daham, N.; Davis, M.; Emtestam, L.; Fernández-Peñas, P.; Filippelli, M.; Gibbons, A.; Grant, T.; Guilbault, S.; Gulliver, S.; Harris, C; Harvent, C.; Houston, K.; Kirby, J.S.; Matusiak, L.; Mehdizadeh, A.; Mojica, T.; Okun, M.; Orgill, D.; Pallack, L.; Parks-Miller, A.; Prens, E.P.; Randell, S.; Rogers, C.; Rosen, C.F.; Choon, S.E.; van der Zee, H.H.; Christensen, R.; Jemec, G.B.E.

2018-01-01

Summary Background A core outcomes set (COS) is an agreed minimum set of outcomes that should be measured and reported in all clinical trials for a specific condition. Hidradenitis suppurativa (HS) has no agreed-upon COS. A central aspect in the COS development process is to identify a set of candidate outcome domains from a long list of items. Our long list had been developed from patient interviews, a systematic review of the literature and a healthcare professional survey, and initial votes had been cast in two e-Delphi surveys. In this manuscript, we describe two in-person consensus meetings of Delphi participants designed to ensure an inclusive approach to generation of domains from related items. Objectives To consider which items from a long list of candidate items to exclude and which to cluster into outcome domains. Methods The study used an international and multistakeholder approach, involving patients, dermatologists, surgeons, the pharmaceutical industry and medical regulators. The study format was a combination of formal presentations, small group work based on nominal group theory and a subsequent online confirmation survey. Results Forty-one individuals from 13 countries and four continents participated. Nine items were excluded and there was consensus to propose seven domains: disease course, physical signs, HS-specific quality of life, satisfaction, symptoms, pain and global assessments. Conclusions The HISTORIC consensus meetings I and II will be followed by further e-Delphi rounds to finalize the core domain set, building on the work of the in-person consensus meetings. PMID:29080368

Programme Reporting Standards (PRS) for improving the reporting of sexual, reproductive, maternal, newborn, child and adolescent health programmes.

PubMed

Kågesten, Anna E; Tunçalp, Özge; Portela, Anayda; Ali, Moazzam; Tran, Nhan; Gülmezoglu, A Metin

2017-08-03

Information about design, implementation, monitoring and evaluation is central to understand the impact of programmes within the field of sexual, reproductive, maternal, newborn, child and adolescent health (SRMNCAH). Existing reporting guidelines do not orient on reporting of contextual and implementation issues in sufficient detail. We therefore developed Programme Reporting Standards (PRS) to be used by SRMNCAH programme implementers and researchers. Building on the first step of the PRS development (a systematic review to identify reporting items), we conducted a three-round online Delphi consensus survey with experts. Consensus was defined a-priori as 80% agreement of items as essential. This was followed by a technical consultation with a group of experts to refine the items, definitions and their structuring. The revised PRS was piloted to assess its relevance to current SRMNCAH programme reports and identify key issues regarding the use of the PRS. Of the 81 participants invited to the Delphi survey, 20 responded to all three rounds. In the final round, 27 items received consensus as essential; three items were ranked as "borderline" essential; 20 items as supplementary. The items were subsequently revised, followed by a technical consultation with 29 experts to further review and refine the PRS. The feedback resulted in substantial changes to the structure and content of the PRS into 24 items across five domains: Programme overview; Programme components and implementation; Monitoring of Implementation; Evaluation and Results; and Synthesis. This version was used in a piloting exercise, where questions regarding how much information to report and how to comment on the quality of the information reported were addressed. All items were kept in the PRS following the pilot although minor changes were made to the flow and description of items. The PRS 1.0 is the result of a structured, collaborative process, including methods to incorporate input from SRMNCAH stakeholders. The World Health Organization will develop a document that explains the items in greater detail, and will also apply the PRS to on-going initiatives. We welcome continuous input from the field, while it is being used, to improve its relevance and usefulness.

LC-PROM: Validation of a patient reported outcomes measure for liver cirrhosis patients.

PubMed

Zhang, Ying; Yang, Yuanyuan; Lv, Jing; Zhang, Yanbo

2016-05-10

The aim of the study is to develop a specific patient-reported scale of liver cirrhosis according to the Patient Reported Outcome guidelines of the Food and Drug Administration (FDA), and to examine its capacity to fill gaps in this field. A conceptual framework was developed and a preliminary item pool developed through literature review and interviews of 10 patients with liver cirrhosis. With the preliminary items, we performed a pilot survey that included a cognitive test with patients and interviews with experts; the focus was on content and language of the scale. In the item selection stage, seven statistical methods including discrete trends method, discrimination analysis, exploratory factor analysis, Cronbach's α coefficient, correlation coefficient, test-retest reliability, Item-Response Theory were applied to survey data from 200 subjects (150 liver cirrhosis patients and 50 controls). This produced the preliminary Liver Cirrhosis Patient-reported Outcome Measure (LC-PROM). In the next stage, we conducted the survey with 620 subjects (500 patients and 120 controls) to validate reliability, validity and acceptability of this scale. The 55 items and 13 dimensions addressed four domains: physical, psychological, social, and therapeutic. Cronbach's α coefficients were 0.921 for the total scale; the confirmatory factor analysis, t-tests and ANOVA supported scale validity; the model fit index as Root Mean Square Error of Approximation (RMSEA), Root Mean Square Residual (RMR), Normed Fit Index (NFI), Non-Normed Fit Index (NNFI), Comparative Fit Index (CFI) and Incremental Fit Index (IFI) met the criterion generally. The acceptance ratio and response rate indicated good feasibility. This study developed an accurate and stable patient-reported outcome scale of liver cirrhosis, which is able to evaluate clinical effects effectively, is helpful to patients in recognizing their health condition, and contributes to clinical decision making both for patients and physicians. Additionally, the LC-PROM can perform as an ultimate assessment of medical and health care effects and can inform clinical trials of new drugs for liver cirrhosis.

Development of a patient safety climate survey for Chinese hospitals: cross-national adaptation and psychometric evaluation.

PubMed

Zhu, Junya; Li, Liping; Zhao, Hailei; Han, Guangshu; Wu, Albert W; Weingart, Saul N

2014-10-01

Existing patient safety climate instruments, most of which have been developed in the USA, may not accurately reflect the conditions in the healthcare systems of other countries. To develop and evaluate a patient safety climate instrument for healthcare workers in Chinese hospitals. Based on a review of existing instruments, expert panel review, focus groups and cognitive interviews, we developed items relevant to patient safety climate in Chinese hospitals. The draft instrument was distributed to 1700 hospital workers from 54 units in six hospitals in five Chinese cities between July and October 2011, and 1464 completed surveys were received. We performed exploratory and confirmatory factor analyses and estimated internal consistency reliability, within-unit agreement, between-unit variation, unit-mean reliability, correlation between multi-item composites, and association between the composites and two single items of perceived safety. The final instrument included 34 items organised into nine composites: institutional commitment to safety, unit management support for safety, organisational learning, safety system, adequacy of safety arrangements, error reporting, communication and peer support, teamwork and staffing. All composites had acceptable unit-mean reliabilities (≥0.74) and within-unit agreement (Rwg ≥0.71), and exhibited significant between-unit variation with intraclass correlation coefficients ranging from 9% to 21%. Internal consistency reliabilities ranged from 0.59 to 0.88 and were ≥0.70 for eight of the nine composites. Correlations between composites ranged from 0.27 to 0.73. All composites were positively and significantly associated with the two perceived safety items. The Chinese Hospital Survey on Patient Safety Climate demonstrates adequate dimensionality, reliability and validity. The integration of qualitative and quantitative methods is essential to produce an instrument that is culturally appropriate for Chinese hospitals. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Trends in Sexual Orientation Missing Data Over a Decade of the California Health Interview Survey

PubMed Central

Viana, Joseph; Grant, David; Cochran, Susan D.; Lee, Annie C.; Ponce, Ninez A.

2015-01-01

Objectives. We explored changes in sexual orientation question item completion in a large statewide health survey. Methods. We used 2003 to 2011 California Health Interview Survey data to investigate sexual orientation item nonresponse and sexual minority self-identification trends in a cross-sectional sample representing the noninstitutionalized California household population aged 18 to 70 years (n = 182 812 adults). Results. Asians, Hispanics, limited-English-proficient respondents, and those interviewed in non-English languages showed the greatest declines in sexual orientation item nonresponse. Asian women, regardless of English-proficiency status, had the highest odds of item nonresponse. Spanish interviews produced more nonresponse than English interviews and Asian-language interviews produced less nonresponse when we controlled for demographic factors and survey cycle. Sexual minority self-identification increased in concert with the item nonresponse decline. Conclusions. Sexual orientation nonresponse declines and the increase in sexual minority identification suggest greater acceptability of sexual orientation assessment in surveys. Item nonresponse rate convergence among races/ethnicities, language proficiency groups, and interview languages shows that sexual orientation can be measured in surveys of diverse populations. PMID:25790399

Development of post-disaster psychosocial evaluation and intervention for children: Results of a South Korean delphi panel survey

PubMed Central

Lee, Mi-Sun; Hwang, Jun-Won; Lee, Cheol-Soon; Kim, Ji-Youn; Lee, Ju-Hyun; Kim, Eunji; Chang, Hyoung Yoon; Bae, SeungMin; Park, Jang-Ho

2018-01-01

Objective This study aimed to administer a Delphi panel survey and provide evidence for the development of a psychological intervention protocol for use after disasters in South Korea. Method A three-round Delphi survey was conducted. In all rounds, respondents answered open- or closed-ended questions regarding their views on i) the concept of disaster, ii) evaluation, iii) intervention, and iv) considerations in a disaster. Data from Round 1 were subjected to content analysis. In Round 2, items with content validity ratios (CVRs) greater than 0.49 were included, and in Round 3, items with a CVR≥0.38 were accepted. Results The response rates for the Delphi survey were high: 83% (n = 15, Round 1), 80% (n = 16, Round 2), and 86% (n = 24, Round 3). The data collected during this survey showed a need for a support system for children; for preventive strategies, including disaster readiness plans; for the protection of children's safety; and for the development of post-disaster psychosocial care. Conclusions The panel experts reached a consensus regarding the steps they considered critical in post-disaster evaluation and intervention. The findings suggest a unified model for advancing the development of the Korean version of an intervention protocol for children and adolescents exposed to traumatic events. PMID:29596483

Developing an oropharyngeal cancer (OPC) knowledge and behaviors survey.

PubMed

Dodd, Virginia J; Riley Iii, Joseph L; Logan, Henrietta L

2012-09-01

To use the community participation research model to (1) develop a survey assessing knowledge about mouth and throat cancer and (2) field test and establish test-retest reliability with newly developed instrument. Cognitive interviews with primarily rural African American adults to assess their perception and interpretation of survey items. Test-retest reliability was established with a racially diverse rural population. Test-retest reliabilities ranged from .79 to .40 for screening awareness and .74 to .19 for knowledge. Coefficients increased for composite scores. Community participation methodology provided a culturally appropriate survey instrument that demonstrated acceptable levels of reliability.

Development of a conceptually equivalent Chinese-language translation of the US Household Food Security Survey Module for Chinese immigrants to the USA

PubMed Central

Kwan, Christine ML; Napoles, Anna M; Chou, Jeyling; Seligman, Hilary K

2014-01-01

Objective To develop a conceptually equivalent Chinese-language translation of the eighteen-item US Household Food Security Survey Module. Design In the current qualitative study, we (i) highlight methodological challenges which arise in developing survey instruments that will be used to make comparisons across language groups and (ii) describe the development of a Chinese-language translation of the US Household Food Security Survey Module, called the San Francisco Chinese Food Security Module. Setting Community sites in San Francisco, CA, USA. Subjects We conducted cognitive interviews with twenty-two community members recruited from community sites hosting food pantries and with five professionals recruited from clinical settings. Results Development of conceptually equivalent surveys can be difficult. We highlight challenges related to dialect, education, literacy (e.g. preferences for more or less formal phrasing), English words and phrases for which there is no Chinese language equivalent (e.g. ‘balanced meals’ and ‘eat less than you felt you should’) and response formats. We selected final translations to maximize: (i) consistency of the Chinese translation with the intent of the English version; (ii) clarity; and (iii) similarities in understanding across dialects and literacy levels. Conclusions Survey translation is essential for conducting research in many communities. The challenges encountered illustrate how literal translations can affect the conceptual equivalence of survey items across languages. Cognitive interview methods should be routinely used for survey translation when such non-equivalence is suspected, such as in surveys addressing highly culturally bound behaviours such as diet and eating behaviours. Literally translated surveys lacking conceptual equivalence may magnify or obscure important health inequalities. PMID:24642365

A Survey of Equipment in the Singing Voice Studio and Its Perceived Effectiveness by Vocologists and Student Singers.

PubMed

Gerhard, Julia; Rosow, David E

2016-05-01

Speech-language pathologists have long used technology for the clinical measurement of the speaking voice, but present research shows that vocal pedagogues and voice students are becoming more accepting of technology in the studio. As a result, the equipment and technology used in singing voice studios by speech-language pathologists and vocal pedagogues are changing. Although guides exist regarding equipment and technology necessary for developing a voice laboratory and private voice studio, there are no data documenting the current implementation of these items and their perceived effectiveness. This study seeks to document current trends in equipment used in voice laboratories and studios. Two separate surveys were distributed to 60 vocologists and approximately 300 student singers representative of the general singing student population. The surveys contained questions about the inventory of items found in voice studios and perceived effectiveness of these items. Data were analyzed using descriptive analyses and statistical analyses when applicable. Twenty-six of 60 potential vocologists responded, and 66 student singers responded. The vocologists reported highly uniform inventories and ratings of studio items. There were wide-ranging differences between the inventories reported by the vocologist and student singer groups. Statistically significant differences between ratings of effectiveness of studio items were found for 11 of the 17 items. In all significant cases, vocologists rated usefulness to be higher than student singers. Although the order of rankings of vocologists and student singers was similar, a much higher percentage of vocologists report the items as being efficient and effective than students. The historically typical studio items, including the keyboard and mirror, were ranked as most effective by both vocologists and student singers. Copyright © 2016 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Measurement of household food security in the USA and other industrialised countries.

PubMed

Radimer, Kathy L; Radimer, Kathy L

2002-12-01

To describe the history and current status of household food security measurement. In the 1980s evidence of rising levels of hunger was a concern for many, but disputed by some, Americans. Acknowledgement and quantification of hunger was hindered by the lack of an accepted definition and measure of hunger. Qualitative research at Cornell provided a conceptual framework, description, definition and survey items for hunger. The Community Childhood Hunger Identification Project developed an instrument used in numerous communities. Based upon these initiatives, widely accepted definitions of hunger and food insecurity, and the US Household Food Security Module for its measurement, now exist. The module classifies households as food-secure, or food-insecure without hunger or with moderate or severe hunger, and contains household-, adult- and child-referent items. Its inclusion in the Current Population Survey (CPS) since 1995 has yielded annual estimates of food insecurity. A six-item short form of the module, for surveys with severe time constraints, classifies households only as food-secure or food-insecure without or with hunger and contains no child-specific items. Surveys using the 18-item or short-form module can compare results with published national data from the CPS. Information about the module is available at http://www.ers.usda.gov/briefing/foodsecurity and http://www.fns.usda/fsec. Current research on food security measurement includes measurement of individual food insecurity and hunger, module performance regarding hunger duration and frequency, performance of the module in population sub-groups, and the effect of translations on module meaning and performance. National surveys in Canada, New Zealand and Australia also have measured food security.

Improving the Validity and Reliability of a Health Promotion Survey for Physical Therapists

PubMed Central

Stephens, Jaca L.; Lowman, John D.; Graham, Cecilia L.; Morris, David M.; Kohler, Connie L.; Waugh, Jonathan B.

2013-01-01

Purpose Physical therapists (PTs) have a unique opportunity to intervene in the area of health promotion. However, no instrument has been validated to measure PTs’ views on health promotion in physical therapy practice. The purpose of this study was to evaluate the content validity and test-retest reliability of a health promotion survey designed for PTs. Methods An expert panel of PTs assessed the content validity of “The Role of Health Promotion in Physical Therapy Survey” and provided suggestions for revision. Item content validity was assessed using the content validity ratio (CVR) as well as the modified kappa statistic. Therapists then participated in the test-retest reliability assessment of the revised health promotion survey, which was assessed using a weighted kappa statistic. Results Based on feedback from the expert panelists, significant revisions were made to the original survey. The expert panel reached at least a majority consensus agreement for all items in the revised survey and the survey-CVR improved from 0.44 to 0.66. Only one item on the revised survey had substantial test-retest agreement, with 55% of the items having moderate agreement and 43% poor agreement. Conclusions All items on the revised health promotion survey demonstrated at least fair validity, but few items had reasonable test-retest reliability. Further modifications should be made to strengthen the validity and improve the reliability of this survey. PMID:23754935

Oropharyngeal dysphagia: surveying practice patterns of the speech-language pathologist.

PubMed

Martino, Rosemary; Pron, Gaylene; Diamant, Nicholas E

2004-01-01

The present study was designed to obtain a comprehensive view of the dysphagia assessment practice patterns of speech-language pathologists and their opinion on the importance of these practices using survey methods and taking into consideration clinician, patient, and practice-setting variables. A self-administered mail questionnaire was developed following established methodology to maximize response rates. Eight dysphagia experts independently rated the new survey for content validity. Test-retest reliability was assessed with a random sample of 23 participants. The survey was sent to 50 speech-language pathologists randomly selected from the Canadian professional association database of members who practice in dysphagia. Surveys were mailed according to the Dillman Total Design Method and included an incentive offer. High survey (64%) and item response (95%) rates were achieved and clinicians were reliable reporters of their practice behaviors (ICC>0.60). Of all the clinical assessment items, 36% were reported with high (>80%) utilization and 24% with low (<20%) utilization, the former pertaining to tongue motion and vocal quality after food/fluid intake and the latter to testing of oral sensation without food. One-third (33%) of instrumental assessment items were highly utilized and included assessment of bolus movement and laryngeal response to bolus misdirection. Overall, clinician experience and teaching institutions influenced greater utilization. Opinions of importance were similar to utilization behaviors (r = 0.947, p = 0.01). Of all patients referred for dysphagia assessment, full clinical assessments were administered to 71% of patients but instrumental assessments to only 36%. A hierarchical model of practice behavior is proposed to explain this pattern of progressively decreasing item utilization.

Development of the parental needs scale for rare diseases: a tool for measuring the supportive care needs of parents caring for a child with a rare disease.

PubMed

Pelentsov, Lemuel J; Fielder, Andrea L; Laws, Thomas A; Esterman, Adrian J

2016-01-01

Children and families affected by rare diseases have received scant consideration from the medical, scientific, and political communities, with parents' needs especially having received little attention. Affected parents often have limited access to information and support and appropriate health care services. While scales to measure the needs of parents of children with chronic illnesses have been developed, there have been no previous attempts to develop a scale to assess the needs of parents of children with rare diseases. To develop a scale for measuring the supportive care needs of parents of children with rare diseases. A total of 301 responses to our Parental Needs Survey were randomly divided into two halves, one for exploratory factor analysis and the other for confirmatory factor analysis (CFA). After removing unsuitable items, exploratory factor analysis was undertaken to determine the factor structure of the data. CFA using structural equation modeling was then undertaken to confirm the factor structure. Seventy-two items were entered into the CFA, with a scree plot showing a likely four-factor solution. The results provided four independent subscales of parental needs: Understanding the disease (four items); Working with health professionals (four items); Emotional issues (three items); and Financial needs (three items). The structural equation modeling confirmed the suitability of the four-factor solution and demonstrated that the four subscales could be added to provide an overall scale of parental need. This is the first scale developed to measure the supportive care needs of parents of children with rare diseases. The scale is suitable for use in surveys to develop policy, in individual clinical assessments, and, potentially, for evaluating new programs. Measuring the supportive care needs of parents caring for a child with a rare disease will hopefully lead to better physical and psychological health outcomes for parents and their affected children.

Development of a Medication Safety and Quality Survey for Small Rural Hospitals.

PubMed

Winterstein, Almut G; Johns, Thomas E; Campbell, Kyle N; Libby, Joel; Pannell, Bob

2017-12-01

We summarize the development and initial implementation of a survey tool to assess medication safety in small rural hospitals. As part of an ongoing rural hospital medication safety improvement program, we developed a survey tool in all 13 critical access hospitals (CAHs) in Florida. The survey was compiled from existing medication safety assessments and standards, clinical practice guidelines, and published literature. Survey items were selected based on considerations regarding practicality and relevance to the CAH setting.The final survey instrument included 134 items representing 17 medication safety domains. Overall hospital scores ranged from 41% to 95%, with a median of 59%. Most hospitals showed large variation in scores across domains, with 5 hospitals having at least 1 domain with scores less than 10%. Highest scores across all facilities were seen for safety procedures concerning high-alert or look-alike medications and the assembly of emergency carts. The lowest median scores included availability and consistent use of standardized order sets and the effective implementation of medication safety committees. Most hospitals used the survey results to identify and prioritize quality improvement activities. The survey can be used to conduct a short medication safety assessment specific to a limited number of areas and services in CAHs. It showed good ability to discriminate medication safety levels across participating sites and highlighted opportunities for improvement. It may need modification if case mix or services differ in other states or if the status quo of medication safety in CAHs or related standards advance. The described process of survey development might be helpful to support such modifications.

"How Do I Quantify This?" Students Reflect on Survey Items Related to Diversity and Cross-Racial Interaction

ERIC Educational Resources Information Center

Park, Julie J.; Buckley, Jessica Belue; Koo, Katie

2017-01-01

Given the critical significance of empirical studies of diversity, it is important for researchers and assessment practitioners to gain insight into how students are interpreting and answering survey items that have noteworthy implications for policy and practice. To examine how students make meaning of survey items related to diversity, we…

"Don't know" responses to risk perception measures: implications for underserved populations.

PubMed

Waters, Erika A; Hay, Jennifer L; Orom, Heather; Kiviniemi, Marc T; Drake, Bettina F

2013-02-01

Risk perceptions are legitimate targets for behavioral interventions because they can motivate medical decisions and health behaviors. However, some survey respondents may not know (or may not indicate) their risk perceptions. The scope of "don't know" (DK) responding is unknown. Examine the prevalence and correlates of responding DK to items assessing perceived risk of colorectal cancer. Two nationally representative, population-based, cross-sectional surveys (2005 National Health Interview Survey [NHIS]; 2005 Health Information National Trends Survey [HINTS]), and one primary care clinic-based survey comprised of individuals from low-income communities. Analyses included 31,202 (NHIS), 1,937 (HINTS), and 769 (clinic) individuals. Five items assessed perceived risk of colorectal cancer. Four of the items differed in format and/or response scale: comparative risk (NHIS, HINTS); absolute risk (HINTS, clinic), and "likelihood" and "chance" response scales (clinic). Only the clinic-based survey included an explicit DK response option. "Don't know" responding was 6.9% (NHIS), 7.5% (HINTS-comparative), and 8.7% (HINTS-absolute). "Don't know" responding was 49.1% and 69.3% for the "chance" and "likely" response options (clinic). Correlates of DK responding were characteristics generally associated with disparities (e.g., low education), but the pattern of results varied among samples, question formats, and response scales. The surveys were developed independently and employed different methodologies and items. Consequently, the results were not directly comparable. There may be multiple explanations for differences in the magnitude and characteristics of DK responding. "Don't know" responding is more prevalent in populations affected by health disparities. Either not assessing or not analyzing DK responses could further disenfranchise these populations and negatively affect the validity of research and the efficacy of interventions seeking to eliminate health disparities.

Measuring children's self-reported sport participation, risk perception and injury history: development and validation of a survey instrument.

PubMed

Siesmaa, Emma J; Blitvich, Jennifer D; White, Peta E; Finch, Caroline F

2011-01-01

Despite the health benefits associated with children's sport participation, the occurrence of injury in this context is common. The extent to which sport injuries impact children's ongoing involvement in sport is largely unknown. Surveys have been shown to be useful for collecting children's injury and sport participation data; however, there are currently no published instruments which investigate the impact of injury on children's sport participation. This study describes the processes undertaken to assess the validity of two survey instruments for collecting self-reported information about child cricket and netball related participation, injury history and injury risk perceptions, as well as the reliability of the cricket-specific version. Face and content validity were assessed through expert feedback from primary and secondary level teachers and from representatives of peak sporting bodies for cricket and netball. Test-retest reliability was measured using a sample of 59 child cricketers who completed the survey on two occasions, 3-4 weeks apart. Based on expert feedback relating to face and content validity, modification and/or deletion of some survey items was undertaken. Survey items with low test-retest reliability (κ≤0.40) were modified or deleted, items with moderate reliability (κ=0.41-0.60) were modified slightly and items with higher reliability (κ≥0.61) were retained, with some undergoing minor modifications. This is the first survey of its kind which has been successfully administered to cricketers aged 10-16 years to collect information about injury risk perceptions and intentions for continued sport participation. Implications for its generalisation to other child sport participants are discussed. Copyright © 2010 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Hardware survey for the avionics test bed

NASA Technical Reports Server (NTRS)

Cobb, J. M.

1981-01-01

A survey of maor hardware items that could possibly be used in the development of an avionics test bed for space shuttle attached or autonomous large space structures was conducted in NASA Johnson Space Center building 16. The results of the survey are organized to show the hardware by laboratory usage. Computer systems in each laboratory are described in some detail.

The development and initial validation of a questionnaire to measure help-seeking behaviour in patients with new onset rheumatoid arthritis.

PubMed

Stack, Rebecca J; Mallen, Christian D; Deighton, Chris; Kiely, Patrick; Shaw, Karen L; Booth, Alison; Kumar, Kanta; Thomas, Susan; Rowan, Ian; Horne, Rob; Nightingale, Peter; Herron-Marx, Sandy; Jinks, Clare; Raza, Karim

2015-12-01

Early treatment for rheumatoid arthritis (RA) is vital. However, people often delay in seeking help at symptom onset. An assessment of the reasons behind patient delay is necessary to develop interventions to promote rapid consultation. Using a mixed methods design, we aimed to develop and test a questionnaire to assess the barriers to help seeking at RA onset. Questionnaire items were extracted from previous qualitative studies. Fifteen people with a lived experience of arthritis participated in focus groups to enhance the questionnaire's face validity. The questionnaire was also reviewed by groups of multidisciplinary health-care professionals. A test-retest survey of 41 patients with newly presenting RA or unclassified arthritis assessed the questionnaire items' intraclass correlations. During focus groups, participants rephrased questions, added questions and deleted items not relevant to the questionnaire's aims. Participants organized items into themes: early symptom experience, initial reactions to symptoms, self-management behaviours, causal beliefs, involvement of significant others, pre-diagnosis knowledge about RA, direct barriers to seeking help and relationship with GP. The test-retest survey identified seven items (out of 79) with low intraclass correlations which were removed from the final questionnaire. The involvement of people with a lived experience of arthritis and multidisciplinary health-care professionals in the preliminary validation of the DELAY (delays in evaluating arthritis early) questionnaire has enriched its development. Preliminary assessment established its reliability. The DELAY questionnaire provides a tool for researchers to evaluate individual, cultural and health service barriers to help-seeking behaviour at RA onset. © 2014 John Wiley & Sons Ltd.

Cultural Resources Survey of the Angelina Revetment Item, St. James Parish, Louisiana.

DTIC Science & Technology

1986-10-22

Corps G) of Engineers O New Oreans Dist 0 N In CULTURAL RESOURCES SURVEY OF THE ANGELINA REVETMENT ITEM, ST. JAMES . PARISH, LOUISIANA. FINAL REPORT...PD-86/0 3 AF Go 4. TITLE (ad S-belde) S. TYPE OF REPORT & PENIOO COVERED Cultural Resources Survey of the Final Angelina Revetment Item, St. James...the Angelina Revetment Item, adjacent to the Mississippi River channel, during August and September, 1985. b-The area was settled during the Spanish

Compendium of highway safety questionnaire items

DOT National Transportation Integrated Search

1980-09-29

This survey compendium contains questionnaire items and results (when furnished) that were used in state and national surveys during the period 1976 to 1980. The compendium is organized by safety issues into item groups that reflect drivers' attitude...

Poisson and negative binomial item count techniques for surveys with sensitive question.

PubMed

Tian, Guo-Liang; Tang, Man-Lai; Wu, Qin; Liu, Yin

2017-04-01

Although the item count technique is useful in surveys with sensitive questions, privacy of those respondents who possess the sensitive characteristic of interest may not be well protected due to a defect in its original design. In this article, we propose two new survey designs (namely the Poisson item count technique and negative binomial item count technique) which replace several independent Bernoulli random variables required by the original item count technique with a single Poisson or negative binomial random variable, respectively. The proposed models not only provide closed form variance estimate and confidence interval within [0, 1] for the sensitive proportion, but also simplify the survey design of the original item count technique. Most importantly, the new designs do not leak respondents' privacy. Empirical results show that the proposed techniques perform satisfactorily in the sense that it yields accurate parameter estimate and confidence interval.

Self-Report Measures of the Home Learning Environment in Large Scale Research: Measurement Properties and Associations with Key Developmental Outcomes

ERIC Educational Resources Information Center

Niklas, Frank; Nguyen, Cuc; Cloney, Daniel S.; Tayler, Collette; Adams, Raymond

2016-01-01

Favourable home learning environments (HLEs) support children's literacy, numeracy and social development. In large-scale research, HLE is typically measured by self-report survey, but there is little consistency between studies and many different items and latent constructs are observed. Little is known about the stability of these items and…

Effect of Items Direction (Positive or Negative) on the Factorial Construction and Criterion Related Validity in Likert Scale

ERIC Educational Resources Information Center

Naji Qasem, Mamun Ali; Ahmad Gul, Showkeen Bilal

2014-01-01

The study was conducted to know the effect of items direction (positive or negative) on the factorial construction and criterion related validity in Likert scale. The descriptive survey research method was used for the study and the sample consisted of 510 undergraduate students selected by used random sampling technique. A scale developed by…

How Do Teachers Make Judgments about Ethical and Unethical Behaviors? Toward the Development of a Code of Conduct for Teachers

ERIC Educational Resources Information Center

Barrett, David E.; Casey, J. Elizabeth; Visser, Ryan D.; Headley, Kathy N.

2012-01-01

The authors examined the dimensions that underlie teachers' judgments about ethical versus unethical behaviors. 593 educators and teachers in training were administered a 41 item survey. For each item, respondents rated the extent to which they believed the behavior (a) occurred frequently and (b) represented a serious violation of professional…

Development of the Children's Scale of Hostility and Aggression: Reactive/Proactive (C-SHARP).

PubMed

Farmer, Cristan A; Aman, Michael G

2009-01-01

Whereas some scales exist for assessing aggression in typically developing children, they do not give a detailed analysis, and none is available for populations with developmental disabilities (DD). Parents of 365 children with DD completed the Children's Scale of Hostility and Aggression: Reactive/Proactive (C-SHARP), which surveys the severity of aggressive and hostile behaviors (Problem Scale) in addition to their proactive or reactive qualities (the Provocation Scale). Factor analysis yielded a 5-factor solution: I. Verbal Aggression (12 items), II. Bullying (12 items), III. Covert Aggression (11 items), IV. Hostility (9 items), and V. Physical Aggression (8 items). Coefficient alpha ranged from moderate (0.74, Physical Aggression) to high (0.92, Verbal Aggression). General validity was supported by expected differences between age and gender groups. Preliminary normative data were presented. The C-SHARP appears to be a promising tool for assessing aggression and hostility in children with DD.

The Long-Term Conditions Questionnaire: conceptual framework and item development

PubMed Central

Peters, Michele; Potter, Caroline M; Kelly, Laura; Hunter, Cheryl; Gibbons, Elizabeth; Jenkinson, Crispin; Coulter, Angela; Forder, Julien; Towers, Ann-Marie; A’Court, Christine; Fitzpatrick, Ray

2016-01-01

Purpose To identify the main issues of importance when living with long-term conditions to refine a conceptual framework for informing the item development of a patient-reported outcome measure for long-term conditions. Materials and methods Semi-structured qualitative interviews (n=48) were conducted with people living with at least one long-term condition. Participants were recruited through primary care. The interviews were transcribed verbatim and analyzed by thematic analysis. The analysis served to refine the conceptual framework, based on reviews of the literature and stakeholder consultations, for developing candidate items for a new measure for long-term conditions. Results Three main organizing concepts were identified: impact of long-term conditions, experience of services and support, and self-care. The findings helped to refine a conceptual framework, leading to the development of 23 items that represent issues of importance in long-term conditions. The 23 candidate items formed the first draft of the measure, currently named the Long-Term Conditions Questionnaire. Conclusion The aim of this study was to refine the conceptual framework and develop items for a patient-reported outcome measure for long-term conditions, including single and multiple morbidities and physical and mental health conditions. Qualitative interviews identified the key themes for assessing outcomes in long-term conditions, and these underpinned the development of the initial draft of the measure. These initial items will undergo cognitive testing to refine the items prior to further validation in a survey. PMID:27621678

Choosing Wisely: the American College of Rheumatology's Top 5 for pediatric rheumatology.

PubMed

Rouster-Stevens, Kelly A; Ardoin, Stacy P; Cooper, Ashley M; Becker, Mara L; Dragone, Leonard L; Huttenlocher, Anna; Jones, Karla B; Kolba, Karen S; Moorthy, L Nandini; Nigrovic, Peter A; Stinson, Jennifer N; Ferguson, Polly J

2014-05-01

To create a pediatric rheumatology Top 5 list as part of the American Board of Internal Medicine Foundation's Choosing Wisely campaign. Delphi surveys of a core group of representative pediatric rheumatology providers from across North America generated candidate Top 5 items. Items with high content agreement and perceived to be of prevalent use and of high impact were included in a survey of all American College of Rheumatology (ACR) members who identified themselves as providing care to pediatric patients. Items with the highest ratings were subjected to literature review and further evaluation. A total of 121 candidate items were proposed in the initial Delphi survey and were reduced to 28 items in subsequent surveys. These 28 items were sent to 1,198 rheumatology providers who care for pediatric patients, and 397 (33%) responded. Based upon survey data and literature review, the Top 5 items were identified. These items focused on testing for antinuclear antibodies, autoantibody panels, Lyme disease, methotrexate toxicity monitoring, and use of routine radiographs. The ACR pediatric rheumatology Top 5 is one of the first pediatric subspecialty-specific Choosing Wisely Top 5 lists and provides an opportunity for patients and providers to discuss appropriate use of health care in pediatric rheumatology. Copyright © 2014 by the American College of Rheumatology.

An international measure of awareness and beliefs about cancer: development and testing of the ABC

PubMed Central

Simon, Alice E; Forbes, Lindsay J L; Boniface, David; Warburton, Fiona; Brain, Kate E; Dessaix, Anita; Donnelly, Michael; Haynes, Kerry; Hvidberg, Line; Lagerlund, Magdalena; Petermann, Lisa; Tishelman, Carol; Vedsted, Peter; Vigmostad, Maria Nyre; Wardle, Jane; Ramirez, Amanda J

2012-01-01

Objectives To develop an internationally validated measure of cancer awareness and beliefs; the awareness and beliefs about cancer (ABC) measure. Design and setting Items modified from existing measures were assessed by a working group in six countries (Australia, Canada, Denmark, Norway, Sweden and the UK). Validation studies were completed in the UK, and cross-sectional surveys of the general population were carried out in the six participating countries. Participants Testing in UK English included cognitive interviewing for face validity (N=10), calculation of content validity indexes (six assessors), and assessment of test–retest reliability (N=97). Conceptual and cultural equivalence of modified (Canadian and Australian) and translated (Danish, Norwegian, Swedish and Canadian French) ABC versions were tested quantitatively for equivalence of meaning (≥4 assessors per country) and in bilingual cognitive interviews (three interviews per translation). Response patterns were assessed in surveys of adults aged 50+ years (N≥2000) in each country. Main outcomes Psychometric properties were evaluated through tests of validity and reliability, conceptual and cultural equivalence and systematic item analysis. Test–retest reliability used weighted-κ and intraclass correlations. Construction and validation of aggregate scores was by factor analysis for (1) beliefs about cancer outcomes, (2) beliefs about barriers to symptomatic presentation, and item summation for (3) awareness of cancer symptoms and (4) awareness of cancer risk factors. Results The English ABC had acceptable test–retest reliability and content validity. International assessments of equivalence identified a small number of items where wording needed adjustment. Survey response patterns showed that items performed well in terms of difficulty and discrimination across countries except for awareness of cancer outcomes in Australia. Aggregate scores had consistent factor structures across countries. Conclusions The ABC is a reliable and valid international measure of cancer awareness and beliefs. The methods used to validate and harmonise the ABC may serve as a methodological guide in international survey research. PMID:23253874

Reliability of a survey tool for measuring consumer nutrition environment in urban food stores.

PubMed

Hosler, Akiko S; Dharssi, Aliza

2011-01-01

Despite the increase in the volume and importance of food environment research, there is a general lack of reliable measurement tools. This study presents the development and reliability assessment of a tool for measuring consumer nutrition environment in urban food stores. Cross-sectional design. A racially diverse downtown portion (6 ZIP code areas) in Albany, New York. A sample of 39 food stores was visited by our research team in 2009 to 2010. These stores were randomly selected from 123 eligible food stores identified through multiple government lists and ground-truthing. The Food Retail Outlet Survey Tool was developed to assess the presence of selected food and nonfood items, placement, milk prices, physical characteristics of the store, policy implementation, and advertisements on outside windows. For in-store items, agreement of observations between experienced and lightly trained surveyors was assessed. For window advertisement assessments, inter-method agreement (on-site sketch vs digital photo), and inter-rater agreement (both on-site) among lightly trained surveyors were evaluated. Percent agreement, Kappa, and prevalence-adjusted bias-adjusted kappa were calculated for in-store observations. Interclass correlation coefficients were calculated for window observations. Twenty-seven of the 47 in-store items had 100% agreement. The prevalence-adjusted bias-adjusted kappa indicated excellent agreement (≥0.90) on all items, except aisle width (0.74) and dark-green/orange colored fresh vegetables (0.85). The store type (nonconvenience store), the order of visits (first half), and the time to complete survey (>10 minutes) were associated with lower reliability in these 2 items. Both the inter-method and inter-rater agreements for window advertisements were uniformly high (intraclass correlation coefficient ranged 0.94-1.00), indicating high reliability. The Food Retail Outlet Survey Tool is a reliable tool for quickly measuring consumer nutrition environment. It can be effectively used by an individual who attended a 30-minute group briefing and practiced with 3 to 4 stores.

Student Learning in Student Services Extended Opportunity Program & Services

ERIC Educational Resources Information Center

Soltani, Parisa

2013-01-01

The purpose of this mixed methods study was to investigate the relationship between student learning and participation in Equal Opportunity Programs and Services (EOP&S) at Irvine Valley College (IVC). An embedded survey design was developed using William Sedlacek's non-cognitive questionnaire (NCQ), items from the Community College Survey of…

Job Satisfaction of Employees at a Christian University

ERIC Educational Resources Information Center

Schroder, Ralph

2008-01-01

As part of this quantitative study, a survey questionnaire was mailed out to 835 university employees to measure levels of overall, intrinsic, and extrinsic job satisfaction. The survey included items of the Professional Satisfaction Scale, an instrument developed according to Herzberg's two-factor theory. Responses were measured on a 5-point…

Development and initial evaluation of the SCI-FI/AT

PubMed Central

Jette, Alan M.; Slavin, Mary D.; Ni, Pengsheng; Kisala, Pamela A.; Tulsky, David S.; Heinemann, Allen W.; Charlifue, Susie; Tate, Denise G.; Fyffe, Denise; Morse, Leslie; Marino, Ralph; Smith, Ian; Williams, Steve

2015-01-01

Objectives To describe the domain structure and calibration of the Spinal Cord Injury Functional Index for samples using Assistive Technology (SCI-FI/AT) and report the initial psychometric properties of each domain. Design Cross sectional survey followed by computerized adaptive test (CAT) simulations. Setting Inpatient and community settings. Participants A sample of 460 adults with traumatic spinal cord injury (SCI) stratified by level of injury, completeness of injury, and time since injury. Interventions None Main outcome measure SCI-FI/AT Results Confirmatory factor analysis (CFA) and Item response theory (IRT) analyses identified 4 unidimensional SCI-FI/AT domains: Basic Mobility (41 items) Self-care (71 items), Fine Motor Function (35 items), and Ambulation (29 items). High correlations of full item banks with 10-item simulated CATs indicated high accuracy of each CAT in estimating a person's function, and there was high measurement reliability for the simulated CAT scales compared with the full item bank. SCI-FI/AT item difficulties in the domains of Self-care, Fine Motor Function, and Ambulation were less difficult than the same items in the original SCI-FI item banks. Conclusion With the development of the SCI-FI/AT, clinicians and investigators have available multidimensional assessment scales that evaluate function for users of AT to complement the scales available in the original SCI-FI. PMID:26010975

Development and initial evaluation of the SCI-FI/AT.

PubMed

Jette, Alan M; Slavin, Mary D; Ni, Pengsheng; Kisala, Pamela A; Tulsky, David S; Heinemann, Allen W; Charlifue, Susie; Tate, Denise G; Fyffe, Denise; Morse, Leslie; Marino, Ralph; Smith, Ian; Williams, Steve

2015-05-01

To describe the domain structure and calibration of the Spinal Cord Injury Functional Index for samples using Assistive Technology (SCI-FI/AT) and report the initial psychometric properties of each domain. Cross sectional survey followed by computerized adaptive test (CAT) simulations. Inpatient and community settings. A sample of 460 adults with traumatic spinal cord injury (SCI) stratified by level of injury, completeness of injury, and time since injury. None SCI-FI/AT RESULTS: Confirmatory factor analysis (CFA) and Item response theory (IRT) analyses identified 4 unidimensional SCI-FI/AT domains: Basic Mobility (41 items) Self-care (71 items), Fine Motor Function (35 items), and Ambulation (29 items). High correlations of full item banks with 10-item simulated CATs indicated high accuracy of each CAT in estimating a person's function, and there was high measurement reliability for the simulated CAT scales compared with the full item bank. SCI-FI/AT item difficulties in the domains of Self-care, Fine Motor Function, and Ambulation were less difficult than the same items in the original SCI-FI item banks. With the development of the SCI-FI/AT, clinicians and investigators have available multidimensional assessment scales that evaluate function for users of AT to complement the scales available in the original SCI-FI.

Development and validation of the patient evaluation scale (PES) for primary health care in Nigeria.

PubMed

Ogaji, Daprim S; Giles, Sally; Daker-White, Gavin; Bower, Peter

2017-03-01

Questionnaires developed for patient evaluation of the quality of primary care are often focussed on primary care systems in developed countries. Aim To report the development and validation of the patient evaluation scale (PES) designed for use in the Nigerian primary health care context. An iterative process was used to develop and validate the questionnaire using patients attending 28 primary health centres across eight states in Nigeria. The development involved literature review, patient interviews, expert reviews, cognitive testing with patients and waves of quantitative cross-sectional surveys. The questionnaire's content validity, internal structures, acceptability, reliability and construct validity are reported. Findings The full and shortened version of PES with 27 and 18 items, respectively, were developed through these process. The low item non-response from the serial cross-sectional surveys depicts questionnaire's acceptability among the local population. PES-short form (SF) has Cronbach's α of 0.87 and three domains (codenamed 'facility', 'organisation' and 'health care') with Cronbach's αs of 0.78, 0.79 and 0.81, respectively. Items in the multi-dimensional questionnaire demonstrated adequate convergent and discriminant properties. PES-SF scores show significant positive correlation with scores of the full PES and also discriminated population groups in support of a priori hypotheses. The PES and PES-SF contain items that are relevant to the needs of patients in Nigeria. The good measurement properties of the questionnaire demonstrates its potential usefulness for patient-focussed quality improvement activities in Nigeria. There is still need to translate these questionnaires into major languages in Nigeria and assess their validity against external quality criteria.

76 FR 79054 - Direct Investment Surveys: BE-12, Benchmark Survey of Foreign Direct Investment in the United States

Federal Register 2010, 2011, 2012, 2013, 2014

2011-12-21

... items collected, as well as changing the names and design of the survey forms. The changes are intended... reporting thresholds and data items collected, as well as changes in the names and design of the survey... survey forms. The new design incorporates improvements made to other BEA surveys. Survey instructions and...

Nurses' perceptions of their professional practice environment: a cross-sectional study.

PubMed

Cao, Yingjuan; DiGiacomo, Michelle; Salamonson, Yenna; Li, Ye; Huai, Baosha; Davidson, Patricia M

2015-12-01

To describe nurses' perceptions concerning their professional practice environment in mainland China and identify factors associated with these views. Globally, the environments in which nurses work influence the quality of nursing practice and health care. A cross-sectional descriptive survey using both paper- and online-based delivery modes was used. A convenience sampling method was used. The survey questionnaire was composed of sociodemographic items and the 38-item Chinese version of Professional Practice Environment survey. The content of the paper-based questionnaire was identical to the online survey. Pearson's chi-square test was conducted to compare the demographic characteristics of these two data sets. Descriptive statistics analysis included frequency, percentage, mean and standard deviation. Multiple linear regression analysis using the Backwards method was applied to identify independent predictors of each subscale of the 38-item Chinese version of Professional Practice Environment. A total of 573 questionnaires were analysed. The mean score of each subscale of the 38-item Chinese version of Professional Practice Environment in this study ranged from 2·66-3·05. All subscales except work motivation (3·05, standard deviation: 0·44) scored less than 3·0. Areas rated as most in need of improvement included control over practice, interpersonal interaction, supportive leadership and handling conflict, and staff relationships with physicians and autonomy. This study has identified nurses' perspectives regarding their workplaces in contemporary China. These data have provided an important baseline for developing and implementing culturally appropriate strategies to improve the working environment of Chinese nurses. A supportive and enabling work environment promotes professional development and the safety and quality of health care. Addressing these factors is important in optimising work place environments. © 2015 John Wiley & Sons Ltd.

Development and validation of Neonatal Satisfaction Survey--NSS-13.

PubMed

Hagen, Inger H; Vadset, Tove B; Barstad, Johan; Svindseth, Marit F

2015-06-01

The purpose of this study was to develop and validate a survey to investigate parents' satisfaction with neonatal wards in a population of parents of children with a gestation age of ≥24 weeks to 3 months after full-term birth. We explored the literature and conducted three focus groups: two with expert health personnel and one with parents. We tested the survey in a parent population (N = 105) and report the different stages in the validation process along with the full survey, the Neonatal Satisfaction Survey - 13 categories (NSS-13). We found 13 subcategories in the Neonatal Satisfaction Survey. The subcategories measure parents' satisfaction with neonatal units based on staff, admission, nurses, anxiety, siblings (parents' perceptions of caring for the siblings of the newborn), information, timeout, doctors, facilities, nutrition, preparation for discharge, trust and visitors. Each subcategory showed acceptable internal consistency. The full version of the Neonatal Satisfaction Survey presents 69 items, and each subcategory contains two to eleven items. The Neonatal Satisfaction Survey seems suitable to measure parents' satisfaction with neonatal units and can be used in full, but it can also measure subcategories. Parents' satisfaction with neonatal units can be used to improve the quality in such wards. We consider this study as the first in a series to validate the NSS-13. The full survey with subcategories is presented in this paper. © 2014 Nordic College of Caring Science.

Scale development on consumer behavior toward counterfeit drugs in a developing country: a quantitative study exploiting the tools of an evolving paradigm

PubMed Central

2013-01-01

Background Although desperate need and drug counterfeiting are linked in developing countries, little research has been carried out to address this link, and there is a lack of proper tools and methodology. This study addresses the need for a new methodological approach by developing a scale to aid in understanding the demand side of drug counterfeiting in a developing country. Methods The study presents a quantitative, non-representative survey conducted in Sudan. A face-to-face structured interview survey methodology was employed to collect the data from the general population (people in the street) in two phases: pilot (n = 100) and final survey (n = 1003). Data were analyzed by examining means, variances, squared multiple correlations, item-to-total correlations, and the results of an exploratory factor analysis and a confirmatory factor analysis. Results As an approach to scale purification, internal consistency was examined and improved. The scale was reduced from 44 to 41 items and Cronbach’s alpha improved from 0.818 to 0.862. Finally, scale items were assessed. The result was an eleven-factor solution. Convergent and discriminant validity were demonstrated. Conclusion The results of this study indicate that the “Consumer Behavior Toward Counterfeit Drugs Scale” is a valid, reliable measure with a solid theoretical base. Ultimately, the study offers public health policymakers a valid measurement tool and, consequently, a new methodological approach with which to build a better understanding of the demand side of counterfeit drugs and to develop more effective strategies to combat the problem. PMID:24020730

Scale development on consumer behavior toward counterfeit drugs in a developing country: a quantitative study exploiting the tools of an evolving paradigm.

PubMed

Alfadl, Abubakr A; Ibrahim, Mohamed Izham b Mohamed; Hassali, Mohamed Azmi Ahmad

2013-09-11

Although desperate need and drug counterfeiting are linked in developing countries, little research has been carried out to address this link, and there is a lack of proper tools and methodology. This study addresses the need for a new methodological approach by developing a scale to aid in understanding the demand side of drug counterfeiting in a developing country. The study presents a quantitative, non-representative survey conducted in Sudan. A face-to-face structured interview survey methodology was employed to collect the data from the general population (people in the street) in two phases: pilot (n = 100) and final survey (n = 1003). Data were analyzed by examining means, variances, squared multiple correlations, item-to-total correlations, and the results of an exploratory factor analysis and a confirmatory factor analysis. As an approach to scale purification, internal consistency was examined and improved. The scale was reduced from 44 to 41 items and Cronbach's alpha improved from 0.818 to 0.862. Finally, scale items were assessed. The result was an eleven-factor solution. Convergent and discriminant validity were demonstrated. The results of this study indicate that the "Consumer Behavior Toward Counterfeit Drugs Scale" is a valid, reliable measure with a solid theoretical base. Ultimately, the study offers public health policymakers a valid measurement tool and, consequently, a new methodological approach with which to build a better understanding of the demand side of counterfeit drugs and to develop more effective strategies to combat the problem.

Development of a Short Questionnaire to Measure an Extended Set of Job Demands, Job Resources, and Positive Health Outcomes: The New Brief Job Stress Questionnaire

PubMed Central

INOUE, Akiomi; KAWAKAMI, Norito; SHIMOMITSU, Teruichi; TSUTSUMI, Akizumi; HARATANI, Takashi; YOSHIKAWA, Toru; SHIMAZU, Akihito; ODAGIRI, Yuko

2014-01-01

This study aimed to investigate the reliability and construct validity of a new version of the Brief Job Stress Questionnaire (New BJSQ), which measures an extended set of psychosocial factors at work by adding new scales/items to the current version of the BJSQ. Additional scales/items were extensively collected from theoretical job stress models and similar questionnaires in several countries. Scales/items were field-tested and refined through a pilot internet survey. Finally, an 84-item questionnaire (141 items in total when combined with the current BJSQ) was developed. A nationally representative survey was administered to employees in Japan (n=1,633) to examine the reliability and construct validity. Most scales showed acceptable levels of internal consistency and test-retest reliability. Principal component analyses showed that the first factor explained 50% or greater proportion of the variance in most scales. A scale factor analysis and a correlation analysis showed that these scales fit the theoretical expectations. These findings provided a piece of evidence that the New BJSQ scales are reliable and valid. Although more detailed content and construct validity should be examined in future study, the New BJSQ is a useful instrument to evaluate psychosocial work environment and positive mental health outcomes in the current workplace. PMID:24492763

Development of a short questionnaire to measure an extended set of job demands, job resources, and positive health outcomes: the new brief job stress questionnaire.

PubMed

Inoue, Akiomi; Kawakami, Norito; Shimomitsu, Teruichi; Tsutsumi, Akizumi; Haratani, Takashi; Yoshikawa, Toru; Shimazu, Akihito; Odagiri, Yuko

2014-01-01

This study aimed to investigate the reliability and construct validity of a new version of the Brief Job Stress Questionnaire (New BJSQ), which measures an extended set of psychosocial factors at work by adding new scales/items to the current version of the BJSQ. Additional scales/items were extensively collected from theoretical job stress models and similar questionnaires in several countries. Scales/items were field-tested and refined through a pilot internet survey. Finally, an 84-item questionnaire (141 items in total when combined with the current BJSQ) was developed. A nationally representative survey was administered to employees in Japan (n=1,633) to examine the reliability and construct validity. Most scales showed acceptable levels of internal consistency and test-retest reliability. Principal component analyses showed that the first factor explained 50% or greater proportion of the variance in most scales. A scale factor analysis and a correlation analysis showed that these scales fit the theoretical expectations. These findings provided a piece of evidence that the New BJSQ scales are reliable and valid. Although more detailed content and construct validity should be examined in future study, the New BJSQ is a useful instrument to evaluate psychosocial work environment and positive mental health outcomes in the current workplace.

Educators' Use of Electronic Networks: An E-Mail Survey of Account-Holders on a Statewide Telecomputing System.

ERIC Educational Resources Information Center

Anderson, Susan E.; Harris, Judith B.

This study investigated educators' use of TENET, a statewide educational telecomputing network in Texas. It also documented the development and testing of a lengthy theory-based questionnaire and verified the efficacy of a method for administering surveys via electronic mail. The 70-item survey was sent to a random sample of 300 TENET users with a…

Measuring Workplace Climate in Community Clinics and Health Centers.

PubMed

Friedberg, Mark W; Rodriguez, Hector P; Martsolf, Grant R; Edelen, Maria O; Vargas Bustamante, Arturo

2016-10-01

The effectiveness of community clinics and health centers' efforts to improve the quality of care might be modified by clinics' workplace climates. Several surveys to measure workplace climate exist, but their relationships to each other and to distinguishable dimensions of workplace climate are unknown. To assess the psychometric properties of a survey instrument combining items from several existing surveys of workplace climate and to generate a shorter instrument for future use. We fielded a 106-item survey, which included items from 9 existing instruments, to all clinicians and staff members (n=781) working in 30 California community clinics and health centers, receiving 628 responses (80% response rate). We performed exploratory factor analysis of survey responses, followed by confirmatory factor analysis of 200 reserved survey responses. We generated a new, shorter survey instrument of items with strong factor loadings. Six factors, including 44 survey items, emerged from the exploratory analysis. Two factors (Clinic Workload and Teamwork) were independent from the others. The remaining 4 factors (staff relationships, quality improvement orientation, managerial readiness for change, and staff readiness for change) were highly correlated, indicating that these represented dimensions of a higher-order factor we called "Clinic Functionality." This 2-level, 6-factor model fit the data well in the exploratory and confirmatory samples. For all but 1 factor, fewer than 20 survey responses were needed to achieve clinic-level reliability >0.7. Survey instruments designed to measure workplace climate have substantial overlap. The relatively parsimonious item set we identified might help target and tailor clinics' quality improvement efforts.

Measuring Workplace Climate in Community Clinics and Health Centers

PubMed Central

Friedberg, Mark W.; Rodriguez, Hector P.; Martsolf, Grant; Edelen, Maria Orlando; Vargas-Bustamante, Arturo

2018-01-01

Background The effectiveness of community clinics and health centers’ efforts to improve the quality of care might be modified by clinics’ workplace climates. Several surveys to measure workplace climate exist, but their relationships to each other and to distinguishable dimensions of workplace climate are unknown. Objective To assess the psychometric properties of a survey instrument combining items from several existing surveys of workplace climate and to generate a shorter instrument for future use. Methods We fielded a 106-item survey, which included items from 9 existing instruments, to all clinicians and staff members (n=781) working in 30 California community clinics and health centers, receiving 628 responses (80% response rate). We performed exploratory factor analysis of survey responses, followed by confirmatory factor analysis of 200 reserved survey responses. We generated a new, shorter survey instrument of items with strong factor loadings. Results Six factors, including 44 survey items, emerged from the exploratory analysis. Two factors (Clinic Workload and Teamwork) were independent from the others. The remaining 4 factors (Staff Relationships, Quality Improvement Orientation, Managerial Readiness for Change, and Staff Readiness for Change) were highly correlated, indicating that these represented dimensions of a higher-order factor we called “Clinic Functionality.” This two-level, six-factor model fit the data well in the exploratory and confirmatory samples. For all but one factor, fewer than 20 survey responses were needed to achieve clinic-level reliability >0.7. Conclusion Survey instruments designed to measure workplace climate have substantial overlap. The relatively parsimonious item set we identified might help target and tailor clinics’ quality improvement efforts. PMID:27326549

Customizing Survey Instruments and Data Collection to Reach Hispanic/Latino Adults in Border Communities in Texas

PubMed Central

Pederson, Linda L.; Thorne, Stacy L.; Caraballo, Ralph S.; Evans, Brian; Athey, Leslie; McMichael, Joseph

2010-01-01

Objectives. We sought to modify an instrument and to use it to collect information on smoking knowledge, attitudes, beliefs, and behaviors among Hispanics/Latinos, and to adapt survey methods to obtain high participation levels. Methods. Promotoras (outreach workers) conducted face-to-face interviews with 1485 Hispanic adults (July 2007–April 2008). The project team used GeoFrame field enumeration methods to develop a sampling frame from households in randomly selected colonias (residential areas along the Texas–Mexico border that may lack some basic necessities (e.g. portable water), in El Paso, Texas. Results. The revised questionnaire included 36 unchanged items from the State Adult Tobacco Survey, 7 modified items, and 17 new items focusing on possible culturally specific quitting methods, secondhand smoke issues, and attitudes and knowledge about tobacco use that might be unique for Hispanic/Latino groups. The eligibility rate was 90.2%, and the conservative combined completed screener and interview response rate was 80.0%. Conclusions. Strategic, targeted, carefully designed methods and surveys can achieve high reach and response rates in hard-to-reach populations. Similar procedures could be used to obtain cooperation of groups who may not be accessible with traditional methods. PMID:20147687

Improving Inpatient Surveys: Web-Based Computer Adaptive Testing Accessed via Mobile Phone QR Codes

PubMed Central

2016-01-01

Background The National Health Service (NHS) 70-item inpatient questionnaire surveys inpatients on their perceptions of their hospitalization experience. However, it imposes more burden on the patient than other similar surveys. The literature shows that computerized adaptive testing (CAT) based on item response theory can help shorten the item length of a questionnaire without compromising its precision. Objective Our aim was to investigate whether CAT can be (1) efficient with item reduction and (2) used with quick response (QR) codes scanned by mobile phones. Methods After downloading the 2008 inpatient survey data from the Picker Institute Europe website and analyzing the difficulties of this 70-item questionnaire, we used an author-made Excel program using the Rasch partial credit model to simulate 1000 patients’ true scores followed by a standard normal distribution. The CAT was compared to two other scenarios of answering all items (AAI) and the randomized selection method (RSM), as we investigated item length (efficiency) and measurement accuracy. The author-made Web-based CAT program for gathering patient feedback was effectively accessed from mobile phones by scanning the QR code. Results We found that the CAT can be more efficient for patients answering questions (ie, fewer items to respond to) than either AAI or RSM without compromising its measurement accuracy. A Web-based CAT inpatient survey accessed by scanning a QR code on a mobile phone was viable for gathering inpatient satisfaction responses. Conclusions With advances in technology, patients can now be offered alternatives for providing feedback about hospitalization satisfaction. This Web-based CAT is a possible option in health care settings for reducing the number of survey items, as well as offering an innovative QR code access. PMID:26935793

Improving Inpatient Surveys: Web-Based Computer Adaptive Testing Accessed via Mobile Phone QR Codes.

PubMed

Chien, Tsair-Wei; Lin, Weir-Sen

2016-03-02

The National Health Service (NHS) 70-item inpatient questionnaire surveys inpatients on their perceptions of their hospitalization experience. However, it imposes more burden on the patient than other similar surveys. The literature shows that computerized adaptive testing (CAT) based on item response theory can help shorten the item length of a questionnaire without compromising its precision. Our aim was to investigate whether CAT can be (1) efficient with item reduction and (2) used with quick response (QR) codes scanned by mobile phones. After downloading the 2008 inpatient survey data from the Picker Institute Europe website and analyzing the difficulties of this 70-item questionnaire, we used an author-made Excel program using the Rasch partial credit model to simulate 1000 patients' true scores followed by a standard normal distribution. The CAT was compared to two other scenarios of answering all items (AAI) and the randomized selection method (RSM), as we investigated item length (efficiency) and measurement accuracy. The author-made Web-based CAT program for gathering patient feedback was effectively accessed from mobile phones by scanning the QR code. We found that the CAT can be more efficient for patients answering questions (ie, fewer items to respond to) than either AAI or RSM without compromising its measurement accuracy. A Web-based CAT inpatient survey accessed by scanning a QR code on a mobile phone was viable for gathering inpatient satisfaction responses. With advances in technology, patients can now be offered alternatives for providing feedback about hospitalization satisfaction. This Web-based CAT is a possible option in health care settings for reducing the number of survey items, as well as offering an innovative QR code access.

The assessment of emergency physicians by a regulatory authority.

PubMed

Lockyer, Jocelyn M; Violato, Claudio; Fidler, Herta

2006-12-01

To determine whether it is possible to develop a feasible, valid, and reliable multisource feedback program (360 degree evaluation) for emergency physicians. Surveys with 16, 20, 30, and 31 items were developed to assess emergency physicians by 25 patients, eight coworkers, eight medical colleagues, and self, respectively, using five-point scales along with an "unable to assess" category. Items addressed key competencies related to communication skills, professionalism, collegiality, and self-management. Data from 187 physicians who identified themselves as emergency physicians were available. The mean number of respondents per physician was 21.6 (SD +/- 3.87) (93%) for patients, 7.6 (SD +/- 0.89) (96%) for coworkers, and 7.7 (SD +/- 0.61) (95%) for medical colleagues, suggesting it was a feasible tool. Only the patient survey had four items with "unable to assess" percentages > or = 15%. The factor analysis indicated there were two factors on the patient questionnaire (communication/professionalism and patient education), two on the coworker survey (communication/collegiality and professionalism), and four on the medical colleague questionnaire (clinical performance, professionalism, self-management, and record management) that accounted for 80.0%, 62.5%, and 71.9% of the variance on the surveys, respectively. The factors were consistent with the intent of the instruments, providing empirical evidence of validity for the instruments. Reliability was established for the instruments (Cronbach's alpha > 0.94) and for each physician (generalizability coefficients were 0.68 for patients, 0.85 for coworkers, and 0.84 for medical colleagues). The psychometric examination of the data suggests that the instruments developed to assess emergency physicians were feasible and provide evidence for validity and reliability.

The development and exploratory analysis of the Back Pain Attitudes Questionnaire (Back-PAQ).

PubMed

Darlow, Ben; Perry, Meredith; Mathieson, Fiona; Stanley, James; Melloh, Markus; Marsh, Reginald; Baxter, G David; Dowell, Anthony

2014-05-23

To develop an instrument to assess attitudes and underlying beliefs about back pain, and subsequently investigate its internal consistency and underlying structures. The instrument was developed by a multidisciplinary team of clinicians and researchers based on analysis of qualitative interviews with people experiencing acute and chronic back pain. Exploratory analysis was conducted using data from a population-based cross-sectional survey. Qualitative interviews with community-based participants and subsequent postal survey. Instrument development informed by interviews with 12 participants with acute back pain and 11 participants with chronic back pain. Data for exploratory analysis collected from New Zealand residents and citizens aged 18 years and above. 1000 participants were randomly selected from the New Zealand Electoral Roll. 602 valid responses were received. The 34-item Back Pain Attitudes Questionnaire (Back-PAQ) was developed. Internal consistency was evaluated by the Cronbach α coefficient. Exploratory analysis investigated the structure of the data using Principal Component Analysis. The 34-item long form of the scale had acceptable internal consistency (α=0.70; 95% CI 0.66 to 0.73). Exploratory analysis identified five two-item principal components which accounted for 74% of the variance in the reduced data set: 'vulnerability of the back'; 'relationship between back pain and injury'; 'activity participation while experiencing back pain'; 'prognosis of back pain' and 'psychological influences on recovery'. Internal consistency was acceptable for the reduced 10-item scale (α=0.61; 95% CI 0.56 to 0.66) and the identified components (α between 0.50 and 0.78). The 34-item long form of the scale may be appropriate for use in future cross-sectional studies. The 10-item short form may be appropriate for use as a screening tool, or an outcome assessment instrument. Further testing of the 10-item Back-PAQ's construct validity, reliability, responsiveness to change and predictive ability needs to be conducted. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

1999 Survey of Active Duty Personnel: Administration, Datasets, and Codebook. Appendix G: Frequency and Percentage Distributions for Variables in the Survey Analysis Files.

DTIC Science & Technology

2000-12-01

A SKIP FLAG INDICATING THE RESULT OF CHECKING THE RESPONSE ON THE PARENT (SCREENING) ITEM AGAINST THE RESPONSE(S) ON THE ITEMS WITHIN THE SKIP...RESPONSE ON THE PARENT (SCREENING) ITEM AGAINST THE RESPONSE(S) ON THE ITEMS WITHIN THE SKIP PATTERN. SEE TABLE D-5, NOTE 2, IN APPENDIX D. G-52...RESULT OF CHECKING THE RESPONSE ON THE PARENT (SCREENING) ITEM AGAINST THE RESPONSE(S) ON THE ITEMS WITHIN THE SKIP PATTERN. SEE TABLE D-5

Head and neck cancer-specific quality of life: instrument validation.

PubMed

Terrell, J E; Nanavati, K A; Esclamado, R M; Bishop, J K; Bradford, C R; Wolf, G T

1997-10-01

The disfigurement and dysfunction associated with head and neck cancer affect emotional well-being and some of the most basic functions of life. Most cancer-specific quality-of-life assessments give a single composite score for head and neck cancer-related quality of life. To develop and evaluate an improved multidimensional instrument to assess head and neck cancer-related functional status and well-being. The item selection process included literature review, interviews with health care workers, and patient surveys. A survey with 37 disease-specific questions and the SF-12 survey were administered to 253 patients in 3 large medical centers. Factor analysis was performed to identify disease-specific domains. Domain scores were calculated as the standardized score of the component items. These domains were assessed for construct validity based on clinical hypotheses and test-retest reliability. Four relevant domains were identified: Eating (6 items), Communication (4 items), Pain (4 items), and Emotion (6 items). Each had an internal consistency (Cronbach alpha value) of greater than 0.80. Construct validity was demonstrated by moderate correlations with the SF-12 Physical and Mental component scores (r=0.43-0.60). Test-retest reliability for each domain demonstrated strong reliability between the 2 time points. Correlations were strong for each individual question, ranging from 0.53 to 0.93. Construct validity testing demonstrated that the direction of differences for each domain were as hypothesized. The Head and Neck Quality of Life questionnaire is a promising multidimensional tool with which to assess head and neck cancer-specific quality of life.

The Impact of Supervision on Internal Medicine Residents' Attitudes and Management of Depression in Primary Care: A Pilot Study

ERIC Educational Resources Information Center

Milone, Jennifer M.; Gottumukkala, Aruna; Ward, Christopher P.; York, Kaki M.

2013-01-01

Objective: The authors examined the effect of supervision on internal medicine residents' attitudes toward and management of depression. Method: Internal medicine residents completed a survey during preclinical conferences. The survey included a published, validated questionnaire, the Depression Attitude Questionnaire, and items developed by the…

A Community Survey of the "Disadvantaged."

ERIC Educational Resources Information Center

Schaumburg, Gary F.; Spriggs, Ted

The specific goals of this study were: (1) to develop a survey instrument for both the English and Spanish speaking that would be understood easily and be nonthreatening; (2) through the use of community representatives, select "items" to be included in the questionnaire that would be particularly relevant to the needs and problems of…

Benefits of e-Learning Benchmarks: Australian Case Studies

ERIC Educational Resources Information Center

Choy, Sarojni

2007-01-01

In 2004 the Australian Flexible Learning Framework developed a suite of quantitative and qualitative indicators on the uptake, use and impact of e-learning in the Vocational Education and Training (VET) sector. These indicators were used to design items for a survey to gather quantitative data for benchmarking. A series of four surveys gathered…

The Advisor Quality Survey: Good College Advisors Are Available, Knowledgeable, and Autonomy Supportive

ERIC Educational Resources Information Center

Sheldon, Kennon M.; Garton, Bryan; Orr, Rachael; Smith, Amy

2015-01-01

Most US institutions of higher education do not assess advisor quality. We report a scale development effort informed by the developmental prescriptions of self-determination theory (Deci & Ryan, 1985, 2000). The 15-item Missouri Advisor Quality Survey assesses advisor knowledge, advisor availability, and advisor autonomy supportiveness.…

Design of a Microcomputer-Based Adaptive Testing System.

ERIC Educational Resources Information Center

Vale, C. David

This paper explores the feasibility of developing a single-user microcomputer-based testing system. Testing literature was surveyed to discover types of test items that might be used in the system and to compile a list of strategies that such a system might use. Potential users were surveyed. Several were interviewed, and a questionnaire was…

The Law Enforcement Officer Stress Survey (LEOSS): Evaluation of Psychometric Properties

ERIC Educational Resources Information Center

Van Hasselt, Vincent B.; Sheehan, Donald C.; Malcolm, Abigail S.; Sellers, Alfred H.; Baker, Monty T.; Couwels, Judy

2008-01-01

This study establishes the reliability and validity of the Law Enforcement Officer Stress Survey (LEOSS), a short early-warning stress-screening measure for law enforcement officers. The initial phase of LEOSS development employed the behavioral-analytic model to construct a 25-item instrument specifically geared toward evaluation of stress in…

A Permutation Test for Correlated Errors in Adjacent Questionnaire Items

ERIC Educational Resources Information Center

Hildreth, Laura A.; Genschel, Ulrike; Lorenz, Frederick O.; Lesser, Virginia M.

2013-01-01

Response patterns are of importance to survey researchers because of the insight they provide into the thought processes respondents use to answer survey questions. In this article we propose the use of structural equation modeling to examine response patterns and develop a permutation test to quantify the likelihood of observing a specific…

Identification and assessment of professional competencies for implementation of nanotechnology in engineering education

NASA Astrophysics Data System (ADS)

Jean, Ming-Der; Jiang, Ji-Bin; Chien, Jia-Yi

2017-11-01

The purpose of this study was to construct the indicators of professional competencies of the nanotechnology-based sputtering system industry based on industry requirements and analyse the core competencies of the industry for promoting the human resource of physical vapour deposition technology. The document analysis, expert interview, and Delphi technique surveys were considered and the survey items with 32 items divided into 7 domains were selected according to consensus opinions of 10 experts by the Delphi survey technique. Through three questionnaire surveys' analysis, the professional competence scales for the K-S tests showed a good internal consistency. The findings of this study provide guidelines for professional competence for nanotechnology-based sputtering technology by applying surface heat-treatment industry. These guidelines can also reveal the practical competency requirements of nanotechnology-based sputtering technology to deal with any subsequent challenges, future developments, and invisible services for students in a technology institute programme.

A Novel Measure of "Good" Mentoring: Testing Its Reliability and Validity in Four Academic Health Centers.

PubMed

Pololi, Linda H; Evans, Arthur T; Civian, Janet T; Gibbs, Brian K; Gillum, Linda H; Brennan, Robert T

2016-01-01

Despite the well-recognized benefits of mentoring in academic medicine, there is a lack of clarity regarding what constitutes effective mentoring. We developed a tool to assess mentoring activities experienced by faculty and evaluated evidence for its validity. The National Initiative on Gender, Culture, and Leadership in Medicine-"C-Change"-previously developed the C-Change Faculty Survey to assess the culture of academic medicine. After intensive review, we added six items representing six components of mentoring to the survey-receiving help with career and personal goals, learning skills, sponsorship, and resources. We tested the items in four academic health centers during 2013 to 2014. We estimated reliability of the new items and tested the correlation of the new items with a mentoring composite variable representing faculty mentoring experiences as positive, neutral, or inadequate and with other C-Change dimensions of culture. Among the 1520 responding faculty (response rate 61-63%), there was a positive association between each of the six mentoring activities and satisfaction with both the amount and quality of mentoring received. There was no difference by sex. Cronbach α coefficients ranged from 0.89 to 0.95 across subgroups of faculty (by sex, race, and principal roles). The mentoring responses were associated most closely with dimensions of Institutional Support (r = 0.58, P < .001), Institutional Change Efforts for Faculty Support (r = 0.52, P < .001), Values Alignment (r = 0.58, P < .001), Self-efficacy (r = 0.43; P < .001), and Relationships/Inclusion/Trust (r = 0.41; P < .001). Data demonstrated that the Mentoring scale is a valid instrument to assess mentoring. Survey results could facilitate mentoring program development and evaluation.

Measuring teamwork and conflict among emergency medical technician personnel.

PubMed

Patterson, P Daniel; Weaver, Matthew D; Weaver, Sallie J; Rosen, Michael A; Todorova, Gergana; Weingart, Laurie R; Krackhardt, David; Lave, Judith R; Arnold, Robert M; Yealy, Donald M; Salas, Eduardo

2012-01-01

We sought to develop a reliable and valid tool for measuring teamwork among emergency medical technician (EMT) partnerships. We adapted existing scales and developed new items to measure components of teamwork. After recruiting a convenience sample of 39 agencies, we tested a 122-item draft survey tool (EMT-TEAMWORK). We performed a series of exploratory factor analyses (EFAs) and confirmatory factor analysis (CFA) to test reliability and construct validity, describing variation in domain and global scores using descriptive statistics. We received 687 completed surveys. The EFAs identified a nine-factor solution. We labeled these factors 1) Team Orientation, 2) Team Structure & Leadership, 3) Partner Communication, Team Support, & Monitoring, 4) Partner Trust and Shared Mental Models, 5) Partner Adaptability & Back-Up Behavior, 6) Process Conflict, 7) Strong Task Conflict, 8) Mild Task Conflict, and 9) Interpersonal Conflict. We tested a short-form (30-item SF) and long-form (45-item LF) version. The CFAs determined that both the SF and the LF possess positive psychometric properties of reliability and construct validity. The EMT-TEAMWORK-SF has positive internal consistency properties, with a mean Cronbach's alpha coefficient ≥0.70 across all nine factors (mean = 0.84; minimum = 0.78, maximum = 0.94). The mean Cronbach's alpha coefficient for the EMT-TEAMWORK-LF was 0.87 (minimum = 0.79, maximum = 0.94). There was wide variation in weighted scores across all nine factors and the global score for the SF and LF. Mean scores were lowest for the Team Orientation factor (48.1, standard deviation [SD] 21.5, SF; 49.3, SD 19.8, LF) and highest (more positive) for the Interpersonal Conflict factor (87.7, SD 18.1, for both SF and LF). We developed a reliable and valid survey to evaluate teamwork between EMT partners.

Anxiety and fear. Discriminant validity in the child and adolescent practitioner's perspective.

PubMed

Pavuluri, Mani N; Henry, David; Allen, Kathleen

2002-12-01

We assessed the ability of child and adolescent practitioners to discriminate between anxiety items from the Revised Children's Manifest Anxiety Scale (RCMAS) and fear items from the Fear Survey Schedule for Children-Revised (FSSC-R). In addition, we examined the effects age, gender, nationality, and therapeutic orientation on discrimination ability. Child and adolescent psychiatrists and psychologists from two university hospitals in Australia and the USA completed a questionnaire comprised of items randomly chosen from the RCMAS and the FSSC-R. Clinicians rated each item on the extent to which the item represented the construct of anxiety or fear, using a 7-point Likert-type scale. Clinicians were more accurate in their perceptions of anxiety than in their perceptions of fear. Clinicians with a psychodynamic orientation were more likely to perceive an item as describing anxiety, and were less likely to identify fear. There was a significant interaction between age, scale and perception, with the youngest clinicians showing the greatest perceptual differentiation between the fear and anxiety items. The results suggest a need to develop common terminology among researchers and clinicians, develop scales with items specific to the pathology they intend to measure, and consider the variables influencing the clinicians rating them.

Medical student quality-of-life in the clerkships: a scale validation study.

PubMed

Brannick, Michael T; Horn, Gregory T; Schnaus, Michael J; Wahi, Monika M; Goldin, Steven B

2015-04-01

Many aspects of medical school are stressful for students. To empirically assess student reactions to clerkship programs, or to assess efforts to improve such programs, educators must measure the overall well-being of the students reliably and validly. The purpose of the study was to develop and validate a measure designed to achieve these goals. The authors developed a measure of quality of life for medical students by sampling (public domain) items tapping general happiness, fatigue, and anxiety. A quality-of-life scale was developed by factor analyzing responses to the items from students in two different clerkships from 2005 to 2008. Reliability was assessed using Cronbach's alpha. Validity was assessed by factor analysis, convergence with additional theoretically relevant scales, and sensitivity to change over time. The refined nine-item measure is a Likert scaled survey of quality-of-life items comprised of two domains: exhaustion and general happiness. The resulting scale demonstrated good reliability and factorial validity at two time points for each of the two samples. The quality-of-life measure also correlated with measures of depression and the amount of sleep reported during the clerkships. The quality-of-life measure appeared more sensitive to changes over time than did the depression measure. The measure is short and can be easily administered in a survey. The scale appears useful for program evaluation and more generally as an outcome variable in medical educational research.

The Therapeutic Environment Screening Survey for Nursing Homes (TESS-NH): an observational instrument for assessing the physical environment of institutional settings for persons with dementia.

PubMed

Sloane, Philip D; Mitchell, C Madeline; Weisman, Gerald; Zimmerman, Sheryl; Foley, Kristie M Long; Lynn, Mary; Calkins, Margaret; Lawton, M Powell; Teresi, Jeanne; Grant, Leslie; Lindeman, David; Montgomery, Rhonda

2002-03-01

To develop an observational instrument that describes the ability of physical environments of institutional settings to address therapeutic goals for persons with dementia. A National Institute on Aging workgroup identified and subsequently revised items that evaluated exit control, maintenance, cleanliness, safety, orientation/cueing, privacy, unit autonomy, outdoor access, lighting, noise, visual/tactile stimulation, space/seating, and familiarity/homelikeness. The final instrument contains 84 discrete items and one global rating. A summary scale, the Special Care Unit Environmental Quality Scale (SCUEQS), consists of 18 items. Lighting items were validated using portable light meters. Concurrent criterion validation compared SCUEQS scores with the Professional Environmental Assessment Protocol (PEAP). Interrater kappa statistics for 74% of items were above.60. For another 10% of items, kappas could not be calculated due to empty cells, but interrater agreement was above 80%. The SCUEQS demonstrated an interrater reliability of.93, a test--retest reliability of.88, and an internal consistency of.81--.83. Light meter ratings correlated significantly with the Therapeutic Environment Screening Survey for Nursing Homes (TESS-NH) lighting items (r =.29--.38, p =.01--.04), and the SCUEQS correlated significantly with global PEAP ratings (r =.52, p <.01). The TESS-NH efficiently assesses discrete elements of the physical environment and has strong reliability and validity. The SCUEQS provides a quantitative measure of environmental quality in institutional settings.

A Core Outcome Set for the Benefits and Adverse Events of Bariatric and Metabolic Surgery: The BARIACT Project.

PubMed

Coulman, Karen D; Hopkins, James; Brookes, Sara T; Chalmers, Katy; Main, Barry; Owen-Smith, Amanda; Andrews, Robert C; Byrne, James; Donovan, Jenny L; Mazza, Graziella; Reeves, Barnaby C; Rogers, Chris A; Thompson, Janice L; Welbourn, Richard; Wordsworth, Sarah; Blazeby, Jane M

2016-11-01

Bariatric and metabolic surgery is used as a treatment for patients with severe and complex obesity. However, there is a need to improve outcome selection and reporting in bariatric surgery trials. A Core Outcome Set (COS), an agreed minimum set of outcomes reported in all studies of a specific condition, may achieve this. Here, we present the development of a COS for BARIAtric and metabolic surgery Clinical Trials-the BARIACT Study. Outcomes identified from systematic reviews and patient interviews informed a questionnaire survey. Patients and health professionals were surveyed three times and asked to rate the importance of each item on a 1-9 scale. Delphi methods provided anonymised feedback to participants. Items not meeting predefined criteria were discarded between rounds. Remaining items were discussed at consensus meetings, held separately with patients and professionals, where the COS was agreed. Data sources identified 2,990 outcomes, which were used to develop a 130-item questionnaire. Round 1 response rates were moderate but subsequently improved to above 75% for other rounds. After rounds 2 and 3, 81 and 14 items were discarded, respectively, leaving 35 items for discussion at consensus meetings. The final COS included nine items: "weight," "diabetes status," "cardiovascular risk," "overall quality of life (QOL)," "mortality," "technical complications of the specific operation," "any re-operation/re-intervention," "dysphagia/regurgitation," and "micronutrient status." The main limitation of this study was that it was based in the United Kingdom only. The COS is recommended to be used as a minimum in all trials of bariatric and metabolic surgery. Adoption of the COS will improve data synthesis and the value of research data. Future work will establish methods for the measurement of the outcomes in the COS.

Development of a vision-targeted health-related quality of life item measure

PubMed Central

Slotkin, Jerry; McKean-Cowdin, Roberta; Lee, Paul; Owsley, Cynthia; Vitale, Susan; Varma, Rohit; Gershon, Richard; Hays, Ron D.

2013-01-01

Purpose To develop a vision-targeted health-related quality of life (HRQOL) measure for the NIH Toolbox for the Assessment of Neurological and Behavioral Function. Methods We conducted a review of existing vision-targeted HRQOL surveys and identified color vision, low luminance vision, distance vision, general vision, near vision, ocular symptoms, psychosocial well-being, and role performance domains. Items in existing survey instruments were sorted into these domains. We selected non-redundant items and revised them to improve clarity and to limit the number of different response options. We conducted 10 cognitive interviews to evaluate the items. Finally, we revised the items and administered them to 819 individuals to calibrate the items and estimate the measure’s reliability and validity. Results The field test provided support for the 53-item vision-targeted HRQOL measure encompassing 6 domains: color vision, distance vision, near vision, ocular symptoms, psychosocial well-being, and role performance. The domain scores had high levels of reliability (coefficient alphas ranged from 0.848 to 0.940). Validity was supported by high correlations between National Eye Institute Visual Function Questionnaire scales and the new-vision-targeted scales (highest values were 0.771 between psychosocial well-being and mental health, and 0.729 between role performance and role difficulties), and by lower mean scores in those groups self-reporting eye disease (F statistic with p < 0.01 for all comparisons except cataract with ocular symptoms, psychosocial well-being, and role performance scales). Conclusions This vision-targeted HRQOL measure provides a basis for comprehensive assessment of the impact of eye diseases and treatments on daily functioning and well-being in adults. PMID:23475688

Developing measures of food and nutrition security within an Australian context.

PubMed

Archer, Claire; Gallegos, Danielle; McKechnie, Rebecca

2017-10-01

To develop a measure of food and nutrition security for use among an Australian population that measures all pillars of food security and to establish its content validity. The study consisted of two phases. Phase 1 involved focus groups with experts working in the area of food security. Data were assessed using content analysis and results informed the development of a draft tool. Phase 2 consisted of a series of three online surveys using the Delphi technique. Findings from each survey were used to establish content validity and progressively modify the tool until consensus was reached for all items. Australia. Phase 1 focus groups involved twenty-five experts working in the field of food security, who were attending the Dietitians Association of Australia National Conference, 2013. Phase 2 included twenty-five experts working in food security, who were recruited via email. Findings from Phase 1 supported the need for an Australian-specific tool and highlighted the failure of current tools to measure across all pillars of food security. Participants encouraged the inclusion of items to measure barriers to food acquisition and the previous single item to enable comparisons with previous data. Phase 2 findings informed the selection and modification of items for inclusion in the final tool. The results led to the development of a draft tool to measure food and nutrition security, and supported its content validity. Further research is needed to validate the tool among the Australian population and to establish inter- and intra-rater reliability.

Development and psychometric testing of the Nurse Practitioner Primary Care Organizational Climate Questionnaire.

PubMed

Poghosyan, Lusine; Nannini, Angela; Finkelstein, Stacey R; Mason, Emanuel; Shaffer, Jonathan A

2013-01-01

Policy makers and healthcare organizations are calling for expansion of the nurse practitioner (NP) workforce in primary care settings to assure timely access and high-quality care for the American public. However, many barriers, including those at the organizational level, exist that may undermine NP workforce expansion and their optimal utilization in primary care. This study developed a new NP-specific survey instrument, Nurse Practitioner Primary Care Organizational Climate Questionnaire (NP-PCOCQ), to measure organizational climate in primary care settings and conducted its psychometric testing. Using instrument development design, the organizational climate domain pertinent for primary care NPs was identified. Items were generated from the evidence and qualitative data. Face and content validity were established through two expert meetings. Content validity index was computed. The 86-item pool was reduced to 55 items, which was pilot tested with 81 NPs using mailed surveys and then field-tested with 278 NPs in New York State. SPSS 18 and Mplus software were used for item analysis, reliability testing, and maximum likelihood exploratory factor analysis. Nurse Practitioner Primary Care Organizational Climate Questionnaire had face and content validity. The content validity index was .90. Twenty-nine items loaded on four subscale factors: professional visibility, NP-administration relations, NP-physician relations, and independent practice and support. The subscales had high internal consistency reliability. Cronbach's alphas ranged from.87 to .95. Having a strong instrument is important to promote future research. Also, administrators can use it to assess organizational climate in their clinics and propose interventions to improve it, thus promoting NP practice and the expansion of NP workforce.

International consensus criteria for the diagnosis of Raynaud's phenomenon.

PubMed

Maverakis, Emanual; Patel, Forum; Kronenberg, Daniel G; Chung, Lorinda; Fiorentino, David; Allanore, Yannick; Guiducci, Serena; Hesselstrand, Roger; Hummers, Laura K; Duong, Chris; Kahaleh, Bashar; Macgregor, Alexander; Matucci-Cerinic, Marco; Wollheim, Frank A; Mayes, Maureen D; Gershwin, M Eric

2014-01-01

Vasoconstriction accompanied by changes in skin color is a normal physiologic response to cold. The distinction between this normal physiology and Raynaud's phenomenon (RP) has yet to be well characterized. In anticipation of the 9th International Congress on Autoimmunity, a panel of 12 RP experts from 9 different institutes and four different countries were assembled for a Delphi exercise to establish new diagnostic criteria for RP. Relevant investigators with highly cited manuscripts in Raynaud's-related research were identified using the Web of Science and invited to participate. Surveys at each stage were administered to participants via the on-line SurveyMonkey software tool. The participants evaluated the level of appropriateness of statements using a scale of 1 (extremely inappropriate) through 9 (extremely appropriate). In the second stage, panel participants were asked to rank rewritten items from the first round that were scored as "uncertain" for the diagnosis of RP, items with significant disagreement (Disagreement Index > 1), and new items suggested by the panel. Results were analyzed using the Interpercentile Range Adjusted for Symmetry (IPRAS) method. A 3-Step Approach to diagnose RP was then developed using items the panelists "agreed" were "appropriate" diagnostic criteria. In the final stage, the panel was presented with the newly developed diagnostic criteria and asked to rate them against previous models. Following the first two iterations of the Delphi exercise, the panel of 12 experts agreed that 36 of the items were "appropriate", 12 items had "uncertain" appropriateness, and 13 items were "inappropriate" to use in the diagnostic criteria of RP. Using an expert committee, we developed a 3-Step Approach for the diagnosis of RP and 5 additional criteria for the diagnosis of primary RP. The committee came to an agreement that the proposed criteria were "appropriate and accurate" for use by physicians to diagnose patients with RP. Published by Elsevier Ltd.

International Consensus Criteria for the Diagnosis of Raynaud’s Phenomenon

PubMed Central

Maverakis, Emanual; Patel, Forum; Kronenberg, Daniel; Chung, Lori; Fiorentino, David; Allanore, Yannick; Guiducci, Serena; Hesselstrand, Roger; Hummers, Laura; Duong, Chris; Kahaleh, Bashar; Macgregor, Alexander; Matucci-Cerinic, Marco; Wollheim, Frank; Mayes, Maureen; Gershwin, M. Eric

2014-01-01

Vasoconstriction accompanied by changes in skin color is a normal physiologic response to cold. The distinction between this normal physiology and Raynaud’s phenomenon (RP) has yet to be well characterized. In anticipation of the 9th International Congress on Autoimmunity, a panel of 12 RP experts from 9 different institutes and four different countries were assembled for a Delphi exercise to establish new diagnostic criteria for RP. Relevant investigators with highly cited manuscripts in Raynaud’s-related research were identified using the Web of Science and invited to participate. Surveys at each stage were administered to participants via the on-line SurveyMonkey software tool. The participants evaluated the level of appropriateness of statements using a scale of 1 (extremely inappropriate) through 9 (extremely appropriate). In the second stage, panel participants were asked to rank rewritten items from the first round that were scored as “uncertain” for the diagnosis of RP, items with significant disagreement (Disagreement Index > 1), and new items suggested by the panel. Results were analyzed using the Interpercentile Range Adjusted for Symmetry (IPRAS) method. A 3-Step Approach to diagnose RP was then developed using items the panelists “agreed” were “appropriate” diagnostic criteria. In the final stage, the panel was presented with the newly developed diagnostic criteria and asked to rate them against previous models. Following the first two iterations of the Delphi exercise, the panel of 12 experts agreed that 36 of the items were “appropriate,” 12 items had “uncertain” appropriateness, and 13 items were “inappropriate” to use in the diagnostic criteria of RP. Using an expert committee, we developed a 3-Step Approach for the diagnosis of RP and 5 additional criteria for the diagnosis of primary RP. The committee came to an agreement that the proposed criteria were “appropriate and accurate” for use by physicians to diagnose patients with RP. PMID:24491823

Developing, testing, and implementing a survey of scientist mentoring teachers as part of an RET: The GABI RET mentor survey.

NASA Astrophysics Data System (ADS)

Davey, B.

2017-12-01

The impacts of mentoring in education have been well established. Mentors have a large impact on their mentees and have been show to affect mentee attitudes towards learning, interest in subjects, future success, and more. While mentoring has a well-documented impact on the mentees, mentoring also has an impact on the mentors themselves. However, little has been studied empirically about these impacts. When we looked for a validated instrument that measured the impact of mentoring on the scientists working with the teachers, we found many anecdotal reports but no instruments that meet our specific needs. To this end, we developed, tested, and implemented our own instrument for measuring the impacts of mentoring on our scientist mentors. Our instrument contained both quantitative and qualitative items designed to reveal the effects of mentoring in two areas: 1) cognitive domain (mentoring, teaching, understanding K-12) and 2) affective domain (professional, personal, participation). We first shared our survey with experts in survey development and mentoring, gathered their feedback, and incorporated their suggestions into our instrument. We then had a subsection of our mentors complete the survey and then complete it again three to four days later (test-retest). Our survey has a high correlation for the test-retest quantitative items (0.93) and a high correlation (0.90) between the three reviewers of the qualitative items. From our findings, we feel we have a validated instrument (face, content, and contruct validity) that answers our research questions reliably. Our contribution to the study of mentoring of science teachers reveals a broad range of impacts on the mentors themselves including an improved understanding of the challenges of classroom teaching, a recognition of the importance of scientists working with science teachers, an enhanced ability to communicate their research and findings, and an increased interest and excitement for their own work.

Improving School Psychologists' Knowledge and Confidence Pertinent to Suicide Prevention through Professional Development

ERIC Educational Resources Information Center

Suldo, Shannon; Loker, Troy; Friedrich, Allison; Sundman, Ashley; Cunningham, Jennifer; Saari, Bonnie; Schatzberg, Tracy

2010-01-01

This study evaluated a professional development intervention that stemmed from a university-district partnership and was developed through participatory action research. Baseline and postintervention survey items showed participating school psychologists' (n = 57) knowledge related to youth suicide improved reliably immediately after the…

Measuring the Success of a Pipeline Program to Increase Nursing Workforce Diversity.

PubMed

Katz, Janet R; Barbosa-Leiker, Celestina; Benavides-Vaello, Sandra

2016-01-01

The purpose of this study was to understand changes in knowledge and opinions of underserved American Indian and Hispanic high school students after attending a 2-week summer pipeline program using and testing a pre/postsurvey. The research aims were to (a) psychometrically analyze the survey to determine if scale items could be summed to create a total scale score or subscale scores; (b) assess change in scores pre/postprogram; and (c) examine the survey to make suggestions for modifications and further testing to develop a valid tool to measure changes in student perceptions about going to college and nursing as a result of pipeline programs. Psychometric analysis indicated poor model fit for a 1-factor model for the total scale and majority of subscales. Nonparametric tests indicated statistically significant increases in 13 items and decreases in 2 items. Therefore, while total scores or subscale scores cannot be used to assess changes in perceptions from pre- to postprogram, the survey can be used to examine changes over time in each item. Student did not have an accurate view of nursing and college and underestimated support needed to attend college. However students realized that nursing was a profession with autonomy, respect, and honor. Copyright © 2016 Elsevier Inc. All rights reserved.

The Eastland Prostate Cancer Survey: instrument development and psychometric testing.

PubMed

Eastland, Taryn Y; Dancy, Barbara L

2013-03-01

African-American (AA) women could be instrumental in communicating positive prostate screening behavior to the significant males in their lives. However, little is known about AA women's prostate cancer attitudes, perceived behavioral control, subjective norms, intentions, behaviors, and knowledge regarding prostate cancer screening. This study describes the development and psychometric testing of the Eastland Prostate Cancer Survey (EPCS). A nonexperimental, correlational study with 200 AA women was used to test the psychometric properties of the six-subscale EPCS with 66 items. Construct validity, internal consistency, and test-retest reliability for the EPCS were acceptable and resulted in an eight-subscale EPCS with 56 items. Cronbach's alphas for the subscales ranged from 0.69 to 0.92. The EPCS is a culturally sensitive, gender-relevant instrument that could be used by community health providers to develop community health programs aimed at engaging AA women in the promotion of prostate cancer screening for AA men.

Factor Structure of Content Preparation for E-Business Web Sites: Results of a Survey of 428 Industrial Employees in the People's Republic of China

ERIC Educational Resources Information Center

Guo, Yinni; Salvendy, Gavriel

2009-01-01

To better fulfil customer satisfaction, a study of what content e-business web sites should contain is conducted. Based on background literature, a content preparation survey of 70 items was developed and completed by 428 white collar employees of an electronic company in mainland China. The survey aimed at examining the significant content…

Work environments of people with mobility impairments and limitations: Mobility Device User Work Survey (MWS).

PubMed

Morgan, Kerri A; Gottlieb, Meghan; Hollingsworth, Holly H; Gray, David B

2014-01-01

Few studies of employed people who use wheelchairs, canes, crutches or walkers have been reported in the literature. One reason for this paucity of research reports is that surveys are most often made of unemployed individuals with disabilities a defined broadly. Understanding the work site of successfully employed people who use mobility devices requires the development of as survey that can be used to examine the important features of worksite from employees who use mobility devices at their worksites. This article describes the development and psychometrics of a survey on currently employed people with lower limb impairments and mobility limitations who use mobility devices. The items in the Mobility Device User Work Survey (MWS) were based on interviews and survey items pilot tested on employed mobility device users. A sample of 183 employed people who use mobility devices including wheelchairs, canes, crutches or walkers was recruited using internet postings on disability-related organizations. The average age of the sample was 46.3, most were college educated, 72% used wheelchairs and the average number of years of employment was 24. The MWS was completed by 183 people who met the inclusion criteria. The survey was sent to these same people a second time and 132 of them returned the second survey. The MWS consists of 106 questions on demographic, work and worksite characteristics and 58 subjective evaluation items that were organized into five scales. The internal consistencies (Cronbach's alpha) of the five scales were moderate (0.72) to good (0.93). Stability values of the five scales were calculated using correlations between forms and ranged from 0.70 to 0.80. The evaluative scales were analyzed using exploratory factor analysis. The MWS provides a tool for studying the variables that influence employed people who use mobility devices. Future studies of unemployed people who use mobility devices may benefit from using the results of the MWS to plan interventions.

Evaluating Differential Item Functioning in the English General Practice Patient Survey: Comparison of South Asian and White British Subgroups.

PubMed

Setodji, Claude M; Elliott, Marc N; Abel, Gary; Burt, Jenni; Roland, Martin; Campbell, John

2015-09-01

To evaluate two 5-item patient experience scales from the English General Practice (GP) Patient Survey for evidence of differential item functioning (DIF) given prior evidence of substantially worse reported health care experiences for South Asian compared with white British respondents. A national survey of English patients' primary care experiences. We used classic test and item response theory analysis to examine the possibility of DIF by patient ethnicity (South Asian, white British) after controlling for age, sex, health status, and quality of life in the English GP Patient Survey conducted in 2011/2012. Data were available for 873,051 respondents (818,219 white British/54,832 South Asian from 7795 English practices) who answered items relating to experiences of GP or nurses' care. Internal consistency reliability was high and similar for South Asian and white British patients. White British patients reported better average experiences than South Asians, but there was no evidence of DIF or different item response curves for white British and South Asian respondents, even in sensitivity analyses using matched samples. All communication items in the English GP Patient Survey showed similar South Asian versus white British differences, with no evidence of DIF. In contrast, differences due to scale use or expectations are typically variable rather than constant across scales. While other possibilities remain, these findings increase the likelihood that the observed negative responses of South Asian patients to this national survey reflect true differences in their experiences of care.

Attitudes of physical therapist students toward physical therapist assistants before and after full-time clinical internships.

PubMed

Cavallo, Cheryl L; Richter, Randy R

2004-01-01

Development of attitudes of physical therapists (PTs) toward physical therapist assistants (PTAs) begins during their professional education, and attitudes are influenced further by clinical experiences. The purpose of this study was to understand attitudes of student PTs toward PTAs. We surveyed 66 clinical intern students enrolled in an entry-level master of physical therapy program. PT students received the same survey before and after their full-time clinical internship. Eleven Likert scale items were used to assess students' attitudes toward PTAs in the areas of competence, financial remuneration, and job security. One item was designed to determine whether PT students' level of contact with PTAs influenced attitudes. A random sample of 13 (20.9%) students who returned surveys were asked to participate in a telephone interview designed to enrich the quantitative data. After item analysis, five of the scale items were eliminated from the analyses due to poor internal consistency. Cronbach's alpha of the remaining six scale items was 0.75. Survey results reveal that PT students maintain an overall positive attitude toward PTAs before and after full-time clinical internship. Qualitative interview data support this finding. Students' attitudes in specific areas of PTA competence were negative and positive, however. The negative attitude may have been based on the students' beliefs that PTAs are not competent to perform physical therapy in situations that are changing or unpredictable. Positive attitudes may have been reflective of the students' beliefs that PTAs are competent to implement established plans of care. Student ranking of four professional issues showed a significant difference before and after full-time clinical internships.

[Development and validation of the Korean patient safety culture scale for nursing homes].

PubMed

Yoon, Sook Hee; Kim, Byungsoo; Kim, Se Young

2013-06-01

The purpose of this study was to develop a tool to evaluate patient safety culture in nursing homes and to test its validity and reliability. A preliminary tool was developed through interviews with focus group, content validity tests, and a pilot study. A nationwide survey was conducted from February to April, 2011, using self-report questionnaires. Participants were 982 employees in nursing homes. Data were analyzed using Cronbach's alpha, item analysis, factor analysis, and multitrait/multi-Item analysis. From the results of the analysis, 27 final items were selected from 49 items on the preliminary tool. Items with low correlation with total scale were excluded. The 4 factors sorted by factor analysis contributed 63.4% of the variance in the total scale. The factors were labeled as leadership, organizational system, working attitude, management practice. Cronbach's alpha for internal consistency was .95 and the range for the 4 factors was from .86 to .93. The results of this study indicate that the Korean Patient Safety Culture Scale has reliability and validity and is suitable for evaluation of patient safety culture in Korean nursing homes.

Development and validation of Iranian children’s participation assessment scale

PubMed Central

Amini, Malek; Hassani Mehraban, Afsoon; Haghni, Hamid; Asgharnezhad, Ali Asghar; Khayatzadeh Mahani, Mohammad

2016-01-01

Background: Participation is mostly cultural and familial based, and there is not any assessment scales for evaluating kids’ participation in Iranian context, therefore the purpose of this study was developing children’s participation assessment scale for Iranian children. Methods: Development of this scale occurred in two phases; phase I: planning: following reviewing the literature and adopting and compiling some items of available evaluation tools in the area (such as CAPE, CPQ, CLASS, Life-H) and receiving advice from two expert panels, the preliminary94- item questionnaire was prepared. Phase II: construct: the survey study was carried out on40 children and 21 of their parents to assess the popularity of the activity in Iran; thus, the items of the questionnaire reduced to 92 and after face and content validity, the final version prepared with 71 items. Results: The final 71-item questionnaire was developed in two parent-report and child-report versions. The 71 items based on the literature and expert panels’ advice were categorized in 8 areas of occupation according to Occupational Therapy Practice Framework (ADL, IADL, Play, leisure, social participation, education, work, and sleep/rest). Conclusion: Iranian children’s participation assessment is a useful and culturally relevant tool to measure participation of Iranian children. It can be used in rigorous clinical and population-based research. PMID:27390703

Sources of Interactional Problems in a Survey of Racial/Ethnic Discrimination

PubMed Central

Johnson, Timothy P.; Shariff-Marco, Salma; Willis, Gordon; Cho, Young Ik; Breen, Nancy; Gee, Gilbert C.; Krieger, Nancy; Grant, David; Alegria, Margarita; Mays, Vickie M.; Williams, David R.; Landrine, Hope; Liu, Benmei; Reeve, Bryce B.; Takeuchi, David; Ponce, Ninez A.

2014-01-01

Cross-cultural variability in respondent processing of survey questions may bias results from multiethnic samples. We analyzed behavior codes, which identify difficulties in the interactions of respondents and interviewers, from a discrimination module contained within a field test of the 2007 California Health Interview Survey. In all, 553 (English) telephone interviews yielded 13,999 interactions involving 22 items. Multilevel logistic regression modeling revealed that respondent age and several item characteristics (response format, customized questions, length, and first item with new response format), but not race/ethnicity, were associated with interactional problems. These findings suggest that item function within a multi-cultural, albeit English language, survey may be largely influenced by question features, as opposed to respondent characteristics such as race/ethnicity. PMID:26166949

Test-retest reliability of Physical Activity Neighborhood Environment Scale among urban men and women in Nanjing, China.

PubMed

Zhao, L; Wang, Z; Qin, Z; Leslie, E; He, J; Xiong, Y; Xu, F

2018-03-01

The identification of physical-activity-friendly built environment (BE) constructs is highly useful for physical activity promotion and maintenance. The Physical Activity Neighborhood Environment Scale (PANES) was developed for assessing BE correlates. However, PANES reliability has not been investigated among adults in China. A cross-sectional study. With multistage sampling approaches, 1568 urban adults (aged 35-74 years) were recruited for the initial survey on all 17 items of PANES Chinese version (PANES-CHN), with the survey repeated 7 days later for each participant. Intraclass correlation coefficient (ICC) was used to assess the test-retest reliability of PANES-CHN for each item. Totally, 1551 participants completed both surveys (follow-up rate = 98.9%). Among participants (mean age: 54.7 ± 11.1 years), 47.8% were men, 22.1% were elders, and 22.7% had ≥13 years of education. Overall, the PANES-CHN demonstrated at least substantial reliability with ICCs ranging from 0.66 to 0.95 (core items), from 0.75 to 0.95 (recommended items), and from 0.78 to 0.87 (optional items). Similar outcomes were observed when data were analyzed by gender or age groups. The PANES-CHN has excellent test-retest reliability and thus has valuable utility for assessing urban BE attributes among Chinese adults. Copyright © 2017 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Development and evaluation of the PI-G: a three-scale measure based on the German translation of the PROMIS ® pain interference item bank.

PubMed

Farin, Erik; Nagl, Michaela; Gramm, Lukas; Heyduck, Katja; Glattacker, Manuela

2014-05-01

Study aim was to translate the PROMIS(®) pain interference (PI) item bank (41 items) into German, test its psychometric properties in patients with chronic low back pain and develop static subforms. We surveyed N = 262 patients undergoing rehabilitation who were asked to fill out questionnaires at the beginning and 2 weeks after the end of rehabilitation, applying the Oswestry Disability Index (ODI) and Pain Disability Index (PDI) in addition to the PROMIS(®) PI items. For psychometric testing, a 1-parameter item response theory (IRT) model was used. Exploratory and confirmatory factor analyses as well as reliability and construct validity analyses were conducted. The assumptions regarding IRT scaling of the translated PROMIS(®) PI item bank as a whole were not confirmed. However, we succeeded in devising three static subforms (PI-G scales: PI mental 13 items, PI functional 11 items, PI physical 4 items), revealing good psychometric properties. The PI-G scales in their static form can be recommended for use in German-speaking countries. Their strengths versus the ODI and PDI are that pain interference is assessed in a differentiated manner and that several psychometric values are somewhat better than those associated with the ODI and PDI (distribution properties, IRT model fit, reliability). To develop an IRT-scaled item bank of the German translations of the PROMIS(®) PI items, it would be useful to have additional studies (e.g., with larger sample sizes and using a 2-parameter IRT model).

Test Excavations at 3CT219 and 3CT220: Archaeological Assessment of Two Sites Along the Big Creek Channel Enlargement, Item 2, Crittenden County, Arkansas.

DTIC Science & Technology

1986-06-01

Big Creek, Item 1 Memphis COE Survey & LeeDecker (1979c) (Sta 0+00-50+60) Testing 1978 Blackfish Bayou, Memphis COE Survey & LeeDecker (1979a) Items 2...the Blackfish Bayou channel enlarRement project, items 2 and 3, St. Francis and Crittenden counties, Arkansas. Iroquois Research Institute. Fairfax

NFIRE Survey of Rural Education Needs.

ERIC Educational Resources Information Center

Jongeward, Ray

Tabulated results of a 1976 National Federation for the Improvement of Rural Education (NFIRE) survey soliciting 140 opinions (a 43% return on 322 survey forms) re: rural education priorities are presented in this paper. These results include the total number of persons responding to each item and the resultant ranking of all items in the survey.…

Development and pilot of an international survey: 'Radiation Therapists and Psychosocial Support'.

PubMed

Elsner, Kelly L; Naehrig, Diana; Halkett, Georgia K B; Dhillon, Haryana M

2018-06-07

Up to one third of radiation therapy patients are reported to have unmet psychosocial needs. Radiation therapists (RTs) have daily contact with patients and can provide daily psychosocial support to reduce patient anxiety, fear and loneliness. However, RTs vary in their values, skills, training, knowledge and involvement in providing psychosocial support. The aims of this study were to: (1) develop an online survey instrument to explore RT values, skills, training and knowledge regarding patient anxiety and psychosocial support, and (2) pilot the instrument with RT professionals to assess content validity, functionality and length. An online cross-sectional survey, titled 'Radiation therapists and psychosocial support' was developed. Items included patient vignettes, embedded items from RT research, and the Professional Quality of Life Scale (ProQOL5). Four radiation oncology departments volunteered to pilot the survey; each nominated four RT staff to participate. Survey data were analysed descriptively and qualitative feedback grouped and coded to determine whether the survey needed to be refined. Thirteen of sixteen RTs completed the pilot survey and feedback form. Median time to completion was 35 mins, with 54% of respondents stating this was too long. Respondents reported content, questions and response options were relevant and appropriate. Feedback was used to: refine the survey instrument, minimise responder burden and drop out and improve functionality and quality of data collection. This pilot of the 'Radiation therapists and psychosocial support' survey instrument demonstrated content validity and usability. The main survey will be circulated to a representative sample of RTs for completion. © 2018 The Authors. Journal of Medical Radiation Sciences published by John Wiley & Sons Australia, Ltd on behalf of Australian Society of Medical Imaging and Radiation Therapy and New Zealand Institute of Medical Radiation Technology.

Recovery definitions: Do they change?

PubMed Central

Kaskutas, Lee Ann; Witbrodt, Jane; Grella, Christine E.

2015-01-01

Background The term “recovery” is widely used in the substance abuse literature and clinical settings, but data have not been available to empirically validate how recovery is defined by individuals who are themselves in recovery. The “What Is Recovery?” project developed a 39-item definition of recovery based on a large nationwide online survey of individuals in recovery. The objective of this paper is to report on the stability of those definitions one to two years later. Methods To obtain a sample for studying recovery definitions that reflected the different pathways to recovery, the parent study involved intensive outreach. Follow-up interviews (n = 1237) were conducted online and by telephone among respondents who consented to participate in follow-up studies. Descriptive analyses considered endorsement of individual recovery items at both surveys, and t-tests of summary scores studied significant change in the sample overall and among key subgroups. To assess item reliability, Cronbach’s alpha was estimated. Results Rates of endorsement of individual items at both interviews was above 90% for a majority of the recovery elements, and there was about as much transition into endorsement as out of endorsement. Statistically significant t-test scores were of modest magnitude, and reliability statistics were high (ranging from .782 to .899). Conclusions Longitudinal analyses found little evidence of meaningful change in recovery definitions at follow-up. Results thus suggest that the recovery definitions developed in the parent “What Is Recovery?” survey represent stable definitions of recovery that can be used to guide service provision in Recovery-Oriented Systems of Care. PMID:26166666

[Development of critical thinking skill evaluation scale for nursing students].

PubMed

You, So Young; Kim, Nam Cho

2014-04-01

To develop a Critical Thinking Skill Test for Nursing Students. The construct concepts were drawn from a literature review and in-depth interviews with hospital nurses and surveys were conducted among students (n=607) from nursing colleges. The data were collected from September 13 to November 23, 2012 and analyzed using the SAS program, 9.2 version. The KR 20 coefficient for reliability, difficulty index, discrimination index, item-total correlation and known group technique for validity were performed. Four domains and 27 skills were identified and 35 multiple choice items were developed. Thirty multiple choice items which had scores higher than .80 on the content validity index were selected for the pre test. From the analysis of the pre test data, a modified 30 items were selected for the main test. In the main test, the KR 20 coefficient was .70 and Corrected Item-Total Correlations range was .11-.38. There was a statistically significant difference between two academic systems (p=.001). The developed instrument is the first critical thinking skill test reflecting nursing perspectives in hospital settings and is expected to be utilized as a tool which contributes to improvement of the critical thinking ability of nursing students.

[Development of a measurement of intellectual capital for hospital nursing organizations].

PubMed

Kim, Eun A; Jang, Keum Seong

2011-02-01

This study was done to develop an instrument for measuring intellectual capital and assess its validity and reliability in identifying the components, human capital, structure capital and customer capital of intellectual capital in hospital nursing organizations. The participants were 950 regular clinical nurses who had worked for over 13 months in 7 medical hospitals including 4 national university hospitals and 3 private university hospitals. The data were collected through a questionnaire survey done from July 2 to August 25, 2009. Data from 906 nurses were used for the final analysis. Data were analyzed using descriptive statistics, Cronbach's alpha coefficients, item analysis, factor analysis (principal component analysis, Varimax rotation) with the SPSS PC+ 17.0 for Windows program. Developing the instrument for measuring intellectual capital in hospital nursing organizations involved a literature review, development of preliminary items, and verification of validity and reliability. The final instrument was in a self-report form on a 5-point Likert scale. There were 29 items on human capital (5 domains), 21 items on customer capital (4 domains), 26 items on structure capital (4 domains). The results of this study may be useful to assess the levels of intellectual capital of hospital nursing organizations.

The development of the Pictorial Thai Quality of Life.

PubMed

Phattharayuttawat, Sucheera; Ngamthipwatthana, Thienchai; Pitiyawaranun, Buncha

2005-11-01

"Quality of life" has become a main focus of interest in medicine. The Pictorial Thai Quality of Life (PTQL) was developed in order to measure the Thai mental illness both in a clinical setting and community. The purpose of this study was to develop the Pictorial Thai Quality of Life (PTQL), having adequate and sufficient construct validity, discriminant power, concurrent validity, and reliability. To develop the Pictorial Thai Quality of Life Test, two samples groups were used in the present study: (1) pilot study samples: 30 samples and (2) survey samples were 672 samples consisting of normal, and psychiatric patients. The developing tests items were collected from a review of the literature in which all the items were based on the WHO definition of Quality of Life. Then, experts judgment by the Delphi technique was used in the first stage. After that a pilot study was used to evaluate the testing administration, and wording of the tests items. The final stage was collected data from the survey samples. The results of the present study showed that the final test was composed 25 items. The construct validity of this test consists of six domains: Physical, Cognitive, Affective, Social Function, Economic and Self-Esteem. All the PTQL items have sufficient discriminant power It was found to be statistically significant different at the. 001 level between those people with mental disorders and normal people. There was a high level of concurrent validity association with WHOQOL-BREF, Pearson correlation coefficient and Area under ROC curve were 0.92 and 0.97 respectively. The reliability coefficients for the Alpha coefficients of the PTQL total test was 0.88. The values of the six scales were from 0.81 to 0:91. The present study was directed at developing an effective psychometric properties pictorial quality of life questionnaire. The result will be a more direct and meaningful application of an instrument to detect the mental health illness poor quality of life in Thai communities.

Development and Psychometric Properties of the Math and Me Survey: Measuring Third through Sixth Graders' Attitudes toward Mathematics

ERIC Educational Resources Information Center

Adelson, Jill L.; McCoach, D. Betsy

2011-01-01

The Math and Me Survey was designed to measure elementary students' attitudes toward mathematics. The authors conducted content validation, exploratory factor analysis, confirmatory factor analysis, item response theory, reliability, and external validity analyses to improve it and to test its psychometric properties. The final Math and Me Survey…

What Every Public School Physical Educator Should Know about the Hiring Process

ERIC Educational Resources Information Center

Stier, William F., Jr.; Schneider, Robert C.

2007-01-01

A national survey of high school principals was conducted to determine whether they agreed or disagreed with selected practices and procedures used to hire high school physical education teachers. A survey instrument, developed with the help of experts in the field and consisting of 29 items, was sent to 400 randomly selected principals. Useable…

The Climate Change Attitude Survey: Measuring Middle School Student Beliefs and Intentions to Enact Positive Environmental Change

ERIC Educational Resources Information Center

Christensen, Rhonda; Knezek, Gerald

2015-01-01

The Climate Change Attitude Survey is composed of 15 Likert-type attitudinal items selected to measure students' beliefs and intentions toward the environment with a focus on climate change. This paper describes the development of the instrument and psychometric performance characteristics including reliability and validity. Data were gathered…

Continuous Assessment in a New Testament Survey Course: Empirically Informed Reflections on an Australian Trial

ERIC Educational Resources Information Center

Hussey, Ian

2017-01-01

This article reports on a practitioner action research project focused on developing, trialing, and reflecting upon a continuous and formative-assessment plan for a foundational New Testament survey course. Three pedagogical convictions are discussed and drive the design of the assessment. Seven to nine assessment items (depending on level of…

Tablet PC: A Preliminary Report on a Tool for Teaching Calculus

ERIC Educational Resources Information Center

Gorgievski, Nicholas; Stroud, Robert; Truxaw, Mary; DeFranco, Thomas

2005-01-01

This study examined students' perceptions of the Tablet PC as an instructional tool for teaching Calculus. A thirteen item survey was developed by the researchers and administered to 103 students in an introductory Calculus course at a large university in the Northeast of the United States. The purpose of this survey was to collect data regarding…

Development and content validation of a patient-reported endometriosis pain daily diary.

PubMed

van Nooten, Floortje E; Cline, Jennifer; Elash, Celeste A; Paty, Jean; Reaney, Matthew

2018-01-04

Endometriosis is a common gynecological disorder that causes inflammation and pelvic pain. Endometriosis-related pain is best captured with patient-reported outcome (PRO) measures, however, assessment of endometriosis-related pain in clinical trials has been difficult in the absence of a reliable and valid PRO instrument. We describe the development of the Endometriosis Pain Daily Diary (EPDD), an electronic PRO developed as a survey instrument to assess endometriosis-related pain and its impact on patients' lives. The EPDD was initially developed on the basis of an existing Endometriosis Pain and Bleeding Diary, a targeted review of relevant literature, clinical expert interviews, and open-ended (concept elicitation) patient interviews in the United States (US) and Japan which captured patients' experience with endometriosis. Cognitive interviews of patients with endometriosis were conducted to evaluate patient comprehension of the EPDD items. A conceptual model of endometriosis was developed, and meetings with US and European regulatory authorities provided feedback for validating the EPDD in the context of clinical trials. Translatability assessments of the EPDD were conducted to confirm its appropriate interpretation and ease of completion across 17 languages. The iterative development progressed through three versions of the instrument. The EPDDv1 included 18 items relating to dysmenorrhea/pelvic pain, dyspareunia and sexual activity, bleeding, hot flashes, daily activities, and use of rescue medication. The EPDDv2 was a larger 43-item survey tested in cognitive interviews and subsequently revised to yield the current 11-item EPDDv3, consisting of five core items relating to dysmenorrhea, non-menstrual pelvic pain, and dyspareunia, and six extension items relating to sexual activity, daily activities, and use of rescue medication. The EPDD is a PRO for the evaluation of endometriosis-related pain and its associated impacts on patients' lives. The EPDD represents an important step in providing a PRO that is relevant to patients with endometriosis-related pain in the context of a clinical study setting (ie, fit-for-purpose), designed to evaluate pain associated with endometriosis, including regulatory agency support for its further exploration in clinical trials.

Developing a guideline for clinical trial protocol content: Delphi consensus survey

PubMed Central

2012-01-01

Background Recent evidence has highlighted deficiencies in clinical trial protocols, having implications for many groups. Existing guidelines for randomized clinical trial (RCT) protocol content vary substantially and most do not describe systematic methodology for their development. As one of three prespecified steps for the systematic development of a guideline for trial protocol content, the objective of this study was to conduct a three-round Delphi consensus survey to develop and refine minimum content for RCT protocols. Methods Panellists were identified using a multistep iterative approach, met prespecified minimum criteria and represented key stakeholders who develop or use clinical trial protocols. They were asked to rate concepts for importance in a minimum set of items for RCT protocols. The main outcome measures were degree of importance (scale of 1 to 10; higher scores indicating higher importance) and level of consensus for items. Results were presented as medians, interquartile ranges, counts and percentages. Results Ninety-six expert panellists participated in the Delphi consensus survey including trial investigators, methodologists, research ethics board members, funders, industry, regulators and journal editors. Response rates were between 88 and 93% per round. Overall, panellists rated 63 of 88 concepts of high importance (of which 50 had a 25th percentile rating of 8 or greater), 13 of moderate importance (median 6 or 7) and 12 of low importance (median less than or equal to 5) for minimum trial protocol content. General and item-specific comments and subgroup results provided valuable insight for further discussions. Conclusions This Delphi process achieved consensus from a large panel of experts from diverse stakeholder groups on essential content for RCT protocols. It also highlights areas of divergence. These results, complemented by other empirical research and consensus meetings, are helping guide the development of a guideline for protocol content. PMID:23006145

NASA communications technology research and development

NASA Technical Reports Server (NTRS)

Durham, A. F.; Stankiewicz, N.

1979-01-01

The development of a 1978 NASA study to identify technology requirements is surveyed, and its principal conclusions, recommendations, and priorities are summarized. In addition, antenna, traveling wave tube, and solid state amplifier developments representing selected items from the current communications technology development programs at the NASA Lewis Research and Goddard Space Flight Centers are described.

Social Exclusion Index-for Health Surveys (SEI-HS): a prospective nationwide study to extend and validate a multidimensional social exclusion questionnaire.

PubMed

van Bergen, Addi P L; Hoff, Stella J M; Schreurs, Hanneke; van Loon, Annelies; van Hemert, Albert M

2017-03-14

Social exclusion (SE) refers to the inability of certain groups or individuals to fully participate in society. SE is associated with socioeconomic inequalities in health, and its measurement in routine public health monitoring is considered key to designing effective health policies. In an earlier retrospective analysis we demonstrated that in all four major Dutch cities, SE could largely be measured with existing local public health monitoring data. The current prospective study is aimed at constructing and validating an extended national measure for SE that optimally employs available items. In 2012, a stratified general population sample of 258,928 Dutch adults completed a version of the Netherlands Public Health Monitor (PHM) questionnaire in which 9 items were added covering aspects of SE that were found to be missing in our previous research. Items were derived from the SCP social exclusion index, a well-constructed 15-item instrument developed by the Netherlands Institute for Social Research (SCP). The dataset was randomly divided into a development sample (N =129,464) and a validation sample (N = 129,464). Canonical correlation analysis was conducted in the development sample. The psychometric properties were studied and compared with those of the original SCP index. All analyses were then replicated in the validation sample. The analysis yielded a four dimensional index, the Social Exclusion Index for Health Surveys (SEI-HS), containing 8 SCP items and 9 PHM items. The four dimensions: "lack of social participation", "material deprivation", "lack of normative integration" and "inadequate access to basic social rights", were each measured with 3 to 6 items. The SEI-HS showed adequate internal consistency for both the general index and for two of four dimension scales. The internal structure and construct validity of the SEI-HS were satisfactory and similar to the original SCP index. Replication of the SEI-HS in the validation sample confirmed its generalisability. This study demonstrates that the SEI-HS offers epidemiologists and public health researchers a uniform, reliable, valid and efficient means of assessing social exclusion and its underlying dimensions. The study also provides valuable insights in how to develop embedded measures for public health surveillance.

An empirically derived short form of the Hypoglycaemia Fear Survey II.

PubMed

Grabman, J; Vajda Bailey, K; Schmidt, K; Cariou, B; Vaur, L; Madani, S; Cox, D; Gonder-Frederick, L

2017-04-01

To develop an empirically derived short version of the Hypoglycaemia Fear Survey II that still accurately measures fear of hypoglycaemia. Item response theory methods were used to generate an 11-item version of the Hypoglycaemia Fear Survey from a sample of 487 people with Type 1 or Type 2 diabetes mellitus. Subsequently, this scale was tested on a sample of 2718 people with Type 1 or insulin-treated Type 2 diabetes taking part in DIALOG, a large observational prospective study of hypoglycaemia in France. The short form of the Hypoglycaemia Fear Survey II matched the factor structure of the long form for respondents with both Type 1 and Type 2 diabetes, while maintaining adequate internal reliability on the total scale and all three subscales. The two forms were highly correlated on both the total scale and each subscale (Pearson's R > 0.89). The short form of the Hypoglycaemia Fear Survey II is an important first step in more efficiently measuring fear of hypoglycaemia. Future prospective studies are needed for further validity testing and exploring the survey's applicability to different populations. © 2016 Diabetes UK.

A Practitioner's Instrument for Measuring Secondary Mathematics Teachers' Beliefs Surrounding Learner-Centered Classroom Practice.

PubMed

Lischka, Alyson E; Garner, Mary

In this paper we present the development and validation of a Mathematics Teaching Pedagogical and Discourse Beliefs Instrument (MTPDBI), a 20 item partial-credit survey designed and analyzed using Rasch measurement theory. Items on the MTPDBI address beliefs about the nature of mathematics, teaching and learning mathematics, and classroom discourse practices. A Rasch partial credit model (Masters, 1982) was estimated from the pilot study data. Results show that item separation reliability is .96 and person separation reliability is .71. Other analyses indicate the instrument is a viable measure of secondary teachers' beliefs about reform-oriented mathematics teaching and learning. This instrument is proposed as a useful measure of teacher beliefs for those working with pre-service and in-service teacher development.

1999 Survey of Active Duty Personnel: Administration, Datasets, and Codebook

DTIC Science & Technology

2000-12-01

but left key items blank. These surveys were treated as nonrespondents when at least one item in each of the Questions 39, 50, and 52 were not...be useable, a questionnaire had to have at least one item in each of the questions 39, 50 and 52 answered. 27 These two subgroups of records are...1988). Mail survey response rate: A meta-analysis of selected techniques for inducing response. Public Opinion Quarterly, 52 , 467-491. Francisco, C

[Development of an Instrument to Assess the Quality of Childbirth Care from the Mother's Perspective].

PubMed

Jeong, Geum Hee; Kim, Hyun Kyoung; Kim, Young Hee; Kim, Sun Hee; Lee, Sun Hee; Kim, Kyung Won

2018-02-01

This study aimed to develop an instrument to assess the quality of childbirth care from the perspective of a mother after delivery. The instrument was developed from a literature review, interviews, and item validation. Thirty-eight items were compiled for the instrument. The data for validity and reliability testing were collected using a questionnaire survey conducted on 270 women who had undergone normal vaginal delivery in Korea and analyzed with descriptive statistics, exploratory factor analysis, and reliability coefficients. The exploratory factor analysis reduced the number of items in the instrument to 28 items that were factored into four subscales: family-centered care, personal care, emotional empowerment, and information provision. With respect to convergence validation, there was positive correlation between this instrument and birth satisfaction scale (r=.34, p<.001). The internal consistency reliability was acceptable (Cronbach's alpha =.96). This instrument could be used as a measure of the quality of nursing care for women who have a normal vaginal delivery. © 2018 Korean Society of Nursing Science.

Measurement Equivalence in ADL and IADL Difficulty Across International Surveys of Aging: Findings From the HRS, SHARE, and ELSA

PubMed Central

Kasper, Judith D.; Brandt, Jason; Pezzin, Liliana E.

2012-01-01

Objective. To examine the measurement equivalence of items on disability across three international surveys of aging. Method. Data for persons aged 65 and older were drawn from the Health and Retirement Survey (HRS, n = 10,905), English Longitudinal Study of Aging (ELSA, n = 5,437), and Survey of Health, Ageing and Retirement in Europe (SHARE, n = 13,408). Differential item functioning (DIF) was assessed using item response theory (IRT) methods for activities of daily living (ADL) and instrumental activities of daily living (IADL) items. Results. HRS and SHARE exhibited measurement equivalence, but 6 of 11 items in ELSA demonstrated meaningful DIF. At the scale level, this item-level DIF affected scores reflecting greater disability. IRT methods also spread out score distributions and shifted scores higher (toward greater disability). Results for mean disability differences by demographic characteristics, using original and DIF-adjusted scores, were the same overall but differed for some subgroup comparisons involving ELSA. Discussion. Testing and adjusting for DIF is one means of minimizing measurement error in cross-national survey comparisons. IRT methods were used to evaluate potential measurement bias in disability comparisons across three international surveys of aging. The analysis also suggested DIF was mitigated for scales including both ADL and IADL and that summary indexes (counts of limitations) likely underestimate mean disability in these international populations. PMID:22156662

Development and initial validation of primary care provider mental illness management and team-based care self-efficacy scales.

PubMed

Loeb, Danielle F; Crane, Lori A; Leister, Erin; Bayliss, Elizabeth A; Ludman, Evette; Binswanger, Ingrid A; Kline, Danielle M; Smith, Meredith; deGruy, Frank V; Nease, Donald E; Dickinson, L Miriam

Develop and validate self-efficacy scales for primary care provider (PCP) mental illness management and team-based care participation. We developed three self-efficacy scales: team-based care (TBC), mental illness management (MIM), and chronic medical illness (CMI). We developed the scales using Bandura's Social Cognitive Theory as a guide. The survey instrument included items from previously validated scales on team-based care and mental illness management. We administered a mail survey to 900 randomly selected Colorado physicians. We conducted exploratory principal factor analysis with oblique rotation. We constructed self-efficacy scales and calculated standardized Cronbach's alpha coefficients to test internal consistency. We calculated correlation coefficients between the MIM and TBC scales and previously validated measures related to each scale to evaluate convergent validity. We tested correlations between the TBC and the measures expected to correlate with the MIM scale and vice versa to evaluate discriminant validity. PCPs (n=402, response rate=49%) from diverse practice settings completed surveys. Items grouped into factors as expected. Cronbach's alphas were 0.94, 0.88, and 0.83 for TBC, MIM, and CMI scales respectively. In convergent validity testing, the TBC scale was correlated as predicted with scales assessing communications strategies, attitudes toward teams, and other teamwork indicators (r=0.25 to 0.40, all statistically significant). Likewise, the MIM scale was significantly correlated with several items about knowledge and experience managing mental illness (r=0.24 to 41, all statistically significant). As expected in discriminant validity testing, the TBC scale had only very weak correlations with the mental illness knowledge and experience managing mental illness items (r=0.03 to 0.12). Likewise, the MIM scale was only weakly correlated with measures of team-based care (r=0.09 to.17). This validation study of MIM and TBC self-efficacy scales showed high internal validity and good construct validity. Copyright © 2016 Elsevier Inc. All rights reserved.

An instrument to characterize the environment for residents' evidence-based medicine learning and practice.

PubMed

Mi, Misa; Moseley, James L; Green, Michael L

2012-02-01

Many residency programs offer training in evidence-based medicine (EBM). However, these curricula often fail to achieve optimal learning outcomes, perhaps because they neglect various contextual factors in the learning environment. We developed and validated an instrument to characterize the environment for EBM learning and practice in residency programs. An EBM Environment Scale was developed following scale development principles. A survey was administered to residents across six programs in primary care specialties at four medical centers. Internal consistency reliability was analyzed with Cronbach's coefficient alpha. Validity was assessed by comparing predetermined subscales with the survey's internal structure as assessed via factor analysis. Scores were also compared for subgroups based on residency program affiliation and residency characteristics. Out of 262 eligible residents, 124 completed the survey (response rate 47%). The overall mean score was 3.89 (standard deviation=0.56). The initial reliability analysis of the 48-item scale had a high reliability coefficient (Cronbach α=.94). Factor analysis and further item analysis resulted in a shorter 36-item scale with a satisfactory reliability coefficient (Cronbach α=.86). Scores were higher for residents with prior EBM training in medical school (4.14 versus 3.62) and in residency (4.25 versus 3.69). If further testing confirms its properties, the EBM Environment Scale may be used to understand the influence of the learning environment on the effectiveness of EBM training. Additionally, it may detect changes in the EBM learning environment in response to programmatic or institutional interventions.

Development and validation of a tool to assess the physical and social environment associated with physical activity among adults in Sri Lanka.

PubMed

De Silva Weliange, Shreenika H; Fernando, Dulitha; Gunatilake, Jagath

2014-05-03

Environmental characteristics are known to be associated with patterns of physical activity (PA). Although several validated tools exist, to measure the environment characteristics, these instruments are not necessarily suitable for application in all settings especially in a developing country. This study was carried out to develop and validate an instrument named the "Physical And Social Environment Scale--PASES" to assess the physical and social environmental factors associated with PA. This will enable identification of various physical and social environmental factors affecting PA in Sri Lanka, which will help in the development of more tailored intervention strategies for promoting higher PA levels in Sri Lanka. The PASES was developed using a scientific approach of defining the construct, item generation, analysis of content of items and item reduction. Both qualitative and quantitative methods of key informant interviews, in-depth interviews and rating of the items generated by experts were conducted. A cross sectional survey among 180 adults was carried out to assess the factor structure through principal component analysis. Another cross sectional survey among a different group of 180 adults was carried out to assess the construct validity through confirmatory factor analysis. Reliability was assessed with test re-test reliability and internal consistency using Spearman r and Cronbach's alpha respectively. Thirty six items were selected after the expert ratings and were developed into interviewer administered questions. Exploration of factor structure of the 34 items which were factorable through principal component analysis with Quartimax rotation extracted 8 factors. The 34 item instrument was assessed for construct validity with confirmatory factor analysis which confirmed an 8 factor model (x2 = 339.9, GFI = 0.90). The identified factors were infrastructure for walking, aesthetics and facilities for cycling, vehicular traffic safety, access and connectivity, recreational facilities for PA, safety, social cohesion and social acceptance of PA with the two non-factorable factors, residential density and land use mix. The PASES also showed good test re-test reliability and a moderate level of internal consistency. The PASES is a valid and reliable tool which could be used to assess the physical and social environment associated with PA in Sri Lanka.

Meta-analytic guidelines for evaluating single-item reliabilities of personality instruments.

PubMed

Spörrle, Matthias; Bekk, Magdalena

2014-06-01

Personality is an important predictor of various outcomes in many social science disciplines. However, when personality traits are not the principal focus of research, for example, in global comparative surveys, it is often not possible to assess them extensively. In this article, we first provide an overview of the advantages and challenges of single-item measures of personality, a rationale for their construction, and a summary of alternative ways of assessing their reliability. Second, using seven diverse samples (Ntotal = 4,263) we develop the SIMP-G, the German adaptation of the Single-Item Measures of Personality, an instrument assessing the Big Five with one item per trait, and evaluate its validity and reliability. Third, we integrate previous research and our data into a first meta-analysis of single-item reliabilities of personality measures, and provide researchers with guidelines and recommendations for the evaluation of single-item reliabilities. © The Author(s) 2013.

Educational Research in the United States: A Survey of Pre-K-12 Teachers' Perceptions Regarding the Purpose, Conceptions, Use, Impact, and Dissemination

ERIC Educational Resources Information Center

Mahoney, Shawn

2013-01-01

The purpose of this survey study was to collect data from pre-K-12 educators in the U.S. regarding their perceptions of the purpose, conceptions, use, impact, and results of educational research. The survey tool was based on existing questionnaires and case studies in the literature, as well as newly developed items. 3,908 educators in a database…

Behaviors in Advance Care Planning and ACtions Survey (BACPACS): development and validation part 1.

PubMed

Kassam, Aliya; Douglas, Maureen L; Simon, Jessica; Cunningham, Shannon; Fassbender, Konrad; Shaw, Marta; Davison, Sara N

2017-11-22

Although advance care planning (ACP) is fairly well understood, significant barriers to patient participation remain. As a result, tools to assess patient behaviour are required. The objective of this study was to improve the measurement of patient engagement in ACP by detecting existing survey design issues and establishing content and response process validity for a new survey entitled Behaviours in Advance Care Planning and ACtions Survey (BACPACS). We based our new tool on that of an existing ACP engagement survey. Initial item reduction was carried out using behavior change theories by content and design experts to help reduce response burden and clarify questions. Thirty-two patients with chronic diseases (cancer, heart failure or renal failure) were recruited for the think aloud cognitive interviewing with the new, shortened survey evaluating patient engagement with ACP. Of these, n = 27 had data eligible for analysis (n = 8 in round 1 and n = 19 in rounds 2 and 3). Interviews were audio-recorded and analyzed using the constant comparison method. Three reviewers independently listened to the interviews, summarized findings and discussed discrepancies until consensus was achieved. Item reduction from key content expert review and conversation analysis helped decrease number of items from 116 in the original ACP Engagement Survey to 24-38 in the new BACPACS depending on branching of responses. For the think aloud study, three rounds of interviews were needed until saturation for patient clarity was achieved. The understanding of ACP as a construct, survey response options, instructions and terminology pertaining to patient engagement in ACP warranted further clarification. Conversation analysis, content expert review and think aloud cognitive interviewing were useful in refining the new survey instrument entitled BACPACS. We found evidence for both content and response process validity for this new tool.

Validation of the Oxford Participation and Activities Questionnaire.

PubMed

Morley, David; Dummett, Sarah; Kelly, Laura; Dawson, Jill; Fitzpatrick, Ray; Jenkinson, Crispin

2016-01-01

There is growing interest in the management of long-term conditions and in keeping people active and participating in the community. Testing the effectiveness of interventions that aim to affect activities and participation can be challenging without a well-developed, valid, and reliable instrument. This study therefore aims to develop a patient-reported outcome measure, the Oxford Participation and Activities Questionnaire (Ox-PAQ), which is theoretically grounded in the World Health Organization's International Classification of Functioning, Disability, and Health (ICF) and fully compliant with current best practice guidelines. Questionnaire items generated from patient interviews and based on the nine chapters of the ICF were administered by postal survey to 386 people with three neurological conditions: motor neuron disease, multiple sclerosis, and Parkinson's disease. Participants also completed the Medical Outcomes Study (MOS) 36-Item Short Form Health Survey (SF-36) and EQ-5D-5L. Thus, 334 participants completed the survey, a response rate of 86.5%. Factor analysis techniques identified three Ox-PAQ domains, consisting of 23 items, accounting for 72.8% of variance. Internal reliability for the three domains was high (Cronbach's α: 0.81-0.96), as was test-retest reliability (intraclass correlation: 0.83-0.92). Concurrent validity was demonstrated through highly significant relationships with relevant domains of the MOS SF-36 and the EQ- 5D-5L. Assessment of known-groups validity identified significant differences in Ox-PAQ scores among the three conditions included in the survey. Results suggest that the Ox-PAQ is a valid and reliable measure of participation and activity. The measure will now be validated in a range of further conditions, and additional properties, such as responsiveness, will also be assessed in the next phase of the instrument's development.

Validation of the Oxford Participation and Activities Questionnaire

PubMed Central

Morley, David; Dummett, Sarah; Kelly, Laura; Dawson, Jill; Fitzpatrick, Ray; Jenkinson, Crispin

2016-01-01

Purpose There is growing interest in the management of long-term conditions and in keeping people active and participating in the community. Testing the effectiveness of interventions that aim to affect activities and participation can be challenging without a well-developed, valid, and reliable instrument. This study therefore aims to develop a patient-reported outcome measure, the Oxford Participation and Activities Questionnaire (Ox-PAQ), which is theoretically grounded in the World Health Organization’s International Classification of Functioning, Disability, and Health (ICF) and fully compliant with current best practice guidelines. Methods Questionnaire items generated from patient interviews and based on the nine chapters of the ICF were administered by postal survey to 386 people with three neurological conditions: motor neuron disease, multiple sclerosis, and Parkinson’s disease. Participants also completed the Medical Outcomes Study (MOS) 36-Item Short Form Health Survey (SF-36) and EQ-5D-5L. Results Thus, 334 participants completed the survey, a response rate of 86.5%. Factor analysis techniques identified three Ox-PAQ domains, consisting of 23 items, accounting for 72.8% of variance. Internal reliability for the three domains was high (Cronbach’s α: 0.81–0.96), as was test–retest reliability (intraclass correlation: 0.83–0.92). Concurrent validity was demonstrated through highly significant relationships with relevant domains of the MOS SF-36 and the EQ- 5D-5L. Assessment of known-groups validity identified significant differences in Ox-PAQ scores among the three conditions included in the survey. Conclusion Results suggest that the Ox-PAQ is a valid and reliable measure of participation and activity. The measure will now be validated in a range of further conditions, and additional properties, such as responsiveness, will also be assessed in the next phase of the instrument’s development. PMID:27366108

Development and validation of the Myasthenia Gravis Impairment Index.

PubMed

Barnett, Carolina; Bril, Vera; Kapral, Moira; Kulkarni, Abhaya; Davis, Aileen M

2016-08-30

We aimed to develop a measure of myasthenia gravis impairment using a previously developed framework and to evaluate reliability and validity, specifically face, content, and construct validity. The first draft of the Myasthenia Gravis Impairment Index (MGII) included examination items from available measures enriched with newly developed, patient-reported items, modified after patient input. International neuromuscular specialists evaluated face and content validity via an e-mail survey. Test-retest reliability was assessed in stable patients at a 3-week interval and interrater reliability was evaluated in the same day. Construct validity was assessed through correlations between the MGII and other measures and by comparing scores in different patient groups. The first draft was assessed by 18 patients, and 72 specialists answered the survey. The second draft had 7 examination and 22 patient-reported items. Field testing included 200 patients, with 54 patients completing the reliability studies. Test-retest reliability of the total score was good (intraclass correlation coefficient 0.92; 95% confidence interval 0.79-0.94), as was interrater reliability of the examination component (intraclass correlation coefficient 0.81; 95% confidence interval 0.79-0.94). The MGII correlated well with comparison measures, with higher correlations with the MG-activities of daily living (r = 0.91) and MG-specific quality of life 15-item scale (r = 0.78). When assessing different patient groups, the scores followed expected patterns. The MGII was developed using a patient-centered framework of myasthenia-related impairments and incorporating patient input throughout the development process. It is reliable in an outpatient setting and has demonstrated construct validity. Responsiveness studies are under way. © 2016 American Academy of Neurology.

Development and validation of the Myasthenia Gravis Impairment Index

PubMed Central

Bril, Vera; Kapral, Moira; Kulkarni, Abhaya; Davis, Aileen M.

2016-01-01

Objective: We aimed to develop a measure of myasthenia gravis impairment using a previously developed framework and to evaluate reliability and validity, specifically face, content, and construct validity. Methods: The first draft of the Myasthenia Gravis Impairment Index (MGII) included examination items from available measures enriched with newly developed, patient-reported items, modified after patient input. International neuromuscular specialists evaluated face and content validity via an e-mail survey. Test–retest reliability was assessed in stable patients at a 3-week interval and interrater reliability was evaluated in the same day. Construct validity was assessed through correlations between the MGII and other measures and by comparing scores in different patient groups. Results: The first draft was assessed by 18 patients, and 72 specialists answered the survey. The second draft had 7 examination and 22 patient-reported items. Field testing included 200 patients, with 54 patients completing the reliability studies. Test–retest reliability of the total score was good (intraclass correlation coefficient 0.92; 95% confidence interval 0.79–0.94), as was interrater reliability of the examination component (intraclass correlation coefficient 0.81; 95% confidence interval 0.79–0.94). The MGII correlated well with comparison measures, with higher correlations with the MG–activities of daily living (r = 0.91) and MG-specific quality of life 15-item scale (r = 0.78). When assessing different patient groups, the scores followed expected patterns. Conclusions: The MGII was developed using a patient-centered framework of myasthenia-related impairments and incorporating patient input throughout the development process. It is reliable in an outpatient setting and has demonstrated construct validity. Responsiveness studies are under way. PMID:27402891

Measuring Science Instructional Practice: A Survey Tool for the Age of NGSS

NASA Astrophysics Data System (ADS)

Hayes, Kathryn N.; Lee, Christine S.; DiStefano, Rachelle; O'Connor, Dawn; Seitz, Jeffery C.

2016-03-01

Ambitious efforts are taking place to implement a new vision for science education in the United States, in both Next Generation Science Standards (NGSS)-adopted states and those states creating their own, often related, standards. In-service and pre-service teacher educators are involved in supporting teacher shifts in practice toward the new standards. With these efforts, it will be important to document shifts in science instruction toward the goals of NGSS and broader science education reform. Survey instruments are often used to capture instructional practices; however, existing surveys primarily measure inquiry based on previous definitions and standards and with a few exceptions, disregard key instructional practices considered outside the scope of inquiry. A comprehensive survey and a clearly defined set of items do not exist. Moreover, items specific to the NGSS Science and Engineering practices have not yet been tested. To address this need, we developed and validated a Science Instructional Practices survey instrument that is appropriate for NGSS and other related science standards. Survey construction was based on a literature review establishing key areas of science instruction, followed by a systematic process for identifying and creating items. Instrument validity and reliability were then tested through a procedure that included cognitive interviews, expert review, exploratory and confirmatory factor analysis (using independent samples), and analysis of criterion validity. Based on these analyses, final subscales include: Instigating an Investigation, Data Collection and Analysis, Critique, Explanation and Argumentation, Modeling, Traditional Instruction, Prior Knowledge, Science Communication, and Discourse.

Development of the 7-Item Binge-Eating Disorder Screener (BEDS-7)

PubMed Central

Deal, Linda S.; DiBenedetti, Dana B.; Nelson, Lauren; Fehnel, Sheri E.; Brown, T. Michelle

2016-01-01

Objective Develop a brief, patient-reported screening tool designed to identify individuals with probable binge-eating disorder (BED) for further evaluation or referral to specialists. Methods Items were developed on the basis of the DSM-5 diagnostic criteria, existing tools, and input from 3 clinical experts (January 2014). Items were then refined in cognitive debriefing interviews with participants self-reporting BED characteristics (March 2014) and piloted in a multisite, cross-sectional, prospective, noninterventional study consisting of a semistructured diagnostic interview (to diagnose BED) and administration of the pilot Binge-Eating Disorder Screener (BEDS), Binge Eating Scale (BES), and RAND 36-Item Short-Form Health Survey (RAND-36) (June 2014–July 2014). The sensitivity and specificity of classification algorithms (formed from the pilot BEDS item-level responses) in predicting BED diagnosis were evaluated. The final algorithm was selected to minimize false negatives and false positives, while utilizing the fewest number of BEDS items. Results Starting with the initial BEDS item pool (20 items), the 13-item pilot BEDS resulted from the cognitive debriefing interviews (n = 13). Of the 97 participants in the noninterventional study, 16 were diagnosed with BED (10/62 female, 16%; 6/35 male, 17%). Seven BEDS items (BEDS-7) yielded 100% sensitivity and 38.7% specificity. Participants correctly identified (true positives) had poorer BES scores and RAND-36 scores than participants identified as true negatives. Conclusions Implementation of the brief, patient-reported BEDS-7 in real-world clinical practice is expected to promote better understanding of BED characteristics and help physicians identify patients who may have BED. PMID:27486542

Development of the 7-Item Binge-Eating Disorder Screener (BEDS-7).

PubMed

Herman, Barry K; Deal, Linda S; DiBenedetti, Dana B; Nelson, Lauren; Fehnel, Sheri E; Brown, T Michelle

2016-01-01

Develop a brief, patient-reported screening tool designed to identify individuals with probable binge-eating disorder (BED) for further evaluation or referral to specialists. Items were developed on the basis of the DSM-5 diagnostic criteria, existing tools, and input from 3 clinical experts (January 2014). Items were then refined in cognitive debriefing interviews with participants self-reporting BED characteristics (March 2014) and piloted in a multisite, cross-sectional, prospective, noninterventional study consisting of a semistructured diagnostic interview (to diagnose BED) and administration of the pilot Binge-Eating Disorder Screener (BEDS), Binge Eating Scale (BES), and RAND 36-Item Short-Form Health Survey (RAND-36) (June 2014-July 2014). The sensitivity and specificity of classification algorithms (formed from the pilot BEDS item-level responses) in predicting BED diagnosis were evaluated. The final algorithm was selected to minimize false negatives and false positives, while utilizing the fewest number of BEDS items. Starting with the initial BEDS item pool (20 items), the 13-item pilot BEDS resulted from the cognitive debriefing interviews (n = 13). Of the 97 participants in the noninterventional study, 16 were diagnosed with BED (10/62 female, 16%; 6/35 male, 17%). Seven BEDS items (BEDS-7) yielded 100% sensitivity and 38.7% specificity. Participants correctly identified (true positives) had poorer BES scores and RAND-36 scores than participants identified as true negatives. Implementation of the brief, patient-reported BEDS-7 in real-world clinical practice is expected to promote better understanding of BED characteristics and help physicians identify patients who may have BED.

Development and testing of item response theory-based item banks and short forms for eye, skin and lung problems in sarcoidosis.

PubMed

Victorson, David E; Choi, Seung; Judson, Marc A; Cella, David

2014-05-01

Sarcoidosis is a multisystem disease that can negatively impact health-related quality of life (HRQL) across generic (e.g., physical, social and emotional wellbeing) and disease-specific (e.g., pulmonary, ocular, dermatologic) domains. Measurement of HRQL in sarcoidosis has largely relied on generic patient-reported outcome tools, with little disease-specific measures available. The purpose of this paper is to present the development and testing of disease-specific item banks and short forms of lung, skin and eye problems, which are a part of a new patient-reported outcome (PRO) instrument called the sarcoidosis assessment tool. After prioritizing and selecting the most important disease-specific domains, we wrote new items to reflect disease-specific problems by drawing from patient focus group and clinician expert survey data that were used to create our conceptual model of HRQL in sarcoidosis. Item pools underwent cognitive interviews by sarcoidosis patients (n = 13), and minor modifications were made. These items were administered in a multi-site study (n = 300) to obtain item calibrations and create calibrated short forms using item response theory (IRT) approaches. From the available item pools, we created four new item banks and short forms: (1) skin problems, (2) skin stigma, (3) lung problems, and (4) eye Problems. We also created and tested supplemental forms of the most common constitutional symptoms and negative effects of corticosteroids. Several new sarcoidosis-specific PROs were developed and tested using IRT approaches. These new measures can advance more precise and targeted HRQL assessment in sarcoidosis clinical trials and clinical practice.

Doing peer review and receiving feedback: impact on scientific literacy and writing skills.

PubMed

Geithner, Christina A; Pollastro, Alexandria N

2016-03-01

Doing peer review has been effectively implemented to help students develop critical reading and writing skills; however, its application in Human Physiology programs is limited. The purpose of the present study was to determine the impact of peer review on Human Physiology majors' perceptions of their scientific literacy and writing skills. Students enrolled in the Scientific Writing course completed multiple writing assignments, including three revisions after receiving peer and instructor feedback. Students self-assessed their knowledge, skills, and attitudes related to science and writing in pre- and postcourse surveys (n = 26 with complete data). Seven survey items related to scientific literacy and writing skills impacted by peer review were selected for analysis. Scores on these survey items were summed to form a composite self-rating score. Responses to two questions regarding the most useful learning activities were submitted to frequency analysis. Mean postcourse scores for individual survey items and composite self-rating scores were significantly higher than precourse means (P < 0.05). Peer review was the most frequently noted among 21 learning activities for increasing scientific literacy and in the top 5 for improving writing skills. In conclusion, peer review is an effective teaching/learning approach for improving undergraduate Human Physiology majors' knowledge, skills, and attitudes regarding science and scientific writing. Copyright © 2016 The American Physiological Society.

Chefs' opinions about reducing the calorie content of menu items in restaurants.

PubMed

Obbagy, Julie E; Condrasky, Margaret D; Roe, Liane S; Sharp, Julia L; Rolls, Barbara J

2011-02-01

Modifying the energy content of foods, particularly foods eaten away from home, is important in addressing the obesity epidemic. Chefs in the restaurant industry are uniquely placed to influence the provision of reduced-calorie foods, but little is known about their opinions on this issue. A survey was conducted among chefs attending US culinary meetings about strategies for creating reduced-calorie foods and opportunities for introducing such items on restaurant menus. The 432 respondents were from a wide variety of employment positions and the majority had been in the restaurant industry for ≥ 20 years. Nearly all chefs (93%) thought that the calories in menu items could be reduced by 10-25% without customers noticing. To decrease the calories in two specific foods, respondents were more likely to select strategies for reducing energy density than for reducing portion size (P < 0.004). Low consumer demand was identified as the greatest barrier to including reduced-calorie items on the menu by 38% of chefs, followed by the need for staff skills and training (24%), and high ingredient cost (18%). The majority of respondents (71%) ranked taste as the most influential factor in the success of reduced-calorie items (P < 0.0001). The results of this survey indicate that opportunities exist for reducing the energy content of restaurant items. Ongoing collaboration is needed between chefs and public health professionals to ensure that appealing reduced-calorie menu items are more widely available in restaurants and that research is directed toward effective ways to develop and promote these items.

Chefs’ opinions about reducing the calorie content of menu items in restaurants

PubMed Central

Obbagy, Julie E.; Condrasky, Margaret D.; Roe, Liane S.; Sharp, Julia L.; Rolls, Barbara J.

2011-01-01

Modifying the energy content of foods, particularly foods eaten away from home, is important in addressing the obesity epidemic. Chefs in the restaurant industry are uniquely placed to influence the provision of reduced-calorie foods, but little is known about their opinions on this issue. A survey was conducted among chefs attending U.S. culinary meetings about strategies for creating reduced-calorie foods and opportunities for introducing such items on restaurant menus. The 432 respondents were from a wide variety of employment positions and the majority had been in the restaurant industry for 20 years or more. Nearly all chefs (93%) thought that the calories in menu items could be reduced by 10 to 25% without customers noticing. To decrease the calories in two specific foods, respondents were more likely to select strategies for reducing energy density than for reducing portion size (p<0.004). Low consumer demand was identified as the greatest barrier to including reduced-calorie items on the menu by 38% of chefs, followed by the need for staff skills and training (24%), and high ingredient cost (18%). The majority of respondents (71%) ranked taste as the most influential factor in the success of reduced-calorie items (p<0.0001). The results of this survey indicate that opportunities exist for reducing the energy content of restaurant items. Ongoing collaboration is needed between chefs and public health professionals to ensure that appealing reduced-calorie menu items are more widely available in restaurants and that research is directed towards effective ways to develop and promote these items. PMID:20814414

Review of Measures of Worksite Environmental and Policy Supports for Physical Activity and Healthy Eating

PubMed Central

Reeds, Dominic N.; van Bakergem, Margaret A.; Marx, Christine M.; Brownson, Ross C.; Pamulapati, Surya C.; Hoehner, Christine M.

2015-01-01

Introduction Obesity prevention strategies are needed that target multiple settings, including the worksite. The objective of this study was to assess the state of science concerning available measures of worksite environmental and policy supports for physical activity (PA) and healthy eating (HE). Methods We searched multiple databases for instruments used to assess worksite environments and policies. Two commonly cited instruments developed by state public health departments were also included. Studies that were published from 1991 through 2013 in peer-reviewed publications and gray literature that discussed the development or use of these instruments were analyzed. Instrument administration mode and measurement properties were documented. Items were classified by general health topic, 5 domains of general worksite strategy, and 19 subdomains of worksite strategy specific to PA or HE. Characteristics of worksite measures were described including measurement properties, length, and administration mode, as well as frequencies of items by domain and subdomain. Results Seventeen instruments met inclusion criteria (9 employee surveys, 5 manager surveys, 1 observational assessment, and 2 studies that used multiple administration modes). Fourteen instruments included reliability testing. More items were related to PA than HE. Most instruments (n = 10) lacked items in the internal social environment domain. The most common PA subdomains were exercise facilities and lockers/showers; the most common HE subdomain was healthy options/vending. Conclusion This review highlights gaps in measurement of the worksite social environment. The findings provide a useful resource for researchers and practitioners and should inform future instrument development. PMID:25950572

Review of measures of worksite environmental and policy supports for physical activity and healthy eating.

PubMed

Hipp, J Aaron; Reeds, Dominic N; van Bakergem, Margaret A; Marx, Christine M; Brownson, Ross C; Pamulapati, Surya C; Hoehner, Christine M

2015-05-07

Obesity prevention strategies are needed that target multiple settings, including the worksite. The objective of this study was to assess the state of science concerning available measures of worksite environmental and policy supports for physical activity (PA) and healthy eating (HE). We searched multiple databases for instruments used to assess worksite environments and policies. Two commonly cited instruments developed by state public health departments were also included. Studies that were published from 1991 through 2013 in peer-reviewed publications and gray literature that discussed the development or use of these instruments were analyzed. Instrument administration mode and measurement properties were documented. Items were classified by general health topic, 5 domains of general worksite strategy, and 19 subdomains of worksite strategy specific to PA or HE. Characteristics of worksite measures were described including measurement properties, length, and administration mode, as well as frequencies of items by domain and subdomain. Seventeen instruments met inclusion criteria (9 employee surveys, 5 manager surveys, 1 observational assessment, and 2 studies that used multiple administration modes). Fourteen instruments included reliability testing. More items were related to PA than HE. Most instruments (n = 10) lacked items in the internal social environment domain. The most common PA subdomains were exercise facilities and lockers/showers; the most common HE subdomain was healthy options/vending. This review highlights gaps in measurement of the worksite social environment. The findings provide a useful resource for researchers and practitioners and should inform future instrument development.

Climate of Respect Evaluation in ICUs: Development of an Instrument (ICU-CORE).

PubMed

Beach, Mary Catherine; Topazian, Rachel; Chan, Kitty S; Sugarman, Jeremy; Geller, Gail

2018-06-01

To develop a valid, reliable measure that reflected the environment of respectfulness within the ICU setting. We developed a preliminary survey instrument based on conceptual domains of respect identified through prior qualitative analyses of ICU patient, family member, and clinician perspectives. The initial instrument consisted of 21 items. After five cognitive interviews and 16 pilot surveys, we revised the instrument to include 23 items. We used standard psychometric methods to analyze the instrument. Eight ICUs serving adult patients affiliated with a large university health system. ICU clinicians. None. Based on 249 responses, we identified three factors and created subscales: General Respect, Respectful Behaviors, and Disrespectful Behaviors. The General Respect subscale had seven items (α = 0.932) and reflected how often patients in the ICU are treated with respect, in a dignified manner, as an individual, equally to all other patients, on the "same level" as the ICU team, as a person, and as you yourself would want to be treated. The Respectful Behaviors subscale had 10 items (α = 0.926) and reflected how often the ICU team responds to patient and/or family anxiety, makes an effort to get to know the patient and family as people, listens carefully, explains things thoroughly, gives the opportunity to provide input into care, protects patient modesty, greets when entering room, and talks to sedated patients. The subscale measuring disrespect has four items (α = 0.702) and reflects how often the ICU team dismisses family concerns, talks down to patients and families, speaks disrespectfully behind their backs, and gets frustrated with patients and families. We created a reliable set of scales to measure the climate of respectfulness in intensive care settings. These measures can be used for ongoing quality improvement that aim to enhance the experience of ICU patients and their families.

Psychometric assessment of a scale to measure bonding workplace social capital

PubMed Central

Tsutsumi, Akizumi; Inoue, Akiomi; Odagiri, Yuko

2017-01-01

Objectives Workplace social capital (WSC) has attracted increasing attention as an organizational and psychosocial factor related to worker health. This study aimed to assess the psychometric properties of a newly developed WSC scale for use in work environments, where bonding social capital is important. Methods We assessed the psychometric properties of a newly developed 6-item scale to measure bonding WSC using two data sources. Participants were 1,650 randomly selected workers who completed an online survey. Exploratory factor analyses were conducted. We examined the item–item and item–total correlations, internal consistency, and associations between scale scores and a previous 8-item measure of WSC. We evaluated test–retest reliability by repeating the survey with 900 of the respondents 2 weeks later. The overall scale reliability was quantified by an intraclass coefficient and the standard error of measurement. We evaluated convergent validity by examining the association with several relevant workplace psychosocial factors using a dataset from workers employed by an electrical components company (n = 2,975). Results The scale was unidimensional. The item–item and item–total correlations ranged from 0.52 to 0.78 (p < 0.01) and from 0.79 to 0.89 (p < 0.01), respectively. Internal consistency was good (Cronbach’s α coefficient: 0.93). The correlation with the 8-item scale indicated high criterion validity (r = 0.81) and the scale showed high test–retest reliability (r = 0.74, p < 0.01). The intraclass coefficient and standard error of measurement were 0.74 (95% confidence intervals: 0.71–0.77) and 4.04 (95% confidence intervals: 1.86–6.20), respectively. Correlations with relevant workplace psychosocial factors showed convergent validity. Conclusions The results confirmed that the newly developed WSC scale has adequate psychometric properties. PMID:28662058

Development of the PROMIS positive emotional and sensory expectancies of smoking item banks.

PubMed

Tucker, Joan S; Shadel, William G; Edelen, Maria Orlando; Stucky, Brian D; Li, Zhen; Hansen, Mark; Cai, Li

2014-09-01

The positive emotional and sensory expectancies of cigarette smoking include improved cognitive abilities, positive affective states, and pleasurable sensorimotor sensations. This paper describes development of Positive Emotional and Sensory Expectancies of Smoking item banks that will serve to standardize the assessment of this construct among daily and nondaily cigarette smokers. Data came from daily (N = 4,201) and nondaily (N =1,183) smokers who completed an online survey. To identify a unidimensional set of items, we conducted item factor analyses, item response theory analyses, and differential item functioning analyses. Additionally, we evaluated the performance of fixed-item short forms (SFs) and computer adaptive tests (CATs) to efficiently assess the construct. Eighteen items were included in the item banks (15 common across daily and nondaily smokers, 1 unique to daily, 2 unique to nondaily). The item banks are strongly unidimensional, highly reliable (reliability = 0.95 for both), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.86). Results from simulated CATs indicated that, on average, less than 8 items are needed to assess the construct with adequate precision using the item banks. These analyses identified a new set of items that can assess the positive emotional and sensory expectancies of smoking in a reliable and standardized manner. Considerable efficiency in assessing this construct can be achieved by using the item bank SF, employing computer adaptive tests, or selecting subsets of items tailored to specific research or clinical purposes. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

5 CFR 591.212 - How does OPM select survey items?

Code of Federal Regulations, 2010 CFR

2010-01-01

... large weight) within the PEG; (2) Relatively easy to find in both COLA and DC areas; (3) Relatively... COLA area must be identical to the items that OPM surveys in the DC area or be of closely similar... compares prices for such items between the COLA area and the DC area, OPM compares prices of like products. ...

5 CFR 591.212 - How does OPM select survey items?

Code of Federal Regulations, 2013 CFR

2013-01-01

... large weight) within the PEG; (2) Relatively easy to find in both COLA and DC areas; (3) Relatively... COLA area must be identical to the items that OPM surveys in the DC area or be of closely similar... compares prices for such items between the COLA area and the DC area, OPM compares prices of like products. ...

5 CFR 591.212 - How does OPM select survey items?

Code of Federal Regulations, 2014 CFR

2014-01-01

... large weight) within the PEG; (2) Relatively easy to find in both COLA and DC areas; (3) Relatively... COLA area must be identical to the items that OPM surveys in the DC area or be of closely similar... compares prices for such items between the COLA area and the DC area, OPM compares prices of like products. ...

5 CFR 591.212 - How does OPM select survey items?

Code of Federal Regulations, 2012 CFR

2012-01-01

... large weight) within the PEG; (2) Relatively easy to find in both COLA and DC areas; (3) Relatively... COLA area must be identical to the items that OPM surveys in the DC area or be of closely similar... compares prices for such items between the COLA area and the DC area, OPM compares prices of like products. ...

5 CFR 591.212 - How does OPM select survey items?

Code of Federal Regulations, 2011 CFR

2011-01-01

... large weight) within the PEG; (2) Relatively easy to find in both COLA and DC areas; (3) Relatively... COLA area must be identical to the items that OPM surveys in the DC area or be of closely similar... compares prices for such items between the COLA area and the DC area, OPM compares prices of like products. ...

Australasian emergency physicians: a learning and educational needs analysis. Part one: background and methodology. Profile of FACEM.

PubMed

Dent, Andrew W; Asadpour, Ali; Weiland, Tracey J; Paltridge, Debbie

2008-02-01

Fellows of the Australasian College for Emergency Medicine (FACEM) have opportunities to participate in a range of continuing professional development activities. To inform FACEM and assist those involved in planning continuing professional development interventions for FACEM, we undertook a learning needs analysis of emergency physicians. Exploratory study using survey methodology. Following questionnaire development by iterative feedback with emergency physicians and researchers, a mailed survey was distributed to all FACEM. The survey comprised eight items on work and demographic characteristics of FACEM, and 194 items on attitudes to existing learning opportunities, barriers to learning, and perceived learning needs and preferences. Fifty-eight percent (503/854) of all FACEM surveyed responded to the questionnaire, almost half of whom attained their FACEM after year 2000. The sample comprised mostly males (72.8%) with mean age of the sample 41.6 years, similar to ACEM database. Most respondents reported working in ACEM accredited hospitals (89%), major referral hospitals (54%), and practiced on both children and adults (78%). FACEM reported working on average 26.7 clinical hours per week with those at private hospitals working a greater proportion of clinical hours than other hospital types. As the first of six related reports, this paper documents the methodology used, including questionnaire development, and provides the demographics of responding FACEM, including the clinical and non-clinical hours worked and type of hospital of principal employment.

Development and validation of the Medical Home Care Coordination Survey for assessing care coordination in the primary care setting from the patient and provider perspectives.

PubMed

Zlateva, Ianita; Anderson, Daren; Coman, Emil; Khatri, Khushbu; Tian, Terrence; Fifield, Judith

2015-06-07

Community health centers are increasingly embracing the Patient Centered Medical Home (PCMH) model to improve quality, access to care, and patient experience while reducing healthcare costs. Care coordination (CC) is an important element of the PCMH model, but implementation and measurability of CC remains a problem within the outpatient setting. Assessing CC is an integral component of quality monitoring in health care systems. This study developed and validated the Medical Home Care Coordination Survey (MHCCS), to fill the gap in assessing CC in primary care from the perspectives of patients and their primary healthcare teams. We conducted a review of relevant literature and existing care coordination instruments identified by bibliographic search and contact with experts. After identifying all care coordination domains that could be assessed by primary healthcare team members and patients, we developed a conceptual model. Potentially appropriate items from existing published CC measures, along with newly developed items, were matched to each domain for inclusion. A modified Delphi approach was used to establish content validity. Primary survey data was collected from 232 patients with care transition and/or complex chronic illness needs from the Community Health Center, Inc. and from 164 staff members from 12 community health centers across the country via mail, phone and online survey. The MHCCS was validated for internal consistency, reliability, discriminant and convergent validity. This study was conducted at the Community Health Center, Inc. from January 15, 2012 to July 15, 2014. The 13-item MHCCS - Patient and the 32-item MHCCS - Healthcare Team were developed and validated. Exploratory Structural Equation Modeling was used to test the hypothesized domain structure. Four CC domains were confirmed from the patient group and eight were confirmed from the primary healthcare team group. All domains had high reliability (Cronbach's α scores were above 0.8). Patients experience the ultimate output of care coordination services, but primary healthcare staff members are best primed to perceive many of the structural elements of care coordination. The proactive measurement and monitoring of the core domains from both perspectives provides a richer body of information for the continuous improvement of care coordination services. The MHCCS shows promise as a valid and reliable assessment of these CC efforts.

Quality of physical therapy from a patient's perspective; factor analysis on web-based survey data revealed three dimensions on patient experiences with physical therapy.

PubMed

Scholte, Marijn; Calsbeek, Hilly; Nijhuis-van der Sanden, Maria W G; Braspenning, Jozé

2014-06-18

Assessing quality of care from the patient's perspective has changed from patient satisfaction to the more general term patient experience, as satisfaction measures turned out to be less discriminative due to high scores. Literature describes four to ten dimensions of patient experience, tailored to specific conditions or types of care. Given the administrative burden on patients, less dimensions and items could increase feasibility. Ten dimensions of patient experiences with physical therapy (PT) were proposed in the Netherlands in a consensus-based process with patients, physical therapists, health insurers, and policy makers. The aim of this paper is to detect the number of dimensions from data of a field study using factor analysis at item level. A web-based survey yielded data of 2,221 patients from 52 PT practices on 41 items. Principal component factor analysis at item level was used to assess the proposed distinction between the ten dimensions. Factor analysis revealed two dimensions: 'personal interaction' and 'practice organisation'. The dimension 'patient reported outcome' was artificially established. The three dimensions 'personal interaction' (14 items) (median(practice level) = 91.1; IQR = 2.4), 'practice organisation' (9 items) (median(practice level) = 88.9; IQR = 6.0) and 'outcome' (3 items) (median(practice level) = 80.6; IQR = 19.5) reduced the number of dimensions from ten to three and the number of items by more than a third. Factor analysis revealed three dimensions and achieved an item reduction of more than a third. It is a relevant step in the development process of a quality measurement tool to reduce respondent burden, increase clarity, and promote feasibility.

Hospital antibiotic management in Austria--results of the ABS maturity survey of the ABS International group.

PubMed

Burgmann, Heinz; Janata, Oskar; Allerberger, Franz; Frank, Annegret

2008-01-01

The ABS International group conducted a survey to estimate the prevalence and characteristics of country-specific hospital antibiotic management programs. This paper summarizes the results for Austria. The survey was conducted in April and May 2007. A questionnaire with various items related to hospital antibiotic management was sent to 160 Austrian hospitals. Of 160 questionnaires sent, 80 were returned and evaluable. The mean total score for all items and all hospitals was 3.29 (median: 3.42; range 1.35-4.74). The larger the hospital the higher were the reported scores concerning diagnostics, antibiotic-related organization and antibiotic-consumption control, but the lower the scores for antibiotic-related personnel development and antibiotic-related relationships to relevant environments. The maturity figure for large hospitals (>500 beds) was 3.57, for medium hospitals 3.34, and for small hospitals (<200 beds) 3.01. The self-reported results of our questionnaire-based survey clearly show that there is still need for improvement. In all five categories surveyed, Austrian hospitals scored their antibiotic maturity lower than the international averages. The establishment of an antibiotic officer enables the development of antibiotic stewardship tools such as antibiotic lists. Such tools can be seen as quality indicators.

Development of a simple 12-item theory-based instrument to assess the impact of continuing professional development on clinical behavioral intentions.

PubMed

Légaré, France; Borduas, Francine; Freitas, Adriana; Jacques, André; Godin, Gaston; Luconi, Francesca; Grimshaw, Jeremy

2014-01-01

Decision-makers in organizations providing continuing professional development (CPD) have identified the need for routine assessment of its impact on practice. We sought to develop a theory-based instrument for evaluating the impact of CPD activities on health professionals' clinical behavioral intentions. Our multipronged study had four phases. 1) We systematically reviewed the literature for instruments that used socio-cognitive theories to assess healthcare professionals' clinically-oriented behavioral intentions and/or behaviors; we extracted items relating to the theoretical constructs of an integrated model of healthcare professionals' behaviors and removed duplicates. 2) A committee of researchers and CPD decision-makers selected a pool of items relevant to CPD. 3) An international group of experts (n = 70) reached consensus on the most relevant items using electronic Delphi surveys. 4) We created a preliminary instrument with the items found most relevant and assessed its factorial validity, internal consistency and reliability (weighted kappa) over a two-week period among 138 physicians attending a CPD activity. Out of 72 potentially relevant instruments, 47 were analyzed. Of the 1218 items extracted from these, 16% were discarded as improperly phrased and 70% discarded as duplicates. Mapping the remaining items onto the constructs of the integrated model of healthcare professionals' behaviors yielded a minimum of 18 and a maximum of 275 items per construct. The partnership committee retained 61 items covering all seven constructs. Two iterations of the Delphi process produced consensus on a provisional 40-item questionnaire. Exploratory factorial analysis following test-retest resulted in a 12-item questionnaire. Cronbach's coefficients for the constructs varied from 0.77 to 0.85. A 12-item theory-based instrument for assessing the impact of CPD activities on health professionals' clinical behavioral intentions showed adequate validity and reliability. Further studies could assess its responsiveness to behavior change following CPD activities and its capacity to predict health professionals' clinical performance.

Development of a Simple 12-Item Theory-Based Instrument to Assess the Impact of Continuing Professional Development on Clinical Behavioral Intentions

PubMed Central

Légaré, France; Borduas, Francine; Freitas, Adriana; Jacques, André; Godin, Gaston; Luconi, Francesca; Grimshaw, Jeremy

2014-01-01

Background Decision-makers in organizations providing continuing professional development (CPD) have identified the need for routine assessment of its impact on practice. We sought to develop a theory-based instrument for evaluating the impact of CPD activities on health professionals' clinical behavioral intentions. Methods and Findings Our multipronged study had four phases. 1) We systematically reviewed the literature for instruments that used socio-cognitive theories to assess healthcare professionals' clinically-oriented behavioral intentions and/or behaviors; we extracted items relating to the theoretical constructs of an integrated model of healthcare professionals' behaviors and removed duplicates. 2) A committee of researchers and CPD decision-makers selected a pool of items relevant to CPD. 3) An international group of experts (n = 70) reached consensus on the most relevant items using electronic Delphi surveys. 4) We created a preliminary instrument with the items found most relevant and assessed its factorial validity, internal consistency and reliability (weighted kappa) over a two-week period among 138 physicians attending a CPD activity. Out of 72 potentially relevant instruments, 47 were analyzed. Of the 1218 items extracted from these, 16% were discarded as improperly phrased and 70% discarded as duplicates. Mapping the remaining items onto the constructs of the integrated model of healthcare professionals' behaviors yielded a minimum of 18 and a maximum of 275 items per construct. The partnership committee retained 61 items covering all seven constructs. Two iterations of the Delphi process produced consensus on a provisional 40-item questionnaire. Exploratory factorial analysis following test-retest resulted in a 12-item questionnaire. Cronbach's coefficients for the constructs varied from 0.77 to 0.85. Conclusion A 12-item theory-based instrument for assessing the impact of CPD activities on health professionals' clinical behavioral intentions showed adequate validity and reliability. Further studies could assess its responsiveness to behavior change following CPD activities and its capacity to predict health professionals' clinical performance. PMID:24643173

Variable stars around selected open clusters in the VVV area: Young Stellar Objects

NASA Astrophysics Data System (ADS)

Medina, Nicolas; Borissova, Jura; Bayo, Amelia; Kurtev, Radostin; Lucas, Philip

2017-09-01

Time-varying phenomena are one of the most substantial sources of astrophysical information, and led to many fundamental discoveries in modern astronomy. We have developed an automated tool to search and analyze variable sources in the near infrared Ks band, using the data from the Vista Variables in the Vía Láctea (VVV) ESO Public Survey ([5, 8]). One of our main goals is to investigate the Young Stellar Objects (YSOs) in the Galactic star forming regions, looking for: •Variability. •New pre-main sequence star clusters. Here we present the newly discovered YSOs within some selected stellar clusters in our Galaxy.

TPACK Survey Development Study for Social Sciences Teachers and Teacher Candidates

ERIC Educational Resources Information Center

Akman, Özkan; Güven, Cemal

2015-01-01

The purpose of this research is to develop a scale for analyzing the technological pedagogical and content knowledge (TPACK) and self-efficacy perceptions of the social sciences teachers and teacher candidates. During the development process, an item pool has been generated by evaluating the studies made in the literature. Also, after opinions…

Team Sports Achievement and Self-Esteem Development among Urban Adolescent Girls

ERIC Educational Resources Information Center

Pedersen, Sara; Seidman, Edward

2004-01-01

In this study we investigate the contribution of achievement in team sports to adolescent girls' self-esteem development. Adolescent girls (N = 247) from racially and ethnically diverse backgrounds were surveyed as part of a larger study investigating the development of poor urban youth. Participants responded to items tapping global self-esteem,…

Core Outcome Set-STAndards for Development: The COS-STAD recommendations.

PubMed

Kirkham, Jamie J; Davis, Katherine; Altman, Douglas G; Blazeby, Jane M; Clarke, Mike; Tunis, Sean; Williamson, Paula R

2017-11-01

The use of core outcome sets (COS) ensures that researchers measure and report those outcomes that are most likely to be relevant to users of their research. Several hundred COS projects have been systematically identified to date, but there has been no formal quality assessment of these studies. The Core Outcome Set-STAndards for Development (COS-STAD) project aimed to identify minimum standards for the design of a COS study agreed upon by an international group, while other specific guidance exists for the final reporting of COS development studies (Core Outcome Set-STAndards for Reporting [COS-STAR]). An international group of experienced COS developers, methodologists, journal editors, potential users of COS (clinical trialists, systematic reviewers, and clinical guideline developers), and patient representatives produced the COS-STAD recommendations to help improve the quality of COS development and support the assessment of whether a COS had been developed using a reasonable approach. An open survey of experts generated an initial list of items, which was refined by a 2-round Delphi survey involving nearly 250 participants representing key stakeholder groups. Participants assigned importance ratings for each item using a 1-9 scale. Consensus that an item should be included in the set of minimum standards was defined as at least 70% of the voting participants from each stakeholder group providing a score between 7 and 9. The Delphi survey was followed by a consensus discussion with the study management group representing multiple stakeholder groups. COS-STAD contains 11 minimum standards that are the minimum design recommendations for all COS development projects. The recommendations focus on 3 key domains: the scope, the stakeholders, and the consensus process. The COS-STAD project has established 11 minimum standards to be followed by COS developers when planning their projects and by users when deciding whether a COS has been developed using reasonable methods.

Developing energy and momentum conceptual survey (EMCS) with four-tier diagnostic test items

NASA Astrophysics Data System (ADS)

Afif, Nur Faadhilah; Nugraha, Muhammad Gina; Samsudin, Achmad

2017-05-01

Students' conceptions of work and energy are important to support the learning process in the classroom. For that reason, a diagnostic test instrument is needed to diagnose students' conception of work and energy. As a result, the researcher decided to develop Energy and Momentum Conceptual Survey (EMCS) instrument test into four-tier test diagnostic items. The purpose of this research is organized as the first step of four-tier test-formatted EMCS development as one of diagnostic test instruments on work and Energy. The research method used the 4D model (Defining, Designing, Developing and Disseminating). The instrument developed has been tested to 39 students in one of Senior High Schools. The resulting research showed that four-tier test-formatted EMCS is able to diagnose students' conception level of work and energy concept. It can be concluded that the development of four-tier test-formatted EMCS is one of potential diagnostic test instruments that able to obtain the category of students who understand concepts, misconceptions and do not understand about Work and Energy concept at all.

Problems experienced by people with arthritis when using a computer.

PubMed

Baker, Nancy A; Rogers, Joan C; Rubinstein, Elaine N; Allaire, Saralynn H; Wasko, Mary Chester

2009-05-15

To describe the prevalence of computer use problems experienced by a sample of people with arthritis, and to determine differences in the magnitude of these problems among people with rheumatoid arthritis (RA), osteoarthritis (OA), and fibromyalgia (FM). Subjects were recruited from the Arthritis Network Disease Registry and asked to complete a survey, the Computer Problems Survey, which was developed for this study. Descriptive statistics were calculated for the total sample and the 3 diagnostic subgroups. Ordinal regressions were used to determine differences between the diagnostic subgroups with respect to each equipment item while controlling for confounding demographic variables. A total of 359 respondents completed a survey. Of the 315 respondents who reported using a computer, 84% reported a problem with computer use attributed to their underlying disorder, and approximately 77% reported some discomfort related to computer use. Equipment items most likely to account for problems and discomfort were the chair, keyboard, mouse, and monitor. Of the 3 subgroups, significantly more respondents with FM reported more severe discomfort, more problems, and greater limitations related to computer use than those with RA or OA for all 4 equipment items. Computer use is significantly affected by arthritis. This could limit the ability of a person with arthritis to participate in work and home activities. Further study is warranted to delineate disease-related limitations and develop interventions to reduce them.

Defining Workplace Literacy Education in Massachusetts. A Survey of Workplace Literacy Education Programs in Massachusetts, Conducted in September and October 1989.

ERIC Educational Resources Information Center

Rosen, David J.; Kale, Cerci

A survey of 42 Massachusetts workplace literacy programs was conducted in fall 1989 to determine whether the programs generally fit a standard definition of workplace literacy derived from "A Guide to Developing Instruction for Workforce Literacy Programs" by Jorie W. Philippi. The study's seven-item questionnaire included the definition…

Quality of Life Assessment for Physical Activity and Health Promotion: Further Psychometrics and Comparison of Measures

ERIC Educational Resources Information Center

Gill, Diane L.; Reifsteck, Erin J.; Adams, Melanie M.; Shang, Ya-Ting

2015-01-01

Despite the clear relationship between physical activity and quality of life, few sound, relevant quality of life measures exist. Gill and colleagues developed a 32-item quality of life survey, and provided initial psychometric evidence. This study further examined that quality of life survey in comparison with the widely used short form (SF-36)…

Workforce Training in a Recovering Economy: Perceptions of State Community College Leaders

ERIC Educational Resources Information Center

Katsinas, Stephen G.; D'Amico, Mark M.; Friedel, Janice N.

2012-01-01

The purpose of this study was to examine policy issues from the unique viewpoint of state offices that are responsible for the supervision of community colleges and their role in developing the workforce. Using selected survey items from the 2012 Survey of Access and Finance conducted by the Education Policy Center at the University of Alabama, 50…

Low-cost Computer-Aided Instruction/Computer-Managed Instruction (CAI/ CMI) System: Feasibility Study

DTIC Science & Technology

1979-12-01

capabilities that are not essential to routine support of the majority of Air Force training. TABLE OF CONTENTS PAGE 1.0 INTRODUCTION ...66 APPEINDIX A Listing of All Survey Items ---------------------- 67 APPENDIX B Introduction to Survey Form and...5 6 1.0 INTRODUCTION Prototype computer-based individualized training systems have been developed and implemented at a number of

Development of a Survey Instrument to Measure TEFL Academics' Perceptions about, Individual and Workplace Characteristics for Conducting Research

ERIC Educational Resources Information Center

Bai, Li; Hudson, Peter; Millwater, Jan; Tones, Megan

2013-01-01

A 30-item survey was devised to determine Chinese TEFL (Teaching English as a Foreign Language) academics' potential for conducting research. A five-part Likert scale was used to gather data from 182 academics on four factors: (1) perceptions on teaching-research nexus, (2) personal perspectives for conducting research, (3) predispositions for…

Human Capital Planning in Higher Education Institutions: A Strategic Human Resource Development Initiative in Jordan

ERIC Educational Resources Information Center

Khasawneh, Samer

2011-01-01

Purpose: The primary purpose of this study is to determine the status of human capital planning in higher education institutions in Jordan. Design/methodology/approach: A random sample of 120 faculty members (in administrative positions) responded to a human capital planning (HCP) survey. The survey consisted of a pool of 38 items distributed over…

Development and analysis of an instrument to assess student understanding of GOB chemistry knowledge relevant to clinical nursing practice.

PubMed

Brown, Corina E; Hyslop, Richard M; Barbera, Jack

2015-01-01

The General, Organic, and Biological Chemistry Knowledge Assessment (GOB-CKA) is a multiple-choice instrument designed to assess students' understanding of the chemistry topics deemed important to clinical nursing practice. This manuscript describes the development process of the individual items along with a psychometric evaluation of the final version of the items and instrument. In developing items for the GOB-CKA, essential topics were identified through a series of expert interviews (with practicing nurses, nurse educators, and GOB chemistry instructors) and confirmed through a national survey. Individual items were tested in qualitative studies with students from the target population for clarity and wording. Data from pilot and beta studies were used to evaluate each item and narrow the total item count to 45. A psychometric analysis performed on data from the 45-item final version was used to provide evidence of validity and reliability. The final version of the instrument has a Cronbach's alpha value of 0.76. Feedback from an expert panel provided evidence of face and content validity. Convergent validity was estimated by comparing the results from the GOB-CKA with the General-Organic-Biochemistry Exam (Form 2007) of the American Chemical Society. Instructors who wish to use the GOB-CKA for teaching and research may contact the corresponding author for a copy of the instrument. © 2014 Wiley Periodicals, Inc.

Measuring the effects of online health information: Scale validation for the e-Health Impact Questionnaire.

PubMed

Kelly, Laura; Ziebland, Sue; Jenkinson, Crispin

2015-11-01

Health-related websites have developed to be much more than information sites: they are used to exchange experiences and find support as well as information and advice. This paper documents the development of a tool to compare the potential consequences and experiences a person may encounter when using health-related websites. Questionnaire items were developed following a review of relevant literature and qualitative secondary analysis of interviews relating to experiences of health. Item reduction steps were performed on pilot survey data (n=167). Tests of validity and reliability were subsequently performed (n=170) to determine the psychometric properties of the questionnaire. Two independent item pools entered psychometric testing: (1) Items relating to general views of using the internet in relation to health and, (2) Items relating to the consequences of using a specific health-related website. Identified sub-scales were found to have high construct validity, internal consistency and test-retest reliability. Analyses confirmed good psychometric properties in the eHIQ-Part 1 (11 items) and the eHIQ-Part 2 (26 items). This tool will facilitate the measurement of the potential consequences of using websites containing different types of material (scientific facts and figures, blogs, experiences, images) across a range of health conditions. Copyright © 2015 The Authors. Published by Elsevier Ireland Ltd.. All rights reserved.

Development of a Microsoft Excel tool for one-parameter Rasch model of continuous items: an application to a safety attitude survey.

PubMed

Chien, Tsair-Wei; Shao, Yang; Kuo, Shu-Chun

2017-01-10

Many continuous item responses (CIRs) are encountered in healthcare settings, but no one uses item response theory's (IRT) probabilistic modeling to present graphical presentations for interpreting CIR results. A computer module that is programmed to deal with CIRs is required. To present a computer module, validate it, and verify its usefulness in dealing with CIR data, and then to apply the model to real healthcare data in order to show how the CIR that can be applied to healthcare settings with an example regarding a safety attitude survey. Using Microsoft Excel VBA (Visual Basic for Applications), we designed a computer module that minimizes the residuals and calculates model's expected scores according to person responses across items. Rasch models based on a Wright map and on KIDMAP were demonstrated to interpret results of the safety attitude survey. The author-made CIR module yielded OUTFIT mean square (MNSQ) and person measures equivalent to those yielded by professional Rasch Winsteps software. The probabilistic modeling of the CIR module provides messages that are much more valuable to users and show the CIR advantage over classic test theory. Because of advances in computer technology, healthcare users who are familiar to MS Excel can easily apply the study CIR module to deal with continuous variables to benefit comparisons of data with a logistic distribution and model fit statistics.

Validation of the French version of the Hospital Survey on Patient Safety Culture questionnaire.

PubMed

Occelli, P; Quenon, J-L; Kret, M; Domecq, S; Delaperche, F; Claverie, O; Castets-Fontaine, B; Amalberti, R; Auroy, Y; Parneix, P; Michel, P

2013-09-01

To assess the psychometric properties of the French version of the Hospital Survey on Patient Safety Culture questionnaire (HSOPSC) and study the hierarchical structure of the measured dimensions. Cross-sectional survey of the safety culture. 18 acute care units of seven hospitals in South-western France. Full- and part-time healthcare providers who worked in the units. None. Item responses measured with 5-point agreement or frequency scales. Data analyses A principal component analysis was used to identify the emerging components. Two structural equation modeling methods [LInear Structural RELations (LISREL) and Partial Least Square (PLS)] were used to verify the model and to study the relative importance of the dimensions. Internal consistency of the retained dimensions was studied. A test-retest was performed to assess reproducibility of the items. Overall response rate was 77% (n = 401). A structure in 40 items grouped in 10 dimensions was proposed. The LISREL approach showed acceptable data fit of the proposed structure. The PLS approach indicated that three dimensions had the most impact on the safety culture: 'Supervisor/manager expectations & actions promoting safety' 'Organizational learning-continuous improvement' and 'Overall perceptions of safety'. Internal consistency was above 0.70 for six dimensions. Reproducibility was considered good for four items. The French HSOPSC questionnaire showed acceptable psychometric properties. Classification of the dimensions should guide future development of safety culture improving action plans.

Combining agreement and frequency rating scales to optimize psychometrics in measuring behavioral health functioning.

PubMed

Marfeo, Elizabeth E; Ni, Pengsheng; Chan, Leighton; Rasch, Elizabeth K; Jette, Alan M

2014-07-01

The goal of this article was to investigate optimal functioning of using frequency vs. agreement rating scales in two subdomains of the newly developed Work Disability Functional Assessment Battery: the Mood & Emotions and Behavioral Control scales. A psychometric study comparing rating scale performance embedded in a cross-sectional survey used for developing a new instrument to measure behavioral health functioning among adults applying for disability benefits in the United States was performed. Within the sample of 1,017 respondents, the range of response category endorsement was similar for both frequency and agreement item types for both scales. There were fewer missing values in the frequency items than the agreement items. Both frequency and agreement items showed acceptable reliability. The frequency items demonstrated optimal effectiveness around the mean ± 1-2 standard deviation score range; the agreement items performed better at the extreme score ranges. Findings suggest an optimal response format requires a mix of both agreement-based and frequency-based items. Frequency items perform better in the normal range of responses, capturing specific behaviors, reactions, or situations that may elicit a specific response. Agreement items do better for those whose scores are more extreme and capture subjective content related to general attitudes, behaviors, or feelings of work-related behavioral health functioning. Copyright © 2014 Elsevier Inc. All rights reserved.

Psychometric properties of the Press Ganey® Outpatient Medical Practice Survey.

PubMed

Presson, Angela P; Zhang, Chong; Abtahi, Amir M; Kean, Jacob; Hung, Man; Tyser, Andrew R

2017-02-10

The Press Ganey® Medical Practice Survey ("Press Ganey® survey") is a patient-reported questionnaire commonly used to measure patient satisfaction with outpatient health care in the United States. Our objective was to evaluate the reliability and validity of the Press Ganey® survey in a single institution setting. We analyzed surveys from 34,503 unique respondents seen by 624 providers from 47 specialties and 94 clinics at the University of Utah in 2013. The University of Utah is a health care system that provides primary through tertiary care for over 200 medical specialties. Surveys were administered online. The Press Ganey® survey consisted of 24 items organized into 6 scales: Access (4 items), Moving Through the Visit (2), Nurse Assistant (2), Care Provider (10), Personal Issues (4) and Overall Assessment (2). Missingness, ceiling and floor rates were summarized. Cronbach's alpha was used to evaluate internal consistency reliability. Confirmatory factor analysis was used to assess convergent and discriminant validities. Missingness was 0.01% for the total score and ranged from 0.8 to 11.4% across items. The ceiling rate was high at 29.3% for the total score, and ranged from 55.4 to 84.1% across items. Floor rates were 0.01% for the total score, and ranged from 0.1 to 2.1% across items. Internal consistency reliability ranged from 0.79 to 0.96, and item-scale correlations ranged from 0.49 to 0.9. Confirmatory factor analysis supported convergent and discriminant validities. The Press Ganey® survey demonstrated suitable psychometric properties for most metrics. However, the high ceiling rate can have a notable impact on quarterly percentile scores within our institution. Multi-institutional studies of the Press Ganey® survey are needed to inform administrative decision making and institution reimbursement decisions based on this survey.

Development of the Primary Care Quality-Homeless (PCQ-H) Instrument: A Practical Survey of Patients' Experiences in Primary Care

PubMed Central

Kertesz, Stefan. G.; Pollio, David E.; Jones, Richard N.; Steward, Jocelyn; Stringfellow, Erin J.; Gordon, Adam J.; Johnson, Nancy K.; Kim, Theresa A.; Granstaff, Unita; Austin, Erika L.; Young, Alexander S.; Golden, Joya; Davis, Lori L.; Roth, David L.; Holt, Cheryl L.

2015-01-01

Background Homeless patients face unique challenges in obtaining primary care responsive to their needs and context. Patient experience questionnaires could permit assessment of patient-centered medical homes for this population, but standard instruments may not reflect homeless patients' priorities and concerns. Objectives This report describes (a) the content and psychometric properties of a new primary care questionnaire for homeless patients and (b) the methods utilized in its development. Methods Starting with quality-related constructs from the Institute of Medicine, we identified relevant themes by interviewing homeless patients and experts in their care. A multidisciplinary team drafted a preliminary set of 78 items. This was administered to homeless-experienced clients (n=563) across 3 VA facilities and 1 non-VA Health Care for the Homeless Program. Using Item Response Theory, we examined Test Information Function curves to eliminate less informative items and devise plausibly distinct subscales. Results The resulting 33-item instrument (Primary Care Quality-Homeless, PCQ-H) has four subscales: Patient-Clinician Relationship (15 items), Cooperation among Clinicians (3 items), Access/Coordination (11 items) and Homeless-Specific Needs (4 items). Evidence for divergent and convergent validity is provided. Test Information Function (TIF) graphs showed adequate informational value to permit inferences about groups for 3 subscales (Relationship, Cooperation and Access/Coordination). The 3-item Cooperation subscale had lower informational value (TIF<5) but had good internal consistency (alpha=0.75) and patients frequently reported problems in this aspect of care. Conclusions Systematic application of qualitative and quantitative methods supported the development of a brief patient-reported questionnaire focused on the primary care of homeless patients and offers guidance for future population-specific instrument development. PMID:25023918

Item generation in the development of an inpatient experience questionnaire: a qualitative study

PubMed Central

2013-01-01

Background Patient experience is a key feature of quality improvement in modern health-care delivery. Measuring patient experience is one of several tools used to assess and monitor the quality of health services. This study aims to develop a tool for assessing patient experience with inpatient care in public hospitals in Hong Kong. Methods Based on the General Inpatient Questionnaire (GIQ) framework of the Care Quality Commission as a discussion guide, a qualitative study involving focus group discussions and in-depth individual interviews with patients was employed to develop a tool for measuring inpatient experience in Hong Kong. Results All participants agreed that a patient satisfaction survey is an important platform for collecting patients’ views on improving the quality of health-care services. Findings of the focus group discussions and in-depth individual interviews identified nine key themes as important hospital quality indicators: prompt access, information provision, care and involvement in decision making, physical and emotional needs, coordination of care, respect and privacy, environment and facilities, handling of patient feedback, and overall care from health-care professionals and quality of care. Privacy, complaint mechanisms, patient involvement, and information provision were further highlighted as particularly important areas for item revision by the in-depth individual interviews. Thus, the initial version of the Hong Kong Inpatient Experience Questionnaire (HKIEQ), comprising 58 core items under nine themes, was developed. Conclusions A set of dimensions and core items of the HKIEQ was developed and the instrument will undergo validity and reliability tests through a validation survey. A valid and reliable tool is important in accurately assessing patient experience with care delivery in hospitals to improve the quality of health-care services. PMID:23835186

A Methodological Study of Order Effects in Reporting Relational Aggression Experiences.

PubMed

Serico, Jennifer M; NeMoyer, Amanda; Goldstein, Naomi E S; Houck, Mark; Leff, Stephen S

2018-03-01

Unlike the overt nature of physical aggression, which lends itself to simpler and more direct methods of investigation, the often-masked nature of relational aggression has led to difficulties and debate regarding the most effective tools of study. Given concerns with the accuracy of third-party relational aggression reports, especially as individuals age, self-report measures may be particularly useful when assessing experiences with relational aggression. However, it is important to recognize validity concerns-in particular, the potential effects of item order presentation-associated with self-report of relational aggression perpetration and victimization. To investigate this issue, surveys were administered and completed by 179 young adults randomly assigned to one of four survey conditions reflecting manipulation of item order. Survey conditions included presentation of (a) perpetration items only, (b) victimization items only, (c) perpetration items followed by victimization items, and (d) victimization items followed by perpetration items. Results revealed that participants reported perpetrating relational aggression significantly more often when asked only about perpetration or when asked about perpetration before victimization, compared with participants who were asked about victimization before perpetration. Item order manipulation did not result in significant differences in self-reported victimization experiences. Results of this study indicate a need for greater consideration of item order when conducting research using self-report data and the importance of additional investigation into which form of item presentation elicits the most accurate self-report information.

Transformational, transactional among physician and laissez-faire leadership among physician executives.

PubMed

Xirasagar, Sudha

2008-01-01

The purpose of this paper is to examine the empirical validity of transformational, transactional and laissez-faire leadership and their sub-scales among physician managers. A nation-wide, anonymous mail survey was carried out in the United States, requesting community health center executive directors to provide ratings of their medical director's leadership behaviors (34 items) and effectiveness (nine items), using the Multifactor Leadership Questionnaire 5X-Short, on a five-point Likert scale. The survey response rate was 40.9 percent, for a total 269 responses. Exploratory factor analysis was done, using principal factor extraction, followed by promax rotation). The data yielded a three-factor structure, generally aligned with Bass and Avolio's constructs of transformational, transactional and laissez-faire leadership. Data do not support the factorial independence of their subscales (idealized influence, inspirational motivation, individualized consideration, and intellectual stimulation under transformational leadership; contingent reward, management-by-exception active, and management-by-exception passive under transactional leadership). Two contingent reward items loaded on transformational leadership, and all items of management-by-exception passive loaded on laissez-faire. A key limitation is that supervisors were surveyed for ratings of the medical directors' leadership style. Although past research in other fields has shown that supervisor ratings are strongly correlated with subordinate ratings, further research is needed to validate the findings by surveying physician and other clinical subordinates. Such research will also help to develop appropriate content of leadership training for clinical leaders. This study represents an important step towards establishing the empirical evidence for the full range of leadership constructs among physician leaders.

Construction and validation of the South African version of the Fear Survey Schedule for Children: an exploratory factor analysis.

PubMed

Burkhardt, Käthe; Loxton, Helene; Kagee, Ashraf; Ollendick, Thomas H

2012-09-01

The Fear Survey Schedule for Children-Revised (Ollendick, 1983) is an 80-item self-report instrument that has been used internationally to asses the number of fears and general level of fearfulness among children. Despite its widespread use, this instrument has not been adapted to the South African context. The present study addressed this gap by means of a 2-phase investigation aimed at developing a South African version of the instrument. In Phase 1, semistructured interviews were conducted with 40 children (7 to 13 years of age). Qualitative data obtained from these interviews were used to construct additional items for inclusion in the South African Fear Survey Schedule for Children-Revised. The modified scale, consisting of 97 items, was then administered to a sample of 646 children between the ages of 7 and 13 years. Further psychometric considerations resulted in the final version of the scale consisting of 74 items with high internal consistency (α=.97). The factor structure was explored by means of principal component analysis with varimax rotation and a 5-factor solution was found to provide the best conceptual fit. The factors identified were as follows: Fear of Death and Danger; Fear of the Unknown; Fear of Small Animals and Minor Threats to Self; Large Animal Fears; and Situational Fears. Differences between the South African version and the original Fear Survey Schedule for Children-Revised are noted and implications for the study of fear in South Africa and other countries are discussed. Copyright © 2012. Published by Elsevier Ltd.

Using and understanding consumer satisfaction to effect an improvement in mental health service delivery.

PubMed

Brunero, S; Lamont, S; Fairbrother, G

2009-04-01

Consumer satisfaction is today, widely accepted as a measure of the level and quality of service received by consumers. The aim of this survey-based study is to explore consumer satisfaction with quality of care, staff, environment and discharge in a south eastern Sydney adult acute inpatient mental health unit. A cross-sectional analysis is pursued in order to identify aspects of the patient stay, which form an associative relationship with an overall rating of consumer satisfaction on a 10-point scale. During the survey period, there were 182 discharges. Seventy questionnaires (38.5%) were returned from this group. The survey results highlight a number of areas of identified need, enabling the service to prioritize organizational systems around meeting these needs. Multiple regression analysis identified three items in the survey, which were independently significant associates of overall consumer satisfaction. They included being happy with the service provided by the consumer support worker, having support for services on discharge and feeling safe and secure on the ward. The model containing these three items accounted for 50% of the variation in overall satisfaction. Two primary interventions have been developed because survey administration which, it is hoped, will address issues raised in the survey. The interventions were the development of an admission and discharge pathway and a ward-based psychosocial intervention programme, which includes the involvement of consumer support workers.

Validation of the Child HCAHPS survey to measure pediatric inpatient experience of care in Flanders.

PubMed

Bruyneel, Luk; Coeckelberghs, Ellen; Buyse, Gunnar; Casteels, Kristina; Lommers, Barbara; Vandersmissen, Jo; Van Eldere, Johan; Van Geet, Chris; Vanhaecht, Kris

2017-07-01

The recently developed Child HCAHPS provides a standard to measure US hospitals' performance on pediatric inpatient experiences of care. We field-tested Child HCAHPS in Belgium to instigate international comparison. In the development stage, forward/backward translation was conducted and patients assessed content validity index as excellent. The draft Flemish Child HCAHPS included 63 items: 38 items for five topics hypothesized to be similar to those proposed in the US (communication with parent, communication with child, attention to safety and comfort, hospital environment, and global rating), 10 screeners, a 14-item demographic and descriptive section, and one open-ended item. A 6-week pilot test was subsequently performed in three pediatric wards (general ward, hematology and oncology ward, infant and toddler ward) at a JCI-accredited university hospital. An overall response rate of 90.99% (303/333) was achieved and was consistent across wards. Confirmatory factor analysis largely confirmed the configuration of the proposed composites. Composite and single-item measures related well to patients' global rating of the hospital. Interpretation of different patient experiences across types of wards merits further investigation. Child HCAHPS provides an opportunity for systematic and cross-national assessment of pediatric inpatient experiences. Sharing and implementing international best practices are the next logical step. What is Known: • Patient experience surveys are increasingly used to reflect on the quality, safety, and centeredness of patient care. • While adult inpatient experience surveys are routinely used across countries around the world, the measurement of pediatric inpatient experiences is a young field of research that is essential to reflect on family-centered care. What is New: • We demonstrate that the US-developed Child HCAHPS provides an opportunity for international benchmarking of pediatric inpatient experiences with care through parents and guardians. • Our study findings show considerable variation in experiences for types of pediatric services. Support to share good practices and launch quality improvement initiatives can be obtained by organizing regular two-way feedback sessions with clinicians to place the findings in context.

Parallel short forms for the assessment of activities of daily living in cardiovascular rehabilitation patients (PADL-cardio): development and validation.

PubMed

Schmucker, Andreas; Abberger, Birgit; Boecker, Maren; Baumeister, Harald

2017-11-26

To develop and validate parallel short forms for the assessment of activities of daily living in cardiac rehabilitation patients (PADL-cardio I & II). PADL-cardio I & II were developed based on a sample of 106 patients [mean age  =  57.6; standard deviation (SD) = 11.1; 72.6% males] using Rasch analysis and validated with a sample of 81 patients (mean age  =  59.1; SD  =  11.1; 88.9% males). All patients answered PADL-cardio and the Short Form 12 Health Survey. Both versions of PADL-cardio are composed of 10 items. The fit to the Rasch model was given documented by a non-significant Item-trait interaction score (PADL-cardio I: χ 2  = 31.08, df  =  30, p  =  0.41; PADL-cardio II: χ 2  = 45.6, df  =  40, p  =  0.25). The two versions were free of differential item functioning. Person-separation reliability was 0.72/0.78 and unidimensionality was given. The two versions correlated with r = 0.98 and the correlation between PADL-cardio and the underlying item bank was 0.99 for both versions. Concurrent validity is indicated through correlations with the Short Form 12 Health Survey (r  = -0.37 to -0.40). PADL-cardio provides a short and psychometrically sound option for the assessment of activities of daily living in cardiovascular rehabilitation patients. The two versions of PADL-cardio are equivalent. Hence, they can be used to reduce practice and retest effects in repeated measurement, facilitating the longitudinal assessment of activities of daily living. Implications for Rehabilitation New parallel test forms for the assessment of activities of daily living in cardiac rehabilitation (PADL-cardio I & PADL-cardio II) are available. PADL-cardio I & II consist of 10 items and are therefore especially timesaving. Concurrent validity is given through correlations with the Short Form Health Survey 12. Therapeutic success could be determined more precisely by the parallel forms reducing practice and retest effects.

Development of a golf-specific load monitoring tool: Content validity and feasibility.

PubMed

Williams, Scott B; Gastin, Paul B; Saw, Anna E; Robertson, Sam

2018-05-01

Athletes often record details of their training and competitions, supported by information such as environmental conditions, travel, as well as how they felt. However, it is not known how prevalent these practices are in golfers, or how valuable this process is perceived. The purpose of this study was to develop a golf-specific load monitoring tool (GLMT), and establish the content validity and feasibility of this tool amongst high-level golfers. In the first phase of development, 21 experts were surveyed to determine the suitability of items for inclusion in the GLMT. Of the 36 items, 21 received >78% agreement, a requirement to establish content validity and for inclusion in the GLMT. Total duration was the preferred metric for golf-specific activities, whilst rating of perceived exertion (RPE) was preferred for measuring physical training. In the second phase, feasibility of the tool was assessed by surveying 13 high-level male golfers following 28-days of daily GLMT use. All items included in the GLMT were deemed feasible to record, with all players participating in the feasibility study providing high to very high ratings. Golfers responded that they would consider using a load monitoring tool of this nature long term, provided it can be completed in less than five minutes per day.

Using Symbolic-Logic Matrices To Improve Confirmatory Factor Analysis Techniques.

ERIC Educational Resources Information Center

Creighton, Theodore B.; Coleman, Donald G.; Adams, R. C.

A continuing and vexing problem associated with survey instrument development is the creation of items, initially, that correlate favorably a posteriori with constructs being measured. This study tests the use of symbolic-logic matrices developed by D. G. Coleman (1979) in creating factorially "pure" statistically discrete constructs in…

The 1988 CDA National Survey Results.

ERIC Educational Resources Information Center

Council for Early Childhood Professional Recognition, Washington, DC.

A 44-item questionnare was sent to 11,000 Child Development Associates in the fall of 1988 in an effort to provide an updated view of the constituency served by the Child Development Association (CDA) National Credentialing Program. The questionnaire covered four categories: (1) background information; (2) education and experience; (3) training…

Reliability and Validity of Wisconsin Upper Respiratory Symptom Survey, Korean Version

PubMed Central

Yang, Su-Young; Kang, Weechang; Yeo, Yoon; Park, Yang-Chun

2011-01-01

Background The Wisconsin Upper Respiratory Symptom Survey (WURSS) is a self-administered questionnaire developed in the United States to evaluate the severity of the common cold and its reliability has been validated. We developed a Korean language version of this questionnaire by using a sequential forward and backward translation approach. The purpose of this study was to validate the Korean version of the Wisconsin Upper Respiratory Symptom Survey (WURSS-K) in Korean patients with common cold. Methods This multicenter prospective study enrolled 107 participants who were diagnosed with common cold and consented to participate in the study. The WURSS-K includes 1 global illness severity item, 32 symptom-based items, 10 functional quality-of-life (QOL) items, and 1 item assessing global change. The SF-8 was used as an external comparator. Results The participants were 54 women and 53 men aged 18 to 42 years. The WURSS-K showed good reliability in 10 domains, with Cronbach’s alphas ranging from 0.67 to 0.96 (mean: 0.84). Comparison of the reliability coefficients of the WURSS-K and WURSS yielded a Pearson correlation coefficient of 0.71 (P = 0.02). Validity of the WURSS-K was evaluated by comparing it with the SF-8, which yielded a Pearson correlation coefficient of −0.267 (P < 0.001). The Guyatt’s responsiveness index of the WURSS-K ranged from 0.13 to 0.46, and the correlation coefficient with the WURSS was 0.534 (P < 0.001), indicating that there was close correlation between the WURSS-K and WURSS. Conclusions The WURSS-K is a reliable, valid, and responsive disease-specific questionnaire for assessing symptoms and QOL in Korean patients with common cold. PMID:21691034

Developing and Pilot Testing a Spanish Translation of CollaboRATE for Use in the United States.

PubMed

Forcino, Rachel C; Bustamante, Nitzy; Thompson, Rachel; Percac-Lima, Sanja; Elwyn, Glyn; Pérez-Arechaederra, Diana; Barr, Paul J

2016-01-01

Given the need for access to patient-facing materials in multiple languages, this study aimed to develop and pilot test an accurate and understandable translation of CollaboRATE, a three-item patient-reported measure of shared decision-making, for Spanish-speaking patients in the United States (US). We followed the Translate, Review, Adjudicate, Pre-test, Document (TRAPD) survey translation protocol. Cognitive interviews were conducted with Spanish-speaking adults within an urban Massachusetts internal medicine clinic. For the pilot test, all patients with weekday appointments between May 1 and May 29, 2015 were invited to complete CollaboRATE in either English or Spanish upon exit. We calculated the proportion of respondents giving the best score possible on CollaboRATE and compared scores across key patient subgroups. Four rounds of cognitive interviews with 26 people were completed between January and April 2015. Extensive, iterative refinements to survey items between interview rounds led to final items that were generally understood by participants with diverse educational backgrounds. Pilot data collection achieved an overall response rate of 73 percent, with 606 (49%) patients completing Spanish CollaboRATE questionnaires and 624 (51%) patients completing English CollaboRATE questionnaires. The proportion of respondents giving the best score possible on CollaboRATE was the same (86%) for both the English and Spanish versions of the instrument. Our translation method, guided by emerging best practices in survey and health measurement translation, encompassed multiple levels of review. By conducting four rounds of cognitive interviews with iterative item refinement between each round, we arrived at a Spanish language version of CollaboRATE that was understandable to a majority of cognitive interview participants and was completed by more than 600 pilot questionnaire respondents.

Validating survey measurement scales for AIDS-related knowledge and stigma among construction workers in South Africa.

PubMed

Bowen, Paul; Govender, Rajen; Edwards, Peter

2016-01-23

Construction workers in South Africa are regarded as a high-risk group in the context of HIV/AIDS. HIV testing is pivotal to controlling HIV transmission and providing palliative care and AIDS-related knowledge and stigma are key issues in addressing the likelihood of testing behaviour. In exploring these issues, various studies have employed an 11-item AIDS-related knowledge scale (Kalichman and Simbayi, AIDS Care 16:572-580, 2004) and a 9-item stigma scale (Kalichman et al., AIDS Behav 9:135-143, 2005), but little evidence exists confirming the psychometric properties of these scales. Using survey data from 512 construction workers in the Western Cape, South Africa, this research examines the validity and reliability of the two scales through exploratory and confirmatory factor analysis and internal consistency tests. From confirmatory factor analysis, a revised 10-item knowledge scale was developed (χ2 /df ratio = 1.675, CFI = 0.982, RMSEA = 0.038, and Hoelter (95 %) = 393). A revised 8-item stigma scale was also developed (χ2 /df ratio = 1.929, CFI = 0.974, RMSEA = 0.045, and Hoelter (95 %) = 380). Both revised scales demonstrated good model fit and all factor loadings were significant (p < 0.01). Reliability analysis demonstrated excellent to good internal consistency, with alpha values of 0.80 and 0.74, respectively. Both revised scales also demonstrated satisfactory convergent and divergent validity. Limitations of the original survey from which the data was obtained include the failure to properly account for respondent selection of language for completion of the survey, use of ethnicity as a proxy for identifying the native language of participants, the limited geographical area from which the survey data was collected, and the limitations associated with the convenience sample. A limitation of the validation study was the lack of available data for a more robust examination of reliability beyond internal consistency, such as test-retest reliability. The revised knowledge and stigma scales offered here hold considerable promise as measures of AIDS-related knowledge and stigma among South African construction workers.

Feasibility survey on international cooperation for high efficiency energy conversion technology in fiscal 1993

NASA Astrophysics Data System (ADS)

1994-03-01

Following cooperative researches on fuel cell jointly conducted by NEDO and EGAT (Electricity Generating Authority of Thailand), the survey on international cooperation relating to high efficiency energy conversion technology was carried out for the ASEAN countries. The paper summed up the results of the survey. The study of the international cooperation is made for the following three items: a program for periodical exchange of information with EGAT, a project for cooperative research on phosphoric acid fuel cell in Indonesia, and a project for cooperative research with EGAT on electric power storage by advanced battery. In Malaysia, which is small in scale of state, part of the Ministry of Energy, Telecommunication and Posts is only in charge of the energy issue. Therefore, the situation is that they cannot answer well to many items of research/development cooperation brought in from Japan. The item of medium- and long-term developmental research in the Philippines is about the problems which are seen subsequently in the Manila metropolitan area where the problem of outage is being settled. Accordingly, it is essential to promote the cooperative research, well confirming policies and systems of the Ministry of Energy and the national electricity corporation.

Role of Cognitive Testing in the Development of the CAHPS® Hospital Survey

PubMed Central

Levine, Roger E; Fowler, Floyd J; Brown, Julie A

2005-01-01

Objective To describe how cognitive testing results were used to inform the modification and selection of items for the Consumer Assessment of Health Providers and Systems (CAHPS®) Hospital Survey pilot test instrument. Data Sources Cognitive interviews were conducted on 31 subjects in two rounds of testing: in December 2002–January 2003 and in February 2003. In both rounds, interviews were conducted in northern California, southern California, Massachusetts, and North Carolina. Study Design A common protocol served as the basis for cognitive testing activities in each round. This protocol was modified to enable testing of the items as interviewer-administered and self-administered items and to allow members of each of three research teams to use their preferred cognitive research tools. Data Collection/Extraction Methods Each research team independently summarized, documented, and reported their findings. Item-specific and general issues were noted. The results were reviewed and discussed by senior staff from each research team after each round of testing, to inform the acceptance, modification, or elimination of candidate items. Principal Findings Many candidate items required modification because respondents lacked the information required to answer them, respondents failed to understand them consistently, the items were not measuring the constructs they were intended to measure, the items were based on erroneous assumptions about what respondents wanted or experienced during their hospitalization, or the items were asking respondents to make distinctions that were too fine for them to make. Cognitive interviewing enabled the detection of these problems; an understanding of the etiology of the problem informed item revisions. However, for some constructs, the revisions proved to be inadequate. Accordingly, items could not be developed to provide acceptable measures of certain constructs such as shared decision making, coordination of care, and delays in the admissions process. Conclusions Cognitive testing is the most direct way of finding out whether respondents understand questions consistently, have the information needed to answer the questions, and can use the response alternatives provided to describe their experiences or their opinions accurately. Many of the candidate questions failed to meet these standards. Cognitive testing only evaluates the way in which respondents understand and answer questions. Although it does not directly assess the validity of the answers, it is a reasonable premise that cognitive problems will seriously compromise validity and reliability. PMID:16316437

Surveying Turkish high school and university students' attitudes and approaches to physics problem solving

NASA Astrophysics Data System (ADS)

Balta, Nuri; Mason, Andrew J.; Singh, Chandralekha

2016-06-01

Students' attitudes and approaches to physics problem solving can impact how well they learn physics and how successful they are in solving physics problems. Prior research in the U.S. using a validated Attitude and Approaches to Problem Solving (AAPS) survey suggests that there are major differences between students in introductory physics and astronomy courses and physics experts in terms of their attitudes and approaches to physics problem solving. Here we discuss the validation, administration, and analysis of data for the Turkish version of the AAPS survey for high school and university students in Turkey. After the validation and administration of the Turkish version of the survey, the analysis of the data was conducted by grouping the data by grade level, school type, and gender. While there are no statistically significant differences between the averages of various groups on the survey, overall, the university students in Turkey were more expertlike than vocational high school students. On an item by item basis, there are statistically differences between the averages of the groups on many items. For example, on average, the university students demonstrated less expertlike attitudes about the role of equations and formulas in problem solving, in solving difficult problems, and in knowing when the solution is not correct, whereas they displayed more expertlike attitudes and approaches on items related to metacognition in physics problem solving. A principal component analysis on the data yields item clusters into which the student responses on various survey items can be grouped. A comparison of the responses of the Turkish and American university students enrolled in algebra-based introductory physics courses shows that on more than half of the items, the responses of these two groups were statistically significantly different, with the U.S. students on average responding to the items in a more expertlike manner.

Measuring Filial Piety in the 21st Century: Development, Factor Structure, and Reliability of the 10-Item Contemporary Filial Piety Scale.

PubMed

Lum, Terry Y S; Yan, Elsie C W; Ho, Andy H Y; Shum, Michelle H Y; Wong, Gloria H Y; Lau, Mandy M Y; Wang, Junfang

2016-11-01

The experience and practice of filial piety have evolved in modern Chinese societies, and existing measures fail to capture these important changes. Based on a conceptual analysis on current literature, 42 items were initially compiled to form a Contemporary Filial Piety Scale (CFPS), and 1,080 individuals from a representative sample in Hong Kong were surveyed. Principal component analysis generated a 16-item three-factor model: Pragmatic Obligations (Factor 1; 10 items), Compassionate Reverence (Factor 2; 4 items), and Family Continuity (Factor 3; 2 items). Confirmatory factor analysis revealed strong factor loadings for Factors 1 and 2, while removing Factor 3 and conceptually duplicated items increased total variance explained from 58.02% to 60.09% and internal consistency from .84 to .88. A final 10-item two-factor structure model was adopted with a goodness of fit of 0.95. The CFPS-10 is a data-driven, simple, and efficient instrument with strong psychometric properties for assessing contemporary filial piety. © The Author(s) 2015.

Measuring health literacy in populations: illuminating the design and development process of the European Health Literacy Survey Questionnaire (HLS-EU-Q)

PubMed Central

2013-01-01

Background Several measurement tools have been developed to measure health literacy. The tools vary in their approach and design, but few have focused on comprehensive health literacy in populations. This paper describes the design and development of the European Health Literacy Survey Questionnaire (HLS-EU-Q), an innovative, comprehensive tool to measure health literacy in populations. Methods Based on a conceptual model and definition, the process involved item development, pre-testing, field-testing, external consultation, plain language check, and translation from English to Bulgarian, Dutch, German, Greek, Polish, and Spanish. Results The development process resulted in the HLS-EU-Q, which entailed two sections, a core health literacy section and a section on determinants and outcomes associated to health literacy. The health literacy section included 47 items addressing self-reported difficulties in accessing, understanding, appraising and applying information in tasks concerning decisions making in healthcare, disease prevention, and health promotion. The second section included items related to, health behaviour, health status, health service use, community participation, socio-demographic and socio-economic factors. Conclusions By illuminating the detailed steps in the design and development process of the HLS-EU-Q, it is the aim to provide a deeper understanding of its purpose, its capability and its limitations for others using the tool. By stimulating a wide application it is the vision that HLS-EU-Q will be validated in more countries to enhance the understanding of health literacy in different populations. PMID:24112855

Development of a work addiction scale.

PubMed

Andreassen, Cecilie Schou; Griffiths, Mark D; Hetland, Jørn; Pallesen, Ståle

2012-06-01

Research into excessive work has gained increasing attention over the last 20 years. Terms such as "workaholism,"work addiction" and "excessive work" have been used interchangeably. Given the increase in empirical research, this study presents the development of the Bergen Work Addiction Scale (BWAS), a new psychometrically validated scale for the assessment of work addiction. A pool of 14 items, with two reflecting each of seven core elements of addiction (i.e., salience, mood modification, tolerance, withdrawal, conflict, relapse, and problems) was initially constructed. The items were then administered to two samples, one recruited by a web survey following a television broadcast about workaholism (n = 11,769) and one comprising participants in the second wave of a longitudinal internet-based survey about working life (n = 368). The items with the highest corrected item-total correlation from within each of the seven addiction elements were retained in the final scale. The assumed one-factor solution of the refined seven-item scale was acceptable (root mean square error of approximation = 0.077, Comparative Fit Index = 0.96, Tucker-Lewis Index = 0.95) and the internal reliability of the two samples were 0.84 and 0.80, respectively. The scores of the BWAS converged with scores on other workaholism scales, except for a Work Enjoyment subscale. A suggested cut-off for categorization of workaholics showed good discriminative ability in terms of working hours, leadership position, and subjective health complaints. It is concluded that the BWAS has good psychometric properties. © 2012 The Authors. Scandinavian Journal of Psychology © 2012 The Scandinavian Psychological Associations.

Health professionals' use of documents obtained through the Regional Medical Library Network.

PubMed

Lovas, I; Graham, E; Flack, V

1991-01-01

The Pacific Southwest Regional Medical Library Service (PSRMLS) studied how health professionals use documents obtained through the regional medical library (RML) network and how various factors, such as delivery time, affected that use. A random sample of libraries in Region 7 of the RML network was selected to survey health professionals who had received documents through the interlibrary loan (ILL) network. The survey provided data about the purposes for which health professionals requested documents, how the immediacy of need for the items affected their usefulness, what effect the obtained information had on the health professionals' work, and whether the illustrations represented an important part of the information content of the items. Survey results provided a positive assessment of the ILL network. Results also verified the basic value of the materials provided to health professionals through ILL and identified some areas for consideration in future network development. Users of the documents indicated that the network works efficiently and effectively to provide timely and useful information needed by health professionals. Technological developments in electronic information transmission and imaging will further enhance network operation in the future.

Development and validation of sustainability criteria of administrative green schools in Iran.

PubMed

Meiboudi, Hossein; Lahijanian, Akramolmolok; Shobeiri, Seyed Mohammad; Jozi, Seyed Ali; Azizinezhad, Reza

2017-07-15

Environmental responsibility in school has led to the emergence of a variety of criteria to administer green schools' contributions to sustainability. Sustainability criteria of administrative green schools need validity, reliability and norms. The aim of the current study was to develop and validate assessment criteria for green schools in Iran based on the role of academia. A national survey was conducted to obtain data on sustainability criteria initiatives for green schools and the Iranian profile was defined. An initial pool of 71 items was generated and after its first edition, 63 items were selected to comprise the sustainability criteria. Engineering-architectural and behavioral aspects of this sustainability criteria were evaluated through a sample of 1218 graduate students with environmental degrees from Iran's universities. Exploratory factor analysis using principal components and promax rotation method showed that these 9 criteria have simple structures and are consistent with the theoretical framework. The reliability coefficients of subscales ranged between 0.62 (participation) and 0.84 (building location and position). The study's survey of correlation coefficients between items and subscales illustrated that those coefficients varied between 0.24 and 0.68. Copyright © 2017 Elsevier Ltd. All rights reserved.

Measuring teamwork and conflict among Emergency Medical Technician personnel

PubMed Central

Patterson, P. Daniel; Weaver, Matthew D.; Weaver, Sallie J.; Rosen, Michael A.; Todorova, Gergana; Weingart, Laurie R.; Krackhardt, David; Lave, Judith R.; Arnold, Robert M.; Yealy, Donald M.; Salas, Eduardo

2011-01-01

Objective We sought to develop a reliable and valid tool for measuring teamwork among Emergency Medical Technician (EMT) partnerships. Methods We adapted existing scales and developed new items to measure components of teamwork. After recruiting a convenience sample of 39 agencies, we tested a 122-item draft survey tool. We performed a series of Exploratory Factor Analyses (EFA) and Confirmatory Factor Analysis (CFA) to test reliability and construct validity, describing variation in domain and global scores using descriptive statistics. Results We received 687 completed surveys. The EFA analyses identified a 9-factor solution. We labeled these factors [1] Team Orientation, [2] Team Structure & Leadership, [3] Partner Communication, Team Support, & Monitoring, [4] Partner Trust and Shared Mental Models, [5] Partner Adaptability & Back-Up Behavior, [6] Process Conflict, [7] Strong Task Conflict, [8] Mild Task Conflict, and [9] Interpersonal Conflict. We tested a short form (30-item SF) and long form (45-item LF) version. The CFA analyses determined that both the SF and LF versions possess positive psychometric properties of reliability and construct validity. The EMT-TEAMWORK-SF has positive internal consistency properties with a mean Cronbach’s alpha coefficient ≥0.70 across all 9-factors (mean=0.84; min=0.78, max=0.94). The mean Cronbach’s alpha coefficient for the EMT-TEAMWORK-LF version was 0.87 (min=0.79, max=0.94). There was wide variation in weighted scores across all 9 factors and the global score for the SF and LF versions. Mean scores were lowest for the Team Orientation factor (48.1, SD 21.5 SF; 49.3 SD 19.8 LF) and highest (more positive) for the Interpersonal Conflict factor (87.7 SD 18.1 for both SF and LF). Conclusions We developed a reliable and valid survey to evaluate teamwork between EMT partners. PMID:22128909

Knowledge and skills of cancer clinical trials nurses in Australia.

PubMed

Scott, Kathleen; White, Kate; Johnson, Catherine; Roydhouse, Jessica K

2012-05-01

  This paper is a report of the development and testing of a questionnaire measuring knowledge and skills of cancer clinical trials nurse in Australia.   The role of cancer clinical trials nurse, widely acknowledged as an integral member of the clinical research team, has evolved in recent years. Elements of the clinical trials nurse role in cancer have previously been described. To evaluate specific cancer clinical trials nurse educational and training needs, the development of a valid and reliable tool is required.   In 2009, a study was conducted in three stages. Stage I: questionnaire development and pilot testing; stage II: focus group; stage III: national survey. Internal consistency reliability testing and multi-trait analysis of item convergent/divergent validity were employed. Regression analysis was used to identify predictors of clinical trials nurse knowledge and skills.   The national survey was a 48-item questionnaire, measuring six clinical trial knowledge and seven skills sub-scales. Of 61 respondents, 90% were women, with mean age 43 years, 19 years as a Registered Nurse and 5 years as a cancer clinical trials nurse. Self-reported knowledge and skills were satisfactory to good. Internal consistency reliability was high (Cronbach's alpha: knowledge = 0·98; skills = 0·90). Criteria for item convergent/divergent validity were met. Number of years as cancer clinical trials nurse was positively related to self-reported knowledge and skills.   Preliminary data suggest that the national survey is reliable and valid. Data have contributed to better understanding the knowledge and skills of cancer clinical trials nurse in Australia and development of a postgraduate course in clinical trials. © 2011 Blackwell Publishing Ltd.

Eye Health in New Zealand: A Study of Public Knowledge, Attitudes, and Practices Related to Eye Health and Disease

ERIC Educational Resources Information Center

Ahn, Mark J.; Frederikson, Lesley; Borman, Barry; Bednarek, Rebecca

2011-01-01

Purpose: This study seeks to measure the public knowledge, attitudes, and practices related to eye health and disease in New Zealand (NZ). Design/methodology/approach: A 22-item survey of 507 adults in NZ was conducted. The survey was developed using interviews and focus groups, as well as comparisons with other benchmark international studies.…

Key Features of Academic Detailing: Development of an Expert Consensus Using the Delphi Method.

PubMed

Yeh, James S; Van Hoof, Thomas J; Fischer, Michael A

2016-02-01

Academic detailing is an outreach education technique that combines the direct social marketing traditionally used by pharmaceutical representatives with unbiased content summarizing the best evidence for a given clinical issue. Academic detailing is conducted with clinicians to encourage evidence-based practice in order to improve the quality of care and patient outcomes. The adoption of academic detailing has increased substantially since the original studies in the 1980s. However, the lack of standard agreement on its implementation makes the evaluation of academic detailing outcomes challenging. To identify consensus on the key elements of academic detailing among a group of experts with varying experiences in academic detailing. This study is based on an online survey of 20 experts with experience in academic detailing. We used the Delphi process, an iterative and systematic method of developing consensus within a group. We conducted 3 rounds of online surveys, which addressed 72 individual items derived from a previous literature review of 5 features of academic detailing, including (1) content, (2) communication process, (3) clinicians targeted, (4) change agents delivering intervention, and (5) context for intervention. Nonrespondents were removed from later rounds of the surveys. For most questions, a 4-point ordinal scale was used for responses. We defined consensus agreement as 70% of respondents for a single rating category or 80% for dichotomized ratings. The overall survey response rate was 95% (54 of 57 surveys) and nearly 92% consensus agreement on the survey items (66 of 72 items) by the end of the Delphi exercise. The experts' responses suggested that (1) focused clinician education offering support for clinical decision-making is a key component of academic detailing, (2) detailing messages need to be tailored and provide feasible strategies and solutions to challenging cases, and (3) academic detailers need to develop specific skill sets required to overcome barriers to changing clinician behavior. Consensus derived from this Delphi exercise can serve as a useful template of general principles in academic detailing initiatives and evaluation. The study findings are limited by the lack of standard definitions of certain terms used in the Delphi process.

Key Features of Academic Detailing: Development of an Expert Consensus Using the Delphi Method

PubMed Central

Yeh, James S.; Van Hoof, Thomas J.; Fischer, Michael A.

2016-01-01

Background Academic detailing is an outreach education technique that combines the direct social marketing traditionally used by pharmaceutical representatives with unbiased content summarizing the best evidence for a given clinical issue. Academic detailing is conducted with clinicians to encourage evidence-based practice in order to improve the quality of care and patient outcomes. The adoption of academic detailing has increased substantially since the original studies in the 1980s. However, the lack of standard agreement on its implementation makes the evaluation of academic detailing outcomes challenging. Objective To identify consensus on the key elements of academic detailing among a group of experts with varying experiences in academic detailing. Methods This study is based on an online survey of 20 experts with experience in academic detailing. We used the Delphi process, an iterative and systematic method of developing consensus within a group. We conducted 3 rounds of online surveys, which addressed 72 individual items derived from a previous literature review of 5 features of academic detailing, including (1) content, (2) communication process, (3) clinicians targeted, (4) change agents delivering intervention, and (5) context for intervention. Nonrespondents were removed from later rounds of the surveys. For most questions, a 4-point ordinal scale was used for responses. We defined consensus agreement as 70% of respondents for a single rating category or 80% for dichotomized ratings. Results The overall survey response rate was 95% (54 of 57 surveys) and nearly 92% consensus agreement on the survey items (66 of 72 items) by the end of the Delphi exercise. The experts' responses suggested that (1) focused clinician education offering support for clinical decision-making is a key component of academic detailing, (2) detailing messages need to be tailored and provide feasible strategies and solutions to challenging cases, and (3) academic detailers need to develop specific skill sets required to overcome barriers to changing clinician behavior. Conclusion Consensus derived from this Delphi exercise can serve as a useful template of general principles in academic detailing initiatives and evaluation. The study findings are limited by the lack of standard definitions of certain terms used in the Delphi process. PMID:27066195

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research.

PubMed

Staniszewska, S; Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-01-01

While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. One hundred forty-three participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites.

Effective communication of molecular genetic test results to primary care providers.

PubMed

Scheuner, Maren T; Edelen, Maria Orlando; Hilborne, Lee H; Lubin, Ira M

2013-06-01

We evaluated a template for molecular genetic test reports that was developed as a strategy to reduce communication errors between the laboratory and ordering clinician. We surveyed 1,600 primary care physicians to assess satisfaction, ease of use, and effectiveness of genetic test reports developed using our template and reports developed by clinical laboratories. Mean score differences of responses between the reports were compared using t-tests. Two-way analysis of variance evaluated the effect of template versus standard reports and the influence of physician characteristics. There were 396 (24%) respondents. Template reports had higher scores than the standard reports for each survey item. The gender and specialty of the physician did not influence scores; however, younger physicians gave higher scores regardless of report type. There was significant interaction between report type and whether physicians ordered or reviewed any genetic tests (none versus at least one) in the past year, P = 0.005. For each survey item assessing satisfaction, ease of use, and effectiveness, physicians gave higher ratings to genetic test reports developed with the template than standard reports used by clinical laboratories. Physicians least familiar with genetic test reports, and possibly having the greatest need for better communication, were best served by the template reports.

The Inviting School Survey--Revised (ISS--R): A Survey for Measuring the Invitational Qualities (I.Q.) of the Total School Climate

ERIC Educational Resources Information Center

Smith, Kenneth H.

2005-01-01

This article describes the revised Inviting School Survey (ISS-R) which is a 50- item checklist based on the 100-item Inviting School Survey (Purkey & Schmidt, 1990, Purkey & Fuller, 1995). Both the original ISS and the ISS-R are designed for use by Grade Four students and above, teachers, school administrators and others associated with the…

2012 Workplace and Gender Relations Survey of Active Duty Members. Survey Note and Briefing

DTIC Science & Technology

2013-03-15

items regarding unwanted attempts to establish a sexual relationship – Sexual Coercion – four items regarding classic quid pro quo instances of special...continues to emphasize sexual assault and sexual harassment response and prevention in the military. This survey note discusses findings from the... harassment in the active duty force. This survey note and accompanying briefing (Appendix) provide information on the prevalence rates of sexual

Applying the revised Chinese Job Content Questionnaire to assess psychosocial work conditions among Taiwan's hospital workers

PubMed Central

2011-01-01

Background For hospital accreditation and health promotion reasons, we examined whether the 22-item Job Content Questionnaire (JCQ) could be applied to evaluate job strain of individual hospital employees and to determine the number of factors extracted from JCQ. Additionally, we developed an Excel module of self-evaluation diagnostic system for consultation with experts. Methods To develop an Excel-based self-evaluation diagnostic system for consultation to experts to make job strain assessment easier and quicker than ever, Rasch rating scale model was used to analyze data from 1,644 hospital employees who enrolled in 2008 for a job strain survey. We determined whether the 22-item Job Content Questionnaire (JCQ) could evaluate job strain of individual employees in work sites. The respective item responding to specific groups' occupational hazards causing job stress was investigated by using skewness coefficient with its 95% CI through item-by-item analyses. Results Each of those 22 items on the questionnaire was examined to have five factors. The prevalence rate of Chinese hospital workers with high job strain was 16.5%. Conclusions Graphical representations of four quadrants, item-by-item bar chart plots and skewness 95% CI comparison generated in Excel can help employers and consultants of an organization focusing on a small number of key areas of concern for each worker in job strain. PMID:21682912

Applying the revised Chinese Job Content Questionnaire to assess psychosocial work conditions among Taiwan's hospital workers.

PubMed

Chien, Tsair-Wei; Lai, Wen-Pin; Wang, Hsien-Yi; Hsu, Sen-Yen; Castillo, Roberto Vasquez; Guo, How-Ran; Chen, Shih-Chung; Su, Shih-Bin

2011-06-18

For hospital accreditation and health promotion reasons, we examined whether the 22-item Job Content Questionnaire (JCQ) could be applied to evaluate job strain of individual hospital employees and to determine the number of factors extracted from JCQ. Additionally, we developed an Excel module of self-evaluation diagnostic system for consultation with experts. To develop an Excel-based self-evaluation diagnostic system for consultation to experts to make job strain assessment easier and quicker than ever, Rasch rating scale model was used to analyze data from 1,644 hospital employees who enrolled in 2008 for a job strain survey. We determined whether the 22-item Job Content Questionnaire (JCQ) could evaluate job strain of individual employees in work sites. The respective item responding to specific groups' occupational hazards causing job stress was investigated by using skewness coefficient with its 95% CI through item-by-item analyses. Each of those 22 items on the questionnaire was examined to have five factors. The prevalence rate of Chinese hospital workers with high job strain was 16.5%. Graphical representations of four quadrants, item-by-item bar chart plots and skewness 95% CI comparison generated in Excel can help employers and consultants of an organization focusing on a small number of key areas of concern for each worker in job strain.

Optimizing data collection for public health decisions: a data mining approach

PubMed Central

2014-01-01

Background Collecting data can be cumbersome and expensive. Lack of relevant, accurate and timely data for research to inform policy may negatively impact public health. The aim of this study was to test if the careful removal of items from two community nutrition surveys guided by a data mining technique called feature selection, can (a) identify a reduced dataset, while (b) not damaging the signal inside that data. Methods The Nutrition Environment Measures Surveys for stores (NEMS-S) and restaurants (NEMS-R) were completed on 885 retail food outlets in two counties in West Virginia between May and November of 2011. A reduced dataset was identified for each outlet type using feature selection. Coefficients from linear regression modeling were used to weight items in the reduced datasets. Weighted item values were summed with the error term to compute reduced item survey scores. Scores produced by the full survey were compared to the reduced item scores using a Wilcoxon rank-sum test. Results Feature selection identified 9 store and 16 restaurant survey items as significant predictors of the score produced from the full survey. The linear regression models built from the reduced feature sets had R2 values of 92% and 94% for restaurant and grocery store data, respectively. Conclusions While there are many potentially important variables in any domain, the most useful set may only be a small subset. The use of feature selection in the initial phase of data collection to identify the most influential variables may be a useful tool to greatly reduce the amount of data needed thereby reducing cost. PMID:24919484

Optimizing data collection for public health decisions: a data mining approach.

PubMed

Partington, Susan N; Papakroni, Vasil; Menzies, Tim

2014-06-12

Collecting data can be cumbersome and expensive. Lack of relevant, accurate and timely data for research to inform policy may negatively impact public health. The aim of this study was to test if the careful removal of items from two community nutrition surveys guided by a data mining technique called feature selection, can (a) identify a reduced dataset, while (b) not damaging the signal inside that data. The Nutrition Environment Measures Surveys for stores (NEMS-S) and restaurants (NEMS-R) were completed on 885 retail food outlets in two counties in West Virginia between May and November of 2011. A reduced dataset was identified for each outlet type using feature selection. Coefficients from linear regression modeling were used to weight items in the reduced datasets. Weighted item values were summed with the error term to compute reduced item survey scores. Scores produced by the full survey were compared to the reduced item scores using a Wilcoxon rank-sum test. Feature selection identified 9 store and 16 restaurant survey items as significant predictors of the score produced from the full survey. The linear regression models built from the reduced feature sets had R2 values of 92% and 94% for restaurant and grocery store data, respectively. While there are many potentially important variables in any domain, the most useful set may only be a small subset. The use of feature selection in the initial phase of data collection to identify the most influential variables may be a useful tool to greatly reduce the amount of data needed thereby reducing cost.

Sex-Role Attitude Items and Scales from U.S. Sample Surveys.

ERIC Educational Resources Information Center

Mason, Karen Oppenheim; And Others

This introductory guide to sex role attitude measures used in the United States was designed to aid researchers in finding items for surveying sex role attitudes. Measures devised or published after July, 1974, or those used only in foreign surveys are not included. The compendium focuses on measures of peoples' attitudes rather than their…

ITEM RESPONSE ANALYSES OF THE EDUCATIONAL OPPORTUNITIES SURVEY 9TH GRADE STUDENT QUESTIONNAIRE.

ERIC Educational Resources Information Center

WEINFELD, FREDERIC D.; AND OTHERS

THIS REPORT PRESENTS THE ANALYSIS OF QUESTIONNAIRE ITEM RESPONSES FROM THE NINTH-GRADE STUDENT QUESTIONNAIRE ADMINISTERED AS PART OF THE EDUCATIONAL OPPORTUNITIES SURVEY. THE ANALYSES WERE PERFORMED TO DOCUMENT SOME OF THE BASIC DATA FROM THE SURVEY, TO MAKE THEM AVAILABLE TO INTERESTED EDUCATIONAL RESEARCHERS, AND TO REWORK THE BASIC DATA FOR…

Establishing key components of yoga interventions for musculoskeletal conditions: a Delphi survey

PubMed Central

2014-01-01

Background Evidence suggests yoga is a safe and effective intervention for the management of physical and psychosocial symptoms associated with musculoskeletal conditions. However, heterogeneity in the components and reporting of clinical yoga trials impedes both the generalization of study results and the replication of study protocols. The aim of this Delphi survey was to address these issues of heterogeneity, by developing a list of recommendations of key components for the design and reporting of yoga interventions for musculoskeletal conditions. Methods Recognised experts involved in the design, conduct, and teaching of yoga for musculoskeletal conditions were identified from a systematic review, and invited to contribute to the Delphi survey. Forty-one of the 58 experts contacted, representing six countries, agreed to participate. A three-round Delphi was conducted via electronic surveys. Round 1 presented an open-ended question, allowing panellists to individually identify components they considered key to the design and reporting of yoga interventions for musculoskeletal conditions. Thematic analysis of Round 1 identified items for quantitative rating in Round 2; items not reaching consensus were forwarded to Round 3 for re-rating. Results Thirty-six panellists (36/41; 88%) completed the three rounds of the Delphi survey. Panellists provided 348 comments to the Round 1 question. These comments were reduced to 49 items, grouped under five themes, for rating in subsequent rounds. A priori group consensus of ≥80% was reached on 28 items related to five themes concerning defining the yoga intervention, types of yoga practices to include in an intervention, delivery of the yoga protocol, domains of outcome measures, and reporting of yoga interventions for musculoskeletal conditions. Additionally, a priori consensus of ≥50% was reached on five items relating to minimum values for intervention parameters. Conclusions Expert consensus has provided a non-prescriptive reference list for the design and reporting of yoga interventions for musculoskeletal conditions. It is anticipated future research incorporating the Delphi guidelines will facilitate high quality international research in this field, increase homogeneity of intervention components and parameters, and enhance the comparison and reproducibility of research into the use of yoga for the management of musculoskeletal conditions. PMID:24942270

Attitudes Toward Transgender Men and Women: Development and Validation of a New Measure

PubMed Central

Billard, Thomas J

2018-01-01

A series of three studies were conducted to generate, develop, and validate the Attitudes toward Transgender Men and Women (ATTMW) scale. In Study 1, 120 American adults responded to an open-ended questionnaire probing various dimensions of their perceptions of transgender individuals and identity. Qualitative thematic analysis generated 200 items based on their responses. In Study 2, 238 American adults completed a questionnaire consisting of the generated items. Exploratory factor analysis (EFA) revealed two non-identical 12-item subscales (ATTM and ATTW) of the full 24-item scale. In Study 3, 150 undergraduate students completed a survey containing the ATTMW and a number of validity-testing variables. Confirmatory factor analysis (CFA) verified the single-factor structures of the ATTM and ATTW subscales, and the convergent, discriminant, predictive, and concurrent validities of the ATTMW were also established. Together, our results demonstrate that the ATTMW is a reliable and valid measure of attitudes toward transgender individuals. PMID:29666595

The SWPER index for women's empowerment in Africa: development and validation of an index based on survey data.

PubMed

Ewerling, Fernanda; Lynch, John W; Victora, Cesar G; van Eerdewijk, Anouka; Tyszler, Marcelo; Barros, Aluisio J D

2017-09-01

The Sustainable Development Goals strongly focus on equity. Goal 5 explicitly aims to empower all women and girls, reinforcing the need to have a reliable indicator to track progress. Our objective was to develop a novel women's empowerment indicator from widely available data sources, broadening opportunities for monitoring and research on women's empowerment. We used Demographic and Health Survey data from 34 African countries, targeting currently partnered women. We identified items related to women's empowerment present in most surveys, and used principal component analysis to extract the components. We carried out a convergent validation process using coverage of three health interventions as outcomes; and an external validation process by analysing correlations with the Gender Development Index. 15 items related to women's empowerment were selected. We retained three components (50% of total variation) which, after rotation, were identified as three dimensions of empowerment: attitude to violence, social independence, and decision making. All dimensions had moderate to high correlation with the Gender Development Index. Social independence was associated with higher coverage of maternal and child interventions; attitude to violence and decision making were more consistently associated with the use of modern contraception. The index, named Survey-based Women's emPowERment index (SWPER), has potential to widen the research on women's empowerment and to give a better estimate of its effect on health interventions and outcomes. It allows within-country and between-country comparison, as well as time trend analysis, which no other survey-based index provides. Bill & Melinda Gates Foundation. Copyright © 2017 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 license. Published by Elsevier Ltd.. All rights reserved.

Challenges faced with the implementation of Web-Based Data Query Systems for population health: development of a questionnaire based on expert consensus.

PubMed

Ahuja, Manik; Aseltine, Robert; Warren, Nicholas; Reisine, Susan; Williams, Pam Holtzclaw; Cislo, Andy

2018-01-01

State health agencies (SHA) and local health agencies (LHA) face several challenges with the dissemination of local health data using Web-Based Data Query Systems (WDQS). To help guide future research, this study aimed to utilize expert consensus to identify the most relevant items that contribute to these challenges. A total of 17 researchers and public health professionals agreed to participate in a three-round Delphi process. In round 1, four topics were represented on a 42-item questionnaire using a 5-point Likert scale, along with free-text responses. Free-text responses were analyzed leading to a series of items for a second Delphi round. Participants were given an opportunity to revise results in round 3 for items that did not meet consensus in round 1 or round 2. Consensus on expert opinions was defined at interquartile range (IQR) ≤ 1. The experts reached consensus on a total of 21 (50%) of the 42 items presented in the initial questionnaire. Eleven of the 15 (73%) of the items extracted from the free-text responses met consensus. Items in consensus from this pilot study were used to develop an instrument for a broader survey across Behavioral Risk Factor Surveillance System (BRFSS) coordinators across all 50 US states. Experts confirmed that software development costs, inadequate human resources, data sharing gaps, a lack of political support, and poor data quality contribute significantly to challenges in their data implementation. The findings from this pilot study inform us of items of public health significance that will help guide future research.

Workforce perceptions of hospital safety culture: development and validation of the patient safety climate in healthcare organizations survey.

PubMed

Singer, Sara; Meterko, Mark; Baker, Laurence; Gaba, David; Falwell, Alyson; Rosen, Amy

2007-10-01

To describe the development of an instrument for assessing workforce perceptions of hospital safety culture and to assess its reliability and validity. Primary data collected between March 2004 and May 2005. Personnel from 105 U.S. hospitals completed a 38-item paper and pencil survey. We received 21,496 completed questionnaires, representing a 51 percent response rate. Based on review of existing safety climate surveys, we developed a list of key topics pertinent to maintaining a culture of safety in high-reliability organizations. We developed a draft questionnaire to address these topics and pilot tested it in four preliminary studies of hospital personnel. We modified the questionnaire based on experience and respondent feedback, and distributed the revised version to 42,249 hospital workers. We randomly divided respondents into derivation and validation samples. We applied exploratory factor analysis to responses in the derivation sample. We used those results to create scales in the validation sample, which we subjected to multitrait analysis (MTA). We identified nine constructs, three organizational factors, two unit factors, three individual factors, and one additional factor. Constructs demonstrated substantial convergent and discriminant validity in the MTA. Cronbach's alpha coefficients ranged from 0.50 to 0.89. It is possible to measure key salient features of hospital safety climate using a valid and reliable 38-item survey and appropriate hospital sample sizes. This instrument may be used in further studies to better understand the impact of safety climate on patient safety outcomes.

Incidence of ventilator-associated pneumonia in Australasian intensive care units: use of a consensus-developed clinical surveillance checklist in a multisite prospective audit

PubMed Central

Elliott, Doug; Elliott, Rosalind; Burrell, Anthony; Harrigan, Peter; Murgo, Margherita; Rolls, Kaye; Sibbritt, David

2015-01-01

Objectives With disagreements on diagnostic criteria for ventilator-associated pneumonia (VAP) hampering efforts to monitor incidence and implement preventative strategies, the study objectives were to develop a checklist for clinical surveillance of VAP, and conduct an audit in Australian/New Zealand intensive care units (ICUs) using the checklist. Setting Online survey software was used for checklist development. The prospective audit using the checklist was conducted in 10 ICUs in Australia and New Zealand. Participants Checklist development was conducted with members of a bi-national professional society for critical care physicians using a modified Delphi technique and survey. A 30-day audit of adult patients mechanically ventilated for >72 h. Primary and secondary outcome measures Presence of items on the screening checklist; physician diagnosis of VAP, clinical characteristics, investigations, treatments and patient outcome. Results A VAP checklist was developed with five items: decreasing gas exchange, sputum changes, chest X-ray infiltrates, inflammatory response, microbial growth. Of the 169 participants, 17% (n=29) demonstrated characteristics of VAP using the checklist. A similar proportion had an independent physician diagnosis (n=30), but in a different patient subset (only 17% of cases were identified by both methods). The VAP rate per 1000 mechanical ventilator days for the checklist and clinician diagnosis was 25.9 and 26.7, respectively. The item ‘inflammatory response’ was most associated with the first episode of physician-diagnosed VAP. Conclusions VAP rates using the checklist and physician diagnosis were similar to ranges reported internationally and in Australia. Of note, different patients were identified with VAP by the checklist and physicians. While the checklist items may assist in identifying patients at risk of developing VAP, and demonstrates synergy with the recently developed Centers for Disease Control (CDC) guidelines, decision-making processes by physicians when diagnosing VAP requires further exploration. PMID:26515685

Development of a brief measure of intimate partner violence experiences: the Composite Abuse Scale (Revised)—Short Form (CASR-SF)

PubMed Central

Ford-Gilboe, Marilyn; Wathen, C Nadine; Varcoe, Colleen; MacMillan, Harriet L; Scott-Storey, Kelly; Mantler, Tara; Hegarty, Kelsey; Perrin, Nancy

2016-01-01

Objectives Approaches to measuring intimate partner violence (IPV) in populations often privilege physical violence, with poor assessment of other experiences. This has led to underestimating the scope and impact of IPV. The aim of this study was to develop a brief, reliable and valid self-report measure of IPV that adequately captures its complexity. Design Mixed-methods instrument development and psychometric testing to evolve a brief version of the Composite Abuse Scale (CAS) using secondary data analysis and expert feedback. Setting Data from 5 Canadian IPV studies; feedback from international IPV experts. Participants 31 international IPV experts including academic researchers, service providers and policy actors rated CAS items via an online survey. Pooled data from 6278 adult Canadian women were used for scale development. Primary/secondary outcome measures Scale reliability and validity; robustness of subscales assessing different IPV experiences. Results A 15-item version of the CAS has been developed (Composite Abuse Scale (Revised)—Short Form, CASR-SF), including 12 items developed from the original CAS and 3 items suggested through expert consultation and the evolving literature. Items cover 3 abuse domains: physical, sexual and psychological, with questions asked to assess lifetime, recent and current exposure, and abuse frequency. Factor loadings for the final 3-factor solution ranged from 0.81 to 0.91 for the 6 psychological abuse items, 0.63 to 0.92 for the 4 physical abuse items, and 0.85 and 0.93 for the 2 sexual abuse items. Moderate correlations were observed between the CASR-SF and measures of depression, post-traumatic stress disorder and coercive control. Internal consistency of the CASR-SF was 0.942. These reliability and validity estimates were comparable to those obtained for the original 30-item CAS. Conclusions The CASR-SF is brief self-report measure of IPV experiences among women that has demonstrated initial reliability and validity and is suitable for use in population studies or other studies. Additional validation of the 15-item scale with diverse samples is required. PMID:27927659

Influence of Skip Patterns on Item Non-Response in a Substance Use Survey of 7th to 12th Grade Students

ERIC Educational Resources Information Center

Ding, Kele; Olds, R. Scott; Thombs, Dennis L.

2009-01-01

This retrospective case study assessed the influence of item non-response error on subsequent response to questionnaire items assessing adolescent alcohol and marijuana use. Post-hoc analyses were conducted on survey results obtained from 4,371 7th to 12th grade students in Ohio in 2005. A skip pattern design in a conventional questionnaire…

Barriers to vocational effectiveness in ACT: staff perspectives.

PubMed

Waynor, William R; Pratt, Carlos W

2011-01-01

Assertive community treatment (ACT), for persons with serious mental illness, includes a vocational focus as an important aspect of community integration. Nevertheless, research suggests that ACT does not assist significant numbers of consumers in achieving employment goals. A two-step survey of New Jersey ACT team members was designed to identify the key issues that hinder ACT staff members in assisting consumers with obtaining employment. Survey items were categorized into three sections: (a) staff attitudes, (b) consumer barriers, and (c) staff barriers to working on employment. The initial survey asked staff members to rate items in each of these categories. Highly rated items were used in a subsequent paired comparison survey to determine the relative importance of each. This method highlighted the following issues: four staff attitude items-(a) returning to work is positive, (b) employment is key to recovery, (c) abstinence from substance abuse is needed to work, and (d) consumers are too ill to work; four consumer barrier items-(a) fear of loss of Social Security Administration benefits, (b) symptoms related to the illness, (c) lack of motivation, and (d) poor social skills; and three barriers to working on employment issues items-(a) clinical issues take priority, (b) other case management issues takes priority, and (c) too many emergencies. The implications for staff training are discussed.

Development of CRIS: Measure of community reintegration of injured service members

PubMed Central

Resnik, Linda; Plow, Matthew; Jette, Alan

2012-01-01

Identification and prevention of community reintegration problems of veterans is an important public health mandate. However, no veteran-specific measure exists. Study purposes were to (1) develop the Community Reintegration for Service Members (CRIS) measure and (2) test the validity and reliability of the measure. Formative research identified challenges in community reintegration postdeployment. The World Health Organization’s International Classification of Functioning, Disability and Health participation domain guided item-bank development. Items were refined through cognitive interviews and clinician consultation. Pilot studies with 126 veterans examined unidimensionality, internal consistency, reliability, and construct validity. Three unidimensional CRIS scales were developed. Working subjects had better CRIS scores then unemployed subjects. Subjects with posttraumatic stress disorder, substance abuse, or mental health problems had worse scores than subjects without these conditions. The correlations between the CRIS and the 36-Item Short Form Health Survey scales of role physical, role emotional, and social functioning were 0.44–0.80. CRIS has strong reliability, conceptual integrity, and construct validity. PMID:19882482

5 CFR 591.214 - How does OPM collect prices?

Code of Federal Regulations, 2010 CFR

2010-01-01

... by catalog, Internet, or a similar source. Other items, not normally sold within an area, may be... time of survey, OPM may, on a case-by-case basis, use the price of the item in a neighboring survey or...

2012 Workplace and Gender Relations Survey of Reserve Component Members (Survey Note No. 2013-002)

DTIC Science & Technology

2013-01-18

items regarding unwanted attempts to establish a sexual relationship – Sexual Coercion – four items regarding classic quid pro quo instances of...Department of Defense (DoD) continues to emphasize sexual assault and sexual harassment response and prevention in the Reserve components. This survey...survey assesses the prevalence of sexual assault and sexual harassment and other gender-related issues in the National Guard and Reserves. This

2012 Workplace and Gender Relations Survey of Active Duty Members (Survey Note No. 2013-002)

DTIC Science & Technology

2013-01-18

Attention – four items regarding unwanted attempts to establish a sexual relationship – Sexual Coercion – four items regarding classic quid pro quo ...of Defense (DoD) continues to emphasize sexual assault and sexual harassment response and prevention in the military. This survey note discusses...assault and sexual harassment in the active duty force. This survey note and accompanying briefing (Appendix) provide information on the prevalence

The Afghan symptom checklist: a culturally grounded approach to mental health assessment in a conflict zone.

PubMed

Miller, Kenneth E; Omidian, Patricia; Quraishy, Abdul Samad; Quraishy, Naseema; Nasiry, Mohammed Nader; Nasiry, Seema; Karyar, Nazar Mohammed; Yaqubi, Abdul Aziz

2006-10-01

This article describes a methodology for developing culturally grounded assessment measures in conflict and postconflict situations. A mixed-method design was used in Kabul, Afghanistan, to identify local indicators of distress and develop the 22-item Afghan Symptom Checklist (ASCL). The ASCL contains several indigenous items and items familiar to Western mental health professionals. The ASCL was pilot tested and subsequently administered to 324 adults in 8 districts of Kabul. It demonstrated excellent reliability (alpha=.93) and good construct validity, correlating strongly with a measure of exposure to war-related violence and loss (r=.70). Results of the survey indicate moderate levels of distress among Afghan men and markedly higher levels of distress and impaired functioning among women (and widows in particular). (c) 2007 APA, all rights reserved

Factors affecting construction performance: exploratory factor analysis

NASA Astrophysics Data System (ADS)

Soewin, E.; Chinda, T.

2018-04-01

The present work attempts to develop a multidimensional performance evaluation framework for a construction company by considering all relevant measures of performance. Based on the previous studies, this study hypothesizes nine key factors, with a total of 57 associated items. The hypothesized factors, with their associated items, are then used to develop questionnaire survey to gather data. The exploratory factor analysis (EFA) was applied to the collected data which gave rise 10 factors with 57 items affecting construction performance. The findings further reveal that the items constituting ten key performance factors (KPIs) namely; 1) Time, 2) Cost, 3) Quality, 4) Safety & Health, 5) Internal Stakeholder, 6) External Stakeholder, 7) Client Satisfaction, 8) Financial Performance, 9) Environment, and 10) Information, Technology & Innovation. The analysis helps to develop multi-dimensional performance evaluation framework for an effective measurement of the construction performance. The 10 key performance factors can be broadly categorized into economic aspect, social aspect, environmental aspect, and technology aspects. It is important to understand a multi-dimension performance evaluation framework by including all key factors affecting the construction performance of a company, so that the management level can effectively plan to implement an effective performance development plan to match with the mission and vision of the company.

Using the Entrustable Professional Activities Framework in the Assessment of Procedural Skills.

PubMed

Pugh, Debra; Cavalcanti, Rodrigo B; Halman, Samantha; Ma, Irene W Y; Mylopoulos, Maria; Shanks, David; Stroud, Lynfa

2017-04-01

The entrustable professional activity (EPA) framework has been identified as a useful approach to assessment in competency-based education. To apply an EPA framework for assessment, essential skills necessary for entrustment to occur must first be identified. Using an EPA framework, our study sought to (1) define the essential skills required for entrustment for 7 bedside procedures expected of graduates of Canadian internal medicine (IM) residency programs, and (2) develop rubrics for the assessment of these procedural skills. An initial list of essential skills was defined for each procedural EPA by focus groups of experts at 4 academic centers using the nominal group technique. These lists were subsequently vetted by representatives from all Canadian IM training programs through a web-based survey. Consensus (more than 80% agreement) about inclusion of each item was sought using a modified Delphi exercise. Qualitative survey data were analyzed using a framework approach to inform final assessment rubrics for each procedure. Initial lists of essential skills for procedural EPAs ranged from 10 to 24 items. A total of 111 experts completed the national survey. After 2 iterations, consensus was reached on all items. Following qualitative analysis, final rubrics were created, which included 6 to 10 items per procedure. These EPA-based assessment rubrics represent a national consensus by Canadian IM clinician educators. They provide a practical guide for the assessment of procedural skills in a competency-based education model, and a robust foundation for future research on their implementation and evaluation.

The ABC’s of Suicide Risk Assessment: Applying a Tripartite Approach to Individual Evaluations

PubMed Central

Harris, Keith M.; Syu, Jia-Jia; Lello, Owen D.; Chew, Y. L. Eileen; Willcox, Christopher H.; Ho, Roger H. M.

2015-01-01

There is considerable need for accurate suicide risk assessment for clinical, screening, and research purposes. This study applied the tripartite affect-behavior-cognition theory, the suicidal barometer model, classical test theory, and item response theory (IRT), to develop a brief self-report measure of suicide risk that is theoretically-grounded, reliable and valid. An initial survey (n = 359) employed an iterative process to an item pool, resulting in the six-item Suicidal Affect-Behavior-Cognition Scale (SABCS). Three additional studies tested the SABCS and a highly endorsed comparison measure. Studies included two online surveys (Ns = 1007, and 713), and one prospective clinical survey (n = 72; Time 2, n = 54). Factor analyses demonstrated SABCS construct validity through unidimensionality. Internal reliability was high (α = .86-.93, split-half = .90-.94)). The scale was predictive of future suicidal behaviors and suicidality (r = .68, .73, respectively), showed convergent validity, and the SABCS-4 demonstrated clinically relevant sensitivity to change. IRT analyses revealed the SABCS captured more information than the comparison measure, and better defined participants at low, moderate, and high risk. The SABCS is the first suicide risk measure to demonstrate no differential item functioning by sex, age, or ethnicity. In all comparisons, the SABCS showed incremental improvements over a highly endorsed scale through stronger predictive ability, reliability, and other properties. The SABCS is in the public domain, with this publication, and is suitable for clinical evaluations, public screening, and research. PMID:26030590

Methods Used to Streamline the CAHPS® Hospital Survey

PubMed Central

Keller, San; O'Malley, A James; Hays, Ron D; Matthew, Rebecca A; Zaslavsky, Alan M; Hepner, Kimberly A; Cleary, Paul D

2005-01-01

Objective To identify a parsimonious subset of reliable, valid, and consumer-salient items from 33 questions asking for patient reports about hospital care quality. Data Source CAHPS® Hospital Survey pilot data were collected during the summer of 2003 using mail and telephone from 19,720 patients who had been treated in 132 hospitals in three states and discharged from November 2002 to January 2003. Methods Standard psychometric methods were used to assess the reliability (internal consistency reliability and hospital-level reliability) and construct validity (exploratory and confirmatory factor analyses, strength of relationship to overall rating of hospital) of the 33 report items. The best subset of items from among the 33 was selected based on their statistical properties in conjunction with the importance assigned to each item by participants in 14 focus groups. Principal Findings Confirmatory factor analysis (CFA) indicated that a subset of 16 questions proposed to measure seven aspects of hospital care (communication with nurses, communication with doctors, responsiveness to patient needs, physical environment, pain control, communication about medication, and discharge information) demonstrated excellent fit to the data. Scales in each of these areas had acceptable levels of reliability to discriminate among hospitals and internal consistency reliability estimates comparable with previously developed CAHPS instruments. Conclusion Although half the length of the original, the shorter CAHPS hospital survey demonstrates promising measurement properties, identifies variations in care among hospitals, and deals with aspects of the hospital stay that are important to patients' evaluations of care quality. PMID:16316438

Three-year customer satisfaction survey in laboratory medicine in a Chinese university hospital.

PubMed

Guo, Siqi; Duan, Yifei; Liu, Xiaojuan; Jiang, Yongmei

2018-04-25

Customer satisfaction is a key quality indicator of laboratory service. Patients and physicians are the ultimate customers in medical laboratory, and their opinions are essential components in developing a customer-oriented laboratory. A longitudinal investigation of customer satisfaction was conducted through questionnaires. We designed two different questionnaires and selected 1200 customers (600 outpatients and 600 physicians) to assess customer satisfaction every other year from 2012 to 2016. Items with scores <4 were considered unsatisfactory, and corrective actions should be taken. The completion rates of physicians were 96.8% in 2012, 97% in 2014 and 96.5% in 2016, whereas the rates of patients were 95.3%, 96.2% and 95.2%, respectively. In 2012, the most dissatisfaction items were test turnaround time (3.77 points) and service attitude (3.87 points) from physicians, whereas waiting time (3.58 points) and examination environment (3.64 points) were the most dissatisfaction items from patients. After corrective actions were taken, the result of satisfaction in 2014 was better, which illustrated our strategy was effective. However, some items remained to be less than 4, so we repeated the survey after modifying questionnaires in 2016. However, the general satisfaction points of the physicians and patients reduced in 2016, which reminded us of some influential factors we had neglected. By using dynamic survey of satisfaction, we can continuously find deficiencies in our laboratory services and take suitable corrective actions, thereby improving our service quality.

Development of the Oxford Participation and Activities Questionnaire: constructing an item pool

PubMed Central

Kelly, Laura; Jenkinson, Crispin; Dummett, Sarah; Dawson, Jill; Fitzpatrick, Ray; Morley, David

2015-01-01

Purpose The Oxford Participation and Activities Questionnaire is a patient-reported outcome measure in development that is grounded on the World Health Organization International Classification of Functioning, Disability, and Health (ICF). The study reported here aimed to inform and generate an item pool for the new measure, which is specifically designed for the assessment of participation and activity in patients experiencing a range of health conditions. Methods Items were informed through in-depth interviews conducted with 37 participants spanning a range of conditions. Interviews aimed to identify how their condition impacted their ability to participate in meaningful activities. Conditions included arthritis, cancer, chronic back pain, diabetes, motor neuron disease, multiple sclerosis, Parkinson’s disease, and spinal cord injury. Transcripts were analyzed using the framework method. Statements relating to ICF themes were recast as questionnaire items and shown for review to an expert panel. Cognitive debrief interviews (n=13) were used to assess items for face and content validity. Results ICF themes relevant to activities and participation in everyday life were explored, and a total of 222 items formed the initial item pool. This item pool was refined by the research team and 28 generic items were mapped onto all nine chapters of the ICF construct, detailing activity and participation. Cognitive interviewing confirmed the questionnaire instructions, items, and response options were acceptable to participants. Conclusion Using a clear conceptual basis to inform item generation, 28 items have been identified as suitable to undergo further psychometric testing. A large-scale postal survey will follow in order to refine the instrument further and to assess its psychometric properties. The final instrument is intended for use in clinical trials and interventions targeted at maintaining or improving activity and participation. PMID:26056503

Development of the Oxford Participation and Activities Questionnaire: constructing an item pool.

PubMed

Kelly, Laura; Jenkinson, Crispin; Dummett, Sarah; Dawson, Jill; Fitzpatrick, Ray; Morley, David

2015-01-01

The Oxford Participation and Activities Questionnaire is a patient-reported outcome measure in development that is grounded on the World Health Organization International Classification of Functioning, Disability, and Health (ICF). The study reported here aimed to inform and generate an item pool for the new measure, which is specifically designed for the assessment of participation and activity in patients experiencing a range of health conditions. Items were informed through in-depth interviews conducted with 37 participants spanning a range of conditions. Interviews aimed to identify how their condition impacted their ability to participate in meaningful activities. Conditions included arthritis, cancer, chronic back pain, diabetes, motor neuron disease, multiple sclerosis, Parkinson's disease, and spinal cord injury. Transcripts were analyzed using the framework method. Statements relating to ICF themes were recast as questionnaire items and shown for review to an expert panel. Cognitive debrief interviews (n=13) were used to assess items for face and content validity. ICF themes relevant to activities and participation in everyday life were explored, and a total of 222 items formed the initial item pool. This item pool was refined by the research team and 28 generic items were mapped onto all nine chapters of the ICF construct, detailing activity and participation. Cognitive interviewing confirmed the questionnaire instructions, items, and response options were acceptable to participants. Using a clear conceptual basis to inform item generation, 28 items have been identified as suitable to undergo further psychometric testing. A large-scale postal survey will follow in order to refine the instrument further and to assess its psychometric properties. The final instrument is intended for use in clinical trials and interventions targeted at maintaining or improving activity and participation.

Core information set for oesophageal cancer surgery.

PubMed

Blazeby, J M; Macefield, R; Blencowe, N S; Jacobs, M; McNair, A G K; Sprangers, M; Brookes, S T

2015-07-01

Surgeons provide patients with information before surgery, although standards of information are lacking and practice varies. The development and use of a 'core information set' as baseline information before surgery may improve understanding. A core set is a minimum set of information to use in all consultations before a specific procedure. This study developed a core information set for oesophageal cancer surgery. Information was identified from the literature, observations of clinical consultations and patient interviews. This was integrated to create a questionnaire survey. Stakeholders (patients and professionals) were surveyed twice to assess views on importance of information from 'not essential' to 'absolutely essential' using Delphi methods. Items not meeting predefined criteria were discarded after each survey and the final retained items were voted on, in separate patient and professional stakeholder meetings, to agree the core set. Some 67 information items were identified initially from multiple sources. Survey response rates were 76·5 per cent (185 of 242) and 54·8 per cent (126 of 230) for patients and professionals respectively (first round), and over 83 per cent in both groups thereafter. Health professionals rated short-term clinical outcomes most highly (technical complications), whereas patients prioritized information related to long-term benefits. The consensus meetings agreed the final set, which consisted of: in-hospital milestones to recovery, rates of open-and-close surgery, in-hospital mortality, major complications (reoperation), milestones in recovery after discharge, longer-term eating and drinking and overall quality of life, and chances of survival. This study has established a core information set for surgery for oesophageal cancer. © 2015 BJS Society Ltd Published by John Wiley & Sons Ltd.

SERDP and ESTCP Workshop on Technology Needs for the Characterization, Management, and Remediation of Military Munitions in Underwater Environments

DTIC Science & Technology

2007-10-01

5.3.1.1 Study of Surf Zone Environment........................................... 5-6 5.3.2 Research Needs: High Priority...Detection of Smaller Munitions Items Study of Surf Zone Environment Improve Navigation Error Analysis Develop Cooperative Cued Platforms...towbodies, AUVs, ROVs, HOVs, and divers. Surveys in high energy surf zones present unique difficulties. Finally, participants stressed that the survey

Development and content validation of performance assessments for endoscopic third ventriculostomy.

PubMed

Breimer, Gerben E; Haji, Faizal A; Hoving, Eelco W; Drake, James M

2015-08-01

This study aims to develop and establish the content validity of multiple expert rating instruments to assess performance in endoscopic third ventriculostomy (ETV), collectively called the Neuro-Endoscopic Ventriculostomy Assessment Tool (NEVAT). The important aspects of ETV were identified through a review of current literature, ETV videos, and discussion with neurosurgeons, fellows, and residents. Three assessment measures were subsequently developed: a procedure-specific checklist (CL), a CL of surgical errors, and a global rating scale (GRS). Neurosurgeons from various countries, all identified as experts in ETV, were then invited to participate in a modified Delphi survey to establish the content validity of these instruments. In each Delphi round, experts rated their agreement including each procedural step, error, and GRS item in the respective instruments on a 5-point Likert scale. Seventeen experts agreed to participate in the study and completed all Delphi rounds. After item generation, a total of 27 procedural CL items, 26 error CL items, and 9 GRS items were posed to Delphi panelists for rating. An additional 17 procedural CL items, 12 error CL items, and 1 GRS item were added by panelists. After three rounds, strong consensus (>80% agreement) was achieved on 35 procedural CL items, 29 error CL items, and 10 GRS items. Moderate consensus (50-80% agreement) was achieved on an additional 7 procedural CL items and 1 error CL item. The final procedural and error checklist contained 42 and 30 items, respectively (divided into setup, exposure, navigation, ventriculostomy, and closure). The final GRS contained 10 items. We have established the content validity of three ETV assessment measures by iterative consensus of an international expert panel. Each measure provides unique assessment information and thus can be used individually or in combination, depending on the characteristics of the learner and the purpose of the assessment. These instruments must now be evaluated in both the simulated and operative settings, to determine their construct validity and reliability. Ultimately, the measures contained in the NEVAT may prove suitable for formative assessment during ETV training and potentially as summative assessment measures during certification.

Development of a Therapists' Self-Report Measure of Pluralistic Thought and Practice: The Therapy Pluralism Inventory

ERIC Educational Resources Information Center

Thompson, Allison; Cooper, Mick; Pauli, Regina

2017-01-01

This study aimed to develop a self-report measure of pluralistic thought and practice. Following pilot development, a 23-item inventory was placed on an online survey site, and 474 participants satisfactorily completed the measure. Respondents were trainee or qualified therapists, predominantly female, based in the UK, and of a humanistic or…

Validation of the malaysian versions of parents and children health survey for asthma by using rasch-model.

PubMed

Hussein, Maryam Se; Akram, Waqas; Mamat, Mohd Nor; Majeed, Abu Bakar Abdul; Ismail, Nahlah Elkudssiah Binti

2015-04-01

In recent years, health-related quality of life (HRQOL) has become an important outcome measure in epidemiologic studies and clinical trials. For patients with asthma there are many instruments but most of them have been developed in English. With the increase in research project, researchers working in other languages have two options; either to develop a new measure or to translate an already developed measure. Children Health Survey for Asthma is developed by American Academy of Paediatrics which has two versions one for the parents (CHSA) and the other for the child (CHSA-C). However, there is no Malay version of the CHSA or the CHSA-C. The aim of this study was to translate and determine the validity and reliability of the Malaysian versions of Parent and Children Health Survey for Asthma. Questionnaires were translated to Bahasa Malayu using previously established guidelines, data from 180 respondents (asthmatic children and their parent) were analysed using Rasch-Model; as, it is an approach that has been increasingly used in health field and also it explores the performance of each item rather than total set score. The internal consistency was high for the parent questionnaire (CHSA) (reliability score for persons = 0.88 and for items was 0.97), and good for child questionnaire (CHSA-C) (reliability score for persons = 0.83 and for items was 0.94). Also, this study shows that all items measure for both questionnaires (CHSA and CHSA-C) are fitted to Rasch-Model. This study produced questionnaires that are conceptually equivalent to the original, easy to understand for the children and their parents, and good in terms of internal consistency. Because of the questionnaire has two versions one for the child and the other for the parents, they could be used in clinical practice to measure the effect of asthma on the child and their families. This current research had translated two instruments to other language (BahasaMalayu) and evaluated their reliability and validity hence will help researchers from the same country to use these translated instruments in their studies.

Family strengths and the Kansas Marital Satisfaction Scale: a factor analytic study.

PubMed

Schumm, W R; Bollman, S R; Jurich, A P; Hatch, R C

2001-06-01

20 new items were developed to measure six concepts of family strengths and were administered, along with the Kansas Marital Satisfaction Scale, to over 266 married subjects as part of a larger survey of current and former members of the Christian Church (Disciples of Christ). A common factor analysis suggested that most of the items were associated with their expected factors, while reliability analyses indicated that most of the scales had acceptable estimates of internal consistency. The marital satisfaction items clearly were associated with their own factor and not other factors, providing support for the unidimensional nature of the Kansas Marital Satisfaction Scale and for its construct validity.

ISSLS Prize Winner: Consensus on the Clinical Diagnosis of Lumbar Spinal Stenosis: Results of an International Delphi Study.

PubMed

Tomkins-Lane, Christy; Melloh, Markus; Lurie, Jon; Smuck, Matt; Battié, Michele C; Freeman, Brian; Samartzis, Dino; Hu, Richard; Barz, Thomas; Stuber, Kent; Schneider, Michael; Haig, Andrew; Schizas, Constantin; Cheung, Jason Pui Yin; Mannion, Anne F; Staub, Lukas; Comer, Christine; Macedo, Luciana; Ahn, Sang-Ho; Takahashi, Kazuhisa; Sandella, Danielle

2016-08-01

Delphi. The aim of this study was to obtain an expert consensus on which history factors are most important in the clinical diagnosis of lumbar spinal stenosis (LSS). LSS is a poorly defined clinical syndrome. Criteria for defining LSS are needed and should be informed by the experience of expert clinicians. Phase 1 (Delphi Items): 20 members of the International Taskforce on the Diagnosis and Management of LSS confirmed a list of 14 history items. An online survey was developed that permits specialists to express the logical order in which they consider the items, and the level of certainty ascertained from the questions. Phase 2 (Delphi Study) Round 1: Survey distributed to members of the International Society for the Study of the Lumbar Spine. Round 2: Meeting of 9 members of Taskforce where consensus was reached on a final list of 10 items. Round 3: Final survey was distributed internationally. Phase 3: Final Taskforce consensus meeting. A total of 279 clinicians from 29 different countries, with a mean of 19 (±SD: 12) years in practice participated. The six top items were "leg or buttock pain while walking," "flex forward to relieve symptoms," "feel relief when using a shopping cart or bicycle," "motor or sensory disturbance while walking," "normal and symmetric foot pulses," "lower extremity weakness," and "low back pain." Significant change in certainty ceased after six questions at 80% (P < .05). This is the first study to reach an international consensus on the clinical diagnosis of LSS, and suggests that within six questions clinicians are 80% certain of diagnosis. We propose a consensus-based set of "seven history items" that can act as a pragmatic criterion for defining LSS in both clinical and research settings, which in the long term may lead to more cost-effective treatment, improved health care utilization, and enhanced patient outcomes. 2.

A survey of evidence users about the information need of acupuncture clinical evidence.

PubMed

Shi, Xiue; Wang, Xiaoqin; Liu, Yali; Li, Xiuxia; Wei, Dang; Zhao, Xu; Gu, Jing; Yang, Kehu

2016-11-10

The PRISMA statement was rarely used in the field of acupuncture, possibly because of knowledge gaps and the lack of items tailored for characteristics of acupuncture. And with an increasing number of systematic reviews in acupuncture, it is necessary to develop an extension of PRISMA for acupuncture. And this study was the first step of our project, of which the aim was to investigate the need for information of clinical evidence on acupuncture from the perspectives of evidence users. We designed a questionnaire based on a pilot survey and a literature review of acupuncture systematic review or meta-analysis(SR/MA). Participants from five cities (Lanzhou, Chengdu, Shanghai, Nanjing and Beijing) representing the different regions of China, including clinicians, researchers and postgraduates in their second year of Master studies or higher level, were surveyed. A total of 269 questionnaires were collected in 18 hospitals, medical universities and research agencies, and 251 (93 %) with complete data were used for analysis. The average age of respondents was 33 years (SD 8.959, range 25-58) with male 43 % and female 57 %. Most respondents had less than 5 years of working experience on acupuncture, and read only one to five articles per month. Electronic databases, search engines and academic conferences were the most common sources for obtaining information. Fifty-six percent of the respondents expressed low satisfaction of the completeness of information from the literature. The eight items proposed for acupuncture SR/MAs received all high scores, and five of the items scored higher than eight on a scale zero to ten. The differences for the scores of most items between postgraduates and non-postgraduates were not statistically significant. The majority of the respondents were not very satisfied with the information provided in acupuncture SRs. Most of the items proposed in this questionnaire received high scores, and opinions from postgraduates and non-postgraduates tended to agree on most items. Comments from the respondents can promote future work.

Pancreatitis Quality of Life Instrument: Development of a new instrument

PubMed Central

Bova, Carol; Barton, Bruce; Hartigan, Celia

2014-01-01

Objectives: The goal of this project was to develop the first disease-specific instrument for the evaluation of quality of life in chronic pancreatitis. Methods: Focus groups and interview sessions were conducted, with chronic pancreatitis patients, to identify items felt to impact quality of life which were subsequently formatted into a paper-and-pencil instrument. This instrument was used to conduct an online survey by an expert panel of pancreatologists to evaluate its content validity. Finally, the modified instrument was presented to patients during precognitive testing interviews to evaluate its clarity and appropriateness. Results: In total, 10 patients were enrolled in the focus groups and interview sessions where they identified 50 items. Once redundant items were removed, the 40 remaining items were made into a paper-and-pencil instrument referred to as the Pancreatitis Quality of Life Instrument. Through the processes of content validation and precognitive testing, the number of items in the instrument was reduced to 24. Conclusions: This marks the development of the first disease-specific instrument to evaluate quality of life in chronic pancreatitis. It includes unique features not found in generic instruments (economic factors, stigma, and spiritual factors). Although this marks a giant step forward, psychometric evaluation is still needed prior to its clinical use. PMID:26770703

Health-Related Quality of Life in a Predictive Model for Mortality in Older Breast Cancer Survivors.

PubMed

DuMontier, Clark; Clough-Gorr, Kerri M; Silliman, Rebecca A; Stuck, Andreas E; Moser, André

2018-03-13

To develop a predictive model and risk score for 10-year mortality using health-related quality of life (HRQOL) in a cohort of older women with early-stage breast cancer. Prospective cohort. Community. U.S. women aged 65 and older diagnosed with Stage I to IIIA primary breast cancer (N=660). We used medical variables (age, comorbidity), HRQOL measures (10-item Physical Function Index and 5-item Mental Health Index from the Medical Outcomes Study (MOS) 36-item Short-Form Survey; 8-item Modified MOS Social Support Survey), and breast cancer variables (stage, surgery, chemotherapy, endocrine therapy) to develop a 10-year mortality risk score using penalized logistic regression models. We assessed model discriminative performance using the area under the receiver operating characteristic curve (AUC), calibration performance using the Hosmer-Lemeshow test, and overall model performance using Nagelkerke R 2 (NR). Compared to a model including only age, comorbidity, and cancer stage and treatment variables, adding HRQOL variables improved discrimination (AUC 0.742 from 0.715) and overall performance (NR 0.221 from 0.190) with good calibration (p=0.96 from HL test). In a cohort of older women with early-stage breast cancer, HRQOL measures predict 10-year mortality independently of traditional breast cancer prognostic variables. These findings suggest that interventions aimed at improving physical function, mental health, and social support might improve both HRQOL and survival. © 2018, Copyright the Authors Journal compilation © 2018, The American Geriatrics Society.

Construct validity test of evaluation tool for professional behaviors of entry-level occupational therapy students in the United States.

PubMed

Yuen, Hon K; Azuero, Andres; Lackey, Kaitlin W; Brown, Nicole S; Shrestha, Sangita

2016-01-01

This study aimed to test the construct validity of an instrument to measure student professional behaviors in entry-level occupational therapy (OT) students in the academic setting. A total of 718 students from 37 OT programs across the United States answered a self-assessment survey of professional behavior that we developed. The survey consisted of ranking 28 attributes, each on a 5-point Likert scale. A split-sample approach was used for exploratory and then confirmatory factor analysis. A three-factor solution with nine items was extracted using exploratory factor analysis [EFA] (n=430, 60%). The factors were 'Commitment to Learning' (2 items), 'Skills for Learning' (4 items), and 'Cultural Competence' (3 items). Confirmatory factor analysis (CFA) on the validation split (n=288, 40%) indicated fair fit for this three-factor model (fit indices: CFI=0.96, RMSEA=0.06, and SRMR=0.05). Internal consistency reliability estimates of each factor and the instrument ranged from 0.63 to 0.79. Results of the CFA in a separate validation dataset provided robust measures of goodness-of-fit for the three-factor solution developed in the EFA, and indicated that the three-factor model fitted the data well enough. Therefore, we can conclude that this student professional behavior evaluation instrument is a structurally validated tool to measure professional behaviors reported by entry-level OT students. The internal consistency reliability of each individual factor and the whole instrument was considered to be adequate to good.

Neonatal intensive care practices: perceptions of parents, professionals, and managers.

PubMed

Lantz, Björn; Ottosson, Cornelia

2014-06-01

This article explores the differences and similarities in opinions of neonatal intensive care issues between parents, neonatal intensive care unit (NICU) healthcare professionals (nurses and physicians), and managers (neonatal unit managers and pediatric division managers). An exploratory survey (n = 624) was conducted in Sweden during 2012-2013 on the basis of a validated questionnaire composed of 92 neonatal care-related Likert items. A total of 141 parents, 443 professionals, and 40 managers completed the survey. The parents were recruited consecutively from 5 NICUs of the Västra Götaland region in Sweden and the professionals and managers from all 40 NICUs in Sweden. Data were analyzed with analysis of variances, and post hoc analyses were conducted through pairwise t tests with Bonferroni corrections. Professionals and managers differed significantly on 1 item. Parents, however, found 54 items significantly less important than professionals did, but found only 4 to be significantly more important than professionals did. In line with previous research, we found that a gap exists between views of neonatal intensive care practices, with parents on one side and professionals and managers on the other. The nature of this gap, however, differs substantially from previous research, where parents found many items to be more important than professionals did. To develop and improve neonatal intensive care, this gap must be acknowledged and addressed, both in research and in practice. NICU managers need to develop strategies and routines that allow professionals to understand and adjust to the specific priorities of individual parents and families.

Cultural Resources Survey of Three Iberville Parish Levee Enlargement and Revetment Construction Items

DTIC Science & Technology

1993-09-22

SURVEY OF THREE IBERVILLE PARISH LEVEE ENLARGEMENT AND REVETMENT CONSTRUCTION ITEMS September 1993 Sam .4 D2 FINAL REPORT E R. Christopher Goodwin...LEVEE ENLARGEMENT ANj REVETMENT CONSTRUCTION ITEMS 12. PERSONAL AUTHOR(S) R. Christopher Goodwin, Ph.d., Rebecca E. Bruce, Lawrence L Hewitt, and E... block number) FIELD GROUP SUB-GROUP Acadian Coast Historic Arche6cogy Rice Antebellum Iberville Parish Saw Mill Plantation Carville Leprosarium Ophelia

Are we Aware of what we are, we are what we Eat- An Epidemiological Survey.

PubMed

Kaur, Manpreet; M Hegde, Amitha

2008-09-01

The lure of convenience in addition to good taste gets people to junk food addiction. With the advent of television even in the remotest areas people have become more aware of the fast food items available. Children watch television where fast food continues to dominate the food advertisements viewed by children. The easily available fast food in and around school campus and with little knowledge of the far reaching effects of these food items consumed, children fall an easy prey to junk food. Children are unaware of the food they eat and the effects it has on their growth and development. This survey reflects the large percentageof children who surrender to the temptation junk food consumption with little knowledge of its far sighted effects on their health.

A Guide to Item Banking in Education. (Third Edition).

ERIC Educational Resources Information Center

Naccarato, Richard W.

The current status of banks of test items existing across the United States was determined through a survey conducted between September and December 1987. Item "bank" in this context does not imply that the test items are available in computerized form, but simply that "deposited" test items can be withdrawn for use. Emphasis…

Delivering information: A descriptive study of Australian women’s information needs for decision-making about birth facility

PubMed Central

2012-01-01

Background Little information is known about what information women want when choosing a birth facility. The objective of this study was to inform the development of a consumer decision support tool about birth facility by identifying the information needs of maternity care consumers in Queensland, Australia. Methods Participants were 146 women residing in both urban and rural areas of Queensland, Australia who were pregnant and/or had recently given birth. A cross-sectional survey was administered in which participants were asked to rate the importance of 42 information items to their decision-making about birth facility. Participants could also provide up to ten additional information items of interest in an open-ended question. Results On average, participants rated 30 of the 42 information items as important to decision-making about birth facility. While the majority of information items were valued by most participants, those related to policies about support people, other women’s recommendations about the facility, freedom to choose one’s preferred position during labour and birth, the aesthetic quality of the facility, and access to on-site neonatal intensive care were particularly widely valued. Additional items of interest frequently focused on postnatal care and support, policies related to medical intervention, and access to water immersion. Conclusions The women surveyed had significant and diverse information needs for decision-making about birth facility. These findings have immediate applications for the development of decision support tools about birth facility, and highlight the need for tools which provide a large volume of information in an accessible and user-friendly format. These findings may also be used to guide communication and information-sharing by care providers involved in counselling pregnant women and families about their options for birth facility or providing referrals to birth facilities. PMID:22708648

Delivering information: a descriptive study of Australian women's information needs for decision-making about birth facility.

PubMed

Thompson, Rachel; Wojcieszek, Aleena M

2012-06-18

Little information is known about what information women want when choosing a birth facility. The objective of this study was to inform the development of a consumer decision support tool about birth facility by identifying the information needs of maternity care consumers in Queensland, Australia. Participants were 146 women residing in both urban and rural areas of Queensland, Australia who were pregnant and/or had recently given birth. A cross-sectional survey was administered in which participants were asked to rate the importance of 42 information items to their decision-making about birth facility. Participants could also provide up to ten additional information items of interest in an open-ended question. On average, participants rated 30 of the 42 information items as important to decision-making about birth facility. While the majority of information items were valued by most participants, those related to policies about support people, other women's recommendations about the facility, freedom to choose one's preferred position during labour and birth, the aesthetic quality of the facility, and access to on-site neonatal intensive care were particularly widely valued. Additional items of interest frequently focused on postnatal care and support, policies related to medical intervention, and access to water immersion. The women surveyed had significant and diverse information needs for decision-making about birth facility. These findings have immediate applications for the development of decision support tools about birth facility, and highlight the need for tools which provide a large volume of information in an accessible and user-friendly format. These findings may also be used to guide communication and information-sharing by care providers involved in counselling pregnant women and families about their options for birth facility or providing referrals to birth facilities.

The physical examination content of the Japanese National Health and Nutrition Survey: temporal changes.

PubMed

Tanaka, Hisako; Imai, Shino; Nakade, Makiko; Imai, Eri; Takimoto, Hidemi

2016-12-01

Survey items of the Japan National Nutrition Survey (J-NNS) have changed over time. Several papers on dietary surveys have been published; however, to date, there are no in-depth papers regarding physical examinations. Therefore, we investigated changes in the survey items in the physical examinations performed in the J-NNS and the National Health and Nutrition Survey (NHNS), with the aim of incorporating useful data for future policy decisions. We summarized the description of physical examinations and marshalled the changes of survey items from the J-NNS and NHNS from 1946 to 2012. The physical examination is roughly classified into the following six components: some are relevant to anthropometric measurements, clinical measurements, physical symptoms, blood tests, lifestyle and medication by interview, and others. Items related to nutritional deficiency, such as anaemia and tendon reflex disappearance, and body weight measurements were collected during the early period, according to the instructions of the General Headquarters. From 1989, blood tests and measurement of physical activity were added, and serum total protein, total cholesterol, triglycerides, HDL-cholesterol, blood glucose, red blood corpuscles and haemoglobin measurements have been performed continuously for more than 20 years. This is the first report on the items of physical examination in the J-NNS and NHNS. Our research results provide basic information for the utilization of the J-NNS and NHNS, to researchers, clinicians or policy makers. Monitoring the current state correctly is essential for national health promotion, and also for improvement of the investigation methods to apply country-by-country comparisons.

SU-F-T-244: Radiotherapy Risk Estimation Based On Expert Group Survey

DOE Office of Scientific and Technical Information (OSTI.GOV)

Koo, J; Yoon, M; Chung, W

Purpose: To evaluate the reliability of RPN (Risk Priority Number) decided by expert group and to provide preliminary data for adapting FMEA in Korea. Methods: 1163 Incidents reported in ROSIS for 11 years were used as a real data to be compared with, and were categorized into 146 items. The questionnaire was composed of the 146 items and respondents had to valuate ‘occurrence (O)’, ‘severity (S)’, ‘detectability (D)’ of each item on a scale from 1 to 10 according to the proposed AAPM TG-100 rating scales. 19 medical physicists from 19 different organizations in Korea had participated in the survey.more » Because the number of ROSIS items was not evenly spread enough to be classified into 10 grades, 1–5 scale was chosen instead of 1–10 and survey result was also fit to 5 grades to compare. Results: The average O,S,D were 1.77, 3.50, 2.13, respectively and the item which had the highest RPN(32) was ‘patient movement during treatment’ in the survey. When comparing items ranked in the top 10 of each survey(O) and ROSIS database, two items were duplicated and ‘Simulation’ and ’Treatment’ were the most frequently ranked RT process in top 10 of survey and ROSIS each. The Chronbach α of each RT process were ranged from 0.74 to 0.99 and p-value was <0.001. When comparing O*D, the average difference was 1.4. Conclusion: This work indicates the deviation between actual risk and expectation. Considering that the respondents were Korean and ROSIS is mainly composed of incidents happened in European countries and some of the top 10 items of ROSIS cannot be applied in radiotherapy procedure in Korea, the deviation could have been came from procedural difference. Moreover, if expert group was consisted of experts from various parts, expectation might have been more accurate. Therefore, further research on radiotherapy risk estimation is needed.« less

Assessment of the psychometrics of a PROMIS item bank: self-efficacy for managing daily activities

PubMed Central

Hong, Ickpyo; Li, Chih-Ying; Romero, Sergio; Gruber-Baldini, Ann L.; Shulman, Lisa M.

2017-01-01

Purpose The aim of this study is to investigate the psychometrics of the Patient-Reported Outcomes Measurement Information System self-efficacy for managing daily activities item bank. Methods The item pool was field tested on a sample of 1087 participants via internet (n = 250) and in-clinic (n = 837) surveys. All participants reported having at least one chronic health condition. The 35 item pool was investigated for dimensionality (confirmatory factor analyses, CFA and exploratory factor analysis, EFA), item-total correlations, local independence, precision, and differential item functioning (DIF) across gender, race, ethnicity, age groups, data collection modes, and neurological chronic conditions (McFadden Pseudo R2 less than 10 %). Results The item pool met two of the four CFA fit criteria (CFI = 0.952 and SRMR = 0.07). EFA analysis found a dominant first factor (eigenvalue = 24.34) and the ratio of first to second eigenvalue was 12.4. The item pool demonstrated good item-total correlations (0.59–0.85) and acceptable internal consistency (Cronbach’s alpha = 0.97). The item pool maintained its precision (reliability over 0.90) across a wide range of theta (3.70), and there was no significant DIF. Conclusion The findings indicated the item pool has sound psychometric properties and the test items are eligible for development of computerized adaptive testing and short forms. PMID:27048495

Assessment of the psychometrics of a PROMIS item bank: self-efficacy for managing daily activities.

PubMed

Hong, Ickpyo; Velozo, Craig A; Li, Chih-Ying; Romero, Sergio; Gruber-Baldini, Ann L; Shulman, Lisa M

2016-09-01

The aim of this study is to investigate the psychometrics of the Patient-Reported Outcomes Measurement Information System self-efficacy for managing daily activities item bank. The item pool was field tested on a sample of 1087 participants via internet (n = 250) and in-clinic (n = 837) surveys. All participants reported having at least one chronic health condition. The 35 item pool was investigated for dimensionality (confirmatory factor analyses, CFA and exploratory factor analysis, EFA), item-total correlations, local independence, precision, and differential item functioning (DIF) across gender, race, ethnicity, age groups, data collection modes, and neurological chronic conditions (McFadden Pseudo R (2) less than 10 %). The item pool met two of the four CFA fit criteria (CFI = 0.952 and SRMR = 0.07). EFA analysis found a dominant first factor (eigenvalue = 24.34) and the ratio of first to second eigenvalue was 12.4. The item pool demonstrated good item-total correlations (0.59-0.85) and acceptable internal consistency (Cronbach's alpha = 0.97). The item pool maintained its precision (reliability over 0.90) across a wide range of theta (3.70), and there was no significant DIF. The findings indicated the item pool has sound psychometric properties and the test items are eligible for development of computerized adaptive testing and short forms.

Sexual Harassment DEOCS 4.1 Construct Validity Summary

DTIC Science & Technology

2017-08-01

These items were modified to provide additional clarity regarding chain of command actions and response in the final survey . ** These items were...modified to provide additional clarity regarding indivduals from the respondent’s workplace in the final survey . 4 Conclusion The revised sexual

The Manual Work Instability Scale: development and validation.

PubMed

Gilworth, G; Smyth, M G; Smith, J; Tennant, A

2016-06-01

Increasing awareness of the burden of absenteeism and reduced performance at work highlights the importance of early identification of individuals experiencing work instability (WI), a mismatch between functional and cognitive abilities and job demands. To develop and validate a screening questionnaire to measure WI in manual workers. Questionnaire items were generated via qualitative interviews with manual workers and a draft survey instrument was completed by workers in a variety of fields. Rasch analysis was used interactively to assess the psychometric aspects of the emerging scale, including unidimensionality and absence of item bias (differential item functioning). A total of 17 qualitative interviews generated 110 potential items for the questionnaire. The item set resolved to a 25-item scale, which satisfied model expectations (item residual mean = -0.13, SD = 1.04; person residual mean = -0.29, SD = 0.75), had good reliability (alpha = 0.86) and strict unidimensionality (t-test 7.5% confidence interval 3.8-11.2). The Manual Work Instability Scale is a short psychometrically robust questionnaire based on the concept of WI, which incorporates both musculoskeletal symptoms and relevant psychosocial factors. It may prove effective in screening and identifying WI in workers in predominantly physical occupations. © The Author 2016. Published by Oxford University Press on behalf of the Society of Occupational Medicine. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Identifying children with special health care needs: development and evaluation of a short screening instrument.

PubMed

Bethell, Christina D; Read, Debra; Stein, Ruth E K; Blumberg, Stephen J; Wells, Nora; Newacheck, Paul W

2002-01-01

Public agencies, health care plans, providers, and consumer organizations share the need to monitor the health care needs and quality of care for children with special health care needs (CSHCN). Doing so requires a definition of CSHCN and a precise methodology for operationalizing that definition. The purpose of this study was to develop an efficient and flexible consequence-based screening instrument that identifies CSHCN across populations with rates commensurate with other studies of CSHCN. The CSHCN Screener was developed using the federal Maternal and Child Health Bureau (MCHB) definition of CSHCN and building on the conceptual and empirical properties of the Questionnaire for Identifying Children with Chronic Conditions (QuICCC) and other consequence-based models for identifying CSHCN. The CSHCN Screener was administered to 3 samples: a national sample of households with children (n = 17985), children enrolled in Medicaid managed care health plans (n = 3894), and children receiving Supplemental Security Income (SSI) benefits in Washington State (n = 1550). The efficiency, impact of further item reduction, and flexibility of administration mode were evaluated. Rates and expected variation in rates across demographic groups of children positively identified by one or more of the 5 CSHCN Screener item sequences in each sample were examined and multinomial logistic regression analysis were conducted to evaluate the effect of child characteristics in predicting positive identification. The CSHCN Screener took approximately 1 minute per child to administer by telephone and 2.1 minutes per household. During self-administration, over 98% of respondents completed each of the 5 CSHCN Screener item sequences, and respondents accurately followed each of the item skip patterns 94% of the time. Mailed surveys and telephone-administered surveys led to similar rates of positive identification in the same sample. Two Screener items would have identified 80%-90% of children positively identified as CSHCN across the study samples, although using only 2 items eliminates some children with more complex health needs. Rates of children identified by the CSHCN Screener varied according to age, sex, race/ethnicity, health status, and utilization of health services. Results of this study indicate that the CSHCN Screener requires minimal time to administer, is acceptable for use as both an interview-based and self-administered survey, and that rates of children positively identified by the CSHCN Screener vary according to child demographic, health, and health care-need characteristics. The CSHCN Screener provides a comprehensive yet parsimonious and flexible method for identifying CSHCN, making it more feasible than existing measures for standardized use across public agencies, health care plans, and other users.

Cross-cultural adaptation and validation of the Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0): the development of the Taiwanese version.

PubMed

Mao, Hui-Fen; Chen, Wan-Yin; Yao, Grace; Huang, Sheau-Ling; Lin, Chia-Chi; Huang, Wen-Ni Wennie

2010-05-01

To develop and validate a cross-cultural version of the Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0) for users of assistive technology devices in Taiwan. A cross-sectional survey. The standard cultural adaptation procedure was used for questionnaire translation and cultural item design. A field test was then conducted for item selection and psychometric properties testing. One hundred and five volunteer assistive device users in community. A questionnaire comprising 12 items of the QUEST 2.0 and 16 culture-specific items. One culture-specific item, 'Cost', was selected based on eight criteria and added to the QUEST 2.0 (12 items) to formulate the Taiwanese version of QUEST 2.0 (T-QUEST). The T-QUEST consisted of 13 items which were classified into two domains: device (8 items) and service (5 items). The internal consistencies of the device, service and total T-QUEST scores were 0.87, 0.84 and 0.90, respectively. The device, services and total T-QUEST scores achieved good test-retest stability (intraclass correlation coefficient (ICC) 0.90, 0.97, 0.95). Exploratory factor analysis revealed that T-QUEST had a two-factor structure for device and service in the construct of user satisfaction (53.42% of the variance explained). Users of assistive device in different culture may have different concerns regarding satisfaction. T-QUEST is the first published version of QUEST with culture-specific items added to the original translated items of QUEST 2.0. T-QUEST was a valid and reliable tool for measuring user satisfaction among Mandarin-speaking individuals using various kinds of assistive devices.

Development of an item bank for food parenting practices based on published instruments and reports from Canadian and US parents.

PubMed

O'Connor, Teresia M; Pham, Truc; Watts, Allison W; Tu, Andrew W; Hughes, Sheryl O; Beauchamp, Mark R; Baranowski, Tom; Mâsse, Louise C

2016-08-01

Research to understand how parents influence their children's dietary intake and eating behaviors has expanded in the past decades and a growing number of instruments are available to assess food parenting practices. Unfortunately, there is no consensus on how constructs should be defined or operationalized, making comparison of results across studies difficult. The aim of this study was to develop a food parenting practice item bank with items from published scales and supplement with parenting practices that parents report using. Items from published scales were identified from two published systematic reviews along with an additional systematic review conducted for this study. Parents (n = 135) with children 5-12 years old from the US and Canada, stratified to represent the demographic distribution of each country, were recruited to participate in an online semi-qualitative survey on food parenting. Published items and parent responses were coded using the same framework to reduce the number of items into representative concepts using a binning and winnowing process. The literature contributed 1392 items and parents contributed 1985 items, which were reduced to 262 different food parenting concepts (26% exclusive from literature, 12% exclusive from parents, and 62% represented in both). Food parenting practices related to 'Structure of Food Environment' and 'Behavioral and Educational' were emphasized more by parent responses, while practices related to 'Consistency of Feeding Environment' and 'Emotional Regulation' were more represented among published items. The resulting food parenting item bank should next be calibrated with item response modeling for scientists to use in the future. Copyright © 2016 Elsevier Ltd. All rights reserved.

Mobile phone text messaging to improve knowledge and practice of diabetic foot care in a developing country: Feasibility and outcomes.

PubMed

Hassan, Zeinab M

2017-06-01

To test the feasibility and effectiveness of using mobile phone text messaging to reinforce learning and the practice of diabetic foot care in a developing country. Ongoing learning reinforcement (2-3 times weekly) by text messaging followed an informal class on diabetic foot care in a community clinic setting. Subjects with cell phone access and no history of diabetic foot wounds or current wounds were recruited for participation (N = 225). Foot examinations and pretesting by survey occurred just before patients departed the clinic; the posttest survey and a final foot examination occurred 12 weeks later. The survey included basic demographic items along with items to measure knowledge and current foot care practices. One sample t tests (raw scores) and Wilcoxon signed-rank tests compared knowledge and practice before and after intervention. Initially, a majority of the sample (76%) reported poor levels of foot care. After 12 weeks <1% reported poor foot care practices. Statistical testing showed significant gains in knowledge (by score and level) and nearly unanimous compliance with daily foot examination. Mobile phone text messaging is an economical, feasible, and effective method for educators to improve diabetic self-care, even in a developing country. © 2017 John Wiley & Sons Australia, Ltd.

New Instrument to Measure Hospital Patient Experiences in Flanders

PubMed Central

Tambuyzer, Else; De Wachter, Dirk; Sermeus, Walter; De Ridder, Dirk; Ramaekers, Dirk; Weeghmans, Ilse; Vanhaecht, Kris

2017-01-01

Implementing a standardized patient experience survey may initiate a process to apply pressure on hospitals to attend to improving patient experiences. In Flanders, Belgium, the Flemish Patient Survey was developed between 2011 and 2015. A preliminary version was developed from a scoping review and patient and expert focus groups, and included 27 items for eight hypothesized dimensions: ‘preparing for hospital stay’, ‘information and communication’, ‘coordination’, ‘respect’, ‘privacy’, ‘safe care’, pain management’, and ‘participation’. Exploratory factor analysis for 1076 patients in 17 hospitals found that the data did not fit the dimensions. Adaptations in item wording and response categories were based on the US Hospital Consumer Assessment of Healthcare Providers and Systems. The revised version showed excellent model fit in 22,143 patients in 37 hospitals. Multiple group analysis pointed to evidence of measurement invariance over time across mode of administration, type of nursing unit, and various patient characteristics. Fostering a collaborative approach thus proved successful in implementing a standardized patient experience survey. The most recent findings (2016) illustrate substandard performance and a need for patient-mix adjustment. The Flemish government developed a dedicated website to make findings publicly available and the federal government currently considers patient experiences in devising a pay-for-quality scheme. PMID:29084160

Using Cognitive Interviews to Pilot an International Survey of Principal Preparation: A Western Australian Perspective

ERIC Educational Resources Information Center

Wildy, Helen; Clarke, Simon

2009-01-01

This paper provides an example of the application of the cognitive interview, a qualitative tool for pre-testing a survey instrument to check its cognitive validity, that is, whether the items mean to respondents what they mean to the item designers. The instrument is the survey used in the final phase of the International Study of Principal…

Development of a refractive error quality of life scale for Thai adults (the REQ-Thai).

PubMed

Sukhawarn, Roongthip; Wiratchai, Nonglak; Tatsanavivat, Pyatat; Pitiyanuwat, Somwung; Kanato, Manop; Srivannaboon, Sabong; Guyatt, Gordon H

2011-08-01

To develop a scale for measuring refractive error quality of life (QOL) for Thai adults. The full survey comprised 424 respondents from 5 medical centers in Bangkok and from 3 medical centers in Chiangmai, Songkla and KhonKaen provinces. Participants were emmetropes and persons with refractive correction with visual acuity of 20/30 or better An item reduction process was employed by combining 3 methods-expert opinion, impact method and item-total correlation methods. The classical reliability testing and the validity testing including convergent, discriminative and construct validity was performed. The developed questionnaire comprised 87 items in 6 dimensions: 1) quality of vision, 2) visual function, 3) social function, 4) psychological function, 5) symptoms and 6) refractive correction problems. It is the 5-level Likert scale type. The Cronbach's Alpha coefficients of its dimensions ranged from 0.756 to 0. 979. All validity testing were shown to be valid. The construct validity was validated by the confirmatory factor analysis. A short version questionnaire comprised 48 items with good reliability and validity was also developed. This is the first validated instrument for measuring refractive error quality of life for Thai adults that was developed with strong research methodology and large sample size.

Factorial and Item-Level Invariance of a Principal Perspectives Survey: German and U.S. Principals.

PubMed

Wang, Chuang; Hancock, Dawson R; Muller, Ulrich

This study examined the factorial and item-level invariance of a survey of principals' job satisfaction and perspectives about reasons and barriers to becoming a principal with a sample of US principals and another sample of German principals. Confirmatory factor analysis (CFA) and differential item functioning (DIF) analysis were employed at the test and item level, respectively. A single group CFA was conducted first, and the model was found to fit the data collected. The factorial invariance between the German and the US principals was tested through three steps: (a) configural invariance; (b) measurement invariance; and (c) structural invariance. The results suggest that the survey is a viable measure of principals' job satisfaction and perspectives about reasons and barriers to becoming a principal because principals from two different cultures shared a similar pattern on all three constructs. The DIF analysis further revealed that 22 out of the 28 items functioned similarly between German and US principals.

Development and pilot-test of the Workplace Readiness Questionnaire, a theory-based instrument to measure small workplaces’ readiness to implement wellness programs

PubMed Central

Hannon, Peggy A.; Helfrich, Christian D.; Chan, K. Gary; Allen, Claire L.; Hammerback, Kristen; Kohn, Marlana J.; Parrish, Amanda T.; Weiner, Bryan J.; Harris, Jeffrey R.

2016-01-01

Purpose To develop a theory-based questionnaire to assess readiness for change in small workplaces adopting wellness programs. Design In developing our scale, we first tested items via “think-aloud” interviews. We tested the revised items in a cross-sectional quantitative telephone survey. Setting Small workplaces (20–250 employees) in low-wage industries. Subjects Decision-makers representing small workplaces in King County, Washington (think-aloud interviews, n=9) and the United States (telephone survey, n=201). Measures We generated items for each construct in Weiner’s theory of organizational readiness for change. We also measured workplace characteristics and current implementation of workplace wellness programs. Analysis We assessed reliability by coefficient alpha for each of the readiness questionnaire subscales. We tested the association of all subscales with employers’ current implementation of wellness policies, programs, and communications, and conducted a path analysis to test the associations in the theory of organizational readiness to change. Results Each of the readiness subscales exhibited acceptable internal reliability (coefficient alpha range = .75–.88) and was positively associated with wellness program implementation (p <.05). The path analysis was consistent with the theory of organizational readiness to change, except change efficacy did not predict change-related effort. Conclusion We developed a new questionnaire to assess small workplaces’ readiness to adopt and implement evidence-based wellness programs. Our findings also provide empirical validation of Weiner’s theory of readiness for change. PMID:26389975

Development and Pilot Test of the Workplace Readiness Questionnaire, a Theory-Based Instrument to Measure Small Workplaces' Readiness to Implement Wellness Programs.

PubMed

Hannon, Peggy A; Helfrich, Christian D; Chan, K Gary; Allen, Claire L; Hammerback, Kristen; Kohn, Marlana J; Parrish, Amanda T; Weiner, Bryan J; Harris, Jeffrey R

2017-01-01

To develop a theory-based questionnaire to assess readiness for change in small workplaces adopting wellness programs. In developing our scale, we first tested items via "think-aloud" interviews. We tested the revised items in a cross-sectional quantitative telephone survey. The study setting comprised small workplaces (20-250 employees) in low-wage industries. Decision-makers representing small workplaces in King County, Washington (think-aloud interviews, n = 9), and the United States (telephone survey, n = 201) served as study subjects. We generated items for each construct in Weiner's theory of organizational readiness for change. We also measured workplace characteristics and current implementation of workplace wellness programs. We assessed reliability by coefficient alpha for each of the readiness questionnaire subscales. We tested the association of all subscales with employers' current implementation of wellness policies, programs, and communications, and conducted a path analysis to test the associations in the theory of organizational readiness to change. Each of the readiness subscales exhibited acceptable internal reliability (coefficient alpha range, .75-.88) and was positively associated with wellness program implementation ( p < .05). The path analysis was consistent with the theory of organizational readiness to change, except change efficacy did not predict change-related effort. We developed a new questionnaire to assess small workplaces' readiness to adopt and implement evidence-based wellness programs. Our findings also provide empirical validation of Weiner's theory of readiness for change.

A historical examination of the nature of science and its consensus as presented in the Benchmarks for Science Literacy and National Science Education Standards

NASA Astrophysics Data System (ADS)

Felske, Daniel D.

Developing a scientific literate citizenry has fueled science education reforms for the past 40 years. A review of the literature reveals that definitions of scientific literacy during this period were greatly influenced by the goals, directions, and political agendas of the day. This approach has resulted in programs emphasizing certain aspects of scientific literacy while neglecting others. Additionally, consensus on what scientific literacy means or how to develop it has not been achieved. One aspect of scientific literacy that is agreed upon is the essential role that the nature of science (NOS) plays in its development. For this reason, an extensive review of the literature was conducted to develop a comprehensive background of this topic. The component structure of the NOS revealed in the literature was then synthesized into a NOS framework. The NOS framework served to guide the construction of a 21 item questionnaire taken from statements embedded in the consensual documents Benchmarks for Science Literacy (AAAS, 1993) and National Science Education Standards (NRC, 1996). A panel of five experts who have written extensively on the nature of science was then assembled and the degree of NOS consensus measured using a modified Delphi technique. The results of the survey indicated a high level of consensus (95%) at the ≥80% level. The panelists concurred positively on 19 of 21 NOS items, concurred negatively on one of 21 NOS items (item 10), and could not reach consensus on one of 21 NOS items (item 16). These findings, as well as, the NOS framework, are important first steps toward developing programs that foster the development of scientific literacy.

The dimensionality of DSM-IV alcohol use disorders among adolescent and adult drinkers and symptom patterns by age, gender, and race/ethnicity.

PubMed

Harford, Thomas C; Yi, Hsiao-ye; Faden, Vivian B; Chen, Chiung M

2009-05-01

There is limited information on the validity of Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) alcohol use disorders (AUD) symptom criteria among adolescents in the general population. The purpose of this study is to assess the DSM-IV AUD symptom criteria as reported by adolescent and adult drinkers in a single representative sample of the U.S. population aged 12 years and older. This design avoids potential confounding due to differences in survey methodology when comparing adolescents and adults from different surveys. A total of 133,231 current drinkers (had at least 1 drink in the past year) aged 12 years and older were drawn from respondents to the 2002 to 2005 National Surveys on Drug Use and Health. DSM-IV AUD criteria were assessed by questions related to specific symptoms occurring during the past 12 months. Factor analytic and item response theory models were applied to the 11 AUD symptom criteria to assess the probabilities of symptom item endorsements across different values of the underlying trait. A 1-factor model provided an adequate and parsimonious interpretation for the 11 AUD criteria for the total sample and for each of the gender-age groups. The MIMIC model exhibited significant indication for item bias among some criteria by gender, age, and race/ethnicity. Symptom criteria for "tolerance,"time spent," and "hazardous use" had lower item thresholds (i.e., lower severity) and low item discrimination, and they were well separated from the other symptoms, especially in the 2 younger age groups (12 to 17 and 18 to 25). "Larger amounts,"cut down,"withdrawal," and "legal problems" had higher item thresholds but generally lower item discrimination, and they tend to exhibit greater dispersion at higher AUD severity, particularly in the youngest age group (12 to 17). Findings from the present study do not provide support for the 2 separate DSM-IV diagnoses of alcohol abuse and dependence among either adolescents or adults. Variations in criteria severity for both abuse and dependence offer support for a dimensional approach to diagnosis which should be considered in the ongoing development of DSM-V.

Evaluation of Online Course Websites: Is Teaching Online a Tug-of-War?

ERIC Educational Resources Information Center

Hathorn, Lesley; Hathorn, John

2010-01-01

The need for an evaluation instrument for web-based, mainly asynchronous, course websites is necessary. An instrument was developed and tested to assess whether there was an appropriate checklist of items that were expected of an online course website by both students and faculty. The instrument was developed from surveying the current literature…

A Case Study of Local Needs for Information on Industrial Development. Extension Studies 55.

ERIC Educational Resources Information Center

Fuller, Theodore E.; Turner, Francis C.

In order to identify some basic types of information concerning industrial development which might be useful to decision-makers at the local level, an opinion survey was conducted in five bordering nonmetropolitan Pennsylvania counties. A 13-item questionnaire was mailed to 222 local organizations, categorized by response rate as follows: (1)…

Drawing and Using Free Body Diagrams: Why It May Be Better Not to Decompose Forces

ERIC Educational Resources Information Center

Aviani, Ivica; Erceg, Nataša; Mešic, Vanes

2015-01-01

In this study we investigated how two different approaches to drawing free body diagrams influence the development of students' understanding of Newton's laws, including their ability to identify real forces. For this purpose we developed a 12-item two-tier multiple choice survey and conducted a quasiexperiment. This experiment included two groups…

Development and Validation of the Enculturation Scale for Filipino Americans

ERIC Educational Resources Information Center

del Prado, Alicia M.; Church, A. Timothy

2010-01-01

Enculturation is the degree to which a person adheres to the values and behaviors of an indigenous or ethnic culture. This study was conducted to develop the Enculturation Scale for Filipino Americans (ESFA). Items were generated from a literature review, interviews with 5 Filipino American academic experts, and a survey of 24 cultural informants.…

Capturing the true burden of dystonia on patients: the Cervical Dystonia Impact Profile (CDIP-58).

PubMed

Cano, S J; Warner, T T; Linacre, J M; Bhatia, K P; Thompson, A J; Fitzpatrick, R; Hobart, J C

2004-11-09

To develop a new rating scale for measuring the health impact of cervical dystonia (CD) that includes patients' perceptions and complements existing observer dependent clinician rating scales. Scale development was in three stages. In Stage 1, a large pool of items was generated from patient interviews (n = 25), expert opinion, and literature review. In Stage 2, these items were administered by postal survey to people with CD. The resulting data were analyzed using Rasch item analysis to construct, from the item pool, a rating scale that satisfied criteria for rigorous measurement. In Stage 3, the measurement properties of this rating scale were examined in an independent sample of people with CD. In Stage 1, 150 items concerning the health impact of CD were generated. In Stage 2, 556 people completed questionnaires (87% response rate) and a 58-item rating scale measuring the health impact of CD in eight areas was constructed (CD Impact Profile, CDIP-58). In Stage 3, CDIP-58 data from 391 people (87% response rate) were received. Analyses supported the measurement of eight unidimensional constructs (infit mean square range 0.62 to 1.50), item calibration (33.37 to 67.56), and patient separation statistics (2.59 to 3.38). Items demonstrated stable calibrations in subgroups of people with CD supporting the stability of the CDIP-58. The CDIP-58 is a reliable and valid patient-based rating scale measuring the health impact of CD in eight health dimensions.

Developing a model of competence in the operating theatre: psychometric validation of the perceived perioperative competence scale-revised.

PubMed

Gillespie, Brigid M; Polit, Denise F; Hamlin, Lois; Chaboyer, Wendy

2012-01-01

This paper describes the development and validation of the Revised Perioperative Competence Scale (PPCS-R). There is a lack of a psychometrically tested sound self-assessment tools to measure nurses' perceived competence in the operating room. Content validity was established by a panel of international experts and the original 98-item scale was pilot tested with 345 nurses in Queensland, Australia. Following the removal of several items, a national sample that included all 3209 nurses who were members of the Australian College of Operating Room Nurses was surveyed using the 94-item version. Psychometric testing assessed content validity using exploratory factor analysis, internal consistency using Cronbach's alpha, and construct validity using the "known groups" technique. During item reduction, several preliminary factor analyses were performed on two random halves of the sample (n=550). Usable data for psychometric assessment were obtained from 1122 nurses. The original 94-item scale was reduced to 40 items. The final factor analysis using the entire sample resulted in a 40 item six-factor solution. Cronbach's alpha for the 40-item scale was .96. Construct validation demonstrated significant differences (p<.0001) in perceived competence scores relative to years of operating room experience and receipt of specialty education. On the basis of these results, the psychometric properties of the PPCS-R were considered encouraging. Further testing of the tool in different samples of operating room nurses is necessary to enable cross-cultural comparisons. Copyright © 2011 Elsevier Ltd. All rights reserved.

The Trauma Center Organizational Culture Survey: development and conduction.

PubMed

Davis, Matthew L; Wehbe-Janek, Hania; Subacius, Haris; Pinto, Ruxandra; Nathens, Avery B

2015-01-01

The Trauma Center Organizational Culture Survey (TRACCS) instrument was developed to assess organizational culture of trauma centers enrolled in the American College of Surgeons Trauma Quality Program (ACS TQIP). The objective is to provide evidence on the psychometric properties of the factors of TRACCS and describe the current organizational culture of TQIP-enrolled trauma centers. A cross-sectional study was conducted by surveying a sampling of employees at 174 TQIP-enrolled trauma centers. Data collection was preceded by multistep survey development. Psychometric properties were assessed by an exploratory factor analysis (construct validity) and the item-total correlations and Cronbach alpha were calculated (internal reliability). Statistical outcomes of the survey responses were measured by descriptive statistics and mixed effect models. The response rate for trauma center participation in the study was 78.7% (n = 137). The factor analysis resulted in 16 items clustered into three factors as described: opportunity, pride, and diversity, trauma center leadership, and employee respect and recognition. TRACCS was found to be highly reliable with a Cronbach alpha of 0.90 in addition to the three factors (0.91, 0.90, and 0.85). Considerable variability of TRACCS overall and factor score among hospitals was measured, with the largest interhospital deviations among trauma center leadership. More than 80% of the variability in the responses occurred within rather than between hospitals. TRACCS was developed as a reliable tool for measuring trauma center organizational culture. Relationships between TQIP outcomes and measured organizational culture are under investigation. Trauma centers could apply TRACCS to better understand current organizational culture and how change tools can impact culture and subsequent patient and process outcomes. Copyright © 2015 Elsevier Inc. All rights reserved.

Leadership Development in Dental Education: Report on the ADEA Leadership Institute, 2000-14.

PubMed

Haden, N Karl; Ditmyer, Marcia M; Mobley, Connie; Rodriguez, Tobias; Brallier, Lynn Beck; Valachovic, Richard W

2016-04-01

The American Dental Education Association’s Leadership Institute (ADEA LI) is the association’s flagship development program for those aspiring to leadership in dental and higher education. As with previous studies of the ADEA LI, ADEA will use information from the survey described in this report to improve the ADEA LI curriculum and to guide other leadership development efforts. In 2014-15, ADEA distributed a 50-item online survey via email to all ADEA LI alumni from the classes of 2000 through 2014. The survey included selected-response questions, closed-ended questions, and open-response questions. The survey had an overall response rate of 47% (133/285); response rates to individual items varied. The mean age of the respondents when they participated in the Institute was 48.5 years. Men and women were almost equally represented among the respondents. Nearly half reported their ultimate career goal as department chair, associate dean, or assistant dean, while 20 (15.8%) indicated a goal of becoming dean and 15 (11.8%) aspired to administrative roles higher than dean. Areas the respondents recommended for improvement included more programming in budgeting and financial management, fundraising, and personnel management. Almost 100% of the respondents indicated they would recommend the ADEA LI to others. Overall, the survey respondents confirmed the value of the ADEA LI in their assessment of their fellowship and its subsequent application to their careers. Comparison of elements from this study to previous studies of ADEA LI alumni demonstrates the effectiveness of past changes made to the Institute and the creation of additional ADEA leadership initiatives.

Mokken scale analysis of mental health and well-being questionnaire item responses: a non-parametric IRT method in empirical research for applied health researchers

PubMed Central

2012-01-01

Background Mokken scaling techniques are a useful tool for researchers who wish to construct unidimensional tests or use questionnaires that comprise multiple binary or polytomous items. The stochastic cumulative scaling model offered by this approach is ideally suited when the intention is to score an underlying latent trait by simple addition of the item response values. In our experience, the Mokken model appears to be less well-known than for example the (related) Rasch model, but is seeing increasing use in contemporary clinical research and public health. Mokken's method is a generalisation of Guttman scaling that can assist in the determination of the dimensionality of tests or scales, and enables consideration of reliability, without reliance on Cronbach's alpha. This paper provides a practical guide to the application and interpretation of this non-parametric item response theory method in empirical research with health and well-being questionnaires. Methods Scalability of data from 1) a cross-sectional health survey (the Scottish Health Education Population Survey) and 2) a general population birth cohort study (the National Child Development Study) illustrate the method and modeling steps for dichotomous and polytomous items respectively. The questionnaire data analyzed comprise responses to the 12 item General Health Questionnaire, under the binary recoding recommended for screening applications, and the ordinal/polytomous responses to the Warwick-Edinburgh Mental Well-being Scale. Results and conclusions After an initial analysis example in which we select items by phrasing (six positive versus six negatively worded items) we show that all items from the 12-item General Health Questionnaire (GHQ-12) – when binary scored – were scalable according to the double monotonicity model, in two short scales comprising six items each (Bech’s “well-being” and “distress” clinical scales). An illustration of ordinal item analysis confirmed that all 14 positively worded items of the Warwick-Edinburgh Mental Well-being Scale (WEMWBS) met criteria for the monotone homogeneity model but four items violated double monotonicity with respect to a single underlying dimension. Software availability and commands used to specify unidimensionality and reliability analysis and graphical displays for diagnosing monotone homogeneity and double monotonicity are discussed, with an emphasis on current implementations in freeware. PMID:22686586

Mokken scale analysis of mental health and well-being questionnaire item responses: a non-parametric IRT method in empirical research for applied health researchers.

PubMed

Stochl, Jan; Jones, Peter B; Croudace, Tim J

2012-06-11

Mokken scaling techniques are a useful tool for researchers who wish to construct unidimensional tests or use questionnaires that comprise multiple binary or polytomous items. The stochastic cumulative scaling model offered by this approach is ideally suited when the intention is to score an underlying latent trait by simple addition of the item response values. In our experience, the Mokken model appears to be less well-known than for example the (related) Rasch model, but is seeing increasing use in contemporary clinical research and public health. Mokken's method is a generalisation of Guttman scaling that can assist in the determination of the dimensionality of tests or scales, and enables consideration of reliability, without reliance on Cronbach's alpha. This paper provides a practical guide to the application and interpretation of this non-parametric item response theory method in empirical research with health and well-being questionnaires. Scalability of data from 1) a cross-sectional health survey (the Scottish Health Education Population Survey) and 2) a general population birth cohort study (the National Child Development Study) illustrate the method and modeling steps for dichotomous and polytomous items respectively. The questionnaire data analyzed comprise responses to the 12 item General Health Questionnaire, under the binary recoding recommended for screening applications, and the ordinal/polytomous responses to the Warwick-Edinburgh Mental Well-being Scale. After an initial analysis example in which we select items by phrasing (six positive versus six negatively worded items) we show that all items from the 12-item General Health Questionnaire (GHQ-12)--when binary scored--were scalable according to the double monotonicity model, in two short scales comprising six items each (Bech's "well-being" and "distress" clinical scales). An illustration of ordinal item analysis confirmed that all 14 positively worded items of the Warwick-Edinburgh Mental Well-being Scale (WEMWBS) met criteria for the monotone homogeneity model but four items violated double monotonicity with respect to a single underlying dimension.Software availability and commands used to specify unidimensionality and reliability analysis and graphical displays for diagnosing monotone homogeneity and double monotonicity are discussed, with an emphasis on current implementations in freeware.

Development and validation of green eating behaviors, stage of change, decisional balance, and self-efficacy scales in college students.

PubMed

Weller, Kathryn E; Greene, Geoffrey W; Redding, Colleen A; Paiva, Andrea L; Lofgren, Ingrid; Nash, Jessica T; Kobayashi, Hisanori

2014-01-01

To develop and validate an instrument to assess environmentally conscious eating (Green Eating [GE]) behavior (BEH) and GE Transtheoretical Model constructs including Stage of Change (SOC), Decisional Balance (DB), and Self-efficacy (SE). Cross-sectional instrument development survey. Convenience sample (n = 954) of 18- to 24-year-old college students from a northeastern university. The sample was randomly split: (N1) and (N2). N1 was used for exploratory factor analyses using principal components analyses; N2 was used for confirmatory analyses (structural modeling) and reliability analyses (coefficient α). The full sample was used for measurement invariance (multi-group confirmatory analyses) and convergent validity (BEH) and known group validation (DB and SE) by SOC using analysis of variance. Reliable (α > .7), psychometrically sound, and stable measures included 2 correlated 5-item DB subscales (Pros and Cons), 2 correlated SE subscales (school [5 items] and home [3 items]), and a single 6-item BEH scale. Most students (66%) were in Precontemplation and Contemplation SOC. Behavior, DB, and SE scales differed significantly by SOC (P < .001) with moderate to large effect sizes, as predicted by the Transtheoretical Model, which supported the validity of these measures. Successful development and preliminary validation of this 25-item GE instrument provides a basis for assessment as well as development of tailored interventions for college students. Copyright © 2014 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Iranian women's perceptions of family-planning services quality: a client-satisfaction survey.

PubMed

Nakhaee, N; Mirahmadizadeh, A-R

2005-09-01

As Iran (IR) is included among the most successful developing countries in family planning, clarification and expression of the ideas and needs of women receiving the services not only have a great positive impact on national policies but also may be of interest to other nations. This research was conducted to clarify the client perceptions of the quality of family planning services in the capital cities of the two largest provinces of Iran. A representative sample of 909 women aged 15-50 referred to health centers were interviewed by skillful interviewers in a private area after obtaining informed consent. A questionnaire consisting of baseline data and 17 five-point Likert-scaled items measuring the satisfaction of clients and perceived importance of each item was developed by investigators. Half were aged 26-35 years, and most (84%) were housewives. The highest percentage of dissatisfaction was reported in relation to 'privacy protection' item. However, when the importance score was included, too, 'provision of sufficient information regarding other contraceptive methods' and 'unavailability of all methods' implicated the areas where priorities should be focused. The satisfaction levels obtained by the survey should be carefully heeded, and the supply chain and provision of information to the clients may be the first priorities in the process of improving the quality of care.

Risky Business: Factor Analysis of Survey Data – Assessing the Probability of Incorrect Dimensionalisation

PubMed Central

van der Eijk, Cees; Rose, Jonathan

2015-01-01

This paper undertakes a systematic assessment of the extent to which factor analysis the correct number of latent dimensions (factors) when applied to ordered-categorical survey items (so-called Likert items). We simulate 2400 data sets of uni-dimensional Likert items that vary systematically over a range of conditions such as the underlying population distribution, the number of items, the level of random error, and characteristics of items and item-sets. Each of these datasets is factor analysed in a variety of ways that are frequently used in the extant literature, or that are recommended in current methodological texts. These include exploratory factor retention heuristics such as Kaiser’s criterion, Parallel Analysis and a non-graphical scree test, and (for exploratory and confirmatory analyses) evaluations of model fit. These analyses are conducted on the basis of Pearson and polychoric correlations. We find that, irrespective of the particular mode of analysis, factor analysis applied to ordered-categorical survey data very often leads to over-dimensionalisation. The magnitude of this risk depends on the specific way in which factor analysis is conducted, the number of items, the properties of the set of items, and the underlying population distribution. The paper concludes with a discussion of the consequences of over-dimensionalisation, and a brief mention of alternative modes of analysis that are much less prone to such problems. PMID:25789992

Development and psychometric testing of the Clinical Learning Organisational Culture Survey (CLOCS).

PubMed

Henderson, Amanda; Creedy, Debra; Boorman, Rhonda; Cooke, Marie; Walker, Rachel

2010-10-01

This paper describes the development and psychometric testing of the Clinical Learning Organisational Culture Survey (CLOCS) that measures prevailing beliefs and assumptions important for learning to occur in the workplace. Items from a tool that measured motivation in workplace learning were adapted to the nursing practice context. The tool was tested in the clinical setting, and then further modified to enhance face and content validity. Registered nurses (329) across three major Australian health facilities were surveyed between June 2007 and September 2007. An exploratory factor analysis identified five concepts--recognition, dissatisfaction, affiliation, accomplishment, and influence. VALIDITY AND RELIABILITY: Internal consistency measures of reliability revealed that four concepts had good internal consistency: recognition (alpha=.914), dissatisfaction (alpha=.771), affiliation (alpha=.801), accomplishment (alpha=.664), but less so for influence (alpha=.529). This tool effectively measures recognition, affiliation and accomplishment--three concepts important for learning in practice situations, as well as dissatisfied staff across all these domains. Testing of additional influence items identify that this concept is difficult to delineate. The CLOCS can effectively inform leaders about concepts inherent in the culture important for maximising learning by staff. Crown Copyright © 2009. Published by Elsevier Ltd. All rights reserved.

A survey of tobacco dependence treatment guidelines in 121 countries

PubMed Central

Piné-Abata, Hembadoon; McNeill, Ann; Raw, Martin; Bitton, Asaf; Rigotti, Nancy; Murray, Rachael

2013-01-01

Aims To report progress among Parties to the World Health Organization (WHO) Framework Convention on Tobacco Control (FCTC) in developing national tobacco treatment guidelines in accordance with FCTC Article 14 guideline recommendations. Design Cross-sectional study. Setting Electronic survey from December 2011 to August 2012; participants were asked to complete either an online or attached Microsoft Word questionnaire. Participants One hundred and sixty-three of the 173 Parties to the FCTC at the time of our survey. Measurements The 51-item questionnaire contained 30 items specifically on guidelines. Questions covered the areas of guidelines writing process, content, key recommendations and other characteristics. Findings One hundred and twenty-one countries (73%) responded. Fifty-three countries (44%) had guidelines, ranging from 75% among high-income countries to 11% among low-income countries. Nearly all guidelines recommended brief advice (93%), intensive specialist support (93%) and medications (96%), while 66% recommended quitlines. Fifty-seven percent had a dissemination strategy, 76% stated funding source and 68% had professional endorsement. Conclusion Fewer than half of the Parties to the WHO FCTC have developed national tobacco treatment guidelines, but, where guidelines exist, they broadly follow FCTC Article 14 guideline recommendations. PMID:23437892

Assessing quality of maternity care in Hungary: expert validation and testing of the mother-centered prenatal care (MCPC) survey instrument.

PubMed

Rubashkin, Nicholas; Szebik, Imre; Baji, Petra; Szántó, Zsuzsa; Susánszky, Éva; Vedam, Saraswathi

2017-11-16

Instruments to assess quality of maternity care in Central and Eastern European (CEE) region are scarce, despite reports of poor doctor-patient communication, non-evidence-based care, and informal cash payments. We validated and tested an online questionnaire to study maternity care experiences among Hungarian women. Following literature review, we collated validated items and scales from two previous English-language surveys and adapted them to the Hungarian context. An expert panel assessed items for clarity and relevance on a 4-point ordinal scale. We calculated item-level Content Validation Index (CVI) scores. We designed 9 new items concerning informal cash payments, as well as 7 new "model of care" categories based on mode of payment. The final questionnaire (N = 111 items) was tested in two samples of Hungarian women, representative (N = 600) and convenience (N = 657). We conducted bivariate analysis and thematic analysis of open-ended responses. Experts rated pre-existing English-language items as clear and relevant to Hungarian women's maternity care experiences with an average CVI for included questions of 0.97. Significant differences emerged across the model of care categories in terms of informal payments, informed consent practices, and women's perceptions of autonomy. Thematic analysis (N = 1015) of women's responses identified 13 priority areas of the maternity care experience, 9 of which were addressed by the questionnaire. We developed and validated a comprehensive questionnaire that can be used to evaluate respectful maternity care, evidence-based practice, and informal cash payments in CEE region and beyond.

A Descriptive, Cross-sectional Survey of Turkish Nurses' Knowledge of Pressure Ulcer Risk, Prevention, and Staging.

PubMed

Gul, Asiye; Andsoy, Isil Isik; Ozkaya, Birgul; Zeydan, Ayten

2017-06-01

Nurses' knowledge of pressure ulcer (PU) prevention and management is an important first step in the provision of optimal care. To evaluate PU prevention/risk, staging, and wound description knowledge, a descriptive, cross-sectional survey was conducted among nurses working in an acute care Turkish hospital. The survey instrument was a modified and translated version of the Pieper Pressure Ulcer Knowledge Test (PUKT), and its validity and reliability were established. Nurses completed a Personal Characteristics Form, including sociodemographic information and exposure to educational presentations and information about and experience with PUs, followed by the 49-item modified PUKT which includes 33 prevention/risk items, 9 staging items, and 7 wound description items. All items are true/false questions with an I don't know option (scoring: minimum 0, maximum 49). Correct answers received 1 point and incorrect/unknown answers received 0 points. The paper-pencil questionnaires were distributed by 2 researchers to all nurses in the participating hospital and completed by those willing to be included. Responses were analyzed using descriptive statistics. Pearson's correlation test was used to examine the relationship between quantitative variables, and mean scores were compared using the Mann-Whitney U and Kruskal-Wallis tests. Among the 308 participating nurses (mean age 29.5 ± 8.1 [range 19-56] years) most were women (257, 83.4%) with 7.3 ± 7.8 (range 1-36) years of experience. The mean knowledge score for the entire sample was 29.7 ± 6.7 (range 8-42). The overall percentage of correct answers was 60.6% to 61.8% for PU prevention/risk assessment, 60% for wound description, and 56.6% for PU staging. Knowledge scores were significantly (P <.05) higher for participants who attended at least 1 lecture/conference/course on PUs in the last year, read articles/books about PUs, cared for patients with PUs, or believed their patients were at risk for PU development. Most participants (180, 58.4%) scored 60% or more correct; 8 (2.6%) correctly answered 80% or more of the items. The lowest number of correct answers was for the item, "Bunny boots and gel pads relieve pressure on the heels" (22, 7.1%). The results of this study suggest education and experience caring for patients who are at risk for or have a PU affect nurses' knowledge. This study, and additional research examining nurse knowledge, will help the development of much-needed education programs.

Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings

PubMed Central

2012-01-01

Background There is a great deal of variation in the existing capacity of primary prevention programs and policies addressing chronic disease to deliver evidence-based interventions (EBIs). In order to develop and evaluate implementation strategies that are tailored to the appropriate level of capacity, there is a need for an easy-to-administer tool to stage organizational readiness for EBIs. Methods Based on theoretical frameworks, including Rogers’ Diffusion of Innovations, we developed a survey instrument to measure four domains representing stages of readiness for EBI: awareness, adoption, implementation, and maintenance. A separate scale representing organizational climate as a potential mediator of readiness for EBIs was also included in the survey. Twenty-three questions comprised the four domains, with four to nine items each, using a seven-point response scale. Representatives from obesity, asthma, diabetes, and tobacco prevention programs serving diverse populations in the United States were surveyed (N = 243); test-retest reliability was assessed with 92 respondents. Results Confirmatory factor analysis (CFA) was used to test and refine readiness scales. Test-retest reliability of the readiness scales, as measured by intraclass correlation, ranged from 0.47–0.71. CFA found good fit for the five-item adoption and implementation scales and resulted in revisions of the awareness and maintenance scales. The awareness scale was split into two two-item scales, representing community and agency awareness. The maintenance scale was split into five- and four-item scales, representing infrastructural maintenance and evaluation maintenance, respectively. Internal reliability of scales (Cronbach’s α) ranged from 0.66–0.78. The model for the final revised scales approached good fit, with most factor loadings >0.6 and all >0.4. Conclusions The lack of adequate measurement tools hinders progress in dissemination and implementation research. These preliminary results help fill this gap by describing the reliability and measurement properties of a theory-based tool; the short, user-friendly instrument may be useful to researchers and practitioners seeking to assess organizational readiness for EBIs across a variety of chronic disease prevention programs and settings. PMID:22800294

Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings.

PubMed

Stamatakis, Katherine A; McQueen, Amy; Filler, Carl; Boland, Elizabeth; Dreisinger, Mariah; Brownson, Ross C; Luke, Douglas A

2012-07-16

There is a great deal of variation in the existing capacity of primary prevention programs and policies addressing chronic disease to deliver evidence-based interventions (EBIs). In order to develop and evaluate implementation strategies that are tailored to the appropriate level of capacity, there is a need for an easy-to-administer tool to stage organizational readiness for EBIs. Based on theoretical frameworks, including Rogers' Diffusion of Innovations, we developed a survey instrument to measure four domains representing stages of readiness for EBI: awareness, adoption, implementation, and maintenance. A separate scale representing organizational climate as a potential mediator of readiness for EBIs was also included in the survey. Twenty-three questions comprised the four domains, with four to nine items each, using a seven-point response scale. Representatives from obesity, asthma, diabetes, and tobacco prevention programs serving diverse populations in the United States were surveyed (N=243); test-retest reliability was assessed with 92 respondents. Confirmatory factor analysis (CFA) was used to test and refine readiness scales. Test-retest reliability of the readiness scales, as measured by intraclass correlation, ranged from 0.47-0.71. CFA found good fit for the five-item adoption and implementation scales and resulted in revisions of the awareness and maintenance scales. The awareness scale was split into two two-item scales, representing community and agency awareness. The maintenance scale was split into five- and four-item scales, representing infrastructural maintenance and evaluation maintenance, respectively. Internal reliability of scales (Cronbach's α) ranged from 0.66-0.78. The model for the final revised scales approached good fit, with most factor loadings >0.6 and all >0.4. The lack of adequate measurement tools hinders progress in dissemination and implementation research. These preliminary results help fill this gap by describing the reliability and measurement properties of a theory-based tool; the short, user-friendly instrument may be useful to researchers and practitioners seeking to assess organizational readiness for EBIs across a variety of chronic disease prevention programs and settings.

Using Qualitative Research to Inform the Development of a Comprehensive Outcomes Assessment for Asthma

PubMed Central

Turner-Bowker, Diane M.; Saris-Baglama, Renee N.; DeRosa, Michael A.; Paulsen, Christine A.; Bransfield, Christopher P.

2009-01-01

Background Qualitative research can inform the development of asthma patient-reported outcome (PRO) measures and user-friendly technologies through defining measurement constructs, identifying potential limitations in measurement and sources of response error, and evaluating usability. Objective The goal of the current study was to inform the development of a comprehensive asthma PRO assessment with input from patients and clinical experts. Method Self-reported adult asthma sufferers recruited from a 3,000 member New England-area research panel participated in either one of three focus groups (N=21) or individual cognitive item debriefing interviews (N=20) to discuss how asthma impacts their health-related quality of life (HRQOL), and provide feedback on a preliminary set of asthma impact survey items and prototype patient report. Focus groups and cognitive interviews were conducted using traditional research principles (e.g., semi-structured interview guide, probing, and think aloud techniques). An Expert Advisory Panel (N=12) including asthma clinical specialists and measurement professionals was convened to review results from the focus group and cognitive interview studies and make recommendations for final survey and report development. Results Domains of health impacted by asthma included physical (recreation, play, competitive sports, and exercise), social (activities, family relationships), emotional (anger, upset, frustration, anxiety, worry), sleep, role (recreational/leisure activities; work), and sexual functioning. Most items in the impact survey were easily understood, covered important content, and included relevant response options. Items with contradictory examples and multiple concepts were difficult to comprehend. Suggestions were made to expand survey content by including additional items on physical and sexual functioning, sleep, self-consciousness, stigma, and finances. Reports were considered useful and participants saw value in sharing the results with their doctor. Graphic presentation of scores was not always understood; participants preferred tabular presentation of score levels with associated interpretative text. Display of inverse scores for different measures (higher scores equaling better health on one scale and worse health on another) shown on a single page was confusing. The score history section of the report was seen as helpful for monitoring progress over time, particularly for those recently diagnosed with asthma. Expert panelists agreed that displaying inverse scores in a single summary report may be confusing to patients and providers. They also stressed the importance of comprehensive interpretation guidelines for patients, with an emphasis on what they should do next based on scores. Panelists made recommendations for provider and aggregate-level reports (e.g., “red flags” to indicate significant score changes or cut-points of significance; identification of subgroups that have scored poorly or recently gotten worse). Conclusion Incorporating input from patients, clinicians, and measurement experts in the early stages of product development should improve the construct validity of this PRO measure and enhance its practical application in healthcare. PMID:20508735

[Development of Autogenic Training Clinical Effectiveness Scale (ATCES)].

PubMed

Ikezuki, Makoto; Miyauchi, Yuko; Yamaguchi, Hajime; Koshikawa, Fusako

2002-02-01

The purpose of the present study was to develop a scale measuring clinical effectiveness of autogenic training. In Study 1, 167 undergraduates completed a survey of items concerning physical and mental states, which were thought to vary in the course of autogenic training. With item and factor analyses, 20 items were selected, and the resulting scale (ATCES) had high discrimination and clear factor structure. In Study 2, reliability and concurrent and clinical validity of the scale were examined with three groups of respondents: 85 mentally healthy, 31 control, 13 clinical persons. The scale showed a high test-retest correlation (r = .83) and alpha coefficient (alpha = .86). ATCES had a Pearson correlation coefficient of r = .56 with General Health Questionnaire (GHQ-12), and r = .73 with trait anxiety (STAI-T). And ATCES successfully discriminated the mentally healthy and clinical groups in terms of clinical effectiveness. These results demonstrated high reliability and sufficient concurrent and clinical validity of the new scale.

College Students' Responses to Kanakun and Kantaro.

ERIC Educational Resources Information Center

Inoue, Fumiko

1998-01-01

Japanese learners must acquire three sets of orthographic characters (Hiragana, Katakana, and Kanji). Computerized programs were developed to facilitate learners' acquisition of Japanese characters and vocabulary items. Surveys of college students in first-, second-, and third-year Japanese courses examined their feelings about the programs. The…

Development and validation of the Bullying and Cyberbullying Scale for Adolescents: A multi-dimensional measurement model.

PubMed

Thomas, Hannah J; Scott, James G; Coates, Jason M; Connor, Jason P

2018-05-03

Intervention on adolescent bullying is reliant on valid and reliable measurement of victimization and perpetration experiences across different behavioural expressions. This study developed and validated a survey tool that integrates measurement of both traditional and cyber bullying to test a theoretically driven multi-dimensional model. Adolescents from 10 mainstream secondary schools completed a baseline and follow-up survey (N = 1,217; M age  = 14 years; 66.2% male). The Bullying and cyberbullying Scale for Adolescents (BCS-A) developed for this study comprised parallel victimization and perpetration subscales, each with 20 items. Additional measures of bullying (Olweus Global Bullying and the Forms of Bullying Scale [FBS]), as well as measures of internalizing and externalizing problems, school connectedness, social support, and personality, were used to further assess validity. Factor structure was determined, and then, the suitability of items was assessed according to the following criteria: (1) factor interpretability, (2) item correlations, (3) model parsimony, and (4) measurement equivalence across victimization and perpetration experiences. The final models comprised four factors: physical, verbal, relational, and cyber. The final scale was revised to two 13-item subscales. The BCS-A demonstrated acceptable concurrent and convergent validity (internalizing and externalizing problems, school connectedness, social support, and personality), as well as predictive validity over 6 months. The BCS-A has sound psychometric properties. This tool establishes measurement equivalence across types of involvement and behavioural forms common among adolescents. An improved measurement method could add greater rigour to the evaluation of intervention programmes and also enable interventions to be tailored to subscale profiles. © 2018 The British Psychological Society.

Goal orientation in surgical residents: a study of the motivation behind learning.

PubMed

Hoffman, Rebecca L; Hudak-Rosander, Cristina; Datta, Jashodeep; Morris, Jon B; Kelz, Rachel R

2014-08-01

The subconscious way in which an individual approaches learning, goal orientation (GO), has been shown to influence job satisfaction, job performance, and burnout in nonmedical cohorts. The aim of this study was to adapt and validate an instrument to assess GO in surgical residents, so that in the future, we can better understand how differences in motivation affect professional development. Residents were recruited to complete a 17-item survey adapted from the Patterns of Adaptive Learning Scales (PALS). The survey included three scales assessing GO in residency-specific terms. Items were scored on a 5-point Likert scale, and the psychometric properties of the adapted and original PALS were compared. Ninety-five percent of residents (61/64) participated. Median age was 30 y and 33% were female. Mean (standard deviation) scale scores for the adapted PALS were: mastery 4.30 (0.48), performance approach (PAP) 3.17 (0.99), and performance avoid 2.75 (0.88). Mean (standard deviation) scale scores for the original PALS items were: mastery 3.35 (1.02), PAP 2.76 (1.15), and performance avoid 2.41 (0.91). Cronbach alpha were α = 0.89 and α = 0.84 for the adapted PAP and avoid scales, respectively, which were comparable with the original scales. For the adapted mastery scale, α = 0.54. Exploratory factor analysis revealed five factors, and factor loadings for individual mastery items did not load consistently onto a single factor. This study represents the first steps in the development of a novel tool to measure GO among surgical residents. Understanding motivational psychology in residents may facilitate improved education and professional development. Copyright © 2014 Elsevier Inc. All rights reserved.

Using Cognitive Testing to Develop Items for Surveying Asian American Cancer Patients and Their Caregivers as a Pathway to Culturally Competent Care.

PubMed

Bolcic-Jankovic, Dragana; Lu, Fengxin; Colten, Mary Ellen; McCarthy, Ellen P

2016-02-01

We report the results from cognitive interviews with Asian American patients and their caregivers. We interviewed seven caregivers and six patients who were all bilingual Asian Americans. The main goal of the cognitive interviews was to test a survey instrument developed for a study about perspectives of Asian American patients with advanced cancer who are facing decisions around end-of-life care. We were particularly interested to see whether items commonly used in White and Black populations are culturally meaningful and equivalent in Asian populations, primarily those of Chinese and Vietnamese ethnicity. Our exploration shows that understanding respondents' language proficiency, degree of acculturation, and cultural context of receiving, processing, and communicating information about medical care can help design questions that are appropriate for Asian American patients and caregivers, and therefore can help researchers obtain quality data about the care Asian American cancer patients receive. © The Author(s) 2016.

Development of the AGREE II, part 2: assessment of validity of items and tools to support application

PubMed Central

Brouwers, Melissa C.; Kho, Michelle E.; Browman, George P.; Burgers, Jako S.; Cluzeau, Françoise; Feder, Gene; Fervers, Béatrice; Graham, Ian D.; Hanna, Steven E.; Makarski, Julie

2010-01-01

Background We established a program of research to improve the development, reporting and evaluation of practice guidelines. We assessed the construct validity of the items and user’s manual in the β version of the AGREE II. Methods We designed guideline excerpts reflecting high-and low-quality guideline content for 21 of the 23 items in the tool. We designed two study packages so that one low-quality and one high-quality version of each item were randomly assigned to each package. We randomly assigned 30 participants to one of the two packages. Participants reviewed and rated the guideline content according to the instructions of the user’s manual and completed a survey assessing the manual. Results In all cases, content designed to be of high quality was rated higher than low-quality content; in 18 of 21 cases, the differences were significant (p < 0.05). The manual was rated by participants as appropriate, easy to use, and helpful in differentiating guidelines of varying quality, with all scores above the mid-point of the seven-point scale. Considerable feedback was offered on how the items and manual of the β-AGREE II could be improved. Interpretation The validity of the items was established and the user’s manual was rated as highly useful by users. We used these results and those of our study presented in part 1 to modify the items and user’s manual. We recommend AGREE II (available at www.agreetrust.org) as the revised standard for guideline development, reporting and evaluation. PMID:20513779

Factoring handedness data: I. Item analysis.

PubMed

Messinger, H B; Messinger, M I

1995-12-01

Recently in this journal Peters and Murphy challenged the validity of factor analyses done on bimodal handedness data, suggesting instead that right- and left-handers be studied separately. But bimodality may be avoidable if attention is paid to Oldfield's questionnaire format and instructions for the subjects. Two characteristics appear crucial: a two-column LEFT-RIGHT format for the body of the instrument and what we call Oldfield's Admonition: not to indicate strong preference for handedness item, such as write, unless "... the preference is so strong that you would never try to use the other hand unless absolutely forced to...". Attaining unimodality of an item distribution would seem to overcome the objections of Peters and Murphy. In a 1984 survey in Boston we used Oldfield's ten-item questionnaire exactly as published. This produced unimodal item distributions. With reflection of the five-point item scale and a logarithmic transformation, we achieved a degree of normalization for the items. Two surveys elsewhere based on Oldfield's 20-item list but with changes in the questionnaire format and the instructions, yielded markedly different item distributions with peaks at each extreme and sometimes in the middle as well.

Making sense of sexual orientation measures: findings from a cognitive processing study with adolescents on health survey questions.

PubMed

Austin, S Bryn; Conron, Kerith; Patel, Aarti; Freedner, Naomi

2007-01-01

To carry out a study using cognitive processing interview methods to explore ways in which adolescents understand sexual orientation questions currently used on epidemiologic surveys. In-depth, individual interviews were conducted to probe cognitive processes involved in answering four self-report survey questions assessing sexual identity, sexual attraction, and sex of sexual partners.A semi-structured interview guide was used to explore variation in question interpretation, information retrieval patterns and problems, item clarity, valence of reactions to items (positive, negative, neutral), respondent burden, and perceived threat associated with the measures. Thirty adolescents aged 15 to 21 of diverse sexual orientations and race/ethnicities participated in the study, including female, male, and transgender youth. A question on sexual attraction was the most consistently understood and thus was easy for nearly all youth to answer. In contrast, a measure of sexual identity with options heterosexual, bisexual, gay/lesbian, and unsure was the most difficult to answer. Most preferred a sexual identity item that also provided the intermediate options mostly heterosexual and mostly homosexual, which many said reflected their experience of feeling between categories. Participants had varying and inconsistent interpretations of sexual behavior terms, such as sex and sexual intercourse, used in assessing the sex of sexual partners. Differences in understanding could affect interpretation of survey data in important ways. Development of valid measures of sexual orientation will be essential to better monitor health disparities.

Adaptive Measurement of Well-Being: Maximizing Efficiency and Optimizing User Experience during Individual Assessment

PubMed Central

Kraatz, Miriam; Coberley, Carter R.; Pope, James E.

2016-01-01

Abstract Well-being is linked to important societal factors such as health care costs and productivity and has experienced a surge in development activity of both theories and measurement. This study builds on validation of the Well-Being 5 survey and for the first time applies Item Response Theory, a modern and flexible measurement paradigm, to form the basis of adaptive population well-being measurement. Adaptive testing allows survey questions to be administered selectively, thereby reducing the number of questions required of the participant. After the graded response model was fit to a sample of size N = 12,035, theta scores were estimated based on both the full-item bank and a simulation of Computerized Adaptive Testing (CAT). Comparisons of these 2 sets of score estimates with each other and of their correlations with external outcomes of job performance, absenteeism, and hospital admissions demonstrate that the CAT well-being scores maintain accuracy and validity. The simulation indicates that the average survey taker can expect a reduction in number of items administered during the CAT process of almost 50%. An increase in efficiency of this extent is of considerable value because of the time savings during the administration of the survey and the potential improvement of user experience, which in turn can help secure the success of a total population-based well-being improvement program. (Population Health Management 2016;19:284–290) PMID:26674396

Development and validation of the Perceived Food Environment Questionnaire in a French-Canadian population.

PubMed

Carbonneau, Elise; Robitaille, Julie; Lamarche, Benoît; Corneau, Louise; Lemieux, Simone

2017-08-01

The present study aimed to develop and validate a questionnaire assessing perceived food environment in a French-Canadian population. A questionnaire, the Perceived Food Environment Questionnaire, was developed assessing perceived accessibility to healthy (nine items) and unhealthy foods (three items). A pre-test sample was recruited for a pilot testing of the questionnaire. For the validation study, another sample was recruited and completed the questionnaire twice. Exploratory factor analysis was performed on the items to assess the number of factors (subscales). Cronbach's α was used to measure internal consistency reliability. Test-retest reliability was assessed with Pearson correlations. Online survey. Men and women from the Québec City area (n 31 in the pre-test sample; n 150 in the validation study sample). The pilot testing did not lead to any change in the questionnaire. The exploratory factor analysis revealed a two-subscale structure. The first subscale is composed of six items assessing accessibility to healthy foods and the second includes three items related to accessibility to unhealthy foods. Three items were removed from the questionnaire due to low loading on the two subscales. The subscales demonstrated adequate internal consistency (Cronbach's α=0·77 for healthy foods and 0·62 for unhealthy foods) and test-retest reliability (r=0·59 and 0·60, respectively; both P<0·0001). The Perceived Food Environment Questionnaire was developed for a French-Canadian population and demonstrated good psychometric properties. Further validation is recommended if the questionnaire is to be used in other populations.

Development and validation of a nutrition knowledge questionnaire for a Canadian population.

PubMed

Bradette-Laplante, Maude; Carbonneau, Élise; Provencher, Véronique; Bégin, Catherine; Robitaille, Julie; Desroches, Sophie; Vohl, Marie-Claude; Corneau, Louise; Lemieux, Simone

2017-05-01

The present study aimed to develop and validate a nutrition knowledge questionnaire in a sample of French Canadians from the province of Quebec, taking into account dietary guidelines. A thirty-eight-item questionnaire was developed by the research team and evaluated for content validity by an expert panel, and then administered to respondents. Face validity and construct validity were measured in a pre-test. Exploratory factor analysis and covariance structure analysis were performed to verify the structure of the questionnaire and identify problematic items. Internal consistency and test-retest reliability were evaluated through a validation study. Online survey. Six nutrition and psychology experts, fifteen registered dietitians (RD) and 180 lay people participated. Content validity evaluation resulted in the removal of two items and reformulation of one item. Following face validity, one item was reformulated. Construct validity was found to be adequate, with higher scores for RD v. non-RD (21·5 (sd 2·1) v. 15·7 (sd 3·0) out of 24, P<0·001). Exploratory factor analysis revealed that the questionnaire contained only one factor. Covariance structure analysis led to removal of sixteen items. Internal consistency for the overall questionnaire was adequate (Cronbach's α=0·73). Assessment of test-retest reliability resulted in significant associations for the total knowledge score (r=0·59, P<0·001). This nutrition knowledge questionnaire was found to be a suitable instrument which can be used to measure levels of nutrition knowledge in a Canadian population. It could also serve as a model for the development of similar instruments in other populations.

Content validity of governing in Building Information Modelling (BIM) implementation assessment instrument

NASA Astrophysics Data System (ADS)

Hadzaman, N. A. H.; Takim, R.; Nawawi, A. H.; Mohamad Yusuwan, N.

2018-04-01

BIM governance assessment instrument is a process of analysing the importance in developing BIM governance solution to tackle the existing problems during team collaboration in BIM-based projects. Despite the deployment of integrative technologies in construction industry particularly BIM, it is still insufficient compare to other sectors. Several studies have been established the requirements of BIM implementation concerning all technical and non-technical BIM adoption issues. However, the data are regarded as inadequate to develop a BIM governance framework. Hence, the objective of the paper is to evaluate the content validity of the BIM governance instrument prior to the main data collection. Two methods were employed in the form of literature review and questionnaire survey. Based on the literature review, 273 items with six main constructs are suggested to be incorporated in the BIM governance instrument. The Content Validity Ratio (CVR) scores revealed that 202 out of 273 items are considered as the utmost critical by the content experts. The findings for Item Level Content Validity Index (I-CVI) and Modified Kappa Coefficient however revealed that 257 items in BIM governance instrument are appropriate and excellent. The instrument is highly reliable for future strategies and the development of BIM projects in Malaysia.

Identifying patterns of item missing survey data using latent groups: an observational study

PubMed Central

McElwee, Paul; Nathan, Andrea; Burton, Nicola W; Turrell, Gavin

2017-01-01

Objectives To examine whether respondents to a survey of health and physical activity and potential determinants could be grouped according to the questions they missed, known as ‘item missing’. Design Observational study of longitudinal data. Setting Residents of Brisbane, Australia. Participants 6901 people aged 40–65 years in 2007. Materials and methods We used a latent class model with a mixture of multinomial distributions and chose the number of classes using the Bayesian information criterion. We used logistic regression to examine if participants’ characteristics were associated with their modal latent class. We used logistic regression to examine whether the amount of item missing in a survey predicted wave missing in the following survey. Results Four per cent of participants missed almost one-fifth of the questions, and this group missed more questions in the middle of the survey. Eighty-three per cent of participants completed almost every question, but had a relatively high missing probability for a question on sleep time, a question which had an inconsistent presentation compared with the rest of the survey. Participants who completed almost every question were generally younger and more educated. Participants who completed more questions were less likely to miss the next longitudinal wave. Conclusions Examining patterns in item missing data has improved our understanding of how missing data were generated and has informed future survey design to help reduce missing data. PMID:29084795

Stakeholder opinion of functional communication activities following traumatic brain injury.

PubMed

Larkins, B M; Worrall, L E; Hickson, L M

2004-07-01

To establish a process whereby assessment of functional communication reflects the authentic communication of the target population. The major functional communication assessments available from the USA may not be as relevant to those who reside elsewhere, nor assessments developed primarily for persons who have had a stroke as relevant for traumatic brain injury rehabilitation. The investigation used the Nominal Group Technique to elicit free opinion and support individuals who have compromised communication ability. A survey mailed out sampled a larger number of stakeholders to test out differences among groups. Five stakeholder groups generated items and the survey determined relative 'importance'. The stakeholder groups in both studies comprised individuals with traumatic brain injury and their families, health professionals, third-party payers, employers, and Maori, the indigenous population of New Zealand. There was no statistically significant difference found between groups for 19 of the 31 items. Only half of the items explicitly appear on a well-known USA functional communication assessment. The present study has implications for whether functional communication assessments are valid across cultures and the type of impairment.

Methods and Processes of Developing the Strengthening the Reporting of Observational Studies in Epidemiology - Veterinary (STROBE-Vet) Statement.

PubMed

Sargeant, J M; O'Connor, A M; Dohoo, I R; Erb, H N; Cevallos, M; Egger, M; Ersbøll, A K; Martin, S W; Nielsen, L R; Pearl, D L; Pfeiffer, D U; Sanchez, J; Torrence, M E; Vigre, H; Waldner, C; Ward, M P

2016-12-01

The reporting of observational studies in veterinary research presents many challenges that often are not adequately addressed in published reporting guidelines. A consensus meeting of experts was organized to develop an extension of the STROBE statement to address observational studies in veterinary medicine with respect to animal health, animal production, animal welfare and food safety outcomes. The consensus meeting was held 11-13 May 2014 in Mississauga, Ontario, Canada. Seventeen experts from North America, Europe and Australia attended the meeting. The experts were epidemiologists and biostatisticians, many of whom hold or have held editorial positions with relevant journals. Prior to the meeting, 19 experts completed a survey about whether they felt any of the 22 items of the STROBE statement should be modified and whether items should be added to address unique issues related to observational studies in animal species with health, production, welfare or food safety outcomes. At the meeting, the participants were provided with the survey responses and relevant literature concerning the reporting of veterinary observational studies. During the meeting, each STROBE item was discussed to determine whether or not re-wording was recommended, and whether additions were warranted. Anonymous voting was used to determine whether there was consensus for each item change or addition. The consensus was that six items needed no modifications or additions. Modifications or additions were made to the STROBE items numbered as follows: 1 (title and abstract), 3 (objectives), 5 (setting), 6 (participants), 7 (variables), 8 (data sources/measurement), 9 (bias), 10 (study size), 12 (statistical methods), 13 (participants), 14 (descriptive data), 15 (outcome data), 16 (main results), 17 (other analyses), 19 (limitations) and 22 (funding). Published literature was not always available to support modification to, or inclusion of, an item. The methods and processes used in the development of this statement were similar to those used for other extensions of the STROBE statement. The use of this extension to the STROBE statement should improve the reporting of observational studies in veterinary research related to animal health, production, welfare or food safety outcomes by recognizing the unique features of observational studies involving food-producing and companion animals, products of animal origin, aquaculture and wildlife. © 2016 The Authors. Zoonoses and Public Health published by Blackwell Verlag GmbH.

Measuring Constructs in Family Science: How Can Item Response Theory Improve Precision and Validity?

PubMed Central

Gordon, Rachel A.

2014-01-01

This article provides family scientists with an understanding of contemporary measurement perspectives and the ways in which item response theory (IRT) can be used to develop measures with desired evidence of precision and validity for research uses. The article offers a nontechnical introduction to some key features of IRT, including its orientation toward locating items along an underlying dimension and toward estimating precision of measurement for persons with different levels of that same construct. It also offers a didactic example of how the approach can be used to refine conceptualization and operationalization of constructs in the family sciences, using data from the National Longitudinal Survey of Youth 1979 (n = 2,732). Three basic models are considered: (a) the Rasch and (b) two-parameter logistic models for dichotomous items and (c) the Rating Scale Model for multicategory items. Throughout, the author highlights the potential for researchers to elevate measurement to a level on par with theorizing and testing about relationships among constructs. PMID:25663714

Development and validation of competencies for return to work coordinators.

PubMed

Pransky, Glenn; Shaw, William S; Loisel, Patrick; Hong, Quan Nha; Désorcy, Bruno

2010-03-01

Return to work (RTW) coordinators are a key element in programs that facilitate RTW of injured or ill workers, yet little research documents the competencies required for success in this role. Competencies were defined as knowledge, skills, attitudes, and behaviors. Eight focus groups were conducted with 75 experienced RTW coordinators to identify 904 individual competencies. These were subsequently reduced to 234 unique items through affinity mapping, and sorted into eight groups: administration, individual personal attributes, information gathering, communication, professional credibility, evaluation, problem-solving, and conflict management. A subset of 100 items, including 88 items most often cited, were incorporated in an Internet-based survey that sampled a broad range of RTW coordinators from three countries. Eighty-three of the questionnaire items were rated 4 or 5 (very important or essential) by over half of the 148 respondents. There were no differences in affinity group mean ratings by country, employer, profession, or type of clients. The highest-rated items reflect general personal characteristics, or specific skills related to coordinating among all involved with the RTW process. RTW coordinators with nursing backgrounds provided slightly higher ratings for items related to medical knowledge, but otherwise their ratings were similar to non-nurses. These findings indicate a consensus across a wide range of RTW coordinators, and results can be applied to improve coordinator selection, training, and development. Certain key competencies may be well-established individual attributes, and others may be best developed through mentorship. Most of these competencies are probably best evaluated by direct observation.

Workforce Perceptions of Hospital Safety Culture: Development and Validation of the Patient Safety Climate in Healthcare Organizations Survey

PubMed Central

Singer, Sara; Meterko, Mark; Baker, Laurence; Gaba, David; Falwell, Alyson; Rosen, Amy

2007-01-01

Objective To describe the development of an instrument for assessing workforce perceptions of hospital safety culture and to assess its reliability and validity. Data Sources/Study Setting Primary data collected between March 2004 and May 2005. Personnel from 105 U.S. hospitals completed a 38-item paper and pencil survey. We received 21,496 completed questionnaires, representing a 51 percent response rate. Study Design Based on review of existing safety climate surveys, we developed a list of key topics pertinent to maintaining a culture of safety in high-reliability organizations. We developed a draft questionnaire to address these topics and pilot tested it in four preliminary studies of hospital personnel. We modified the questionnaire based on experience and respondent feedback, and distributed the revised version to 42,249 hospital workers. Data Collection We randomly divided respondents into derivation and validation samples. We applied exploratory factor analysis to responses in the derivation sample. We used those results to create scales in the validation sample, which we subjected to multitrait analysis (MTA). Principal Findings We identified nine constructs, three organizational factors, two unit factors, three individual factors, and one additional factor. Constructs demonstrated substantial convergent and discriminant validity in the MTA. Cronbach's α coefficients ranged from 0.50 to 0.89. Conclusions It is possible to measure key salient features of hospital safety climate using a valid and reliable 38-item survey and appropriate hospital sample sizes. This instrument may be used in further studies to better understand the impact of safety climate on patient safety outcomes. PMID:17850530

Safety climate in Swiss hospital units: Swiss version of the Safety Climate Survey

PubMed Central

Gehring, Katrin; Mascherek, Anna C.; Bezzola, Paula

2015-01-01

Abstract Rationale, aims and objectives Safety climate measurements are a broadly used element of improvement initiatives. In order to provide a sound and easy‐to‐administer instrument for the use in Swiss hospitals, we translated the Safety Climate Survey into German and French. Methods After translating the Safety Climate Survey into French and German, a cross‐sectional survey study was conducted with health care professionals (HCPs) in operating room (OR) teams and on OR‐related wards in 10 Swiss hospitals. Validity of the instrument was examined by means of Cronbach's alpha and missing rates of the single items. Item‐descriptive statistics group differences and percentage of ‘problematic responses’ (PPR) were calculated. Results 3153 HCPs completed the survey (response rate: 63.4%). 1308 individuals were excluded from the analyses because of a profession other than doctor or nurse or invalid answers (n = 1845; nurses = 1321, doctors = 523). Internal consistency of the translated Safety Climate Survey was good (Cronbach's alpha G erman = 0.86; Cronbach's alpha F rench = 0.84). Missing rates at item level were rather low (0.23–4.3%). We found significant group differences in safety climate values regarding profession, managerial function, work area and time spent in direct patient care. At item level, 14 out of 21 items showed a PPR higher than 10%. Conclusions Results indicate that the French and German translations of the Safety Climate Survey might be a useful measurement instrument for safety climate in Swiss hospital units. Analyses at item level allow for differentiating facets of safety climate into more positive and critical safety climate aspects. PMID:25656302

Validity and reliability of survey items and pictograms for use in a national household survey of tobacco use in Cambodia.

PubMed

Singh, Pramil N; Khieng, Sothy; Yel, Daravuth; Nguyen, Duc; Job, Jayakaran S

2013-09-01

The validity of survey measures of smoked and smokeless tobacco use in the Western Pacific Region is often unknown. We conducted a validation study (n = 201) in a random sample of rural adults in Cambodia. A comparison with salivary cotinine indicated (1) that survey items and pictograms of current tobacco use had an 87% (95% confidence interval [CI] = 78%-93%) sensitivity, 94% specificity (95% CI = 87%-98%), and 93% (95% CI = 85%-97%) positive predictive value in detecting cotinine levels >10 ng/mL; (2) a positive correlation with number of cigarettes smoked (R = 0.34; P = .01); and (3) a positive correlation with the amount of tobacco chewed (R = 0.44; P = .02). The validity of the index for the amount of smokeless tobacco used was enhanced by adding to the index the data from pictograms that were utilized to help participants estimate the amount of loose tobacco used per session. These tobacco items and pictograms were found to have excellent reliability (κ = 0.80-1) over 2 to 3 weeks. Interviewer-administered survey items and pictograms can provide an accurate, quantitative measure of smoked and smokeless tobacco use in rural Cambodia.

Brief assessment of food insecurity accurately identifies high-risk US adults.

PubMed

Gundersen, Craig; Engelhard, Emily E; Crumbaugh, Amy S; Seligman, Hilary K

2017-06-01

To facilitate the introduction of food insecurity screening into clinical settings, we examined the test performance of two-item screening questions for food insecurity against the US Department of Agriculture's Core Food Security Module. We examined sensitivity, specificity and accuracy of various two-item combinations of questions assessing food insecurity in the general population and high-risk population subgroups. 2013 Current Population Survey December Supplement, a population-based US survey. All survey participants from the general population and high-risk subgroups. The test characteristics of multiple two-item combinations of questions assessing food insecurity had adequate sensitivity (>97 %) and specificity (>70 %) for widespread adoption as clinical screening measures. We recommend two specific items for clinical screening programmes based on their widespread current use and high sensitivity for detecting food insecurity. These items query how often the household 'worried whether food would run out before we got money to buy more' and how often 'the food that we bought just didn't last and we didn't have money to get more'. The recommended items have sensitivity across high-risk population subgroups of ≥97 % and a specificity of ≥74 % for food insecurity.

An instrument to measure job satisfaction of nursing home administrators

PubMed Central

Castle, Nicholas G

2006-01-01

Background The psychometric properties of the nursing home administrator job satisfaction questionnaire (NHA-JSQ) are presented, and the steps used to develop this instrument. Methods The NHA-JSQ subscales were developed from pilot survey activities with 93 administrators, content analysis, and a research panel. The resulting survey was sent to 1,000 nursing home administrators. Factor analyses were used to determine the psychometric properties of the instrument. Results Of the 1,000 surveys mailed, 721 usable surveys were returned (72 percent response rate). The factor analyses show that the items were representative of six underlying factors (i.e., coworkers, work demands, work content, work load, work skills, and rewards). Conclusion The NHA-JSQ represents a short, psychometrically sound job satisfaction instrument for use in nursing homes. PMID:17029644

[Information transmission to the community pharmacist after a patient's discharge from the hospital: setting up of a written medication discharge form, prospective evaluation of its impact, and survey of the information needs of the pharmacists].

PubMed

Claeys, C; Dufrasne, M; De Vriese, C; Nève, J; Tulkens, P M; Spinewine, A

2015-03-01

Discharge from the hospital is a period at risk for the continuity of patient's medication (seamless pharmaceutical care). The community pharmacist is often the first health care professional seen by the patient after hospital discharge. The clinical pharmacist has potentially a key role in establishing an efficient information transfer from the hospital to the community pharmacy. (1) To develop and, (2) to evaluate the impact of a structured discharge medication form prepared at hospital discharge by the clinical pharmacist and containing information items related to the medication regimen for the community pharmacist, and (3) to survey the information needs of the Belgian community pharmacists to ensure continuity of care after hospitalization. (1) A structured discharge medication form has been developed based on a Literature review and on opinions expressed by community and clinical pharmacists, members of the Belgian Pharmaceutical Union (Association Pharmaceutique Belge) and an ethical committee. (2) A prospective study has been conducted with patients from geriatrics and orthopaedics wards of the University Hospital Dinant-Godinne returning home after hospital discharge with the discharge medication form to be given to their commuiity pharmacist; its use, the reasons for non-use, the perceived impact and the satisfaction of the community pharmacist have been assessed. (3) An on-line survey addressed to all Belgian community pharmacists evaluated their information needs. (1) The final version of the discharge medication form included key information items concerning the hospital, the patient, the discharge treatment (including the type of modifications made as compared to medications taken before admission), and on medication management at home. Some items were excluded because of Lack of perceived utility by pharmacists, confidentiality issues, and respect of patient's freedom of choice. (2) From the 71 medication forms given to patients, 48 were received by the community pharmacist. One quarter of respondents stated that they did not use the form, the main reason being that it was received after dispensing of the discharge treatment (n=6/11). The majority of the community pharmacists considered most of the information items as useful and the discharge medication form as being valuable for continuity of care. Requests for additional information were made (e.g., reason of admission and of treatment modifications, etc.). (3) The utility, benefits, and need for additional information items beyond what was included in the discharge medication form were highlighted by the respondents (n=309) of the national survey. Most of these respondents confirmed the value of the different information items included in the discharge medication form. The transmission of a structured medication form containing information about the medication regimen upon hospital discharge is of real interest and value for the community pharmacist because it goes beyond what is usually provided on a medical prescription. However, this discharge medication form should include more information items for effective pharmaceutical care.

The failing measurement of attitudes: How semantic determinants of individual survey responses come to replace measures of attitude strength.

PubMed

Arnulf, Jan Ketil; Larsen, Kai Rune; Martinsen, Øyvind Lund; Egeland, Thore

2018-01-12

The traditional understanding of data from Likert scales is that the quantifications involved result from measures of attitude strength. Applying a recently proposed semantic theory of survey response, we claim that survey responses tap two different sources: a mixture of attitudes plus the semantic structure of the survey. Exploring the degree to which individual responses are influenced by semantics, we hypothesized that in many cases, information about attitude strength is actually filtered out as noise in the commonly used correlation matrix. We developed a procedure to separate the semantic influence from attitude strength in individual response patterns, and compared these results to, respectively, the observed sample correlation matrices and the semantic similarity structures arising from text analysis algorithms. This was done with four datasets, comprising a total of 7,787 subjects and 27,461,502 observed item pair responses. As we argued, attitude strength seemed to account for much information about the individual respondents. However, this information did not seem to carry over into the observed sample correlation matrices, which instead converged around the semantic structures offered by the survey items. This is potentially disturbing for the traditional understanding of what survey data represent. We argue that this approach contributes to a better understanding of the cognitive processes involved in survey responses. In turn, this could help us make better use of the data that such methods provide.

Development of short-form and screening cutoff point of the Smartphone Addiction Inventory (SPAI-SF).

PubMed

Lin, Yu-Hsuan; Pan, Yuan-Chien; Lin, Sheng-Hsuan; Chen, Sue-Huei

2017-06-01

Smartphone addiction is considered a form of technological addiction that has attracted increasing attention. The present study developed and validated the short-form Smartphone Addiction Inventory (SPAI-SF) and established cutoff point for screening smartphone addiction based on diagnostic criteria established by psychiatric interview. A total of 268 participants completed an online survey that collected demographic data, smartphone use behaviours, and responses to the 26-item SPAI. Each participant also completed a psychiatric interview. Confirmatory factor analysis (CFA) revealed that the 10-item SPAI-SF replicated the structure of original 26-item SPAI accurately, yielding a four-factor model consisting of compulsive behaviour, functional impairment, withdrawal, and tolerance. For maximal diagnostic accuracy, a cutoff point of 24/25 best discriminated cases of smartphone addiction from diagnostic negatives. The present findings suggest that both the 26-item SPAI and SPAI-SF manifest the four constructs of behavioural addiction and the characteristics of smartphone addiction. The cutoff point determined by psychiatrists' diagnostic interview will be useful for clinical screening and epidemiologic research. Copyright © 2016 John Wiley & Sons, Ltd.

Understanding the Areas and Correlates of Diabetes-Related Distress in Parents of Teens With Type 1 Diabetes.

PubMed

Hessler, Danielle; Fisher, Lawrence; Polonsky, William; Johnson, Nicole

2016-08-01

To identify the unique areas of diabetes-related distress (DD) for parents of teens with type 1 diabetes and parent and teen characteristics associated with DD. Areas of DD were developed from structured interviews and translated into 46 survey items. Items were analyzed with exploratory factor analysis (EFA). An EFA with 332 parents (88% mothers) reduced items to four Parent Diabetes Distress Scale (PDDS) factors (20 items, α = .94): Personal, Teen Management, Parent/Teen Relationship, and Healthcare Team Distress. Parent DD was higher among fathers, younger or single parents, parents of teens with higher hemoglobin A1c or severe low blood glucose levels, authoritarian parenting, depressive symptoms, and low emotional support. 4 areas of parent DD were identified using a newly developed measure, the PDDS. DD was associated with family demographic, teen diabetes status, and parent contextual factors, and can help identify parents who may be more vulnerable to DD. © The Author 2016. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Development of a traffic control devices and pavement markings manual for Iowa's cities and counties with a survey of common practices.

DOT National Transportation Integrated Search

2001-04-01

Local transportation agencies are responsible for a significant investment in traffic control : devices and pavement markings. Thousands of signs and other inventory items, equipment, : facilities, and staff are all dedicated to the installation and ...

Development and content validation of the information assessment method for patients and consumers.

PubMed

Pluye, Pierre; Granikov, Vera; Bartlett, Gillian; Grad, Roland M; Tang, David L; Johnson-Lafleur, Janique; Shulha, Michael; Barbosa Galvão, Maria Cristiane; Ricarte, Ivan Lm; Stephenson, Randolph; Shohet, Linda; Hutsul, Jo-Anne; Repchinsky, Carol A; Rosenberg, Ellen; Burnand, Bernard; Légaré, France; Dunikowski, Lynn; Murray, Susan; Boruff, Jill; Frati, Francesca; Kloda, Lorie; Macaulay, Ann; Lagarde, François; Doray, Geneviève

2014-02-18

Online consumer health information addresses health problems, self-care, disease prevention, and health care services and is intended for the general public. Using this information, people can improve their knowledge, participation in health decision-making, and health. However, there are no comprehensive instruments to evaluate the value of health information from a consumer perspective. We collaborated with information providers to develop and validate the Information Assessment Method for all (IAM4all) that can be used to collect feedback from information consumers (including patients), and to enable a two-way knowledge translation between information providers and consumers. Content validation steps were followed to develop the IAM4all questionnaire. The first version was based on a theoretical framework from information science, a critical literature review and prior work. Then, 16 laypersons were interviewed on their experience with online health information and specifically their impression of the IAM4all questionnaire. Based on the summaries and interpretations of interviews, questionnaire items were revised, added, and excluded, thus creating the second version of the questionnaire. Subsequently, a panel of 12 information specialists and 8 health researchers participated in an online survey to rate each questionnaire item for relevance, clarity, representativeness, and specificity. The result of this expert panel contributed to the third, current, version of the questionnaire. The current version of the IAM4all questionnaire is structured by four levels of outcomes of information seeking/receiving: situational relevance, cognitive impact, information use, and health benefits. Following the interviews and the expert panel survey, 9 questionnaire items were confirmed as relevant, clear, representative, and specific. To improve readability and accessibility for users with a lower level of literacy, 19 items were reworded and all inconsistencies in using a passive or active voice have been solved. One item was removed due to redundancy. The current version of the IAM4all questionnaire contains 28 items. We developed and content validated the IAM4all in partnership with information providers, information specialists, researchers and representatives of information consumers. This questionnaire can be integrated within electronic knowledge resources to stimulate users' reflection (eg, their intention to use information). We claim that any organization (eg, publishers, community organizations, or patient associations), can evaluate and improve their online consumer health information from a consumers' perspective using this method.

Translating and culturally adapting the shortened version of the Hospital Ethical Climate Survey (HECS-S) - retaining or modifying validated instruments.

PubMed

Pergert, Pernilla; Bartholdson, Cecilia; Wenemark, Marika; Lützén, Kim; Af Sandeberg, Margareta

2018-05-10

The Hospital Ethical Climate Survey (HECS) was developed in the USA and later shortened (HECS-S). HECS has previously been translated into Swedish and the aim of this study was to describe a process of translating and culturally adapting HECS-S and to develop a Swedish multi-professional version, relevant for paediatrics. Another aim was to describe decisions about retaining versus modifying the questionnaire in order to keep the Swedish version as close as possible to the original while achieving a good functional level and trustworthiness. In HECS-S, the respondents are asked to indicate the veracity of statements. In HECS and HECS-S the labels of the scale range from 'almost never true' to 'almost always true'; while the Swedish HECS labels range from 'never' to 'always'. The procedure of translating and culturally adapting the Swedish version followed the scientific structure of guidelines. Three focus group interviews and three cognitive interviews were conducted with healthcare professionals. Furthermore, descriptive data were used from a previous study with healthcare professionals (n = 89), employing a modified Swedish HECS. Decisions on retaining or modifying items were made in a review group. The Swedish HECS-S consists of 21 items including all 14 items from HECS-S and items added to develop a multi-professional version, relevant for paediatrics. The descriptive data showed that few respondents selected 'never' and 'always'. To obtain a more even distribution of responses and keep Swedish HECS-S close to HECS-S, the original labels were retained. Linguistic adjustments were made to retain the intended meaning of the original items. The word 'respect' was used in HECS-S with two different meanings and was replaced in one of these because participants were concerned that respecting patients' wishes implied always complying with them. The process of developing a Swedish HECS-S included decisions on whether to retain or modify. Only minor adjustments were needed to achieve a good functional level and trustworthiness although some items needed to be added. Adjustments made could be used to also improve the English HECS-S. The results shed further light on the need to continuously evaluate even validated instruments and adapt them before use.

Three nested randomized controlled trials of peer-only or multiple stakeholder group feedback within Delphi surveys during core outcome and information set development.

PubMed

Brookes, Sara T; Macefield, Rhiannon C; Williamson, Paula R; McNair, Angus G; Potter, Shelley; Blencowe, Natalie S; Strong, Sean; Blazeby, Jane M

2016-08-17

Methods for developing a core outcome or information set require involvement of key stakeholders to prioritise many items and achieve agreement as to the core set. The Delphi technique requires participants to rate the importance of items in sequential questionnaires (or rounds) with feedback provided in each subsequent round such that participants are able to consider the views of others. This study examines the impact of receiving feedback from different stakeholder groups, on the subsequent rating of items and the level of agreement between stakeholders. Randomized controlled trials were nested within the development of three core sets each including a Delphi process with two rounds of questionnaires, completed by patients and health professionals. Participants rated items from 1 (not essential) to 9 (absolutely essential). For round 2, participants were randomized to receive feedback from their peer stakeholder group only (peer) or both stakeholder groups separately (multiple). Decisions as to which items to retain following each round were determined by pre-specified criteria. Whilst type of feedback did not impact on the percentage of items for which a participant subsequently changed their rating, or the magnitude of change, it did impact on items retained at the end of round 2. Each core set contained discordant items retained by one feedback group but not the other (3-22 % discordant items). Consensus between patients and professionals in items to retain was greater amongst those receiving multiple group feedback in each core set (65-82 % agreement for peer-only feedback versus 74-94 % for multiple feedback). In addition, differences in round 2 scores were smaller between stakeholder groups receiving multiple feedback than between those receiving peer group feedback only. Variability in item scores across stakeholders was reduced following any feedback but this reduction was consistently greater amongst the multiple feedback group. In the development of a core outcome or information set, providing feedback within Delphi questionnaires from all stakeholder groups separately may influence the final core set and improve consensus between the groups. Further work is needed to better understand how participants rate and re-rate items within a Delphi process. The three randomized controlled trials reported here were each nested within the development of a core information or outcome set to investigate processes in core outcome and information set development. Outcomes were not health-related and therefore trial registration was not applicable.

Uncontrolled Web-based administration of surveys on factual health-related knowledge: a randomized study of untimed versus timed quizzing.

PubMed

Domnich, Alexander; Panatto, Donatella; Signori, Alessio; Bragazzi, Nicola Luigi; Cristina, Maria Luisa; Amicizia, Daniela; Gasparini, Roberto

2015-04-13

Health knowledge and literacy are among the main determinants of health. Assessment of these issues via Web-based surveys is growing continuously. Research has suggested that approximately one-fifth of respondents submit cribbed answers, or cheat, on factual knowledge items, which may lead to measurement error. However, little is known about methods of discouraging cheating in Web-based surveys on health knowledge. This study aimed at exploring the usefulness of imposing a survey time limit to prevent help-seeking and cheating. On the basis of sample size estimation, 94 undergraduate students were randomly assigned in a 1:1 ratio to complete a Web-based survey on nutrition knowledge, with or without a time limit of 15 minutes (30 seconds per item); the topic of nutrition was chosen because of its particular relevance to public health. The questionnaire consisted of two parts. The first was the validated consumer-oriented nutrition knowledge scale (CoNKS) consisting of 20 true/false items; the second was an ad hoc questionnaire (AHQ) containing 10 questions that would be very difficult for people without health care qualifications to answer correctly. It therefore aimed at measuring cribbing and not nutrition knowledge. AHQ items were somewhat encyclopedic and amenable to Web searching, while CoNKS items had more complex wording, so that simple copying/pasting of a question in a search string would not produce an immediate correct answer. A total of 72 of the 94 subjects started the survey. Dropout rates were similar in both groups (11%, 4/35 and 14%, 5/37 in the untimed and timed groups, respectively). Most participants completed the survey from portable devices, such as mobile phones and tablets. To complete the survey, participants in the untimed group took a median 2.3 minutes longer than those in the timed group; the effect size was small (Cohen's r=.29). Subjects in the untimed group scored significantly higher on CoNKS (mean difference of 1.2 points, P=.008) and the effect size was medium (Cohen's d=0.67). By contrast, no significant between-group difference in AHQ scores was documented. Unexpectedly high AHQ scores were recorded in 23% (7/31) and 19% (6/32) untimed and timed respondents, respectively, very probably owing to "e-cheating". Cribbing answers to health knowledge items in researcher-uncontrolled conditions is likely to lead to overestimation of people's knowledge; this should be considered during the design and implementation of Web-based surveys. Setting a time limit alone may not completely prevent cheating, as some cheats may be very fast in Web searching. More complex and contextualized wording of items and checking for the "findability" properties of items before implementing a Web-based health knowledge survey may discourage help-seeking, thus reducing measurement error. Studies with larger sample sizes and diverse populations are needed to confirm our results.

Uncontrolled Web-Based Administration of Surveys on Factual Health-Related Knowledge: A Randomized Study of Untimed Versus Timed Quizzing

PubMed Central

2015-01-01

Background Health knowledge and literacy are among the main determinants of health. Assessment of these issues via Web-based surveys is growing continuously. Research has suggested that approximately one-fifth of respondents submit cribbed answers, or cheat, on factual knowledge items, which may lead to measurement error. However, little is known about methods of discouraging cheating in Web-based surveys on health knowledge. Objective This study aimed at exploring the usefulness of imposing a survey time limit to prevent help-seeking and cheating. Methods On the basis of sample size estimation, 94 undergraduate students were randomly assigned in a 1:1 ratio to complete a Web-based survey on nutrition knowledge, with or without a time limit of 15 minutes (30 seconds per item); the topic of nutrition was chosen because of its particular relevance to public health. The questionnaire consisted of two parts. The first was the validated consumer-oriented nutrition knowledge scale (CoNKS) consisting of 20 true/false items; the second was an ad hoc questionnaire (AHQ) containing 10 questions that would be very difficult for people without health care qualifications to answer correctly. It therefore aimed at measuring cribbing and not nutrition knowledge. AHQ items were somewhat encyclopedic and amenable to Web searching, while CoNKS items had more complex wording, so that simple copying/pasting of a question in a search string would not produce an immediate correct answer. Results A total of 72 of the 94 subjects started the survey. Dropout rates were similar in both groups (11%, 4/35 and 14%, 5/37 in the untimed and timed groups, respectively). Most participants completed the survey from portable devices, such as mobile phones and tablets. To complete the survey, participants in the untimed group took a median 2.3 minutes longer than those in the timed group; the effect size was small (Cohen’s r=.29). Subjects in the untimed group scored significantly higher on CoNKS (mean difference of 1.2 points, P=.008) and the effect size was medium (Cohen’s d=0.67). By contrast, no significant between-group difference in AHQ scores was documented. Unexpectedly high AHQ scores were recorded in 23% (7/31) and 19% (6/32) untimed and timed respondents, respectively, very probably owing to “e-cheating”. Conclusions Cribbing answers to health knowledge items in researcher-uncontrolled conditions is likely to lead to overestimation of people’s knowledge; this should be considered during the design and implementation of Web-based surveys. Setting a time limit alone may not completely prevent cheating, as some cheats may be very fast in Web searching. More complex and contextualized wording of items and checking for the “findability” properties of items before implementing a Web-based health knowledge survey may discourage help-seeking, thus reducing measurement error. Studies with larger sample sizes and diverse populations are needed to confirm our results. PMID:25872617

Development and assessment of floor and ceiling items for the PROMIS physical function item bank

PubMed Central

2013-01-01

Introduction Disability and Physical Function (PF) outcome assessment has had limited ability to measure functional status at the floor (very poor functional abilities) or the ceiling (very high functional abilities). We sought to identify, develop and evaluate new floor and ceiling items to enable broader and more precise assessment of PF outcomes for the NIH Patient-Reported-Outcomes Measurement Information System (PROMIS). Methods We conducted two cross-sectional studies using NIH PROMIS item improvement protocols with expert review, participant survey and focus group methods. In Study 1, respondents with low PF abilities evaluated new floor items, and those with high PF abilities evaluated new ceiling items for clarity, importance and relevance. In Study 2, we compared difficulty ratings of new floor items by low functioning respondents and ceiling items by high functioning respondents to reference PROMIS PF-10 items. We used frequencies, percentages, means and standard deviations to analyze the data. Results In Study 1, low (n = 84) and high (n = 90) functioning respondents were mostly White, women, 70 years old, with some college, and disability scores of 0.62 and 0.30. More than 90% of the 31 new floor and 31 new ceiling items were rated as clear, important and relevant, leaving 26 ceiling and 30 floor items for Study 2. Low (n = 246) and high (n = 637) functioning Study 2 respondents were mostly White, women, 70 years old, with some college, and Health Assessment Questionnaire (HAQ) scores of 1.62 and 0.003. Compared to difficulty ratings of reference items, ceiling items were rated to be 10% more to greater than 40% more difficult to do, and floor items were rated to be about 12% to nearly 90% less difficult to do. Conclusions These new floor and ceiling items considerably extend the measurable range of physical function at either extreme. They will help improve instrument performance in populations with broad functional ranges and those concentrated at one or the other extreme ends of functioning. Optimal use of these new items will be assisted by computerized adaptive testing (CAT), reducing questionnaire burden and insuring item administration to appropriate individuals. PMID:24286166

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research

PubMed Central

Brett, J; Simera, I; Seers, K; Mockford, C; Goodlad, S; Altman, D G; Moher, D; Barber, R; Denegri, S; Entwistle, A; Littlejohns, P; Morris, C; Suleman, R; Thomas, V; Tysall, C

2017-01-01

Background While the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why. Objective To develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2. Methods The EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process. Results 143 participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus. Conclusions GRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites. PMID:28768629

Teachers' Attitude towards ICT Use in Secondary Schools: A Scale Development Study

ERIC Educational Resources Information Center

Aydin, Mehmet Kemal; Semerci, Ali; Gürol, Mehmet

2016-01-01

The current study aims to develop a valid and reliable instrument that measures secondary school teachers' attitudes towards ICT use in teaching and learning process. A cross-sectional survey design was employed with a group of 173 teachers. Based on the literature review, a pool of 21 items was proposed and reviewed by a board of experts. As to…

Development and Validation of a Music Self-Concept Inventory for College Students

ERIC Educational Resources Information Center

Hash, Phillip M.

2017-01-01

The purpose of this study was to develop a Music Self-Concept Inventory (MSCI) for college students that is easy to administer and reflects the global nature of this construct. Students (N = 237) at a private college in the midwestern United States completed the initial survey, which contained 15 items rated on a 5-point Likert scale. Three…

Repositioning the Facilities in Technical College Workshops for Efficiency: A Case Study of North Central Nigeria

ERIC Educational Resources Information Center

Umar, Ibrahim Y.; Ma'aji, Abdullahi S.

2010-01-01

This article focuses on assessing the facilities in Government Technical College workshops in the context of a developing country. A descriptive survey design was adopted. Two research questions and a hypothesis were formulated to guide the study. A 35-item questionnaire was developed based on the National Board for Technical Education (NBTE)…

Development and evaluation of the McKnight Risk Factor Survey for assessing potential risk and protective factors for disordered eating in preadolescent and adolescent girls.

PubMed

Shisslak, C M; Renger, R; Sharpe, T; Crago, M; McKnight, K M; Gray, N; Bryson, S; Estes, L S; Parnaby, O G; Killen, J; Taylor, C B

1999-03-01

To describe the development, test-retest reliability, internal consistency, and convergent validity of the McKnight Risk Factor Survey-III (MRFS-III). The MRFS-III was designed to assess a number of potential risk and protective factors for the development of disordered eating in preadolescent and adolescent girls. Several versions of the MRFS were pilot tested before the MRFS-III was administered to a sample of 651 4th through 12th- grade girls to establish its psychometric properties. Most of the test-retest reliability coefficients of individual items on the MRFS-III were r > .40. Alpha coefficients for each risk and protective factor domain on the MRFS-III were also computed. The majority of these coefficients were r > .60. High convergent validity coefficients were obtained for specific items on the MRFS-III and measures of self-esteem (Rosenberg Self-Esteem Scale) and weight concerns (Weight Concerns Scale). The test-retest reliability, internal consistency, and convergent validity of the MRFS-III suggest that it is a useful new instrument to assess potential risk and protective factors for the development of disordered eating in preadolescent and adolescent girls.

Methods and processes of developing the strengthening the reporting of observational studies in epidemiology - veterinary (STROBE-Vet) statement.

PubMed

Sargeant, J M; O'Connor, A M; Dohoo, I R; Erb, H N; Cevallos, M; Egger, M; Ersbøll, A K; Martin, S W; Nielsen, L R; Pearl, D L; Pfeiffer, D U; Sanchez, J; Torrence, M E; Vigre, H; Waldner, C; Ward, M P

2016-11-01

The reporting of observational studies in veterinary research presents many challenges that often are not adequately addressed in published reporting guidelines. To develop an extension of the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) statement that addresses unique reporting requirements for observational studies in veterinary medicine related to health, production, welfare, and food safety. A consensus meeting of experts was organized to develop an extension of the STROBE statement to address observational studies in veterinary medicine with respect to animal health, animal production, animal welfare, and food safety outcomes. Consensus meeting May 11-13, 2014 in Mississauga, Ontario, Canada. Seventeen experts from North America, Europe, and Australia attended the meeting. The experts were epidemiologists and biostatisticians, many of whom hold or have held editorial positions with relevant journals. Prior to the meeting, 19 experts completed a survey about whether they felt any of the 22 items of the STROBE statement should be modified and if items should be added to address unique issues related to observational studies in animal species with health, production, welfare, or food safety outcomes. At the meeting, the participants were provided with the survey responses and relevant literature concerning the reporting of veterinary observational studies. During the meeting, each STROBE item was discussed to determine whether or not re-wording was recommended, and whether additions were warranted. Anonymous voting was used to determine whether there was consensus for each item change or addition. The consensus was that six items needed no modifications or additions. Modifications or additions were made to the STROBE items numbered: 1 (title and abstract), 3 (objectives), 5 (setting), 6 (participants), 7 (variables), 8 (data sources/measurement), 9 (bias), 10 (study size), 12 (statistical methods), 13 (participants), 14 (descriptive data), 15 (outcome data), 16 (main results), 17 (other analyses), 19 (limitations), and 22 (funding). Published literature was not always available to support modification to, or inclusion of, an item. The methods and processes used in the development of this statement were similar to those used for other extensions of the STROBE statement. The use of this extension to the STROBE statement should improve the reporting of observational studies in veterinary research related to animal health, production, welfare, or food safety outcomes by recognizing the unique features of observational studies involving food-producing and companion animals, products of animal origin, aquaculture, and wildlife. Copyright © 2016 The Authors. Published by Elsevier B.V. All rights reserved.

Reliability and validity of the workplace harassment questionnaire for Korean finance and service workers.

PubMed

Lee, Myeongjun; Kim, Hyunjung; Shin, Donghee; Lee, Sangyun

2016-01-01

Harassment means systemic and repeated unethical acts. Research on workplace harassment have been conducted widely and the NAQ-R has been widely used for the researches. But this tool, however the limitations in revealing differended in sub-factors depending on the culture and in reflecting that unique characteristics of the Koren society. So, The workplace harassment questionnaire for Korean finace and service workers has been developed to assess the level of personal harassment at work. This study aims to develop a tool to assess the level of personal harassment at work and to test its validity and reliability while examining specific characteristics of workplace harassment against finance and service workers in Korea. The framework of survey was established based on literature review, focused-group interview for the Korean finance and service workers. To verify its reliability, Cronbach's alpha coefficient was calculated; and to verify its validity, items and factors of the tool were analyzed. The correlation matrix analysis was examined to verify the tool's convergent validity and discriminant validity. Structural validity was verified by checking statistical significance in relation to the BDI-K. Cronbach's alpha coefficient of this survey was 0.93, which indicates a quite high level of reliability. To verify the appropriateness of this survey tool, its construct validity was examined through factor analysis. As a result of the factor analysis, 3 factors were extracted, explaining 56.5 % of the total variance. The loading values and communalities of the 20 items were 0.85 to 0.48 and 0.71 to 0.46. The convergent validity and discriminant validity were analyzed and rate of item discriminant validity was 100 %. Finally, for the concurrent validity, We examined the relationship between the WHI-KFSW and pschosocial stress by examining the correlation with the BDI-K. The results of chi-square test and multiple logistic analysis indicated that the correlation with the BDI-K was satatisctically significant. Workplace harassment in actual workplaces were investigated based on interviews, and the statistical analysis contributed to systematizing the types of actual workplace harassment. By statistical method, we developed the questionare, 20 items of 3 categories.

Development of a 12-item short version of the HIV stigma scale.

PubMed

Reinius, Maria; Wettergren, Lena; Wiklander, Maria; Svedhem, Veronica; Ekström, Anna Mia; Eriksson, Lars E

2017-05-30

Valid and reliable instruments for the measurement of enacted, anticipated and internalised stigma in people living with HIV are crucial for mapping trends in the prevalence of HIV-related stigma and tracking the effectiveness of stigma-reducing interventions. Although longer instruments exist, e.g., the commonly used 40-item HIV Stigma Scale by Berger et al., a shorter instrument would be preferable to facilitate the inclusion of HIV stigma in more and broader surveys. Therefore, the aim of this work was to develop a substantially shorter, but still valid, version of the HIV Stigma Scale. Data from a psychometric evaluation of the Swedish 40-item HIV Stigma Scale were reanalysed to create a short version with 12 items (three from each of the four stigma subscales: personalised stigma, disclosure concerns, concerns with public attitudes and negative self-image). The short version of the HIV stigma scale was then psychometrically tested using data from a national survey investigating stigma and quality of life among people living with HIV in Sweden (n = 880, mean age 47.9 years, 26% female). The hypothesized factor structure of the proposed short version was replicated in exploratory factor analysis without cross loadings and confirmatory factor analysis supported construct validity with high standardised effects (>0.7) of items on the intended scales. The χ 2 test was statistically significant (χ 2  = 154.2, df = 48, p < 0.001), but alternate fit measures indicated acceptable fit (comparative fit index: 0.963, Tucker-Lewis index: 0.950 and root mean square error of approximation: 0.071). Corrected item-total correlation coefficients were >0.4 for all items, with a variation indicating that the broadness of the concept of stigma had been captured. All but two aspects of HIV-related stigma that the instrument is intended to cover were captured by the selected items in the short version. The aspects that did not lose any items were judged to have acceptable psychometric properties. The short version of the instrument showed higher floor and ceiling effects than the full-length scale, indicating a loss of sensitivity in the short version. Cronbach's α for the subscales were all >0.7. Although being less sensitive in measurement, the proposed 12-item short version of the HIV Stigma Scale has comparable psychometric properties to the full-length scale and may be used when a shorter instrument is needed.

The blood donor identity survey: a multidimensional measure of blood donor motivations.

PubMed

France, Christopher R; Kowalsky, Jennifer M; France, Janis L; Himawan, Lina K; Kessler, Debra A; Shaz, Beth H

2014-08-01

Evidence indicates that donor identity is an important predictor of donation behavior; however, prior studies have relied on diverse, unidimensional measures with limited psychometric support. The goals of this study were to examine the application of self-determination theory to blood donor motivations and to develop and validate a related multidimensional measure of donor identity. Items were developed and administered electronically to a sample of New York Blood Center (NYBC) donors (n=582) and then to a sample of Ohio University students (n=1005). Following initial confirmatory factor analysis (CFA) on the NYBC sample to identify key items related to self-determination theory's six motivational factors, a revised survey was administered to the university sample to reexamine model fit and to assess survey reliability and validity. Consistent with self-determination theory, for both samples CFAs indicated that the best fit to the data was provided by a six-motivational-factor model, including amotivation, external regulation, introjected regulation, identified regulation, integrated regulation, and intrinsic regulation. The Blood Donor Identity Survey provides a psychometrically sound, multidimensional measure of donor motivations (ranging from unmotivated to donate to increasing levels of autonomous motivation to donate) that is suitable for nondonors as well as donors with varying levels of experience. Future research is needed to examine longitudinal changes in donor identity and its relationship to actual donation behavior. © 2014 AABB.

Necessary but not yet sufficient: a survey of aged residential care staff perceptions of palliative care communication, education and delivery.

PubMed

Frey, Rosemary; Boyd, Michal; Foster, Sue; Robinson, Jackie; Gott, Merryn

2016-12-01

Previous research has indicated that staff in aged residential care (ARC) may be unprepared for their role in palliative care provision. The need for palliative care knowledge among ARC staff has been characterised as 'pervasive'. Determining the palliative care education, communication and support needs of ARC clinical care staff is, therefore, of critical importance to the delivery of quality healthcare in this setting. A survey of clinical staff (n=431) in 52 ARC facilities in 1 urban district health board was conducted, using a paper-based questionnaire. Instruments included the 3-item Experiences with End of Life scale, developed measures of communication and support (13 items), support accessibility (12 items), and palliative care education (19 items). Only 199 (46.2%) of staff participants reported undertaking palliative care education. Nurses were more likely to have engaged in palliative care education in comparison with healthcare assistants (HCAs) (χ 2 (1, N=387)=18.10, p=0.00). Participants (n=347) who wanted further education preferred an interactive, hands-on applied education (13.9%) in comparison to short topic-specific sessions/seminars (6.5%) or lecture-based courses (7.7%). The study reveals an ongoing need for staff palliative care education. Results suggest the development of an integrated model of care which draws on both hospice and ARC staff expertise. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

Development and psychometric evaluation of a health-related quality of life instrument for individuals with adult-onset hearing loss.

PubMed

Stika, Carren J; Hays, Ron D

2015-07-01

Self-reports of 'hearing handicap' are available, but a comprehensive measure of health-related quality of life (HRQOL) for individuals with adult-onset hearing loss (AOHL) does not exist. Our objective was to develop and evaluate a multidimensional HRQOL instrument for individuals with AOHL. The Impact of Hearing Loss Inventory Tool (IHEAR-IT) was developed using results of focus groups, a literature review, advisory expert panel input, and cognitive interviews. The 73-item field-test instrument was completed by 409 adults (22-91 years old) with varying degrees of AOHL and from different areas of the USA. Multitrait scaling analysis supported four multi-item scales and five individual items. Internal consistency reliabilities ranged from 0.93 to 0.96 for the scales. Construct validity was supported by correlations between the IHEAR-IT scales and scores on the 36-item Short Form Health Survey, version 2.0 (SF-36v2) mental composite summary (r = 0.32-0.64) and the Hearing Handicap Inventory for the Elderly/Adults (HHIE/HHIA) (r ≥ -0.70). The field test provides initial support for the reliability and construct validity of the IHEAR-IT for evaluating HRQOL of individuals with AOHL. Further research is needed to evaluate the responsiveness to change of the IHEAR-IT scales and identify items for a short-form.

Probing University Students' Pre-Knowledge in Quantum Physics with QPCS Survey

ERIC Educational Resources Information Center

Asikainen, Mervi A.

2017-01-01

The study investigated the use of Quantum Physics Conceptual Survey (QPCS) in probing student understanding of quantum physics. Altogether 103 Finnish university students responded to QPCS. The mean scores of the student responses were calculated and the test was evaluated using common five indices: Item difficulty index, Item discrimination…

College Students' Perspectives on Dating a Person Who Stutters

ERIC Educational Resources Information Center

Mayo, Robert; Mayo, Carolyn M.

2013-01-01

The purpose of this study was to examine college students' perspectives on dating a person who stutters (PWS). One hundred and thirty-two college students responded to a 19-item survey questionnaire. Survey items included questions about participants' familiarity with persons who stutter, family and/or personal history of stuttering, knowledge of…

Better assessment of physical function: item improvement is neglected but essential

PubMed Central

2009-01-01

Introduction Physical function is a key component of patient-reported outcome (PRO) assessment in rheumatology. Modern psychometric methods, such as Item Response Theory (IRT) and Computerized Adaptive Testing, can materially improve measurement precision at the item level. We present the qualitative and quantitative item-evaluation process for developing the Patient Reported Outcomes Measurement Information System (PROMIS) Physical Function item bank. Methods The process was stepwise: we searched extensively to identify extant Physical Function items and then classified and selectively reduced the item pool. We evaluated retained items for content, clarity, relevance and comprehension, reading level, and translation ease by experts and patient surveys, focus groups, and cognitive interviews. We then assessed items by using classic test theory and IRT, used confirmatory factor analyses to estimate item parameters, and graded response modeling for parameter estimation. We retained the 20 Legacy (original) Health Assessment Questionnaire Disability Index (HAQ-DI) and the 10 SF-36's PF-10 items for comparison. Subjects were from rheumatoid arthritis, osteoarthritis, and healthy aging cohorts (n = 1,100) and a national Internet sample of 21,133 subjects. Results We identified 1,860 items. After qualitative and quantitative evaluation, 124 newly developed PROMIS items composed the PROMIS item bank, which included revised Legacy items with good fit that met IRT model assumptions. Results showed that the clearest and best-understood items were simple, in the present tense, and straightforward. Basic tasks (like dressing) were more relevant and important versus complex ones (like dancing). Revised HAQ-DI and PF-10 items with five response options had higher item-information content than did comparable original Legacy items with fewer response options. IRT analyses showed that the Physical Function domain satisfied general criteria for unidimensionality with one-, two-, three-, and four-factor models having comparable model fits. Correlations between factors in the test data sets were > 0.90. Conclusions Item improvement must underlie attempts to improve outcome assessment. The clear, personally important and relevant, ability-framed items in the PROMIS Physical Function item bank perform well in PRO assessment. They will benefit from further study and application in a wider variety of rheumatic diseases in diverse clinical groups, including those at the extremes of physical functioning, and in different administration modes. PMID:20015354

Better assessment of physical function: item improvement is neglected but essential.

PubMed

Bruce, Bonnie; Fries, James F; Ambrosini, Debbie; Lingala, Bharathi; Gandek, Barbara; Rose, Matthias; Ware, John E

2009-01-01

Physical function is a key component of patient-reported outcome (PRO) assessment in rheumatology. Modern psychometric methods, such as Item Response Theory (IRT) and Computerized Adaptive Testing, can materially improve measurement precision at the item level. We present the qualitative and quantitative item-evaluation process for developing the Patient Reported Outcomes Measurement Information System (PROMIS) Physical Function item bank. The process was stepwise: we searched extensively to identify extant Physical Function items and then classified and selectively reduced the item pool. We evaluated retained items for content, clarity, relevance and comprehension, reading level, and translation ease by experts and patient surveys, focus groups, and cognitive interviews. We then assessed items by using classic test theory and IRT, used confirmatory factor analyses to estimate item parameters, and graded response modeling for parameter estimation. We retained the 20 Legacy (original) Health Assessment Questionnaire Disability Index (HAQ-DI) and the 10 SF-36's PF-10 items for comparison. Subjects were from rheumatoid arthritis, osteoarthritis, and healthy aging cohorts (n = 1,100) and a national Internet sample of 21,133 subjects. We identified 1,860 items. After qualitative and quantitative evaluation, 124 newly developed PROMIS items composed the PROMIS item bank, which included revised Legacy items with good fit that met IRT model assumptions. Results showed that the clearest and best-understood items were simple, in the present tense, and straightforward. Basic tasks (like dressing) were more relevant and important versus complex ones (like dancing). Revised HAQ-DI and PF-10 items with five response options had higher item-information content than did comparable original Legacy items with fewer response options. IRT analyses showed that the Physical Function domain satisfied general criteria for unidimensionality with one-, two-, three-, and four-factor models having comparable model fits. Correlations between factors in the test data sets were > 0.90. Item improvement must underlie attempts to improve outcome assessment. The clear, personally important and relevant, ability-framed items in the PROMIS Physical Function item bank perform well in PRO assessment. They will benefit from further study and application in a wider variety of rheumatic diseases in diverse clinical groups, including those at the extremes of physical functioning, and in different administration modes.

Development and Validation of a Cross-Cultural Knowledge, Attitudes, and Practices Survey Instrument for Chronic Kidney Disease in a Swahili-Speaking Population

PubMed Central

Stanifer, John W.; Karia, Francis; Voils, Corrine I.; Turner, Elizabeth L.; Maro, Venance; Shimbi, Dionis; Kilawe, Humphrey; Lazaro, Matayo; Patel, Uptal D.

2015-01-01

Introduction Non-communicable diseases are a growing global burden, and structured surveys can identify critical gaps to address this epidemic. In sub-Saharan Africa, there are very few well-tested survey instruments measuring population attributes related to non-communicable diseases. To meet this need, we have developed and validated the first instrument evaluating knowledge, attitudes and practices pertaining to chronic kidney disease in a Swahili-speaking population. Methods and Results Between December 2013 and June 2014, we conducted a four-stage, mixed-methods study among adults from the general population of northern Tanzania. In stage 1, the survey instrument was constructed in English by a group of cross-cultural experts from multiple disciplines and through content analysis of focus group discussions to ensure local significance. Following translation, in stage 2, we piloted the survey through cognitive and structured interviews, and in stage 3, in order to obtain initial evidence of reliability and construct validity, we recruited and then administered the instrument to a random sample of 606 adults. In stage 4, we conducted analyses to establish test-retest reliability and known-groups validity which was informed by thematic analysis of the qualitative data in stages 1 and 2. The final version consisted of 25 items divided into three conceptual domains: knowledge, attitudes and practices. Each item demonstrated excellent test-retest reliability with established content and construct validity. Conclusions We have developed a reliable and valid cross-cultural survey instrument designed to measure knowledge, attitudes and practices of chronic kidney disease in a Swahili-speaking population of Northern Tanzania. This instrument may be valuable for addressing gaps in non-communicable diseases care by understanding preferences regarding healthcare, formulating educational initiatives, and directing development of chronic disease management programs that incorporate chronic kidney disease across sub-Saharan Africa. PMID:25811781

Global Tobacco Surveillance System (GTSS): purpose, production, and potential.

PubMed

2005-01-01

The World Health Organization (WHO), Centers for Disease Control and Prevention (CDC), and Canadian Public Health Association (CPHA) developed the Global Tobacco Surveillance System (GTSS) to assist all 192 WHO Member States in collecting data on youth and adult tobacco use. The flexible GTSS system includes common data items but allows countries to include important unique information at their discretion. It uses a common survey methodology, similar field procedures for data collection, and similar data management and processing techniques. The GTSS includes collection of data through three surveys: the Global Youth Tobacco Survey (GYTS) for youth, and the Global School Personnel Survey (GSPS) and the Global Health Professional Survey (GHPS) for adults. GTSS data potentially can be applied in four ways. First, countries and research partners can disseminate data through publications, presentations, and an active GTSS web site. Second, countries can use GTSS data to inform politicians about the tobacco problem in their country, leading to new policy decisions to prevent and control tobacco use. Third, GTSS can provide countries with valuable feedback to evaluate and improve Country National Action Plans or develop new plans. Fourth, in response to the WHO FCTC call for countries to use consistent methods and procedures in their surveillance efforts, GTSS offers such consistency in sampling procedures, core questionnaire items, training infield procedures, and analysis of data across all survey sites. The GTSS represents the most comprehensive tobacco surveillance system ever developed and implemented. As an example, this paper describes development of the GYTS and discusses potential uses of the data. Sample data were drawn from 38 sites in 24 countries in the African Region, 82 sites in 35 countries in the Americas Region, 20 sites in 17 countries and the Gaza Strip/West Bank region in the Eastern Mediterranean Region, 25 sites in 22 countries in the European Region, 34 sites in six countries in the Southeast Asia Region, and 25 sites in 14 countries in the Western Pacific Region.

Assessing Student Understanding of the "New Biology": Development and Evaluation of a Criterion-Referenced Genomics and Bioinformatics Assessment

NASA Astrophysics Data System (ADS)

Campbell, Chad Edward

Over the past decade, hundreds of studies have introduced genomics and bioinformatics (GB) curricula and laboratory activities at the undergraduate level. While these publications have facilitated the teaching and learning of cutting-edge content, there has yet to be an evaluation of these assessment tools to determine if they are meeting the quality control benchmarks set forth by the educational research community. An analysis of these assessment tools indicated that <10% referenced any quality control criteria and that none of the assessments met more than one of the quality control benchmarks. In the absence of evidence that these benchmarks had been met, it is unclear whether these assessment tools are capable of generating valid and reliable inferences about student learning. To remedy this situation the development of a robust GB assessment aligned with the quality control benchmarks was undertaken in order to ensure evidence-based evaluation of student learning outcomes. Content validity is a central piece of construct validity, and it must be used to guide instrument and item development. This study reports on: (1) the correspondence of content validity evidence gathered from independent sources; (2) the process of item development using this evidence; (3) the results from a pilot administration of the assessment; (4) the subsequent modification of the assessment based on the pilot administration results and; (5) the results from the second administration of the assessment. Twenty-nine different subtopics within GB (Appendix B: Genomics and Bioinformatics Expert Survey) were developed based on preliminary GB textbook analyses. These subtopics were analyzed using two methods designed to gather content validity evidence: (1) a survey of GB experts (n=61) and (2) a detailed content analyses of GB textbooks (n=6). By including only the subtopics that were shown to have robust support across these sources, 22 GB subtopics were established for inclusion in the assessment. An expert panel subsequently developed, evaluated, and revised two multiple-choice items to align with each of the 22 subtopics, producing a final item pool of 44 items. These items were piloted with student samples of varying content exposure levels. Both Classical Test Theory (CTT) and Item Response Theory (IRT) methodologies were used to evaluate the assessment's validity, reliability and ability inferences, and its ability to differentiate students with different magnitudes of content exposure. A total of 18 items were subsequently modified and reevaluated by an expert panel. The 26 original and 18 modified items were once again piloted with student samples of varying content exposure levels. Both CTT and IRT methodologies were once again used to evaluate student responses in order to evaluate the assessment's validity and reliability inferences as well as its ability to differentiate students with different magnitudes of content exposure. Interviews with students from different content exposure levels were also performed in order to gather convergent validity evidence (external validity evidence) as well as substantive validity evidence. Also included are the limitations of the assessment and a set of guidelines on how the assessment can best be used.

Factors Associated with Patient Press Ganey Satisfaction Scores for Ophthalmology Patients.

PubMed

Long, Chao; Tsay, Ellen L; Jacobo, Samuel A; Popat, Rita; Singh, Kuldev; Chang, Robert T

2016-02-01

To determine which metrics from the Press Ganey patient satisfaction survey best correlate with "likelihood to recommend" among patients in an academic tertiary medical center practice setting. Cross-sectional study. Over a 3-month period, patients presenting to an academic practice who agreed to participate were enrolled in the study if they met the following entry criteria: (1) age ≥18 years, (2) ability to read and speak English, and (3) followed in this practice between 4 months and 4 years. A total of 196 patients were recruited. A 26-item abridged version of the Press Ganey survey typically distributed to patients via mail or e-mail after visiting the Stanford University Hospital was administered privately to each eligible patient of 2 different attending clinics at the conclusion of his or her visit. The 26 survey items were not modified for the purposes of the study and were administered such that participants could not be individually identified. The arithmetic mean score for the item "Likelihood of your recommending our practice to others" was calculated by assigning a value (0-100) to the Likert value associated with survey responses and correlated with the 25 other items using the differences in the mean scores. Response to survey items graded on a 1 to 5 standard Likert scale. The weighted mean patient survey score for the "likelihood to recommend" item for the junior faculty member was 95.9% and for the senior faculty member was 94.5%, respectively. For the remaining 25 items, "Amount of time the care provider spent with you" (Diff[1-2]=1.03; P < 0.0001) and "Ease of scheduling your appointment" (Diff[1-2]=0.99; P < 0.0001) best correlated with likelihood to recommend. In contrast, "Friendliness/courtesy of the care provider" (Diff[1-2]=0.29; P = 0.0045) correlated least with likelihood to recommend. Stratification based on provider did not affect the study results. The perception of time spent with the practitioner and ease of appointment scheduling are the 2 variables that best correlate with patients recommending their ophthalmologists to other prospective patients. Copyright © 2016 American Academy of Ophthalmology. Published by Elsevier Inc. All rights reserved.

Outcome-based self-assessment on a team-teaching subject in the medical school

PubMed Central

Cho, Sa Sun

2014-01-01

We attempted to investigate the reason why the students got a worse grade in gross anatomy and the way how we can improve upon the teaching method since there were gaps between teaching and learning under recently changed integration curriculum. General characteristics of students and exploratory factors to testify the validity were compared between year 2011 and 2012. Students were asked to complete a short survey with a Likert scale. The results were as follows: although the percentage of acceptable items was similar between professors, professor C preferred questions with adequate item discrimination and inappropriate item difficulty whereas professor Y preferred adequate item discrimination and appropriate item difficulty with statistical significance (P<0.01). The survey revealed that 26.5% of total students gave up the exam on gross anatomy of professor Y irrespective of years. These results suggested that students were affected by the corrected item difficulty rather than item discrimination in order to obtain academic achievement. Therefore, professors in a team-teaching subject should reach a consensus on an item difficulty with proper teaching methods. PMID:25548724

A top-five list for emergency medicine: a pilot project to improve the value of emergency care.

PubMed

Schuur, Jeremiah D; Carney, Dylan P; Lyn, Everett T; Raja, Ali S; Michael, John A; Ross, Nicholas G; Venkatesh, Arjun K

2014-04-01

IMPORTANCE The mean cost of medical care in the United States is growing at an unsustainable rate; from 2003 through 2011, the cost for an emergency department (ED) visit rose 240%, from $560 to $1354. The diagnostic tests, treatments, and hospitalizations that emergency clinicians order result in significant costs. OBJECTIVE To create a "top-five" list of tests, treatments, and disposition decisions that are of little value, are amenable to standardization, and are actionable by emergency medicine clinicians. DESIGN, SETTING, AND PARTICIPANTS Modified Delphi consensus process and survey of 283 emergency medicine clinicians (physicians, physician assistants, and nurse practitioners) from 6 EDs. INTERVENTION We assembled a technical expert panel (TEP) and conducted a modified Delphi process to identify a top-five list using a 4-step process. In phase 1, we generated a list of low-value clinical decisions from TEP brainstorming and e-mail solicitation of clinicians. In phase 2, the TEP ranked items on contribution to cost, benefit to patients, and actionability by clinicians. In phase 3, we surveyed all ordering clinicians from the 6 EDs regarding distinct aspects of each item. In phase 4, the TEP voted for a final top-five list based on survey results and discussion. MAIN OUTCOMES AND MEASURES A top-five list for emergency medicine. The TEP ranked items on contribution to cost, benefit to patients, and actionability by clinicians. The survey asked clinicians to score items on the potential benefit or harm to patients and the provider actionability of each item. Voting and surveys used 5-point Likert scales. A Pearson interdomain correlation was used. RESULTS Phase 1 identified 64 low-value items. Phase 2 narrowed this list to 7 laboratory tests, 3 medications, 4 imaging studies, and 3 disposition decisions included in the phase 3 survey (71.0% response rate). All 17 items showed a significant positive correlation between benefit and actionability (r, 0.19-0.37 [P ≤ .01]). One item received unanimous TEP support, 4 received majority support, and 12 received at least 1 vote. CONCLUSIONS AND RELEVANCE Our TEP identified clinical actions that are of low value and within the control of ED health care providers. This method can be used to identify additional actionable targets of overuse in emergency medicine.

Development of the Knee Numeric-Entity Evaluation Score (KNEES-ACL): a condition-specific questionnaire.

PubMed

Comins, J D; Krogsgaard, M R; Brodersen, J

2013-10-01

Patient-related outcome measures (PROMs) are commonly used to gauge treatment effects in patients with anterior cruciate ligament (ACL) deficiency. Valid measures of specific conditions depend on relevant item content. While item content can be derived either from clinicians (face validity) or from patients, item relevance and comprehensiveness can only be confirmed by the patient (content validity). Focus group and single interviews were conducted with patients' pre- and post-ACL reconstruction in order to construct a condition-specific PROM for the target patients. One hundred fifty-seven items from a previously conducted literature search were used as a basis for content genesis. Content saturation was achieved after three focus groups and seven single interviews. Thirty-eight items from the literature search were directly endorsed, and five modified items were endorsed. Twelve new item themes with verbatim content emerged. Thus, a 55-item pilot PROM consisting of six conceptual domains was assembled. We have constructed a condition-specific PROM for measurement of surgical and non-surgical treatment effects on ACL deficiency. The instrument possesses face and content validity. A pilot survey to assess the psychometric properties will be performed using Rasch measurement theory. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

A new algorithm to build bridges between two patient-reported health outcome instruments: the MOS SF-36® and the VR-12 Health Survey.

PubMed

Selim, Alfredo; Rogers, William; Qian, Shirley; Rothendler, James A; Kent, Erin E; Kazis, Lewis E

2018-04-19

To develop bridging algorithms to score the Veterans Rand-12 (VR-12) scales for comparability to those of the SF-36® for facilitating multi-cohort studies using data from the National Cancer Institute Surveillance, Epidemiology, and End Results Program (SEER) linked to Medicare Health Outcomes Survey (MHOS), and to provide a model for minimizing non-statistical error in pooled analyses stemming from changes to survey instruments over time. Observational study of MHOS cohorts 1-12 (1998-2011). We modeled 2-year follow-up SF-36 scale scores from cohorts 1-6 based on baseline SF-36 scores, age, and gender, yielding 100 clusters using Classification and Regression Trees. Within each cluster, we averaged follow-up SF-36 scores. Using the same cluster specifications, expected follow-up SF-36 scores, based on cohorts 1-6, were computed for cohorts 7-8 (where the VR-12 was the follow-up survey). We created a new criterion validity measure, termed "extensibility," calculated from the square root of the mean square difference between expected SF-36 scale averages and observed VR-12 item score from cohorts 7-8, weighted by cluster size. VR-12 items were rescored to minimize this quantity. Extensibility of rescored VR-12 items and scales was considerably improved from the "simple" scoring method for comparability to the SF-36 scales. The algorithms are appropriate across a wide range of potential subsamples within the MHOS and provide robust application for future studies that span the SF-36 and VR-12 eras. It is possible that these surveys in a different setting outside the MHOS, especially in younger age groups, could produce somewhat different results.

The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations.

PubMed

Hutton, Brian; Salanti, Georgia; Caldwell, Deborah M; Chaimani, Anna; Schmid, Christopher H; Cameron, Chris; Ioannidis, John P A; Straus, Sharon; Thorlund, Kristian; Jansen, Jeroen P; Mulrow, Cynthia; Catalá-López, Ferrán; Gøtzsche, Peter C; Dickersin, Kay; Boutron, Isabelle; Altman, Douglas G; Moher, David

2015-06-02

The PRISMA statement is a reporting guideline designed to improve the completeness of reporting of systematic reviews and meta-analyses. Authors have used this guideline worldwide to prepare their reviews for publication. In the past, these reports typically compared 2 treatment alternatives. With the evolution of systematic reviews that compare multiple treatments, some of them only indirectly, authors face novel challenges for conducting and reporting their reviews. This extension of the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) statement was developed specifically to improve the reporting of systematic reviews incorporating network meta-analyses. A group of experts participated in a systematic review, Delphi survey, and face-to-face discussion and consensus meeting to establish new checklist items for this extension statement. Current PRISMA items were also clarified. A modified, 32-item PRISMA extension checklist was developed to address what the group considered to be immediately relevant to the reporting of network meta-analyses. This document presents the extension and provides examples of good reporting, as well as elaborations regarding the rationale for new checklist items and the modification of previously existing items from the PRISMA statement. It also highlights educational information related to key considerations in the practice of network meta-analysis. The target audience includes authors and readers of network meta-analyses, as well as journal editors and peer reviewers.

Using Rasch Analysis to Inform Rating Scale Development

ERIC Educational Resources Information Center

Van Zile-Tamsen, Carol

2017-01-01

The use of surveys, questionnaires, and rating scales to measure important outcomes in higher education is pervasive, but reliability and validity information is often based on problematic Classical Test Theory approaches. Rasch Analysis, based on Item Response Theory, provides a better alternative for examining the psychometric quality of rating…