Prioritizing guideline topics: development and evaluation of a practical tool.

PubMed

Ketola, Eeva; Toropainen, Erja; Kaila, Minna; Luoto, Riitta; Mäkelä, Marjukka

2007-08-01

A clear process for selecting and adopting clinical practice guidelines in the new topic areas is needed. The aim of this study is to design and develop a practical tool to assess guideline topics that have been suggested to the organization responsible for producing guidelines. We carried out an iterative development, feasibility and validation study of a guideline topic prioritization tool. The setting included the guideline producer organization and the tax-funded health care system. In the first stage of the tool development, participants were researchers, members of the Current Care Board and experts from health care organizations. In the second stage, the evaluation was done internally within the project by three independent reviewers. The main outcome measures were responses to an evaluation questionnaire, qualitative process feedback and analysis of the performance of the instrument on a random set of guidelines. Evaluations by three independent reviewers revealed good agreement and face validity with respect to its feasibility as a planning tool at the guideline board level. Feedback from board members suggested that the instrument is useful in prioritizing guideline topics. This instrument was accepted for use by the Board. Further developments are needed to ensure feedback and acceptability of the instrument by those proposing topics.

Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report.

PubMed

Rothman, Margaret; Burke, Laurie; Erickson, Pennifer; Leidy, Nancy Kline; Patrick, Donald L; Petrie, Charles D

2009-01-01

Patient-reported outcome (PRO) instruments are used to evaluate the effect of medical products on how patients feel or function. This article presents the results of an ISPOR task force convened to address good clinical research practices for the use of existing or modified PRO instruments to support medical product labeling claims. The focus of the article is on content validity, with specific reference to existing or modified PRO instruments, because of the importance of content validity in selecting or modifying an existing PRO instrument and the lack of consensus in the research community regarding best practices for establishing and documenting this measurement property. Topics addressed in the article include: definition and general description of content validity; PRO concept identification as the important first step in establishing content validity; instrument identification and the initial review process; key issues in qualitative methodology; and potential threats to content validity, with three case examples used to illustrate types of threats and how they might be resolved. A table of steps used to identify and evaluate an existing PRO instrument is provided, and figures are used to illustrate the meaning of content validity in relationship to instrument development and evaluation. RESULTS & RECOMMENDATIONS: Four important threats to content validity are identified: unclear conceptual match between the PRO instrument and the intended claim, lack of direct patient input into PRO item content from the target population in which the claim is desired, no evidence that the most relevant and important item content is contained in the instrument, and lack of documentation to support modifications to the PRO instrument. In some cases, careful review of the threats to content validity in a specific application may be reduced through additional well documented qualitative studies that specifically address the issue of concern. Published evidence of the content validity of a PRO instrument for an intended application is often limited. Such evidence is, however, important to evaluating the adequacy of a PRO instrument for the intended application. This article provides an overview of key issues involved in assessing and documenting content validity as it relates to using existing instruments in the drug approval process.

Evaluating the Quality of Learning Environments and Teaching Practice in Special Schools

ERIC Educational Resources Information Center

Hedegaard-Soerensen, Lotte; Tetler, Susan

2016-01-01

This article reports on findings of a study which objective is the development of an instrument for systematic evaluation and improvement of the quality of teaching in special schools. The article describes the research process which led to the construction of the instrument as well as the way teachers can use the instrument to improve the quality…

Analysis instruments for the performance of Advanced Practice Nursing.

PubMed

Sevilla-Guerra, Sonia; Zabalegui, Adelaida

2017-11-29

Advanced Practice Nursing has been a reality in the international context for several decades and recently new nursing profiles have been developed in Spain as well that follow this model. The consolidation of these advanced practice roles has also led to of the creation of tools that attempt to define and evaluate their functions. This study aims to identify and explore the existing instruments that enable the domains of Advanced Practice Nursing to be defined. A review of existing international questionnaires and instruments was undertaken, including an analysis of the design process, the domains/dimensions defined, the main results and an exploration of clinimetric properties. Seven studies were analysed but not all proved to be valid, stable or reliable tools. One included tool was able to differentiate between the functions of the general nurse and the advanced practice nurse by the level of activities undertaken within the five domains described. These tools are necessary to evaluate the scope of advanced practice in new nursing roles that correspond to other international models of competencies and practice domains. Copyright © 2017 Elsevier España, S.L.U. All rights reserved.

Evaluating critical thinking in clinical practice.

PubMed

Oermann, M H

1997-01-01

Although much has been written about measurement instruments for evaluating critical thinking in nursing, this article describes clinical evaluation strategies for critical thinking. Five methods are discussed: 1) observation of students in practice; 2) questions for critical thinking, including Socratic questioning; 3) conferences; 4) problem-solving strategies; and 5) written assignments. These methods provide a means of evaluating students' critical thinking within the context of clinical practice.

Sensitivity, Specificity, and Receiver Operating Characteristics: A Primer for Neuroscience Nurses.

PubMed

McNett, Molly; Amato, Shelly; Olson, DaiWai M

2017-04-01

It is important for neuroscience nurses to have a solid understanding of the instruments they use in clinical practice. Specifically, when reviewing reports of research instruments, nurses should be knowledgeable of analytical terms when determining the applicability of instruments for use in clinical practice. The purpose of this article is to review 3 such analytical terms: sensitivity, specificity, and receiver operating characteristic curves. Examples of how these terms are used in the neuroscience literature highlight the relevance of these terms to neuroscience nursing practice. As the role of the nurse continues to expand, it is important not to simply accept all instruments as valid but to be able to critically evaluate their properties for applicability to nursing practice and evidence-based care of our patients.

Exploratory Factor Analysis and Psychometric Evaluation of the Teacher Reporting Attitude Scale for Child Sexual Abuse

ERIC Educational Resources Information Center

Walsh, Kerryann; Rassafiani, Mehdi; Mathews, Ben; Farrell, Ann; Butler, Des

2012-01-01

This paper presents an evaluation of an instrument to measure teachers' attitudes toward reporting child sexual abuse and discusses the instrument's merit for research into reporting practice. Based on responses from 444 Australian teachers, the Teachers' Reporting Attitude Scale for Child Sexual Abuse was evaluated using exploratory factor…

The PEACE project review of clinical instruments for hospice and palliative care.

PubMed

Hanson, Laura C; Scheunemann, Leslie P; Zimmerman, Sheryl; Rokoske, Franziska S; Schenck, Anna P

2010-10-01

Hospice and palliative care organizations are expanding their use of standardized instruments and other approaches to measure quality. We undertook a systematic review and evaluation of published patient-level instruments for potential application in hospice and palliative care clinical quality measurement. We searched prior reviews and computerized reference databases from 1990 through February 2007 for studies of instruments relevant to physical, psychological, social, cultural, spiritual, or ethical aspects of palliative care, or measuring prognosis, function or continuity of care. Publications were selected for full review if they provided evidence of psychometric properties or practical application of an instrument tested in or appropriate for a hospice or palliative care population. Selected instruments were evaluated and scored for scientific soundness and potential application in clinical quality measurement. The search found 1427 publications, with 229 selected for full manuscript review. Manuscripts provided information on 129 instruments which were evaluated using a structured scoring guide for psychometric properties. Thirty-nine instruments scoring near or above the 75th percentile were recommended. Most instruments covered multiple domains or focused on care for physical symptoms, psychological or social aspects of care. Few instruments were available to measure cultural aspects of care, structure and process of care, and continuity of care. Numerous patient-level instruments are available to measure physical, psychological and social aspects of palliative care with adequate evidence for scientific soundness and practical clinical use for quality improvement and research. Other aspects of palliative care may benefit from further instrument development research.

Development and Analysis of an Instrument to Assess Student Understanding of GOB Chemistry Knowledge Relevant to Clinical Nursing Practice

ERIC Educational Resources Information Center

Brown, Corina E.; Hyslop, Richard M.; Barbera, Jack

2015-01-01

The General, Organic, and Biological Chemistry Knowledge Assessment (GOB-CKA) is a multiple-choice instrument designed to assess students' understanding of the chemistry topics deemed important to clinical nursing practice. This manuscript describes the development process of the individual items along with a psychometric evaluation of the…

Development and psychometric testing of the nursing student mentors' competence instrument (MCI): A cross-sectional study.

PubMed

Tuomikoski, Anna-Maria; Ruotsalainen, Heidi; Mikkonen, Kristina; Miettunen, Jouko; Kääriäinen, Maria

2018-06-05

Mentors require competence at a diverse array of skills to mentor students during clinical practice. According to the latest evidence, competence at mentoring includes: knowledge, skills and attributes of individual students' learning objectives, core elements of nursing, learning processes, a reciprocal and trustful relationship, feedback, evaluation, cooperation with stakeholders, and the mentor's personal qualities. The purpose of the study was to test psychometric properties of a mentor's competence instrument developed to self-evaluate mentors' competence at mentoring nursing students in clinical practice. A cross-sectional, descriptive, explorative study design was used. Data were collected from mentors at five university hospitals in Finland in 2016. A total of 576 mentors participated in this study. The instrument was developed through systematic review, experts' evaluations, and pilot versions of the instrument tested in previous studies. The construct validity and reliability of the instrument were tested using exploratory factor analysis (EFA) with promax rotation and Cronbach's alpha. A 10-factor model showed that the instrument has acceptable construct validity. Cronbach's alpha values for the subscales observed ranged from 0.76 to 0.90. The instrument exhibited acceptable psychometric properties, thereby proving itself a valuable tool for evaluating mentors' competence at mentoring students. Further assessments of its reliability, validity and generality for measuring mentor's competence for mentoring students in different contexts and cultures are recommended. Copyright © 2018 Elsevier Ltd. All rights reserved.

Development of the evaluation instrument use CIPP on the implementation of project assessment topic optik

NASA Astrophysics Data System (ADS)

Asfaroh, Jati Aurum; Rosana, Dadan; Supahar

2017-08-01

This research aims to develop an evaluation instrument models CIPP valid and reliable as well as determine the feasibility and practicality of an evaluation instrument models CIPP. An evaluation instrument models CIPP to evaluate the implementation of the project assessment topic optik to measure problem-solving skills of junior high school class VIII in the Yogyakarta region. This research is a model of development that uses 4-D. Subject of product trials are students in class VIII SMP N 1 Galur and SMP N 1 Sleman. Data collection techniques in this research using non-test techniques include interviews, questionnaires and observations. Validity in this research was analyzed using V'Aikens. Reliability analyzed using ICC. This research uses 7 raters are derived from two lecturers expert (expert judgment), two practitioners (science teacher) and three colleagues. The results of this research is the evaluation's instrument model of CIPP is used to evaluate the implementation of the implementation of the project assessment instruments. The validity result of evaluation instrument have V'Aikens values between 0.86 to 1, which means a valid and 0.836 reliability values into categories so well that it has been worth used as an evaluation instrument.

[Clinical practice guidelines (II): searching and critical evaluation].

PubMed

Alonso, P; Bonfill, X

2007-01-01

Clinical practice guidelines have unique characteristics of the Internet era in which they are starting to be increasingly popular. The fact that they are often elaborated by governmental agencies and are not published in conventional journals means that they may not be accessible using the usual search methods employed for other types of scientific studies and documents (clinical trials, reviews, etc.). The Internet has become an essential tool for locating clinical practice guidelines, and meta-search engines, specific databases, directories, and elaborating institutions are of special importance. The relative lack of indexing of clinical practice guides means that Medline and Embase are not as useful in this context as in searching for original studies. With the aim of evaluating the validity, reproducibility, and reliability of clinical practice guidelines, a series of European institutions designed a tool to evaluate clinical practice guidelines at the end of the 1990s. This instrument, named AGREE, aims to offer a framework for the evaluation of the quality of clinical practice guidelines. It can also be useful in the design of new clinical practice guidelines as well as in the evaluation of the validity of guidelines to be updated or adapted. The AGREE instrument has become the reference for those that use guidelines, those that elaborate them, and for healthcare providers.

A call for change: clinical evaluation of student registered nurse anesthetists.

PubMed

Collins, Shawn; Callahan, Margaret Faut

2014-02-01

The ability to integrate theory with practice is integral to a student's success. A common reason for attrition from a nurse anesthesia program is clinical issues. To document clinical competence, students are evaluated using various tools. For use of a clinical evaluation tool as possible evidence for a student's dismissal, an important psychometric property to ensure is instrument validity. Clinical evaluation instruments of nurse anesthesia programs are not standardized among programs, which suggests a lack of instrument validity. The lack of established validity of the instruments used to evaluate students' clinical progress brings into question their ability to detect a student who is truly in jeopardy of attrition. Given this possibility, clinical instrument validity warrants research to be fair to students and improve attrition rates based on valid data. This ex post facto study evaluated a 17-item clinical instrument tool to demonstrate the need for validity of clinical evaluation tools. It also compared clinical scores with scores on the National Certification Examination.

A Survey of Modes of Student Response Indicative of Musical Learning in Elementary Instrumental Music.

ERIC Educational Resources Information Center

Weaver, Molly A.

This master's thesis reports on a study of the frequency and modes of student responses that demonstrate musical learning in the elementary instrumental music class. Some advances must be made toward more definitive evaluation practices in elementary school instrumental music if instrumental programs are to be justified in terms of improved…

The Way We See It: A Survey of Teacher Evaluation Policies and Practices Operant in the State of Washington.

ERIC Educational Resources Information Center

Buck, James J., Comp.; Parsley, James F., Jr., Comp.

This paper assesses teacher evaluation policies and practices operant in First Class School Districts in the state of Washington. The data, submitted from mailed questionnaires, deal with a district's assessment policy and specifically include concerns relating to evaluative personnel, procedures, and an evaluative instrument or model.…

Instrumentation issues in implementation science.

PubMed

Martinez, Ruben G; Lewis, Cara C; Weiner, Bryan J

2014-09-04

Like many new fields, implementation science has become vulnerable to instrumentation issues that potentially threaten the strength of the developing knowledge base. For instance, many implementation studies report findings based on instruments that do not have established psychometric properties. This article aims to review six pressing instrumentation issues, discuss the impact of these issues on the field, and provide practical recommendations. This debate centers on the impact of the following instrumentation issues: use of frameworks, theories, and models; role of psychometric properties; use of 'home-grown' and adapted instruments; choosing the most appropriate evaluation method and approach; practicality; and need for decision-making tools. Practical recommendations include: use of consensus definitions for key implementation constructs; reporting standards (e.g., regarding psychometrics, instrument adaptation); when to use multiple forms of observation and mixed methods; and accessing instrument repositories and decision aid tools. This debate provides an overview of six key instrumentation issues and offers several courses of action to limit the impact of these issues on the field. With careful attention to these issues, the field of implementation science can potentially move forward at the rapid pace that is respectfully demanded by community stakeholders.

[Clinical practice guidelines in Peru: evaluation of its quality using the AGREE II instrument].

PubMed

Canelo-Aybar, Carlos; Balbin, Graciela; Perez-Gomez, Ángela; Florez, Iván D

2016-01-01

To evaluate the methodological quality of clinical practice guidelines (CPGs) put into practice by the Peruvian Ministry of Health (MINSA), 17 CPGs from the ministry, published between 2009 and 2014, were independently evaluated by three methodologic experts using the AGREE II instrument. The score of AGREE II domains was low and very low in all CPGs: scope and purpose (medium, 44%), clarity of presentation (medium, 47%), participation of decision-makers (medium, 8%), methodological rigor (medium, 5%), applicability (medium, 5%), and editorial independence (medium, 8%). In conclusion, the methodological quality of CPGs implemented by the MINSA is low. Consequently, its use could not be recommended. The implementation of the methodology for the development of CPGs described in the recentlypublished CPG methodological preparation manual in Peru is a pressing need.

Alignment of Outcome Instruments Used in Hand Therapy With the Occupational Therapy Practice Framework: Domain and Process and the International Classification of Functioning, Disability and Health: A Scoping Review.

PubMed

Lesher, Danielle Ann-Marie; Mulcahey, M J; Hershey, Peter; Stanton, Donna Breger; Tiedgen, Andrea C

We sought to identify outcome instruments used in rehabilitation of the hand and upper extremity; to determine their alignment with the constructs of the International Classification of Functioning, Disability and Health (ICF) and the Occupational Therapy Practice Framework: Domain and Process; and to report gaps in the constructs measured by outcome instruments as a basis for future research. We searched CINAHL, MEDLINE, OTseeker, and the Cochrane Central Register of Controlled Trials using scoping review methodology and evaluated outcome instruments for concordance with the ICF and the Framework. We identified 18 outcome instruments for analysis. The findings pertain to occupational therapists' focus on body functions, body structures, client factors, and activities of daily living; a gap in practice patterns in use of instruments; and overestimation of the degree to which instruments used are occupationally based. Occupational therapy practitioners should use outcome instruments that embody conceptual frameworks for classifying function and activity. Copyright © 2017 by the American Occupational Therapy Association, Inc.

Adaptation of the Practice Environment Scale for military nurses: a psychometric analysis.

PubMed

Swiger, Pauline A; Raju, Dheeraj; Breckenridge-Sproat, Sara; Patrician, Patricia A

2017-09-01

The aim of this study was to confirm the psychometric properties of Practice Environment Scale of the Nursing Work Index in a military population. This study also demonstrates association rule analysis, a contemporary exploratory technique. One of the instruments most commonly used to evaluate the nursing practice environment is the Practice Environment Scale of the Nursing Work Index. Although the instrument has been widely used, the reliability, validity and individual item function are not commonly evaluated. Gaps exist with regard to confirmatory evaluation of the subscale factors, individual item analysis and evaluation in the outpatient setting and with non-registered nursing staff. This was a secondary data analysis of existing survey data. Multiple psychometric methods were used for this analysis using survey data collected in 2014. First, descriptive analyses were conducted, including exploration using association rules. Next, internal consistency was tested and confirmatory factor analysis was performed to test the factor structure. The specified factor structure did not hold; therefore, exploratory factor analysis was performed. Finally, item analysis was executed using item response theory. The differential item functioning technique allowed the comparison of responses by care setting and nurse type. The results of this study indicate that responses differ between groups and that several individual items could be removed without altering the psychometric properties of the instrument. The instrument functions moderately well in a military population; however, researchers may want to consider nurse type and care setting during analysis to identify any meaningful variation in responses. © 2017 John Wiley & Sons Ltd.

Clinical evaluation of a new pressure ulcer risk assessment instrument, the Pressure Ulcer Risk Primary or Secondary Evaluation Tool (PURPOSE T).

PubMed

Coleman, Susanne; Smith, Isabelle L; McGinnis, Elizabeth; Keen, Justin; Muir, Delia; Wilson, Lyn; Stubbs, Nikki; Dealey, Carol; Brown, Sarah; Nelson, E Andrea; Nixon, Jane

2018-02-01

To test the psychometric properties and clinical usability of a new Pressure Ulcer Risk Assessment Instrument including inter-rater and test-retest reliability, convergent validity and data completeness. Methodological and practical limitations associated with traditional Pressure Ulcer Risk Assessment Instruments, prompted a programme to work to develop a new instrument, as part of the National Institute for Health Research funded, Pressure UlceR Programme Of reSEarch (RP-PG-0407-10056). Observational field test. For this clinical evaluation 230 patients were purposefully sampled across four broad levels of pressure ulcer risk with representation from four secondary care and four community NHS Trusts in England. Blinded and simultaneous paired (ward/community nurse and expert nurse) PURPOSE-T assessments were undertaken. Follow-up retest was undertaken by the expert nurse. Field notes of PURPOSE-T use were collected. Data were collected October 2012-January 2013. The clinical evaluation demonstrated "very good" (kappa) inter-rater and test-retest agreement for PURPOSE-T assessment decision overall. The percentage agreement for "problem/no problem" was over 75% for the main risk factors. Convergent validity demonstrated moderate to high associations with other measures of similar constructs. The PURPOSE-T evaluation facilitated the initial validation and clinical usability of the instrument and demonstrated that PURPOSE-T is suitable of use in clinical practice. Further study is needed to evaluate the impact of using the instrument on care processes and outcomes. © 2017 The Authors. Journal of Advanced Nursing Published by John Wiley & Sons Ltd.

The Instrument for Measuring the Implementation Situation of Traditional Chinese Medicine Guideline: Evaluation and Application

PubMed Central

Wang, Yangyang; Chen, Yaolong; Wang, Xiaoyun; Deng, Jingwen

2017-01-01

Clinical practice guidelines play an important role in reducing the variations in clinical practices and improving the quality of care. To assess the real effect, measuring its implementation situation is needed. The implementation situation can be reflected by testing the consistency between the actual clinical practice and the guideline. We constructed an instrument to measure the implementation situation of Traditional Chinese Medicine (TCM) guideline through consistency testing. The main objectives of our study were to validate the instrument and evaluate the implementation situation of menopause syndrome guideline of TCM, using the data from the consistency test of comparing the medical records with the guideline. A total of 621 cases were included for data analysis. Cronbach's Alpha coefficient is 0.73. The model fit of 7 items in four dimensions was good (SRMR = 0.04; GFI = 0.97; NFI = 0.97; TLI = 0.96; CFI = 0.98; AGFI = 0.90). This instrument is of good reliability and validity. It can help the guideline developers to measure the implementation situation, find the reasons affecting the implementation, and revise the guideline. The method of using consistency test to measure the implementation situation may provide a sample for evaluating the guideline implementation in other fields. PMID:29234379

[Security material for venous peripheral..catheterization evaluation in an emergency ward].

PubMed

Romero Ruiz, Adolfo; Jiménez Ruiz, Manuel; Rodríguez Navarro, Luis Miguel; Muñoz Pascual, José Carlos; Ramos Rueda, M del Carmen; Torres Pérez, Luis

2007-06-01

Venous canalization can be one of the most frequent causes of accidents due to an accidental puncture. To carry out activities which serve to lessen these misfortunes, bearing high biological risk, should become a priority for sanitary institutions and for their professionals. Inside a global strategy which deals with this aspect and with the objective of evaluating the convenience these instruments have in our center the authors made a practical evaluation on a series of them to discover their technical viability and their subjective consideration by professionals who employ them. For motives related to the practices of the ward in which this research took place, an emergency ward, the authors intentionally chose two passive instruments, available on the market, and three nurses who received 120 sample security catheters, 60 each for products A and B, to carry out habitual clinical practices, alongside a pad of paper on which to record any incidents. Regarding instrument A, 30 incidents, 52.6%, were detected while 37 sample procedures occurred. Regarding instrument B, 4 incidents, 7.01%, were detected while 47 sample procedures occurred. In absolute terms, neither of the two instruments demonstrated problems of an insecure manner; which is to say neither produced a situation related to the appearance of mis fortunate incidents associated to accidental punctures. The lower number of incidents with instrument B appears to be related to the habitual use of a conventional cathetec not a security one, produced by the same manufacturer in our center This research project was subsidized by the Sanitary Research Fund, PI 051265.

Clinical practice guidelines in hypertension: a review.

PubMed

Álvarez-Vargas, Mayita Lizbeth; Galvez-Olortegui, José Kelvin; Galvez-Olortegui, Tomas Vladimir; Sosa-Rosado, José Manuel; Camacho-Saavedra, Luis Arturo

2015-10-23

The aim of this study is the methodological evaluation of Clinical Practice Guidelines (CPG) in hypertension. This is the first in a series of review articles, analysis, assessment in methodology and content of clinical practice guidelines in Cardiology. Of all clinical practice guidelines, three were selected and the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument was used to assess each guide. The guidelines obtained the lowest score in the domain of applicability (mean 43.8%); while the highest score was for clarity of presentation (mean 81.5%). The lowest percentage was found in the applicability domain (European guideline) and the highest of all scores was found in two domains: scope and purpose, and clarity of presentation (Canadian guideline). Assessing the quality of the clinical practice guidelines analyzed, the Canadian is one with the best scores obtained by applying the AGREE II instrument, and it is advised to be used without modifications.

Development and Psychometric Properties of the Nursing Critical Thinking in Clinical Practice Questionnaire.

PubMed

Zuriguel-Pérez, Esperanza; Falcó-Pegueroles, Anna; Roldán-Merino, Juan; Agustino-Rodriguez, Sandra; Gómez-Martín, Maria Del Carmen; Lluch-Canut, Maria Teresa

2017-08-01

A complex healthcare environment, with greater need for care based on the patient and evidence-based practice, are factors that have contributed to the increased need for critical thinking in professional competence. At the theoretical level, Alfaro-LeFevre () put forward a model of critical thinking made up of four components. And although these explain the construct, instruments for their empirical measurement are lacking. The purpose of the study was to develop and validate the psychometric properties of an instrument, the Nursing Critical Thinking in Clinical Practice Questionnaire (N-CT-4 Practice), designed to evaluate the critical thinking abilities of nurses in the clinical setting. A cross-sectional survey design was used. A pool of items was generated for evaluation by a panel of experts who considered their validity for the new instrument, which was finally made up of 109 items. Following this, validation was carried out using a sample of 339 nurses at a hospital in Barcelona, Spain. Reliability was determined by means of internal consistency and test-retest stability over time, although the validity of the construct was assessed by means of confirmatory factor analysis. The content validity index of the N-CT-4 Practice was .85. Cronbach's alpha coefficient for the whole instrument was .96. The intraclass correlation coefficient was .77. Confirmatory factor analysis showed that the instrument was in line with the four-dimensional model proposed by Alfaro-LeFevre (). The psychometric properties of theN-CT-4 Practice uphold its potential for use in measuring critical thinking and in future research related with the examination of critical thinking. © 2017 The Authors Worldviews on Evidence-Based Nursing published by Wiley Periodicals, Inc. on behalf of Sigma Theta Tau International The Honor Society of Nursing.

Instruments to Explore Blended Learning: Modifying a Method to Analyse Online Communication for the Analysis of Face-to-Face Communication

ERIC Educational Resources Information Center

de Leng, Bas A.; Dolmans, Diana H. J. M.; Donkers, H. H. L. M.; Muijtjens, Arno M. M.; van der Vleuten, Cees P. M.

2010-01-01

In the complex practice of today's blended learning, educators need to be able to evaluate both online and face-to-face communication in order to get the full picture of what is going on in blended learning scenarios. The aim of this study was to investigate the reliability and feasibility of a practical instrument for analysing face-to-face…

Cross-cultural adaptation and validation of the Protective Nursing Advocacy Scale for Brazilian nurses 1

PubMed Central

Tomaschewski-Barlem, Jamila Geri; Lunardi, Valéria Lerch; Barlem, Edison Luiz Devos; da Silveira, Rosemary Silva; Dalmolin, Graziele de Lima; Ramos, Aline Marcelino

2015-01-01

Abstract Objective: to adapt culturally and validate the Protective Nursing Advocacy Scale for Brazilian nurses. Method: methodological study carried out with 153 nurses from two hospitals in the South region of Brazil, one public and the other philanthropic. The cross-cultural adaptation of the Protective Nursing Advocacy Scale was performed according to international standards, and its validation was carried out for use in the Brazilian context, by means of factor analysis and Cronbach's alpha as measure of internal consistency. Results: by means of evaluation by a committee of experts and application of pre-test, face validity and content validity of the instrument were considered satisfactory. From the factor analysis, five constructs were identified: negative implications of the advocacy practice, advocacy actions, facilitators of the advocacy practice, perceptions that favor practice advocacy and barriers to advocacy practice. The instrument showed satisfactory internal consistency, with Cronbach's alpha values ranging from 0.70 to 0.87. Conclusion: it was concluded that the Protective Nursing Advocacy Scale - Brazilian version, is a valid and reliable instrument for use in the evaluation of beliefs and actions of health advocacy, performed by Brazilian nurses in their professional practice environment. PMID:26444169

An evaluation of a new instrument to measure organisational safety culture values and practices.

PubMed

Díaz-Cabrera, D; Hernández-Fernaud, E; Isla-Díaz, R

2007-11-01

The main aim of this research is to evaluate a safety culture measuring instrument centred upon relevant organisational values and practices related to the safety management system. Seven dimensions that reflect underlying safety meanings are proposed. A second objective is to explore the four cultural orientations in the field of safety arising from the competing values framework. The study sample consisted of 299 participants from five companies in different sectors. The results show six dimensions of organisational values and practices and different company profiles in the organisations studied. The four cultural orientations proposed by the competing values framework are not confirmed. Nevertheless, a coexistence of diverse cultural orientations or paradoxes in the companies is observed.

Assessment of classification instruments designed to detect alcohol abuse

DOT National Transportation Integrated Search

1988-12-01

The report summarizes an effort to identify and evaluate instruments currently in use to assess substance abuse problems in driving while impaired (DWI) offenders. The results of a national survey of DWI assessment practices in the United States are ...

[Some critical remarks on standardised assessment instruments in nursing].

PubMed

Bartholomeyczik, Sabine

2007-08-01

The use of standardised instruments in nursing has rapidly grown and can be seen as a symptom of the necessary comprehensive nursing diagnostics. However, these instruments comprise the risk of misuse, if they are not critically evaluated. Published statements about tests of reliability and validity of an instrument are insufficient. First, the critical evaluation has to ask for the instrument's theoretical and content base: Is the instrument relevant for nursing, suitable for practice and leading to nursing actions? Two examples of well known instruments and different kinds of their utilization in nursing are discussed. Next, the instruments have to be questioned as "bodies with numbers". Studies on reliability and validity have to be as carefully evaluated as other empirical research. The sample, the suitability of agreement indicators (interraterreliability), kind and reason of tests have to be questioned. The same has to be done with tests of validity which comprise an even greater challenge. Methodological studies about these questions are missing; guidelines for test user qualifications need to be developed.

The Clinimetric Properties of Instruments Measuring Home Hazards for Older People at Risk of Falling: A Systematic Review.

PubMed

Romli, Muhammad Hibatullah; Mackenzie, Lynette; Lovarini, Meryl; Tan, Maw Pin; Clemson, Lindy

2018-03-01

Home hazards are associated with falls among older people living in the community. However, evaluating home hazards is a complex process as environmental factors vary according to geography, culture, and architectural design. As a result, many health practitioners commonly use nonstandardized assessment methods that may lead to inaccurate findings. Thus, the aim of this systematic review was to identify standardized instruments for evaluating home hazards related to falls and evaluate the clinimetric properties of these instruments for use by health practitioners. A systematic search was conducted in the Medline, CINAHL, AgeLine, Web of Science databases, and the University of Sydney Library CrossSearch Engine. Study screening, assessment, and quality ratings were conducted independently. Thirty-six studies were identified describing 19 instruments and three assessment techniques. The clinimetric properties varied between instruments. The Home Falls and Accidents Screening Tool, Home Safety Self-Assessment Tool, In-Home Occupational Performance Evaluation, and Westmead Home Safety Assessment were the instruments with high potential for evaluating home hazards associated with falls. Health practitioners can choose the most appropriate instruments for their practice, as a range of standardized instruments with established clinimetric properties are available.

Teacher Evaluation: Practices and Procedures. ERS Report.

ERIC Educational Resources Information Center

Educational Research Service, Arlington, VA.

This report presents findings of the 1988 Educational Research Service survey of teacher evaluation practices and procedures in U.S. schools. The survey instrument was mailed to a random sample of 1,730 superintendents of school districts of varying size. The response rate was 52.5 percent. The first section discusses the purposes of teacher…

ASSESSMENT OF GOOD PRACTICES IN HOSPITAL FOOD SERVICE BY COMPARING EVALUATION TOOLS.

PubMed

Macedo Gonçalves, Juliana; Lameiro Rodrigues, Kelly; Santiago Almeida, Ângela Teresinha; Pereira, Giselda Maria; Duarte Buchweitz, Márcia Rúbia

2015-10-01

since food service in hospitals complements medical treatment, it should be produced in proper hygienic and sanitary conditions. It is a well-known fact that food-transmitted illnesses affect with greater severity hospitalized and immunosuppressed patients. good practices in hospital food service are evaluated by comparing assessment instruments. good practices were evaluated by a verification list following Resolution of Collegiate Directory n. 216 of the Brazilian Agency for Sanitary Vigilance. Interpretation of listed items followed parameters of RCD 216 and the Brazilian Association of Collective Meals Enterprises (BACME). Fisher's exact test was applied to detect whether there were statistically significant differences. Analysis of data grouping was undertaken with Unweighted Pair-group using Arithmetic Averages, coupled to a correlation study between dissimilarity matrixes to verify disagreement between the two methods. Good Practice was classified with mean total rates above 75% by the two methods. There were statistically significant differences between services and food evaluated by BACME instrument. Hospital Food Services have proved to show conditions of acceptable good practices. the comparison of interpretation tools based on RCD n. 216 and BACME provided similar results for the two classifications. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

Essential elements of the nursing practice environment in nursing homes: Psychometric evaluation.

PubMed

de Brouwer, Brigitte Johanna Maria; Kaljouw, Marian J; Schoonhoven, Lisette; van Achterberg, Theo

2017-06-01

To develop and psychometrically test the Essentials of Magnetism II in nursing homes. Increasing numbers and complex needs of older people in nursing homes strain the nursing workforce. Fewer adequately trained staff and increased care complexity raise concerns about declining quality. Nurses' practice environment has been reported to affect quality of care and productivity. The Essentials of Magnetism II © measures processes and relationships of practice environments that contribute to productivity and quality of care and can therefore be useful in identifying processes requiring change to pursue excellent practice environments. However, this instrument was not explicitly evaluated for its use in nursing home settings so far. In a preparatory phase, a cross-sectional survey study focused on face validity of the essentials of magnetism in nursing homes. A second cross-sectional survey design was then used to further test the instrument's validity and reliability. Psychometric testing included evaluation of content and construct validity, and reliability. Nurses (N = 456) working at 44 units of three nursing homes were included. Respondent acceptance, relevance and clarity were adequate. Five of the eight subscales and 54 of the 58 items did meet preset psychometric criteria. All essentials of magnetism are considered relevant for nursing homes. The subscales Adequacy of Staffing, Clinically Competent Peers, Patient Centered Culture, Autonomy and Nurse Manager Support can be used in nursing homes without problems. The other subscales cannot be directly applied to this setting. The valid subscales of the Essentials of Magnetism II instrument can be used to design excellent nursing practice environments that support nurses' delivery of care. Before using the entire instrument, however, the other subscales have to be improved. © 2016 John Wiley & Sons Ltd.

Development and psychometric evaluation of the Primary Health Care Engagement (PHCE) Scale: a pilot survey of rural and remote nurses.

PubMed

Kosteniuk, Julie G; Wilson, Erin C; Penz, Kelly L; MacLeod, Martha L P; Stewart, Norma J; Kulig, Judith C; Karunanayake, Chandima P; Kilpatrick, Kelley

2016-01-01

To report the development and psychometric evaluation of a scale to measure rural and remote (rural/remote) nurses' perceptions of the engagement of their workplaces in key dimensions of primary health care (PHC). Amidst ongoing PHC reforms, a comprehensive instrument is needed to evaluate the degree to which rural/remote health care settings are involved in the key dimensions that characterize PHC delivery, particularly from the perspective of professionals delivering care. This study followed a three-phase process of instrument development and psychometric evaluation. A literature review and expert consultation informed instrument development in the first phase, followed by an iterative process of content evaluation in the second phase. In the final phase, a pilot survey was undertaken and item discrimination analysis employed to evaluate the internal consistency reliability of each subscale in the preliminary 60-item Primary Health Care Engagement (PHCE) Scale. The 60-item scale was subsequently refined to a 40-item instrument. The pilot survey sample included 89 nurses in current practice who had experience in rural/remote practice settings. Participants completed either a web-based or paper survey from September to December, 2013. Following item discrimination analysis, the 60-item instrument was refined to a 40-item PHCE Scale consisting of 10 subscales, each including three to five items. Alpha estimates of the 10 refined subscales ranged from 0.61 to 0.83, with seven of the subscales demonstrating acceptable reliability (α ⩾ 0.70). The refined 40-item instrument exhibited good internal consistency reliability (α=0.91). The 40-item PHCE Scale may be considered for use in future studies regardless of locale, to measure the extent to which health care professionals perceive their workplaces to be engaged in key dimensions of PHC.

Design criteria monograph for actuators and operators

NASA Technical Reports Server (NTRS)

1974-01-01

Instrumentation for actuators and operators includes electrical position-indicating switches, potentiometers, and transducers and pressure-indicating switches and transducers. Monograph is based on critical evaluation of experiences and practices in design, test, and use of these control devices and instruments in operational space vehicles.

Can a workbook work? Examining whether a practitioner evaluation toolkit can promote instrumental use.

PubMed

Campbell, Rebecca; Townsend, Stephanie M; Shaw, Jessica; Karim, Nidal; Markowitz, Jenifer

2015-10-01

In large-scale, multi-site contexts, developing and disseminating practitioner-oriented evaluation toolkits are an increasingly common strategy for building evaluation capacity. Toolkits explain the evaluation process, present evaluation design choices, and offer step-by-step guidance to practitioners. To date, there has been limited research on whether such resources truly foster the successful design, implementation, and use of evaluation findings. In this paper, we describe a multi-site project in which we developed a practitioner evaluation toolkit and then studied the extent to which the toolkit and accompanying technical assistance was effective in promoting successful completion of local-level evaluations and fostering instrumental use of the findings (i.e., whether programs directly used their findings to improve practice, see Patton, 2008). Forensic nurse practitioners from six geographically dispersed service programs completed methodologically rigorous evaluations; furthermore, all six programs used the findings to create programmatic and community-level changes to improve local practice. Implications for evaluation capacity building are discussed. Copyright © 2015 Elsevier Ltd. All rights reserved.

Instruments to assess the quality of health information on the World Wide Web: what can our patients actually use?

PubMed

Bernstam, Elmer V; Shelton, Dawn M; Walji, Muhammad; Meric-Bernstam, Funda

2005-01-01

To find and assess quality-rating instruments that can be used by health care consumers to assess websites displaying health information. Searches of PubMed, the World Wide Web (using five different search engines), reference tracing from identified articles, and a review of the of the American Medical Informatics Association's annual symposium proceedings. Sources were examined for availability, number of elements, objectivity, and readability. A total of 273 distinct instruments were found and analyzed. Of these, 80 (29%) made evaluation criteria publicly available and 24 (8.7%) had 10 or fewer elements (items that a user has to assess to evaluate a website). Seven instruments consisted of elements that could all be evaluated objectively. Of these seven, one instrument consisted entirely of criteria with acceptable interobserver reliability (kappa> or =0.6); another instrument met readability standards. There are many quality-rating instruments, but few are likely to be practically usable by the intended audience.

[Systemic validation of clinical practice guidelines: the AGREE network].

PubMed

Hannes, K; Van Royen, P; Aertgeerts, B; Buntinx, F; Ramaekers, D; Chevalier, P

2005-12-01

Over recent decades, the number of available clinical practice guidelines has enormously grown. Guidelines should meet specific quality criteria to ensure good quality. There is a growing need for the developement of a set of criteria to ensure that potential biases inherent in guideline development have been properly addressed and that the recommendations for practice are valid and reliable. The AGREE-collaboration is an international network that developed an instrument to critically appraise the methodological quality of guidelines. AGREE promotes a clear strategy to produce, disseminate and evaluate guidelines of high quality. In the first phase of the international project the AGREE-instrument was tested in 11 different countries. Based on this experience the instrument was refined and optimised. In the second phase it was disseminated, promoted and evaluated in 18 participating countries. Belgium was one of them. The Belgian partner in the AGREE-project developed 3 workshops and established 13 validation committees to validate guidelines from Belgian developer groups. We collected 33 questionnaires from participants of the workshops and the validation committees, in which we asked for primary experiences and information on the usefulness and applicability of the instrument. We were also interested in the shortcomings of the instrument and potential strategies to bridge them. More efforts should be made to train methodological experts to gain certain skills for a critical appraisal of clinical practice guidelines. Promoting the AGREE-instrument will lead to a broader knowledge and use of quality criteria in guideline development and appraisal. The development and dissemination of an international list of criteria to appraise the quality of guidelines will stimulate the development of methodologically sound guidelines. International comparisons between existing guidelines will lead to a better collaboration between guideline developers throughout the world.

Status Report on Speech Research: A Report on the Status and Progress of Studies on the Nature of Speech, Instrumentation for its Investigation, and Practical Applications, April 1-September 30, 1983.

ERIC Educational Resources Information Center

Studdert-Kennedy, Michael, Ed.; O'Brien, Nancy, Ed.

Prepared as part of a regular series on the status and progress of studies on the nature of speech, instrumentation for its evaluation, and practical applications for speech research, this compilation contains 14 reports. Topics covered in the reports include the following: (1) phonetic coding and order memory in relation to reading proficiency,…

Designing and Piloting a Leadership Daily Practice Log: Using Logs to Study the Practice of Leadership

ERIC Educational Resources Information Center

Spillane, James P.; Zuberi, Anita

2009-01-01

Purpose: This article aims to validate the Leadership Daily Practice (LDP) log, an instrument for conducting research on leadership in schools. Research Design: Using a combination of data sources--namely, a daily practice log, observations, and open-ended cognitive interviews--the authors evaluate the validity of the LDP log. Participants: Formal…

Home blood pressure monitoring and self-titration of antihypertensive medications: Proposed patient selection criteria.

PubMed

Hill, James R

2016-05-01

Recent studies have demonstrated that home blood pressure monitoring (HBPM), coupled with self-titration of medications is a viable intervention to control hypertension. There are currently no established criteria to evaluate patients for inclusion in such a program. The purpose of this discussion is to propose criteria for determining if a patient is appropriate to participate in a program of HBPM and self-titration. Inclusion criteria for two self-titration trials were examined, and additional factors in clinical practice were identified and discussed. Additional selection criteria were proposed to support the decision to enroll a patient in an antihypertensive self-titration program. Inclusion criteria from self-titration trials provide a reasonable starting point for choosing appropriate patients in clinical practice, but additional research is necessary. Adaptation of these criteria and consideration of the identified factors can be used to develop decision support instruments. Such instruments should be evaluated for effectiveness and reliability prior to use in clinical practice. HBPM combined with self-titration is an effective patient-centered approach for hypertension management. Decision support instruments to determine appropriate patients are necessary for safe and effective use in clinical practice. ©2015 American Association of Nurse Practitioners.

Development and analysis of an instrument to assess student understanding of GOB chemistry knowledge relevant to clinical nursing practice.

PubMed

Brown, Corina E; Hyslop, Richard M; Barbera, Jack

2015-01-01

The General, Organic, and Biological Chemistry Knowledge Assessment (GOB-CKA) is a multiple-choice instrument designed to assess students' understanding of the chemistry topics deemed important to clinical nursing practice. This manuscript describes the development process of the individual items along with a psychometric evaluation of the final version of the items and instrument. In developing items for the GOB-CKA, essential topics were identified through a series of expert interviews (with practicing nurses, nurse educators, and GOB chemistry instructors) and confirmed through a national survey. Individual items were tested in qualitative studies with students from the target population for clarity and wording. Data from pilot and beta studies were used to evaluate each item and narrow the total item count to 45. A psychometric analysis performed on data from the 45-item final version was used to provide evidence of validity and reliability. The final version of the instrument has a Cronbach's alpha value of 0.76. Feedback from an expert panel provided evidence of face and content validity. Convergent validity was estimated by comparing the results from the GOB-CKA with the General-Organic-Biochemistry Exam (Form 2007) of the American Chemical Society. Instructors who wish to use the GOB-CKA for teaching and research may contact the corresponding author for a copy of the instrument. © 2014 Wiley Periodicals, Inc.

Construct validity and internal consistency in the Leisure Practices Scale (EPL) for adults.

PubMed

Andrade, Rubian Diego; Schwartz, Gisele Maria; Tavares, Giselle Helena; Pelegrini, Andreia; Teixeira, Clarissa Stefani; Felden, Érico Pereira Gomes

2018-02-01

This study proposes and analyzes the construct validity and internal consistency of the Leisure Practices Scale (EPL). This survey seeks to identify the preferences and involvement in in different leisure practices in adults. The instrument was formed based on the cultural leisure content (artistic, manual, physical, sports, intellectual, social, tourist, virtual and contemplation/leisure). The validation process was conducted with: a) content analysis by leisure experts, who evaluated the instrument for clarity of language and practical relevance, which allowed the calculation of the content validity coefficient (CVC); b) reproducibility test-retest with 51 subjects to calculate the temporal variation coefficient; c) internal consistency analysis with 885 participants. The evaluation presented appropriate coefficients, both with respect to language clarity (CVCt = 0.883) and practical relevance (CVCt = 0.879). The reproducibility coefficients were moderate to excellent. The scale showed adequate internal consistency (0.72). The EPL has psychometric quality and acceptable values in its structure, and can be used to investigate adult involvement in leisure activities.

Effectiveness of Teamwork in an Integrated Care Setting for Patients with COPD: Development and Testing of a Self-Evaluation Instrument for Interprofessional Teams.

PubMed

Van Dijk-de Vries, Anneke N; Duimel-Peeters, Inge G P; Muris, Jean W; Wesseling, Geertjan J; Beusmans, George H M I; Vrijhoef, Hubertus J M

2016-04-08

Teamwork between healthcare providers is conditional for the delivery of integrated care. This study aimed to assess the usefulness of the conceptual framework Integrated Team Effectiveness Model for developing and testing of the Integrated Team Effectiveness Instrument. Focus groups with healthcare providers in an integrated care setting for people with chronic obstructive pulmonary disease (COPD) were conducted to examine the recognisability of the conceptual framework and to explore critical success factors for collaborative COPD practice out of this framework. The resulting items were transposed into a pilot instrument. This was reviewed by expert opinion and completed 153 times by healthcare providers. The underlying structure and internal consistency of the instrument were verified by factor analysis and Cronbach's alpha. The conceptual framework turned out to be comprehensible for discussing teamwork effectiveness. The pilot instrument measures 25 relevant aspects of teamwork in integrated COPD care. Factor analysis suggested three reliable components: teamwork effectiveness, team processes and team psychosocial traits (Cronbach's alpha between 0.76 and 0.81). The conceptual framework Integrated Team Effectiveness Model is relevant in developing a practical full-spectrum instrument to facilitate discussing teamwork effectiveness. The Integrated Team Effectiveness Instrument provides a well-founded basis to self-evaluate teamwork effectiveness in integrated COPD care by healthcare providers. Recommendations are provided for the improvement of the instrument.

Feedback-giving behaviour in performance evaluations during clinical clerkships.

PubMed

Bok, Harold G J; Jaarsma, Debbie A D C; Spruijt, Annemarie; Van Beukelen, Peter; Van Der Vleuten, Cees P M; Teunissen, Pim W

2016-01-01

Narrative feedback documented in performance evaluations by the teacher, i.e. the clinical supervisor, is generally accepted to be essential for workplace learning. Many studies have examined factors of influence on the usage of mini-clinical evaluation exercise (mini-CEX) instruments and provision of feedback, but little is known about how these factors influence teachers' feedback-giving behaviour. In this study, we investigated teachers' use of mini-CEX in performance evaluations to provide narrative feedback in undergraduate clinical training. We designed an exploratory qualitative study using an interpretive approach. Focusing on the usage of mini-CEX instruments in clinical training, we conducted semi-structured interviews to explore teachers' perceptions. Between February and June 2013, we conducted interviews with 14 clinicians participated as teachers during undergraduate clinical clerkships. Informed by concepts from the literature, we coded interview transcripts and iteratively reduced and displayed data using template analysis. We identified three main themes of interrelated factors that influenced teachers' practice with regard to mini-CEX instruments: teacher-related factors; teacher-student interaction-related factors, and teacher-context interaction-related factors. Four issues (direct observation, relationship between teacher and student, verbal versus written feedback, formative versus summative purposes) that are pertinent to workplace-based performance evaluations were presented to clarify how different factors interact with each other and influence teachers' feedback-giving behaviour. Embedding performance observation in clinical practice and establishing trustworthy teacher-student relationships in more longitudinal clinical clerkships were considered important in creating a learning environment that supports and facilitates the feedback exchange. Teachers' feedback-giving behaviour within the clinical context results from the interaction between personal, interpersonal and contextual factors. Increasing insight into how teachers use mini-CEX instruments in daily practice may offer strategies for creating a professional learning culture in which feedback giving and seeking would be enhanced.

An Assessment Instrument to Measure Geospatial Thinking Expertise

ERIC Educational Resources Information Center

Huynh, Niem Tu; Sharpe, Bob

2013-01-01

Spatial thinking is fundamental to the practice and theory of geography, however there are few valid and reliable assessment methods in geography to measure student performance in spatial thinking. This article presents the development and evaluation of a geospatial thinking assessment instrument to measure participant understanding of spatial…

Design, Validation, and Use of an Evaluation Instrument for Monitoring Systemic Reform.

ERIC Educational Resources Information Center

Scantlebury, Kathryn; Boone, William; Kahle, Jane Butler; Fraser, Barry J.

2001-01-01

Describes the design, development, validation, and use of an instrument that measures student attitudes and several environmental dimensions (i.e., standards-based teaching, home support, and peer support). Indicates that the classroom environment (standards-based teaching practices) was the strongest independent predictor of both achievement and…

Diabetes-related emotional distress instruments: a systematic review of measurement properties.

PubMed

Lee, Jiyeon; Lee, Eun-Hyun; Kim, Chun-Ja; Moon, Seung Hei

2015-12-01

The objectives of this study were to identify all available diabetes-related emotional distress instruments and evaluate the evidence regarding their measurement properties to help in the selection of the most appropriate instrument for use in practice and research. A systematic literature search was performed. PubMed, Embase, CINAHL, and PsycINFO were searched systematically for articles on diabetes-related emotional distress instruments. The Consensus-based Standards for the Selection of Health Measurement Instruments checklist was used to evaluate the methodological quality of the identified studies. The quality of results with respect to the measurement properties of each study was evaluated using Terwee's quality criteria. An ancillary meta-analysis was performed. Of the 2345 articles yielded by the search, 19 full-text articles evaluating 6 diabetes-related emotional distress instruments were included in this study. No instrument demonstrated evidence for all measurement properties. The Problem Areas in Diabetes scale (PAID) was the most frequently studied and the best validated of the instruments. Pooled summary estimates of the correlation coefficient between the PAID and serum glycated hemoglobin revealed a positive but weak correlation. No diabetes-related emotional distress instrument demonstrated evidence for all measurement properties. No instrument was better than another, although the PAID was the best validated and is thus recommended for use. Further psychometric studies of the diabetes-related emotional distress instruments with rigorous methodologies are required. Copyright © 2015 Elsevier Ltd. All rights reserved.

Development and evaluation of the content validity, practicability and feasibility of the Innovative dementia-oriented Assessment system for challenging behaviour in residents with dementia.

PubMed

Halek, Margareta; Holle, Daniela; Bartholomeyczik, Sabine

2017-08-14

One of the most difficult issues for care staff is the manifestation of challenging behaviour among residents with dementia. The first step in managing this type of behaviour is analysing its triggers. A structured assessment instrument can facilitate this process and may improve carers' management of the situation. This paper describes the development of an instrument designed for this purpose and an evaluation of its content validity and its feasibility and practicability in nursing homes. The development process and evaluation of the content validity were based on Lynn's methodology (1998). A literature review (steps 1 + 2) provided the theoretical framework for the instrument and for item formation. Ten experts (step 3) evaluated the first version of the instrument (the Innovative dementia-oriented Assessment (IdA®)) regarding its relevance, clarity, meaningfulness and completeness; content validity indices at the scale-level (S-CVI) and item-level (I-CVI) were calculated. Health care workers (step 4) evaluated the second version in a workshop. Finally, the instrument was introduced to 17 units in 11 nursing homes in a field study (step 5), and 60 care staff members assessed its practicability and feasibility. The IdA® used the need-driven dementia-compromised behaviour (NDB) model as a theoretical framework. The literature review and expert-based panel supported the content validity of the IdA®. At the item level, 77% of the ratings had a CVI greater than or equal to 0.78. The majority of the question-ratings (84%, n = 154) and answer-ratings (69%, n = 122) showed valid results, with none below 0.50. The health care workers confirmed the understandability, completeness and plausibility of the IdA®. Steps 3 and 4 led to further item clarification. The carers in the study considered the instrument helpful for reflecting challenging behaviour and beneficial for the care of residents with dementia. Negative ratings referred to the time required and the lack of effect on residents´ behaviour. There was strong evidence supporting the content validity of the IdA®. Despite the substantial length and time requirement, the instrument was considered helpful for analysing challenging behaviour. Thus, further research on the psychometric qualities, implementation aspects and effectiveness of the IdA® in understanding challenging behaviour is needed.

[An instrument in Spanish to evaluate the performance of clinical teachers by students].

PubMed

Bitran, Marcela; Mena, Beltrán; Riquelme, Arnoldo; Padilla, Oslando; Sánchez, Ignacio; Moreno, Rodrigo

2010-06-01

The modernization of clinical teaching has called for the creation of faculty development programs, and the design of suitable instruments to evaluate clinical teachers' performance. To report the development and validation of an instrument in Spanish designed to measure the students' perceptions of their clinical teachers' performance and to provide them with feedback to improve their teaching practices. In a process that included the active participation of authorities, professors in charge of courses and internships, clinical teachers, students and medical education experts, we developed a 30-item questionnaire called MEDUC30 to evaluate the performance of clinical teachers by their students. The internal validity was assessed by factor analysis of 5214 evaluations of 265 teachers, gathered from 2004 to 2007. The reliability was measured with the Cronbach's alpha coefficient and the generalizability coefficient (g). MEDUC30 had good content and construct validity. Its internal structure was compatible with four factors: patient-centered teaching, teaching skills, assessment skills and learning climate, and it proved to be consistent with the structure anticipated by the theory. The scores were highly reliable (Cronbach's alpha: 0.97); five evaluations per teacher were sufficient to reach a reliability coefficient (g) of 0.8. MEDUC30 is a valid, reliable and useful instrument to evaluate the performance of clinical teachers. To our knowledge, this is the first instrument in Spanish for which solid validity and reliability evidences have been reported. We hope that MEDUC30 will be used to improve medical education in Spanish-speaking medical schools, providing teachers a specific feedback upon which to improve their pedagogical practice, and authorities with valuable information for the assessment of their faculty.

Development and validation of EMP-3: an instrument to measure physician's attitudes toward ethnic minority patients.

PubMed

De Maesschalck, Stephanie; Willems, Sara; De Maeseneer, Jan; Deveugele, Myriam

2010-04-01

The growing diversity of patient populations challenges health care providers. Physicians' attitudes and perceptions toward cultural diversity in health care could be partly contributing to difficulties in communication between physicians and ethnic minority patients. To evaluate these attitudes and perceptions, an instrument was developed and validated. A preliminary version of the instrument was developed through literature research and expert consultation and completed by 112 family physicians. Factor analysis was performed and reliability and construct validity tested. The instrument revealed three factors that were interpreted as: (1) physicians' task perception and ideas on cultural differences in health and health care, (2) physicians' attitudes toward physician-patient communication with minority patients, and (3) physicians' perception of minority patients' needs in communication. Moderate but significant correlations were found between factors of the EMP-3 and practice organization, practice location, and physicians' gender. Several factors of the Jefferson Empathy Scale, the Patient Practitioner Orientation Scale, and the Health Beliefs and Attitude Scale related to the first two factors of the EMP-3. This instrument, designed specifically to measure physicians' attitudes toward cultural diversity, showed moderate validity and reliability results. Further adaptations and evaluation could be useful.

Development and evaluation of an instrument for assessing brief behavioral change interventions.

PubMed

Strayer, Scott M; Martindale, James R; Pelletier, Sandra L; Rais, Salehin; Powell, Jon; Schorling, John B

2011-04-01

To develop an observational coding instrument for evaluating the fidelity and quality of brief behavioral change interventions based on the behavioral theories of the 5 A's, Stages of Change and Motivational Interviewing. Content and face validity were assessed prior to an intervention where psychometric properties were evaluated with a prospective cohort of 116 medical students. Properties assessed included the inter-rater reliability of the instrument, internal consistency of the full scale and sub-scales and descriptive statistics of the instrument. Construct validity was assessed based on student's scores. Inter-rater reliability for the instrument was 0.82 (intraclass correlation). Internal consistency for the full scale was 0.70 (KR20). Internal consistencies for the sub-scales were as follows: MI intervention component (KR20=.7); stage-appropriate MI-based intervention (KR20=.55); MI spirit (KR20=.5); appropriate assessment (KR20=.45) and appropriate assisting (KR20=.56). The instrument demonstrated good inter-rater reliability and moderate overall internal consistency when used to assess performing brief behavioral change interventions by medical students. This practical instrument can be used with minimal training and demonstrates promising psychometric properties when evaluated with medical students counseling standardized patients. Further testing is required to evaluate its usefulness in clinical settings. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

The MacArthur Competence Assessment Tool-Fitness to Plead: a preliminary evaluation of a research instrument for assessing fitness to plead in England and Wales.

PubMed

Akinkunmi, Akintunde A

2002-01-01

This study concerns the preliminary evaluation of an instrument, the MacArthur Competence Assessment Tool-Fitness to Plead (MacCAT-FP), for assessing competence to stand trial, according to the legal requirements in England and Wales. The purposes of the study were to ascertain whether the instrument can be administered practically to groups of prisoners, both those with mental illness and those without; to examine its internal consistency and interrater reliability; to determine whether it can distinguish between fit and unfit individuals, as judged by expert forensic psychiatrists; and to discover whether it is sensitive to changes over time. The instrument was administered to two groups of remanded prisoners: those transferred to psychiatric units for treatment and those without mental illness. In addition to the MacCAT-FP, scales measuring symptom severity and IQ were administered to all participants. Results suggest that the instrument is practical, with good internal consistency and interrater reliability. The correlation of scores with psychiatrists' opinions as to fitness was 0.77. Scores of unfit patients were significantly different from those of fit individuals. The instrument was able to detect significant differences in scores over time. It is suggested that once the instrument has been further validated for research purposes, it may be developed for clinical application.

Training Evaluation as an Integral Component of Training for Performance.

ERIC Educational Resources Information Center

Lapp, H. J., Jr.

A training evaluation system should address four major areas: reaction, learning, behavior, and results. The training evaluation system at GPU Nuclear Corporation addresses each of these areas through practical approaches such as course and program evaluation. GPU's program evaluation instrument uses a Likert-type scale to assess task development,…

Organizational attributes and screening and brief intervention in primary care.

PubMed

Nemeth, Lynne S; Miller, Peter M; Nietert, Paul J; Ornstein, Steven M; Wessell, Andrea M; Jenkins, Ruth G

2013-11-01

Overconsumption of alcohol is well known to lead to numerous health and social problems. Prevalence studies of United States adults found that 20% of patients meet criteria for an alcohol use disorder. Routine screening for alcohol use is recommended in primary care settings, yet little is known about the organizational factors that are related to successful implementation of screening and brief intervention (SBI) and treatment in these settings. The purpose of this study was to evaluate organizational attributes in primary care practices that were included in a practice-based research network trial to implement alcohol SBI. The Survey of Organizational Attributes in Primary Care (SOAPC) has reliably measured four factors: communication, decision-making, stress/chaos and history of change. This 21-item instrument was administered to 178 practice members at the baseline of this trial, to evaluate for relationship of organizational attributes to the implementation of alcohol SBI and treatment. No significant relationships were found correlating alcohol screening, identification of high-risk drinkers and brief intervention, to the factors measured in the SOAPC instrument. These results highlight the challenges related to the use of organizational survey instruments in explaining or predicting variations in clinical improvement. Comprehensive mixed methods approaches may be more effective in evaluations of the implementation of SBI and treatment. Copyright © 2013 Elsevier Ltd. All rights reserved.

The Academic Success Inventory for College Students: Scale Development and Practical Implications for Use with Students

ERIC Educational Resources Information Center

Prevatt, Frances; Li, Huijun; Welles, Theresa; Festa-Dreher, Desaree; Yelland, Sherry; Lee, Jiyoon

2011-01-01

The Academic Success Inventory for College Students (ASICS) is a newly-developed, self-report instrument designed to evaluate academic success in college students. The 50-item instrument has 10 factors that measure general academic skills, career decidedness, internal and external motivation, anxiety, concentration, socializing, personal…

Effectiveness of Teamwork in an Integrated Care Setting for Patients with COPD: Development and Testing of a Self-Evaluation Instrument for Interprofessional Teams

PubMed Central

Van Dijk-de Vries, Anneke N.; Duimel-Peeters, Inge G. P.; Muris, Jean W.; Wesseling, Geertjan J.; Beusmans, George H. M. I.

2016-01-01

Introduction: Teamwork between healthcare providers is conditional for the delivery of integrated care. This study aimed to assess the usefulness of the conceptual framework Integrated Team Effectiveness Model for developing and testing of the Integrated Team Effectiveness Instrument. Theory and methods: Focus groups with healthcare providers in an integrated care setting for people with chronic obstructive pulmonary disease (COPD) were conducted to examine the recognisability of the conceptual framework and to explore critical success factors for collaborative COPD practice out of this framework. The resulting items were transposed into a pilot instrument. This was reviewed by expert opinion and completed 153 times by healthcare providers. The underlying structure and internal consistency of the instrument were verified by factor analysis and Cronbach’s alpha. Results: The conceptual framework turned out to be comprehensible for discussing teamwork effectiveness. The pilot instrument measures 25 relevant aspects of teamwork in integrated COPD care. Factor analysis suggested three reliable components: teamwork effectiveness, team processes and team psychosocial traits (Cronbach’s alpha between 0.76 and 0.81). Conclusions and discussion: The conceptual framework Integrated Team Effectiveness Model is relevant in developing a practical full-spectrum instrument to facilitate discussing teamwork effectiveness. The Integrated Team Effectiveness Instrument provides a well-founded basis to self-evaluate teamwork effectiveness in integrated COPD care by healthcare providers. Recommendations are provided for the improvement of the instrument. PMID:27616953

A mixed methods approach to adapting health-related quality of life measures for use in routine oncology clinical practice.

PubMed

Harley, Clare; Takeuchi, Elena; Taylor, Sally; Keding, Ada; Absolom, Kate; Brown, Julia; Velikova, Galina

2012-04-01

The current study reviewed and adapted existing health-related quality of life (HRQoL) instruments for use in routine clinical practice delivering outpatient chemotherapy for colorectal, breast and gynaecological cancers. 564 (288 gynaecological, 208 breast and 68 colorectal) outpatient consultations of 141 patients were audio-recorded and analysed to identify discussed issues. Issues were ranked from most to least commonly discussed within each disease group. Existing HRQoL instruments were evaluated against these lists and best fitting items entered into cancer-specific item banks. Item banks were evaluated during semi-structured interviews by twenty-one oncologists (13 consultants and 8 specialist registrars), four clinical nurse specialists and thirty patients, from breast, gynaecological and colorectal cancer practices. Pilot questionnaires were completed by 448 (145 breast, 148 gynaecological and 155 colorectal) patients attending outpatient clinics. Item selection and scale reliability was explored using descriptive data and psychometric methods alongside qualitative patient and clinician ratings. Each questionnaire includes five physical and three psychosocial function scales each with good internal consistency reliability (α > 0.70) plus disease-specific individual-symptom items identified as useful in clinical practice. Three cancer-specific health-related quality of life measures were developed for use in routine clinical practice. Initial analyses suggest good clinical utility and acceptable psychometric properties for the new instruments.

Practical strategies for nursing education program evaluation.

PubMed

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Cultivation mode research of practical application talents for optical engineering major

NASA Astrophysics Data System (ADS)

Liu, Zhiying

2017-08-01

The requirements on science and technology graduates are more and higher with modern science progress and society market economy development. Because optical engineering major is with very long practicality, practice should be paid more attention from analysis of optical engineering major and students' foundation. To play role of practice to a large amount, the practice need be systemic and correlation. It should be combination of foundation and profundity. Modern foundation professional knowledge is studied with traditional optical concept and technology at the same time. Systemic regularity and correlation should be embodied in the contents. Start from basic geometrical optics concept, the optical parameter of optical instrument is analyzed, the optical module is built and ray tracing is completed during geometrical optics practice. With foundation of primary aberration calculation, the optical system is further designed and evaluated during optical design practice course. With the optical model and given instrument functions and requirements, the optical-mechanism is matched. The accuracy is calculated, analyzed and distributed in every motion segment. And the mechanism should guarantee the alignment and adjustment. The optical mechanism is designed during the instrument and element design practice. When the optical and mechanism drawings are completed, the system is ready to be fabricated. Students can complete grinding, polishing and coating process by themselves through optical fabricating practice. With the optical and mechanical elements, the system can be assembled and aligned during the thesis practice. With a set of correlated and logical practices, the students can acquire the whole process knowledge about optical instrument. All details are contained in every practice process. These practical experiences provide students working ability. They do not need much adaption anymore when they go to work after graduation. It is favorable to both student talents and employer.

Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project.

PubMed

2003-02-01

International interest in clinical practice guidelines has never been greater but many published guidelines do not meet the basic quality requirements. There have been renewed calls for validated criteria to assess the quality of guidelines. To develop and validate an international instrument for assessing the quality of the process and reporting of clinical practice guideline development. The instrument was developed through a multi-staged process of item generation, selection and scaling, field testing, and refinement procedures. 100 guidelines selected from 11 participating countries were evaluated independently by 194 appraisers with the instrument. Following refinement the instrument was further field tested on three guidelines per country by a new set of 70 appraisers. The final version of the instrument contained 23 items grouped into six quality domains with a 4 point Likert scale to score each item (scope and purpose, stakeholder involvement, rigour of development, clarity and presentation, applicability, editorial independence). 95% of appraisers found the instrument useful for assessing guidelines. Reliability was acceptable for most domains (Cronbach's alpha 0.64-0.88). Guidelines produced as part of an established guideline programme had significantly higher scores on editorial independence and, after the publication of a national policy, had significantly higher quality scores on rigour of development (p<0.005). Guidelines with technical documentation had higher scores on that domain (p<0.0001). This is the first time an appraisal instrument for clinical practice guidelines has been developed and tested internationally. The instrument is sensitive to differences in important aspects of guidelines and can be used consistently and easily by a wide range of professionals from different backgrounds. The adoption of common standards should improve the consistency and quality of the reporting of guideline development worldwide and provide a framework to encourage international comparison of clinical practice guidelines.

Graduate nursing students' evaluation of EBP courses: a cross-sectional study.

PubMed

Zelenikova, Renata; Beach, Michael; Ren, Dianxu; Wolff, Emily; Sherwood, Paula R

2015-01-01

There is a lack of appropriate tools for assessing the effectiveness of teaching evidence-based practice in nursing. The objective of the study was to develop the instrument evaluating the students' perception of the effectiveness of EBP courses and to verify its psychometric properties. A descriptive cross-sectional study design was used to verify psychometric properties of the questionnaire measuring the students' perception of the effectiveness of EBP courses. The psychometric properties were evaluated in a group of 129 graduate nursing students who completed EBP courses. The instrument for measuring the students' perception of the effectiveness of EBP courses was inspired by Kirkpatrick's evaluation model, which advocates evaluating interventions at four levels - reaction (satisfaction), learning, behavior change (transfer) and results (benefits). A web-based survey was used for data collection. Data was collected from the middle of January 2013 through the end of March 2013. A thirteen item instrument was developed for measuring the students' perception of the effectiveness of EBP courses. The internal consistency of the scale, based on standardized Cronbach's alpha, was .93. The results of factor analysis identified three factors of the instrument. The highest rated items on a scale of 1 (strongly disagree) to 7 (strongly agree) were 'implementation of EBP can improve clinical care' (mean 6.16), 'EBP instructors had a thorough knowledge of EBP' (6.13), 'EBP instructors were enthusiastic about teaching EBP' (5.65), and 'I can use my EBP knowledge and skills in my practice' (5.58). The results of testing of the psychometric properties of the questionnaire showed at least satisfactory validity and reliability. The majority of students perceived EBP courses as effective. The instrument may be used to assess the students' perception of the effectiveness of EBP courses. Copyright © 2014 Elsevier Ltd. All rights reserved.

Development and validation of instrument for ergonomic evaluation of tablet arm chairs

PubMed Central

Tirloni, Adriana Seára; dos Reis, Diogo Cunha; Bornia, Antonio Cezar; de Andrade, Dalton Francisco; Borgatto, Adriano Ferreti; Moro, Antônio Renato Pereira

2016-01-01

The purpose of this study was to develop and validate an evaluation instrument for tablet arm chairs based on ergonomic requirements, focused on user perceptions and using Item Response Theory (IRT). This exploratory study involved 1,633 participants (university students and professors) in four steps: a pilot study (n=26), semantic validation (n=430), content validation (n=11) and construct validation (n=1,166). Samejima's graded response model was applied to validate the instrument. The results showed that all the steps (theoretical and practical) of the instrument's development and validation processes were successful and that the group of remaining items (n=45) had a high consistency (0.95). This instrument can be used in the furniture industry by engineers and product designers and in the purchasing process of tablet arm chairs for schools, universities and auditoriums. PMID:28337099

Intimate Partner Violence Programs in a Children's Hospital: Comprehensive Assessment Utilizing a Delphi Instrument.

PubMed

Randell, Kimberly A; Evans, Sarah E; O'Malley, Donna; Dowd, M Denise

2015-03-01

The purpose of this study was to conduct a baseline assessment of intimate partner violence (IPV) practices in a pediatric hospital system. The Delphi Instrument for Hospital-based Domestic Violence Programs was used to assess the structure and components of the hospital system's IPV practices. Through key stakeholder interviews, we also assessed IPV practices in individual patient care areas. Qualitative analysis of interview data used a grounded theory approach. The hospital scored 17 of 100 points on the Delphi instrument assessment. Key areas of weakness identified by the Delphi instrument and interviews included lack of coordinated provider training and evaluation of IPV-related processes and no standards for IPV screening, safety assessment, and documentation. Most interviewees supported addressing IPV; all identified barriers to IPV screening at individual provider and institutional levels. Institutional barriers included lack of a standardized response to IPV disclosure, need for individualized screening protocols for different patient care settings, lack of standardized provider training, concerns about overextending social work resources, and lack of resources for hospital staff experiencing vicarious trauma. Individual barriers included concern that screening may harm physician-patient-family relationships and the perception that physicians are unwilling to address psychosocial issues. The Delphi Instrument for Hospital-based Domestic Violence Programs identified weaknesses and key areas for improvement in IPV practices. Deficiencies revealed by the Delphi instrument were affirmed by individual interview results. Institutional and individual provider level barriers must be addressed to optimize IPV practices in a pediatric hospital system. Copyright © 2015 by the American Academy of Pediatrics.

[Goals, possibilities and limits of quality evaluation of guidelines. A background report on the user manual of the "Methodological Quality of Guidelines" check list].

PubMed

Helou, A; Ollenschläger, G

1998-06-01

Recently a German appraisal instrument for clinical guidelines was published that could be used by various parties in formal evaluation of guidelines. An user's guide to the appraisal instrument was designed that contains a detailed explanation for each question to ensure that the instrument is interpreted consistently. This paper describes the purposes, format and contents of the user's guide, and reviews the key factors influencing the validity of guidelines. Taking into account international experiences, the purposes, chances and methodological limitations of a prospective assessment of clinical practice guidelines are discussed.

Self-Evaluation Manual for School Business Management.

ERIC Educational Resources Information Center

Pennsylvania Association of School Business Officials, Harrisburg.

To augment the Pennsylvania Association of School Business Officials in the establishment of the highest standards and practices in school business administration, this manual provides an evaluation instrument of school business functions. Each of the 18 self-evaluation chapters is structured to be used independently and may be utilized in any…

An Evaluation of Digital Stories Created for Social Studies Teaching

ERIC Educational Resources Information Center

Seker, Burcu Sezginsoy

2016-01-01

Digital stories are useful tools for combining technology with education, in terms of the preparation stage, practicality, availability and usability as an evaluation instrument. In this study, digital stories created in a social studies teaching class were evaluated and the opinions of primary school teacher candidates were obtained concerning…

Alumni-based evaluation of a novel veterinary curriculum: are Nottingham graduates prepared for clinical practice?

PubMed Central

Cobb, K. A.; Brown, G. A.; Hammond, R. H.; Mossop, L. H.

2015-01-01

Introduction Outcomes-based education has been the core of the curriculum strategy of the Nottingham School of Veterinary Medicine and Science (SVMS) since its inception in 2006. As part of the ongoing curriculum evaluation, the first two graduating cohorts were invited to provide an appraisal of their preparation by the SVMS curriculum for their role in clinical practice. This paper provides brief accounts of the SVMS curriculum model, the development of the evaluation instrument and the findings of the alumni survey. Materials and Methods The evaluation instrument contained 25 attributes expected of SVMS graduates. Alumni rated their preparation for practice in relation to each attribute. Results The four highest rated characteristics were compassion for animals and the application of ethics to animal welfare; communication skills; recognising own limitations and seeking help and advice where needed and clinical examination skills. The four lowest rated were clinical case management and therapeutic strategies; dealing with veterinary public health and zoonotic issues; knowledge of current veterinary legislation and dealing with emergency and critical care cases. Free text responses were in line with these quantitative findings. Conclusion The results indicate that this sample of SVMS graduates were satisfied with their undergraduate education and felt well prepared for their role in clinical practice. PMID:26392910

Evaluating walking in patients with multiple sclerosis: which assessment tools are useful in clinical practice?

PubMed

Bethoux, Francois; Bennett, Susan

2011-01-01

Walking limitations are among the most visible manifestations of multiple sclerosis (MS). Regular walking assessments should be a component of patient management and require instruments that are appropriate from the clinician's and the patient's perspectives. This article reviews frequently used instruments to assess walking in patients with MS, with emphasis on their validity, reliability, and practicality in the clinical setting. Relevant articles were identified based on PubMed searches using the following terms: "multiple sclerosis AND (walking OR gait OR mobility OR physical activity) AND (disability evaluation)"; references of relevant articles were also searched. Although many clinician- and patient-driven instruments are available, not all have been validated in MS, and some are not sensitive enough to detect small but clinically important changes. Choosing among these depends on what needs to be measured, psychometric properties, the clinical relevance of results, and practicality with respect to space, time, and patient burden. Of the instruments available, the clinician-observed Timed 25-Foot Walk and patient self-report 12-Item Multiple Sclerosis Walking Scale have properties that make them suitable for routine evaluation of walking performance. The Dynamic Gait Index and the Timed Up and Go test involve other aspects of mobility, including balance. Tests of endurance, such as the 2- or 6-Minute Walk, may provide information on motor fatigue not captured by other tests. Quantitative measurement of gait kinetics and kinematics, and recordings of mobility in the patient's environment via accelerometry or Global Positioning System odometry, are currently not routinely used in the clinical setting.

Evidence-based practice guidelines in OHS: are they agree-able?

PubMed

Hulshof, Carel; Hoenen, John

2007-01-01

The purpose of this study was to evaluate the acceptance, validity, reliability and feasibility of the AGREE (Appraisal of Guidelines and REsearch and Evaluation) instrument to assess the quality of evidence-based practice guidelines for occupational physicians. In total, 6 practice guidelines of the Netherlands Society of Occupational Medicine (NVAB) were appraised by 20 occupational health professionals and experts in guideline development or implementation. Although appraisers often disagreed on individual item scores, the internal consistency and interrater reliability for most domains was sufficient. The AGREE criteria were in general considered relevant and no major suggestions for additional items for use in the context of occupational health were brought up. The domain scores for the individual guidelines show a wide variety: 'applicability' had on average the lowest mean score (53%) while 'scope and purpose' had the highest one (87%). Low scores indicate where improvements are possible and necessary, e.g. by providing more information about the development. Key experts in occupational health report that AGREE is a relevant and easy to use instrument to evaluate quality aspects and the included criteria provide a good framework to develop or update evidence-based practice guidelines in the field of occupational health.

Profile of South African Secondary-School Teachers' Teaching Quality: Evaluation of Teaching Practices Using an Observation Instrument

ERIC Educational Resources Information Center

de Jager, Thelma; Coetzee, Mattheus Jacobus; Maulana, Ridwan; Helms-Lorenz, Michelle; van de Grift, Wim

2017-01-01

The need for quality teaching is reflected in the poor performance of students in international tests. Teachers' practices and contextual factors could contribute to substandard quality of teaching in South Africa. Several studies indicate that successful learning is largely dependent on the teachers' practices in class. The focus of the present…

Standards for Instrument Migration When Implementing Paper Patient-Reported Outcome Instruments Electronically: Recommendations from a Qualitative Synthesis of Cognitive Interview and Usability Studies.

PubMed

Muehlhausen, Willie; Byrom, Bill; Skerritt, Barbara; McCarthy, Marie; McDowell, Bryan; Sohn, Jeremy

2018-01-01

To synthesize the findings of cognitive interview and usability studies performed to assess the measurement equivalence of patient-reported outcome (PRO) instruments migrated from paper to electronic formats (ePRO), and make recommendations regarding future migration validation requirements and ePRO design best practice. We synthesized findings from all cognitive interview and usability studies performed by a contract research organization between 2012 and 2015: 53 studies comprising 68 unique instruments and 101 instrument evaluations. We summarized study findings to make recommendations for best practice and future validation requirements. Five studies (9%) identified minor findings during cognitive interview that may possibly affect instrument measurement properties. All findings could be addressed by application of ePRO best practice, such as eliminating scrolling, ensuring appropriate font size, ensuring suitable thickness of visual analogue scale lines, and providing suitable instructions. Similarly, regarding solution usability, 49 of the 53 studies (92%) recommended no changes in display clarity, navigation, operation, and completion without help. Reported usability findings could be eliminated by following good product design such as the size, location, and responsiveness of navigation buttons. With the benefit of accumulating evidence, it is possible to relax the need to routinely conduct cognitive interview and usability studies when implementing minor changes during instrument migration. Application of design best practice and selecting vendor solutions with good user interface and user experience properties that have been assessed in a representative group may enable many instrument migrations to be accepted without formal validation studies by instead conducting a structured expert screen review. Copyright © 2018 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Redesigning and Aligning Assessment and Evaluation for a Federally Funded Math and Science Teacher Educational Program

ERIC Educational Resources Information Center

Hardre, Patricia L.; Slater, Janis; Nanny, Mark

2010-01-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1)…

Instruments to measure cancer management knowledge of rural health care providers.

PubMed

Elliott, T E; Regal, R R; Renier, C M; Crouse, B J; Gangeness, D E; Pharmd; Elliott, B A; Witrak, M

2001-01-01

Instruments to measure cancer management knowledge of rural physicians, nurses, and pharmacists were needed to evaluate the effect of an educational intervention. Since such instruments did not exist, the authors designed and validated a new instrument for each discipline. The design and validation process for these instruments are described. These three instruments were shown to be practical and to have high content and construct validity. Content validation demonstrated that all items were rated as essential or useful by 90% or more of the respondents. Construct validation show highly significant differences in mean scores among several levels of learners and practitioners as expected. These instruments may be useful to other investigators for measuring cancer management knowledge of rural physicians, nurses, and pharmacists.

Use of Information and Communication Technologies in Sign Language Test Development: Results of an International Survey

ERIC Educational Resources Information Center

Haug, Tobias

2015-01-01

Sign language test development is a relatively new field within sign linguistics, motivated by the practical need for assessment instruments to evaluate language development in different groups of learners (L1, L2). Due to the lack of research on the structure and acquisition of many sign languages, developing an assessment instrument poses…

Cross-cultural adaptation and reproducibility of the Brazilian-Portuguese version of the modified FRESNO Test to evaluate the competence in evidence based practice by physical therapists

PubMed Central

Silva, Anderson M.; Costa, Lucíola C. M.; Comper, Maria L.; Padula, Rosimeire S.

2016-01-01

BACKGROUND: The Modified Fresno Test was developed to assess knowledge and skills of both physical therapy (PT) professionals and students to use evidence-based practice (EBP). OBJECTIVES: To translate the Modified Fresno Test into Brazilian-Portuguese and to evaluate the test's reproducibility. METHOD: The first step consisted of adapting the instrument into the Brazilian-Portuguese language. Then, a total of 57 participants, including PT students, PT professors and PT practitioners, completed the translated instrument. The responses from the participants were used to evaluate reproducibility of the translated instrument. Internal consistency was calculated using the Cronbach's alpha. Reliability was calculated using the intraclass correlation coefficient (ICC) for continuous variables, and the Kappa coefficient (K) for categorical variables. The agreement was assessed using the standard error of the measurement (SEM). RESULTS: The cross-cultural adaptation process was appropriate, providing an adequate Brazilian-Portuguese version of the instrument. The internal consistency was good (α=0.769). The reliability for inter- and intra-rater assessment were ICC=0.89 (95% CI 0.82 to 0.93); for evaluator 1 was ICC=0.85 (95% CI 0.57 to 0.93); and for evaluator 2 was ICC=0.98 (95% CI 0.97 to 0.99). The SEM was 13.04 points for inter-rater assessment, 12.57 points for rater 1 and 4.59 points for rater 2. CONCLUSION: The Brazilian-Portuguese language version of the Modified Fresno Test showed satisfactory results in terms of reproducibility. The Modified Fresno Test will allow physical therapy professionals and students to be evaluated on the use of understanding EBP. PMID:26786079

Cross-cultural adaptation and reproducibility of the Brazilian-Portuguese version of the modified FRESNO Test to evaluate the competence in evidence based practice by physical therapists.

PubMed

Silva, Anderson M; Costa, Lucíola C M; Comper, Maria L; Padula, Rosimeire S

2016-01-01

The Modified Fresno Test was developed to assess knowledge and skills of both physical therapy (PT) professionals and students to use evidence-based practice (EBP). To translate the Modified Fresno Test into Brazilian-Portuguese and to evaluate the test's reproducibility. The first step consisted of adapting the instrument into the Brazilian-Portuguese language. Then, a total of 57 participants, including PT students, PT professors and PT practitioners, completed the translated instrument. The responses from the participants were used to evaluate reproducibility of the translated instrument. Internal consistency was calculated using the Cronbach's alpha. Reliability was calculated using the intraclass correlation coefficient (ICC) for continuous variables, and the Kappa coefficient (K) for categorical variables. The agreement was assessed using the standard error of the measurement (SEM). The cross-cultural adaptation process was appropriate, providing an adequate Brazilian-Portuguese version of the instrument. The internal consistency was good (α=0.769). The reliability for inter- and intra-rater assessment were ICC=0.89 (95% CI 0.82 to 0.93); for evaluator 1 was ICC=0.85 (95% CI 0.57 to 0.93); and for evaluator 2 was ICC=0.98 (95% CI 0.97 to 0.99). The SEM was 13.04 points for inter-rater assessment, 12.57 points for rater 1 and 4.59 points for rater 2. The Brazilian-Portuguese language version of the Modified Fresno Test showed satisfactory results in terms of reproducibility. The Modified Fresno Test will allow physical therapy professionals and students to be evaluated on the use of understanding EBP.

Leveraging Observation Tools for Instructional Improvement: Exploring Variability in Uptake of Ambitious Instructional Practices

ERIC Educational Resources Information Center

Cohen, Julie; Schuldt, Lorien Chambers; Brown, Lindsay; Grossman, Pamela

2016-01-01

Background/Context: Current efforts to build rigorous teacher evaluation systems has increased interest in standardized classroom observation tools as reliable measures for assessing teaching. However, many argue these instruments can also be used to effect change in classroom practice. This study investigates a model of professional development…

School District Professional Learning: Teachers' Perceptions of Instructional Leadership, Teacher Practice, and Student Learning

ERIC Educational Resources Information Center

Avery, Christine M.

2013-01-01

This dissertation study includes an evaluation of a school district model of professional learning that aims to improve school administrators' instructional leadership skills and teacher practice to positively impact student learning. This study employs a valid and reliable survey instrument that measures professional learning standards. The…

Appraising the methodological quality of the clinical practice guideline for diabetes mellitus using the AGREE II instrument: a methodological evaluation.

PubMed

Radwan, Mahmoud; Akbari Sari, Ali; Rashidian, Arash; Takian, Amirhossein; Abou-Dagga, Sanaa; Elsous, Aymen

2017-02-01

To evaluate the methodological quality of the Palestinian Clinical Practice Guideline for Diabetes Mellitus using the Translated Arabic Version of the AGREE II. Methodological evaluation. A cross-cultural adaptation framework was followed to translate and develop a standardised Translated Arabic Version of the AGREE II. Palestinian Primary Healthcare Centres. Sixteen appraisers independently evaluated the Clinical Practice Guideline for Diabetes Mellitus using the Translated Arabic Version of the AGREE II. Methodological quality of diabetic guideline. The Translated Arabic Version of the AGREE II showed an acceptable reliability and validity. Internal consistency ranged between 0.67 and 0.88 (Cronbach's α). Intra-class coefficient among appraisers ranged between 0.56 and 0.88. The quality of this guideline is low. Both domains 'Scope and Purpose' and 'Clarity of Presentation' had the highest quality scores (66.7% and 61.5%, respectively), whereas the scores for 'Applicability', 'Stakeholder Involvement', 'Rigour of Development' and 'Editorial Independence' were the lowest (27%, 35%, 36.5%, and 40%, respectively). The findings suggest that the quality of this Clinical Practice Guideline is disappointingly low. To improve the quality of current and future guidelines, the AGREE II instrument is extremely recommended to be incorporated as a gold standard for developing, evaluating or updating the Palestinian Clinical Practice Guidelines. Future guidelines can be improved by setting specific strategies to overcome implementation barriers with respect to economic considerations, engaging of all relevant end-users and patients, ensuring a rigorous methodology for searching, selecting and synthesising the evidences and recommendations, and addressing potential conflict of interests within the development group.

Efficient clinical evaluation of guideline quality: development and testing of a new tool

PubMed Central

2014-01-01

Background Evaluating the methodological quality of clinical practice guidelines is essential before deciding which ones which could best inform policy or practice. One current method of evaluating clinical guideline quality is the research-focused AGREE II instrument. This uses 23 questions scored 1–7, arranged in six domains, which requires at least two independent testers, and uses a formulaic weighted domain scoring system. Following feedback from time-poor clinicians, policy-makers and managers that this instrument did not suit clinical need, we developed and tested a simpler, shorter, binary scored instrument (the iCAHE Guideline Quality Checklist) designed for single users. Methods Content and construct validity, inter-tester reliability and clinical utility were tested by comparing the new iCAHE Guideline Quality Checklist with the AGREE II instrument. Firstly the questions and domains in both instruments were compared. Six randomly-selected guidelines on a similar theme were then assessed by three independent testers with different experience in guideline quality assessment, using both instruments. Per guideline, weighted domain and total AGREE II scores were calculated, using the scoring rubric for three testers. Total iCAHE scores were calculated per guideline, per tester. The linear relationship between iCAHE and AGREE II scores was assessed using Pearson r correlation coefficients. Score differences between testers were assessed for the iCAHE Guideline Quality Checklist. Results There were congruent questions in each instrument in four domains (Scope & Purpose, Stakeholder involvement, Underlying evidence/Rigour, Clarity). The iCAHE and AGREE II scores were moderate to strongly correlated for the six guidelines. There was generally good agreement between testers for iCAHE scores, irrespective of their experience. The iCAHE instrument was preferred by all testers, and took significantly less time to administer than the AGREE II instrument. However, the use of only three testers and six guidelines compromised study power, rendering this research as pilot investigations of the psychometric properties of the iCAHE instrument. Conclusion The iCAHE Guideline Quality Checklist has promising psychometric properties and clinical utility. PMID:24885893

Investigating Assessment Bias for Constructed Response Explanation Tasks: Implications for Evaluating Performance Expectations for Scientific Practice

NASA Astrophysics Data System (ADS)

Federer, Meghan Rector

Assessment is a key element in the process of science education teaching and research. Understanding sources of performance bias in science assessment is a major challenge for science education reforms. Prior research has documented several limitations of instrument types on the measurement of students' scientific knowledge (Liu et al., 2011; Messick, 1995; Popham, 2010). Furthermore, a large body of work has been devoted to reducing assessment biases that distort inferences about students' science understanding, particularly in multiple-choice [MC] instruments. Despite the above documented biases, much has yet to be determined for constructed response [CR] assessments in biology and their use for evaluating students' conceptual understanding of scientific practices (such as explanation). Understanding differences in science achievement provides important insights into whether science curricula and/or assessments are valid representations of student abilities. Using the integrative framework put forth by the National Research Council (2012), this dissertation aimed to explore whether assessment biases occur for assessment practices intended to measure students' conceptual understanding and proficiency in scientific practices. Using a large corpus of undergraduate biology students' explanations, three studies were conducted to examine whether known biases of MC instruments were also apparent in a CR instrument designed to assess students' explanatory practice and understanding of evolutionary change (ACORNS: Assessment of COntextual Reasoning about Natural Selection). The first study investigated the challenge of interpreting and scoring lexically ambiguous language in CR answers. The incorporation of 'multivalent' terms into scientific discourse practices often results in statements or explanations that are difficult to interpret and can produce faulty inferences about student knowledge. The results of this study indicate that many undergraduate biology majors frequently incorporate multivalent concepts into explanations of change, resulting in explanatory practices that were scientifically non-normative. However, use of follow-up question approaches was found to resolve this source of bias and thereby increase the validity of inferences about student understanding. The second study focused on issues of item and instrument structure, specifically item feature effects and item position effects, which have been shown to influence measures of student performance across assessment tasks. Results indicated that, along the instrument item sequence, items with similar surface features produced greater sequencing effects than sequences of items with dissimilar surface features. This bias could be addressed by use of a counterbalanced design (i.e., Latin Square) at the population level of analysis. Explanation scores were also highly correlated with student verbosity, despite verbosity being an intrinsically trivial aspect of explanation quality. Attempting to standardize student response length was one proposed solution to the verbosity bias. The third study explored gender differences in students' performance on constructed-response explanation tasks using impact (i.e., mean raw scores) and differential item function (i.e., item difficulties) patterns. While prior research in science education has suggested that females tend to perform better on constructed-response items, the results of this study revealed no overall differences in gender achievement. However, evaluation of specific item features patterns suggested that female respondents have a slight advantage on unfamiliar explanation tasks. That is, male students tended to incorporate fewer scientifically normative concepts (i.e., key concepts) than females for unfamiliar taxa. Conversely, females tended to incorporate more scientifically non-normative ideas (i.e., naive ideas) than males for familiar taxa. Together these results indicate that gender achievement differences for this CR instrument may be a result of differences in how males and females interpret and respond to combinations of item features. Overall, the results presented in the subsequent chapters suggest that as science education shifts toward the evaluation of fused scientific knowledge and practice (e.g., explanation), it is essential that educators and researchers investigate potential sources of bias inherent to specific assessment practices. This dissertation revealed significant sources of CR assessment bias, and provided solutions to address these problems.

School Evaluation: Current Practices in OECD Countries and a Literature Review. OECD Education Working Papers, No. 42

ERIC Educational Resources Information Center

Faubert, Violaine

2009-01-01

This paper examines the current academic and policy literatures concerning school evaluation in primary and secondary education within the OECD countries. First, it provides a typology of the existing systems of school evaluation across the OECD. It encompasses the diverse criteria and instruments commonly used to carry out schools evaluation, as…

[Evaluation of professional knowledge and attitudes on dementia patient care: a trans-cultural adaptation of an evaluation instrument].

PubMed

Costa, Gislaine Desani da; Souza, Rosely Almeida; Yamashita, Cintia Hitomi; Pinheiro, Juliane Cibelle Ferreira; Alvarenga, Márcia Regina Martins; Oliveira, Maria Amélia de Campos

2015-04-01

To describe the trans-cultural adaptation of the evaluation instrument entitled Atenció Sanitària de Les Demències: la visió de L' Atenció Primarià from Catalan into versions in Portuguese for doctors and nurses. This study evaluates the knowledge and perspectives of these professionals in their treatment of patients diagnosed with dementia in cases of primary care. The adaptation followed internationally accepted rules, which include the following steps: translation, synthesis, back-translation, revision by a committee of specialists, and a test run with 35 practicing doctors and 35 practicing nurses in Brazil's Family Health Strategy (Estratégia Saúde da Família, or ESF in Portuguese). The translation, synthesis, and back-translation steps were performed satisfactorily; only small adjustments were required. The committee of specialists verified the face validity in the version translated into Portuguese, and all of the items that received an agreement score lower than 80% during the initial evaluation were revised. In the test run, the difficulties presented by the health care professionals did not reach 15% of the sample, and therefore, no changes were made. The Portuguese translation of the instrument can be considered semantically, idiomatically, culturally, and conceptually equivalent to the original Catalan version and is, therefore, appropriate for use in Brazil.

The development of an instrument for evaluating clinical teachers: involving stakeholders to determine content validity.

PubMed

Stalmeijer, Renée E; Dolmans, Diana H J M; Wolfhagen, Ineke H A P; Muijtjens, Arno M M; Scherpbier, Albert J J A

2008-01-01

Research indicates that the quality of supervision strongly influences the learning of medical students in clinical practice. Clinical teachers need feedback to improve their supervisory skills. The available instruments either lack a clear theoretical framework or are not suitable for providing feedback to individual teachers. We developed an evaluation instrument based on the 'cognitive apprenticeship model'. The aim was to estimate the content validity of the developed instrument. Item relevance was rated on a five-point scale (1 = highly irrelevant, 5 = highly relevant) by three groups of stakeholders in undergraduate clinical teaching: educationalists (N = 12), doctors (N = 16) and students (N = 12). Additionally, stakeholders commented on content, wording and omission of items. The items were generally rated as very relevant (Mean = 4.3, SD = 0.38, response = 95%) and any differences between the stakeholder groups were small. The results led to elimination of 4 items, rewording of 13 items and addition of 1 item. The cognitive apprenticeship model appears to offer a useful framework for the development of an evaluation instrument aimed at providing feedback to individual clinical teachers on the quality of student supervision. Further studies in larger populations will have to establish the instrument's statistical validity and generalizability.

Tools to assess living with a chronic illness: A systematic review.

PubMed

Ambrosio, Leire; Portillo, Mari Carmen

2018-05-16

To analyse the currently available instruments to assess living with a chronic illness and related aspects. A review of the evidence was made using the databases: Medline, CINHAL, PsycINFO, Cochrane Library, Embase and Cuiden. The criteria that limited the search were: the language, English and / or Spanish and studies carried out in an adult population. Years of article publication were not used as a limit. A total of 16 instruments were identified and analysed that apparently measured the concept of living with a chronic illness and/or related aspects. According to the name of the instrument, four seemed to evaluate the concept of living with a chronic illness while the rest of the instruments evaluated aspects intrinsically related to the concept of "living with", such as attributes or the meaning of living with a chronic illness. Different instruments were identified to evaluate daily living for the chronically ill patient, as well as related aspects. According to this review, further validation studies are required in other populations and/or contexts in order to achieve valid and reliable instruments that could be used in clinical practice. Copyright © 2018 Elsevier España, S.L.U. All rights reserved.

Adaptation and validation of the Evidence-Based Practice Belief and Implementation scales for French-speaking Swiss nurses and allied healthcare providers.

PubMed

Verloo, Henk; Desmedt, Mario; Morin, Diane

2017-09-01

To evaluate two psychometric properties of the French versions of the Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales, namely their internal consistency and construct validity. The Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales developed by Melnyk et al. are recognised as valid, reliable instruments in English. However, no psychometric validation for their French versions existed. Secondary analysis of a cross sectional survey. Source data came from a cross-sectional descriptive study sample of 382 nurses and other allied healthcare providers. Cronbach's alpha was used to evaluate internal consistency, and principal axis factor analysis and varimax rotation were computed to determine construct validity. The French Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales showed excellent reliability, with Cronbach's alphas close to the scores established by Melnyk et al.'s original versions. Principal axis factor analysis showed medium-to-high factor loading scores without obtaining collinearity. Principal axis factor analysis with varimax rotation of the 16-item Evidence-Based Practice Beliefs scale resulted in a four-factor loading structure. Principal axis factor analysis with varimax rotation of the 17-item Evidence-Based Practice Implementation scale revealed a two-factor loading structure. Further research should attempt to understand why the French Evidence-Based Practice Implementation scale showed a two-factor loading structure but Melnyk et al.'s original has only one. The French versions of the Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales can both be considered valid and reliable instruments for measuring Evidence-Based Practice beliefs and implementation. The results suggest that the French Evidence-Based Practice Beliefs and Evidence-Based Practice Implementation scales are valid and reliable and can therefore be used to evaluate the effectiveness of organisational strategies aimed at increasing professionals' confidence in Evidence-Based Practice, supporting its use and implementation. © 2017 John Wiley & Sons Ltd.

The Stuttering Treatment Research Evaluation and Assessment Tool (STREAT): Evaluating Treatment Research as Part of Evidence-Based Practice

ERIC Educational Resources Information Center

Davidow, Jason H.; Bothe, Anne K.; Bramlett, Robin E.

2006-01-01

Purpose: This article presents, and explains the issues behind, the Stuttering Treatment Research Evaluation and Assessment Tool (STREAT), an instrument created to assist clinicians, researchers, students, and other readers in the process of critically appraising reports of stuttering treatment research. Method: The STREAT was developed by…

Development and psychometric validation of a questionnaire to evaluate nurses' adherence to recommendations for preventing pressure ulcers (QARPPU).

PubMed

Moya-Suárez, Ana Belén; Morales-Asencio, José Miguel; Aranda-Gallardo, Marta; Enríquez de Luna-Rodríguez, Margarita; Canca-Sánchez, José Carlos

2017-11-01

The main objective of this work is the development and psychometric validation of an instrument to evaluate nurses' adherence to the main recommendations issued for preventing pressure ulcers. An instrument was designed based on the main recommendations for the prevention of pressure ulcers published in various clinical practice guides. Subsequently, it was proceeded to evaluate the face and content validity of the instrument by an expert group. It has been applied to 249 Spanish nurses took part in a cross-sectional study to obtain a psychometric evaluation (reliability and construct validity) of the instrument. The study data were compiled from June 2015 to July 2016. From the results of the psychometric analysis, a final 18-item, 4-factor questionnaire was derived, which explained 60.5% of the variance and presented the following optimal indices of fit (CMIN/DF: 1.40 p < 0.001; GFI: 0.93; NFI: 0.92; CFI: 0.98; TLI: 0.97; RMSEA: 0.04 (90% CI 0.025-0.054). The results obtained show that the instrument presents suitable psychometric properties for evaluating nurses' adherence to recommendations for the prevention of pressure ulcers. Copyright © 2017 Tissue Viability Society. Published by Elsevier Ltd. All rights reserved.

Development and Validation of an Instrument to Measure Students' Motivation and Self-Regulation in Science Learning

NASA Astrophysics Data System (ADS)

Velayutham, Sunitadevi; Aldridge, Jill; Fraser, Barry

2011-10-01

Students' motivational beliefs and self-regulatory practices have been identified as instrumental in influencing the engagement of students in the learning process. An important aim of science education is to empower students by nurturing the belief that they can succeed in science learning and to cultivate the adaptive learning strategies required to help to bring about that success. This article reports the development and validation of an instrument to measure salient factors related to the motivation and self-regulation of students in lower secondary science classrooms. The development of the instrument involved identifying key determinants of students' motivation and self-regulation in science learning based on theoretical and research underpinnings. Once the instrument was developed, a pilot study involving 52 students from two Grade 8 science classes was undertaken. Quantitative data were collected from 1,360 students in 78 classes across Grades 8, 9, and 10, in addition to in-depth qualitative information gathered from 10 experienced science teachers and 12 Grade 8 students. Analyses of the data suggest that the survey has strong construct validity when used with lower secondary students. This survey could be practically valuable as a tool for gathering information that may guide classroom teachers in refocusing their teaching practices and help to evaluate the effectiveness of intervention programmes.

Review of measurement instruments in clinical and research ethics, 1999–2003

PubMed Central

Redman, B K

2006-01-01

Every field of practice has the responsibility to evaluate its outcomes and to test its theories. Evidence of the underdevelopment of measurement instruments in bioethics suggests that attending to strengthening existing instruments and developing new ones will facilitate the interpretation of accumulating bodies of research as well as the making of clinical judgements. A review of 65 instruments reported in the published literature showed 10 with even a minimal level of psychometric data. Two newly developed instruments provide examples of the full use of psychometric and ethical theory. Bioethicists use a wide range of methods for knowledge development and verification; each method should meet stringent standards of quality. PMID:16507659

Examining Interrater Agreement Analyses of a Pilot Special Education Observation Tool

ERIC Educational Resources Information Center

Johnson, Evelyn S.; Semmelroth, Carrie L.

2012-01-01

This paper reports the results of interrater agreement analyses on a pilot special education teacher evaluation instrument, the Recognizing Effective Special Education Teachers (RESET) Observation Tool (OT). Using evidence-based instructional practices as the basis for the evaluation, the RESET OT is designed for the spectrum of different…

A Document Analysis of Teacher Evaluation Systems Specific to Physical Education

ERIC Educational Resources Information Center

Norris, Jason M.; van der Mars, Hans; Kulinna, Pamela; Kwon, Jayoun; Amrein-Beardsley, Audrey

2017-01-01

Purpose: The purpose of this document analysis study was to examine current teacher evaluation systems, understand current practices, and determine whether the instrumentation is a valid measure of teaching quality as reflected in teacher behavior and effectiveness specific to physical education (PE). Method: An interpretive document analysis…

Prevalence of Body Dysmorphic Disorder and Surgeon Diagnostic Accuracy in Facial Plastic and Oculoplastic Surgery Clinics.

PubMed

Joseph, Andrew W; Ishii, Lisa; Joseph, Shannon S; Smith, Jane I; Su, Peiyi; Bater, Kristin; Byrne, Patrick; Boahene, Kofi; Papel, Ira; Kontis, Theda; Douglas, Raymond; Nelson, Christine C; Ishii, Masaru

2017-07-01

Body dysmorphic disorder (BDD) is a relative contraindication for facial plastic surgery, but formal screening is not common in practice. The prevalence of BDD in patients seeking facial plastic surgery is not well documented. To establish the prevalence of BDD across facial plastic and oculoplastic surgery practice settings, and estimate the ability of surgeons to screen for BDD. This multicenter prospective study recruited a cohort of 597 patients who presented to academic and private facial plastic and oculoplastic surgery practices from March 2015 to February 2016. All patients were screened for BDD using the Body Dysmorphic Disorder Questionnaire (BDDQ). After each clinical encounter, surgeons independently evaluated the likelihood that a participating patient had BDD. Validated instruments were used to assess satisfaction with facial appearance including the FACE-Q, Blepharoplasty Outcomes Evaluation (BOE), Facelift Outcomes Evaluation (FOE), Rhinoplasty Outcomes Evaluation (ROE), and Skin Rejuvenation Outcomes Evaluation (SROE). Across participating practices (9 surgeons, 3 sites), a total of 597 patients were screened for BDD: 342 patients from site 1 (mean [SD] age, 44.2 [16.5] years); 158 patients, site 2 (mean [SD] age, 46.0 [16.2] years), site 3, 97 patients (mean [SD] age, 56.3 [15.5] years). Overall, 58 patients [9.7%] screened positive for BDD by the BDDQ instrument, while only 16 of 402 patients [4.0%] were clinically suspected of BDD by surgeons. A higher percentage of patients presenting for cosmetic surgery (37 of 283 patients [13.1%]) compared with those presenting for reconstructive surgery (21 of 314 patients [6.7%]) screened positive on the BDDQ (odds ratio, 2.10; 95% CI, 1.20-3.68; P = .01). Surgeons were only able to correctly identify 2 of 43 patients (4.7%) who screened positive for BDD on the BDDQ, and the positive likelihood ratio was only 1.19 (95% CI, 0.28-5.07). Patients screening positive for BDD by the BDDQ had lower satisfaction with their appearance as measured by the FACE-Q, ROE, BOE, SROE, and FOE. Body dysmorphic disorder is a relatively common condition across facial plastic and oculoplastic surgery practice settings. Patients who screen positive on the BDDQ have lower satisfaction with their facial appearance at baseline. Surgeons have a poor ability to screen for patients with BDD when compared with validated screening instruments such as the BDDQ. Routine implementation of validated BDD screening instruments may improve patient care. NA.

Development of a scale for the evaluation of patients’ rights prerequisites at educational hospitals in Iran: a study using the Delphi technique

PubMed Central

Aazami, Sanaz; Mozafari, Mosayeb

2015-01-01

The patients’ rights status is one of the essential elements in defining norms related to the concept of clinical governance system. In addition, the patients’ rights status is an important index for quality of care offered in the health care system. However, the lack of a coherent instrument makes it difficult to evaluate patients’ rights status in hospitals and clinics. The aim of this study was to develop an instrument for the evaluation of patients’ rights prerequisites at educational hospitals in Iran. This study was conducted using the modified Delphi technique. In this study, 36 experts in the fields of law, medicine, and professional ethics were participated. The panel of experts participated in 3 rounds. First, experts were asked to judge some pre-identified items, and then, excluded items were judged again in the second round. At the end of the third round, all of the agreed items were included in the final list to form an evaluative scale on practice of patients’ rights. Experts were asked to judge a total 171 items in 3 rounds. Around 31% (n = 53) of items obtained the panel’s approval to be included in the final version of the scale. The experts’ opinions were collected using face-to-face interviews and electronic email during a 6-month period of data collection from October 2013 to February 2014. This study developed a 53-item scale for evaluation of patients’ rights prerequisites in educational hospitals in Iran. This scale was developed in 7 areas of commitments including university education, research, supervision, process management, physical structure, organizational policy, and human resources management. This study developed an evaluative scale to assess the practice of patients’ rights in educational hospitals. The items in the final version of this scale were obtained from a consensus of experts and the instrument can be used to evaluate the context and prerequisites for practice of patients’ rights in Iranian educational hospitals. PMID:27354900

Evaluation of the measurement properties of self-reported health-related work-functioning instruments among workers with common mental disorders.

PubMed

Abma, Femke I; van der Klink, Jac J L; Terwee, Caroline B; Amick, Benjamin C; Bültmann, Ute

2012-01-01

During the past decade, common mental disorders (CMD) have emerged as a major public and occupational health problem in many countries. Several instruments have been developed to measure the influence of health on functioning at work. To select appropriate instruments for use in occupational health practice and research, the measurement properties (eg, reliability, validity, responsiveness) must be evaluated. The objective of this study is to appraise critically and compare the measurement properties of self-reported health-related work-functioning instruments among workers with CMD. A systematic review was performed searching three electronic databases. Papers were included that: (i) mainly focused on the development and/or evaluation of the measurement properties of a self-reported health-related work-functioning instrument; (ii) were conducted in a CMD population; and (iii) were fulltext original papers. Quality appraisal was performed using the consensus-based standards for the selection of health status measurement instruments (COSMIN) checklist. Five papers evaluating measurement properties of five self-reported health-related work-functioning instruments in CMD populations were included. There is little evidence available for the measurement properties of the identified instruments in this population, mainly due to low methodological quality of the included studies. The available evidence on measurement properties is based on studies of poor-to-fair methodological quality. Information on a number of measurement properties, such as measurement error, content validity, and cross-cultural validity is still lacking. Therefore, no evidence-based decisions and recommendations can be made for the use of health-related work functioning instruments. Studies of high methodological quality are needed to properly assess the existing instruments' measurement properties.

The Faculty Self-Reported Assessment Survey (FRAS): Differentiating Faculty Knowledge and Experience in Assessment

PubMed Central

Hanauer, David I.; Bauerle, Cynthia

2015-01-01

Science, technology, engineering, and mathematics education reform efforts have called for widespread adoption of evidence-based teaching in which faculty members attend to student outcomes through assessment practice. Awareness about the importance of assessment has illuminated the need to understand what faculty members know and how they engage with assessment knowledge and practice. The Faculty Self-Reported Assessment Survey (FRAS) is a new instrument for evaluating science faculty assessment knowledge and experience. Instrument validation was composed of two distinct studies: an empirical evaluation of the psychometric properties of the FRAS and a comparative known-groups validation to explore the ability of the FRAS to differentiate levels of faculty assessment experience. The FRAS was found to be highly reliable (α = 0.96). The dimensionality of the instrument enabled distinction of assessment knowledge into categories of program design, instrumentation, and validation. In the known-groups validation, the FRAS distinguished between faculty groups with differing levels of assessment experience. Faculty members with formal assessment experience self-reported higher levels of familiarity with assessment terms, higher frequencies of assessment activity, increased confidence in conducting assessment, and more positive attitudes toward assessment than faculty members who were novices in assessment. These results suggest that the FRAS can reliably and validly differentiate levels of expertise in faculty knowledge of assessment. PMID:25976653

Using Remote Access to Scientific Instrumentation to Create Authentic Learning Activities in Pharmaceutical Analysis

PubMed Central

Albon, Simon P.; Cancilla, Devon A.; Hubball, Harry

2006-01-01

Objectives To pilot test and evaluate a gas chromatography-mass spectrometry (GCMS) case study as a teaching and learning tool. Design A case study incorporating remote access to a GCMS instrument through the Integrated Laboratory Network (ILN) at Western Washington University was developed and implemented. Student surveys, faculty interviews, and examination score data were used to evaluate learning. Assessment While the case study did not impact final examination scores, approximately 70% of students and all faculty members felt the ILN-supported case study improved student learning about GCMS. Faculty members felt the “live” instrument access facilitated more authentic teaching. Students and faculty members felt the ILN should continue to be developed as a teaching tool. Conclusion Remote access to scientific instrumentation can be used to modify case studies to enhance student learning and teaching practice in pharmaceutical analysis. PMID:17149450

Preceptors’ Self-Assessment of Their Ability to Perform the Learning Objectives of an Experiential Program

PubMed Central

2012-01-01

Objective. To evaluate preceptors’ perception of their ability to perform the Structured Practical Experiences in Pharmacy (SPEP) learning objectives through a self-assessment activity. Methods. A self-assessment instrument consisting of 28 learning objectives associated with clinic, community, and hospital pharmacy practice experiences were developed. Preceptors rated their performance ability for each of the learning objectives using a 3-point Likert scale. Results. Of the 116 preceptors, 89 (77%) completed the self-assessment survey instrument. The overall preceptor responses to the items on performance of the 28 SPEP learning objectives ranged from good to excellent. Years of experience, practice experience setting, and involvement as a SPEP or SPEP and PharmD preceptor had no influence on their self-reported capabilities. Conclusion. Most preceptors rated their ability to perform the learning objectives for the structured practical experiences in pharmacy as high. Competency areas requiring further preceptor development were identified. PMID:23193333

Evaluation of surface characteristics of rotary nickel-titanium instruments produced by different manufacturing methods.

PubMed

Inan, U; Gurel, M

2017-02-01

Instrument fracture is a serious concern in endodontic practice. The aim of this study was to investigate the surface quality of new and used rotary nickel-titanium (NiTi) instruments manufactured by the traditional grinding process and twisting methods. Total 16 instruments of two rotary NiTi systems were used in this study. Eight Twisted Files (TF) (SybronEndo, Orange, CA, USA) and 8 Mtwo (VDW, Munich, Germany) instruments were evaluated. New and used of 4 experimental groups were evaluated using an atomic force microscopy (AFM). New and used instruments were analyzed on 3 points along a 3 mm. section at the tip of the instrument. Quantitative measurements according to the topographical deviations were recorded. The data were statistically analyzed with paired samples t-test and independent samples t-test. Mean root mean square (RMS) values for new and used TF 25.06 files were 10.70 ± 2.80 nm and 21.58 ± 6.42 nm, respectively, and the difference between them was statistically significant (P < 0.05). Mean RMS values for new and used Mtwo 25.06 files were 24.16 ± 9.30 nm and 39.15 ± 16.20 nm respectively, the difference between them also was statistically significant (P < 0.05). According to the AFM analysis, instruments produced by twisting method (TF 25.06) had better surface quality than the instruments produced by traditional grinding process (Mtwo 25.06 files).

Measuring Health Literacy in Individuals with Diabetes: A Systematic Review and Evaluation of Available Measures

ERIC Educational Resources Information Center

Al Sayah, Fatima; Williams, Beverly; Johnson, Jeffrey A.

2013-01-01

Objective: To identify instruments used to measure health literacy and numeracy in people with diabetes; evaluate their use, measurement scope, and properties; discuss their strengths and weaknesses; and propose the most useful, reliable, and applicable measure for use in research and practice settings. Methods" A systematic literature review…

Working Commitment among Trainee Teachers: A Meta Evaluation Approach

ERIC Educational Resources Information Center

Hamzah, Mohd Sahandri Gani B.; Mohamed, Hapidah Bt.; Abdullah, Saifuddin Kumar B.; Baki, Roselan B.

2008-01-01

The main aim of the study was to evaluate trainee teachers working commitment in their teaching practicum. There were seven component teaching practices and eleven demographic factors. The instrument of the study was extracted from various sources to suit the research design based on Units, Treatments, Observing, and Surveying (UTOS) model…

A framework and a measurement instrument for sustainability of work practices in long-term care

PubMed Central

2011-01-01

Background In health care, many organizations are working on quality improvement and/or innovation of their care practices. Although the effectiveness of improvement processes has been studied extensively, little attention has been given to sustainability of the changed work practices after implementation. The objective of this study is to develop a theoretical framework and measurement instrument for sustainability. To this end sustainability is conceptualized with two dimensions: routinization and institutionalization. Methods The exploratory methodological design consisted of three phases: a) framework development; b) instrument development; and c) field testing in former improvement teams in a quality improvement program for health care (N teams = 63, N individual = 112). Data were collected not until at least one year had passed after implementation. Underlying constructs and their interrelations were explored using Structural Equation Modeling and Principal Component Analyses. Internal consistency was computed with Cronbach's alpha coefficient. A long and a short version of the instrument are proposed. Results The χ2- difference test of the -2 Log Likelihood estimates demonstrated that the hierarchical two factor model with routinization and institutionalization as separate constructs showed a better fit than the one factor model (p < .01). Secondly, construct validity of the instrument was strong as indicated by the high factor loadings of the items. Finally, the internal consistency of the subscales was good. Conclusions The theoretical framework offers a valuable starting point for the analysis of sustainability on the level of actual changed work practices. Even though the two dimensions routinization and institutionalization are related, they are clearly distinguishable and each has distinct value in the discussion of sustainability. Finally, the subscales conformed to psychometric properties defined in literature. The instrument can be used in the evaluation of improvement projects. PMID:22087884

OERL: A Tool For Geoscience Education Evaluators

NASA Astrophysics Data System (ADS)

Zalles, D. R.

2002-12-01

The Online Evaluation Resource Library (OERL) is a Web-based set of resources for improving the evaluation of projects funded by the Directorate for Education and Human Resources (EHR) of the National Science Foundation (NSF). OERL provides prospective project developers and evaluators with material that they can use to design, conduct, document, and review evaluations. OERL helps evaluators tackle the challenges of seeing if a project is meeting its implementation and outcome-related goals. Within OERL is a collection of exemplary plans, instruments, and reports from evaluations of EHR-funded projects in the geosciences and in other areas of science and mathematics. In addition, OERL contains criteria about good evaluation practices, professional development modules about evaluation design and questionnaire development, a dictionary of key evaluation terms, and links to evaluation standards. Scenarios illustrate how the resources can be used or adapted. Currently housed in OERL are 137 instruments, and full or excerpted versions of 38 plans and 60 reports. 143 science and math projects have contributed to the collection so far. OERL's search tool permits the launching of precise searches based on key attributes of resources such as their subject area and the name of the sponsoring university or research institute. OERL's goals are to 1) meet the needs for continuous professional development of evaluators and principal investigators, 2) complement traditional vehicles of learning about evaluation, 3) utilize the affordances of current technologies (e.g., Web-based digital libraries, relational databases, and electronic performance support systems) for improving evaluation practice, 4) provide anytime/anyplace access to update-able resources that support evaluators' needs, and 5) provide a forum by which professionals can interact on evaluation issues and practices. Geoscientists can search the collection of resources from geoscience education projects that have been funded by NSF to carry out curriculum development, teacher education, faculty development, and increased access, retention, and preparation of under-represented student populations in science. Over the next two years, additional plans, instruments, and reports from other projects will be added to the OERL collection. Also to be added are more professional development modules and online coaches for constructing key evaluation documents. The presentation overviews the structure of OERL, describes some of the geoscience projects in the collection, and provides some examples of how its resources can be used and adapted for other geoscience education evaluations.

Examining Ratings on the VAL-ED Evaluation Instrument of Principals to Improve Instructional Leadership Practices

ERIC Educational Resources Information Center

Babin, Erin Pevey

2017-01-01

The biggest challenge facing American public schools today is increasing student achievement, and this depends on the educational system's ability to improve the quality of instruction. Principals play a key role in improving the quality of instruction on their campus through the instructional leadership practices they engage in on a daily basis.…

Development and validation of an instrument to evaluate science teachers' assessment beliefs and practices

NASA Astrophysics Data System (ADS)

Genc, Evrim

The primary purpose of this study was to develop a valid and reliable instrument to examine science teachers' assessment beliefs and practices in science classrooms. The present study also investigated the relationship between teachers' beliefs and practices in terms of assessment issues in science, their perceptions of the factors that influenced their assessment practices and their feelings towards high-stakes testing. The participants of the study were 408 science teachers teaching at middle and high school levels in the State of Florida. Data were collected through two modes of administration of the instrument as a paper-and-pencil and a web-based form. The response rate for paper-and-pencil administration was estimated as 68% whereas the response for the web administration was found to be 27%. Results from the various dimensions of validity and reliability analyses revealed that the 24 item-four-factor belief and practice measures were psychometrically sound and conceptually anchored measures of science teachers' assessment beliefs and self-reported practices. Reliability estimates for the belief measure ranged from .83 to .91 whereas alpha values for the practice measure ranged from .56 to .90. Results from the multigroup analysis supported that the instrument has the same theoretical structure across both administration groups. Therefore, future researchers may use either a paper-and-pencil or web-based format of the instrument. This study underscored a discrepancy between what teachers believe and how they act in classroom settings. It was emphasized that certain factors were mediating the dynamics between the belief and the practice. The majority of teachers reported that instruction time, class size, professional development activities, availability of school funding, and state testing mandates impact their assessment routines. Teachers reported that both the preparation process and the results of the test created unbelievable tension both on students and teachers. Implications of the study indicated that it would be valuable to conduct alignment studies to examine whether state tests are fully aligned with the state standards and classroom assessment. Perhaps, such analyses would assist state level decision makers in reconsidering the current policies and "unintended" influences of mandated tests on classroom practices.

Evaluating the impact of geologic heritage on Earth science literacy: Adapting best practices from pedagogy and interpretation (Invited)

NASA Astrophysics Data System (ADS)

Semken, S. C.

2013-12-01

How might we authentically and practically evaluate the effects of a geologic heritage place or program on public Earth science literacy? This pedagogical form of evaluation is distinct from the evaluation of a place for its geological importance, heritage value, economic or cultural impact, and so on. Best evaluation practices from the realms of formal education, informal education, and interpretation start with a coherent set of evaluable learning outcomes, ideally recapitulated in one or more 'big ideas' that capture the essential attributes of the place or program. Learning outcomes may be classified as cognitive, affective, or psychomotor. Cognitive learning outcomes in a geoheritage context are the Earth-science concepts a visitor or student would be expected to uncover through on-site or virtual exploration of the stratigraphy, structure, landforms, and processes in a place. The Earth Science Literacy Principles (ESLP), and similar literacy documents relating to atmosphere, oceans, and climate; offer a template for mapping localized concepts onto more global ones. Quantitative instruments to evaluate understanding of the ESLP are in development, and the ESLP also map directly onto measures used in formal educational assessment, notably the Next Generation Science Standards in the USA. Nongeological place meanings (a component of sense of place) may suggest other cognitive outcomes. Affective learning outcomes for visitors and students in geoheritage sites are less readily defined, but may include place attachment (also a component of sense of place), attitudes, and interest. Multiple quantitative and qualitative methods of evaluating these outcomes exist. Psychomotor learning outcomes are even muddier, but accessibility (defined by statutes) offers a potential starting point. In practice, evaluation may be conducted synchronously or asynchronously with visitors' or students' interaction with the geoheritage place or program. Evaluation programs are typically constrained by access and practicality. Synchronous methods include observation, semi-structured interviews, rapid prototyping and surveys. Asynchronous methods include interviews, surveys, and tracking. Evaluation tools may require content or instrument validation for the specific context in which they are used. Illustrative examples from evaluation of public engagement with geoheritage places (National Parks) in the Southwest USA will be offered.

A practical approach to instrument selection, evaluation, basic financial management and implementation in pathology and research.

PubMed

Mina, Ashraf; Favaloro, Emmanuel J; Koutts, Jerry

2008-01-01

In response to increasingly complex demands in terms of productivity and budgets, there is a critical need to avoid mistakes during instrument selection that will be financially costly, and adversely affect customers, staff, productivity and test turnaround time. As there is no "one size fits all", guidelines must be appropriate to permit informed decision making. A Medline search was conducted to assess background knowledge in this area, using the terms "laboratory instrument selection" and "laboratory instrument evaluation". Searches returned over 800 articles, of which only seven were directly related to the topic of the search, with most outdated, and suggesting a paucity of appropriate information. Additional resources used included the American Association of Clinical Chemistry (AACC) website and the Internet. Appropriate criteria for instrument selection were established in the current report based on subjective and objective (technical) evaluations. Additionally, a sound and simple financial approach is also suggested to help in making informed decisions and avoid costly mistakes. We propose that such a process as outlined in our report will protect laboratories from making costly and avoidable mistakes in the acquisition of major equipment.

Selecting relevant and feasible measurement instruments for the revised Dutch clinical practice guideline for physical therapy in patients after stroke.

PubMed

Otterman, Nicoline; Veerbeek, Janne; Schiemanck, Sven; van der Wees, Philip; Nollet, Frans; Kwakkel, Gert

2017-07-01

To select relevant and feasible instruments for the revision of the Dutch clinical practice guideline for physical therapy in patients with stroke. In this implementation study a comprehensive proposal for ICF categories and matching instruments was developed, based on reliability and validity. Relevant instruments were then selected in a consensus round by 11 knowledge brokers who were responsible for the implementation of the selected instruments. The feasibility of the selected instruments was tested by 36 physical therapists at different work settings within stroke services. Finally, instruments that were deemed relevant and feasible were included in the revised guideline. A total of 28 instruments were recommended for inclusion in the revised guideline. Nineteen instruments were retained from the previous guideline. Ten new instruments were tested in clinical practice, seven of which were found feasible. Two more instruments were added after critical appraisal of the set of the measurement instruments. The revised guideline contains 28 relevant and feasible instrument selected and tested in clinical practice by physical therapists. Further education and implementation is needed to integrate instruments in clinical practice. Further research is proposed for developing and implementing a core set of measurement instruments to be used at fixed time points to establish data registries that allow for continuous improvement of rehabilitation for stroke patients. Implications for Rehabilitation The revised Dutch Stroke Physical Therapy Guideline recommends a total of 28 instruments, that are relevant and feasible for clinical practice of physical therapist in the different settings of stroke rehabilitation. The selection of instrument in daily practice should be part of the clinical reasoning process of PTs and be tailored to individual patients' needs and the degree of priority of the affected ICF category. Suggested education strategies for further integration of instruments in of the daily practice of PTs in Stroke Rehabilitation are: 'Training on the job' and 'peer assessment in clinical situations'.

[Assessment of decontamination processes: cleaning, disinfection and sterilization in dental practice in Poland in the years 2011-2012].

PubMed

Röhm-Rodowald, Ewa; Jakimiak, Bozenna; Chojecka, Agnieszka; Zmuda-Baranowska, Magdalena; Kanclerski, Krzysztof

2012-01-01

Effective decontamination of instruments is a key element of infection control and the provision of high quality in dental care. The aim of the study was to evaluate the efficiency of decontamination procedures including cleaning, disinfection and sterilization of re-usable instruments in dental practices in Poland. The efficiency of disinfection and sterilization processes have been evaluated on the results of the questionnaires. The following information were taken into account: setting where disinfection and sterilization had been performed, preparation of dental equipment for sterilization (disinfection, washing and cleaning, packaging), the types of autoclaves and used types of sterilization cycles, routine monitoring and documentation of sterilization processes, treatment of handpieces and the frequency of surface decontamination. Data were collected from 43 dental practices (35 dental offices and 8 clinics). Disinfection and cleaning processes were performed manually in 63% of dental offices and ultrasonic baths were used in 53% of settings. Washer disinfectors were used in 23% of dental practices: in every researched clinic and in a few dental offices. All sterilization processes were performed in steam autoclaves, mainly in small steam sterilizers (81%). Dental handpieces were sterilized in 72% of practices, but only 33% of them performed sterilization in recommended cycle B. Sterilization processes were monitored with chemical indicators in 33% of practices. Biological monitoring of the processes was carried out at different intervals. Incorrect documentation of instruments and surfaces decontamination was recorded in several settings. There is still a need for improvement of decontamination processes in dental practice in Poland. Areas for improvement include: replacement of manual cleaning and disinfection processes with automatic processes, sterilization of dental handpieces after each patient, monitoring of a sterilization process with chemical and biological indicators. Reported incorrect procedures in decontamination of medical devices performed by questioned dentists and lack or inadequate response to asked questions indicate the lack of adequate knowledge about decontamination. Personnel who performs decontamination processes should be continuously trained.

Health Literacy Demands of Patient-Reported Evaluation Tools in Orthopedics: A Mixed-Methods Case Study.

PubMed

Hadden, Kristie; Prince, Latrina Y; Barnes, C Lowry

In response to an assessment of organizational health literacy practices at a major academic health center, this case study evaluated the health literacy demands of patient-reported outcome measures commonly used in orthopedic surgery practices to identify areas for improvement. A mixed-methods approach was used to analyze the readability and patient feedback of orthopedic patient-reported outcome materials. Qualitative results were derived from focus group notes, observations, recordings, and consensus documents. Results were combined to formulate recommendations for quality improvement. Readability results indicated that narrative portions of sample patient outcome tools were written within or below the recommended eighth-grade reading level (= 5.9). However, document literacy results were higher than the recommended reading level (= 9.8). Focus group results revealed that participants had consensus on 8 of 12 plain language best practices, including use of bullet lists and jargon or technical words in both instruments. Although the typical readability of both instruments was not exceedingly high, appropriate readability formula and assessment methods gave a more comprehensive assessment of true readability. In addition, participant feedback revealed the need to reduce jargon and improve formatting to lessen the health literacy demands on patients. As clinicians turn more toward patient-reported measures to assess health care quality, it is important to consider the health literacy demands that are inherent in the instruments they are given in our health systems.

Best Practices in the Evaluation of Large-scale STEM-focused Events: A Review of Recent Literature

NASA Astrophysics Data System (ADS)

Shebby, S.; Cobb, W. H.; Buxner, S.; Shipp, S. S.

2015-12-01

Each year, the National Aeronautics and Space Administration (NASA) sponsors a variety of educational events to share information with educators, students, and the general public. Intended outcomes of these events include increased interest in and awareness of the mission and goals of NASA. Events range in size from relatively small family science nights at a local school to large-scale mission and celestial event celebrations involving thousands of members of the general public. To support community members in designing event evaluations, the Science Mission Directorate (SMD) Planetary Science Forum sponsored the creation of a Best Practices Guide. The guide was generated by reviewing published large-scale event evaluation reports; however, the best practices described within are pertinent for all event organizers and evaluators regardless of event size. Each source included in the guide identified numerous challenges to conducting their event evaluation. These included difficulty in identifying extant instruments or items, collecting representative data, and disaggregating data to inform different evaluation questions. Overall, the guide demonstrates that evaluations of the large-scale events are generally done at a very basic level, with the types of data collected limited to observable demographic information and participant reactions collected via online survey. In addition to these findings, this presentation will describe evaluation best practices that will help practitioners move beyond these basic indicators and examine how to make the evaluation process an integral—and valuable—element of event planning, ultimately informing event outcomes and impacts. It will provide detailed information on five recommendations presented in the guide: 1) consider evaluation methodology, including data analysis, in advance; 2) design data collection instruments well in advance of the event; 3) collect data at different times and from multiple sources; 4) use technology to make the job easier; and 5) be aware of how challenging it is to measure impact.

Evaluative frailty index for physical activity (EFIP): a reliable and valid instrument to measure changes in level of frailty.

PubMed

de Vries, Nienke M; Staal, J Bart; Olde Rikkert, Marcel G M; Nijhuis-van der Sanden, Maria W G

2013-04-01

Physical activity is assumed to be important in the prevention and treatment of frailty. It is unclear, however, to what extent frailty can be influenced because instruments designed to assess frailty have not been validated as evaluative outcome instruments in clinical practice. The aims of this study were: (1) to develop a frailty index (i.e., the evaluative frailty index for physical activity [EFIP]) based on the method of deficit accumulation and (2) to test the clinimetric properties of the EFIP. The content of the EFIP was determined using a written Delphi procedure. Intrarater reliability, interrater reliability, and construct validity were determined in an observational study (n=24). Intrarater reliability and interrater reliability were calculated using Cohen kappa and intraclass correlation coefficients (ICCs). Construct validity was determined by correlating the score on the EFIP with those on the timed "up & go" test (TUG), the performance-oriented mobility assessment (POMA), and the Cumulative Illness Rating Scale for Geriatrics (CIRS-G). Fifty items were included in the EFIP. Interrater reliability (Cohen kappa=0.72, ICC=.96) and intrarater reliability (Cohen kappa=0.77 and 0.80, ICC=.93 and .98) were good. As expected, a fair to moderate correlation with the TUG, POMA, and CIRS-G was found (.61, -.70, and .66, respectively). Reliability and validity of the EFIP have been tested in a small sample. These and other clinimetric properties, such as responsiveness, will be assessed or reassessed in a larger study population. The EFIP is a reliable and valid instrument to evaluate the effect of physical activity on frailty in research and in clinical practice.

Qualifying instrument for evaluation of food and nutritional care in hospital.

PubMed

Díez García, R W; Souza, A A; Proença, R P C

2012-01-01

Establishing criteria for hospital nutrition care ensures that quality care is delivered to patients. The responsibility of the Hospital Food and Nutrition Service (HFNS) is not always well defined, despite efforts to establish guidelines for patient clinical nutrition practice. This study describes the elaboration of an Instrument for Evaluation of Food and Nutritional Care (IEFNC) aimed at directing the actions of the Hospital Food and Nutrition Service. This instrument was qualified by means of a comparative analysis of the categories related to hospital food and nutritional care, published in the literature. Elaboration of the IEFNC comprised the following stages: (a) a survey of databases and documents for selection of the categories to be used in nutrition care evaluation, (b) a study of the institutional procedures for nutrition practice at two Brazilian hospitals, in order to provide a description of the sequence of actions that should be taken by the HFNS as well as other services participating in nutrition care, (c) design of the IEFNC based on the categories published in the literature, adapted to the sequence of actions observed in the routines of the hospitals under study, (d) application of the questionnaire at two different hospitals that was mentioned in the item (b), in order to assess the time spent on its application, the difficulties in phrasing the questions, and the coverage of the instrument, and (e) finalization of the instrument. The IEFNC consists of 50 open and closed questions on two areas of food and nutritional care in hospital: inpatient nutritional care and food service quality. It deals with the characterization and structure of hospitals and their HFNS, the actions concerning the patients' nutritional evaluation and monitoring, the meal production system, and the hospital diets. "This questionnaire is a tool that can be seen as a portrait of the structure and characteristics of the HFNS and its performance in clinical and meal management dietitian activities."

Psychometric evaluation of the Swedish adaptation of the Inventory for Assessing the Process of Cultural Competence Among Healthcare Professionals--Revised (IAPCC-R).

PubMed

Olt, Helen; Jirwe, Maria; Gustavsson, Petter; Emami, Azita

2010-01-01

The purpose of this study was to describe the translation, adaption, and psychometric evaluation process in relation to validity and reliability of the Swedish version of the instrument, Inventory for Assessing The Process of Cultural Competence Among Healthcare Professionals-Revised (IAPCC-R) following the translation, adaptation, and psychometric evaluation process. Validity tests were conducted on the response processes (N = 15), the content (N = 7), and the internal structure of the instrument (N = 334). Reliability (alpha = .65 for the total scale varying between -.01 and .65 for the different subscales) was evaluated in terms of internal consistency. Results indicated weak validity and reliability though it is difficult to conclude whether this is related to adaptation issues or the original construction.The testing of the response process identified problems in relation to respondents' conceptualization of cultural competence. The test of the content identified a weak correspondence between the items and the underlying model. In addition, a confirmatory factor analysis did not confirm the proposed structure of the instrument. This study concludes that this instrument is not valid and reliable for use with a Swedish population of practicing nurses or nursing students.

Development and Validation of a Cross-Cultural Knowledge, Attitudes, and Practices Survey Instrument for Chronic Kidney Disease in a Swahili-Speaking Population

PubMed Central

Stanifer, John W.; Karia, Francis; Voils, Corrine I.; Turner, Elizabeth L.; Maro, Venance; Shimbi, Dionis; Kilawe, Humphrey; Lazaro, Matayo; Patel, Uptal D.

2015-01-01

Introduction Non-communicable diseases are a growing global burden, and structured surveys can identify critical gaps to address this epidemic. In sub-Saharan Africa, there are very few well-tested survey instruments measuring population attributes related to non-communicable diseases. To meet this need, we have developed and validated the first instrument evaluating knowledge, attitudes and practices pertaining to chronic kidney disease in a Swahili-speaking population. Methods and Results Between December 2013 and June 2014, we conducted a four-stage, mixed-methods study among adults from the general population of northern Tanzania. In stage 1, the survey instrument was constructed in English by a group of cross-cultural experts from multiple disciplines and through content analysis of focus group discussions to ensure local significance. Following translation, in stage 2, we piloted the survey through cognitive and structured interviews, and in stage 3, in order to obtain initial evidence of reliability and construct validity, we recruited and then administered the instrument to a random sample of 606 adults. In stage 4, we conducted analyses to establish test-retest reliability and known-groups validity which was informed by thematic analysis of the qualitative data in stages 1 and 2. The final version consisted of 25 items divided into three conceptual domains: knowledge, attitudes and practices. Each item demonstrated excellent test-retest reliability with established content and construct validity. Conclusions We have developed a reliable and valid cross-cultural survey instrument designed to measure knowledge, attitudes and practices of chronic kidney disease in a Swahili-speaking population of Northern Tanzania. This instrument may be valuable for addressing gaps in non-communicable diseases care by understanding preferences regarding healthcare, formulating educational initiatives, and directing development of chronic disease management programs that incorporate chronic kidney disease across sub-Saharan Africa. PMID:25811781

Evaluation of the Implementation Grant Project of Tennessee's Nutrition Education and Training Program 1981-82.

ERIC Educational Resources Information Center

Banta, Trudy W.; And Others

The Bureau of Educational Research and Service at the University of Tennessee, Knoxville (UTK) conducted the 1981-82 evaluation of the Tennessee Nutrition Education and Training Program. Instruments developed, field tested, and revised by the UTK team were used to assess the nutrition knowledge, attitudes, practices, and perceptions of students…

Practice Evaluation Strategies Among Social Workers: Why an Evidence-Informed Dual-Process Theory Still Matters.

PubMed

Davis, Thomas D

2017-01-01

Practice evaluation strategies range in style from the formal-analytic tools of single-subject designs, rapid assessment instruments, algorithmic steps in evidence-informed practice, and computer software applications, to the informal-interactive tools of clinical supervision, consultation with colleagues, use of client feedback, and clinical experience. The purpose of this article is to provide practice researchers in social work with an evidence-informed theory that is capable of explaining both how and why social workers use practice evaluation strategies to self-monitor the effectiveness of their interventions in terms of client change. The author delineates the theoretical contours and consequences of what is called dual-process theory. Drawing on evidence-informed advances in the cognitive and social neurosciences, the author identifies among everyday social workers a theoretically stable, informal-interactive tool preference that is a cognitively necessary, sufficient, and stand-alone preference that requires neither the supplementation nor balance of formal-analytic tools. The author's delineation of dual-process theory represents a theoretical contribution in the century-old attempt to understand how and why social workers evaluate their practice the way they do.

Self-administered health literacy instruments for people with diabetes: systematic review of measurement properties.

PubMed

Lee, Eun-Hyun; Kim, Chun-Ja; Lee, Jiyeon; Moon, Seung Hei

2017-09-01

The aims of this study were to identify all available self-administered instruments measuring health literacy in people with diabetes and to determine the current instrument that is the most appropriate for applying to this population in both practice and research. A systematic review of measurement properties. MEDLINE, EMBASE and CINAHL electronic databases from their inception up to 28 March 2016. The methodological quality of each included study was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. The reported results for measurement properties in the studies were assessed according to Terwee's quality criteria. Thirteen self-administered instruments measuring health literacy in people with diabetes were identified, of which six (44%) were diabetes-specific instruments. The instruments that covered the broadest contents of health literacy were the Health Literacy Scale and Health Literacy Questionnaire. The (test-retest) reliability, measurement error and responsiveness were not evaluated for any instrument, while internal consistency and hypothesis testing validity were the most frequently assessed measurement properties. With the current evidence, the Health Literacy Scale may be the most appropriate instrument for patients with diabetes in practice and research. However, the structural validity of this scale needs to be further established, particularly in other language versions. It is also recommended to use the Diabetes Numeracy Test-15 along with the Health Literacy Scale to complement the lack of numeracy measures in the Health Literacy Scale. © 2017 John Wiley & Sons Ltd.

Measuring health literacy in individuals with diabetes: a systematic review and evaluation of available measures.

PubMed

Al Sayah, Fatima; Williams, Beverly; Johnson, Jeffrey A

2013-02-01

To identify instruments used to measure health literacy and numeracy in people with diabetes; evaluate their use, measurement scope, and properties; discuss their strengths and weaknesses; and propose the most useful, reliable, and applicable measure for use in research and practice settings. A systematic literature review was conducted to identify the instruments. Nutbeam's domains of health literacy and a diabetes health literacy skill set were used to evaluate the measurement scope of the identified instruments and to evaluate their applicability in people with diabetes. Fifty-six studies were included, from which one diabetes-specific (LAD) and eight generic measures of health literacy (REALM, REALM-R, TOFHLA, s-TOFHLA, NVS, 3-brief SQ, 3-level HL Scale, SILS) and one diabetes-specific (DNT) and two generic measures of numeracy (SNS, WRAT) were identified. These instruments were categorized into direct measures, that is, instruments that assess the performance of individuals on health literacy skills and indirect measures that rely on self-report of these skills. The most commonly used instruments measure selective domains of health literacy, focus mainly on reading and writing skills, and do not address other important skills such as verbal communication, health care system navigation, health-related decision making, and numeracy. The structure, mode, and length of administration and measurement properties were found to affect the applicability of these instruments in clinical and research settings. Indirect self- or clinician-administered measures are the most useful in both clinical and research settings. This review provides an evaluation of available health literacy measures and guidance to practitioners and researchers for selecting the appropriate measures for use in clinical settings and research applications.

Development and evaluation of an instrument to measure parental satisfaction with quality of care in neonatal follow-up.

PubMed

Butt, Michelle L; Pinelli, Janet; Boyle, Michael H; Thomas, Helen; Hunsberger, Mabel; Saigal, Saroj; Lee, David S; Fanning, Jamie K; Austin, Patricia

2009-02-01

The goal of this study was to develop and subsequently evaluate the psychometric properties of a new discriminative instrument to measure parental satisfaction with the quality of care provided in neonatal follow-up (NFU) programs. The methodological framework for developing and evaluating measurement scales described by Streiner and Norman (Health Measurement Scales: A Practical Guide to Their Development and Use. 3rd ed. New York: Oxford University Press; 2003) was used for the study. Informing the phases of the research was a sample of 24 health care professionals and 381 parents who use NFU services. A comprehensive list of items representing the construct, parental satisfaction with quality of care, was generated from published reliable and valid instruments, research studies, focus groups with health care experts, and focus groups with parents. Using a clinimetric approach, the 62 items generated were reduced to 39 items based on parents' ratings of importance and refinement of the items by the research team. After content validation and pretesting, the instrument was tested with parents and underwent item-analysis. The resulting 16-item instrument was composed of 2 subscales, Process and Outcomes. Evaluation of the instrument's psychometric properties indicated adequate test-retest reliability (intraclass correlation coefficient = 0.72) and internal consistency (Process subscale, alpha = 0.77; Outcomes subscale, alpha = 0.90; overall instrument, alpha = 0.90), as well as good content and construct validity. A confirmatory factor analysis supported the multidimensionality of the construct. This new instrument provides clinicians and policy-makers with a tool to assess parental satisfaction with the quality of care in NFU, so areas of dissatisfaction can be identified and changes implemented to optimize service provision.

Evaluator competencies in the context of diversity training: The practitioners' point of view.

PubMed

Froncek, Benjamin; Mazziotta, Agostino; Piper, Verena; Rohmann, Anette

2018-04-01

Evaluator competencies have been discussed since the beginnings of program evaluation literature. More recently, the Essential Competencies for Program Evaluators (Ghere et al., 2006; Stevahn, King, Ghere & Minnema, 2005a) have proven to be a useful taxonomy for learning and improving evaluation practice. Evaluation is critical to diversity training activities, and diversity training providers face the challenge of conducting evaluations of their training programs. We explored what competencies are viewed as instrumental to conducting useful evaluations in this specific field of evaluation practice. In an online survey, N = 172 diversity training providers were interviewed via an open answer format about their perceptions of evaluator competencies, with n = 95 diversity training providers contributing statements. The Essential Competencies for Program Evaluators were used to conduct a deductive qualitative content analysis of the statements. While systematic inquiry, reflective practice, and interpersonal competence were well represented, situational analysis and project management were not. Implications are discussed for evaluation capacity building among diversity training providers and for negotiating evaluation projects with evaluation professionals. Copyright © 2018 Elsevier Ltd. All rights reserved.

Piloting violence and incident reporting measures on one acute mental health inpatient unit.

PubMed

Woods, Phil; Ashley, Carolyn; Kayto, Denise; Heusdens, Carol

2008-05-01

During May, 2006, on one acute mental health inpatient unit, nursing staff evaluated each patient three times a day (i.e., once each nursing shift) using the Broset Violence Checklist (BVC). Associated data were collected using the Staff Observation and Aggression Scale-Revised (SOAS-R) if an adverse incident occurred. At the end of the data collection period, the nursing staff were asked to complete a short questionnaire anonymously to evaluate how useful they had found the instruments. N = 93 patients were admitted to the unit during the month of study. Seven incidents were reported using the SOAS-R. A slight trend was noted for higher BVC score in aggressive patients. A potential high occurrence of underreporting on incidents was observed. There was limited feedback data from nursing staff at the end of the study, but the responses received were encouraging for continued use of the instruments in practice. The pilot study fulfilled its purpose in two ways. First, it allowed staff on the unit to experience using structured instruments to support their practice. Second, it allowed an opportunity to raise awareness of potential underreporting and tolerance of aggression on the unit.

Evaluating Walking in Patients with Multiple Sclerosis

PubMed Central

Bennett, Susan

2011-01-01

Walking limitations are among the most visible manifestations of multiple sclerosis (MS). Regular walking assessments should be a component of patient management and require instruments that are appropriate from the clinician's and the patient's perspectives. This article reviews frequently used instruments to assess walking in patients with MS, with emphasis on their validity, reliability, and practicality in the clinical setting. Relevant articles were identified based on PubMed searches using the following terms: “multiple sclerosis AND (walking OR gait OR mobility OR physical activity) AND (disability evaluation)”; references of relevant articles were also searched. Although many clinician- and patient-driven instruments are available, not all have been validated in MS, and some are not sensitive enough to detect small but clinically important changes. Choosing among these depends on what needs to be measured, psychometric properties, the clinical relevance of results, and practicality with respect to space, time, and patient burden. Of the instruments available, the clinician-observed Timed 25-Foot Walk and patient self-report 12-Item Multiple Sclerosis Walking Scale have properties that make them suitable for routine evaluation of walking performance. The Dynamic Gait Index and the Timed Up and Go test involve other aspects of mobility, including balance. Tests of endurance, such as the 2- or 6-Minute Walk, may provide information on motor fatigue not captured by other tests. Quantitative measurement of gait kinetics and kinematics, and recordings of mobility in the patient's environment via accelerometry or Global Positioning System odometry, are currently not routinely used in the clinical setting. PMID:24453700

Development and Validation of a Practical Instrument for Injury Prevention: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT).

PubMed

Sun, Yi; Arning, Martin; Bochmann, Frank; Börger, Jutta; Heitmann, Thomas

2018-06-01

The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT) is a practical instrument that is currently used in the German woodworking and metalworking industries to monitor safety conditions at workplaces. The 12-item scoring system has three subscales rating technical, organizational, and personnel-related conditions in a company. Each item has a rating value ranging from 1 to 9, with higher values indicating higher standard of safety conditions. The reliability of this instrument was evaluated in a cross-sectional survey among 128 companies and its validity among 30,514 companies. The inter-rater reliability of the instrument was examined independently and simultaneously by two well-trained safety engineers. Agreement between the double ratings was quantified by the intraclass correlation coefficient and absolute agreement of the rating values. The content validity of the OSH-MAT was evaluated by quantifying the association between OSH-MAT values and 5-year average injury rates by Poisson regression analysis adjusted for the size of the companies and industrial sectors. The construct validity of OSH-MAT was examined by principle component factor analysis. Our analysis indicated good to very good inter-rater reliability (intraclass correlation coefficient = 0.64-0.74) of OSH-MAT values with an absolute agreement of between 72% and 81%. Factor analysis identified three component subscales that met exactly the structure theory of this instrument. The Poisson regression analysis demonstrated a statistically significant exposure-response relationship between OSH-MAT values and the 5-year average injury rates. These analyses indicate that OSH-MAT is a valid and reliable instrument that can be used effectively to monitor safety conditions at workplaces.

Developing a cultural competence inventory for nurses in China.

PubMed

Cai, D; Kunaviktikul, W; Klunklin, A; Sripusanapan, A; Avant, P K

2017-06-01

To develop and psychometrically test the Cultural Competence Inventory for Nurses in China. Cultural competence is expected worldwide from nurses due to the increasing cultural diversity of people in healthcare establishments. Yet, no cultural competence framework or instrument for nurses has been identified to guide nursing practice in China where the cultural diversity of the populations and the characteristics of the healthcare system are different from those of the West. A review of literature and individual interviews among nurse experts generated 74 items, which were evaluated by six experts in transcultural nursing. A stratified random sampling technique was used to recruit 520 Chinese nurses for the field test. Construct validity and internal consistency reliability of the instrument were estimated by exploratory factor analysis and Cronbach's alpha, respectively. The data were collected from May 2015 to January 2016. The final instrument consists of 29 items in five dimensions, namely 'cultural awareness, cultural respect, cultural knowledge, cultural understanding and cultural skills'. Cronbach's alpha for the instrument was 0.94, with a range of 0.79-0.92 for the individual dimensions. The evidence for contrast-group validity (P < 0.001) was also obtained. The study provides evidence that the Cultural Competence Inventory for Nurses in China is reliable, valid and culturally sensitive for measuring nurses' cultural competence. The instrument development process facilitates the understanding of cultural competence globally. Cultural competence of nurses can be evaluated for self-development, workforce management and quality assurance. The instrument can also serve as the foundation to develop education curricula and nursing procedures or protocols to improve culturally competent nursing practice. © 2017 International Council of Nurses.

Qualitative Evaluation Methods in Ethics Education: A Systematic Review and Analysis of Best Practices.

PubMed

Watts, Logan L; Todd, E Michelle; Mulhearn, Tyler J; Medeiros, Kelsey E; Mumford, Michael D; Connelly, Shane

2017-01-01

Although qualitative research offers some unique advantages over quantitative research, qualitative methods are rarely employed in the evaluation of ethics education programs and are often criticized for a lack of rigor. This systematic review investigated the use of qualitative methods in studies of ethics education. Following a review of the literature in which 24 studies were identified, each study was coded based on 16 best practices characteristics in qualitative research. General thematic analysis and grounded theory were found to be the dominant approaches used. Researchers are effectively executing a number of best practices, such as using direct data sources, structured data collection instruments, non-leading questioning, and expert raters. However, other best practices were rarely present in the courses reviewed, such as collecting data using multiple sources, methods, raters, and timepoints, evaluating reliability, and employing triangulation analyses to assess convergence. Recommendations are presented for improving future qualitative research studies in ethics education.

Outcome Measures in Myasthenia Gravis: Incorporation Into Clinical Practice.

PubMed

Muppidi, Srikanth

2017-03-01

The development of validated assessment tools for evaluating disease status and response to interventions in patients with myasthenia gravis (MG) has been driven by clinical studies of emerging MG therapies. However, only a small proportion of MG-focused neurology practices have adopted these assessment tools for routine clinical use. This article reviews the suitability of 5 assessment instruments for incorporation into clinical practice, which should be driven by their ability to contribute to improved patient outcomes, and to be implemented within practice personnel and resource constraints. It is recommended that assessments based on both physician-evaluated and patient-reported outcomes be selected, to adequately evaluate both point-in-time symptom load and functional impact of MG symptoms over time. Provider resource allocation and reimbursement issues may be the most significant roadblocks to successful ongoing use of these tools; to that end, the addition of regular assessments to MG standards of care is recommended.

A systematic review of psychometric testing of instruments that measure intention to work with older people.

PubMed

Che, Chong Chin; Hairi, Noran Naqiah; Chong, Mei Chan

2017-09-01

To review systematically the psychometric properties of instruments used to measure intention to work with older people. Nursing students are part of the future healthcare workforce; thus, being aware of their intention to work with older people would give valuable insights to nursing education and practice. Despite a plethora of research on measuring intention to work with older people, a valid and reliable instrument has not been identified. A systematic literature review of evidence and psychometric properties. Eight database searches were conducted between 2006 - 2016. English articles were selected based on inclusion and exclusion criteria. The COSMIN checklist was used to assess instruments reporting a psychometric evaluation of validity and reliability. Of 41 studies identified for full text review, 36 met the inclusion criteria. Seven different types of instruments were identified for psychometric evaluation. Measures of reliability were reported in eight papers and validity in five papers. Evidence for each measurement property was limited, with each instrument demonstrating a lack of information on measurement properties. Based on the COSMIN checklist, the overall quality of the psychometric properties was rated as poor to good. No single instrument was found to be optimal for use. Studies of high methodological quality are needed to properly assess the measurement properties of the instruments that are currently available. Until such studies are available, we recommend using existing instruments with caution. © 2017 John Wiley & Sons Ltd.

Measuring organizational and individual factors thought to influence the success of quality improvement in primary care: a systematic review of instruments

PubMed Central

2012-01-01

Background Continuous quality improvement (CQI) methods are widely used in healthcare; however, the effectiveness of the methods is variable, and evidence about the extent to which contextual and other factors modify effects is limited. Investigating the relationship between these factors and CQI outcomes poses challenges for those evaluating CQI, among the most complex of which relate to the measurement of modifying factors. We aimed to provide guidance to support the selection of measurement instruments by systematically collating, categorising, and reviewing quantitative self-report instruments. Methods Data sources: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments, reference lists of systematic reviews, and citations and references of the main report of instruments. Study selection: The scope of the review was determined by a conceptual framework developed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). Papers reporting development or use of an instrument measuring a construct encompassed by the framework were included. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarising and comparing instruments. Instrument content was categorised using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care. Results We identified 186 potentially relevant instruments, 152 of which were analysed to develop the taxonomy. Eighty-four instruments measured constructs relevant to primary care, with content measuring CQI implementation and use (19 instruments), organizational context (51 instruments), and individual factors (21 instruments). Forty-one instruments were included for full review. Development methods were often pragmatic, rather than systematic and theory-based, and evidence supporting measurement properties was limited. Conclusions Many instruments are available for evaluating CQI, but most require further use and testing to establish their measurement properties. Further development and use of these measures in evaluations should increase the contribution made by individual studies to our understanding of CQI and enhance our ability to synthesise evidence for informing policy and practice. PMID:23241168

Controversies on the values for health instruments of Chinese medicine.

PubMed

Hou, Zheng-Kun; Chang, Xiang; Liu, Feng-Bin; Xie, Nelson; Guo, Nicole; Chen, Xin-Lin

2017-02-01

Currently, there are increasing debates on the necessity of health instruments in Chinese medicine (CM) emerging in China. This study aims to reevaluate its status and values. Analyzing the causes, limits, advantages, and properties characters of health instruments in CM, it is found that weak fundamental research, incomplete self-awareness, and complicated social factors are the primary causes of debates. A comprehensive analysis showed health instruments in CM have health evaluation benefits to people from a dominant Chinese culture, meet the requirements of cultural background, and bring long-term value to Chinese instrument researches. However, its values and status should be treated differently depending on various subtypes. Although little theoretical and practical evidences proved that patients-reported health instruments in CM should be proposed independently, the doctors- and nurses-reported questionnaires are necessary. With this in mind, the study group proposes the 'Chinese cultural instruments (CCIs)' and 'health-related CCIs'. The latter one aims to evaluate the health status of people in a dominant Chinese culture. The CCIs theory represents Chinese instrument researches on a larger regional and higher level, and resolves the debates on instruments between CM and Western medicine in China. Health instruments in CM bring more scientific and social benefits for Chinese instrument researches. However, it does not include cultural demands, and lacks scientific significance. CCIs have all its virtues, and add solutions to the latter's theory bottleneck and scientific debates, thus bringing increased benefits to clinical assessment in complementary and alternative medicine researches.

Validation of an instrument to measure inter-organisational linkages in general practice.

PubMed

Amoroso, Cheryl; Proudfoot, Judith; Bubner, Tanya; Jayasinghe, Upali W; Holton, Christine; Winstanley, Julie; Beilby, Justin; Harris, Mark F

2007-12-03

Linkages between general medical practices and external services are important for high quality chronic disease care. The purpose of this research is to describe the development, evaluation and use of a brief tool that measures the comprehensiveness and quality of a general practice's linkages with external providers for the management of patients with chronic disease. In this study, clinical linkages are defined as the communication, support, and referral arrangements between services for the care and assistance of patients with chronic disease. An interview to measure surgery-level (rather than individual clinician-level) clinical linkages was developed, piloted, reviewed, and evaluated with 97 Australian general practices. Two validated survey instruments were posted to patients, and a survey of locally available services was developed and posted to participating Divisions of General Practice (support organisations). Hypotheses regarding internal validity, association with local services, and patient satisfaction were tested using factor analysis, logistic regression and multilevel regression models. The resulting General Practice Clinical Linkages Interview (GP-CLI) is a nine-item tool with three underlying factors: referral and advice linkages, shared care and care planning linkages, and community access and awareness linkages. Local availability of chronic disease services has no affect on the comprehensiveness of services with which practices link, however, comprehensiveness of clinical linkages has an association with patient assessment of access, receptionist services, and of continuity of care in their general practice. The GP-CLI may be useful to researchers examining comparable health care systems for measuring the comprehensiveness and quality of linkages at a general practice-level with related services, possessing both internal and external validity. The tool can be used with large samples exploring the impact, outcomes, and facilitators of high quality clinical linkages in general practice.

Challenges of Maintaining Good Clinical Laboratory Practices in Low-Resource Settings:  A Health Program Evaluation Framework Case Study From East Africa.

PubMed

Zhang, Helen L; Omondi, Michael W; Musyoka, Augustine M; Afwamba, Isaac A; Swai, Remigi P; Karia, Francis P; Muiruri, Charles; Reddy, Elizabeth A; Crump, John A; Rubach, Matthew P

2016-08-01

Using a clinical research laboratory as a case study, we sought to characterize barriers to maintaining Good Clinical Laboratory Practice (GCLP) services in a developing world setting. Using a US Centers for Disease Control and Prevention framework for program evaluation in public health, we performed an evaluation of the Kilimanjaro Christian Medical Centre-Duke University Health Collaboration clinical research laboratory sections of the Kilimanjaro Clinical Research Institute in Moshi, Tanzania. Laboratory records from November 2012 through October 2014 were reviewed for this analysis. During the 2-year period of study, seven instrument malfunctions suspended testing required for open clinical trials. A median (range) of 9 (1-55) days elapsed between instrument malfunction and biomedical engineer service. Sixteen (76.1%) of 21 suppliers of reagents, controls, and consumables were based outside Tanzania. Test throughput among laboratory sections used a median (range) of 0.6% (0.2%-2.7%) of instrument capacity. Five (55.6%) of nine laboratory technologists left their posts over 2 years. These findings demonstrate that GCLP laboratory service provision in this setting is hampered by delays in biomedical engineer support, delays and extra costs in commodity procurement, low testing throughput, and high personnel turnover. © American Society for Clinical Pathology, 2016. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Systematic review of guidelines for management of intermediate hepatocellular carcinoma using the Appraisal of Guidelines Research and Evaluation II instrument.

PubMed

Holvoet, Tom; Raevens, Sarah; Vandewynckel, Yves-Paul; Van Biesen, Wim; Geboes, Karen; Van Vlierberghe, Hans

2015-10-01

Hepatocellular carcinoma is the second leading cause of cancer-related mortality worldwide. Multiple guidelines have been developed to assist clinicians in its management. We aimed to explore methodological quality of these guidelines focusing on treatment of intermediate hepatocellular carcinoma by transarterial chemoembolization. A systematic search was performed for Clinical Practice Guidelines and Consensus statements for hepatocellular carcinoma management. Guideline quality was appraised using the Appraisal of Guidelines Research and Evaluation II instrument, which rates guideline development processes across 6 domains: 'Scope and purpose', 'Stakeholder involvement', 'Rigour of development', 'Clarity of presentation', 'Applicability' and 'Editorial independence'. Thematic analysis of guidelines was performed to map differences in recommendations. Quality of 21 included guidelines varied widely, but was overall poor with only one guideline passing the 50% mark on all domains. Key recommendations as (contra)indications and technical aspects were inconsistent between guidelines. Aspects on side effects and health economics were mainly neglected. Methodological quality of guidelines on transarterial chemoembolization in hepatocellular carcinoma management is poor. This results in important discrepancies between guideline recommendations, creating confusion in clinical practice. Incorporation of the Appraisal of Guidelines Research and Evaluation II instrument in guideline development may improve quality of future guidelines by increasing focus on methodological aspects. Copyright © 2015 Editrice Gastroenterologica Italiana S.r.l. Published by Elsevier Ltd. All rights reserved.

[New method and instrument to diagnose crop growth status in greenhouse based on spectroscopy].

PubMed

Zhang, Xi-Jie; Li, Min-Zan; Cui, Di; Zhao, Peng; Sun, Jian-Ying; Tang, Ning

2006-05-01

Spectral reflectance of cucumber leaves in greenhouse was measured using an ASD FieldSpec Pro VNIR spectrometer with natural illumination. Two sensitive wavelengths, 527 nm and 762 nm, were selected to evaluate the nitrogen content of the cucumber leaves. A model was established and validated using normal difference color index(NDCI) with the correlation coefficient of 0.881. Based on the above efforts, a handheld spectral instrument was developed to diagnose the growth status of the crop in greenhouse using fiber optics. The instrument was mainly composed of four parts: reflected light acquisition system, light intensity measurement unit, signal conditioning unit, and data acquisition system. The sunlight reflected by the crop was transmitted by the fiber, and passed through the light filter to obtain light at the sensitive wavelengths. Finally it was transformed into electronic signal by the photoelectric transistor, and was used to diagnose the growth status of the crop according to the evaluation model. The result showed that the developed instrument was practical.

Pianists exhibit enhanced memory for vocal melodies but not piano melodies.

PubMed

Weiss, Michael W; Vanzella, Patrícia; Schellenberg, E Glenn; Trehub, Sandra E

2015-01-01

Nonmusicians remember vocal melodies (i.e., sung to la la) better than instrumental melodies. If greater exposure to the voice contributes to those effects, then long-term experience with instrumental timbres should elicit instrument-specific advantages. Here we evaluate this hypothesis by comparing pianists with other musicians and nonmusicians. We also evaluate the possibility that absolute pitch (AP), which involves exceptional memory for isolated pitches, influences melodic memory. Participants heard 24 melodies played in four timbres (voice, piano, banjo, marimba) and were subsequently required to distinguish the melodies heard previously from 24 novel melodies presented in the same timbres. Musicians performed better than nonmusicians, but both groups showed a comparable memory advantage for vocal melodies. Moreover, pianists performed no better on melodies played on piano than on other instruments, and AP musicians performed no differently than non-AP musicians. The findings confirm the robust nature of the voice advantage and rule out explanations based on familiarity, practice, and motor representations.

A Framework for Establishing Standard Reference Scale of Texture by Multivariate Statistical Analysis Based on Instrumental Measurement and Sensory Evaluation.

PubMed

Zhi, Ruicong; Zhao, Lei; Xie, Nan; Wang, Houyin; Shi, Bolin; Shi, Jingye

2016-01-13

A framework of establishing standard reference scale (texture) is proposed by multivariate statistical analysis according to instrumental measurement and sensory evaluation. Multivariate statistical analysis is conducted to rapidly select typical reference samples with characteristics of universality, representativeness, stability, substitutability, and traceability. The reasonableness of the framework method is verified by establishing standard reference scale of texture attribute (hardness) with Chinese well-known food. More than 100 food products in 16 categories were tested using instrumental measurement (TPA test), and the result was analyzed with clustering analysis, principal component analysis, relative standard deviation, and analysis of variance. As a result, nine kinds of foods were determined to construct the hardness standard reference scale. The results indicate that the regression coefficient between the estimated sensory value and the instrumentally measured value is significant (R(2) = 0.9765), which fits well with Stevens's theory. The research provides reliable a theoretical basis and practical guide for quantitative standard reference scale establishment on food texture characteristics.

Development and Initial Validation of a Measure to Assess Factors Related to Sustainability of School-Wide Positive Behavior Support

ERIC Educational Resources Information Center

McIntosh, Kent; MacKay, Leslie D.; Hume, Amanda E.; Doolittle, Jennifer; Vincent, Claudia G.; Horner, Robert H.; Ervin, Ruth A.

2011-01-01

Sustainability of effective practices in schools is a critical area for research in any domain. The purpose of this article is to describe and evaluate the validity and reliability of a recently developed research instrument designed to evaluate schools' capacity to sustain school-wide positive behavior support (SWPBS) efforts at the universal…

Beyond Portfolios: A Practical Look at Student Projects as Teaching and Evaluation Devices (Part 2).

ERIC Educational Resources Information Center

Tillyer, Anthea; Sokolik, Maggi

1993-01-01

Steps required for developing a successful project class are described, beginning with an examination of how to use student writing projects with lower proficiency learners. A discussion of how projects can best be used as teaching and evaluation instruments in higher level classes is followed by examples of specific projects and styles. (Contains…

Solid motor diagnostic instrumentation. [design of self-contained instrumentation

NASA Technical Reports Server (NTRS)

Nakamura, Y.; Arens, W. E.; Wuest, W. S.

1973-01-01

A review of typical surveillance and monitoring practices followed during the flight phases of representative solid-propellant upper stages and apogee motors was conducted to evaluate the need for improved flight diagnostic instrumentation on future spacecraft. The capabilities of the flight instrumentation package were limited to the detection of whether or not the solid motor was the cause of failure and to the identification of probable primary failure modes. Conceptual designs of self-contained flight instrumentation packages capable of meeting these reqirements were generated and their performance, typical cost, and unit characteristics determined. Comparisons of a continuous real time and a thresholded hybrid design were made on the basis of performance, mass, power, cost, and expected life. The results of this analysis substantiated the feasibility of a self-contained independent flight instrumentation module as well as the existence of performance margins by which to exploit growth option applications.

Instrument Rating Practical Test Standards for Airplane, Helicopter, Airship

DOT National Transportation Integrated Search

1994-10-01

The Instrument Rating Practical Test Standards (PTS) book has : been published by the Federal Aviation Administration (FAA) to : establish the standards for the instrument rating practical test for : airplanes, helicopters, and airships. FAA inspecto...

A systematic review of instruments for assessing parent satisfaction with family-centred care in neonatal intensive care units.

PubMed

Dall'Oglio, Immacolata; Mascolo, Rachele; Gawronski, Orsola; Tiozzo, Emanuela; Portanova, Anna; Ragni, Angela; Alvaro, Rosaria; Rocco, Gennaro; Latour, Jos M

2018-03-01

This systematic review synthesised and described instruments measuring parent satisfaction with the increasing standard practice of family-centred care (FCC) in neonatal intensive care units. We evaluated 11 studies published from January 2006 to March 2016: two studies validated a parent satisfaction questionnaire, and nine developed or modified previous questionnaires to use as outcome measures in their local settings. Most instruments were not tested on reliability and validity. Only two validated instruments included all six of the FCC principles and could assess parent satisfaction with FCC in neonatal intensive care units and be considered as outcome indicators for further research. ©2017 Foundation Acta Paediatrica. Published by John Wiley & Sons Ltd.

Nuclear medicine and quantitative imaging research (instrumentation and quantitative methods of evaluation)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Beck, R.N.; Cooper, M.D.

1990-09-01

This report summarizes goals and accomplishments of the research program supported under DOE Grant No. FG02-86ER60418 entitled Instrumentation and Quantitative Methods of Evaluation, with R. Beck, P. I. and M. Cooper, Co-P.I. during the period January 15, 1990 through September 1, 1990. This program addresses the problems involving the basic science and technology underlying the physical and conceptual tools of radioactive tracer methodology as they relate to the measurement of structural and functional parameters of physiologic importance in health and disease. The principal tool is quantitative radionuclide imaging. The overall objective of this program is to further the development andmore » transfer of radiotracer methodology from basic theory to routine clinical practice in order that individual patients and society as a whole will receive the maximum net benefit from the new knowledge gained. The focus of the research is on the development of new instruments and radiopharmaceuticals, and the evaluation of these through the phase of clinical feasibility. 7 figs.« less

The equivalence of computerized and paper-and-pencil psychological instruments: implications for measures of negative affect.

PubMed

Schulenberg, S E; Yutrzenka, B A

1999-05-01

The use of computerized psychological assessment is a growing practice among contemporary mental health professionals. Many popular and frequently used paper-and-pencil instruments have been adapted into computerized versions. Although equivalence for many instruments has been evaluated and supported, this issue is far from resolved. This literature review deals with recent research findings that suggest that computer aversion negatively impacts computerized assessment, particularly as it relates to measures of negative affect. There is a dearth of equivalence studies that take into account computer aversion's potential impact on the measurement of negative affect. Recommendations are offered for future research in this area.

Clinical utility of measures of breathlessness.

PubMed

Cullen, Deborah L; Rodak, Bernadette

2002-09-01

The clinical utility of measures of dyspnea has been debated in the health care community. Although breathlessness can be evaluated with various instruments, the most effective dyspnea measurement tool for patients with chronic lung disease or for measuring treatment effectiveness remains uncertain. Understanding the evidence for the validity and reliability of these instruments may provide a basis for appropriate clinical application. Evaluate instruments designed to measure breathlessness, either as single-symptom or multidimensional instruments, based on psychometrics foundations such as validity, reliability, and discriminative and evaluative properties. Classification of each dyspnea measurement instrument will recommend clinical application in terms of exercise, benchmarking patients, activities of daily living, patient outcomes, clinical trials, and responsiveness to treatment. Eleven dyspnea measurement instruments were selected. Each instrument was assessed as discriminative or evaluative and then analyzed as to its psychometric properties and purpose of design. Descriptive data from all studies were described according to their primary patient application (ie, chronic obstructive pulmonary disease, asthma, or other patient populations). The Borg Scale and the Visual Analogue Scale are applicable to exertion and thus can be applied to any cardiopulmonary patient to determine dyspnea. All other measures were determined appropriate for chronic obstructive pulmonary disease, whereas the Shortness of Breath Questionnaire can be applied to cystic fibrosis and lung transplant patients. The most appropriate utility for all instruments was measuring the effects on activities of daily living and for benchmarking patient progress. Instruments that quantify function and health-related quality of life have great utility for documenting outcomes but may be limited as to documenting treatment responsiveness in terms of clinically important changes. The dyspnea measurement instruments we studied meet important standards of validity and reliability. Discriminative measures have limited clinical utility and, when used for populations or conditions for which they are not designed or validated, the data collected may not be clinically relevant. Evaluative measures have greater clinical utility and can be applied for outcome purposes. Measures should be applied to the populations and conditions for which they were designed. The relationship between clinical therapies and the measurement of dyspnea as an outcome can develop as respiratory therapists become more comfortable with implementing dyspnea measurement instruments and use the data to improve patient treatment. Dyspnea evaluation should be considered for all clinical practice guidelines and care pathways.

Degradation of learned skills. Static practice effectiveness for visual approach and landing skill retention

NASA Technical Reports Server (NTRS)

Sitterley, T. E.

1974-01-01

The effectivess of an improved static retraining method was evaluated for a simulated space vehicle approach and landing under instrument and visual flight conditions. Experienced pilots were trained and then tested after 4 months without flying to compare their performance using the improved method with three methods previously evaluated. Use of the improved static retraining method resulted in no practical or significant skill degradation and was found to be even more effective than methods using a dynamic presentation of visual cues. The results suggested that properly structured open loop methods of flight control task retraining are feasible.

School-Based Methylphenidate Placebo Protocols: Methodological and Practical Issues.

ERIC Educational Resources Information Center

Hyman, Irwin A.; Wojtowicz, Alexandra; Lee, Kee Duk; Haffner, Mary Elizabeth; Fiorello, Catherine A.; And Others

1998-01-01

Focuses on methodological issues involved in choosing instruments to monitor behavior, once a comprehensive evaluation has suggested trials on Ritalin. Case examples illustrate problems of teacher compliance in filling out measures, supplying adequate placebos, and obtaining physical cooperation. Emerging school-based methodologies are discussed…

The Communication Audit as a Class Project.

ERIC Educational Resources Information Center

Conaway, Roger N.

1994-01-01

Describes a class project in which students conduct a "communication audit" or assessment of an off-campus organization, providing students with opportunities to explore, examine, monitor, and evaluate communication in a practical way. Discusses grading, beginning the class, contacting clients, instrumentation and procedures, costs, and…

Multicomponent Program to Reduce Functional Decline in Frail Elderly People: A Cluster Controlled Trial.

PubMed

Ruikes, Franca G H; Zuidema, Sytse U; Akkermans, Reinier P; Assendelft, Willem J J; Schers, Henk J; Koopmans, Raymond T C M

2016-01-01

The increasing number of community-dwelling frail elderly people poses a challenge to general practice. We evaluated the effectiveness of a general practitioner-led extensive, multicomponent program integrating cure, care, and welfare for the prevention of functional decline. We performed a cluster controlled trial in 12 general practices in Nijmegen, the Netherlands. Community-dwelling frail elderly people aged ≥70 years were identified with the EASY-Care two-step older persons screening instrument. In 6 general practices, 287 frail elderly received care according to the CareWell primary care program. This consisted of proactive care planning, case management, medication reviews, and multidisciplinary team meetings with a general practitioner, practice and/or community nurse, elderly care physician, and social worker. In another 6 general practices, 249 participants received care as usual. The primary outcome was independence in functioning during (instrumental) activities of daily living (Katz-15 index). Secondary outcomes were quality of life [EuroQol (EQ5D+C) instrument], mental health and health-related social functioning (36-item RAND Short Form survey instrument), institutionalization, hospitalization, and mortality. Outcomes were assessed at baseline and at 12 months, and were analyzed with linear mixed-model analyses. A total of 204 participants (71.1%) in the intervention group and 165 participants (66.3%) in the control group completed the study. No differences between groups regarding independence in functioning and secondary outcomes were found. We found no evidence for the effectiveness of a multifaceted integrated care program in the prevention of adverse outcomes in community-dwelling frail elderly people. Large-scale implementation of this program is not advocated. © Copyright 2016 by the American Board of Family Medicine.

Assessment of psychometric properties of the Brazilian version of the oral anticoagulation knowledge test.

PubMed

Praxedes, Marcus Fernando da Silva; de Abreu, Mauro Henrique Nogueira Guimarães; Paiva, Saul Martins; Mambrini, Juliana Vaz de Melo; Marcolino, Milena Soriano; Martins, Maria Auxiliadora Parreiras

2016-06-24

The aim of this study was to evaluate the psychometric properties of the Brazilian version of the Oral Anticoagulation Knowledge (OAK) Test. This study, conducted in an anticoagulation clinic, included 201 Brazilian participants aged over 18 years, who had been using warfarin for more than two months. The reliability of the instrument was evaluated by assessing internal consistency (Kuder-Richardson coefficient) and reproducibility (test-retest reliability). The validity was evaluated by hypothesizing that there would be a positive correlation of moderate to strong intensity between the correctness levels of the OAK Test and time within therapeutic range (TTR) values, which is a measure used to evaluate the quality of oral anticoagulation. The instrument exhibited good psychometric properties. The total a Kuder-Richardson coefficient value was 0.818 and intraclass correlation coefficient was 0.967. The validity revealed a strong positive correlation between the values of the level of knowledge, as measured by the OAK Test and the TTR values (rs = 0.780). The instrument proved to be a reliable and valid tool for evaluating the knowledge of Brazilian patients on oral anticoagulation therapy with warfarin. This instrument may be incorporated into the practice of health care for substantiating the structuring of educational activities to ensure the improvement of knowledge about the use of warfarin, thereby increasing the effectiveness and safety of treatment.

An Assessment of the Effectiveness of Air Force Risk Management Practices in Program Acquisition Using Survey Instrument Analysis

DTIC Science & Technology

2015-06-18

Engineering Effectiveness Survey. CMU/SEI-2012-SR-009. Carnegie Mellon University. November 2012. Field, Andy. Discovering Statistics Using SPSS , 3rd...enough into the survey to begin answering questions on risk practices. All of the data statistical analysis will be performed using SPSS . Prior to...probabilistically using distributions for likelihood and impact. Statistical methods like Monte Carlo can more comprehensively evaluate the cost and

Teacher as the Instrument of Evaluation: A Descriptive Case Study of Connoisseurship and Educational Criticism's Role in Project-Based Learning, Technology Arts Classroom

ERIC Educational Resources Information Center

Castro, Edward Anthony

2010-01-01

Purpose: The study's purpose was to determine the degree to which connoisseurship and educational criticism exists in student work evaluation; to identify master teachers' methods utilizing verbal feedback; and to determine the degree that project-based learning (PBL) principles serve as a "model of practice" for selected PBL technology…

What Goes Into a Decision? How Nursing Faculty Decide Which Best Practices to Use for Classroom Testing.

PubMed

Killingsworth, Erin; Kimble, Laura P; Sudia, Tanya

2015-01-01

To explore the decision-making process of BSN faculty when determining which best practices to use for classroom testing. A descriptive, correlational study was conducted with a national sample (N = 127) of full-time BSN faculty. Participants completed a web-based survey incorporating instruments that measured beliefs about evaluation, decision-making, and best practices for item analysis and constructing and revising classroom tests. Study participants represented 31 states and were primarily middle-aged white women. In multiple linear regression analyses, faculty beliefs, contextual factors for decision-making, and decision-making processes accounted for statistically significant amounts of the variance in item analysis and test construction and revision. Strong faculty beliefs that rules were important when evaluating students was a significant predictor of increased use of best practices. Results support that understanding faculty beliefs around classroom testing is important in promoting the use of best practices.

Evaluation of Q-band instrumentation requirements for Strategic Satellite System (SSS) program

NASA Astrophysics Data System (ADS)

Raponi, D. J.

1981-12-01

Q-band instrumentation appropriate for testing the Strategic Satellite System (SSS) satellite terminal is evaluated in terms of current and projected availability; desired and practical measurement capabilities; required development; and schedule/cost impacts to the program. The Air Force is considering several approaches to increasing the strategic communications capability now provided by the recently deployed ultra high frequency (UHF) Air Force Satellite Communications (AFSATCOM) system. The Strategic Satellite System (SSS) was proposed to improve antijam (AJ) characteristics through the use of advanced modulation techniques and higher frequencies (8 and 44 GHz) on links between ground and airborne terminals and the satellites. This report is an assessment of Q-band (44 GHz) test instrumentation requirements, availability, and accuracy as these factors affect cost and schedule for the SSS satellite terminal development program. Though the SSS program has been cancelled, information presented in the report has applicability to the EHF MILSTAR program.

Reliability and construct validity of the Instrument to Measure the Impact of Valve Heart Disease on the Patient's Daily Life

PubMed Central

dos Anjos, Daniela Brianne Martins; Rodrigues, Roberta Cunha Matheus; Padilha, Kátia Melissa; Pedrosa, Rafaela Batista dos Santos; Gallani, Maria Cecília Bueno Jayme

2016-01-01

ABSTRACT Objective: evaluate the practicality, acceptability and the floor and ceiling effects, estimate the reliability and verify the convergent construct's validity with the instrument called the Heart Valve Disease Impact on daily life (IDCV) of the valve disease in patients with mitral and or aortic heart valve disease. Method: data was obtained from 86 heart valve disease patients through 3 phases: a face to face interview for a socio-demographic and clinic characterization and then other two done through phone calls of the interviewed patients for application of the instrument (test and repeat test). Results: as for the practicality and acceptability, the instrument was applied with an average time of 9,9 minutes and with 110% of responses, respectively. Ceiling and floor effects observed for all domains, especially floor effect. Reliability was tested using the test - repeating pattern to give evidence of temporal stability of the measurement. Significant negative correlations with moderate to strong magnitude were found between the score of the generic question about the impact of the disease and the scores of IDCV, which points to the validity of the instrument convergent construct. Conclusion: the instrument to measure the impact of valve heart disease on the patient's daily life showed evidence of reliability and validity when applied to patients with heart valve disease. PMID:27992024

Measuring team factors thought to influence the success of quality improvement in primary care: a systematic review of instruments

PubMed Central

2013-01-01

Background Measuring team factors in evaluations of Continuous Quality Improvement (CQI) may provide important information for enhancing CQI processes and outcomes; however, the large number of potentially relevant factors and associated measurement instruments makes inclusion of such measures challenging. This review aims to provide guidance on the selection of instruments for measuring team-level factors by systematically collating, categorizing, and reviewing quantitative self-report instruments. Methods Data sources: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments; reference lists of systematic reviews; and citations and references of the main report of instruments. Study selection: To determine the scope of the review, we developed and used a conceptual framework designed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). We included papers reporting development or use of an instrument measuring factors relevant to teamwork. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarizing and comparing instruments. Instrument content was categorized using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care. Results We identified 192 potentially relevant instruments, 170 of which were analyzed to develop the taxonomy. Eighty-one instruments measured constructs relevant to CQI teams in primary care, with content covering teamwork context (45 instruments measured enabling conditions or attitudes to teamwork), team process (57 instruments measured teamwork behaviors), and team outcomes (59 instruments measured perceptions of the team or its effectiveness). Forty instruments were included for full review, many with a strong theoretical basis. Evidence supporting measurement properties was limited. Conclusions Existing instruments cover many of the factors hypothesized to contribute to QI success. With further testing, use of these instruments measuring team factors in evaluations could aid our understanding of the influence of teamwork on CQI outcomes. Greater consistency in the factors measured and choice of measurement instruments is required to enable synthesis of findings for informing policy and practice. PMID:23410500

Stormwater management practices (closed drainage) study (C-01-74) : laboratory simulation and field studies

DOT National Transportation Integrated Search

2007-12-01

Two Stormwater Treatment Systems were instrumented and monitored in the field for one : year to evaluate their effectiveness at contaminant removal. The Vortechs and the V2b1TM : were both installed by the NYS Department of Transportation at locati...

Quality appraisal of generic self-reported instruments measuring health-related productivity changes: a systematic review

PubMed Central

2014-01-01

Background Health impairments can result in disability and changed work productivity imposing considerable costs for the employee, employer and society as a whole. A large number of instruments exist to measure health-related productivity changes; however their methodological quality remains unclear. This systematic review critically appraised the measurement properties in generic self-reported instruments that measure health-related productivity changes to recommend appropriate instruments for use in occupational and economic health practice. Methods PubMed, PsycINFO, Econlit and Embase were systematically searched for studies whereof: (i) instruments measured health-related productivity changes; (ii) the aim was to evaluate instrument measurement properties; (iii) instruments were generic; (iv) ratings were self-reported; (v) full-texts were available. Next, methodological quality appraisal was based on COSMIN elements: (i) internal consistency; (ii) reliability; (iii) measurement error; (iv) content validity; (v) structural validity; (vi) hypotheses testing; (vii) cross-cultural validity; (viii) criterion validity; and (ix) responsiveness. Recommendations are based on evidence syntheses. Results This review included 25 articles assessing the reliability, validity and responsiveness of 15 different generic self-reported instruments measuring health-related productivity changes. Most studies evaluated criterion validity, none evaluated cross-cultural validity and information on measurement error is lacking. The Work Limitation Questionnaire (WLQ) was most frequently evaluated with moderate respectively strong positive evidence for content and structural validity and negative evidence for reliability, hypothesis testing and responsiveness. Less frequently evaluated, the Stanford Presenteeism Scale (SPS) showed strong positive evidence for internal consistency and structural validity, and moderate positive evidence for hypotheses testing and criterion validity. The Productivity and Disease Questionnaire (PRODISQ) yielded strong positive evidence for content validity, evidence for other properties is lacking. The other instruments resulted in mostly fair-to-poor quality ratings with limited evidence. Conclusions Decisions based on the content of the instrument, usage purpose, target country and population, and available evidence are recommended. Until high-quality studies are in place to accurately assess the measurement properties of the currently available instruments, the WLQ and, in a Dutch context, the PRODISQ are cautiously preferred based on its strong positive evidence for content validity. Based on its strong positive evidence for internal consistency and structural validity, the SPS is cautiously recommended. PMID:24495301

Development and Evaluation of Event-Specific Quantitative PCR Method for Genetically Modified Soybean MON87701.

PubMed

Tsukahara, Keita; Takabatake, Reona; Masubuchi, Tomoko; Futo, Satoshi; Minegishi, Yasutaka; Noguchi, Akio; Kondo, Kazunari; Nishimaki-Mogami, Tomoko; Kurashima, Takeyo; Mano, Junichi; Kitta, Kazumi

2016-01-01

A real-time PCR-based analytical method was developed for the event-specific quantification of a genetically modified (GM) soybean event, MON87701. First, a standard plasmid for MON87701 quantification was constructed. The conversion factor (C f ) required to calculate the amount of genetically modified organism (GMO) was experimentally determined for a real-time PCR instrument. The determined C f for the real-time PCR instrument was 1.24. For the evaluation of the developed method, a blind test was carried out in an inter-laboratory trial. The trueness and precision were evaluated as the bias and reproducibility of relative standard deviation (RSDr), respectively. The determined biases and the RSDr values were less than 30 and 13%, respectively, at all evaluated concentrations. The limit of quantitation of the method was 0.5%, and the developed method would thus be applicable for practical analyses for the detection and quantification of MON87701.

[Tests of hand functionality in upper limb amputation with prosthesis].

PubMed

Bazzini, G; Orlandini, D; Moscato, T A; Nicita, D; Panigazzi, M

2007-01-01

The need for standardized instruments for clinical measurements has become pressing in the fields of occupational rehabilitation and ergonomics. This is particularly the case for instruments that allow a quantitative evaluation of upper limb function, and especially hand function in patients who have undergone an amputation and then application of an upper limb prosthesis. This study presents a review of the main tests used to evaluate hand function, with a critical analysis of their use in subjects with an upper limb prosthesis. The tests are divided into: tests to evaluate strength, tests to evaluate co-ordination and dexterity, tests of global or overall function, and tests proposed specifically for subjects with an upper limb prosthesis. Of the various tests presented, the authors give their preference to the Bimanual Functional Assessment, Abilhand and/or the ADL Questionnaire, because of the practical usefulness, clinimetric features, simplicity and ease of administration of these tests.

Use of instruments to evaluate leadership in nursing and health services.

PubMed

Carrara, Gisleangela Lima Rodrigues; Bernardes, Andrea; Balsanelli, Alexandre Pazetto; Camelo, Silvia Helena Henriques; Gabriel, Carmen Silvia; Zanetti, Ariane Cristina Barboza

2018-03-12

To identify the available scientific evidence about the use of instruments for the evaluation of leadership in health and nursing services and verify the use of leadership styles/models/theories in the construction of these tools. Integrative literature review of indexed studies in the LILACS, PUBMED, CINAHL and EMBASE databases from 2006 to 2016. Thirty-eight articles were analyzed, exhibiting 19 leadership evaluation tools; the most used were the Multifactor Leadership Questionnaire, the Global Transformational Leadership Scale, the Leadership Practices Inventory, the Servant Leadership Questionnaire, the Servant Leadership Survey and the Authentic Leadership Questionnaire. The literature search allowed to identify the main theories/styles/models of contemporary leadership and analyze their use in the design of leadership evaluation tools, with the transformational, situational, servant and authentic leadership categories standing out as the most prominent. To a lesser extent, the quantum, charismatic and clinical leadership types were evidenced.

Performing at the Top of One's Musical Game

PubMed Central

Hatfield, Johannes L.

2016-01-01

The purpose of the present mixed method study was to investigate personal benefits, perceptions, and the effect of a 15-week sport psychological skills training program adapted for musicians. The program was individually tailored for six music performance students with the objective of facilitating the participants' instrumental practice and performance. The participants learnt techniques such as goal setting, attentional focus, arousal regulation, imagery, and acceptance training/self-talk. Zimmerman's (1989) cyclical model of self-regulated learning was applied as a theoretical frame for the intervention. The present study's mixed-method approach (i.e., quan+ QUAL) included effect size, semi-structured interviews, a research log, and practice diaries of the participants (Creswell, 2009). Thematic analysis revealed that participants had little or no experience concerning planning and goal setting in regard to instrumental practice. Concentration, volition, and physical pain were additional issues that the participants struggled with at the time of pre-intervention. The study found that psychological skills training (with special emphasis on planning and goal setting) facilitated cyclical self-regulated learning patterns in the participants. In essence, the intervention was found to facilitate the participants' concentration, self-observation, self-efficacy, and coping in the face of failure. The appliance of practice journals facilitated the participants‘ self-observation, self-evaluation, and awareness of instrumental practice. Finally, the psychological skills intervention reduced participants' worry and anxiety in performance situations. An 8-month follow up interview revealed that the participants were still actively applying psychological skills. PMID:27679586

The assessment of recalled parental rearing behavior and its relationship to life satisfaction and interpersonal problems: a general population study

PubMed Central

2009-01-01

Background Parental rearing behavior is a significant etiological factor for the vulnerability of psychopathology and has been an issue of clinical research for a long time. For this scope instruments are important who asses economically recalled parental rearing behavior in a clinical practice. Therefore, a short German instrument for the assessment of the recalled parental rearing behavior Fragebogen zum erinnerten elterlichen Erziehungsverhalten (FEE) was psychometrically evaluated [Recalled Parental Rearing Behavior]. Methods This questionnaire was evaluated in a representative population sample (N = 2.948) in Germany which included 44.2% male and 55.8% female persons with a mean age of M = 47.35 (SD = 17.10, range = 18–92). For the content evaluation of the FEE the Life Satisfaction Questionnaire (FLZ) and the Inventory of Interpersonal Problems (IIP) was filled out by the participants. Results The FEE scales yielded a good to satisfactory internal consistency and split-half reliability. Its three factors (rejection/punishment, emotional warmth, control/overprotection) correlated positively with most of the areas of life satisfaction. Furthermore, positive associations between interpersonal problems and parental rejection and control could be identified. Conclusion The FEE is a short, reliable and valid instrument that can be applied in the clinical practice. In addition, the data proved an association between recalled parental rearing behavior, life satisfaction and interpersonal problems conform to the literature. Finally, specific problems with the retrospective assessment of parental rearing behavior were addressed as well. PMID:19267894

A new integrated instrumental approach to autonomic nervous system assessment.

PubMed

Corazza, I; Barletta, G; Guaraldi, P; Cecere, A; Calandra-Buonaura, G; Altini, E; Zannoli, R; Cortelli, P

2014-11-01

The autonomic nervous system (ANS) regulates involuntary body functions and is commonly evaluated by measuring reflex responses of systolic and diastolic blood pressure (BP) and heart rate (HR) to physiological and pharmacological stimuli. However, BP and HR values may not sufficient be to explain specific ANS events and other parameters like the electrocardiogram (ECG), BP waves, the respiratory rate and the electroencephalogram (EEG) are mandatory. Although ANS behaviour and its response to stimuli are well-known, their clinical evaluation is often based on individual medical training and experience. As a result, ANS laboratories have been customized, making it impossible to standardize procedures and share results with colleagues. The aim of our study was to build a powerful versatile instrument easy-to-use in clinical practice to standardize procedures and allow a cross-analysis of all the parameters of interest for ANS evaluation. The new ANScovery System developed by neurologists and technicians is a two-step device: (1) integrating physiological information from different already existing commercial modules, making it possible to cross-analyse, store and share data; (2) standardizing procedures by an innovative tutor monitor able to guide the patient throughout ANS testing. The daily use of the new ANScovery System in clinical practice has proved it is a versatile easy to use instrument. Standardization of the manoeuvres and step-by-step guidance throughout the procedure avoid repetitions and allow intra and inter-patient data comparison. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

The Meal Pattern Questionnaire: A psychometric evaluation using the Eating Disorder Examination.

PubMed

Alfonsson, S; Sewall, A; Lidholm, H; Hursti, T

2016-04-01

Meal pattern is an important variable in both obesity treatment and treatment for eating disorders. Momentary assessment and eating diaries are highly valid measurement methods but often cumbersome and not always feasible to use in clinical practice. The aim of this study was to design and evaluate a self-report instrument for measuring meal patterns. The Pattern of eating item from the Eating Disorder Examination (EDE) interview was adapted to self-report format to follow the same overall structure as the Eating Disorder Examination Questionnaire. The new instrument was named the Meal Patterns Questionnaire (MPQ) and was compared with the EDE in a student sample (n=105) and an obese sample (n=111). The individual items of the MPQ and the EDE showed moderate to high correlations (rho=.63-89) in the two samples. Significant differences between the MPQ and EDE were only found for two items in the obese sample. The total scores correlated to a high degree (rho=.87/.74) in both samples and no significant differences were found in this variable. The MPQ can provide an overall picture of a person's eating patterns and is a valid way to collect data regarding meal patterns. The MPQ may be a useable tool in clinical practice and research studies when more extensive instruments cannot be used. Future studies should evaluate the MPQ in diverse cultural populations and with more ecological assessment methods. Copyright © 2015 Elsevier Ltd. All rights reserved.

Developing a Web-Based Developmental Feedback Program

DTIC Science & Technology

2003-03-01

instruments. Theory Behind and Development of the Feedback Instruments The Leadership Practices Inventory (LPI) has been used extensively to...15304,00.pdf. 185 Posner, B.Z. & Kouzes, J.M. (2002). The leadership practices inventory: Theory and evidence behind the five practices...11 Theory Behind and Development of the Feedback Instruments............................14

A Practice Indexes for Improving Facial Movements of Brass Instrument Players

NASA Astrophysics Data System (ADS)

Ito, Kyoko; Hirano, Takeshi; Noto, Kazufumi; Nishida, Shogo; Ohtsuki, Tatsuyuki

Two experimental studies have been conducted in order to propose practice indexes for the improvement of the embouchure of French horn players, two experimental studies have been conducted. In both studies, the same task was performed by advanced and amateur French horn players. The first study investigated the activity, while performing the above-mentioned task, of the 5 facial muscles (levator labii superioris, zygomaticus major, depressor anguli oris, depressor labii inferioris, and risorius muscles) on the right side of the face by surface electromyography, and the facial movement on the left side of the face by attaching two markers above each muscle and using two high-speed cameras simultaneously. The results of the study showed that it is possible for the four markers around the lower lip to practice indexes. The second study evaluated whether the above-mentioned markers are appropriate as practice indexes using a 3-D tracking system and questionnaires. The results showed that both the advanced and the amateur players assessed that the markers were suitable as practice indexes for improving the embouchure. This set of approaches could be useful for selecting practice indexes and developing scientific practice methods not only for the French horn but also for other instruments and other fields.

Intervention mapping for the development of a strategy to implement the insurance medicine guidelines for depression

PubMed Central

2011-01-01

Background This article describes the development of a strategy to implement the insurance medicine guidelines for depression. Use of the guidelines is intended to result in more transparent and uniform assessment of claimants with depressive symptoms. Methods The implementation strategy was developed using the Intervention Mapping (IM) method for alignment with insurance-medical practice. The ASE behavioural explanation model (Attitude, Social Influence and Self-Efficacy) was used as theoretical basis for the development work. A literature study of implementation strategies and interviews with insurance physicians were performed to develop instruments for use with the guideline. These instruments were designed to match the needs and the working circumstances of insurance physicians. Performance indicators to measure the quality of the assessment and the adherence to the guidelines were defined with input from insurance physicians. Results This study resulted in the development of a training course to teach insurance physicians how to apply the guidelines for depression, using the aforementioned instruments. The efficacy of this training course will be evaluated in a Randomized Controlled Trial. Conclusions The use of IM made it possible to develop guideline support instruments tailored to insurance medical practice. PMID:21208413

Screening and Characterization of Spontaneous Porcine Congenital Heart Defects for Gene Identification and Models of Human Disease

USDA-ARS?s Scientific Manuscript database

Background: Rodent models of human congenital birth defects have been instrumental for gene discovery and investigation of mechanisms of disease. However, these models are limited by their small size making practiced intervention or detailed anatomic evaluation difficult. Swine have similar anato...

Development of a Content-Valid Standardized Orthopedic Assessment Tool (SOAT)

ERIC Educational Resources Information Center

Lafave, Mark; Katz, Larry; Butterwick, Dale

2008-01-01

Content validation of an instrument that measures student performance in OSCE-type practical examinations is a critical step in a tool's overall validity and reliability [Hopkins (1998), "Educational and Psychological Measurement and Evaluation" (8th ed.). Toronto: Allyn & Bacon]. The purpose of the paper is to outline the process…

Civil Defense: An Analysis of Attitudes and Knowledge.

ERIC Educational Resources Information Center

Marko, George Franklin

The study aimed at constructing, validating, and testing two instruments, one of which measured attitude change toward Civil Defense adult education, and one which measured level of knowledge about Civil Defense practices; and evaluating the effectiveness of the Personal and Family Survival (PFS) Course in terms of attitude change and knowledge…

The Forgotten: Formal Assessment of the Adult Writer

ERIC Educational Resources Information Center

McNair, Daniel J.; Curry, Toi L.

2013-01-01

This review of current writing assessment practices focuses upon the adult population, an area significantly underrepresented within psychoeducational literature. As compared to other populations, such as K-12 students, there are few options for the practitioner wishing to evaluate adult writers by means of standardized assessment instruments.…

Preliminary Evidence Assessing Social-Emotional Competences in Deaf and Hard of Hearing Infants and Toddlers Using a New Parent Questionnaire.

PubMed

Hintermair, Manfred; Sarimski, Klaus; Lang, Markus

2017-04-01

Social-emotional competences are an important developmental domain for deaf and hard of hearing (DHH) children and early diagnosis of problems is needed to ensure that DHH children receive appropriate support in this domain. In order to explore the usefulness of an instrument, which was recently developed for very young children, two studies in DHH infants and toddlers were conducted from Germany using the Social-Emotional Assessment/Evaluation Measure (Squires et al. (2013). Social-Emotional Assessment/Evaluation Measure (SEAM). Baltimore, ML: Brooks). Preliminary analysis of data obtained from a sample of 182 DHH children aged between 2 and 36 months (Study 1) suggests that it provides valid, reliable data and is suitable for use in practice. The data also corroborate well-known findings from other research in deaf education, in particular the role of parental responsivity for the development of social-emotional competences. Study 2 documents the consistency of evaluations of 44 DHH children by their mothers and by early intervention providers using the scales. Overall, the results suggest that this new evaluation instrument has potential applications in deaf educational practice but further research is needed to demonstrate its full value. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

[Comparative evaluation of clinical practice guidelines for the treatment of schizophrenia].

PubMed

Delessert, D; Pomini, V; Grasset, F; Baumann, P

2008-01-01

Many clinical practice guidelines (CPG) have been published in reply to the development of the concept of "evidence-based medicine" (EBM) and as a solution to the difficulty of synthesizing and selecting relevant medical literature. Taking into account the expansion of new CPG, the question of choice arises: which CPG to consider in a given clinical situation? It is of primary importance to evaluate the quality of the CPG, but until recently, there has been no standardized tool of evaluation or comparison of the quality of the CPG. An instrument of evaluation of the quality of the CPG, called "AGREE" for appraisal of guidelines for research and evaluation was validated in 2002. The six principal CPG concerning the treatment of schizophrenia are compared with the help of the "AGREE" instrument: (1) "the Agence nationale pour le développement de l'évaluation médicale (ANDEM) recommendations"; (2) "The American Psychiatric Association (APA) practice guideline for the treatment of patients with schizophrenia"; (3) "The quick reference guide of APA practice guideline for the treatment of patients with schizophrenia"; (4) "The schizophrenia patient outcomes research team (PORT) treatment recommendations"; (5) "The Texas medication algorithm project (T-MAP)" and (6) "The expert consensus guideline for the treatment of schizophrenia". The results of our study were then compared with those of a similar investigation published in 2005, structured on 24 CPG tackling the treatment of schizophrenia. The "AGREE" tool was also used by two investigators in their study. In general, the scores of the two studies differed little and the two global evaluations of the CPG converged; however, each of the six CPG is perfectible. The rigour of elaboration of the six CPG was in general average. The consideration of the opinion of potential users was incomplete, and an effort made in the presentation of the recommendations would facilitate their clinical use. Moreover, there was little consideration by the authors regarding the applicability of the recommendations. Globally, two CPG are considered as strongly recommended: "the quick reference guide of the APA practice guideline for the treatment of patients with schizophrenia" and "the T-MAP".

Spinal fusion-hardware construct: Basic concepts and imaging review

PubMed Central

Nouh, Mohamed Ragab

2012-01-01

The interpretation of spinal images fixed with metallic hardware forms an increasing bulk of daily practice in a busy imaging department. Radiologists are required to be familiar with the instrumentation and operative options used in spinal fixation and fusion procedures, especially in his or her institute. This is critical in evaluating the position of implants and potential complications associated with the operative approaches and spinal fixation devices used. Thus, the radiologist can play an important role in patient care and outcome. This review outlines the advantages and disadvantages of commonly used imaging methods and reports on the best yield for each modality and how to overcome the problematic issues associated with the presence of metallic hardware during imaging. Baseline radiographs are essential as they are the baseline point for evaluation of future studies should patients develop symptoms suggesting possible complications. They may justify further imaging workup with computed tomography, magnetic resonance and/or nuclear medicine studies as the evaluation of a patient with a spinal implant involves a multi-modality approach. This review describes imaging features of potential complications associated with spinal fusion surgery as well as the instrumentation used. This basic knowledge aims to help radiologists approach everyday practice in clinical imaging. PMID:22761979

Evaluation of eddy-current proximity devices for measuring thin potassium film thicknesses

NASA Technical Reports Server (NTRS)

Asadourian, A. S.

1972-01-01

Two eddy current proximity probe systems were tested over a range of 0 to 508 micrometers (0 to 20 mils) of simulated potassium film thicknesses for simulated temperatures of 66 C (150 F), 232 C (450 F), and 666 C (1230 F). The results of short time calibration tests are presented. Instrument drift was a problem throughout the testing and, without correction, may limit the use of such systems to short periods of time. Additional development will be required prior to their being usable as practical instrumentation systems.

Maintaining psychology's scientific and professional credibility and ethical responsibility to self-regulate: a comment on "validations" of mental health assessment instruments.

PubMed

Moras, Karla

2005-03-01

Recent growth of "managed" mental health care in the United States has spawned huge demand for products that draw on one of psychology's most well developed subdisciplines, tests and measurement. The commercial potential of mental health assessment instruments intended for widespread use, to meet what Kraus, Seligman, and Jordan (this volume) describe as "an industry-wide surge in outcome evaluations in naturalistic ... settings," necessarily raises conflict of interest dilemmas for those who develop and market them. The American Psychological Association has devoted intensive effort to the preceding issue as it pertains to other aspects of the science and practice of clinical psychology. Comparable attention has not been focused recently on the development and marketing of assessment instruments. This Comment highlights the issue and suggests types of self-regulatory actions that might be taken, e.g., requiring and publishing full disclosure statements of authors' relationships to companies that market instruments like the Treatment Outcome Package in psychometric articles in which they are evaluated. 2004 Wiley Periodicals, Inc.

Recommendations for a mixed methods approach to evaluating the patient-centered medical home.

PubMed

Goldman, Roberta E; Parker, Donna R; Brown, Joanna; Walker, Judith; Eaton, Charles B; Borkan, Jeffrey M

2015-03-01

There is a strong push in the United States to evaluate whether the patient-centered medical home (PCMH) model produces desired results. The explanatory and contextually based questions of how and why PCMH succeeds in different practice settings are often neglected. We report the development of a comprehensive, mixed qualitative-quantitative evaluation set for researchers, policy makers, and clinician groups. To develop an evaluation set, the Brown Primary Care Transformation Initiative convened a multidisciplinary group of PCMH experts, reviewed the PCMH literature and evaluation strategies, developed key domains for evaluation, and selected or created methods and measures for inclusion. The measures and methods in the evaluation set (survey instruments, PCMH meta-measures, patient outcomes, quality measures, qualitative interviews, participant observation, and process evaluation) are meant to be used together. PCMH evaluation must be sufficiently comprehensive to assess and explain both the context of transformation in different primary care practices and the experiences of diverse stakeholders. In addition to commonly assessed patient outcomes, quality, and cost, it is critical to include PCMH components integral to practice culture transformation: patient and family centeredness, authentic patient activation, mutual trust among practice employees and patients, and transparency, joy, and collaboration in delivering and receiving care in a changing environment. This evaluation set offers a comprehensive methodology to enable understanding of how PCMH transformation occurs in different practice settings. This approach can foster insights about how transformation affects critical outcomes to achieve meaningful, patient-centered, high-quality, and cost-effective sustainable change among diverse primary care practices. © 2015 Annals of Family Medicine, Inc.

Confirmatory factor analysis of the Malay version comprehensive feeding practices questionnaire tested among mothers of primary school children in Malaysia.

PubMed

Shohaimi, Shamarina; Wei, Wong Yoke; Shariff, Zalilah Mohd

2014-01-01

Comprehensive feeding practices questionnaire (CFPQ) is an instrument specifically developed to evaluate parental feeding practices. It has been confirmed among children in America and applied to populations in France, Norway, and New Zealand. In order to extend the application of CFPQ, we conducted a factor structure validation of the translated version of CFPQ (CFPQ-M) using confirmatory factor analysis among mothers of primary school children (N = 397) in Malaysia. Several items were modified for cultural adaptation. Of 49 items, 39 items with loading factors >0.40 were retained in the final model. The confirmatory factor analysis revealed that the final model (twelve-factor model with 39 items and 2 error covariances) displayed the best fit for our sample (Chi-square = 1147; df = 634; P < 0.05; CFI = 0.900; RMSEA = 0.045; SRMR = 0.0058). The instrument with some modifications was confirmed among mothers of school children in Malaysia. The present study extends the usability of the CFPQ and enables researchers and parents to better understand the relationships between parental feeding practices and related problems such as childhood obesity.

Adolescents' perception of parental feeding practices: Adaptation and validation of the Comprehensive Feeding Practices Questionnaire for Brazilian adolescents—The CFPQ-Teen

PubMed Central

Piccoli, Ângela Bein; Neiva-Silva, Lucas; Mosmann, Clarisse Pereira; Musher-Eizenman, Dara; Pellanda, Lucia C.

2017-01-01

Background Parental feeding practices may play a key role in dietary habits and nutritional status of adolescents, but research from adolescents’ point of view on this topic is scarce. Objective To adapt and validate an instrument of parental feeding practices as perceived by adolescents in a Brazilian setting. Methods The Comprehensive Feeding Practices Questionnaire was translated into Portuguese and adapted to be answered by adolescents (ages 12 to 18). Content analysis and FACE validity to assess cultural equivalence was undertaken by experts in the adolescent nutritional and psychological fields. Pilot study was evaluated in 23 adolescents. The final version was administered to 41 students to assess instrument reproducibility (Intraclass Correlation Coefficient). Internal consistency (Cronbach's Alpha) and construct validity (Confirmatory Factor Analysis) were assessed in a third sample of 307 adolescents. Results Experts and adolescents considered content validity as appropriate. In reproducibility analysis (Intraclass Correlation Coefficient), 10 of the 12 factors were above 0.7. The factors “teaching about nutrition” and “food as reward” obtained values of 0.60 and 0.68, respectively. The Cronbach's Alpha of the whole scale was 0.83 and alphas for subscales ranged from 0.52 to 0.85; the factors “teaching about nutrition” and “food as a reward” had the lowest values (0.52). After removing these two factors, the Confirmatory Factor Analysis indicated that the structural model was appropriate. The final scale was made up of 10 factors with 43 questions. Conclusions The Comprehensive Feeding Practices Questionnaire-Teen demonstrates validity and reliability, and is a suitable tool to evaluate the perceptions of adolescents regarding parental feeding practices. PMID:29145485

Validity evidence of non-technical skills assessment instruments in simulated anaesthesia crisis management.

PubMed

Jirativanont, T; Raksamani, K; Aroonpruksakul, N; Apidechakul, P; Suraseranivongse, S

2017-07-01

We sought to evaluate the validity of two non-technical skills evaluation instruments, the Anaesthetists' Non-Technical Skills (ANTS) behavioural marker system and the Ottawa Global Rating Scale (GRS), to apply them to anaesthesia training. The content validity, response process, internal structure, relations with other variables and consequences were described for validity evidence. Simulated crisis management sessions were initiated during which two trained raters evaluated the performance of postgraduate first-, second- and third-year (PGY-1, PGY-2 and PGY-3) anaesthesia residents. The study included 70 participants, composed of 24 PGY-1, 24 PGY-2 and 22 PGY-3 residents. Both instruments differentiated the non-technical skills of PGY-1 from PGY-3 residents ( P <0.05). Inter-rater agreement was measured using the intraclass correlation coefficient (ICC). For the ANTS instrument, the intraclass correlation coefficients for task management, team-working, situation awareness and decision-making were 0.79, 0.34, 0.81 and 0.70, respectively. For the Ottawa GRS, the intraclass correlation coefficients for overall performance, leadership, problem-solving, situation awareness, resource utilisation and communication skills were 0.86, 0.83, 0.84, 0.87, 0.80 and 0.86, respectively. The Cronbach's alpha for internal consistency of the ANTS instrument was 0.93, and was 0.96 for the Ottawa GRS. There was a high correlation between the ANTS and Ottawa GRS. The raters reported the ease of use of the Ottawa GRS compared to the ANTS. We found sufficient evidence of validity in the ANTS instrument and the Ottawa GRS for the evaluation of non-technical skills in a simulated anaesthesia setting, but the Ottawa GRS was more practical and had higher reliability.

Development of the Human Factors Skills for Healthcare Instrument: a valid and reliable tool for assessing interprofessional learning across healthcare practice settings.

PubMed

Reedy, Gabriel B; Lavelle, Mary; Simpson, Thomas; Anderson, Janet E

2017-10-01

A central feature of clinical simulation training is human factors skills, providing staff with the social and cognitive skills to cope with demanding clinical situations. Although these skills are critical to safe patient care, assessing their learning is challenging. This study aimed to develop, pilot and evaluate a valid and reliable structured instrument to assess human factors skills, which can be used pre- and post-simulation training, and is relevant across a range of healthcare professions. Through consultation with a multi-professional expert group, we developed and piloted a 39-item survey with 272 healthcare professionals attending training courses across two large simulation centres in London, one specialising in acute care and one in mental health, both serving healthcare professionals working across acute and community settings. Following psychometric evaluation, the final 12-item instrument was evaluated with a second sample of 711 trainees. Exploratory factor analysis revealed a 12-item, one-factor solution with good internal consistency (α=0.92). The instrument had discriminant validity, with newly qualified trainees scoring significantly lower than experienced trainees ( t (98)=4.88, p<0.001) and was sensitive to change following training in acute and mental health settings, across professional groups (p<0.001). Confirmatory factor analysis revealed an adequate model fit (RMSEA=0.066). The Human Factors Skills for Healthcare Instrument provides a reliable and valid method of assessing trainees' human factors skills self-efficacy across acute and mental health settings. This instrument has the potential to improve the assessment and evaluation of human factors skills learning in both uniprofessional and interprofessional clinical simulation training.

Unpaid work in health economic evaluations.

PubMed

Krol, Marieke; Brouwer, Werner

2015-11-01

Given its societal importance, unpaid work should be included in economic evaluations of health care technology aiming to take a societal perspective. However, in practice this does not often appear to be the case. This paper provides an overview of the current place of unpaid work in economic evaluations in theory and in practice. It does so first by summarizing recommendations regarding the inclusion of unpaid labor reported in health economic textbooks and national guidelines for economic evaluations. In total, three prominent health economic text-books were studied and 28 national health economic guidelines. The paper, moreover, provides an overview of the instruments available to measure lost unpaid labor and reports on a review of the place of unpaid labor in applied economic evaluations in the area of rheumatoid arthritis. The review was conducted by examining methodology of evaluations published between 1 March 2008 and 1 March 2013. The results of this study show that little guidance is offered regarding the inclusion of unpaid labor in economic evaluations in textbooks and guidelines. The review identified five productivity costs instruments including questions about unpaid work and 33 economic evaluations of treatments for rheumatoid arthritis of which only one included unpaid work. The results indicate that unpaid work is rarely included in applied economic evaluations of treatments for rheumatoid arthritis, despite this disease expecting to be associated with lost unpaid work. Given the strong effects of certain diseases and treatments on the ability to perform unpaid work, unpaid work currently receives less attention in economic evaluations than it deserves. Copyright © 2015 Elsevier Ltd. All rights reserved.

Focus on Practice-Relationships between Lessons on the Primary Instrument and Individual Practice in Conservatoire Education

ERIC Educational Resources Information Center

Koopman, Constantijn; Smit, Nico; de Vugt, Adri; Deneer, Paul; den Ouden, Jeannette

2007-01-01

This article presents the results of research into the relationships between lessons on the primary instrument and individual practice in conservatoire education. Six cases were extensively investigated through observation, questionnaires, logbooks, and interviews. Regarding the lessons on the primary instrument, we examined aims, topics,…

Measuring conflict management, emotional self-efficacy, and problem solving confidence in an evaluation of outdoor programs for inner-city youth in Baltimore, Maryland.

PubMed

Caldas, Stephanie V; Broaddus, Elena T; Winch, Peter J

2016-08-01

Substantial evidence supports the value of outdoor education programs for promoting healthy adolescent development, yet measurement of program outcomes often lacks rigor. Accurately assessing the impacts of programs that seek to promote positive youth development is critical for determining whether youth are benefitting as intended, identifying best practices and areas for improvement, and informing decisions about which programs to invest in. We generated brief, customized instruments for measuring three outcomes among youth participants in Baltimore City Outward Bound programs: conflict management, emotional self-efficacy, and problem solving confidence. Measures were validated through exploratory and confirmatory factor analyses of pilot-testing data from two groups of program participants. We describe our process of identifying outcomes for measurement, developing and adapting measurement instruments, and validating these instruments. The finalized measures support evaluations of outdoor education programs serving urban adolescent youth. Such evaluations enhance accountability by determining if youth are benefiting from programs as intended, and strengthen the case for investment in programs with demonstrated success. Copyright © 2016 Elsevier Ltd. All rights reserved.

Impact of Professional Nursing Practices on Patient/Nurse Outcomes: Testing the Essential Professional Nursing Practices Instrument.

PubMed

Kramer, Marlene; Brewer, Barbara B; Halfer, Diana; Hnatiuk, Cynthia Nowicki; MacPhee, Maura; Duchscher, Judy Boychuk; Maguire, Pat; Coe, Thomas; Schmalenberg, Claudia

2017-05-01

Increasing patient and healthcare system complexity and the need to accurately measure the engagement of clinical nurses (CNs) in holistic, professional nursing practice indicates that an update to the Essentials of Magnetism instrument is needed. The purposes of this research were to critique and weight items, assess the value and psychometric properties of the newly constructed Essential Professional Nursing Practices (EPNP) instrument, and establish relationships between EPNPs and CN job, practice, and nurse-assessed patient satisfaction.

Nuclear medicine and imaging research (Instrumentation and quantitative methods of evaluation)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Beck, R.N.; Cooper, M.D.

1989-09-01

This program addresses the problems involving the basic science and technology underlying the physical and conceptual tools of radioactive tracer methodology as they relate to the measurement of structural and functional parameters of physiologic importance in health and disease. The principal tool is quantitative radionuclide imaging. The overall objective of this program is to further the development and transfer of radiotracer methodology from basic theory to routine clinical practice in order that individual patients and society as a whole will receive the maximum net benefit from the new knowledge gained. The focus of the research is on the development ofmore » new instruments and radiopharmaceuticals, and the evaluation of these through the phase of clinical feasibility.« less

Reduction and standardization of surgical instruments in pediatric inguinal hernia repair.

PubMed

Koyle, Martin A; AlQarni, Naif; Odeh, Rakan; Butt, Hissan; Alkahtani, Mohammed M; Konstant, Louis; Pendergast, Lisa; Koyle, Leah C C; Baker, G Ross

2018-02-01

To standardize and reduce surgical instrumentation by >25% within a 9-month period for pediatric inguinal hernia repair (PIHR), using "improvement science" methodology. We prospectively evaluated instruments used for PIHR in 56 consecutive cases by individual surgeons across two separate subspecialties, pediatric surgery (S) and pediatric urology (U), to measure actual number of instruments used compared with existing practice based on preference cards. Based on this evaluation, a single preference card was developed using only instruments that had been used in >50% of all cases. A subsequent series of 52 cases was analyzed to assess whether the new tray contained the ideal instrumentation. Cycle time (CT), to sterilize and package the instruments, and weights of the trays were measured before and after the intervention. A survey of operating room (OR) nurses and U and S surgeons was conducted before and after the introduction of the standardized tray to assess the impact and perception of standardization. Prior to creating the standardized tray, a U PIHR tray contained 96 instruments with a weight of 13.5 lbs, while the S set contained 51, weighing 11.2 lbs. The final standardized set comprised 28 instruments and weighed 7.8 lbs. Of 52 PIHRs performed after standardization, in three (6%) instances additional instruments were requested. CT was reduced from 11 to 8 min (U and S respectively) to <5 min for the single tray. Nurses and surgeons reported that quality, safety, and efficiency were improved, and that efforts should continue to standardize instrumentation for other common surgeries. Standardization of surgical equipment can be employed across disciplines with the potential to reduce costs and positively impact quality, safety, and efficiencies. Copyright © 2017 Journal of Pediatric Urology Company. Published by Elsevier Ltd. All rights reserved.

Developing a practical evaluation tool for preceptor use.

PubMed

Walsh, Catherine M; Seldomridge, Lisa A; Badros, Karen K

2008-01-01

After years of dissatisfaction with existing instruments, a tool for preceptors to evaluate an undergraduate student's clinical performance was developed, with preceptors' input in its construction. A 2-year pilot evaluation revealed notable problems including excessively high preceptor ratings and significant disparities between faculty and preceptor ratings. Further revisions were made, reducing indicators to those which the preceptors can actually evaluate on an everyday basis and developing a rubric. Additional recommendations to bolster the quality of ratings are improving orientation and guidance of preceptors and modifying procedures for giving feedback.

The ADL taxonomy for persons with mental disorders - adaptation and evaluation.

PubMed

Holmqvist, Kajsa Lidström; Holmefur, Marie

2018-05-03

There is a lack of occupation-focused instruments to assess Activities of Daily Living (ADL) that are intended for persons with mental disorders. The ADL Taxonomy is an instrument that is widely-used within clinical practice for persons with physical impairment. The aim of this study was to adapt the ADL Taxonomy for persons with mental disorders and evaluate its validity. An expert group of Occupational Therapists (OTs) from psychiatric care adapted the ADL Taxonomy to fit the client group, including creating three new items. OTs in psychiatric care collected client data and evaluated the instrument for usability. Rasch analysis was used to evaluate the contruct validity of 16 activities separately. The OTs collected 123 assessments from clients with various mental disorders. Ten activities had excellent, and four had acceptable, psychometric properties with regard to item and person fit and unidimensionality. The activity managing the day/time gave complex results and would benefit from further development. The OTs found the test version intelligible, relevant and easy to use. The ADL Taxonomy for persons with mental disorders has 16 activities with three to six actions each, and is now ready for clinical use.

Flight Instructor Practical Test Standards for Instrument - Airplane, Helicopter

DOT National Transportation Integrated Search

1990-03-01

The Flight Instructor - Instrument (Airplane and Helicopter) Practical : Test Standards book has been published by the Federal Aviation : Administration (FAA) to establish the standards for the flight instructor : certification and instrument rating ...

Health Promotion Practice and Interprofessional Education in Aging: Senior Wellness Fairs.

PubMed

Diwan, Sadhna; Perdue, Megan; Lee, Sang E; Grossman, Brian R

2016-01-01

Senior wellness fairs (SWFs) offer a unique opportunity for community health promotion and interprofessional education (IPE). The authors describe and evaluate the impact of a 3-year, university-community SWF collaboration on interprofessional competencies among students across multiple professional programs. Participation in the SWF enhanced student knowledge and skills in providing health promotion information to older adults in an interprofessional, collaborative setting as indicated by mean scores on the Perceived Learning Outcomes Survey, an instrument developed for this project. Open-ended data highlighted aspects of the SWF that students found most useful (interaction with seniors, community resources, interprofessional learning, and self-awareness) and most challenging (communication barriers, limited opportunity for interaction, and physical environment). Pre- and posttest scores on the Multidisciplinary SWF Practice Learning Quiz, another instrument developed for this project, illustrated improvement in student understanding of other professions and the importance of interprofessional cooperation to promote and maintain healthy aging. Implications and suggestions for structuring learning opportunities that combine community health promotion practice and interprofessional learning are discussed.

Psychometric evaluation of the Revised Professional Practice Environment (RPPE) scale.

PubMed

Erickson, Jeanette Ives; Duffy, Mary E; Ditomassi, Marianne; Jones, Dorothy

2009-05-01

The purpose was to examine the psychometric properties of the Revised Professional Practice Environment (RPPE) scale. Despite renewed focus on studying health professionals' practice environments, there are still few reliable and valid instruments available to assist nurse administrators in decision making. A psychometric evaluation using a random-sample cross-validation procedure (calibration sample [CS], n = 775; validation sample [VS], n = 775) was undertaken. Cronbach alpha internal consistency reliability of the total score (r = 0.93 [CS] and 0.92 [VS]), resulting subscale scores (r range: 0.80-0.87 [CS], 0.81-0.88 [VS]), and principal components analyses with Varimax rotation and Kaiser normalization (8 components, 59.2% variance [CS], 59.7% [VS]) produced almost identical results in both samples. The multidimensional RPPE is a psychometrically sound measure of 8 components of the professional practice environment in the acute care setting and sufficiently reliable and valid for use as independent subscales in healthcare research.

Enhancing an introductory Pharmacy Practice Experience at free medical clinics.

PubMed

Morello, Candis M; Singh, Renu F; Chen, Karen J; Best, Brookie M

2010-02-01

The aim of the study was to assess and improve first-year student pharmacists' satisfaction and learning experience in a Student-Run Free Medical Clinic Project (SFMCP) providing medical care to an underserved population. Two consecutive classes of first-year student pharmacists at the University of California San Diego (UCSD) Skaggs School of Pharmacy and Pharmaceutical Sciences participated in an Introductory Pharmacy Practice Experience (IPPE) at the UCSD SFMCP. This IPPE involved two inter-professional evening free clinics which provide medical care to an underserved population and opportunities for healthcare professional training and service. Year 1 students completed a self-assessment survey instrument and year 2 students completed the survey instrument plus a new competency checklist tool. Average scores from the self-assessment survey instrument were compared between years 1 and 2. Initial survey results showed that students felt the SFMCP was worthwhile; however, they did not experience enough involvement in the patient assistance programme or non-pharmacy-related clinic activities. After the competency checklist tool implementation, overall student pharmacist satisfaction of the SFMCP IPPE remained high (88%), participation in identified weak areas improved and students agreed that the tool helped focus their clinic experience. Areas of improvement were identified with the survey instrument and the competency checklist tool increased achievement of learning objectives. Overall, student pharmacists felt the SFMCP IPPE was a good learning experience. Practising pharmacists can employ these or similar tools in specific practice settings, to evaluate and help ensure that student pharmacists or interns are achieving applicable learning objectives.

Development of the private practice management standards for psychology.

PubMed

Mathews, Rebecca; Stokes, David; Littlefield, Lyn; Collins, Leah

2011-01-01

This paper describes the process of developing a set of private practice management standards to support Australian psychologists and promote high quality services to the public. A review of the literature was conducted to identify management standards relevant to psychology, which were further developed in consultation with a panel of experts in psychology or in the development of standards. Forty-three psychologists in independent private practice took part in either a survey (n=22) to provide feedback on the relevance of, and their compliance with, the identified standards, or a 6-month pilot study (n=21) in which a web-based self-assessment instrument evaluating the final set of standards and performance indicators was implemented in their practice to investigate self-reported change in management procedures. The pilot study demonstrated good outcomes for practitioners when evaluation of compliance to the standards was operationalized in a self-assessment format. Study results are based on a small sample size. Nevertheless, relevance and utility of the standards was found providing an initial version of management standards that have relevance to the practice of psychology in Australia, along with a system for evaluating psychological service provision to ensure best practice in service delivery. © 2010 National Association for Healthcare Quality.

Development and validity of a method for the evaluation of printed education material

PubMed Central

Castro, Mauro Silveira; Pilger, Diogo; Fuchs, Flávio Danni; Ferreira, Maria Beatriz Cardoso

Objectives To develop and study the validity of an instrument for evaluation of Printed Education Materials (PEM); to evaluate the use of acceptability indices; to identify possible influences of professional aspects. Methods An instrument for PEM evaluation was developed which included tree steps: domain identification, item generation and instrument design. A reading to easy PEM was developed for education of patient with systemic hypertension and its treatment with hydrochlorothiazide. Construct validity was measured based on previously established errors purposively introduced into the PEM, which served as extreme groups. An acceptability index was applied taking into account the rate of professionals who should approve each item. Participants were 10 physicians (9 men) and 5 nurses (all women). Results Many professionals identified intentional errors of crude character. Few participants identified errors that needed more careful evaluation, and no one detected the intentional error that required literature analysis. Physicians considered as acceptable 95.8% of the items of the PEM, and nurses 29.2%. The differences between the scoring were statistically significant in 27% of the items. In the overall evaluation, 66.6% were considered as acceptable. The analysis of each item revealed a behavioral pattern for each professional group. Conclusions The use of instruments for evaluation of printed education materials is required and may improve the quality of the PEM available for the patients. Not always are the acceptability indices totally correct or represent high quality of information. The professional experience, the practice pattern, and perhaps the gendre of the reviewers may influence their evaluation. An analysis of the PEM by professionals in communication, in drug information, and patients should be carried out to improve the quality of the proposed material. PMID:25214924

Quality assessment of clinical practice guidelines for eosinophilic esophagitis using the AGREE II instrument.

PubMed

Lucendo, Alfredo J; Arias, Ángel; Redondo-González, Olga; Molina-Infante, Javier

2017-04-01

High-quality evidence-based clinical practice guidelines can guide diagnosis and treatment to optimize outcomes. We aimed to systematically review the quality of international guidelines on eosinophilic esophagitis (EoE). MEDLINE and Scopus databases were searched for appropriate guidelines up to 2016. Two gastroenterologists and two methodologists independently evaluated the documents using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Amongst the 25 records initially retrieved, four guidelines developed by recognized scientific organizations met inclusion criteria. AGREE II results varied widely across domains, but none achieved an overall assessment score of over 60%. Scope and purpose (61.82 ± 19.24%), clarity of presentation (57.13 ± 40.56%) and editorial independence (93.75 ± 1.69%) showed the highest mean rating, whereas stakeholder involvement (28.82 ± 11.19%), rigor of development (32.29 ± 12.02%) and applicability (21.62 ± 7.14%) did not reach quality thresholds. Intraclass correlation coefficients for agreement was excellent among appraisers (0.903), between gastroenterologists and methodologists (0.878) and for each individual guideline (0.838 to 0.955). Clinical practice guidelines for EoE vary significantly in quality, are invariably limited and currently, none can be 'strongly recommended'.

Assessing the Learning Environment for Medical Students: An Evaluation of a Novel Survey Instrument in Four Medical Schools.

PubMed

Pololi, Linda H; Evans, Arthur T; Nickell, Leslie; Reboli, Annette C; Coplit, Lisa D; Stuber, Margaret L; Vasiliou, Vasilia; Civian, Janet T; Brennan, Robert T

2017-06-01

A practical, reliable, and valid instrument is needed to measure the impact of the learning environment on medical students' well-being and educational experience and to meet medical school accreditation requirements. From 2012 to 2015, medical students were surveyed at the end of their first, second, and third year of studies at four medical schools. The survey assessed students' perceptions of the following nine dimensions of the school culture: vitality, self-efficacy, institutional support, relationships/inclusion, values alignment, ethical/moral distress, work-life integration, gender equity, and ethnic minority equity. The internal reliability of each of the nine dimensions was measured. Construct validity was evaluated by assessing relationships predicted by our conceptual model and prior research. Assessment was made of whether the measurements were sensitive to differences over time and across institutions. Six hundred and eighty-six students completed the survey (49 % women; 9 % underrepresented minorities), with a response rate of 89 % (range over the student cohorts 72-100 %). Internal consistency of each dimension was high (Cronbach's α 0.71-0.86). The instrument was able to detect significant differences in the learning environment across institutions and over time. Construct validity was supported by demonstrating several relationships predicted by our conceptual model. The C-Change Medical Student Survey is a practical, reliable, and valid instrument for assessing the learning environment of medical students. Because it is sensitive to changes over time and differences across institution, results could potentially be used to facilitate and monitor improvements in the learning environment of medical students.

Instrumental variable specifications and assumptions for longitudinal analysis of mental health cost offsets.

PubMed

O'Malley, A James

2012-12-01

Instrumental variables (IVs) enable causal estimates in observational studies to be obtained in the presence of unmeasured confounders. In practice, a diverse range of models and IV specifications can be brought to bear on a problem, particularly with longitudinal data where treatment effects can be estimated for various functions of current and past treatment. However, in practice the empirical consequences of different assumptions are seldom examined, despite the fact that IV analyses make strong assumptions that cannot be conclusively tested by the data. In this paper, we consider several longitudinal models and specifications of IVs. Methods are applied to data from a 7-year study of mental health costs of atypical and conventional antipsychotics whose purpose was to evaluate whether the newer and more expensive atypical antipsychotic medications lead to a reduction in overall mental health costs.

Collaboration in Language Testing and Assessment. Language Testing and Evaluation. Volume 26

ERIC Educational Resources Information Center

Tsagari, Dina, Ed.; Csepes, Ildiko, Ed.

2012-01-01

The Guidelines for Good Practice of the European Association for Language Testing and Assessment (EALTA) stress the importance of collaboration between all parties involved in the process of developing instruments, activities and programmes for testing and assessment. Collaboration is considered to be as important as validity and reliability,…

Finding the Right Fit: Recruiting and Retaining Teachers in Milwaukee Choice Schools

ERIC Educational Resources Information Center

Egalite, Anna J.; Jensen, Laura I.; Stewart, Thomas; Wolf, Patrick J.

2014-01-01

This article explores differential hiring and retention practices across schools of choice using data gathered as part of a comprehensive evaluation of a large-scale school voucher program in Milwaukee, Wisconsin. A variety of interview, survey, and observation instruments are used to describe the challenges and strategies that 13 schools report…

How Rwandan Grade 6 Mathematics Teachers Teach--A First Investigation

ERIC Educational Resources Information Center

Maniraho, Jean Francois; Christiansen, Iben Maj

2015-01-01

This paper offers a tentative snapshot of Grade 6 mathematics classroom practices in Rwanda based on twenty video recorded lessons. It has an objective of investigating through evaluation, the teaching strategies used by Rwandan Grade 6 Mathematics teachers in their classrooms. In the absence of sufficient instruments to measure Pedagogical…

Employability Skill Development in Work-Integrated Learning: Barriers and Best Practice

ERIC Educational Resources Information Center

Jackson, Denise

2015-01-01

Work-integrated learning (WIL) is widely considered instrumental in equipping new graduates with the required employability skills to function effectively in the work environment. Evaluation of WIL programs in enhancing skill development remains predominantly outcomes-focused with little attention to the process of what, how and from whom students…

Energy conversion research and development with diminiodes

NASA Technical Reports Server (NTRS)

Morris, J. F.

1974-01-01

Diminiodes are variable-gap cesium diodes with plane miniature guarded electrodes. These converters allow thermionic evaluations of tiny pieces of rare solids. In addition to smallness, diminiode advantages comprise simplicity, precision, fabrication ease, parts interchangeability, cleanliness, full instrumentation, direct calibration, ruggedness, and economy. Diminiodes with computerized thermionic performance mapping make electrode screening programs practical.

Evaluating the Metacognitive Awareness Inventory Using Empirical Factor-Structure Evidence

ERIC Educational Resources Information Center

Harrison, George M.; Vallin, Lisa M.

2018-01-01

Many scholars agree on the general theoretical structure of metacognition, which is what informed the development of the Metacognitive Awareness Inventory (MAI). Although self-report instruments such as the MAI suffer many threats to validity, they continue to be used in research and practice because of their convenience. With the MAI, studies…

Internal Audit: Does it Enhance Governance in the Australian Public University Sector?

ERIC Educational Resources Information Center

Christopher, Joe

2015-01-01

This study seeks to confirm if internal audit, a corporate control process, is functioning effectively in Australian public universities. The study draws on agency theory, published literature and best-practice guidelines to develop an internal audit evaluation framework. A survey instrument is thereafter developed from the framework and used as a…

Evaluating Classroom Interaction with the iPad®: An Updated Stalling's Tool

ERIC Educational Resources Information Center

MacKinnon, Gregory; Schep, Lourens; Borden, Lisa Lunney; Murray-Orr, Anne; Orr, Jeff; MacKinnon, Paula

2016-01-01

A large study of classrooms in the Caribbean context necessitated the use of a validated classroom observation tool. In practice, the paper-version Stalling's instrument (Stallings & Kaskowitz 1974) presented specific challenges with respect to (a) facile data collection and (b) qualitative observations of classrooms. In response to these…

Evaluating the Use of Criteria for Assessing Profession-Specific Communication Skills in Pharmacy

ERIC Educational Resources Information Center

Hyvarinen, Marja-Leena; Tanskanen, Paavo; Katajavuori, Nina; Isotalus, Pekka

2012-01-01

One central task in higher education is to provide students with interpersonal communication competence in their profession. To achieve this, specialised training, based on an understanding of disciplinary communication practices and appropriate assessment methods, is needed. However, there is a lack of reliable assessment instruments which are…

But Does It Work? Reflective Activities, Learning Outcomes and Instrumental Learning in Continuing Professional Development

ERIC Educational Resources Information Center

Roessger, Kevin M.

2015-01-01

This paper examines the relationship between reflective practice and instrumental learning within the context of continuing professional development (CPD). It is argued that instrumental learning is a unique process of adult learning, and reflective practice's impact on learning outcomes in instrumental learning contexts remains unclear. A…

The Perinatal Palliative Care Perceptions and Barriers Scale Instrument©: development and validation.

PubMed

Wool, Charlotte; Northam, Sally

2011-12-01

To devise and test an instrument measuring clinician perceptions of perinatal palliative care (PPC) and barriers to care delivery. PPC was theorized to involve the care of pregnant women and their families after prenatal testing resulted in a life-limiting fetal diagnosis. Both giving birth to a child with a life-limiting condition or termination of pregnancy for fetal anomaly can be emotionally traumatic life events. Clinicians were thought to face ethical dilemmas that involved approaches to care for this population. The ethical dilemmas were measured on a perceptions scale using items about informed consent, justice, beneficence, and autonomy. Barriers were theorized as obstacles to delivering quality PPC and included insufficient education, personal discomfort, and difficulty garnering team or administrative support for care. Licensed clinicians practicing in the perinatal field. Stage 1 entailed instrument development and validation, which was achieved through a Delphi study involving 11 expert panelists. The devised instrument included 64 six-point Likert items. In stage 2, a computer survey gathered data from a multidisciplinary, clinician group. A total of 264 clinicians completed the survey. Exploratory factor analysis with varimax rotation was used to validate the instrument, evaluate the factors, and summarize the explained variance achieved by sum scores of the perceptions and barriers scales. The perceptions scale was reduced to 23 items with a 6-factor solution explaining 67% of the variance with a good internal consistency reliability of 0.77 (Cronbach α). The 22-item barriers scale had a 6-factor solution explaining 71% of the variance with an alpha reliability of 0.83. The Perinatal Palliative Care Perceptions and Practice Barriers Scale instrument is a valid and reliable measure of PPC perceptions and barriers for measuring the attitudes of physicians and nurses. Use of this instrument can foster educational programs and hospital planning for PPC teams that provide grieving families with the varied support they need. It is also a useful instrument for examining trends in the clinician perspectives and practice barriers as more genetic testing and subsequent terminal diagnoses occur.

Performance evaluation of infrared imaging system in field test

NASA Astrophysics Data System (ADS)

Wang, Chensheng; Guo, Xiaodong; Ren, Tingting; Zhang, Zhi-jie

2014-11-01

Infrared imaging system has been applied widely in both military and civilian fields. Since the infrared imager has various types and different parameters, for system manufacturers and customers, there is great demand for evaluating the performance of IR imaging systems with a standard tool or platform. Since the first generation IR imager was developed, the standard method to assess the performance has been the MRTD or related improved methods which are not perfect adaptable for current linear scanning imager or 2D staring imager based on FPA detector. For this problem, this paper describes an evaluation method based on the triangular orientation discrimination metric which is considered as the effective and emerging method to evaluate the synthesis performance of EO system. To realize the evaluation in field test, an experiment instrument is developed. And considering the importance of operational environment, the field test is carried in practical atmospheric environment. The test imagers include panoramic imaging system and staring imaging systems with different optics and detectors parameters (both cooled and uncooled). After showing the instrument and experiment setup, the experiment results are shown. The target range performance is analyzed and discussed. In data analysis part, the article gives the range prediction values obtained from TOD method, MRTD method and practical experiment, and shows the analysis and results discussion. The experimental results prove the effectiveness of this evaluation tool, and it can be taken as a platform to give the uniform performance prediction reference.

Managing the culturally diverse medical practice team: twenty-five strategies.

PubMed

Hills, Laura

2014-01-01

A common misconception is that the phrase workplace diversity means meeting certain quotas in employee race or gender categories. In fact, diversity is much more than that. This article explores the unique benefits and challenges of managing a culturally diverse medical practice team and offers practice managers 25 practical strategies. It describes the two types of diversity training that are beneficial to practice managers and the kinds of policies, practices, and procedures that foster and promote diversity. This article also explores ethnocentrism, racism, ageism, sexism, stereotyping, and other potentially divisive issues among a diverse medical practice team. It provides an assessment instrument practice managers can use to evaluate their own diversity management skills. Finally, this article defines specifically what is meant by the term diversity and explores the top 10 diversity issues in workplaces today.

Instruments for Assessing Risk of Bias and Other Methodological Criteria of Published Animal Studies: A Systematic Review

PubMed Central

Krauth, David; Woodruff, Tracey J.

2013-01-01

Background: Results from animal toxicology studies are critical to evaluating the potential harm from exposure to environmental chemicals or the safety of drugs prior to human testing. However, there is significant debate about how to evaluate the methodology and potential biases of the animal studies. There is no agreed-upon approach, and a systematic evaluation of current best practices is lacking. Objective: We performed a systematic review to identify and evaluate instruments for assessing the risk of bias and/or other methodological criteria of animal studies. Method: We searched Medline (January 1966–November 2011) to identify all relevant articles. We extracted data on risk of bias criteria (e.g., randomization, blinding, allocation concealment) and other study design features included in each assessment instrument. Discussion: Thirty distinct instruments were identified, with the total number of assessed risk of bias, methodological, and/or reporting criteria ranging from 2 to 25. The most common criteria assessed were randomization (25/30, 83%), investigator blinding (23/30, 77%), and sample size calculation (18/30, 60%). In general, authors failed to empirically justify why these or other criteria were included. Nearly all (28/30, 93%) of the instruments have not been rigorously tested for validity or reliability. Conclusion: Our review highlights a number of risk of bias assessment criteria that have been empirically tested for animal research, including randomization, concealment of allocation, blinding, and accounting for all animals. In addition, there is a need for empirically testing additional methodological criteria and assessing the validity and reliability of a standard risk of bias assessment instrument. Citation: Krauth D, Woodruff TJ, Bero L. 2013. Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review. Environ Health Perspect 121:985–992 (2013); http://dx.doi.org/10.1289/ehp.1206389 PMID:23771496

Measurement Instrument for Scientific Teaching (MIST): A Tool to Measure the Frequencies of Research-Based Teaching Practices in Undergraduate Science Courses

PubMed Central

Durham, Mary F.; Knight, Jennifer K.; Couch, Brian A.

2017-01-01

The Scientific Teaching (ST) pedagogical framework provides various approaches for science instructors to teach in a way that more closely emulates how science is practiced by actively and inclusively engaging students in their own learning and by making instructional decisions based on student performance data. Fully understanding the impact of ST requires having mechanisms to quantify its implementation. While many useful instruments exist to document teaching practices, these instruments only partially align with the range of practices specified by ST, as described in a recently published taxonomy. Here, we describe the development, validation, and implementation of the Measurement Instrument for Scientific Teaching (MIST), a survey derived from the ST taxonomy and designed to gauge the frequencies of ST practices in undergraduate science courses. MIST showed acceptable validity and reliability based on results from 7767 students in 87 courses at nine institutions. We used factor analyses to identify eight subcategories of ST practices and used these categories to develop a short version of the instrument amenable to joint administration with other research instruments. We further discuss how MIST can be used by instructors, departments, researchers, and professional development programs to quantify and track changes in ST practices. PMID:29196428

Psychometric Testing of the Greek Version of the Clinical Learning Environment-Teacher (CLES+T).

PubMed

Papastavrou, Evridiki; Dimitriadou, Maria; Tsangari, Haritini

2015-09-01

Clinical practice is an important part of nursing education, and robust instruments are required to evaluate the effectiveness of the hospital setting as a learning environment. The study aim is the psychometric test of the Clinical Learning Environment+Teacher (CLES+T) scale-Greek version. 463 students practicing in acute care hospitals participated in the study. The reliability of the instrument was estimated with Cronbach's alpha coefficients. The construct validity was evaluated using exploratory factor analysis (EFA) with Varimax rotation. Convergent validity was examined by measuring the bivariate correlations between the scale/subscales. Content, validity and semantic equivalence were examined through reviews by a panel of experts. The total scale showed high internal consistency (α=0.95). EFA was identical to the original scale, had eigen values larger than one and explained a total of 67.4% of the variance. The factor with the highest eigen value and the largest percentage of variance explained was "supervisory relationship", with an original eigenvalue of 13.1 (6.8 after Varimax rotation) and an explanation of around 38% of the variance (or 20% after rotation). Convergent validity was examined by measuring the bivariate correlations between the scale and a question that measured the general satisfaction. The Greek version of the CLES+T is a valid and reliable instrument that can be used to examine students' perceptions of the clinical learning environment.

Investigation into Practical Implementations of a Zero Knowledge Protocol.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Marleau, Peter; Krentz-Wee, Rebecca E.

In recent years, the concept of Zero Knowledge Protocols (ZKP) as a useful approach to nuclear warhead verification has become increasingly popular. Several implementations of ZKP have been proposed, driving technology development toward proof of concept demonstrations. Whereas proposed implementations seem to fall within the general class of template-based techniques, all physical implementations of ZKPs proposed to date have a complication: once the instrumentation is prepared, it is no longer authenticatable; the instrument physically contains sensitive information. In this work we explore three different concepts that may offer more authenticatable and practical ZKP implementations and evaluate the sensitive information thatmore » may be at risk when doing so: sharing a subset of detector counts in a preloaded image (with spatial information removed), real-time image subtraction, and a new concept, CONfirmation using a Fast-neutron Imaging Detector with Anti-image NULL-positive Time Encoding (CONFIDANTE). CONFIDANTE promises to offer an almost ideal implementation of ZKP: a positive result is indicated by a constant rate at all times enabling the monitoring party the possibility of full access to the instrument before, during, and after confirmation. A prototype of CONFIDANTE was designed, built, and its performance evaluated in a series of measurements of several objects including a set of plutonium dioxide Hemispheres. Very encouraging results proving feasibility are presented. 1 Rebecca is currently a graduate student in Nuclear Engineering at UC Berkeley« less

The Estimation and Inclusion of Presenteeism Costs in Applied Economic Evaluation: A Systematic Review.

PubMed

Kigozi, Jesse; Jowett, Sue; Lewis, Martyn; Barton, Pelham; Coast, Joanna

2017-03-01

Given the significant costs of reduced productivity (presenteeism) in comparison to absenteeism, and overall societal costs, presenteeism has a potentially important role to play in economic evaluations. However, these costs are often excluded. The objective of this study is to review applied cost of illness studies and economic evaluations to identify valuation methods used for, and impact of including presenteeism costs in practice. A structured systematic review was carried out to explore (i) the extent to which presenteeism has been applied in cost of illness studies and economic evaluations and (ii) the overall impact of including presenteeism on overall costs and outcomes. Potential articles were identified by searching Medline, PsycINFO and NHS EED databases. A standard template was developed and used to extract information from economic evaluations and cost of illness studies incorporating presenteeism costs. A total of 28 studies were included in the systematic review which also demonstrated that presenteeism costs are rarely included in full economic evaluations. Estimation and monetisation methods differed between the instruments. The impact of disease on presenteeism whilst in paid work is high. The potential impact of presenteeism costs needs to be highlighted and greater consideration should be given to including these in economic evaluations and cost of illness studies. The importance of including presenteeism costs when conducting economic evaluation from a societal perspective should be emphasised in national economic guidelines and more methodological work is required to improve the practical application of presenteeism instruments to generate productivity cost estimates. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

The measurement of patient attitudes regarding prenatal and preconception genetic carrier screening and translational behavioral medicine: an integrative review.

PubMed

Shiroff, Jennifer J; Gregoski, Mathew J

2017-06-01

Measurement of recessive carrier screening attitudes related to conception and pregnancy is necessary to determine current acceptance, and whether behavioral intervention strategies are needed in clinical practice. To evaluate quantitative survey instruments to measure patient attitudes regarding genetic carrier testing prior to conception and pregnancy databases examining patient attitudes regarding genetic screening prior to conception and pregnancy from 2003-2013 were searched yielding 344 articles; eight studies with eight instruments met criteria for inclusion. Data abstraction on theoretical framework, subjects, instrument description, scoring, method of measurement, reliability, validity, feasibility, level of evidence, and outcomes was completed. Reliability information was provided in five studies with an internal consistency of Cronbach's α >0.70. Information pertaining to validity was presented in three studies and included construct validity via factor analysis. Despite limited psychometric information, these questionnaires are self-administered and can be briefly completed, making them a feasible method of evaluation.

[Using attachment measures in the context of providing expert witness through psychiatric assessment in family court proceedings].

PubMed

Besier, Tanja; Ziegenhain, Ute; Fegert, Jörg M; Künster, Anne Katrin

2012-01-01

Prognostic evaluation of child development in the context of his/her actual family situation plays an important role in family law disputes. However, there is a lack of empirically validated instruments to assess socio-emotional development in very young children. Attachment research provides instruments which could be utilized in clinical practice. At this, the focus should be on assessing the quality of parent-child-relationship and the occurrence of risky parenting behaviour. The article illustrates the use of attachment measures in the context of a family court proceeding according to subsection 1666 German Civil Code. Risk assessment is carried out through direct observation of the quality of interaction between mother and ten months old infant as well as through evaluation of the attachment representations of both parent caregivers. Instruments used are the Strange Situation Test (to assess infant attachment), the CARE-Index (to assess parental sensitivity), the Adult Attachment Interview, and the Adult Attachment Projective (to assess parental attachment representations).

Video-Based Method of Quantifying Performance and Instrument Motion During Simulated Phonosurgery

PubMed Central

Conroy, Ellen; Surender, Ketan; Geng, Zhixian; Chen, Ting; Dailey, Seth; Jiang, Jack

2015-01-01

Objectives/Hypothesis To investigate the use of the Video-Based Phonomicrosurgery Instrument Tracking System to collect instrument position data during simulated phonomicrosurgery and calculate motion metrics using these data. We used this system to determine if novice subject motion metrics improved over 1 week of training. Study Design Prospective cohort study. Methods Ten subjects performed simulated surgical tasks once per day for 5 days. Instrument position data were collected and used to compute motion metrics (path length, depth perception, and motion smoothness). Data were analyzed to determine if motion metrics improved with practice time. Task outcome was also determined each day, and relationships between task outcome and motion metrics were used to evaluate the validity of motion metrics as indicators of surgical performance. Results Significant decreases over time were observed for path length (P <.001), depth perception (P <.001), and task outcome (P <.001). No significant change was observed for motion smoothness. Significant relationships were observed between task outcome and path length (P <.001), depth perception (P <.001), and motion smoothness (P <.001). Conclusions Our system can estimate instrument trajectory and provide quantitative descriptions of surgical performance. It may be useful for evaluating phonomicrosurgery performance. Path length and depth perception may be particularly useful indicators. PMID:24737286

Perspectives of dental students and faculty about evidence-based dental practice.

PubMed

Abdelkarim, Ahmad; Sullivan, Donna

2014-12-01

The study aimed at evaluating attitudes and perceptions of dental students and faculty toward evidence-based practice, integration of technology and social media, general practitioners' and specialists' scope of practice, and dental practice rewards and disadvantages. A survey instrument was designed with 10 statements rated on a five-point Likert scale (strongly agree to strongly disagree) and an optional comment section. The survey instrument was delivered through SurveyMonkey, whereby 401 students and 182 faculty members from ten U.S. dental schools participated (16% estimated response rate). Null hypotheses regarding the equality between the responses of the two groups were statistically tested using Mann-Whitney U test. Statistical significance was set at .05. Evidence-based practice is positively perceived by both groups, but with significantly higher support by faculty than students (P = 0.002). Both groups agreed that technological advancements are advantageous (P = 0.95), but do not constitute good dentistry and cannot mask poor clinical skills. Students showed higher support for social media than faculty (P = 0.000). Both groups perceived group practices positively. Faculty members showed higher agreement than students toward limitation of dental specialists' practices to their specialties (P = 0.000). Both groups are aware of practice disadvantages, such as increased litigation, health risks, and detriment to the dentist's posture. However, they both perceive dental practice positively despite all these challenges. Students and faculty share generally comparable perspectives toward dental practice. They are both in agreement with evidence-based practice and adoption of technology. They both acknowledge practice limitations. Copyright © 2014 Elsevier Inc. All rights reserved.

Validation of a moral distress instrument in nurses of primary health care 1

PubMed Central

Barth, Priscila Orlandi; Ramos, Flávia Regina Souza; Barlem, Edison Luiz Devos; Dalmolin, Graziele de Lima; Schneider, Dulcinéia Ghizoni

2018-01-01

ABSTRACT Objective: to validate an instrument to identify situations that trigger moral distress in relation to intensity and frequency in primary health care nurses. Method: this is a methodological study carried out with 391 nurses of primary health care, applied to the Brazilian Scale of Moral Distress in Nurses with 57 questions. Validation for primary health care was performed through expert committee evaluation, pre-test, factorial analysis, and Cronbach’s alpha. Results: there were 46 questions validated divided into six constructs: Health Policies, Working Conditions, Nurse Autonomy, Professional ethics, Disrespect to patient autonomy and Work Overload. The instrument had satisfactory internal consistency, with Cronbach’s alpha 0.98 for the instrument, and between 0.96 and 0.88 for the constructs. Conclusion: the instrument is valid and reliable to be used in the identification of the factors that trigger moral distress in primary care nurses, providing subsidies for new research in this field of professional practice. PMID:29791671

A Comparison of seismic instrument noise coherence analysis techniques

USGS Publications Warehouse

Ringler, A.T.; Hutt, C.R.; Evans, J.R.; Sandoval, L.D.

2011-01-01

The self-noise of a seismic instrument is a fundamental characteristic used to evaluate the quality of the instrument. It is important to be able to measure this self-noise robustly, to understand how differences among test configurations affect the tests, and to understand how different processing techniques and isolation methods (from nonseismic sources) can contribute to differences in results. We compare two popular coherence methods used for calculating incoherent noise, which is widely used as an estimate of instrument self-noise (incoherent noise and self-noise are not strictly identical but in observatory practice are approximately equivalent; Holcomb, 1989; Sleeman et al., 2006). Beyond directly comparing these two coherence methods on similar models of seismometers, we compare how small changes in test conditions can contribute to incoherent-noise estimates. These conditions include timing errors, signal-to-noise ratio changes (ratios between background noise and instrument incoherent noise), relative sensor locations, misalignment errors, processing techniques, and different configurations of sensor types.

Development of an embedded instrument for autofocus and polarization alignment of polarization maintaining fiber

NASA Astrophysics Data System (ADS)

Feng, Di; Fang, Qimeng; Huang, Huaibo; Zhao, Zhengqi; Song, Ningfang

2017-12-01

The development and implementation of a practical instrument based on an embedded technique for autofocus and polarization alignment of polarization maintaining fiber is presented. For focusing efficiency and stability, an image-based focusing algorithm fully considering the image definition evaluation and the focusing search strategy was used to accomplish autofocus. For improving the alignment accuracy, various image-based algorithms of alignment detection were developed with high calculation speed and strong robustness. The instrument can be operated as a standalone device with real-time processing and convenience operations. The hardware construction, software interface, and image-based algorithms of main modules are described. Additionally, several image simulation experiments were also carried out to analyze the accuracy of the above alignment detection algorithms. Both the simulation results and experiment results indicate that the instrument can achieve the accuracy of polarization alignment <±0.1 deg.

Measuring value sensitivity in medicine.

PubMed

Ineichen, Christian; Christen, Markus; Tanner, Carmen

2017-01-28

Value sensitivity - the ability to recognize value-related issues when they arise in practice - is an indispensable competence for medical practitioners to enter decision-making processes related to ethical questions. However, the psychological competence of value sensitivity is seldom an explicit subject in the training of medical professionals. In this contribution, we outline the traditional concept of moral sensitivity in medicine and its revised form conceptualized as value sensitivity and we propose an instrument that measures value sensitivity. We developed an instrument for assessing the sensitivity for three value groups (moral-related values, values related to the principles of biomedical ethics, strategy-related values) in a four step procedure: 1) value identification (n = 317); 2) value representation (n = 317); 3) vignette construction and quality evaluation (n = 37); and 4) instrument validation by comparing nursing professionals with hospital managers (n = 48). We find that nursing professionals recognize and ascribe importance to principle-related issues more than professionals from hospital management. The latter are more likely to recognize and ascribe importance to strategy-related issues. These hypothesis-driven results demonstrate the discriminatory power of our newly developed instrument, which makes it useful not only for health care professionals in practice but for students and people working in the clinical context as well.

Quality assessment of recent evidence-based clinical practice guidelines for management of type 2 diabetes mellitus in adults using the AGREE II instrument.

PubMed

Anwer, Muhammad A; Al-Fahed, Ousama B; Arif, Samir I; Amer, Yasser S; Titi, Maher A; Al-Rukban, Mohammed O

2018-02-01

Type 2 diabetes mellitus (T2DM) is a worldwide and national public health problem that has a great impact on the population in Saudi Arabia. High-quality clinical practice guidelines (CPGs) are cornerstones in improving the health care provided for patients with diabetes. This study evaluated the methodological rigour, transparency, and applicability of recently published CPGs. Our group conducted a systematic search for recently published CPGs for T2DM. The searching and screening for Source CPGs were guided by tools from the ADAPTE methods with specific inclusion/exclusion criteria. Five reviewers using the second version of the Appraisal of Guidelines for Research and Evaluation (AGREE II) Instrument independently assessed the quality of the retrieved Source CPGs. Domains of Scope and purpose and Clarity of presentation received the highest scores in all CPGs. Most of the assessed CPGs (86%) were considered with high overall quality and were recommended for use. Rigour of development and applicability domains were together highest in 3 CPGs (43%). The overall high quality of DM CPGs published in the last 3 years demonstrated the continuous development and improvement in CPG methodologies and standards. Health care professionals should consider the quality of any CPG for T2DM before deciding to use it in their daily clinical practice. Three CPGs have been identified, using the AGREE criteria, as high-quality and trustworthy. Ideally, the resources provided by the AGREE trust including the AGREE II Instrument should be used by a clinician to scan through the large number of published T2DM CPGs to identify the CPGs with high methodological quality and applicability. © 2017 John Wiley & Sons, Ltd.

Foundations of Intervention Research in Instrumental Practice

PubMed Central

Hatfield, Johannes L.; Lemyre, Pierre-Nicolas

2016-01-01

The goals of the present study are to evaluate, implement, and adapt psychological skills used in the realm of sports into music performance. This research project also aims to build foundations on how to implement future interventions to guide music students on how to optimize practice toward performance. A 2-month psychological skills intervention was provided to two students from the national music academy's bachelor program in music performance to better understand how to adapt and construct psychological skills training programs for performing music students. The program evaluated multiple intervention tools including the use of questionnaires, performance profiling, iPads, electronic practice logs, recording the perceived value of individual and combined work, as well as the effectiveness of different communication forms. Perceived effects of the intervention were collected through semi-structured interviews, observations, and logs. PMID:26834660

Evaluation of competence-based teaching in higher education: From theory to practice.

PubMed

Bergsmann, Evelyn; Schultes, Marie-Therese; Winter, Petra; Schober, Barbara; Spiel, Christiane

2015-10-01

Competence-based teaching in higher education institutions and its evaluation have become a prevalent topic especially in the European Union. However, evaluation instruments are often limited, for example to single student competencies or specific elements of the teaching process. The present paper provides a more comprehensive evaluation concept that contributes to sustainable improvement of competence-based teaching in higher education institutions. The evaluation concept considers competence research developments as well as the participatory evaluation approach. The evaluation concept consists of three stages. The first stage evaluates whether the competencies students are supposed to acquire within the curriculum (ideal situation) are well defined. The second stage evaluates the teaching process and the competencies students have actually acquired (real situation). The third stage evaluates concrete aspects of the teaching process. Additionally, an implementation strategy is introduced to support the transfer from the theoretical evaluation concept to practice. The evaluation concept and its implementation strategy are designed for internal evaluations in higher education and primarily address higher education institutions that have already developed and conducted a competence-based curriculum. Copyright © 2015 Elsevier Ltd. All rights reserved.

Evaluation of Nosocomial Infection Control Programs in health services 1

PubMed Central

Menegueti, Mayra Gonçalves; Canini, Silvia Rita Marin da Silva; Bellissimo-Rodrigues, Fernando; Laus, Ana Maria

2015-01-01

OBJECTIVES: to evaluate the Nosocomial Infection Control Programs in hospital institutions regarding structure and process indicators. METHOD: this is a descriptive, exploratory and quantitative study conducted in 2013. The study population comprised 13 Nosocomial Infection Control Programs of health services in a Brazilian city of the state of São Paulo. Public domain instruments available in the Manual of Evaluation Indicators of Nosocomial Infection Control Practices were used. RESULTS: The indicators with the highest average compliance were "Evaluation of the Structure of the Nosocomial Infection Control Programs" (75%) and "Evaluation of the Epidemiological Surveillance System of Nosocomial Infection" (82%) and those with the lowest mean compliance scores were "Evaluation of Operational Guidelines" (58.97%) and "Evaluation of Activities of Control and Prevention of Nosocomial Infection" (60.29%). CONCLUSION: The use of indicators identified that, despite having produced knowledge about prevention and control of nosocomial infections, there is still a large gap between the practice and the recommendations. PMID:25806637

Actual curriculum development practices instrument: Testing for factorial validity

NASA Astrophysics Data System (ADS)

Foi, Liew Yon; Bakar, Kamariah Abu; Hamzah, Mohd Sahandri Gani; Alwi, Nor Hayati

2014-09-01

The Actual Curriculum Development Practices Instrument (ACDP-I) was developed and the factorial validity of the ACDP-I was tested (n = 107) using exploratory factor analysis procedures in the earlier work of [1]. Despite the ACDP-I appears to be content and construct valid instrument with very high internal reliability qualities for using in Malaysia, the accumulated evidences are still needed to provide a sound scientific basis for the proposed score interpretations. Therefore, the present study addresses this concern by utilising the confirmatory factor analysis to further confirm the theoretical structure of the variable Actual Curriculum Development Practices (ACDP) and enrich the psychometrical properties of ACDP-I. Results of this study have practical implication to both researchers and educators whose concerns focus on teachers' classroom practices and the instrument development and validation process.

The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument.

PubMed

Mokkink, Lidwine B; Prinsen, Cecilia A C; Bouter, Lex M; Vet, Henrica C W de; Terwee, Caroline B

2016-01-19

COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) is an initiative of an international multidisciplinary team of researchers who aim to improve the selection of outcome measurement instruments both in research and in clinical practice by developing tools for selecting the most appropriate available instrument. In this paper these tools are described, i.e. the COSMIN taxonomy and definition of measurement properties; the COSMIN checklist to evaluate the methodological quality of studies on measurement properties; a search filter for finding studies on measurement properties; a protocol for systematic reviews of outcome measurement instruments; a database of systematic reviews of outcome measurement instruments; and a guideline for selecting outcome measurement instruments for Core Outcome Sets in clinical trials. Currently, we are updating the COSMIN checklist, particularly the standards for content validity studies. Also new standards for studies using Item Response Theory methods will be developed. Additionally, in the future we want to develop standards for studies on the quality of non-patient reported outcome measures, such as clinician-reported outcomes and performance-based outcomes. In summary, we plea for more standardization in the use of outcome measurement instruments, for conducting high quality systematic reviews on measurement instruments in which the best available outcome measurement instrument is recommended, and for stopping the use of poor outcome measurement instruments.

The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument

PubMed Central

Mokkink, Lidwine B.; Prinsen, Cecilia A. C.; Bouter, Lex M.; de Vet, Henrica C. W.; Terwee, Caroline B.

2016-01-01

Background: COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) is an initiative of an international multidisciplinary team of researchers who aim to improve the selection of outcome measurement instruments both in research and in clinical practice by developing tools for selecting the most appropriate available instrument. Method: In this paper these tools are described, i.e. the COSMIN taxonomy and definition of measurement properties; the COSMIN checklist to evaluate the methodological quality of studies on measurement properties; a search filter for finding studies on measurement properties; a protocol for systematic reviews of outcome measurement instruments; a database of systematic reviews of outcome measurement instruments; and a guideline for selecting outcome measurement instruments for Core Outcome Sets in clinical trials. Currently, we are updating the COSMIN checklist, particularly the standards for content validity studies. Also new standards for studies using Item Response Theory methods will be developed. Additionally, in the future we want to develop standards for studies on the quality of non-patient reported outcome measures, such as clinician-reported outcomes and performance-based outcomes. Conclusions: In summary, we plea for more standardization in the use of outcome measurement instruments, for conducting high quality systematic reviews on measurement instruments in which the best available outcome measurement instrument is recommended, and for stopping the use of poor outcome measurement instruments. PMID:26786084

[VISPA's group (evaluation of the implementation strategies of the measurements instruments adopted in the Italian nursing practice)].

PubMed

Palese, A; Mecugni, S; Barbieri, M; Bonocore, M; Buscaroli, A; Buscaroli, A; Caparnoni, M; Colognese, S; Costi, D; Di Vaio, S; Lapi, L; Lionte, G; Nasi, A M; Pellicciari, C; Quartieri, M; Ricci, R; Saguatti, K; Saragoni, M; Tarantola, S; Torri, E; Vaccari, S; Volpi, P; Vinceti, M

2010-01-01

An innovative teaching strategy focused on problem based approach rather than theorical aiming to facilitate the learning of the research methodology in advanced nursing student has been introduced. Through out a qualitative evaluation of the diary kept by the student nurses involved, advantages and disadvantages of this innovative approach have been evaluated. This paper reports a synthesis of the teaching strategy and its impact on the competences in the research methodology as it has been perceived by the students participants.

Content Validity for the VVSymQ® Instrument: A New Patient-Reported Outcome Measure for the Assessment of Varicose Veins Symptoms.

PubMed

Paty, Jean; Elash, Celeste A; Turner-Bowker, Diane M

2017-02-01

Varicose veins are common and can impact patients' quality of life, but consensus regarding the evaluation of varicose vein symptoms is lacking and existing measures have limitations. This research aimed to develop and establish the content validity of a new electronic patient-reported outcome (PRO) measure, the VVSymQ ® instrument, to assess symptoms of superficial venous insufficiency (varicose veins) in clinical trials. The development of the VVSymQ ® instrument began with qualitative interviews with patients based on the symptom domain of the VEINES-QOL/Sym, an existing PRO instrument for chronic venous disorders of the leg. Three phases of qualitative research were conducted to examine the relevance and importance of the symptoms to patients with varicose veins, and the patients' ability to understand and use the VVSymQ ® instrument. The development included evaluating questions that had 1-week and 24-h recall periods, and paper and electronic versions of the new instrument. Five symptoms (heaviness, achiness, swelling, throbbing, and itching [HASTI™]) were consistently reported by patients across all sources of qualitative data. The final version of the VVSymQ ® instrument queries patients on the HASTI™ symptoms using a 24-h recall period and a 6-point duration-based response scale ranging from "None of the time" to "All of the time," and is administered daily via an electronic diary. Cognitive interviews demonstrated varicose vein patients' understanding of and their ability to use the final version of the VVSymQ ® instrument. Content validity was established for the VVSymQ ® instrument, which assesses the five HASTI™ symptoms of varicose veins daily via an electronic diary and has promise for use in research and practice.

A Survey of Neuropsychologists’ Practices and Perspectives Regarding the Assessment of Judgment Ability

PubMed Central

Rabin, Laura A.; Borgos, Marlana J.; Saykin, Andrew J.

2012-01-01

Judgment is an important aspect of cognitive and real-world functioning that is commonly assessed during neuropsychological evaluations. This study utilized a brief, online survey to examine neuropsychologists’ practices and perspectives regarding available judgment instruments. Participants (n=290, 17% response rate) were randomly selected members of the International Neuropsychological Society and the National Academy of Neuropsychology. Respondents rank-ordered the following issues that should be incorporated into assessments of judgment (from most to least important): safety, ability to perform activities of daily living, and problem solving/decision making about medical, financial, social/ethical, and legal matters. A majority of respondents reported that they “often” or “always” assessed judgment when evaluating patients with traumatic brain injury (89%), dementia (87%), and psychiatric disorders (70%). Surprisingly, the top-ranked instruments were not tests of judgment per se, and included the WAIS-III Comprehension, Wisconsin Card Sorting Test, and WAIS-III Similarities. Further, 61% of respondents were slightly confident, and only 23% were very confident, in their ability to assess a patient’s judgment skills with their current tests. The overwhelming majority (87%) of respondents perceived a need for improved measures. Overall results indicate use of varied techniques by neuropsychologists to evaluate judgment and suggest the need for additional tests of this cognitive domain. PMID:19023743

Pedagogy and the Intuitive Appeal of Learning Styles in Post-Compulsory Education in England

ERIC Educational Resources Information Center

Nixon, Lawrence; Gregson, Maggie; Spedding, Trish

2007-01-01

Despite the rigorous and robust evaluation of learning styles theories, models and inventories, little objective evidence in support of their effectiveness has been found. The lack of unambiguous evidence in support of these models and practices leaves the continued popularity of these models and instruments as a puzzle. Two related accounts of…

An Examination of Factors Associated with School Psychologists' Provision of Counseling Services

ERIC Educational Resources Information Center

DeFago, Jennifer Kelly

2012-01-01

The purpose of this study was to evaluate the factors that predict provision of counseling services by Ohio-based school psychologists. In order to address the research questions, a survey instrument was created and a sample of school psychologists working in Ohio completed a questionnaire regarding their counseling practices. The data were…

The Content, Predictive Power, and Potential Bias in Five Widely Used Teacher Observation Instruments. REL 2017-191

ERIC Educational Resources Information Center

Gill, Brian; Shoji, Megan; Coen, Thomas; Place, Kate

2016-01-01

School districts and states across the Regional Educational Laboratory Mid-Atlantic Region and the country as a whole have been modifying their teacher evaluation systems to identify more effective and less effective teachers and provide better feedback to improve instructional practice. The new systems typically include components related to…

What is the effect of area size when using local area practice style as an instrument?

PubMed

Brooks, John M; Tang, Yuexin; Chapman, Cole G; Cook, Elizabeth A; Chrischilles, Elizabeth A

2013-08-01

Discuss the tradeoffs inherent in choosing a local area size when using a measure of local area practice style as an instrument in instrumental variable estimation when assessing treatment effectiveness. Assess the effectiveness of angiotensin converting-enzyme inhibitors and angiotensin receptor blockers on survival after acute myocardial infarction for Medicare beneficiaries using practice style instruments based on different-sized local areas around patients. We contrasted treatment effect estimates using different local area sizes in terms of the strength of the relationship between local area practice styles and individual patient treatment choices; and indirect assessments of the assumption violations. Using smaller local areas to measure practice styles exploits more treatment variation and results in smaller standard errors. However, if treatment effects are heterogeneous, the use of smaller local areas may increase the risk that local practice style measures are dominated by differences in average treatment effectiveness across areas and bias results toward greater effectiveness. Local area practice style measures can be useful instruments in instrumental variable analysis, but the use of smaller local area sizes to generate greater treatment variation may result in treatment effect estimates that are biased toward higher effectiveness. Assessment of whether ecological bias can be mitigated by changing local area size requires the use of outside data sources. Copyright © 2013 Elsevier Inc. All rights reserved.

Cultural adaptation and psychometric properties of the family questionnaire in a Brazilian sample of relatives of schizophrenia outpatients.

PubMed

Zanetti, Ana C G; Wiedemann, Georg; Dantas, Rosana A S; Hayashida, Miyeko; de Azevedo-Marques, João M; Galera, Sueli A F

2013-06-01

To evaluate the internal reliability and validity of the Brazilian Portuguese version of the Family Questionnaire among families of schizophrenia outpatients. The main studies about the family environment of schizophrenia patients are related to the concept of Expressed Emotion. There is currently no instrument to evaluate this concept in Brazil that is easily applicable and comparable with studies from other countries. Methodological and cross-sectional research design. A convenience sample of 130 relatives of schizophrenia outpatients was selected. The translation and cultural adaptation of the instrument involved experts in mental health and experts in the German language and included back translation, semantic evaluation of items and pretesting of the instrument with 30 relatives of schizophrenia outpatients. The psychometric properties of the instrument were studied with another 100 relatives, which fulfilled the requirements for the Brazilian Portuguese version of the instrument. The psychometric properties of the instrument were assessed by construct validity (using an analysis of its key components, comparisons between distinct groups-convergent validity with the Antonovsky's Sense of Coherence Scale) and reliability (checking the internal consistency of its items and its test-retest reproducibility). The analysis of main components confirmed dimensionality patterns that were comparable between the original and adapted versions. In two domains of the instrument, critical comments and emotional over-involvement had moderate and significant correlations, respectively, with Antonovsky's Sense of Coherence Scale, appropriate values of Cronbach's alpha and strong and significant correlations, respectively, in test-retest reproducibility. We observed significant differences between distinct groups of parents in the category of emotional over-involvement. We conclude that the Portuguese-adapted version of the Family Questionnaire is valid and reliable for the study sample. This study provided evidence that the Family Questionnaire is a reliable and valid instrument for assessing expressed emotion. It is easy and practical to use and is acceptable for use in a Brazilian cultural population. © 2012 Blackwell Publishing Ltd.

An Adaptation of the Original Fresno Test to Measure Evidence-Based Practice Competence in Pediatric Bedside Nurses.

PubMed

Laibhen-Parkes, Natasha; Kimble, Laura P; Melnyk, Bernadette Mazurek; Sudia, Tanya; Codone, Susan

2018-06-01

Instruments used to assess evidence-based practice (EBP) competence in nurses have been subjective, unreliable, or invalid. The Fresno test was identified as the only instrument to measure all the steps of EBP with supportive reliability and validity data. However, the items and psychometric properties of the original Fresno test are only relevant to measure EBP with medical residents. Therefore, the purpose of this paper is to describe the development of the adapted Fresno test for pediatric nurses, and provide preliminary validity and reliability data for its use with Bachelor of Science in Nursing-prepared pediatric bedside nurses. General adaptations were made to the original instrument's case studies, item content, wording, and format to meet the needs of a pediatric nursing sample. The scoring rubric was also modified to complement changes made to the instrument. Content and face validity, and intrarater reliability of the adapted Fresno test were assessed during a mixed-methods pilot study conducted from October to December 2013 with 29 Bachelor of Science in Nursing-prepared pediatric nurses. Validity data provided evidence for good content and face validity. Intrarater reliability estimates were high. The adapted Fresno test presented here appears to be a valid and reliable assessment of EBP competence in Bachelor of Science in Nursing-prepared pediatric nurses. However, further testing of this instrument is warranted using a larger sample of pediatric nurses in diverse settings. This instrument can be a starting point for evaluating the impact of EBP competence on patient outcomes. © 2018 Sigma Theta Tau International.

Confirmatory Factor Analysis of the Malay Version Comprehensive Feeding Practices Questionnaire Tested among Mothers of Primary School Children in Malaysia

PubMed Central

Shohaimi, Shamarina; Yoke Wei, Wong; Mohd Shariff, Zalilah

2014-01-01

Comprehensive feeding practices questionnaire (CFPQ) is an instrument specifically developed to evaluate parental feeding practices. It has been confirmed among children in America and applied to populations in France, Norway, and New Zealand. In order to extend the application of CFPQ, we conducted a factor structure validation of the translated version of CFPQ (CFPQ-M) using confirmatory factor analysis among mothers of primary school children (N = 397) in Malaysia. Several items were modified for cultural adaptation. Of 49 items, 39 items with loading factors >0.40 were retained in the final model. The confirmatory factor analysis revealed that the final model (twelve-factor model with 39 items and 2 error covariances) displayed the best fit for our sample (Chi-square = 1147; df = 634; P < 0.05; CFI = 0.900; RMSEA = 0.045; SRMR = 0.0058). The instrument with some modifications was confirmed among mothers of school children in Malaysia. The present study extends the usability of the CFPQ and enables researchers and parents to better understand the relationships between parental feeding practices and related problems such as childhood obesity. PMID:25538958

Validity of Guatemalan Mother's Self-Reported Breast-Feeding Practices of 3-Month-Old Infants.

PubMed

Mazariegos, Monica; Slater, Christine; Ramirez-Zea, Manuel

2016-12-01

Breast-feeding practices (BFPs) can be assessed by interviewing the mother about current feeding practices and with a 24-hour recall. It is crucial to establish the accuracy of these methods, which are commonly used by public health decision makers to design health policies aimed at increasing exclusive breast-feeding rates. We aimed to validate 2 self-report BFP instruments using the dose-to-mother deuterium oxide turnover technique (DMDOT) as the reference method. Breast-feeding practices were assessed by interviewing the mother about current feeding practices and with a 24-hour recall in 36 Guatemalan mother-infant pairs. The validity of these instruments was assessed using DMDOT as the reference method. Both self-report instruments overestimated exclusively breast-fed (EBF) infants. Infants classified as EBF were 50% by the reported current feeding practice, 61% by the 24-hour recall, and only 36% using DMDOT. Sensitivity to detect EBF infants from the mother's self-report was 92% (95% CI: 62%-99%) while from the 24-hour recall was 100% (95% CI: 72%-100%, P < .01). However, specificity for both instruments was low, at 74% (95% CI: 51%-89%) for reported current feeding practice and at 61% (95% CI: 39%-79%) for the 24-hour recall (P < .01). Both reported current feeding practice and the 24-hour recall instruments overestimated exclusive breast-feeding. Nevertheless, the use of reported current feeding practice provided more accurate data to assess BFPs in a public health setting. Furthermore, population-based surveys should consider the overestimation of exclusive breast-feeding caused when using these BFP instruments. © The Author(s) 2016.

Conceptualizing Interprofessional Teams as Multi-Team Systems-Implications for Assessment and Training.

PubMed

West, Courtney; Landry, Karen; Graham, Anna; Graham, Lori; Cianciolo, Anna T; Kalet, Adina; Rosen, Michael; Sherman, Deborah Witt

2015-01-01

SGEA 2015 CONFERENCE ABSTRACT (EDITED). Evaluating Interprofessional Teamwork During a Large-Scale Simulation. Courtney West, Karen Landry, Anna Graham, and Lori Graham. CONSTRUCT: This study investigated the multidimensional measurement of interprofessional (IPE) teamwork as part of large-scale simulation training. Healthcare team function has a direct impact on patient safety and quality of care. However, IPE team training has not been the norm. Recognizing the importance of developing team-based collaborative care, our College of Nursing implemented an IPE simulation activity called Disaster Day and invited other professions to participate. The exercise consists of two sessions: one in the morning and another in the afternoon. The disaster scenario is announced just prior to each session, which consists of team building, a 90-minute simulation, and debriefing. Approximately 300 Nursing, Medicine, Pharmacy, Emergency Medical Technicians, and Radiology students and over 500 standardized and volunteer patients participated in the Disaster Day event. To improve student learning outcomes, we created 3 competency-based instruments to evaluate collaborative practice in multidimensional fashion during this exercise. A 20-item IPE Team Observation Instrument designed to assess interprofessional team's attainment of Interprofessional Education Collaborative (IPEC) competencies was completed by 20 faculty and staff observing the Disaster Day simulation. One hundred sixty-six standardized patients completed a 10-item Standardized Patient IPE Team Evaluation Instrument developed from the IPEC competencies and adapted items from the 2014 Henry et al. PIVOT Questionnaire. This instrument assessed the standardized or volunteer patient's perception of the team's collaborative performance. A 29-item IPE Team's Perception of Collaborative Care Questionnaire, also created from the IPEC competencies and divided into 5 categories of Values/Ethics, Roles and Responsibilities, Communication, Teamwork, and Self-Evaluation, was completed by 188 students including 99 from Nursing, 43 from Medicine, 6 from Pharmacy, and 40 participants who belonged to more than one component, were students at another institution, or did not indicate their institution. The team instrument was designed to assess each team member's perception of how well the team and him- or herself met the competencies. Five of the items on the team perceptions questionnaire mirrored items on the standardized patient evaluation: demonstrated leadership practices that led to effective teamwork, discussed care and decisions about that care with patient, described roles and responsibilities clearly, worked well together to coordinate care, and good/effective communication. Internal consistency reliability of the IPE Team Observation Instrument was 0.80. In 18 of the 20 items, more than 50% of observers indicated the item was demonstrated. Of those, 6 of the items were observed by 50% to 75% of the observers, and the remaining 12 were observed by more than 80% of the observers. Internal consistency reliability of the IPE Team's Perception of Collaborative Care Instrument was 0.95. The mean response score-1 (strongly disagree) to 4 (strongly agree)-was calculated for each section of the instrument. The overall mean score was 3.57 (SD = .11). Internal consistency reliability of the Standardized Patient IPE Team Evaluation Instrument was 0.87. The overall mean score was 3.28 (SD = .17). The ratings for the 5 items shared by the standardized patient and team perception instruments were compared using independent sample t tests. Statistically significant differences (p < .05) were present in each case, with the students rating themselves higher on average than the standardized patients did (mean differences between 0.2 and 0.6 on a scale of 1-4). Multidimensional, competency-based instruments appear to provide a robust view of IPE teamwork; however, challenges remain. Due to the large scale of the simulation exercise, observation-based assessment did not function as well as self- and standardized patient-based assessment. To promote greater variation in observer assessments during future Disaster Day simulations, we plan to adjust the rating scale from "not observed," "observed," and "not applicable" to a 4-point scale and reexamine interrater reliability.

Measurement and valuation of quality of life in economic appraisal of cancer treatment.

PubMed

Uyl-de Groot, C A; Rutten, F F; Bonsel, G J

1994-01-01

In the economic evaluation (EE) of technologies in cancer treatment at least three endpoints are relevant: costs, survival and quality of life (QoL). This article is focused on QoL. EE requires the use of generic and valuation QoL instruments at a disease non-specific level, but the inclusion of cancer-specific instruments may be advisable, particularly for reasons of explanation if changes in dimensions are small or conflicting. Given the pros and cons of the available questionnaires, we advocate the use of the Nottingham Health Profile, the EuroQol and the Rotterdam Symptom Checklist. In our experience the QoL issue in EE linked with cancer trials is associated with practical problems like questionnaire composition, follow-up time, interviewing schedule, patients' compliance and doctors' acceptance. These problems are discussed and some practical guidelines for the design of QoL measurement in cancer trials are given.

Concussion evaluation and management in pediatrics.

PubMed

Rivera, Robin G; Roberson, Susan P; Whelan, Margaret; Rohan, Annie

2015-01-01

Concussions are among the most complex injuries to assess and manage in sports medicine and primary care. Sports concussion in youth has received much attention in recent years because research shows that improperly managed concussion can lead to long-term cognitive deficits and mental health problems. There are several notable risk factors affecting the incidence and severity of concussion in school-age children and adolescents, including a history of a previous concussion. A more conservative approach for return to activities following concussion has been proposed for children and adolescents. Programs of individualized, stepwise increases in physical activity have largely replaced use of algorithms for assigning a grade and activity expectations to concussions. Although validity and reliability testing is ongoing to support use of concussion assessment instruments in pediatric patients, it is practical and appropriate that clinicians incorporate symptom checklists, sideline and balance assessment tools, and neurocognitive assessment instruments into their practice in accordance with evidence-based guidelines.

Evaluation of the midwifery pilot projects in Quebec: an overview. L'Equipe d'Evaluation des Projets-Pilotes Sages-Femmes.

PubMed

Blais, R; Joubert, P

2000-01-01

In 1990, the province of Quebec adopted a law authorizing the evaluation of the practice of midwifery through eight pilot projects. The projects, which took the form of birth centres outside hospitals, started operating in 1994. The objectives of the evaluation were 1) to compare midwives' services to current physician services with regard to maternal and neonatal mortality and morbidity, the use of obstetrical intervention, individualization and continuity of care as perceived by clients, and cost; and 2) to identify the professional and organizational factors associated with the integration of midwives into the health care system. A mixed evaluative design was used: a multiple case study with each pilot project representing a case and a cohort study where 1,000 women followed by midwives in the birth centres were matched with 1,000 women followed by physicians in the usual hospital-based services. Various quantitative and qualitative data collection instruments were used. Overall, many results were favourable to midwifery practice, while some were favourable to medical care. Following the evaluation, the Government of Quebec decided to legalize the practice of midwifery.

Service profiling and outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies. Clinical Outcomes in Routine Evaluation-Outcome Measures.

PubMed

Barkham, M; Margison, F; Leach, C; Lucock, M; Mellor-Clark, J; Evans, C; Benson, L; Connell, J; Audin, K; McGrath, G

2001-04-01

To complement the evidence-based practice paradigm, the authors argued for a core outcome measure to provide practice-based evidence for the psychological therapies. Utility requires instruments that are acceptable scientifically, as well as to service users, and a coordinated implementation of the measure at a national level. The development of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) is summarized. Data are presented across 39 secondary-care services (n = 2,710) and within an intensively evaluated single service (n = 1,455). Results suggest that the CORE-OM is a valid and reliable measure for multiple settings and is acceptable to users and clinicians as well as policy makers. Baseline data levels of patient presenting problem severity, including risk, are reported in addition to outcome benchmarks that use the concept of reliable and clinically significant change. Basic quality improvement in outcomes for a single service is considered.

Standard Test Methods for Textile Composites

NASA Technical Reports Server (NTRS)

Masters, John E.; Portanova, Marc A.

1996-01-01

Standard testing methods for composite laminates reinforced with continuous networks of braided, woven, or stitched fibers have been evaluated. The microstructure of these textile' composite materials differs significantly from that of tape laminates. Consequently, specimen dimensions and loading methods developed for tape type composites may not be applicable to textile composites. To this end, a series of evaluations were made comparing testing practices currently used in the composite industry. Information was gathered from a variety of sources and analyzed to establish a series of recommended test methods for textile composites. The current practices established for laminated composite materials by ASTM and the MIL-HDBK-17 Committee were considered. This document provides recommended test methods for determining both in-plane and out-of-plane properties. Specifically, test methods are suggested for: unnotched tension and compression; open and filled hole tension; open hole compression; bolt bearing; and interlaminar tension. A detailed description of the material architectures evaluated is also provided, as is a recommended instrumentation practice.

Protocol for a systematic review of preference-based instruments for measuring care-related outcomes and their suitability for the palliative care setting.

PubMed

McCaffrey, Nikki; Al-Janabi, Hareth; Currow, David; Hoefman, Renske; Ratcliffe, Julie

2016-09-12

Despite informal caregivers' integral role in supporting people affected by disease or disability, economic evaluations often ignore the costs and benefits experienced by this group, especially in the palliative setting. The purpose of this systematic review is to identify preference-based instruments for measuring care-related outcomes and provide guidance on the selection of instrument in palliative care economic evaluations. A comprehensive search of the literature will be conducted from database inception (ASSIA; CINAHL; Cochrane library including DARE, NHS EED, HTA; Econlit; Embase; PsychINFO; PubMed). Published peer-reviewed, English-language articles reporting preference-based instruments for measuring care-related outcomes in any clinical area will be included. One researcher will complete the searches and screen the results for potentially eligible studies. A randomly selected subset of 10% citations will be independently screened by two researchers. Any disagreement will be resolved by consensus among the research team. Subsequently, a supplementary search will identify studies detailing the development, valuation, validation and application of the identified instruments. The degree of suitability of the instruments for palliative economic evaluations will be assessed using criteria in the International Society for Quality of Life Research minimum standards for patient-reported outcome measures, the checklist for reporting valuation studies of multiattribute utility-based instruments and information on the development of the instrument in the palliative setting. A narrative summary of the included studies and instruments will be provided; similarities and differences will be described and possible reasons for variations explored. Recommendations for practice on selection of instruments in palliative care economic analyses will be provided. This is a planned systematic review of published literature. Therefore, ethics approval to conduct this research is not required. Findings will be presented at leading palliative care and health economic conferences and published in a peer-reviewed journal. CRD42016034188. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Effective learning among elite football players: the development of a football-specific self-regulated learning questionnaire.

PubMed

Toering, Tynke; Jordet, Geir; Ripegutu, Anders

2013-01-01

The present study aimed to develop a football-specific self-report instrument measuring self-regulated learning in the context of daily practice, which can be used to monitor the extent to which players take responsibility for their own learning. Development of the instrument involved six steps: 1. Literature review based on Zimmerman's (2006) theory of self-regulated learning, 2. Item generation, 3. Item validation, 4. Pilot studies, 5. Exploratory factor analysis (EFA), and 6. Confirmatory factor analysis (CFA). The instrument was tested for reliability and validity among 204 elite youth football players aged 13-16 years (Mage = 14.6; s = 0.60; 123 boys, 81 girls). The EFA indicated that a five-factor model fitted the observed data best (reflection, evaluation, planning, speaking up, and coaching). However, the CFA showed that a three-factor structure including 22 items produced a satisfactory model fit (reflection, evaluation, and planning; non-normed fit index [NNFI] = 0.96, comparative fit index [CFI] = 0.95, root mean square error of approximation [RMSEA] = 0.067). While the self-regulation processes of reflection, evaluation, and planning are strongly related and fit well into one model, other self-regulated learning processes seem to be more individually determined. In conclusion, the questionnaire developed in this study is considered a reliable and valid instrument to measure self-regulated learning among elite football players.

Development of an interprofessional lean facilitator assessment scale.

PubMed

Bravo-Sanchez, Cindy; Dorazio, Vincent; Denmark, Robert; Heuer, Albert J; Parrott, J Scott

2018-05-01

High reliability is important for optimising quality and safety in healthcare organisations. Reliability efforts include interprofessional collaborative practice (IPCP) and Lean quality/process improvement strategies, which require skilful facilitation. Currently, no validated Lean facilitator assessment tool for interprofessional collaboration exists. This article describes the development and pilot evaluation of such a tool; the Interprofessional Lean Facilitator Assessment Scale (ILFAS), which measures both technical and 'soft' skills, which have not been measured in other instruments. The ILFAS was developed using methodologies and principles from Lean/Shingo, IPCP, metacognition research and Bloom's Taxonomy of Learning Domains. A panel of experts confirmed the initial face validity of the instrument. Researchers independently assessed five facilitators, during six Lean sessions. Analysis included quantitative evaluation of rater agreement. Overall inter-rater agreement of the assessment of facilitator performance was high (92%), and discrepancies in the agreement statistics were analysed. Face and content validity were further established, and usability was evaluated, through primary stakeholder post-pilot feedback, uncovering minor concerns, leading to tool revision. The ILFAS appears comprehensive in the assessment of facilitator knowledge, skills, abilities, and may be useful in the discrimination between facilitators of different skill levels. Further study is needed to explore instrument performance and validity.

Webcams as a tool for teaching in Optometry training

NASA Astrophysics Data System (ADS)

Gargallo, A.; Arines, J.

2015-04-01

Clinical Optometry lab training is devoted to develop the students skills needed in eye healthcare professional practice. Nevertheless, students always find difficulties in the management of some optometric instruments and in the understanding of the evaluation techniques. Moreover, teachers also have problems in explaining the eye evaluation tests or making demonstrations of instruments handling. In order to facilitate the learning process, webcams adapted to the optometric devices represent a helpful and useful tool. In this work we present the use of webcams in some of the most common clinical test in Optometry as ocular refraction, colour vision test, eye health evaluation with slip-lamp, retinoscopy, ophthalmoscopy and contact lens fitting. Our experience shows that with this simple approach we can do things easier: show the instrument handling to all the students at the same time; take pictures or videos of different eye health conditions or exploratory routines for posterior visualization with all the students; recreate visual experience of the patient during optometric exam; simulate colour vision pathologies; increase the interactions between students allowing them to help and correct each other; and also record the final routine exam in order to make possible its revision with the students.

The Faculty Self-Reported Assessment Survey (FRAS): differentiating faculty knowledge and experience in assessment.

PubMed

Hanauer, David I; Bauerle, Cynthia

2015-01-01

Science, technology, engineering, and mathematics education reform efforts have called for widespread adoption of evidence-based teaching in which faculty members attend to student outcomes through assessment practice. Awareness about the importance of assessment has illuminated the need to understand what faculty members know and how they engage with assessment knowledge and practice. The Faculty Self-Reported Assessment Survey (FRAS) is a new instrument for evaluating science faculty assessment knowledge and experience. Instrument validation was composed of two distinct studies: an empirical evaluation of the psychometric properties of the FRAS and a comparative known-groups validation to explore the ability of the FRAS to differentiate levels of faculty assessment experience. The FRAS was found to be highly reliable (α = 0.96). The dimensionality of the instrument enabled distinction of assessment knowledge into categories of program design, instrumentation, and validation. In the known-groups validation, the FRAS distinguished between faculty groups with differing levels of assessment experience. Faculty members with formal assessment experience self-reported higher levels of familiarity with assessment terms, higher frequencies of assessment activity, increased confidence in conducting assessment, and more positive attitudes toward assessment than faculty members who were novices in assessment. These results suggest that the FRAS can reliably and validly differentiate levels of expertise in faculty knowledge of assessment. © 2015 D. I. Hanauer and C. Bauerle. CBE—Life Sciences Education © 2015 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Interdisciplinary Approach to the Development of Accessible Computer-Administered Measurement Instruments.

PubMed

Magasi, Susan; Harniss, Mark; Heinemann, Allen W

2018-01-01

Principles of fairness in testing require that all test takers, including people with disabilities, have an equal opportunity to demonstrate their capacity on the construct being measured. Measurement design features and assessment protocols can pose barriers for people with disabilities. Fairness in testing is a fundamental validity issue at all phases in the design, administration, and interpretation of measurement instruments in clinical practice and research. There is limited guidance for instrument developers on how to develop and evaluate the accessibility and usability of measurement instruments. This article describes a 6-stage iterative process for developing accessible computer-administered measurement instruments grounded in the procedures implemented across several major measurement initiatives. A key component of this process is interdisciplinary teams of accessibility experts, content and measurement experts, information technology experts, and people with disabilities working together to ensure that measurement instruments are accessible and usable by a wide range of users. The development of accessible measurement instruments is not only an ethical requirement, it also ensures better science by minimizing measurement bias, missing data, and attrition due to mismatches between the target population and test administration platform and protocols. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Synthetic Vision Systems in GA Cockpit-Evaluation of Basic Maneuvers Performed by Low Time GA Pilots During Transition from VMC to IMC

NASA Technical Reports Server (NTRS)

Takallu, M. A.; Wong, D. T.; Uenking, M. D.

2002-01-01

An experimental investigation was conducted to study the effectiveness of modern flight displays in general aviation cockpits for mitigating Low Visibility Loss of Control and the Controlled Flight Into Terrain accidents. A total of 18 General Aviation (GA) pilots with private pilot, single engine land rating, with no additional instrument training beyond private pilot license requirements, were recruited to evaluate three different display concepts in a fixed-based flight simulator at the NASA Langley Research Center's General Aviation Work Station. Evaluation pilots were asked to continue flight from Visual Meteorological Conditions (VMC) into Instrument Meteorological Conditions (IMC) while performing a series of 4 basic precision maneuvers. During the experiment, relevant pilot/vehicle performance variables, pilot control inputs and physiological data were recorded. Human factors questionnaires and interviews were administered after each scenario. Qualitative and quantitative data have been analyzed and the results are presented here. Pilot performance deviations from the established target values (errors) were computed and compared with the FAA Practical Test Standards. Results of the quantitative data indicate that evaluation pilots committed substantially fewer errors when using the Synthetic Vision Systems (SVS) displays than when they were using conventional instruments. Results of the qualitative data indicate that evaluation pilots perceived themselves to have a much higher level of situation awareness while using the SVS display concept.

Degradation of learned skills: Effectiveness of practice methods on visual approach and landing skill retention

NASA Technical Reports Server (NTRS)

Sitterley, T. E.; Zaitzeff, L. P.; Berge, W. A.

1972-01-01

Flight control and procedural task skill degradation, and the effectiveness of retraining methods were evaluated for a simulated space vehicle approach and landing under instrument and visual flight conditions. Fifteen experienced pilots were trained and then tested after 4 months either without the benefits of practice or with static rehearsal, dynamic rehearsal or with dynamic warmup practice. Performance on both the flight control and procedure tasks degraded significantly after 4 months. The rehearsal methods effectively countered procedure task skill degradation, while dynamic rehearsal or a combination of static rehearsal and dynamic warmup practice was required for the flight control tasks. The quality of the retraining methods appeared to be primarily dependent on the efficiency of visual cue reinforcement.

Dimensionality of Upper Elementary Mathematics Instruction: Exploring Factors across Two Observational Instruments

ERIC Educational Resources Information Center

Blazar, David; Braslow, David; Charalambous, Charalambos Y.

2015-01-01

Over the past several years, research teams have developed observational instruments to measure the quality of teachers' instructional practices. Instruments such as Framework for Teaching (FFT) and the Classroom Assessment Scoring System (CLASS) assess general teaching practices, including student-teacher interactions, behavior management, and…

Design and Development of the Aircraft Instrument Comprehension Program.

ERIC Educational Resources Information Center

Higgins, Norman C.

The Aircraft Instrument Comprehension (AIC) Program is a self-instructional program designed to teach undergraduate student pilots to read instruments that indicate the position of the aircraft in flight, based on sequential instructional stages of information, prompted practice, and unprompted practice. The program includes a 36-item multiple…

Bicultural identity among economical migrants from three south European countries living in Switzerland. Adaptation and validation of a new psychometric instrument

PubMed Central

Eytan, Ariel; Jene-Petschen, Nuria; Gex-Fabry, Marianne

2007-01-01

Background Acculturation is one of the determinants of mental health among immigrants. Evaluating adaptation to the host culture is insufficient, since immigrants will develop various degrees of bi- or multicultural identity. However, mental health professionals lack simple and easy to use instruments to guide them with bicultural identity evaluation in their practice. Our aim was to develop such an instrument to be used for clinical purposes among economical migrants from three South European countries living in Geneva, Switzerland. Methods We adapted from existing instruments a 24 item bi-dimensional scale to assess involvement in both culture of origin and host culture. The study included 93 immigrant adults from three south European countries (Italy, Portugal and Spain). Thirty-eight patients were recruited in an outpatient treatment program for alcohol-related problems and 55 participants were hospital employees. Results The questionnaire was rated as easy or rather easy by 97.8% of participants. Median time to complete it was 5 minutes. The instrument allowed discriminating between patients and healthy subjects, with scores for Swiss culture significantly higher among hospital workers. The subscales related to culture of origin and host culture displayed adequate internal consistency (Cronbach's alpha 0.77 and 0.73 respectively). Conclusion It is possible to assist clinicians' assessment of cultural identity of Italian, Portuguese and Spanish economical immigrants in Switzerland with a single and easy to use instrument. PMID:17490478

Reinforcing Cultural Competency Concepts During Introductory Pharmacy Practice Experiences

PubMed Central

Caligiuri, Frank J

2010-01-01

Objectives To incorporate cultural competency concepts into various introductory pharmacy practice experiences (IPPE) at the University of Missouri - Kansas City, School of Pharmacy. Design A 6-week series, titled “Becoming a Culturally Competent Provider” was developed to provide IPPE students with the opportunity to apply theory regarding cultural competency in a clinical context. Assessment Pre- and post-intervention attitude survey instruments were administered to 25 students in the spring semester of 2009. Several activities within the series were associated with reflection exercises. Student presentations were evaluated and formal feedback was provided by faculty members. A course evaluation was administered to evaluate the series and determine areas of improvement. Conclusion A special series on cultural competency resulted in positive changes in students' attitudes, highlighting the importance of reinforcing cultural competency concepts during IPPEs. PMID:21088735

Process Skill Assessment Instrument: Innovation to measure student’s learning result holistically

NASA Astrophysics Data System (ADS)

Azizah, K. N.; Ibrahim, M.; Widodo, W.

2018-01-01

Science process skills (SPS) are very important skills for students. However, the fact that SPS is not being main concern in the primary school learning is undeniable. This research aimed to develop a valid, practical, and effective assessment instrument to measure student’s SPS. Assessment instruments comprise of worksheet and test. This development research used one group pre-test post-test design. Data were obtained with validation, observation, and test method to investigate validity, practicality, and the effectivenss of the instruments. Results showed that the validity of assessment instruments is very valid, the reliability is categorized as reliable, student SPS activities have a high percentage, and there is significant improvement on student’s SPS score. It can be concluded that assessment instruments of SPS are valid, practical, and effective to be used to measure student’s SPS result.

The impact of problem-based learning on students' perceptions of preparedness for advanced pharmacy practice experiences.

PubMed

Hogan, Shirley; Lundquist, Lisa M

2006-08-15

To evaluate graduating pharmacy students' perceptions of their preparedness for advanced pharmacy practice experiences and the effectiveness of problem-based learning in their preparation. A survey instrument was administered anonymously in May 2004 and May 2005 to graduating pharmacy students of the University of Mississippi School of Pharmacy. Students reported that the areas in which problem-based learning prepared them most effectively for advanced pharmacy practice experiences were retrieval of medical information (80%), discussion of disease states and drug therapies at the basic science level (56%), and evaluation of the appropriateness of a medication regimen based on patient specific information (50%). Areas in which students reported being inadequately prepared included identifying and utilizing drug assistance programs (42%) and processing prescriptions/hospital orders (40%). Data from 2 consecutive graduating classes supports that problem-based learning is an effective format for preparing pharmacy students for advanced pharmacy practice experiences in a variety of areas.

Comparative evaluation of cyclic fatigue resistance of four different nickel-titanium rotary files with different cross-sectional designs and alloy properties.

PubMed

Kaval, Mehmet Emin; Capar, Ismail Davut; Ertas, Hüseyin; Sen, Bilge Hakan

2017-06-01

The purpose of the present study was to evaluate the cyclic fatigue resistance of F6 SkyTaper (Komet Brasseler, Lemgo, Germany), K3XF (SybronEndo, Orange, CA, USA), new generation OneShape (Micro Mega, Besancon, France) and TRUShape 3D conforming files (Dentsply Tulsa Dental Specialties, Tulsa, OK, USA). Ten instruments from each group were selected and allowed to rotate using a low-torque motor in a stainless steel block with 1.5 mm diameter, 3 mm radius of 60° angle of curvature at the manufacturer's recommended speed, and the number of cycles (NCF) from the beginning to the fracture was recorded. The data were analyzed using one-way ANOVA followed by post-hoc Tukey's test (P = 0.05). The ranking of the groups from the highest to the lowest NCF was as follows: F6 SkyTaper (959 ± 92), K3XF (725 ± 71), TRUShape (575 ± 84) and OneShape (289 ± 58). Statistically significant differences were detected between all groups (P < 0.05). Within the limitations of this study, F6 SkyTaper instruments presented the highest cyclic fatigue resistance among the tested instruments. The S-shaped cross-sectional design of F6 SkyTaper instruments could be the most important factor on the superior cyclic life span of these instruments. In endodontic practice, preferring the instruments with higher cyclic fatigue resistance would help to minimize the risk of instrument fractures; therefore especially during the preparation of curved canals, instruments with smaller core area and less cross-sectional metal mass, which could lead higher flexibility, can be proposed.

QNOTE: an instrument for measuring the quality of EHR clinical notes.

PubMed

Burke, Harry B; Hoang, Albert; Becher, Dorothy; Fontelo, Paul; Liu, Fang; Stephens, Mark; Pangaro, Louis N; Sessums, Laura L; O'Malley, Patrick; Baxi, Nancy S; Bunt, Christopher W; Capaldi, Vincent F; Chen, Julie M; Cooper, Barbara A; Djuric, David A; Hodge, Joshua A; Kane, Shawn; Magee, Charles; Makary, Zizette R; Mallory, Renee M; Miller, Thomas; Saperstein, Adam; Servey, Jessica; Gimbel, Ronald W

2014-01-01

The outpatient clinical note documents the clinician's information collection, problem assessment, and patient management, yet there is currently no validated instrument to measure the quality of the electronic clinical note. This study evaluated the validity of the QNOTE instrument, which assesses 12 elements in the clinical note, for measuring the quality of clinical notes. It also compared its performance with a global instrument that assesses the clinical note as a whole. Retrospective multicenter blinded study of the clinical notes of 100 outpatients with type 2 diabetes mellitus who had been seen in clinic on at least three occasions. The 300 notes were rated by eight general internal medicine and eight family medicine practicing physicians. The QNOTE instrument scored the quality of the note as the sum of a set of 12 note element scores, and its inter-rater agreement was measured by the intraclass correlation coefficient. The Global instrument scored the note in its entirety, and its inter-rater agreement was measured by the Fleiss κ. The overall QNOTE inter-rater agreement was 0.82 (CI 0.80 to 0.84), and its note quality score was 65 (CI 64 to 66). The Global inter-rater agreement was 0.24 (CI 0.19 to 0.29), and its note quality score was 52 (CI 49 to 55). The QNOTE quality scores were consistent, and the overall QNOTE score was significantly higher than the overall Global score (p=0.04). We found the QNOTE to be a valid instrument for evaluating the quality of electronic clinical notes, and its performance was superior to that of the Global instrument. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Psychometric Evaluation of a Cultural Competency Assessment Instrument for Health Professionals

PubMed Central

Haywood, Sonja H.; Goode, Tawara; Gao, Yong; Smith, Kristyn; Bronheim, Suzanne; Flocke, Susan A; Zyzanski, Steve

2012-01-01

Background Few valid and reliable measures exist for health care professionals interested in determining their levels of cultural and linguistic competence. Objective To evaluate the measurement properties of the Cultural Competence Health Practitioner Assessment (CCHPA-129). Methods The CCHPA-129 is a 129-item web-based instrument, developed by the National Center for Cultural Competence (NCCC). Responses on the CCHPA -129 were examined using factor analysis; Rasch modeling; and Differential Item Functioning (DIF) across race, ethnicity, gender, and profession. Subjects 2504 practitioners, including 1864 nurses (RN/LPN,/BSN); 341 clinicians (PA/NP); and 299 physicians (MD/DO), who completed the CCHPA-129 online between 2005 and 2008. Results Three factors representing domains of knowledge, adapting practice, and promoting health for culturally and linguistically diverse populations accounted for 46% of the variance. Among Knowledge factor items, 53% (23/43) fit the Rasch model, item difficulties ranged from −1.01 logits (least difficult) to +1.11 logits (most difficult), separation index (SI) 13.82, and Cronbach’s α 0.92. Forty-seven percent (21/44) Adapting Practice factor items fit the model, item difficulties −0.07 to +1.11 logits, SI 11.59, Cronbach’s α 0.88; and 58% (23/39). Promoting Health factor items fit the model, item difficulties −1.01 to +1.38 logits, SI 22.64, Cronbach’s α 0.92. Early evidence of validity was established by known groups having statistically different scores. Conclusion The 67-item CCHPA-67 is psychometrically sound. This shorted instrument can be used to establish associations between practitioners’ cultural and linguistic competence and health outcomes as well as to evaluate interventions to increase practitioners’ cultural and linguistic competence. PMID:22437625

An instrument for assessment of videotapes of general practitioners' performance.

PubMed Central

Cox, J; Mulholland, H

1993-01-01

OBJECTIVES--To identify those important characteristics of doctors' and patients' behaviour that distinguish between "good" and "bad" consultations when viewed on videotape; to use these characteristics to develop a reliable instrument for assessing general practitioners' performance in their own consultations. DESIGN--Questionnaires completed by patients, general practitioner trainers, and general practitioner trainees. Reliability of draft instrument tested by general practitioner trainers. SETTING--All vocational training schemes for general practice in the Northern region of England. SUBJECTS--First stage: 76 patients in seven groups, 108 general practice trainers in 12 groups, and 122 general practice trainees in 10 groups. Second stage: 85 general practice trainers in 12 groups. MAIN OUTCOME MEASURES--Trainers' ratings of importance; alpha coefficients of draft instrument by trainee, group, and consultation. RESULTS--6890 characteristics of good and bad consultations were consolidated into a draft assessment instrument consisting of 46 pairs of definitions separated by six point bipolar scales. Nine statement pairs given low importance ratings by trainers were eliminated, reducing the instrument to 37 statement pairs. To test reliability, general practitioner trainers used the instrument to assess three consultations. With the exception of one group of trainers, all alpha coefficients exceeded the acceptable level of 0.80. CONCLUSION--The instrument produced is reliable for assessing general practitioners' performance in their own consultations. PMID:8490501

Occupational therapy practitioners' perceptions of important competencies for handwriting evaluation and intervention in school-aged children.

PubMed

Giroux, Peter; Woodall, William; Weber, Mark; Bailey, Jessica

2012-02-01

The primary purpose of this study was to identify the practitioner competencies that occupational therapists perceive as important for handwriting evaluation and intervention in school-aged children. A secondary purpose was to compare the practitioner perceptions of those in school-based practice with those from other primary practice settings. A stratified random sample of 376 occupational therapists recruited from a national professional organization database participated by completing a survey instrument containing 80 competency items. A majority of the 80 practitioner competency items were perceived to be of high importance to the respondent groups. A significance difference in perception when comparing the school-based practitioners to all other practitioners was revealed in only 3-12 competency summary categories. Practitioner competency survey items were perceived to be of high importance to the participants. School-based practitioner perceptions of competency were, for the most part, mainly similar to those in other primary practice settings.

[The tinnitus questionnaire. A standard instrument for grading the degree of tinnitus. Results of a multicenter study with the tinnitus questionnaire].

PubMed

Goebel, G; Hiller, W

1994-03-01

The clinical examination of patients with severe and chronic tinnitus must include associated psychological disturbances. The present paper describes traditional diagnostic methods of ENT practice as well as the Tinnitus Questionnaire (TQ) which has been evaluated in a number of studies. This instrument differentiates between emotional and cognitive distress, auditory perceptual difficulties and self-experienced intrusiveness produced by the tinnitus. The results of a German multicenter study are presented which show that the TQ can be used to demonstrate differences of tinnitus distress under different clinical conditions (e.g., ENT clinic vs psychosomatic clinic and in- vs out-patient care). The TQ can be employed for comparative studies in different tinnitus-related institutions and for the evaluation of the relative effects of different treatment approaches.

Nuclear medicine and imaging research (instrumentation and quantitative methods of evaluation): Comprehensive 3-year progress report for the period January 15, 1986-January 14, 1989

DOE Office of Scientific and Technical Information (OSTI.GOV)

Beck, R.N.; Cooper, M.D.

1988-06-01

This program addresses the problems involving the basic science and technology underlying the physical and conceptual tools of radioactive tracer methodology as they relate to the measurement of structural and functional parameters of physiologic importance in health and disease. The principal tool is quantitative radionuclide imaging. The overall objective of this program is to further the development and transfer of radiotracer methodology from basic theory to routine clinical practice in order that individual patients and society as a whole will receive the maximum net benefit from the new knowledge gained. The focus of the research is on the development ofmore » new instruments and radiopharmaceuticals, and the evaluation of these through the phase of clinical feasibility. 58 refs., 15 figs., 4 tabs.« less

Instrument performance of a radon measuring system with the alpha-track detection technique.

PubMed

Tokonami, S; Zhuo, W; Ryuo, H; Yonehara, H; Yamada, Y; Shimo, M

2003-01-01

An instrument performance test has been carried out for a radon measuring system made in Hungary. The system measures radon using the alpha-track detection technique. It consists of three parts: the passive detector, the etching unit and the evaluation unit. A CR-39 detector is used as the radiation detector. Alpha-track reading and data analysis are carried out after chemical etching. The following subjects were examined in the present study: (1) radon sensitivity, (2) performance of etching and evaluation processes and (3) thoron sensitivity. The radon sensitivity of 6.9 x 10(-4) mm(-2) (Bq m(-3) d)(-1) was acceptable for practical application. The thoron sensitivity was estimated to be as low as 3.3 x 10(-5) mm(-2) (Bq m(-3) d)(-1) from the experimental study.

[Measuring Participation - Discussion of the Theoretical Foundations of Current Assessment Instruments].

PubMed

Gebhard, B; Fink, A

2015-09-01

For children and adolescents social participation is a central goal of rehabilitation processes. Available measurements and evaluation tools are exposed to the problem that the theoretical foundation of the construct of participation is still unclear as well as differentiation from activity in the International Classification of Functioning, Disabilities and Health (ICF/ICF-CY) of the WHO is not made sufficiently. The objectives of this article were (1) to illustrate the scientific discussions on the term and understanding of participation from rehabilitation science perspectives and (2) to conclude implications for practice and science. A systematic search for participation instruments was performed in MEDLINE, CINAHL, PsycINFO, ERIC und EMBASE in August 2014. The available instruments are based on very different definitions of participation. The discussion about the term seems to be not yet complete. A major demand is a better operationalization of activity and participation according to the ICF/ICF-CY in the instruments. Before using an existing instrument, the transferability should be tested for the own context. The theoretical assumptions of participation in conjunction to ICF/ICF-CY as well as the objectives of the instrument should all be clearly understood before using an existing instrument but also before the development of new instruments. © Georg Thieme Verlag KG Stuttgart · New York.

Importance Has Been Considered in Satisfaction Evaluation: An Experimental Examination of Locke's Range-of-Affect Hypothesis

ERIC Educational Resources Information Center

Wu, Chia-huei; Yao, Grace

2007-01-01

Importance weighting is a common practice in quality of life (QOL) measurement research. Based on the widespread idea that important domains should make a greater contribution to individuals' QOL total score, the weighting procedure of multiplying item satisfaction by an item's importance has been adopted in many QOL instruments. Locke's [1969,…

How Measurement Characteristics Can Affect ECERS-R Scores and Program Funding

ERIC Educational Resources Information Center

Hofer, Kerry G.

2010-01-01

This project involved examining the most widely used instrument designed to evaluate the quality of early learning environments, the Early Childhood Environment Rating Scale-Revised Edition (ECERS-R). There are many aspects related to the way that the ECERS-R is used in practice that can vary from one observation to the next. The method in which…

Continuous Inquiry Meets Continued Critique: The Professional Learning Community in Practice and the Resistance of (Un)Willing Participants

ERIC Educational Resources Information Center

Elbousty, Youness; Bratt, Kirstin

2010-01-01

The term Professional Learning Community is commonplace, and it holds many meanings and suggestions. For the purpose of this essay, however, we discuss a specific Professional Learning Community (PLC) that was established in a high school, fifteen months prior to the application of a survey instrument to evaluate participants' perceptions on the…

Oral Health Knowledge, Past Oral Health Behaviors, and Barriers to Preventive Oral Care of Head Start Parents

ERIC Educational Resources Information Center

Knowlden, Adam P.; Hill, Lawrence F.; Alles-White, Monica L.; Cottrell, Randall R.

2012-01-01

Tooth decay remains the most common chronic disease of childhood. The CincySmiles Foundation (CSF) developed an instrument to evaluate Head Start parents' knowledge of oral health care practices and to identify barriers Head Start parents face when seeking dental treatment for their children. Data from Head Start parents (n = 675) across 3…

Implementation of an Electronic Health Records System in a Small Clinic: The Viewpoint of Clinic Staff

ERIC Educational Resources Information Center

Carayon, Pascale; Smith, Paul; Hundt, Ann Schoofs; Kuruchittham, Vipat; Li, Qian

2009-01-01

In this study, we examined the implementation of an electronic health records (EHR) system in a small family practice clinic. We used three data collection instruments to evaluate user experience, work pattern changes, and organisational changes related to the implementation and use of the EHR system: (1) an EHR user survey, (2) interviews with…

Validation Study of the Scale for "Assessment of the Teaching-Learning Process", Student Version (ATLP-S)

ERIC Educational Resources Information Center

de la Fuente, Jesus; Sander, Paul; Justicia, Fernando; Pichardo, M. Carmen; Garcia-Berben, Ana B.

2010-01-01

Introduction: The main goal of this study is to evaluate the psychometric and assessment features of the Scale for the "Assessment of the Teaching-Learning Process, Student Version" (ATLP-S), for both practical and theoretical reasons. From an applied point of view, this self-report measurement instrument has been designed to encourage…

Development of an Instrument to Measure Students' Attitudes towards Piano Practice

ERIC Educational Resources Information Center

Umuzdas, Mehmet Serkan

2015-01-01

Practicing the piano is a systematic part of the instrument-learning process. It contains all development practices from the analysis of the work to the improvement of performance. Students usually practice the piano as a preparation for performing in courses, exams, or on stage and they do it individually. The mentality which emerges during the…

[Measurement and health economic evaluation of informal care].

PubMed

Zrubka, Zsombor

2017-09-01

Informal care is non-financed care outside the realm of formal healthcare, which represents an increasing challenge for aging societies. Informal care has frequently been neglected in health economic analyses, while in recent years its coverage has increased considerably in the international scientific literature. This review summarizes the methodology of the health-economic assessment of informal care, including the objective and subjective metrics of caregiver burden, its financial and non-financial valuation and practical applications, with special emphasis on the introduction of care-related quality of life instruments (e.g. Care Related Quality of Life - CarerQoL instrument). Care-related quality of life is a different entity from health-related quality of life, the two cannot be combined, so their joint evaluation requires multi-criteria decision analysis methods. Therefore, it is important to determine the societal preferences of care-related quality of life versus health-related quality of life, and map the relationship of care-related quality of life with time. The local validation of tools measuring care-related quality of life, its more widespread practical application and the analysis of its effect on decision making are also important part of the future research agenda. Orv Hetil. 2017; 158(35): 1363-1372.

The Conceptualization and Development of the Practical Epistemology in Science Survey (PESS)

NASA Astrophysics Data System (ADS)

Villanueva, Mary Grace; Hand, Brian; Shelley, Mack; Therrien, William

2017-08-01

Various inquiry approaches have been promoted in science classrooms as a way for students to engage in, and have a deeper understanding of scientific discourse. However, there is a paucity of empirical evidence to suggest how children's actions and engagement in these approaches, or practical epistemologies (Sandoval, Science Education 89(4): 634-656, 2005), may contribute to the development of their personal epistemologies, or their views about the nature of knowledge and knowing and the nature of learning. This paper puts forth the conceptualization and development of the Practical Epistemology in Science Survey (PESS) instrument, a 26-item Likert-scale self-assessment which measures how students view their individual and social participation in the classroom scientific community. Data were collected from 4th-6th-grade students (n = 1019) in the USA and a psychometric evaluation of the reliability, validity, and dimensionality of the instrument was conducted. The Cronbach's alpha value indices for all subsets of items of the PESS suggest a strong reliability of the instrument (α ≥ .80). The development of the PESS may be useful in science education research to (a) detect changes to students' beliefs about knowledge and knowledge development; (b) identify dispositions and beliefs which may or may not be in line with the aims and values of various pedagogical approaches; (c) monitor the process of change, e.g., time it takes for students to change their approaches and beliefs with respect to teacher practice; and, (d) overall, to provide an understanding of how students' formal epistemologies are developed and informed by the affordances in science classrooms.

Adaptation of a nursing home culture change research instrument for frontline staff quality improvement use.

PubMed

Hartmann, Christine W; Palmer, Jennifer A; Mills, Whitney L; Pimentel, Camilla B; Allen, Rebecca S; Wewiorski, Nancy J; Dillon, Kristen R; Snow, A Lynn

2017-08-01

Enhanced interpersonal relationships and meaningful resident engagement in daily life are central to nursing home cultural transformation, yet these critical components of person-centered care may be difficult for frontline staff to measure using traditional research instruments. To address the need for easy-to-use instruments to help nursing home staff members evaluate and improve person-centered care, the psychometric method of cognitive-based interviewing was used to adapt a structured observation instrument originally developed for researchers and nursing home surveyors. Twenty-eight staff members from 2 Veterans Health Administration (VHA) nursing homes participated in 1 of 3 rounds of cognitive-based interviews, using the instrument in real-life situations. Modifications to the original instrument were guided by a cognitive processing model of instrument refinement. Following 2 rounds of cognitive interviews, pretesting of the revised instrument, and another round of cognitive interviews, the resulting set of 3 short instruments mirrored the concepts of the original longer instrument but were significantly easier for frontline staff to understand and use. Final results indicated frontline staff found the revised instruments feasible to use and clinically relevant in measuring and improving the lived experience of a changing culture. This article provides a framework for developing or adapting other measurement tools for frontline culture change efforts in nursing homes, in addition to reporting on a practical set of instruments to measure aspects of person-centered care. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Measures of upper limb function for people with neck pain: a systematic review of measurement and practical properties (protocol).

PubMed

Alreni, Ahmad Salah Eldin; Harrop, Deborah; Gumber, Anil; McLean, Sionnadh

2015-04-07

Upper limb disability is a common musculoskeletal condition frequently associated with neck pain. Recent literature has reported the need to utilise validated upper limb outcome measures in the assessment and management of patients with neck pain. However, there is a lack of clear guidance about the suitability of available measures, which may impede utilisation. This review will identify all available measures of upper limb function developed for use in neck pain patients and evaluate their measurement and practical properties in order to identify those measures that are most appropriate for use in clinical practice and research. This review will be performed in two phases. Phase one will identify all measures used to assess upper limb function for patients with neck pain. Phase two will identify all available studies of the measurement and practical properties of identified instrument. The COnsensus-based Standards for selection of health Measurement INstrument (COSMIN) will be used to evaluate the methodological quality of the included studies. To ensure methodological rigour, the findings of this review will be reported in accordance with the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) guideline. Optimal management of patients with neck pain should incorporate upper limb rehabilitation. The findings of this study will assist clinicians who seek to utilise suitable and accurate measures to assess upper limb function for a patient with neck pain. In addition, the findings of this study may suggest new research directions to support the development of upper limb outcome measures for patients with neck pain. PROSPERO CRD42015016624.

Nurses' assessments and patients' perceptions: development of the Night Nursing Care Instrument (NNCI), measuring nursing care at night.

PubMed

Johansson, Peter; Oléni, Magnus; Fridlund, Bengt

2005-07-01

Nursing care provided at night has a different purpose and objective to that provided during the day. A review of the literature does not reveal any scientifically tested research instruments for evaluating and comparing the nurse's assessment of nursing care with the patient's perception at night. The aim of this study was to develop and test an instrument for evaluating nursing care and to compare nurses' assessments with patients' perceptions of nursing care provided at night. The study was carried out in two phases; the first had an explorative design and the second an evaluative and comparative design. The Night Nursing Care Instrument (NNCI) included two questionnaires; one for nurses and one for patients. These questionnaires were developed from a nursing framework and covered the following three areas: 'nursing interventions', 'medical interventions' and 'evaluation'. Nurses (n = 40) on night duty on a medical ward at a central hospital in southern Sweden were consecutively selected, to participate in the study. The patients (n = 80) were selected by means of convenience sampling. In order to achieve construct validity, factor analysis of each individual area was carried out. Reliability in terms of internal consistency was tested by Cronbach's alpha. The overall NNCI had acceptable reliability and validity. There was no statistically significant difference between nurses' assessments and patients' perceptions in any of the three areas of 'nursing interventions', 'medical interventions' or 'evaluation'. The patients rated night nursing care as satisfactory for the majority of the items. These findings demonstrate that it is possible to create a short instrument with acceptable reliability and validity, which is easy to use in clinical practice. The results also show that night nurses need to improve their ability to assess patients' needs during the night to increase the quality of night nursing care.

Three common faults in current practice that influence the validity of data obtained from electronic air pollution instrumentation.

PubMed

Dowd, G; Thomas, R S; Monkman, J L

1975-01-01

Instrumental development is now entering a more logical era, where the former artistic character of electronics is being replaced by cold technology. Because of this, one should be expect more reliability; however, there still exist many weak links in practical application. Digital readout systems and computer processing induce a false sense of security. In reality, it is the sample-measurement relationship that determines an instrument's credibility and not the number of digits on its meter. In describing three faulty practices that greatly influence an instrument's performance, it is hoped that measurement may be more closely related to the sample!

Competence evaluation processes for nursing students abroad: Findings from an international case study.

PubMed

Tommasini, Cristina; Dobrowolska, Beata; Zarzycka, Danuta; Bacatum, Claudia; Bruun, Anne Marie Gran; Korsath, Dag; Roel, Siv; Jansen, Mette Bro; Milling, Tine; Deschamps, Anne; Mantzoukas, Stefanos; Mantzouka, Christine; Palese, Alvisa

2017-04-01

Assessing clinical competence in nursing students abroad is a challenge, and requires both methods and instruments capable of capturing the multidimensional nature of the clinical competences acquired. The aim of the study was to compare the clinical competence assessment processes and instruments adopted for nursing students during their clinical placement abroad. A case study design was adopted in 2015. A purposeful sample of eight nursing programmes located in seven countries (Belgium, Denmark, Greece, Norway, Poland, Portugal and Italy) were approached. Tools as instruments for evaluating competences developed in clinical training by international nursing students, and written procedures aimed at guiding the evaluation process, were scrutinised through a content analysis method. All clinical competence evaluation procedures and instruments used in the nursing programmes involved were provided in English. A final evaluation of the competences was expected by all nursing programmes at the end of the clinical placement, while only four provided an intermediate evaluation. Great variability emerged in the tools, with between five and 88 items included. Through content analysis, 196 items emerged, classified into 12 different core competence categories, the majority were categorised as 'Technical skills' (=60), 'Self-learning and critical thinking' (=27) and 'Nursing care process' (=25) competences. Little emphasis was given in the tools to competences involving 'Self-adaptation', 'Inter-professional skills', 'Clinical documentation', 'Managing nursing care', 'Patient communication', and 'Theory and practice integration'. Institutions signing Bilateral Agreements should agree upon the competences expected from students during their clinical education abroad. The tools used in the process, as well as the role expected by the student, should also be agreed upon. Intercultural competences should be further addressed in the process of evaluation, in addition to adaptation to different settings. There is also a need to establish those competences achievable or not in the host country, aiming at increasing transparency in learning expectations and evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

The development and psychometric validation of an instrument to evaluate nurses' attitudes towards communication with the patient (ACO).

PubMed

Giménez-Espert, María Del Carmen; Prado-Gascó, Vicente Javier

2018-05-01

Patient communication is a key skill for nurses involved in clinical care. Its measurement is a complex phenomenon that can be addressed through attitude evaluation. To develop and psychometrically test a measure of nurses' attitudes towards communication with patients (ACO), to study the relationship between these dimensions, and to analyse nursing attitudes. To develop and psychometrically test the ACO questionnaire. All hospitals in the province of Valencia were invited by e-mail to distribute the ACO instrument. Ten hospitals took part in the study. The study population was composed of a convenience sample of 400 hospital nurses on general or special services. The inclusion criteria were nurses at the selected centres who had previously provided an informed consent to participate. A literature review and expert consultation (N = 10) was used to develop the content of the questionnaire. The 62-item version of the instrument was applied to a convenience sample of 400 nurses between May 2015 and March 2016. Factor structure was evaluated with exploratory and confirmatory factor analysis (EFA, CFA), and reliability was evaluated with Cronbach's alpha, composite reliability (CR), and average variance extracted (AVE). The final instrument (ACO), composed of 25 items grouped into three attitude dimensions (cognitive, affective and behavioural), had good psychometric properties. In the study sample, nurses had a favourable attitude towards communication. The cognitive and affective dimensions of the ACO should be able to predict the behaviour dimension. The ACO is useful for evaluating current clinical practices, identifying educational needs and assessing the effectiveness of communication training or other interventions intended to improve communication. Copyright © 2018 Elsevier Ltd. All rights reserved.

Validation of a method for assessing resident physicians' quality improvement proposals.

PubMed

Leenstra, James L; Beckman, Thomas J; Reed, Darcy A; Mundell, William C; Thomas, Kris G; Krajicek, Bryan J; Cha, Stephen S; Kolars, Joseph C; McDonald, Furman S

2007-09-01

Residency programs involve trainees in quality improvement (QI) projects to evaluate competency in systems-based practice and practice-based learning and improvement. Valid approaches to assess QI proposals are lacking. We developed an instrument for assessing resident QI proposals--the Quality Improvement Proposal Assessment Tool (QIPAT-7)-and determined its validity and reliability. QIPAT-7 content was initially obtained from a national panel of QI experts. Through an iterative process, the instrument was refined, pilot-tested, and revised. Seven raters used the instrument to assess 45 resident QI proposals. Principal factor analysis was used to explore the dimensionality of instrument scores. Cronbach's alpha and intraclass correlations were calculated to determine internal consistency and interrater reliability, respectively. QIPAT-7 items comprised a single factor (eigenvalue = 3.4) suggesting a single assessment dimension. Interrater reliability for each item (range 0.79 to 0.93) and internal consistency reliability among the items (Cronbach's alpha = 0.87) were high. This method for assessing resident physician QI proposals is supported by content and internal structure validity evidence. QIPAT-7 is a useful tool for assessing resident QI proposals. Future research should determine the reliability of QIPAT-7 scores in other residency and fellowship training programs. Correlations should also be made between assessment scores and criteria for QI proposal success such as implementation of QI proposals, resident scholarly productivity, and improved patient outcomes.

[Controlling instruments in radiology].

PubMed

Maurer, M

2013-10-01

Due to the rising costs and competitive pressures radiological clinics and practices are now facing, controlling instruments are gaining importance in the optimization of structures and processes of the various diagnostic examinations and interventional procedures. It will be shown how the use of selected controlling instruments can secure and improve the performance of radiological facilities. A definition of the concept of controlling will be provided. It will be shown which controlling instruments can be applied in radiological departments and practices. As an example, two of the controlling instruments, material cost analysis and benchmarking, will be illustrated.

Implementing a routine outcome assessment procedure to evaluate the quality of assistive technology service delivery for children with physical or multiple disabilities: Perceived effectiveness, social cost, and user satisfaction.

PubMed

Desideri, Lorenzo; Bizzarri, Martina; Bitelli, Claudio; Roentgen, Uta; Gelderblom, Gert-Jan; de Witte, Luc

2016-01-01

There is a lack of evidence on the effects and quality of assistive technology service delivery (ATSD). This study presents a quasi-experimental 3-months follow-up using a pre-test/post-test design aimed at evaluating outcomes of assistive technology (AT) interventions targeting children with physical and multiple disabilities. A secondary aim was to evaluate the feasibility of the follow-up assessment adopted in this study with a view to implement the procedure in routine clinical practice. Forty-five children aged 3-17 years were included. Parents were asked to complete the Individual Prioritised Problem Assessment (IPPA) for AT effectiveness; KWAZO (Kwaliteit van Zorg [Quality of Care]) and Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST) 2.0 for satisfaction with ATSD; Siva Cost Analysis Instrument (SCAI) for estimating the social cost of AT interventions. At follow-up, 25 children used the AT recommended. IPPA effect sizes ranged from 1.4 to 0.7, showing a large effect of AT interventions. Overall, parents were satisfied with ATSD, but Maintenance, Professional Services, and AT Delivery were rated not satisfactory. SCAI showed more resources spent for AT intervention compared to human assistance without technological supports. AT may be an effective intervention for children with disabilities. Issues concerning responsiveness and feasibility of the IPPA and the SCAI instruments are discussed with a view to inform routine clinical practice.

Clinical assessment of the physical activity pattern of chronic fatigue syndrome patients: a validation of three methods.

PubMed

Scheeres, Korine; Knoop, Hans; Meer, van der Jos; Bleijenberg, Gijs

2009-04-01

Effective treatment of chronic fatigue syndrome (CFS) with cognitive behavioural therapy (CBT) relies on a correct classification of so called 'fluctuating active' versus 'passive' patients. For successful treatment with CBT is it especially important to recognise the passive patients and give them a tailored treatment protocol. In the present study it was evaluated whether CFS patient's physical activity pattern can be assessed most accurately with the 'Activity Pattern Interview' (API), the International Physical Activity Questionnaire (IPAQ) or the CFS-Activity Questionnaire (CFS-AQ). The three instruments were validated compared to actometers. Actometers are until now the best and most objective instrument to measure physical activity, but they are too expensive and time consuming for most clinical practice settings. In total 226 CFS patients enrolled for CBT therapy answered the API at intake and filled in the two questionnaires. Directly after intake they wore the actometer for two weeks. Based on receiver operating characteristic (ROC) curves the validity of the three methods were assessed and compared. Both the API and the two questionnaires had an acceptable validity (0.64 to 0.71). None of the three instruments was significantly better than the others. The proportion of false predictions was rather high for all three instrument. The IPAQ had the highest proportion of correct passive predictions (sensitivity 70.1%). The validity of all three instruments appeared to be fair, and all showed rather high proportions of false classifications. Hence in fact none of the tested instruments could really be called satisfactory. Because the IPAQ showed to be the best in correctly predicting 'passive' CFS patients, which is most essentially related to treatment results, it was concluded that the IPAQ is the preferable alternative for an actometer when treating CFS patients in clinical practice.

The Philosophy of Practice for Comprehensive Medication Management: Evaluating Its Meaning and Application by Practitioners.

PubMed

Pestka, Deborah L; Sorge, Lindsay A; McClurg, Mary Roth; Sorensen, Todd D

2018-01-01

Philosophy of practice is the foundation of any patient care practice because it provides a set of professional values and beliefs that guide actions and decisions in practice. Study objectives were to understand how pharmacists providing comprehensive medication management (CMM) describe their philosophy of practice and compare how participants' philosophies align with predefined tenets of a CMM philosophy of practice. An instrument with closed and open-ended items was developed and administered online to the lead pharmacist at 36 clinics participating in a large CMM study. Participants were asked to describe their philosophy of practice, rate how well their current practice activities align with five predefined CMM philosophy of practice tenets, and provide examples of how they carry out each tenet and how they could improve. Responses were coded, and descriptive analysis was used to calculate participants' practice alignment with the five philosophy of practice tenets. Thirty pharmacists completed the instrument. Twelve codes emerged that participants used to describe their philosophy of practice. These codes were mapped to five predefined tenets of a philosophy of practice. Only 3 (10%) participants included all five tenets in their philosophy of practice, 8 (26.7%) included four, 8 (26.7%) included three, 6 (20%) included two, and 5 (16.7%) included one tenet. Overall, participants rated their alignment with the five tenets highly. "Embracing a patient-centered approach" received the highest mean score of 9.17/10; "Meeting a societal need" had the lowest mean score of 8.37/10. Participants described their philosophy of practice with significant variability. CMM requires a single and consistently applied philosophy of practice to guide practice and the role of the practitioner. We propose five core tenets that resulted from this assessment to be embraced by pharmacists providing CMM and included in their philosophy of practice. © 2017 Pharmacotherapy Publications, Inc.

Noncognitive constructs in graduate admissions: an integrative review of available instruments.

PubMed

Megginson, Lucy

2009-01-01

In the graduate admission process, both cognitive and noncognitive instruments evaluate a candidate's potential success in a program of study. Traditional cognitive measures include the Graduate Record Examination or graduate grade point average, while noncognitive constructs such as personality, attitude, and motivation are generally measured through letters of recommendation, interviews, or personality inventories. Little consensus exists as to what criteria constitute valid and effective measurements of graduate student potential. This integrative review of available tools to measure noncognitive constructs will assist graduate faculty in identifying valid and reliable instruments that will enhance a more holistic assessment of nursing graduate candidates. Finally, as evidence-based practice begins to penetrate academic processes and as graduate faculty realize the predictive significance of noncognitive attributes, faculty can use the information in this integrative review to guide future research.

Balancing Demands and Resources in Sport: Adaptation and Validation of the Demand-Induced Strain Compensation Questionnaire for Use in Sport.

PubMed

Balk, Yannick A; De Jonge, Jan; Oerlemans, Wido G M; Geurts, Sabine A E; Fletcher, David; Dormann, Christian

2018-06-01

Too high demands, combined with a lack of resources, are often detrimental to athletic health and well-being. However, a valid and reliable instrument to investigate different dimensions of demands and resources in sport is currently unavailable. Therefore, the present study examines the psychometric properties of an existing and well-validated survey instrument on demands and resources at task-level that was adapted to sport. This instrument, the Demand-Induced Strain Compensation Questionnaire for Sport (DISQ-SPORT), was empirically tested among 1,101 athletes (416 females and 685 males) from a variety of sports and in different languages. Results supported the proposed six-factor structure of the instrument, consisting of physical, cognitive, and emotional demands and resources. Internal consistencies of all subscales were satisfactory and the instrument was invariant across type of sport, competitive level and language. Continued evaluation of the psychometric properties of the DISQ-SPORT, especially in terms of content validity and test-retest stability, is nevertheless warranted. Theoretical and practical implications as well as areas for future research are discussed.

Evidence-Based Diagnosis: Incorporating Diagnostic Instruments into Clinical Practice

ERIC Educational Resources Information Center

Doss, Amanda Jensen

2005-01-01

This article is intended to serve as a practical guide for practitioners interested in incorporating evidence-based diagnosis (EBD) instruments into their clinical practices to refine the diagnostic process. Three measures are used to illustrate this process, the DISC-IV (Shaffer et al., 2000), the Schedule for Affective Disorders and…

The Practices of Existential Psychotherapists: Development and Application of an Observational Grid

ERIC Educational Resources Information Center

Correia, Edgar A.; Sartóris, Vítor; Fernandes, Tiago; Cooper, Mick; Berdondini, Lucia; Sousa, Daniel; Pires, Branca Sá; da Fonseca, João

2018-01-01

Within the major therapeutic paradigms, observational instruments have been developed to assess orientation-specific interventions or processes. However, to date, no such instrument exists to assess existential practices. Recent research indicates the key practices of existential therapists, and forms an empirical basis on which to develop an…

[Clinical Practice Guidelines for Management of Schizophrenia: Evaluation Using AGREE II].

PubMed

de la Hoz Bradford, Ana María; Ávila, Mauricio J; Bohórquez Peñaranda, Adriana Patricia; García Valencia, Jenny; Arenas Borrero, Álvaro Enrique; Vélez Traslaviña, Ángela; Jaramillo González, Luis Eduardo; Gómez-Restrepo, Carlos

2014-01-01

Colombia is developing multiple national practice guidelines from a range of diseases. Clinical practice guidelines represent a very useful tool to be able to take decision over a patient care that is widely available for the clinician. In psychiatry there are a good number of international clinical guidelines for the treatment of schizophrenia nevertheless there is no article that evaluate them scientifically In the settings of developing a Colombian schizophrenia practice guideline, a systematic search was performed in multiple databases and the results were then evaluated by two trained persons. We present the results globally and by domains. We found 164 matches for possible guidelines. After screening 7 guidelines were evaluated with the AGREE II instrument. Globally and by the different domains, the National Institute for Health and Care Excellence (NICE) was the guideline that got the best score. From the guidelines that were reviewed, 4 were from Europe and only 2 were from Latin America. None of the guidelines used GRADE methodology for the recommendations. The diversity of the schizophrenia treatment guidelines does not allow an easy adoption of the recommendation by a psychiatrist in Colombia. Copyright © 2014 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

Comparative study of root-canal shaping with stainless steel and rotary NiTi files performed by preclinical dental students.

PubMed

Alrahabi, Mothanna

2015-01-01

We evaluated the use of NiTi rotary and stainless steel endodontic instruments for canal shaping by undergraduate students. We also assessed the quality of root canal preparation as well as the occurrence of iatrogenic events during instrumentation. In total, 30 third-year dental students attending Taibah University Dental College prepared 180 simulated canals in resin blocks with NiTi rotary instruments and stainless steel hand files. Superimposed images were prepared to measure the removal of material at different levels from apical termination using the GSA image analysis software. Preparation time, procedural accidents, and canal shape after preparation were analyzed using χ 2 and t-tests. The statistical significance level was set at P < 0.05. There were significant differences in preparation time between NiTi instruments and stainless steel files; the former was associated with shorter preparation time, less ledge formation (1.1% vs. 14.4%), and greater instrument fracture (5.56% vs. 1.1%). These results indicate that NiTi rotary instruments result in better canal geometry and cause less canal transportation. Manual instrumentation using stainless steel files is safer than rotary instrumentation for inexperienced students. Intensive preclinical training is a prerequisite for using NiTi rotary instruments. These results prompted us to reconsider theoretical and practical coursework when teaching endodontics.

Exploration of the (Interrater) Reliability and Latent Factor Structure of the Alcohol Use Disorders Identification Test (AUDIT) and the Drug Use Disorders Identification Test (DUDIT) in a Sample of Dutch Probationers.

PubMed

Hildebrand, Martin; Noteborn, Mirthe G C

2015-01-01

The use of brief, reliable, valid, and practical measures of substance use is critical for conducting individual (risk and need) assessments in probation practice. In this exploratory study, the basic psychometric properties of the Alcohol Use Disorders Identification Test (AUDIT) and the Drug Use Disorders Identification Test (DUDIT) are evaluated. The instruments were administered as an oral interview instead of a self-report questionnaire. The sample comprised 383 offenders (339 men, 44 women). A subset of 56 offenders (49 men, 7 women) participated in the interrater reliability study. Data collection took place between September 2011 and November 2012. Overall, both instruments have acceptable levels of interrater reliability for total scores and acceptable to good interrater reliabilities for most of the individual items. Confirmatory factor analyses (CFA) indicated that the a priori one-, two- and three-factor solutions for the AUDIT did not fit the observed data very well. Principal axis factoring (PAF) supported a two-factor solution for the AUDIT that included a level of alcohol consumption/consequences factor (Factor 1) and a dependence factor (Factor 2), with both factors explaining substantial variance in AUDIT scores. For the DUDIT, CFA and PAF suggest that a one-factor solution is the preferred model (accounting for 62.61% of total variance). The Dutch language versions of the AUDIT and the DUDIT are reliable screening instruments for use with probationers and both instruments can be reliably administered by probation officers in probation practice. However, future research on concurrent and predictive validity is warranted.

Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship.

PubMed

Lyon, Aaron R; Cook, Clayton R; Brown, Eric C; Locke, Jill; Davis, Chayna; Ehrhart, Mark; Aarons, Gregory A

2018-01-08

A substantial literature has established the role of the inner organizational setting on the implementation of evidence-based practices in community contexts, but very little of this research has been extended to the education sector, one of the most common settings for the delivery of mental and behavioral health services to children and adolescents. The current study examined the factor structure, psychometric properties, and interrelations of an adapted set of pragmatic organizational instruments measuring key aspects of the organizational implementation context in schools: (1) strategic implementation leadership, (2) strategic implementation climate, and (3) implementation citizenship behavior. The Implementation Leadership Scale (ILS), Implementation Climate Scale (ICS), and Implementation Citizenship Behavior Scale (ICBS) were adapted by a research team that included the original scale authors and experts in the implementation of evidence-based practices in schools. These instruments were then administered to a geographically representative sample (n = 196) of school-based mental/behavioral health consultants to assess the reliability and structural validity via a series of confirmatory factor analyses. Overall, the original factor structures for the ILS, ICS, and ICBS were confirmed in the current sample. The one exception was poor functioning of the Rewards subscale of the ICS, which was removed in the final ICS model. Correlations among the revised measures, evaluated as part of an overarching model of the organizational implementation context, indicated both unique and shared variance. The current analyses suggest strong applicability of the revised instruments to implementation of evidence-based mental and behavioral practices in the education sector. The one poorly functioning subscale (Rewards on the ICS) was attributed to typical educational policies that do not allow for individual financial incentives to personnel. Potential directions for future expansion, revision, and application of the instruments in schools are discussed.

Development and evaluation of an instrument to measure community pharmacists' self-efficacy beliefs about communicating with Spanish-speaking patients.

PubMed

Young, Henry N; Hwang, Monica J; Dilworth, Thomas J; Mott, David; Cox, Elizabeth D; Moreno, Megan A

2011-12-01

Hispanics are the largest growing population in the United States, and their use of prescription medications can be influenced by the education and counseling they receive from pharmacists. However, little is known about pharmacists' communication with patients who speak Spanish or factors that can influence such communication. The objective of the study was to develop and validate an instrument to measure pharmacists' self-efficacy in communicating with Spanish-speaking patients. An initial pool of 15 items developed from previous research and suggestions from communication experts and practicing pharmacists was subjected to cognitive interviewing. Nine retained items were administered to 1022 licensed pharmacists by mail survey. Summary statistics and exploratory factor analysis (EFA) were conducted. Retained factors were determined by the examination of eigenvalues and scree test results. Cronbach's alpha coefficients were calculated to assess internal consistency. A total of 540 community pharmacists completed the survey. Item means ranged from 2.93±1.47 to 1.58±0.88 based on a 5-point scale (1: not at all confident to 5: extremely confident). EFA resulted in a 2-factor solution, accounting for 71% of the variance. The 2 factors consisted of health and drug information (alpha=0.92) and opening the encounter (alpha=0.75). The alpha for the overall scale was 0.88. The results provide evidence to support the reliability and validity of an instrument to measure pharmacists' self-efficacy beliefs about communicating with Spanish-speaking patients in community practice. Practitioners and researchers may use this instrument to inform pharmacy education, pharmacy practice improvement, and research efforts around communicating with Spanish-speaking clients. Copyright © 2011 Elsevier Inc. All rights reserved.

Validation of the knowledge, attitude and perceived practice of asthma instrument among community pharmacists using Rasch analysis.

PubMed

Akram, Waqas; Hussein, Maryam S E; Ahmad, Sohail; Mamat, Mohd N; Ismail, Nahlah E

2015-10-01

There is no instrument which collectively assesses the knowledge, attitude and perceived practice of asthma among community pharmacists. Therefore, this study aimed to validate the instrument which measured the knowledge, attitude and perceived practice of asthma among community pharmacists by producing empirical evidence of validity and reliability of the items using Rasch model (Bond & Fox software®) for dichotomous and polytomous data. This baseline study recruited 33 community pharmacists from Penang, Malaysia. The results showed that all PTMEA Corr were in positive values, where an item was able to distinguish between the ability of respondents. Based on the MNSQ infit and outfit range (0.60-1.40), out of 55 items, 2 items from the instrument were suggested to be removed. The findings indicated that the instrument fitted with Rasch measurement model and showed the acceptable reliability values of 0.88 and 0.83 and 0.79 for knowledge, attitude and perceived practice respectively.

An evaluation of the objective quality and perceived usefulness of maternity clinical practice guidelines at a tertiary maternity unit.

PubMed

Trollope, Helena; Leung, Joyce Pui Yee; Wise, Michelle; Farquhar, Cynthia; Sadler, Lynn

2018-03-05

Compliance with maternity clinical practice guidelines developed by National Women's Health has been found to be low at audit. To explore the reasons for poor compliance with maternity guidelines by evaluating the quality of a sample of National Women's Health guidelines using a validated instrument and assessing local guideline users' perceptions of and attitudes toward guidelines. Five independent reviewers evaluated the quality of 10 purposively selected guidelines for adherence to the Appraisal of Guidelines Research & Evaluation (AGREE) II instrument standards. A self-administered questionnaire for staff was undertaken regarding views of and barriers to guideline use. None of the guidelines attained a score over 50% for the following domains: stakeholder involvement, rigour of development, applicability, editorial independence. The highest scoring domain was clarity of presentation (mean 69%). All guidelines scored the minimum possible for editorial independence. Survey respondents had positive attitudes toward guidelines, believed that their use could improve quality of care within the service, and felt that encouragement from senior staff members and peers would encourage their use. Accessibility was the most commonly cited of many barriers identified. The National Women's Health guidelines evaluated in this study cannot be considered to be high quality, and could be improved by reporting on methodology of the development process. Although poor guideline development may contribute to failure of the local maternity guidelines, it appears that accessibility is a major barrier to their use and implementation. © 2018 The Royal Australian and New Zealand College of Obstetricians and Gynaecologists.

16 CFR Figures 1 and 2 to Part 1204 - Suggested Instrumentation for Current Monitoring Device and High Voltage Facility

Code of Federal Regulations, 2012 CFR

2012-01-01

... 16 Commercial Practices 2 2012-01-01 2012-01-01 false Suggested Instrumentation for Current Monitoring Device and High Voltage Facility 1 Figures 1 and 2 to Part 1204 Commercial Practices CONSUMER... Instrumentation for Current Monitoring Device and High Voltage Facility EC03OC91.008 ...

16 CFR Figures 1 and 2 to Part 1204 - Suggested Instrumentation for Current Monitoring Device and High Voltage Facility

Code of Federal Regulations, 2014 CFR

2014-01-01

... 16 Commercial Practices 2 2014-01-01 2014-01-01 false Suggested Instrumentation for Current Monitoring Device and High Voltage Facility 1 Figures 1 and 2 to Part 1204 Commercial Practices CONSUMER... Instrumentation for Current Monitoring Device and High Voltage Facility EC03OC91.008 ...

16 CFR Figures 1 and 2 to Part 1204 - Suggested Instrumentation for Current Monitoring Device and High Voltage Facility

Code of Federal Regulations, 2013 CFR

2013-01-01

... 16 Commercial Practices 2 2013-01-01 2013-01-01 false Suggested Instrumentation for Current Monitoring Device and High Voltage Facility 1 Figures 1 and 2 to Part 1204 Commercial Practices CONSUMER... Instrumentation for Current Monitoring Device and High Voltage Facility EC03OC91.008 ...

Design and validation of instruments to measure knowledge.

PubMed

Elliott, T E; Regal, R R; Elliott, B A; Renier, C M

2001-01-01

Measuring health care providers' learning after they have participated in educational interventions that use experimental designs requires valid, reliable, and practical instruments. A literature review was conducted. In addition, experience gained from designing and validating instruments for measuring the effect of an educational intervention informed this process. The eight main steps for designing, validating, and testing the reliability of instruments for measuring learning outcomes are presented. The key considerations and rationale for this process are discussed. Methods for critiquing and adapting existent instruments and creating new ones are offered. This study may help other investigators in developing valid, reliable, and practical instruments for measuring the outcomes of educational activities.

Development of assessment instruments to measure critical thinking skills

NASA Astrophysics Data System (ADS)

Sumarni, W.; Supardi, K. I.; Widiarti, N.

2018-04-01

Assessment instruments that is commonly used in the school generally have not been orientated on critical thinking skills. The purpose of this research is to develop assessment instruments to measure critical thinking skills, to test validity, reliability, and practicality. This type of research is Research and Development. There are two stages on the preface step, which are field study and literacy study. On the development steps, there some parts, which are 1) instrument construction, 2) expert validity, 3) limited scale tryout and 4) narrow scale try-out. The developed assessment instrument are analysis essay and problem solving. Instruments were declared valid, reliable and practical.

Instrumentation, performance visualization, and debugging tools for multiprocessors

NASA Technical Reports Server (NTRS)

Yan, Jerry C.; Fineman, Charles E.; Hontalas, Philip J.

1991-01-01

The need for computing power has forced a migration from serial computation on a single processor to parallel processing on multiprocessor architectures. However, without effective means to monitor (and visualize) program execution, debugging, and tuning parallel programs becomes intractably difficult as program complexity increases with the number of processors. Research on performance evaluation tools for multiprocessors is being carried out at ARC. Besides investigating new techniques for instrumenting, monitoring, and presenting the state of parallel program execution in a coherent and user-friendly manner, prototypes of software tools are being incorporated into the run-time environments of various hardware testbeds to evaluate their impact on user productivity. Our current tool set, the Ames Instrumentation Systems (AIMS), incorporates features from various software systems developed in academia and industry. The execution of FORTRAN programs on the Intel iPSC/860 can be automatically instrumented and monitored. Performance data collected in this manner can be displayed graphically on workstations supporting X-Windows. We have successfully compared various parallel algorithms for computational fluid dynamics (CFD) applications in collaboration with scientists from the Numerical Aerodynamic Simulation Systems Division. By performing these comparisons, we show that performance monitors and debuggers such as AIMS are practical and can illuminate the complex dynamics that occur within parallel programs.

The Nursing Performance Instrument: Exploratory and Confirmatory Factor Analyses in Registered Nurses.

PubMed

Sagherian, Knar; Steege, Linsey M; Geiger-Brown, Jeanne; Harrington, Donna

2018-04-01

The optimal performance of nurses in healthcare settings plays a critical role in care quality and patient safety. Despite this importance, few measures are provided in the literature that evaluate nursing performance as an independent construct from competencies. The nine-item Nursing Performance Instrument (NPI) was developed to fill this gap. The aim of this study was to examine and confirm the underlying factor structure of the NPI in registered nurses. The design was cross-sectional, using secondary data collected between February 2008 and April 2009 for the "Fatigue in Nursing Survey" (N = 797). The sample was predominantly dayshift female nurses working in acute care settings. Using Mplus software, exploratory and confirmatory factor analyses were applied to the NPI data, which were divided into two equal subsamples. Multiple fit indices were used to evaluate the fit of the alternative models. The three-factor model was determined to fit the data adequately. The factors that were labeled as "physical/mental decrements," "consistent practice," and "behavioral change" were moderately to strongly intercorrelated, indicating good convergent validity. The reliability coefficients for the subscales were acceptable. The NPI consists of three latent constructs. This instrument has the potentialto be used as a self-monitoring instrument that addressesnurses' perceptions of performance while providing patient care.

The Understanding Bereavement Evaluation Tool (UBET) for midwives: factor structure and clinical research applications.

PubMed

Hollins Martin, Caroline J; Forrest, Eleanor; Wylie, Linda; Martin, Colin R

2013-10-01

The NMSF (2009) survey reported that bereavement midwife care was inadequate in a number of UK NHS Trusts. Using a small grant from the Scottish government, 3 experienced midwifery lecturers designed an interactive workbook called "Shaping bereavement care for midwives in clinical practice" for the purpose of improving delivery of bereavement education to student midwives. An instrument called the Understanding Bereavement Evaluation Tool (UBET) was designed to measure effectiveness of the workbook at equipping students with essential knowledge. To assess validity and reliability of the UBET at measuring midwives' self-perceptions of knowledge surrounding delivery of bereavement care to childbearing women, partners and families who have experienced childbirth related bereavement. An evaluative audit using the UBET was undertaken to explore student midwives' (n=179) self perceived knowledge levels before and after the workbook intervention. Validity tests have shown that the UBET, (6-item version), could be considered a psychometrically robust instrument for assessing students' knowledge gain. PCA identified that the UBET comprised two sub-scales (theoretical knowledge base - Q 1, 2 & 3 and psychosocial elements of care delivery - Q 4, 5 & 6). Data has shown that the easy to administer and short 6-item UBET is a valid and reliable tool for educators to measure success at delivering education using the "Shaping bereavement care for midwives in clinical practice" work book. Copyright © 2012 Elsevier Ltd. All rights reserved.

Analytic Method for Computing Instrument Pointing Jitter

NASA Technical Reports Server (NTRS)

Bayard, David

2003-01-01

A new method of calculating the root-mean-square (rms) pointing jitter of a scientific instrument (e.g., a camera, radar antenna, or telescope) is introduced based on a state-space concept. In comparison with the prior method of calculating the rms pointing jitter, the present method involves significantly less computation. The rms pointing jitter of an instrument (the square root of the jitter variance shown in the figure) is an important physical quantity which impacts the design of the instrument, its actuators, controls, sensory components, and sensor- output-sampling circuitry. Using the Sirlin, San Martin, and Lucke definition of pointing jitter, the prior method of computing the rms pointing jitter involves a frequency-domain integral of a rational polynomial multiplied by a transcendental weighting function, necessitating the use of numerical-integration techniques. In practice, numerical integration complicates the problem of calculating the rms pointing error. In contrast, the state-space method provides exact analytic expressions that can be evaluated without numerical integration.

Checklist Model to Improve Work Practices in Small-Scale Demolition Operations with Silica Dust Exposures

PubMed Central

Muianga, Custodio; Rice, Carol; Lentz, Thomas; Lockey, James; Niemeier, Richard; Succop, Paul

2012-01-01

A systematic approach was developed to review, revise and adapt existing exposure control guidance used in developed countries for use in developing countries. One-page employee and multiple-page supervisor guidance sheets were adapted from existing documents using a logic framework and workers were trained to use the information to improve work practices. Interactive, hands-on training was delivered to 26 workers at five small-scale demolition projects in Maputo City, Mozambique, and evaluated. A pre-and-post walkthrough survey used by trained observers documented work practice changes. Worker feedback indicated that the training was effective and useful. Workers acquired knowledge (84% increase, p < 0.01) and applied the work practice guidance. The difference of proportions between use of work practice components before and after the intervention was statistically significant (p < 0.05). Changes in work practices following training included preplanning, use of wet methods and natural ventilation and end-of-task review. Respirable dust measurements indicated a reduction in exposure following training. Consistency in observer ratings and observations support the reliability and validity of the instruments. This approach demonstrated the short-term benefit of training in changing work practices; follow-up is required to determine the long-term impact on changes in work practices, and to evaluate the need for refresher training. PMID:22470296

Refinery evaluation of optical imaging to locate fugitive emissions.

PubMed

Robinson, Donald R; Luke-Boone, Ronke; Aggarwal, Vineet; Harris, Buzz; Anderson, Eric; Ranum, David; Kulp, Thomas J; Armstrong, Karla; Sommers, Ricky; McRae, Thomas G; Ritter, Karin; Siegell, Jeffrey H; Van Pelt, Doug; Smylie, Mike

2007-07-01

Fugitive emissions account for approximately 50% of total hydrocarbon emissions from process plants. Federal and state regulations aiming at controlling these emissions require refineries and petrochemical plants in the United States to implement a Leak Detection and Repair Program (LDAR). The current regulatory work practice, U.S. Environment Protection Agency Method 21, requires designated components to be monitored individually at regular intervals. The annual costs of these LDAR programs in a typical refinery can exceed US$1,000,000. Previous studies have shown that a majority of controllable fugitive emissions come from a very small fraction of components. The Smart LDAR program aims to find cost-effective methods to monitor and reduce emissions from these large leakers. Optical gas imaging has been identified as one such technology that can help achieve this objective. This paper discusses a refinery evaluation of an instrument based on backscatter absorption gas imaging technology. This portable camera allows an operator to scan components more quickly and image gas leaks in real time. During the evaluation, the instrument was able to identify leaking components that were the source of 97% of the total mass emissions from leaks detected. More than 27,000 components were monitored. This was achieved in far less time than it would have taken using Method 21. In addition, the instrument was able to find leaks from components that are not required to be monitored by the current LDAR regulations. The technology principles and the parameters that affect instrument performance are also discussed in the paper.

Opening minds in Canada: background and rationale.

PubMed

Stuart, Heather; Chen, Shu-Ping; Christie, Romie; Dobson, Keith; Kirsh, Bonnie; Knaak, Stephanie; Koller, Michelle; Krupa, Terry; Lauria-Horner, Bianca; Luong, Dorothy; Modgill, Geeta; Patten, Scott B; Pietrus, Mike; Szeto, Andrew; Whitley, Rob

2014-10-01

To summarize the background and rationale of the approach taken by the Mental Health Commission of Canada's Opening Minds (OM) Anti-Stigma Initiative. The approach taken by OM incorporates a grassroots, community development philosophy, has clearly defined target groups, uses contact-based education as the central organizing element across interventions, and has a strong evaluative component, so that best practices can be identified, replicated, and disseminated. Contact-based education occurs when people who have experienced a mental illness share their personal story of recovery and hope. OM has acted as a catalyst to develop partnerships between community groups who are undertaking anti-stigma work and an interdisciplinary team of academic researchers in 5 universities who are evaluating the results of these programs. Building partnerships with existing community programs and promoting systematic evaluation using standardized approaches and instruments have contributed to our understanding of best practices in the field of anti-stigma programming.

High-Level Disinfection of Otorhinolaryngology Clinical Instruments: An Evaluation of the Efficacy and Cost-effectiveness of Instrument Storage.

PubMed

Yalamanchi, Pratyusha; Yu, Jason; Chandler, Laura; Mirza, Natasha

2018-01-01

Objectives Despite increasing interest in individual instrument storage, risk of bacterial cross-contamination of otorhinolaryngology clinic instruments has not been assessed. This study is the first to determine the clinical efficacy and cost-effectiveness of standard high-level disinfection and clinic instrument storage. Methods To assess for cross-contamination, surveillance cultures of otorhinolaryngology clinic instruments subject to standard high-level disinfection and storage were obtained at the start and end of the outpatient clinical workday. Rate of microorganism recovery was compared with cultures of instruments stored in individual peel packs and control cultures of contaminated instruments. Based on historical clinic data, the direct allocation method of cost accounting was used to determine aggregate raw material cost and additional labor hours required to process and restock peel-packed instruments. Results Among 150 cultures of standard high-level disinfected and co-located clinic instruments, 3 positive bacterial cultures occurred; 100% of control cultures were positive for bacterial species ( P < .001). There was no statistical difference between surveillance cultures obtained before and after the clinic day. While there was also no significant difference in rate of contamination between peel-packed and co-located instruments, peel packing all instruments requires 6250 additional labor hours, and conservative analyses place the cost of individual semicritical instrument storage at $97,852.50 per year. Discussion With in vitro inoculation of >200 otorhinolaryngology clinic instruments, this study demonstrates that standard high-level disinfection and storage are equally efficacious to more time-consuming and expensive individual instrument storage protocols, such as peel packing, with regard to bacterial contamination. Implications for Practice Standard high-level disinfection and storage are equally effective to labor-intensive and costly individual instrument storage protocols.

Reusing Joint Polar Satellite System (jpss) Ground System Components to Process AURA Ozone Monitoring Instrument (omi) Science Products

NASA Astrophysics Data System (ADS)

Moses, J. F.; Jain, P.; Johnson, J.; Doiron, J. A.

2017-12-01

New Earth observation instruments are planned to enable advancements in Earth science research over the next decade. Diversity of Earth observing instruments and their observing platforms will continue to increase as new instrument technologies emerge and are deployed as part of National programs such as Joint Polar Satellite System (JPSS), Geostationary Operational Environmental Satellite system (GOES), Landsat as well as the potential for many CubeSat and aircraft missions. The practical use and value of these observational data often extends well beyond their original purpose. The practicing community needs intuitive and standardized tools to enable quick unfettered development of tailored products for specific applications and decision support systems. However, the associated data processing system can take years to develop and requires inherent knowledge and the ability to integrate increasingly diverse data types from multiple sources. This paper describes the adaptation of a large-scale data processing system built for supporting JPSS algorithm calibration and validation (Cal/Val) node to a simplified science data system for rapid application. The new configurable data system reuses scalable JAVA technologies built for the JPSS Government Resource for Algorithm Verification, Independent Test, and Evaluation (GRAVITE) system to run within a laptop environment and support product generation and data processing of AURA Ozone Monitoring Instrument (OMI) science products. Of particular interest are the root requirements necessary for integrating experimental algorithms and Hierarchical Data Format (HDF) data access libraries into a science data production system. This study demonstrates the ability to reuse existing Ground System technologies to support future missions with minimal changes.

Discrepancies between Students' and Teachers' Ratings of Instructional Practice: A Way to Measure Classroom Intuneness and Evaluate Teaching Quality

ERIC Educational Resources Information Center

Dockterman, Daniel Milo

2017-01-01

Student surveys have gained prominence in recent years as a way to give students a voice in their learning process, and teacher self-reports have always been an effective instrument for revealing the planning, intentions, and expectations behind a given lesson. Though student and teacher surveys are widely used, extant research in education has…

Quality of leadership in multidisciplinary cancer tumor boards: development and evaluation of a leadership assessment instrument (ATLAS).

PubMed

Jalil, Rozh; Soukup, Tayana; Akhter, Waseem; Sevdalis, Nick; Green, James S A

2018-03-03

High-quality leadership and chairing skills are vital for good performance in multidisciplinary tumor boards (MTBs), but no instruments currently exist for assessing and improving these skills. To construct and validate a robust instrument for assessment of MTB leading and chairing skills. We developed an observational MTB leadership assessment instrument (ATLAS). ATLAS includes 12 domains that assess the leadership and chairing skills of the MTB chairperson. ATLAS has gone through a rigorous process of refinement and content validation prior to use to assess the MTB lead by two urological surgeons (blinded to each other) in 7 real-live (n = 286 cases) and 10 video-recorded (n = 131 cases) MTBs. ATLAS domains were analyzed via descriptive statistics. Instrument content was evaluated for validity using the content validation index (CVI). Intraclass correlation coefficients (ICCs) were used to assess inter-observer reliability. Instrument refining resulted in ATLAS including the following 12 domains: time management, communication, encouraging contribution, ability to summarize, ensuring all patients have treatment plan, case prioritization, keeping meeting focused, facilitate discussion, conflict management, leadership, creating good working atmosphere, and recruitment for clinical trials. CVI was acceptable and inter-rater agreement adequate to high for all domains. Agreement was somewhat higher in real-time MTBs compared to video ratings. Concurrent validation evidence was derived via positive and significant correlations between ATLAS and an established validated brief MTB leadership assessment scale. ATLAS is an observational assessment instrument that can be reliably used for assessing leadership and chairing skills in cancer MTBs (both live and video-recorded). The ability to assess and feedback on team leader performance provides the ground for promotion of good practice and continuing professional development of tumor board leaders.

Measurement Issues: Screening and diagnostic instruments for autism spectrum disorders – lessons from research and practice

PubMed Central

Charman, Tony; Gotham, Katherine

2012-01-01

Background and Scope Significant progress has been made over the past two decades in the development of screening and diagnostic instruments for autism spectrum disorders (ASD). This article reviews this progress, including recent innovations, focussing on those instruments for which the strongest research data on validity exists, and then turns to addressing issues arising from their use in clinical settings. Findings Research studies have evaluated the ability of screens to prospectively identify cases of ASD in population-based and clinically-referred samples, as well as the accuracy of diagnostic instruments to map onto ‘gold standard’ clinical best estimate diagnosis. However, extension of the findings to clinical services must be done with caution, with a full understanding that instrument properties are sample-specific. Furthermore, we are limited by the lack of a true test for ASD, which remains a behaviourally-defined disorder. In addition screening and diagnostic instruments help clinicians least in the cases where they are most in want of direction, since their accuracy will always be lower for marginal cases. Conclusion Instruments help clinicians to collect detailed, structured information and increase accuracy and reliability of referral for in-depth assessment and recommendations for support, but further research is needed to refine their effective use in clinical settings. PMID:23539140

Performance-based comparison of neonatal intubation training outcomes: simulator and live animal.

PubMed

Andreatta, Pamela B; Klotz, Jessica J; Dooley-Hash, Suzanne L; Hauptman, Joe G; Biddinger, Bea; House, Joseph B

2015-02-01

The purpose of this article was to establish psychometric validity evidence for competency assessment instruments and to evaluate the impact of 2 forms of training on the abilities of clinicians to perform neonatal intubation. To inform the development of assessment instruments, we conducted comprehensive task analyses including each performance domain associated with neonatal intubation. Expert review confirmed content validity. Construct validity was established using the instruments to differentiate between the intubation performance abilities of practitioners (N = 294) with variable experience (novice through expert). Training outcomes were evaluated using a quasi-experimental design to evaluate performance differences between 294 subjects randomly assigned to 1 of 2 training groups. The training intervention followed American Heart Association Pediatric Advanced Life Support and Neonatal Resuscitation Program protocols with hands-on practice using either (1) live feline or (2) simulated feline models. Performance assessment data were captured before and directly following the training. All data were analyzed using analysis of variance with repeated measures and statistical significance set at P < .05. Content validity, reliability, and consistency evidence were established for each assessment instrument. Construct validity for each assessment instrument was supported by significantly higher scores for subjects with greater levels of experience, as compared with those with less experience (P = .000). Overall, subjects performed significantly better in each assessment domain, following the training intervention (P = .000). After controlling for experience level, there were no significant differences among the cognitive, performance, and self-efficacy outcomes between clinicians trained with live animal model or simulator model. Analysis of retention scores showed that simulator trained subjects had significantly higher performance scores after 18 weeks (P = .01) and 52 weeks (P = .001) and cognitive scores after 52 weeks (P = .001). The results of this study demonstrate the feasibility of using valid, reliable assessment instruments to assess clinician competency and self-efficacy in the performance of neonatal intubation. We demonstrated the relative equivalency of live animal and simulation-based models as tools to support acquisition of neonatal intubation skills. Retention of performance abilities was greater for subjects trained using the simulator, likely because it afforded greater opportunity for repeated practice. Outcomes in each assessment area were influenced by the previous intubation experience of participants. This suggests that neonatal intubation training programs could be tailored to the level of provider experience to make efficient use of time and educational resources. Future research focusing on the uses of assessment in the applied clinical environment, as well as identification of optimal training cycles for performance retention, is merited.

The Effects of Limited, Restricted Music Practice on Overnight Memory Enhancement

ERIC Educational Resources Information Center

Allen, Sarah E.; Duke, Robert A.

2013-01-01

During evening practice sessions, 32 nonpianist musicians learned a short melody on piano, and then either learned a second short piano melody, learned a difficult unfamiliar piece on their principal instruments, practiced familiar material on their principal instruments, or engaged in no other music-related motor behavior prior to sleep; practice…

Single-incision Laparoscopic Surgery (SILS) in general surgery: a review of current practice.

PubMed

Froghi, Farid; Sodergren, Mikael Hans; Darzi, Ara; Paraskeva, Paraskevas

2010-08-01

Single-incision laparoscopic surgery (SILS) aims to eliminate multiple port incisions. Although general operative principles of SILS are similar to conventional laparoscopic surgery, operative techniques are not standardized. This review aims to evaluate the current use of SILS published in the literature by examining the types of operations performed, techniques employed, and relevant complications and morbidity. This review considered a total of 94 studies reporting 1889 patients evaluating 17 different general surgical operations. There were 8 different access techniques reported using conventional laparoscopic instruments and specifically designed SILS ports. There is extensive heterogeneity associated with operating methods and in particular ways of overcoming problems with retraction and instrumentation. Published complications, morbidity, and hospital length of stay are comparable to conventional laparoscopy. Although SILS provides excellent cosmetic results and morbidity seems similar to conventional laparoscopy, larger randomized controlled trials are needed to assess the safety and efficacy of this novel technique.

Quality of nursing diagnoses: evaluation of an educational intervention.

PubMed

Florin, Jan; Ehrenberg, Anna; Ehnfors, Margareta

2005-01-01

To investigate the effects on the quality of nursing diagnostic statements in patient records after education in the nursing process and implementation of new forms for recording. Quasi-experimental design. Randomly selected patient records reviewed before and after intervention from one experimental unit (n = 70) and three control units (n = 70). A scale with 14 characteristics pertaining to nursing diagnoses was developed and used together with the instrument (CAT-CH-ING) for record review. Quality of nursing diagnostic statements improved in the experimental unit, whereas no improvement was found in the control units. Serious flaws in the use of the etiology component were found. CONCLUSION. Nurses must be more concerned with the accuracy and quality of the nursing diagnoses and the etiology component needs to be given special attention. Education of RNs in nursing diagnostic statements and peer review using standardized evaluation instruments can be means to further enhance RNs' documentation practice.

The Active Role of Instruments in Articulating Knowing and Knowledge: The Case of Animal Qualification Practices in Breeding Organisations

ERIC Educational Resources Information Center

Labatut, Julie; Aggeri, Franck; Astruc, Jean-Michel; Bibe, Bernard; Girard, Nathalie

2009-01-01

Purpose: The purpose of this paper is to investigate the role of instruments defined as artefacts, rules, models or norms, in the articulation between knowing-in-practice and knowledge, in learning processes. Design/methodology/approach: The paper focuses on a distributed, knowledge-intensive and instrumented activity at the core of any collective…

Designing Chemistry Practice Exams for Enhanced Benefits: An Instrument for Comparing Performance and Mental Effort Measures

ERIC Educational Resources Information Center

Knaus, Karen J.; Murphy, Kristen L.; Holme, Thomas A.

2009-01-01

The design and use of a chemistry practice exam instrument that includes a measure for student mental effort is described in this paper. Use of such an instrument can beneficial to chemistry students and chemistry educators as well as chemical education researchers from both a content and cognitive science perspective. The method for calculating…

The Reliability, Validity and Practical Utility of Measuring Supports Using the I-CAN Instrument: Part II

ERIC Educational Resources Information Center

Riches, Vivienne C.; Parmenter, Trevor R.; Llewellyn, Gwynnyth; Hindmarsh, Gabrielle; Chan, Jeff

2009-01-01

Background: There is an urgent need for developing reliable, valid and practical instruments that assess and classify the support needed by persons with disability to function in their chosen living, working and social environments. I-CAN is an instrument that addresses the frequency and level of support needed (not individual skills or deficits)…

Instruments to assess self-care among healthy children: A systematic review of measurement properties.

PubMed

Urpí-Fernández, Ana-María; Zabaleta-Del-Olmo, Edurne; Montes-Hidalgo, Javier; Tomás-Sábado, Joaquín; Roldán-Merino, Juan-Francisco; Lluch-Canut, María-Teresa

2017-12-01

To identify, critically appraise and summarize the measurement properties of instruments to assess self-care in healthy children. Assessing self-care is a proper consideration for nursing practice and nursing research. No systematic review summarizes instruments of measurement validated in healthy children. Psychometric review in accordance with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) panel. MEDLINE, CINAHL, PsycINFO, Web of Science and Open Grey were searched from their inception to December 2016. Validation studies with a healthy child population were included. Search was not restricted by language. Two reviewers independently assessed the methodological quality of included studies using the COSMIN checklist. Eleven studies were included in the review assessing the measurement properties of ten instruments. There was a maximum of two studies per instrument. None of the studies evaluated the properties of test-retest reliability, measurement error, criterion validity and responsiveness. Internal consistency and structural validity were rated as "excellent" or "good" in four studies. Four studies were rated as "excellent" in content validity. Cross-cultural validity was rated as "poor" in the two studies (three instruments) which cultural adaptation was carried out. The evidence available does not allow firm conclusions about the instruments identified in terms of reliability and validity. Future research should focus on generate evidence about a wider range of measurement properties of these instruments using a rigorous methodology, as well as instrument testing on different countries and child population. © 2017 John Wiley & Sons Ltd.

Child development surveillance: intervention study with nurses of the Family Health Strategy.

PubMed

Reichert, Altamira Pereira da Silva; Collet, Neusa; Eickmann, Sophie Helena; Lima, Marília de Carvalho

2015-01-01

to evaluate the effectiveness of an educational action in child development surveillance performed by nurses working in primary health care. interventional study with a before-and-after type of design, carried out with 45 nurses and 450 mothers of children under 2 years of age. Initially, it was evaluated the practices and knowledge of nurses on child development surveillance and the mothers were interviewed about these practices. Subsequently, workshops were carried out with nurses and four months later, the knowledge of nurses and the maternal information were reevaluated. after intervention there was significant increase in the frequency of the following aspects: from 73% to 100%, in relation to the practice of nurses of asking the opinion of mothers about their children's development; from 42% to 91%, regarding the use of the systematized instrument of evaluation; from 91% to 100% with respect to guidance to mothers on how to stimulate child development. the intervention contributed to the increase of knowledge of nurses and implementation of child development surveillance, showing the importance of this initiative to improve the quality of child health care.

Measures of cultural competence: examining hidden assumptions.

PubMed

Kumaş-Tan, Zofia; Beagan, Brenda; Loppie, Charlotte; MacLeod, Anna; Frank, Blye

2007-06-01

The authors critically examined the quantitative measures of cultural competence most commonly used in medicine and in the health professions, to identify underlying assumptions about what constitutes competent practice across social and cultural diversity. A systematic review of approximately 20 years of literature listed in PubMed, the Cumulative Index of Nursing and Allied Health Literature, Social Services Abstracts, and the Educational Resources Information Center identified the most frequently used cultural competence measures, which were then thematically analyzed following a structured analytic guide. Fifty-four instruments were identified; the 10 most widely used were analyzed closely, identifying six prominent assumptions embedded in the measures. In general, these instruments equate culture with ethnicity and race and conceptualize culture as an attribute possessed by the ethnic or racialized Other. Cultural incompetence is presumed to arise from a lack of exposure to and knowledge of the Other, and also from individual biases, prejudices, and acts of discrimination. Many instruments assume that practitioners are white and Western and that greater confidence and comfort among practitioners signify increased cultural competence. Existing measures embed highly problematic assumptions about what constitutes cultural competence. They ignore the power relations of social inequality and assume that individual knowledge and self-confidence are sufficient for change. Developing measures that assess cultural humility and/or assess actual practice are needed if educators in the health professions and health professionals are to move forward in efforts to understand, teach, practice, and evaluate cultural competence.

Clinical practice guidelines for fertility preservation in young women undergoing gonadotoxic treatment: an overview and critical appraisal of methodological quality and content.

PubMed

Baysal, Özlem; Hamilton, Jozefien A M; Hamilton, Carl J C M; Braat, Didi D M; Beerendonk, Catharina C M; Nelen, Willianne L D M

2018-04-13

What is the methodological quality and content of internationally available clinical practice guidelines (CPGs) on fertility preservation (FP) care in adult women? Internationally available CPGs on FP care in adult women were identified after conducting an extensive literature search and consulting (inter)national key experts. The methodological quality of the CPGs was appraised by an (inter)national panel of experts using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. The content of the best CPGs, scoring ≥60% for the domain 'Rigour of development' of the AGREE II instrument, was extracted and categorized according to their topic. Thirty of the 1808 documents found were included. After consulting (inter)national key experts, 30 CPGs were included, six of which scored ≥60% for their 'Rigour of development'. The number of FP-related topics discussed by these six CPGs ranged from 4 to 12. The number of recommendations provided by the CPGs on these topics varied. The number of topics to which ≥5 recommendations were dedicated ranged from 0 to 4 between CPGs. CPGs on the subject of FP care are available, but there is room for improvement in quality and content. Although written for use in daily practice, the CPGs can also be used to develop quality indicators to monitor the quality of current FP care or to evaluate future improvement initiatives. Copyright © 2018 Reproductive Healthcare Ltd. Published by Elsevier Ltd. All rights reserved.

SAMOS - A Decade of High-Quality, Underway Meteorological and Oceanographic Data from Research Vessels

NASA Astrophysics Data System (ADS)

Smith, S. R.; Rolph, J.; Briggs, K.; Elya, J. L.; Bourassa, M. A.

2016-02-01

The authors will describe the successes and lessons learned from the Shipboard Automated Meteorological and Oceanographic System (SAMOS) initiative. Over the past decade, SAMOS has acquired, quality controlled, and distributed underway surface meteorological and oceanographic observations from nearly 40 oceanographic research vessels. Research vessels provide underway observations at high-temporal frequency (1-minute sampling interval) that include navigational (position, course, heading, and speed), meteorological (air temperature, humidity, wind, surface pressure, radiation, rainfall), and oceanographic (surface sea temperature and salinity) samples. Vessels recruited to the SAMOS initiative collect a high concentration of data within the U.S. continental shelf, around Hawaii and the islands of the tropical Pacific, and frequently operate well outside routine shipping lanes, capturing observations in extreme ocean environments (Southern, Arctic, South Atlantic, and South Pacific oceans) desired by the air-sea exchange, modeling, and satellite remote sensing communities. The presentation will highlight the data stewardship practices of the SAMOS initiative. Activities include routine automated and visual data quality evaluation, feedback to vessel technicians and operators regarding instrumentation errors, best practices for instrument siting and exposure on research vessels, and professional development activities for research vessel technicians. Best practices for data, metadata, and quality evaluation will be presented. We will discuss ongoing efforts to expand data services to enhance interoperability between marine data centers. Data access and archival protocols will also be presented, including how these data may be referenced and accessed via NCEI.

Evaluation of an employment program for people with mental illness using the Supported Employment Fidelity Scale.

PubMed

Cocks, Errol; Boaden, Ross

2009-10-01

The Individual Placement and Support (IPS) model aims to achieve open employment for people with mental illness. The Supported Employment Fidelity Scale (SEFS) is a 15-item instrument that evaluates the extent to which a service follows the IPS principles of best practice. This paper describes the IPS model and an evaluation of a specialist employment program for people with mental illness using the SEFS. The SEFS enabled a quantitative assessment of service provision against the criteria of evidence-based practice principles. Data were collected from multiple sources. In addition, a literature review was conducted, and personnel engaged in implementation of the IPS model at other Australian employment programs were consulted. The program achieved a score of 59 of a possible 75 on the SEFS, which is described as fair supported employment. Analysis of the 15-scale items resulted in the identification of strengths, areas for further development, and a set of recommendations. The program was operating substantially in line with evidence-based practice principles and had considerable scope for further development. Issues arising from the evaluation, areas of applicability of the SEFS and the underlying literature, and implications for occupational therapy are highlighted.

Measurement Instrument for Scientific Teaching (MIST): A Tool to Measure the Frequencies of Research-Based Teaching Practices in Undergraduate Science Courses.

PubMed

Durham, Mary F; Knight, Jennifer K; Couch, Brian A

2017-01-01

The Scientific Teaching (ST) pedagogical framework provides various approaches for science instructors to teach in a way that more closely emulates how science is practiced by actively and inclusively engaging students in their own learning and by making instructional decisions based on student performance data. Fully understanding the impact of ST requires having mechanisms to quantify its implementation. While many useful instruments exist to document teaching practices, these instruments only partially align with the range of practices specified by ST, as described in a recently published taxonomy. Here, we describe the development, validation, and implementation of the Measurement Instrument for Scientific Teaching (MIST), a survey derived from the ST taxonomy and designed to gauge the frequencies of ST practices in undergraduate science courses. MIST showed acceptable validity and reliability based on results from 7767 students in 87 courses at nine institutions. We used factor analyses to identify eight subcategories of ST practices and used these categories to develop a short version of the instrument amenable to joint administration with other research instruments. We further discuss how MIST can be used by instructors, departments, researchers, and professional development programs to quantify and track changes in ST practices. © 2017 M. F. Durham et al. CBE—Life Sciences Education © 2017 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

[Teaching practices and the position concerning medical education].

PubMed

Medina-Figueroa, Alda María; Espinosa-Alarcón, Patricia Atzimba; Viniegra-Velázquez, Leonardo

2008-01-01

Estimate the degree of development of a position concerning medical education, in a phisician population. We carried out a cross-sectional study at with 1580 physicians; we selected 395 participants by non-proportional stratified sampling of an IMSS health facility; 244 (62 %) was medical professors, included 15 physicians responsible for education. A previously validated instrument was applied to these participants. Three indicators were evaluated: agreement in general, most popular trend, and consequence. Group grading was done blindly. Kuder-Richardson test was utilized to calculate the value of internal instrument consistency and nonparametric statistics < 0.05. Answering tendency in agreement were similar among physicians; heads or managers were statistically significant. The most popular trend was participative. In terms of consequence in physicians, there were some without consequent sentences in pair. The most popular trend was participative, although it would appear that this has not been pondered, in that on exploring the indicator, that of consequence. Teaching practices do not have any significant influence on the development of a position concerning medical education.

Translating the short version of the Perinatal Grief Scale: process and challenges.

PubMed

Capitulo, K L; Cornelio, M A; Lenz, E R

2001-08-01

Non-English-speaking populations may be excluded from rigorous clinical research because of the lack of reliable and valid instrumentation to measure psychosocial variables. The purpose of this article is to describe the process and challenges when translating a research instrument. The process will be illustrated in the project of translating into Spanish the Short Version of the Perinatal Grief Scale, extensively studied in English-speaking, primarily Caucasian populations. Translation methods, errors, and tips are included. Tools cannot be used in transcultural research and practice without careful and accurate translation and subsequent psychometric evaluation, which are essential to generate credible and valid findings. Copyright 2001 by W.B. Saunders Company

Physicians' prescribing preferences were a potential instrument for patients' actual prescriptions of antidepressants☆

PubMed Central

Davies, Neil M.; Gunnell, David; Thomas, Kyla H.; Metcalfe, Chris; Windmeijer, Frank; Martin, Richard M.

2013-01-01

Objectives To investigate whether physicians' prescribing preferences were valid instrumental variables for the antidepressant prescriptions they issued to their patients. Study Design and Setting We investigated whether physicians' previous prescriptions of (1) tricyclic antidepressants (TCAs) vs. selective serotonin reuptake inhibitors (SSRIs) and (2) paroxetine vs. other SSRIs were valid instruments. We investigated whether the instrumental variable assumptions are likely to hold and whether TCAs (vs. SSRIs) were associated with hospital admission for self-harm or death by suicide using both conventional and instrumental variable regressions. The setting for the study was general practices in the United Kingdom. Results Prior prescriptions were strongly associated with actual prescriptions: physicians who previously prescribed TCAs were 14.9 percentage points (95% confidence interval [CI], 14.4, 15.4) more likely to prescribe TCAs, and those who previously prescribed paroxetine were 27.7 percentage points (95% CI, 26.7, 28.8) more likely to prescribe paroxetine, to their next patient. Physicians' previous prescriptions were less strongly associated with patients' baseline characteristics than actual prescriptions. We found no evidence that the estimated association of TCAs with self-harm/suicide using instrumental variable regression differed from conventional regression estimates (P-value = 0.45). Conclusion The main instrumental variable assumptions held, suggesting that physicians' prescribing preferences are valid instruments for evaluating the short-term effects of antidepressants. PMID:24075596

EMCDDA Best Practice Promotion in Europe: an internet based dissemination tool.

PubMed

Ferri, Marica; Bo, Alessandra

2013-01-01

Best practice is the best application of available evidence to current activities in the drugs field. The European Monitoring Centre for Drugs and Drug Addiction (EMCDDA) created a web-based tool aimed at bridging together scientific evidence and current practices in the drug addiction field. Beyond dissemination of evidence, the scope is to share best practice among the European countries. The synthesis of the evidence is based on the methods of the Cochrane collaboration (the Drugs and Alcohol Group) and the Grade working group. As of February 2013 the portal encompasses four modules on the effectiveness of demand reduction interventions, a collection of European projects on prevention, treatment, harm reduction and social reintegration and an inventory of European Guidelines and Standards including a bank of instruments to evaluate interventions (http://www.emcdda.europa.eu/bestpractice). The summaries of evidence are presented in a plain language format and include brief explanation of the measures of effect supporting the evidence, but do not provide specific recommendations. The main future challenge of EMCDDA's best practice promotion is to become a service for those willing to implement best practice. The Best Practice Portal should become a platform where to find all is needed for successful implementation (handbooks, training materials, guidelines for evaluation and contacts for mentoring).

European Fissure Sealant Guidelines: assessment using AGREE II.

PubMed

San Martin-Galindo, L; Rodríguez-Lozano, F J; Abalos-Labruzzi, C; Niederman, R

2017-02-01

Pit and fissure sealants are effective in reducing the incidence of occlusal caries, and multiple clinical practice guidelines (CPGs) have been developed for recommending their proper use. The usefulness of CPGs depends on their quality and on the rigour of the guideline development process. A study was made to assess the quality of current European CPGs based on the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument, which uses 23 key items rated on a 7-point scale to assess practice guideline development and the quality of reporting. A search was conducted for fissure sealant guidelines for preventing caries in children and adults at high and low risk published in the last 10 years. Calibration was carried out before scoring to assess agreement between the appraisers using the AGREE II instrument. The searches identified 19 relevant guidelines, and following application of the inclusion/exclusion criteria, three guidelines were retained for evaluation. The proportion of observed agreement was calculated, expressed by the agreement separately for positive and negative ratings (PA = 0.89, NA = 0-91). The results of the guideline assessments revealed the highest score for the Irish guideline, a moderate score for the French guideline and the lowest score for the European guideline. Based on the AGREE II instrument, the results obtained show significant variation in the quality assessment of the three European Fissure Sealant Guidelines. Future studies should be carried out both to develop quality dental CPGs and to investigate effective ways of adopting them. © 2015 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Implementation and application of moving average as continuous analytical quality control instrument demonstrated for 24 routine chemistry assays.

PubMed

Rossum, Huub H van; Kemperman, Hans

2017-07-26

General application of a moving average (MA) as continuous analytical quality control (QC) for routine chemistry assays has failed due to lack of a simple method that allows optimization of MAs. A new method was applied to optimize the MA for routine chemistry and was evaluated in daily practice as continuous analytical QC instrument. MA procedures were optimized using an MA bias detection simulation procedure. Optimization was graphically supported by bias detection curves. Next, all optimal MA procedures that contributed to the quality assurance were run for 100 consecutive days and MA alarms generated during working hours were investigated. Optimized MA procedures were applied for 24 chemistry assays. During this evaluation, 303,871 MA values and 76 MA alarms were generated. Of all alarms, 54 (71%) were generated during office hours. Of these, 41 were further investigated and were caused by ion selective electrode (ISE) failure (1), calibration failure not detected by QC due to improper QC settings (1), possible bias (significant difference with the other analyzer) (10), non-human materials analyzed (2), extreme result(s) of a single patient (2), pre-analytical error (1), no cause identified (20), and no conclusion possible (4). MA was implemented in daily practice as a continuous QC instrument for 24 routine chemistry assays. In our setup when an MA alarm required follow-up, a manageable number of MA alarms was generated that resulted in valuable MA alarms. For the management of MA alarms, several applications/requirements in the MA management software will simplify the use of MA procedures.

The Communication Supports Inventory-Children & Youth (CSI-CY), a new instrument based on the ICF-CY.

PubMed

Rowland, Charity; Fried-Oken, Melanie; Bowser, Gayl; Granlund, Mats; Lollar, Donald; Phelps, Randall; Simeonsson, Rune J; Steiner, Sandra A M

2016-09-01

Two studies are presented that evaluated the Communication Supports Inventory-Children & Youth (CSI-CY), an instrument designed to facilitate the development of communication-related educational goals for students with complex communication needs (CCN). The CSI-CY incorporates a code set based on the ICF-CY. The studies were designed to determine the effect of using the CSI-CY on IEP goals for students with CCN and to evaluate consumer satisfaction. In Study 1, sixty-one educators and speech-language pathologists were randomly assigned to either (a) provide a student's current IEP (control group) or (b) complete the CSI-CY prior to preparing a student's next IEP and to submit the new IEP (experimental group). Study 2 was a field test to generate consumer satisfaction data. Study 1 showed that IEP goals submitted by participants in the experimental group referenced CSI-CY-related content significantly more frequently than did those submitted by control participants. Study 2 revealed high satisfaction with the instrument. The code set basis of the CSI-CY extends the common language of the ICF-CY to practical educational use for children with CCN across diagnostic groups. The CSI-CY is well regarded as an instrument to inform the content of communication goals related to CCN. Implications for Rehabilitation The CSI-CY will guide rehabilitation professionals to develop goals for children with complex communication impairments. The CSI-CY is a new instrument that is based on the ICF-CY for documentation of communication goals.

Validity issues in the evaluation of a measure of science and mathematics teacher knowledge

NASA Astrophysics Data System (ADS)

Talbot, Robert M., III

2011-12-01

This study investigates the reliability and validity of an instrument designed to measure science and mathematics teachers' strategic knowledge . Strategic knowledge is conceptualized as a construct that is related to pedagogical knowledge and is comprised of two dimensions: Flexible Application (FA) and Student Centered Instruction (SCI). The FA dimension describes how a science teacher invokes, applies and modifies her instructional repertoire in a given teaching context. The SCI dimension describes how a science teacher conceives of a given situation as an opportunity for active engagement with the students. The Flexible Application of Student-Centered Instruction (FASCI) survey instrument was designed to measure science teachers' strategic knowledge by eliciting open-ended responses to scenario-based items. This study addresses the following overarching question: What are some potential issues pertaining to the validity of measures of science and mathematics teacher knowledge? Using a validity argument framework, different sources of evidence are identified, collected, and evaluated to examine support for a set or propositions related to the intended score interpretation and instrument use: FASCI scores can be used to compare and distinguish the strategic knowledge of novice science and mathematics teachers in the evaluation of teacher education programs. Three separate but related studies are presented and discussed. These studies focus on the reliability of FASCI scores, the effect of adding specific science content to the scenario-based items, and the observation of strategic knowledge in teaching practice. Serious issues were found with the reliability of scores from the FASCI instrument. It was also found that adding science content to the scenario-based items has an effect on FASCI scores, but not for the reason hypothesized. Finally, it was found that more evidence is needed to make stronger claims about the relationship between FASCI scores and novice teachers' practice. In concluding this work, a set of four recommendations are presented for others who are engaged in similar measure development efforts. These recommendations focus on the areas of construct definition, item design and development, rater recruitment and training, and the validation process.

Questionnaire for measuring organisational attributes in dental-care practices: psychometric properties and test-retest reliability.

PubMed

Goetz, Katja; Hasse, Philipp; Szecsenyi, Joachim; Campbell, Stephen M

2016-04-01

The consideration of organisational aspects, such as shared goals and clear communication, within the health care team is important to ensure good quality care. In primary health care, the instrument Survey of Organizational Attributes for Primary Care (SOAPC) is available to measure organisational attributes of care. However, there is no instrument available for dental care. The aim of the present study was to investigate psychometric properties and test-retest reliability of the version of SOAPC adapted for dental care, namely the Survey of Organizational Attributes in Dental Care (SOADC). The SOADC consists of 21 items in the following four subscales: communication; decision making; stress/chaos; and history of change. Convergent construct validity was measured using the job satisfaction scale. A total of 287 dental-care practices were asked to participate in the validation study. Psychometric properties and test-retest reliability were observed. A total of 43 dental-care practices responded to the survey. At baseline, 178 dental-care staff completed the questionnaire, and 4 weeks later 138 did so. Internal consistency, measured by Cronbach's alpha, was 0.718 or higher in the subscales. The test-retest reliability for each subscale and the overall SOADC score demonstrated good correlations over the 4-week test-retest interval, except for 'history of change'. A strong correlation with the aggregated job-satisfaction scale showed high convergent construct validity of SOADC. The consideration of organisational aspects from the perspective of dental-care teams is important for providing good quality of care. The SOADC is a reliable instrument with good psychometric properties and is suitable for the evaluation of organisational attributes in dental-care practices. © 2015 FDI World Dental Federation.

Development of an Educational Game to Set Up Surgical Instruments on the Mayo Stand or Back Table: Applied Research in Production Technology

PubMed Central

2017-01-01

Background Existing research suggests that digital games can be used effectively for educational purposes at any level of training. Perioperative nursing educators can use games to complement curricula, in guidance and staff development programs, to foster team collaboration, and to give support to critical thinking in nursing practice because it is a complex environment. Objective To describe the process of developing an educational game to set up surgical instruments on the Mayo stand or back table as a resource to assist the instructor in surgical instrumentation training for students and nursing health professionals in continued education. Methods The study was characterized by applied research in production technology. It included the phases of analysis and design, development, and evaluation. The objectives of the educational game were developed through Bloom’s taxonomy. Parallel to the physical development of the educational game, a proposed model for the use of digital elements in educational game activities was applied to develop the game content. Results The development of the game called “Playing with Tweezers” was carried out in 3 phases and was evaluated by 15 participants, comprising students and professional experts in various areas of knowledge such as nursing, information technology, and education. An environment was created with an initial screen, menu buttons containing the rules of the game, and virtual tour modes for learning and assessment. Conclusions The “digital” nursing student needs engagement, stimulation, reality, and entertainment, not just readings. “Playing with Tweezers” is an example of educational gaming as an innovative teaching strategy in nursing that encourages the strategy of involving the use of educational games to support theoretical or practical classroom teaching. Thus, the teacher does not work with only 1 type of teaching methodology, but with a combination of different methodologies. In addition, we cannot forget that skill training in an educational game does not replace curricular practice, but helps. PMID:28073736

Estimation of Sensory Pork Loin Tenderness Using Warner-Bratzler Shear Force and Texture Profile Analysis Measurements

PubMed Central

Choe, Jee-Hwan; Choi, Mi-Hee; Rhee, Min-Suk; Kim, Byoung-Chul

2016-01-01

This study investigated the degree to which instrumental measurements explain the variation in pork loin tenderness as assessed by the sensory evaluation of trained panelists. Warner-Bratzler shear force (WBS) had a significant relationship with the sensory tenderness variables, such as softness, initial tenderness, chewiness, and rate of breakdown. In a regression analysis, WBS could account variations in these sensory variables, though only to a limited proportion of variation. On the other hand, three parameters from texture profile analysis (TPA)—hardness, gumminess, and chewiness—were significantly correlated with all sensory evaluation variables. In particular, from the result of stepwise regression analysis, TPA hardness alone explained over 15% of variation in all sensory evaluation variables, with the exception of perceptible residue. Based on these results, TPA analysis was found to be better than WBS measurement, with the TPA parameter hardness likely to prove particularly useful, in terms of predicting pork loin tenderness as rated by trained panelists. However, sensory evaluation should be conducted to investigate practical pork tenderness perceived by consumer, because both instrumental measurements could explain only a small portion (less than 20%) of the variability in sensory evaluation. PMID:26954174

Estimation of Sensory Pork Loin Tenderness Using Warner-Bratzler Shear Force and Texture Profile Analysis Measurements.

PubMed

Choe, Jee-Hwan; Choi, Mi-Hee; Rhee, Min-Suk; Kim, Byoung-Chul

2016-07-01

This study investigated the degree to which instrumental measurements explain the variation in pork loin tenderness as assessed by the sensory evaluation of trained panelists. Warner-Bratzler shear force (WBS) had a significant relationship with the sensory tenderness variables, such as softness, initial tenderness, chewiness, and rate of breakdown. In a regression analysis, WBS could account variations in these sensory variables, though only to a limited proportion of variation. On the other hand, three parameters from texture profile analysis (TPA)-hardness, gumminess, and chewiness-were significantly correlated with all sensory evaluation variables. In particular, from the result of stepwise regression analysis, TPA hardness alone explained over 15% of variation in all sensory evaluation variables, with the exception of perceptible residue. Based on these results, TPA analysis was found to be better than WBS measurement, with the TPA parameter hardness likely to prove particularly useful, in terms of predicting pork loin tenderness as rated by trained panelists. However, sensory evaluation should be conducted to investigate practical pork tenderness perceived by consumer, because both instrumental measurements could explain only a small portion (less than 20%) of the variability in sensory evaluation.

Psychometric Properties of Patient-Facing eHealth Evaluation Measures: Systematic Review and Analysis

PubMed Central

Turvey, Carolyn L; Nazi, Kim M; Holman, John E; Hogan, Timothy P; Shimada, Stephanie L; Kennedy, Diana R

2017-01-01

Background Significant resources are being invested into eHealth technology to improve health care. Few resources have focused on evaluating the impact of use on patient outcomes A standardized set of metrics used across health systems and research will enable aggregation of data to inform improved implementation, clinical practice, and ultimately health outcomes associated with use of patient-facing eHealth technologies. Objective The objective of this project was to conduct a systematic review to (1) identify existing instruments for eHealth research and implementation evaluation from the patient’s point of view, (2) characterize measurement components, and (3) assess psychometrics. Methods Concepts from existing models and published studies of technology use and adoption were identified and used to inform a search strategy. Search terms were broadly categorized as platforms (eg, email), measurement (eg, survey), function/information use (eg, self-management), health care occupations (eg, nurse), and eHealth/telemedicine (eg, mHealth). A computerized database search was conducted through June 2014. Included articles (1) described development of an instrument, or (2) used an instrument that could be traced back to its original publication, or (3) modified an instrument, and (4) with full text in English language, and (5) focused on the patient perspective on technology, including patient preferences and satisfaction, engagement with technology, usability, competency and fluency with technology, computer literacy, and trust in and acceptance of technology. The review was limited to instruments that reported at least one psychometric property. Excluded were investigator-developed measures, disease-specific assessments delivered via technology or telephone (eg, a cancer-coping measure delivered via computer survey), and measures focused primarily on clinician use (eg, the electronic health record). Results The search strategy yielded 47,320 articles. Following elimination of duplicates and non-English language publications (n=14,550) and books (n=27), another 31,647 articles were excluded through review of titles. Following a review of the abstracts of the remaining 1096 articles, 68 were retained for full-text review. Of these, 16 described an instrument and six used an instrument; one instrument was drawn from the GEM database, resulting in 23 articles for inclusion. None included a complete psychometric evaluation. The most frequently assessed property was internal consistency (21/23, 91%). Testing for aspects of validity ranged from 48% (11/23) to 78% (18/23). Approximately half (13/23, 57%) reported how to score the instrument. Only six (26%) assessed the readability of the instrument for end users, although all the measures rely on self-report. Conclusions Although most measures identified in this review were published after the year 2000, rapidly changing technology makes instrument development challenging. Platform-agnostic measures need to be developed that focus on concepts important for use of any type of eHealth innovation. At present, there are important gaps in the availability of psychometrically sound measures to evaluate eHealth technologies. PMID:29021128

Effects of Practice Schedule on Wind Instrument Performance: A Preliminary Application of a Motor Learning Principle

ERIC Educational Resources Information Center

Stambaugh, Laura A.; Demorest, Steven M.

2010-01-01

The effects of three practice schedules on beginning instrumental achievement were explored. A total of 19 seventh-grade clarinet and saxophone students completed one 18-minute practice session using either a blocked schedule causing a low level of cognitive (contextual) interference, a hybrid schedule causing a moderate level of interference, or…

High School Instrumental Music Students' Attitudes and Beliefs regarding Practice: An Application of Attribution Theory

ERIC Educational Resources Information Center

Schatt, Matthew D.

2011-01-01

The purpose of this study was to explore high school band students' perspectives of instrumental music practice from within the attribution theory paradigm and to attempt to elucidate the secondary student's attitudes toward practice. High school band students from three Midwestern school districts (N = 218) completed a survey that was used to…

A conceptual framework for transferring research to practice.

PubMed

Simpson, D Dwayne

2002-06-01

Systematic evaluations of efforts to transfer research-based interventions and procedures into general practice at community drug treatment programs have been limited. However, practical experiences as well as results from studies of technology transfer and organizational behavior in related fields provide a basis for proposing a heuristic model of key factors that influence this process. The successful completion of four stages of activity typically involved in program change (exposure, adoption, implementation, and practice of new interventions) appears to be influenced by several organizational considerations (e.g., institutional readiness for change, resources, and climate) as well as staff attributes. Assessment instruments for measuring organizational functioning (based on ratings aggregated for staff and patients in a program) are introduced, along with preliminary evidence for their validity. A better conceptual understanding of the process of program change and common barriers that may be encountered is needed for effectively transferring research to practice.

EAACI Food Allergy and Anaphylaxis Guidelines. Food allergy health-related quality of life measures.

PubMed

Muraro, A; Dubois, A E J; DunnGalvin, A; Hourihane, J O'B; de Jong, N W; Meyer, R; Panesar, S S; Roberts, G; Salvilla, S; Sheikh, A; Worth, A; Flokstra-de Blok, B M J

2014-07-01

Instruments have been developed and validated for the measurement of health-related quality of life in patients with food allergy. This guideline has been prepared by the European Academy of Allergy and Clinical Immunology's (EAACI) Guidelines for Food Allergy and Anaphylaxis Group. It draws on a systematic review of the literature on quality of life instruments for food allergy and the Appraisal of Guidelines for Research & Evaluation (AGREE II) guideline development process. Guidance is provided on the use of such instruments in research, and the current limitations of their use in clinical practice are described. Gaps in current knowledge as well as areas of future interest are also discussed. This document is relevant to healthcare workers dealing with food-allergic patients, scientists engaging in food allergy research and policy makers involved in regulatory aspects concerning food allergy and safety. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Derisking Renewable Energy Investment. A Framework to Support Policymakers in Selecting Public Instruments to Promote Renewable Energy Investment in Developing Countries

DOE Office of Scientific and Technical Information (OSTI.GOV)

Waissbein, Oliver; Glemarec, Yannick; Bayraktar, Hande

2013-03-15

This report introduces an innovative framework to assist policymakers to quantitatively compare the impact of different public instruments to promote renewable energy. The report identifies the need to reduce the high financing costs for renewable energy in developing countries as an important task for policymakers acting today. The framework is structured in four stages: (i) risk environment, (ii) public instruments, (iii) levelised cost and (iv) evaluation. To illustrate how the framework can support decision-making in practice, the report presents findings from illustrative case studies in four developing countries. It then draws on these results to discuss possible directions for enhancingmore » public interventions to scale-up renewable energy investment. UNDP is also releasing a financial tool for policymakers to accompany the framework. The financial tool is available for download on the UNDP website.« less

Peer Learning in Instrumental Practicing

PubMed Central

Nielsen, Siw G.; Johansen, Guro G.; Jørgensen, Harald

2018-01-01

In higher music education (HME), the notion of “private teaching, private learning” has a long tradition, where the learning part rests on the student's individual practicing between instrumental lessons. However, recent research suggests that collaborative learning among peers is beneficial in several aspects, such as sense of belonging, motivation and self-efficacy. This is consistent with the concept of vicarious learning. In this study, we conducted a survey among bachelor music students in church music, performance or music education programs enrolled in a music academy (N = 96), where parts of the questionnaire addressed peer learning and peer's influence on the students's instrumental practicing, and the degree of satisfaction with their practicing. These issues were seen in relation to gender, musical genre and study program. Overall, the students reported engaging in peer learning related to their instrumental practicing, to various degrees. This involved discussing practicing matters with peers, and practicing together with peers. However, student's reports of their views on peer learning, show that they perceive it more beneficial than the amount of time reported doing it would indicate. No significant gender differences were found, but students within improvised music/jazz engaged the most in peer learning, and church music students the least. Neither the degree of engaging in peer learning nor reported influence from peers correlated significantly with the degree of satisfaction. We discuss whether a general dissatisfaction is caused by being in a competitive learning environment combined with a privatized culture for learning. Finally, we suggest that collaborative forums for instrumental practicing within HME institutions can function as constructive and supportive arenas to enhance students learning and inner motivation. PMID:29599738

Developing a Scale for Strategies Used during the Practice and Learning of Instrumental Music

ERIC Educational Resources Information Center

Uygun, Mehtap Aydiner; Kilinçer, Özlem

2017-01-01

The purpose of this study is to develop a valid and reliable scale to identify the strategies students who study instrumental music use during the practice and learning of instrumental music based on their own responses. The study group comprised of 358 students studying music education in five universities in the academic year of 2015 to 2016.…

External evaluation of the Dimension Vista 1500® intelligent lab system.

PubMed

Bruneel, Arnaud; Dehoux, Monique; Barnier, Anne; Boutten, Anne

2012-09-01

Dimension Vista® analyzer combines four technologies (photometry, nephelometry, V-LYTE® integrated multisensor potentiometry, and LOCI® chemiluminescence) into one high-throughput system. We assessed analytical performance of assays routinely performed in our emergency laboratory according to the VALTEC protocol, and practicability. Precision was good for most parameters. Analytical domain was large and suitable for undiluted analysis in most clinical settings encountered in our hospital. Data were comparable and correlated to our routine analyzers (Roche Modular DP®, Abbott AXSYM®, Siemens Dimension® RxL, and BN ProSpec®). Performance of nephelometric and LOCI modules was excellent. Functional sensitivity of high-sensitivity C-reactive protein and cardiac troponin I were 0.165 mg/l and 0.03 ng/ml, respectively (coefficient of variation; CV < 10%). The influence of interfering substances (i.e., hemoglobin, bilirubin, or lipids) was moderate, and Dimension Vista® specifically alerted for interference according to HIL (hemolysis, icterus, lipemia) indices. Good instrument performance and full functionality (no reagent or sample carryover in the conditions evaluated, effective sample-volume detection, and clot detection) were confirmed. Simulated routine testing demonstrated excellent practicability, throughput, ease of use of software and security. Performance and practicability of Dimension Vista® are highly suitable for both routine and emergency use. Since no volume detection and thus no warning is available on limited sample racks, pediatric samples require special caution to the Siemens protocol to be analyzed in secured conditions. Our experience in routine practice is also discussed, i.e., the impact of daily workload, "manual" steps resulting from dilutions and pediatric samples, maintenances, flex hydration on instrument's performance on throughput and turnaround time. © 2012 Wiley Periodicals, Inc.

Development of a quality-of-life instrument for autoimmune bullous disease: the Autoimmune Bullous Disease Quality of Life questionnaire.

PubMed

Sebaratnam, Deshan F; Hanna, Anna Marie; Chee, Shien-ning; Frew, John W; Venugopal, Supriya S; Daniel, Benjamin S; Martin, Linda K; Rhodes, Lesley M; Tan, Jeremy Choon Kai; Wang, Charles Qian; Welsh, Belinda; Nijsten, Tamar; Murrell, Dédée F

2013-10-01

Quality-of-life (QOL) evaluation is an increasingly important outcome measure in dermatology, with disease-specific QOL instruments being the most sensitive to changes in disease status. To develop a QOL instrument specific to autoimmune bullous disease (AIBD). A comprehensive item generation process was used to build a 45-item pilot Autoimmune Bullous Disease Quality of Life (ABQOL) questionnaire, distributed to 70 patients with AIBD. Experts in bullous disease refined the pilot ABQOL before factor analysis was performed to yield the final ABQOL questionnaire of 17 questions. We evaluated validity and reliability across a range of indices. Australian dermatology outpatient clinics and private dermatology practices. PATIENTS AND EXPOSURE: Patients with a histological diagnosis of AIBD. The development of an AIBD-specific QOL instrument. Face and content validity were established through the comprehensive patient interview process and expert review. In terms of convergent validity, the ABQOL was found to have a moderate correlation with scores on the Dermatology Life Quality Index (R = 0.63) and the General Health subscale of the 36-Item Short Form Health Survey (R = 0.69; P = .009) and low correlation with the Pemphigus Disease Area Index (R = 0.42) and Autoimmune Bullous Disease Skin Disorder Intensity Score (R = 0.48). In terms of discriminant validity, the ABQOL was found to be more sensitive than the Dermatology Life Quality Index (P = .02). The ABQOL was also found to be a reliable instrument evaluated by internal consistency (Cronbach α coefficient, 0.84) and test-retest reliability (mean percentage variation, 0.92). The ABQOL has been shown to be a valid and reliable instrument that may serve as an end point in clinical trials. Future work should include incorporating patient weighting on questions to further increase content validity and translation of the measure to other languages. anzctr.org.au Identifier: ACTRN12612000750886.

[Critical evaluation of the first draft of DSM-V].

PubMed

Frances, A

2011-02-16

Critical evaluation of DSM-V first draft This is an evaluation of the first DSM-V (Diagnostic and Statistical Manual of Mental Disorders-V) draft from the DSM-IV chairman. First, a brief history of DSM is reported. Then, major reasons for present controversies and the threat they raise to APA leadership in the field are discussed. Third point is careful recollection of the several conflicting aspects of the DSM-V draft, paying attention to drawbacks and their implications for future clinical practice, research and forensic activity. Comment is finally provided about APA (American Psychiatric Association) decisions aimed at reaching more consensus about this basic instrument of American psychiatry.

Constructing objective tests

NASA Astrophysics Data System (ADS)

Aubrecht, Gordon J.; Aubrecht, Judith D.

1983-07-01

True-false or multiple-choice tests can be useful instruments for evaluating student progress. We examine strategies for planning objective tests which serve to test the material covered in science (physics) courses. We also examine strategies for writing questions for tests within a test blueprint. The statistical basis for judging the quality of test items are discussed. Reliability, difficulty, and discrimination indices are defined and examples presented. Our recommendation are rather easily put into practice.

Fiber-optic instrumentation: Cryogenic sensor model description. [for measurement of conditions in cryogenic liquid propellant tanks

NASA Technical Reports Server (NTRS)

Sharma, M. M.

1979-01-01

An assessment and determination of technology requirements for developing a demonstration model to evaluate feasibility of practical cryogenic liquid level, pressure, and temperature sensors is presented. The construction of a demonstration model to measure characteristics of the selected sensor and to develop test procedures are discussed as well as the development of an appropriate electronic subsystem to operate the sensors.

Design, validation, and use of an evaluation instrument for monitoring systemic reform

NASA Astrophysics Data System (ADS)

Scantlebury, Kathryn; Boone, William; Butler Kahle, Jane; Fraser, Barry J.

2001-08-01

Over the past decade, state and national policymakers have promoted systemic reform as a way to achieve high-quality science education for all students. However, few instruments are available to measure changes in key dimensions relevant to systemic reform such as teaching practices, student attitudes, or home and peer support. Furthermore, Rasch methods of analysis are needed to permit valid comparison of different cohorts of students during different years of a reform effort. This article describes the design, development, validation, and use of an instrument that measures student attitudes and several environment dimensions (standards-based teaching, home support, and peer support) using a three-step process that incorporated expert opinion, factor analysis, and item response theory. The instrument was validated with over 8,000 science and mathematics students, taught by more than 1,000 teachers in over 200 schools as part of a comprehensive assessment of the effectiveness of Ohio's systemic reform initiative. When the new four-factor, 20-item questionnaire was used to explore the relative influence of the class, home, and peer environment on student achievement and attitudes, findings were remarkably consistent across 3 years and different units and methods of analysis. All three environments accounted for unique variance in student attitudes, but only the environment of the class accounted for unique variance in student achievement. However, the class environment (standards-based teaching practices) was the strongest independent predictor of both achievement and attitude, and appreciable amounts of the total variance in attitudes were common to the three environments.

The development of an instrument to measure factors that influence self-perceived dignity.

PubMed

Vlug, Mariska G; de Vet, Henrica C W; Pasman, H Roeline W; Rurup, Mette L; Onwuteaka-Philipsen, Bregje D

2011-05-01

Preserving dignity can be considered as a goal of palliative care. To provide dignity-conserving care, it is relevant to identify the factors that influence a patient's self-perceived dignity. This study aims to develop an instrument to measure factors affecting self-perceived dignity that has good content validity and is appropriate for use in practice. Data were collected in the Advance Directives Cohort Study. In 2008, the cohort received a questionnaire with 31 items that might influence one's self-perceived dignity. For a subsample of people with poor health (n = 292), we analyzed which items could be removed because of the mean scores for presence of the item and its influence on dignity. The 31 items fell into four domains: evaluation of self in relation to others, functional status, mental state, and care and situational aspects. Mean scores for presence and influence on dignity showed large differences and were not correlated. Six items were scarcely present and did not substantially affect self-perceived dignity. Because three of these were expected to influence dignity in other settings, only three items could be removed and two items could be combined into one. After calculating correlations between conceptually similar items, one extra item could be removed. Reducing the instrument to 26 items and dichotomizing the answer option for presence increases its feasibility for use in practice. The instrument offers an important step to better understanding the phenomenon of self-perceived dignity by gaining information directly from patients.

Assessing hospitals' clinical risk management: Development of a monitoring instrument

PubMed Central

2010-01-01

Background Clinical risk management (CRM) plays a crucial role in enabling hospitals to identify, contain, and manage risks related to patient safety. So far, no instruments are available to measure and monitor the level of implementation of CRM. Therefore, our objective was to develop an instrument for assessing CRM in hospitals. Methods The instrument was developed based on a literature review, which identified key elements of CRM. These elements were then discussed with a panel of patient safety experts. A theoretical model was used to describe the level to which CRM elements have been implemented within the organization. Interviews with CRM practitioners and a pilot evaluation were conducted to revise the instrument. The first nationwide application of the instrument (138 participating Swiss hospitals) was complemented by in-depth interviews with 25 CRM practitioners in selected hospitals, for validation purposes. Results The monitoring instrument consists of 28 main questions organized in three sections: 1) Implementation and organizational integration of CRM, 2) Strategic objectives and operational implementation of CRM at hospital level, and 3) Overview of CRM in different services. The instrument is available in four languages (English, German, French, and Italian). It allows hospitals to gather comprehensive and systematic data on their CRM practice and to identify areas for further improvement. Conclusions We have developed an instrument for assessing development stages of CRM in hospitals that should be feasible for a continuous monitoring of developments in this important area of patient safety. PMID:21144039

Best practices in Web-based courses: generational differences across undergraduate and graduate nursing students.

PubMed

Billings, Diane M; Skiba, Diane J; Connors, Helen R

2005-01-01

The demand for online courses is greatly increasing across all levels of the curriculum in higher education. With this change in teaching and learning strategies comes the need for quality control to determine best practices in online learning communities. This study examines the differences in student perceptions of the use of technology, educational practices, and outcomes between undergraduate and graduate students enrolled in Web-based courses. The multisite study uses the benchmarking process and the Flashlight Program Evaluating Educational Uses of the Web in Nursing survey instrument to study best practices and examine generational differences between the two groups of students. The outcomes of the study establish benchmarks for quality improvement in online learning. The results support the educational model for online learning and postulates about generational differences for future study.

The role of organizational context in moderating the effect of research use on pain outcomes in hospitalized children: a cross sectional study.

PubMed

Yamada, Janet; Squires, Janet E; Estabrooks, Carole A; Victor, Charles; Stevens, Bonnie

2017-01-23

Despite substantial research on pediatric pain assessment and management, health care professionals do not adequately incorporate this knowledge into clinical practice. Organizational context (work environment) is a significant factor in influencing outcomes; however, the nature of the mechanisms are relatively unknown. The objective of this study was to assess how organizational context moderates the effect of research use and pain outcomes in hospitalized children. A cross-sectional survey was undertaken with 779 nurses in 32 patient care units in 8 Canadian pediatric hospitals, following implementation of a multifaceted knowledge translation intervention, Evidence-based Practice for Improving Quality (EPIQ). The influence of organizational context was assessed in relation to pain process (assessment and management) and clinical (pain intensity) outcomes. Organizational context was measured using the Alberta Context Tool that includes: leadership, culture, evaluation, social capital, informal interactions, formal interactions, structural and electronic resources, and organizational slack (staff, space, and time). Marginal modeling estimated the effects of instrumental research use (direct use of research knowledge) and conceptual research use (indirect use of research knowledge) on pain outcomes while examining the effects of context. Six of the 10 organizational context factors (culture, social capital, informal interactions, resources, and organizational slack [space and time]) significantly moderated the effect of instrumental research use on pain assessment; four factors (culture, social capital, resources and organizational slack time) moderated the effect of conceptual research use and pain assessment. Only two factors (evaluation and formal interactions) moderated the effect of instrumental research use on pain management. All organizational factors except slack space significantly moderated the effect of instrumental research use on pain intensity; informal interactions and organizational slack space moderated the effect of conceptual research use and pain intensity. Many aspects of organizational context consistently moderated the effects of instrumental research use on pain assessment and pain intensity, while only a few influenced conceptual use of research on pain outcomes. Organizational context factors did not generally influence the effect of research use on pain management. Further research is required to further explore the relationships between organizational context and pain management outcomes.

Praxis teaching in the ambit of learning assessment of endodontics in a Chilean university.

PubMed

Sánchez-Sanhueza, Gabriela; Cisterna Cabrera, Francisco

2015-01-01

The practice of assessing must ensure that the outcome of the process be a reflection of the learning achieved by students. The aim of this study was to describe the essential attributes of the praxis teacher in the area of Endodontics Learning Evaluation, in the School of Dentistry at the Universidad de Concepción, Chile. This study is designed to diagnose the reliability and objectivity of assessing the learning process, as a framework for innovation, and with a focus on evaluating endodontics skills. This hermeneutic study has a qualitative methodology. It was based on in-depth semi-structured interviews applied to 14 students and 5 teachers, and two focus groups consisting of eight students each. When the study was conducted, the research findings indicated that the evaluation process was not objective and lacked established criteria, and especially a guide to determining the skills. The theoretical evaluation was only summative. The formative role was not formally established. The subjects answered mostly psychometric instruments by multiple choice and with short or extended answers. It was concluded that teacher practice held meaning only if it was backed by academic expertise in the area of endodontics, according to no clear criteria or validated instruments. On the other hand, the groundwork was in place for using an epistemological style in endodontics. This provided a basis for the actual improvements, and allowed the tools developed to be dialectically interconnected with teacher experience. A quantitative analysis was not considered, but could be supplemented later to enhance the data analysis in a future study.

Non-formal educator use of evaluation results.

PubMed

Baughman, Sarah; Boyd, Heather H; Franz, Nancy K

2012-08-01

Increasing demands for accountability in educational programming have resulted in increasing calls for program evaluation in educational organizations. Many organizations include conducting program evaluations as part of the job responsibilities of program staff. Cooperative Extension is a complex organization offering non-formal educational programs through land grant universities. Many Extension services require non-formal educational program evaluations be conducted by field-based Extension educators. Evaluation research has focused primarily on the efforts of professional, external evaluators. The work of program staff with many responsibilities including program evaluation has received little attention. This study examined how field based Extension educators (i.e. program staff) in four Extension services use the results of evaluations of programs that they have conducted themselves. Four types of evaluation use are measured and explored; instrumental use, conceptual use, persuasive use and process use. Results indicate that there are few programmatic changes as a result of evaluation findings among the non-formal educators surveyed in this study. Extension educators tend to use evaluation results to persuade others about the value of their programs and learn from the evaluation process. Evaluation use is driven by accountability measures with very little program improvement use as measured in this study. Practical implications include delineating accountability and program improvement tasks within complex organizations in order to align evaluation efforts and to improve the results of both. There is some evidence that evaluation capacity building efforts may be increasing instrumental use by educators evaluating their own programs. Copyright © 2011 Elsevier Ltd. All rights reserved.

A psychometric evaluation of the University of Auckland General Practice Report of Educational Environment: UAGREE.

PubMed

Eggleton, Kyle; Goodyear-Smith, Felicity; Henning, Marcus; Jones, Rhys; Shulruf, Boaz

2017-03-01

The aim of this study was to develop an instrument (University of Auckland General Practice Report of Educational Environment: UAGREE) with robust psychometric properties that measured the educational environment of undergraduate primary care. The questions were designed to incorporate measurements of the teaching of cultural competence. Following a structured consensus process and an initial pilot, a list of 55 questions was developed. All Year 5 and 6 students completing a primary care attachment at Auckland University were invited to complete the questionnaire. The results were analysed using exploratory factor analysis and confirmatory factor analysis resulting in a 16-item instrument. Three factors were identified explaining 53% of the variance. The items' reliability within the factors were high (Learning: 0.894; Teaching: 0.871; Cultural competence: 0.857). Multiple groups analysis by gender; and separately across ethnic groups did not find significant differences between groups. UAGREE is a specific instrument measuring the undergraduate primary care educational environment. Its questions fit within established theoretical educational environment frameworks and the incorporation of cultural competence questions reflects the importance of teaching cultural competence within medicine. The psychometric properties of UAGREE suggest that it is a reliable and valid measure of the primary care education environment.

[Benchmarking using different measurement instruments and the management of measurement variability].

PubMed

Blankers, M; Barendregt, M; Dekker, J J M

2016-01-01

In mental health care centres in the Netherlands outcome data are collected using a variety of outcome instruments. This may have implications for the comparability of outcome results between different centres. To discuss recent findings regarding the extent to which the eight instruments currently used in clinical practice report comparable results. Our study is based on a combination of literature review and empirical research. The results obtained with the eight instruments are not equivalent. Patients symptom reductions appear larger with some instruments than with others. The current practice of benchmarking in the Dutch mental health system would have greater validity if the number of different instruments would be reduced. State-of-the-art calibration studies are necessary to validate the comparability of the remaining instruments. Ideally, all mental health centres will soon use one instrument per care domain to measure treatment outcome.

Instruments to measure behavioural and psychological symptoms of dementia.

PubMed

van der Linde, Rianne M; Stephan, Blossom C M; Dening, Tom; Brayne, Carol

2014-03-01

Reliable and valid measurement of behavioural and psychological symptoms of dementia (BPSD) is important for research and clinical practice. Here we provide an overview of the different instruments and discuss issues involved in the choice of the most appropriate instrument to measure BPSD in research. A list of BPSD instruments was generated. For each instrument Pubmed and SCOPUS were searched for articles that reported on their use or quality. Eighty-three instruments that are used to measure BPSD were identified. Instruments differ in length and detail, whether the interview is with participants, informants or by observation, the target sample and the time frames for use. Reliability and validity is generally good, but reported in few independent samples. When choosing a BPSD instrument for research the research question should be carefully scrutinised and the symptoms of interest, population, quality, detail, time frame and practical issues should be considered. Copyright © 2014 John Wiley & Sons, Ltd.

Instrument Reporting Practices in Second Language Research

ERIC Educational Resources Information Center

Derrick, Deirdre J.

2016-01-01

Second language (L2) researchers often have to develop or change the instruments they use to measure numerous constructs (Norris & Ortega, 2012). Given the prevalence of researcher-developed and -adapted data collection instruments, and given the profound effect instrumentation can have on results, thorough reporting of instrumentation is…

Assessment of mastication in healthy children and children with cerebral palsy: a validity and consistency study.

PubMed

Remijn, L; Speyer, R; Groen, B E; Holtus, P C M; van Limbeek, J; Nijhuis-van der Sanden, M W G

2013-05-01

The aim of this study was to develop the Mastication Observation and Evaluation instrument for observing and assessing the chewing ability of children eating solid and lumpy foods. This study describes the process of item definition and item selection and reports the content validity, reproducibility and consistency of the instrument. In the developmental phase, 15 experienced speech therapists assessed item relevance and descriptions over three Delphi rounds. Potential items were selected based on the results from a literature review. At the initial Delphi round, 17 potential items were included. After three Delphi rounds, 14 items that regarded as providing distinctive value in assessment of mastication (consensus >75%) were included in the Mastication Observation and Evaluation instrument. To test item reproducibility and consistency, two experts and five students evaluated video recordings of 20 children (10 children with cerebral palsy aged 29-65 months and 10 healthy children aged 11-42 months) eating bread and a biscuit. Reproducibility was estimated by means of the intraclass correlation coefficient (ICC). With the exception of one item concerning chewing duration, all items showed good to excellent intra-observer agreement (ICC students: 0.73-1.0). With the exception of chewing duration and number of swallows, inter-observer agreement was fair to excellent for all items (ICC experts: 0.68-1.0 and ICC students: 0.42-1.0). Results indicate that this tool is a feasible instrument and could be used in clinical practice after further research is completed on the reliability of the tool. © 2013 Blackwell Publishing Ltd.

Rapid assessment of agents of biological terrorism: defining the differential diagnosis of inhalational anthrax using electronic communication in a practice-based research network.

PubMed

Temte, Jonathan L; Anderson, Anna Lisa

2004-01-01

Early detection of bioterrorism requires assessment of diagnoses assigned to cases of rare diseases with which clinicians have little experience. In this study, we evaluated the process of defining the differential diagnosis for inhalational anthrax using electronic communication within a practice-based research network (PBRN) and compared the results with those obtained from a nationwide random sample of family physicians with a mailed instrument. We distributed survey instruments by e-mail to 55 physician members of the Wisconsin Research Network (WReN), a regional PBRN. The instruments consisted of 3 case vignettes randomly drawn from a set describing 11 patients with inhalational anthrax, 2 with influenza A, and 1 with Legionella pneumonia. Physicians provided their most likely nonanthrax diagnosis, along with their responses to 4 yes-or-no management questions for each case. Physicians who had not responded at 1 week received a second e-mail with the survey instrument. The comparison group consisted of the nationwide sample of physicians who completed mailed survey instruments. Primary outcome measures were response rate, median response time, and frequencies of diagnostic categories assigned to cases of inhalational anthrax. The PBRN response rate compared favorably with that of the national sample (47.3% vs 37.0%; P = not significant). The median response time for the PBRN was significantly shorter than that for the national sample (2 vs 28 days; P < .001). No significant differences were found between the PBRN and the Midwest subset of the national sample in the frequencies of major diagnostic categories or in case management. Electronic means of creating differential diagnoses for rare infectious diseases of national significance is feasible within PBRNs. Information is much more rapidly acquired and is consistent with that obtained by conventional methods.

Promoting healthy eating and active playtime by connecting to nature families with preschool children: evaluation of pilot study "Play&Grow".

PubMed

Sobko, Tanja; Jia, Zhenzhen; Kaplan, Matthew; Lee, Alfred; Tseng, Chia-Huei

2017-04-01

This pilot project aimed to evaluate the "Play&Grow" program which promotes age-appropriate dietary habits and playtime healthy routines through "connectedness to nature" experiences in Hong Kong families with young children. Thirty-eight preschoolers (aged 33.97 ± 9.38 mo), mothers, and their domestic workers were recruited. The families attended one workshop/week for a 4-mo period, consisting of: (i) health topic; (ii) food games; (iii) nature-related outdoor activities. Feeding practices, particularly Promoting and Encouragement to eat (PE) and Instrumental Feeding (IF) improved after the intervention (P = 0.008 and P = 0.016, respectively). Mother's BMI, responsibility for child's meal, child's birth weight had a bearing on the improvement of PE, r 2 = 0.243, F(3,33) = 3.54, P = 0.025. Domestic helper's responsibility for child's cooking and her IF practices could predict child's picky eating (r 2 = 0.203, F(2,34) = 4.322, P = 0.021). Mother's responsibility for child and helper's responsibility for cooking could predict child's consumption of salty foods (r 2 = 0.252, F(2,34) = 5.737, P = 0.007). Physical activity of caregivers improved after the intervention. The pilot confirmed the design, protocols, evaluation instruments, and logistics of the study. Modified "Play&Grow" intervention will be conducted in a more rigorous randomized controlled trial to determine the long-term impact on obesity prevention in Hong Kong.

Using Contact Forces and Robot Arm Accelerations to Automatically Rate Surgeon Skill at Peg Transfer.

PubMed

Brown, Jeremy D; O Brien, Conor E; Leung, Sarah C; Dumon, Kristoffel R; Lee, David I; Kuchenbecker, Katherine J

2017-09-01

Most trainees begin learning robotic minimally invasive surgery by performing inanimate practice tasks with clinical robots such as the Intuitive Surgical da Vinci. Expert surgeons are commonly asked to evaluate these performances using standardized five-point rating scales, but doing such ratings is time consuming, tedious, and somewhat subjective. This paper presents an automatic skill evaluation system that analyzes only the contact force with the task materials, the broad-bandwidth accelerations of the robotic instruments and camera, and the task completion time. We recruited N = 38 participants of varying skill in robotic surgery to perform three trials of peg transfer with a da Vinci Standard robot instrumented with our Smart Task Board. After calibration, three individuals rated these trials on five domains of the Global Evaluative Assessment of Robotic Skill (GEARS) structured assessment tool, providing ground-truth labels for regression and classification machine learning algorithms that predict GEARS scores based on the recorded force, acceleration, and time signals. Both machine learning approaches produced scores on the reserved testing sets that were in good to excellent agreement with the human raters, even when the force information was not considered. Furthermore, regression predicted GEARS scores more accurately and efficiently than classification. A surgeon's skill at robotic peg transfer can be reliably rated via regression using features gathered from force, acceleration, and time sensors external to the robot. We expect improved trainee learning as a result of providing these automatic skill ratings during inanimate task practice on a surgical robot.

On the practicality of emergency surgery during long-duration space missions.

PubMed

Dawson, David L

2008-07-01

While discussions of the practicality of surgery in space often focus on technical issues, such as adapting instrumentation and procedures for use in microgravity, programmatic issues need to be addressed if meaningful capabilities for emergency surgery are to be considered for human exploration missions beyond low Earth orbit. Advanced technologies that have been evaluated, including simulation-enhanced training, telementoring, or robotic assistance, might help prepare or augment a crew medical officer, but a physician with advanced training and relevant experience will be needed if surgical capabilities beyond basic emergency aid are to be considered. Specific operational roles for physician-astronauts should be established.

The Development and Validation of a Transformational Leadership Survey for Substance Use Treatment Programs

PubMed Central

Edwards, Jennifer R.; Knight, Danica K.; Broome, Kirk M.; Flynn, Patrick M.

2014-01-01

Directors in substance use treatment programs are increasingly required to respond to external economic and socio-political pressures. Leadership practices that promote innovation can help offset these challenges. Using focus groups, factor analysis, and validation instruments, the current study developed and established psychometrics for the Survey of Transformational Leadership. In 2008, clinical directors were evaluated on leadership practices by 214 counselors within 57 programs in four U.S. regions. Nine themes emerged: integrity, sensible risk, demonstrates innovation, encourages innovation, inspirational motivation, supports others, develops others, delegates tasks, and expects excellence. Study implications, limitations and suggested future directions are discussed. Funding from NIDA. PMID:20509734

Automated in-clinic hematology instruments for small animal practitioners: what is available, what can they really do, and how do i make a choice?

PubMed

Welles, Elizabeth G

2012-01-01

To have an in-clinic hematology instrument in your practice and how it is used are decisions that precede the purchase of an instrument. Advantages and limitations of the various instruments should be considered. Initial purchase cost, reagent/disposable costs, costs of training personnel in the use and care of the instrument, and service/repair contract costs need to be considered. Once the decision is made to have an in-office hematology instrument in your practice you should benefit from having nearly immediate CBC data results that enable you to provide better quality medicine, more rapid clinical decisions, more closely monitor patients for complications of disease or response to treatment. It should also generate revenue and allow some of your staff members to expand and develop their technical skills as they learn the nuances of a new diagnostic tool and how to provide you with the most accurate CBC information. In the final assessment, the addition of an in-office hematology instrument should improve the quality and efficiency of the medical care you provide patients and generate additional practice income.

The evolution and development of an instrument to measure essential professional nursing practices.

PubMed

Kramer, Marlene; Brewer, Barbara B; Halfer, Diana; Hnatiuk, Cynthia Nowicki; MacPhee, Maura; Schmalenberg, Claudia

2014-11-01

Nursing continues to evolve from a task-oriented occupation to a holistic professional practice. Increased professionalism requires accurate measurement of care processes and practice. Nursing studies often omit measurement of the relationship between structures in the work environment and processes of care or between processes of care and patient outcomes. Process measurement is integral to understanding and improving nursing practice. This article describes the development of an updated Essentials of Magnetism process measurement instrument for clinical nurses (CNs) practicing on inpatient units in hospitals. It has been renamed Essential Professional Nursing Practices: CN.

Postoperative Swallowing Assessment After Lung Transplantation.

PubMed

Baumann, Brooke; Byers, Sara; Wasserman-Wincko, Tamara; Smith, Libby; Hathaway, Bridget; Bhama, Jay; Shigemura, Norihisa; Hayanga, J W Awori; D'Cunha, Jonathan; Johnson, Jonas T

2017-07-01

Dysphagia, aspiration, and potential pneumonia represent a major source of morbidity in patients undergoing lung transplantation. Conditions that potentiate dysphagia and aspiration include frailty and prolonged intubation. Our group of speech-language pathologists has been actively involved in performance of a bedside evaluation of swallowing, and instrumental evaluation of swallowing with modified barium swallow, and postoperative management in patients undergoing lung transplantation. All lung transplant patients from April 2009 to September 2012 were evaluated retrospectively. A clinical bedside examination was performed by the speech-language pathology team, followed by a modified barium swallow or fiberoptic endoscopic evaluation of swallowing. A total of 321 patients were referred for evaluation. Twenty-four patients were unable to complete the evaluation. Clinical signs of aspiration were apparent in 160 patients (54%). Deep laryngeal penetration or aspiration were identified in 198 (67%) patients during instrumental testing. A group of 81 patients (27%) had an entirely normal clinical examination, but were found to have either deep penetration or aspiration. The majority of patients aspirate after lung transplantation. Clinical bedside examination is not sensitive enough and will fail to identify patients with silent aspiration. A standard of practice following lung transplantation has been established that helps avoid postoperative aspiration associated with complications. Copyright © 2017 The Society of Thoracic Surgeons. Published by Elsevier Inc. All rights reserved.

Validating an instrument for selecting interventions to change physician practice patterns: a Michigan Consortium for Family Practice Research study.

PubMed

Green, Lee A; Gorenflo, Daniel W; Wyszewianski, Leon

2002-11-01

The goal of this study was to develop a psychometric instrument that classified physiciansamprsquo response styles to new information as seekers, receptives, traditionalists, or pragmatists. This classification was based on specific combinations of 3 scales: (a) belief in evidence vs experience as the basis of knowledge, (b) willingness to diverge from common or previous practice, and (c) sensitivity to pragmatic concerns of practice. The instrument will help focus efforts to change practice more accurately. This was a cross-sectional study of physician responses to a psychometric instrument. Paper-and-pencil survey forms were distributed to 3 waves of physicians, with revision for improved internal consistency at each iteration. Participants were 1393 primary care physicians at continuing education events in the Midwest or at primary care clinic sites in the Veteransamprsquo Health Administration system. Internal consistency was measured by factor analysis with orthogonal rotation and Cronbachamprsquos alpha. A total of 1287 usable instruments were returned (106, 1120, and 61 in the 3 iterations, respectively), representing approximately three fourths of distributed forms. Final scale internal consistencies were a = 0.79, b = 0.74, and c = 0.68. The patterns of scores on the 3 scales were consistent with the predictions of the theoretical scheme of physician types. The "seeker" type was the rarest, at fewer than 3%. It is possible to reliably classify physicians into categories that a theoretical framework predicts will respond differently to different interventions for implementing guidelines and translating research findings into practice. The next step is to demonstrate that the classification predicts physician practice behavior.

Patient-assessed measures of health outcome in asthma: a comparison of four approaches.

PubMed

Garratt, A M; Hutchinson, A; Russell, I

2000-06-01

The study compares the psychometric properties of four different approaches to patient-assessed health outcomes in asthma, including the Asthma Quality of Life Questionnaire (AQLQ), Newcastle Asthma Symptoms Questionnaire (NASQ), SF-12 and EuroQol. The instruments were administered by means of a self-completed postal questionnaire to 394 patients recruited from general practices in the North East of England. Patients completed a follow-up questionnaire at 6 months. The levels of missing data were assessed and instrument scores compared using correlational analysis. Scores were related to self-reports of smoking behaviour, socioeconomic status and health transition. Responsiveness was assessed using standardized response means. Two hundred and thirty-five patients took part in the study giving a response rate of 59.6%. There was a relatively large amount of missing data for the individualized section of the AQLQ. Correlational analysis provided evidence of convergent validity between the specific instruments; the largest correlation was found between NASQ scores and the asthma symptoms scale of the AQLQ (r = 0.84). The NASQ was found to be the most powerful at discriminating between smokers and non-smokers. All four instruments were linearly related to self-reported asthma transition (P<0.05); the specific instruments having the strongest association. The specific instruments showed good levels of responsiveness with the NASQ producing a large SRM of 0.82. SRMs for the AQLQ were of a moderate to large size (0.32-0.77) and the SRMs for the SF-12 and EuroQol were of a small size. The two specific instruments are capable of greater levels of discrimination between groups of patients and are more responsive to changes in health than the generic SF-12 and EuroQol. The greater responsiveness of the NASQ is probably due to its focus being restricted to symptoms of asthma compared to the broader focus of the AQLQ domains. The NASQ has a strong relationship with the AQLQ and is a more practical instrument that is more acceptable to patients. However, the AQLQ does measure broader patient concerns. The SF-12 and EuroQol have greater potential to capture side-effects and have wider scope for application in economic evaluation.

Teachers' Engagement with Research Texts: Beyond Instrumental, Conceptual or Strategic Use

ERIC Educational Resources Information Center

Cain, Tim

2015-01-01

Recent policy statements have urged greater use of research to guide teaching, with some commentators calling for a "revolution" in evidence-based practice. Scholarly literature suggests that research can influence policy and practice in "instrumental," "conceptual" or "strategic" ways. This paper analyses…

Resource-use measurement based on patient recall: issues and challenges for economic evaluation.

PubMed

Thorn, Joanna C; Coast, Joanna; Cohen, David; Hollingworth, William; Knapp, Martin; Noble, Sian M; Ridyard, Colin; Wordsworth, Sarah; Hughes, Dyfrig

2013-06-01

Accurate resource-use measurement is challenging within an economic evaluation, but is a fundamental requirement for estimating efficiency. Considerable research effort has been concentrated on the appropriate measurement of outcomes and the policy implications of economic evaluation, while methods for resource-use measurement have been relatively neglected. Recently, the Database of Instruments for Resource Use Measurement (DIRUM) was set up at http://www.dirum.org to provide a repository where researchers can share resource-use measures and methods. A workshop to discuss the issues was held at the University of Birmingham in October 2011. Based on material presented at the workshop, this article highlights the state of the art of UK instruments for resource-use data collection based on patient recall. We consider methodological issues in the design and analysis of resource-use instruments, and the challenges associated with designing new questionnaires. We suggest a method of developing a good practice guideline, and identify some areas for future research. Consensus amongst health economists has yet to be reached on many aspects of resource-use measurement. We argue that researchers should now afford costing methodologies the same attention as outcome measurement, and we hope that this Current Opinion article will stimulate a debate on methods of resource-use data collection and establish a research agenda to improve the precision and accuracy of resource-use estimates.

Agents of support: psychometric properties of the Cancer Perceived Agents of Social Support (CPASS) questionnaire.

PubMed

Goldzweig, Gil; Hasson-Ohayon, Ilanit; Meirovitz, Amichay; Braun, Michal; Hubert, Ayala; Baider, Lea

2010-11-01

The current study presents the development and the evaluation of the psychometric properties of the Cancer Perceived Agents of Social Support (CPASS). The CPASS is a new self-rating instrument devised in order to enable both cancer patients and their spouses to report on the level of perceived social support they get. The CPASS evaluates the support given by different agents of support (spouse, family, friends and spiritual or religious beliefs) in several dimensions (emotional, cognitive and instrumental). The study sample comprised 662 cancer patients and their spouses recruited during a routine medical evaluation from three major cancer centers in Israel. The participants completed the CPASS and two other standardized instruments: The ENRICH Marital Satisfaction Scale (EMS) and the Brief Symptom Inventory (BSI). Principal component analysis confirmed a three-factor structure based upon the agent of support (spouse; friends/family; spiritual/religious beliefs). Cronbach's α coefficients for the agent of support indexes were high (0.80-0.95), while Cronbach's α levels for the kind of support were lower (0.45-0.72). Smallest Space Analysis (SSA) also confirmed the theoretical structure of the CPASS. Pearson correlation coefficients to the other study variables were high and significant. As a whole, the CPASS was found to be a valid tool for the current Israeli sample. Theoretical and practical conclusions and socio-cultural implications are discussed. Copyright © 2009 John Wiley & Sons, Ltd.

[Methodologic developmental principles of standardized surveys within the scope of social gerontologic studies].

PubMed

Bansemir, G

1987-01-01

The conception and evaluation of standardized oral or written questioning as quantifying instruments of research orientate by the basic premises of Marxist-Leninist theory of recognition and general scientific logic. In the present contribution the socio-gerontological research process is outlined in extracts. By referring to the intrinsic connection between some of its essential components--problem, formation of hypotheses, obtaining indicators/measurement, preliminary examination, evaluation-as well as to typical errors and (fictitious) examples of practical research, this contribution contrasts the natural, apparently uncomplicated course of structured questioning with its qualitative methodological fundamentals and demands.

Progress in anterior chamber angle imaging for glaucoma risk prediction - A review on clinical equipment, practice and research.

PubMed

V K, Shinoj; Hong, Xun Jie Jeesmond; V M, Murukeshan; M, Baskaran; Tin, Aung

2016-12-01

The visualization capabilities of various ocular imaging instruments can generally be categorized into photographic (e.g. gonioscopy, Pentacam, RetCam) and optical tomographic (e.g. optical coherence tomography (OCT), photoacoustic (PA) imaging, ultrasound biomicriscopy (UBM)) methods. These imaging instruments allow vision researchers and clinicians to visualize the iridocorneal angle, and are essential in the diagnosis and management of glaucoma. Each of these imaging modalities has particular benefits and associated drawbacks in obtaining repeatable and reliable measurement in the evaluation of the angle. This review article in this context summarized recent progresses in anterior chamber imaging techniques in glaucoma diagnosis and follow-up procedures. Copyright © 2016 IPEM. Published by Elsevier Ltd. All rights reserved.

Integrated fiducial sample mount and software for correlated microscopy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Timothy R McJunkin; Jill R. Scott; Tammy L. Trowbridge

2014-02-01

A novel design sample mount with integrated fiducials and software for assisting operators in easily and efficiently locating points of interest established in previous analytical sessions is described. The sample holder and software were evaluated with experiments to demonstrate the utility and ease of finding the same points of interest in two different microscopy instruments. Also, numerical analysis of expected errors in determining the same position with errors unbiased by a human operator was performed. Based on the results, issues related to acquiring reproducibility and best practices for using the sample mount and software were identified. Overall, the sample mountmore » methodology allows data to be efficiently and easily collected on different instruments for the same sample location.« less

Ethical checklist for dental practice.

PubMed

Rinchuse, D J; Rinchuse, D J; Deluzio, C

1995-01-01

A checklist for verification of unethical business practices, originally formulated by Drs. Blanchard and Peale, is adapted to dental practice. A scenario is used as a model to demonstrate the applicability of this instrument to dental practice. The instrument asks three questions in regards to an ethical dilemma: 1) Is it legal? 2) Is it fair? 3) How does it make you feel? The paper concludes the giving of gifts to general dentists by dental specialists for the referral of patients is unethical.

Perception of early parenting in panic and agoraphobia.

PubMed

Faravelli, C; Panichi, C; Pallanti, S; Paterniti, S; Grecu, L M; Rivelli, S

1991-07-01

Thirty-two patients with a DSM-III-R diagnosis of panic disorder (PD) were administered the Parental Bonding Instrument (PBI), a 25-item self-report questionnaire devised to evaluate parental rearing practices. Compared with 32 matched healthy controls, PD patients scored both their parents as being significantly less caring and more overprotective. Moreover, the consistency of parental attitudes between the 2 parents was significantly lower, indicating lesser uniformity in the rearing patterns.

Development and Evaluation of the Telephone Crisis Support Skills Scale.

PubMed

Kitchingman, Taneile A; Wilson, Coralie J; Caputi, Peter; Woodward, Alan; Hunt, Tara

2015-01-01

Although telephone services continue to play an important role in the delivery of front-line crisis support, published evidence of the standardized assessment of such services does not exist to date. To describe the development of the Telephone Crisis Support Skills Scale (TCSSS), an instrument to assess workers' intentions to use recommended skills with callers, and to evaluate its factor structure and reliability. TCSSS items were mapped to a national telephone crisis support practice model. A national sample of workers (n = 210) completed the TCSSS as part of a larger online survey. Principal axis factoring was used to evaluate the structure of the instrument. Internal consistency was assessed by Cronbach's α values. A single factor accounted for more than 40% of the variance within TCSSS ratings, indicating unidimensional structure. Cronbach's α coefficients suggested adequate internal consistency. Results indicate that the TCSSS is an internally consistent, unidimensional scale, sufficiently sensitive to detect workers' skill priorities for different caller problem types. Further study is required to confirm the factor structure and reliability of the TCSSS using workers from different organizations. Following further evaluation, the TCSSS may be applied to assessing readiness for and quality of service delivery.

Practical approach to subject-specific estimation of knee joint contact force.

PubMed

Knarr, Brian A; Higginson, Jill S

2015-08-20

Compressive forces experienced at the knee can significantly contribute to cartilage degeneration. Musculoskeletal models enable predictions of the internal forces experienced at the knee, but validation is often not possible, as experimental data detailing loading at the knee joint is limited. Recently available data reporting compressive knee force through direct measurement using instrumented total knee replacements offer a unique opportunity to evaluate the accuracy of models. Previous studies have highlighted the importance of subject-specificity in increasing the accuracy of model predictions; however, these techniques may be unrealistic outside of a research setting. Therefore, the goal of our work was to identify a practical approach for accurate prediction of tibiofemoral knee contact force (KCF). Four methods for prediction of knee contact force were compared: (1) standard static optimization, (2) uniform muscle coordination weighting, (3) subject-specific muscle coordination weighting and (4) subject-specific strength adjustments. Walking trials for three subjects with instrumented knee replacements were used to evaluate the accuracy of model predictions. Predictions utilizing subject-specific muscle coordination weighting yielded the best agreement with experimental data; however this method required in vivo data for weighting factor calibration. Including subject-specific strength adjustments improved models' predictions compared to standard static optimization, with errors in peak KCF less than 0.5 body weight for all subjects. Overall, combining clinical assessments of muscle strength with standard tools available in the OpenSim software package, such as inverse kinematics and static optimization, appears to be a practical method for predicting joint contact force that can be implemented for many applications. Copyright © 2015 Elsevier Ltd. All rights reserved.

Practical approach to subject-specific estimation of knee joint contact force

PubMed Central

Knarr, Brian A.; Higginson, Jill S.

2015-01-01

Compressive forces experienced at the knee can significantly contribute to cartilage degeneration. Musculoskeletal models enable predictions of the internal forces experienced at the knee, but validation is often not possible, as experimental data detailing loading at the knee joint is limited. Recently available data reporting compressive knee force through direct measurement using instrumented total knee replacements offer a unique opportunity to evaluate the accuracy of models. Previous studies have highlighted the importance of subject-specificity in increasing the accuracy of model predictions; however, these techniques may be unrealistic outside of a research setting. Therefore, the goal of our work was to identify a practical approach for accurate prediction of tibiofemoral knee contact force (KCF). Four methods for prediction of knee contact force were compared: (1) standard static optimization, (2) uniform muscle coordination weighting, (3) subject-specific muscle coordination weighting and (4) subject-specific strength adjustments. Walking trials for three subjects with instrumented knee replacements were used to evaluate the accuracy of model predictions. Predictions utilizing subject-specific muscle coordination weighting yielded the best agreement with experimental data, however this method required in vivo data for weighting factor calibration. Including subject-specific strength adjustments improved models’ predictions compared to standard static optimization, with errors in peak KCF less than 0.5 body weight for all subjects. Overall, combining clinical assessments of muscle strength with standard tools available in the OpenSim software package, such as inverse kinematics and static optimization, appears to be a practical method for predicting joint contact force that can be implemented for many applications. PMID:25952546

Psychometric Evaluation of an Adolescent and Young Adult Module of the Impact of Cancer Instrument.

PubMed

Husson, Olga; Zebrack, Bradley J

2017-03-01

To develop and evaluate a new instrument that measures unique aspects of long-term survivorship for people diagnosed with cancer as Adolescent and Young Adult (AYA), not measured by existing tools. A new candidate instrument-the Impact of Cancer for Adolescent and Young Adult (IOC-AYA) cancer survivors-was developed and administered to AYA cancer survivors aged 18-35 years who were 15-29 years old when diagnosed with cancer. Psychometric properties of newly derived scales were assessed. Factor analyses of items derived seven new and specific subscales: Social Life; Uncertainties, Worries and Wonders; Cognitive Function; Sense of Purpose/Life Goals; Identity; Health Behaviors; and Health Literacy. Two separate and conditional subscales were formed: Relationship Concerns (partnered/unpartnered) and Having Children (at least one child/no children). Internal consistency measurements for these subscales ranged from 0.70 to 0.90. Expected associations within and among IOC-AYA subscales and standardized measures of quality of life were observed. Psychometric analyses indicated that this initial version of the IOC-AYA measures distinct and relevant constructs for survivors diagnosed with cancer in adolescence and young adulthood. Future work is needed to confirm the responsiveness to change and further validate the instrument in multiple and representative samples. Use of the IOC-AYA instrument in research and clinical practice will inform the development of psychosocial and supportive care interventions that not only minimize or prevent long-term deleterious effects of cancer but also promote positive adaptation, resilience, and the achievement of age-specific developmental tasks.

Sterilization and disinfection in the physician's office.

PubMed Central

Drummond, D C; Skidmore, A G

1991-01-01

OBJECTIVE: To review the principles and practice of sterilization and disinfection of medical instruments in the office setting. DATA SOURCES: Searches of MEDLINE for articles published from 1980 to 1990 on disinfection, sterilization, cross infection, surgical instruments and iatrogenic disease, bibliographies, standard texts and reference material located in a central processing department. STUDY SELECTION: We reviewed surveys of decontamination practices in physicians' offices, reviews of current recommendations for office decontamination procedures, case reports of cross infection in offices and much of the standard reference material on decontamination theory and practice. DATA SYNTHESIS: There have been few surveys of physicians' decontamination practices and few case reports of cross infection. Office practitioners have little access to practical information on sterilization and disinfection. CONCLUSION: The increasing threat of cross infection from medical instruments calls for greater knowledge about decontamination. We have adapted material from various sources and offer a primer on the subject. PMID:1913427

Assessment in School Psychology Training and Practice.

ERIC Educational Resources Information Center

Wilson, Marilyn S.; Reschly, Daniel J.

1996-01-01

Examines the empirical analysis of assessment instruments currently used by school psychologists. Wechsler Intelligence Scales, Bender-Gestalt, and Draw-A-Person are the instruments most often used by the 251 practitioners surveyed. Data found a strong relationship between training and practice. Discusses the effectiveness of current measures used…

Effectiveness of a nurse-supported self-management programme for dual sensory impaired older adults in long-term care: a cluster randomised controlled trial

PubMed Central

Roets-Merken, Lieve M; Zuidema, Sytse U; Vernooij-Dassen, Myrra J F J; Teerenstra, Steven; Hermsen, Pieter G J M; Kempen, Gertrudis I J M; Graff, Maud J L

2018-01-01

Objective To evaluate the effectiveness of a nurse-supported self-management programme to improve social participation of dual sensory impaired older adults in long-term care homes. Design Cluster randomised controlled trial. Setting Thirty long-term care homes across the Netherlands. Participants Long-term care homes were randomised into intervention clusters (n=17) and control clusters (n=13), involving 89 dual sensory impaired older adults and 56 licensed practical nurses. Intervention Nurse-supported self-management programme. Measurements Effectiveness was evaluated by the primary outcome social participation using a participation scale adapted for visually impaired older adults distinguishing four domains: instrumental activities of daily living, social-cultural activities, high-physical-demand and low-physical-demand leisure activities. A questionnaire assessing hearing-related participation problems was added as supportive outcome. Secondary outcomes were autonomy, control, mood and quality of life and nurses’ job satisfaction. For effectiveness analyses, linear mixed models were used. Sampling and intervention quality were analysed using descriptive statistics. Results Self-management did not affect all four domains of social participation; however. the domain ‘instrumental activities of daily living’ had a significant effect in favour of the intervention group (P=0.04; 95% CI 0.12 to 8.5). Sampling and intervention quality was adequate. Conclusions A nurse-supported self-management programme was effective in empowering the dual sensory impaired older adults to address the domain ‘instrumental activities of daily living’, but no differences were found in addressing the other three participation domains. Self-management showed to be beneficial for managing practical problems, but not for those problems requiring behavioural adaptations of other persons. Trial registration number NCT01217502; Results. PMID:29371264

Pain assessment in children: theoretical and empirical validity.

PubMed

Villarruel, A M; Denyes, M J

1991-12-01

Valid assessment of pain in children is foundational for both the nursing practice and research domains, yet few validated methods of pain measurement are currently available for young children. This article describes an innovative research approach used in the development of photographic instruments to measure pain intensity in young African-American and Hispanic children. The instruments were designed to enable children to participate actively in their own care and to do so in ways that are congruent with their developmental and cultural heritage. Conceptualization of the instruments, methodological development, and validation processes grounded in Orem's Self-Care Deficit Theory of Nursing are described. The authors discuss the ways in which the gaps between nursing theory, research, and practice are narrowed when development of instruments to measure clinical nursing phenomena are grounded in nursing theory, validated through research and utilized in practice settings.

Parental instrumental feeding, negative affect, and binge eating among overweight individuals.

PubMed

Mason, Tyler B

2015-04-01

Parental instrumental feeding (i.e., rewarding children with food for perceived correct behaviors and punishing by taking away food for perceived incorrect behaviors) and negative affect are independently associated with binge eating in adulthood. However, less is known about interactions between these variables and binge eating. This study examined the relationship of retrospective reports of parental feeding practices and negative affect to binge eating. Participants were 165 overweight and obese undergraduate students at a large Mid-Atlantic University. High parental instrumental feeding strengthened the relationship between negative affect and binge eating. Also, individuals who reported low parental feeding practices reported similar binge eating regardless of negative affect. These findings suggest that overweight and obese individuals whose parents used more instrumental feeding practices are most likely to engage in binge eating in response to negative affect. Published by Elsevier Ltd.

Psychometric Properties of Patient-Facing eHealth Evaluation Measures: Systematic Review and Analysis.

PubMed

Wakefield, Bonnie J; Turvey, Carolyn L; Nazi, Kim M; Holman, John E; Hogan, Timothy P; Shimada, Stephanie L; Kennedy, Diana R

2017-10-11

Significant resources are being invested into eHealth technology to improve health care. Few resources have focused on evaluating the impact of use on patient outcomes A standardized set of metrics used across health systems and research will enable aggregation of data to inform improved implementation, clinical practice, and ultimately health outcomes associated with use of patient-facing eHealth technologies. The objective of this project was to conduct a systematic review to (1) identify existing instruments for eHealth research and implementation evaluation from the patient's point of view, (2) characterize measurement components, and (3) assess psychometrics. Concepts from existing models and published studies of technology use and adoption were identified and used to inform a search strategy. Search terms were broadly categorized as platforms (eg, email), measurement (eg, survey), function/information use (eg, self-management), health care occupations (eg, nurse), and eHealth/telemedicine (eg, mHealth). A computerized database search was conducted through June 2014. Included articles (1) described development of an instrument, or (2) used an instrument that could be traced back to its original publication, or (3) modified an instrument, and (4) with full text in English language, and (5) focused on the patient perspective on technology, including patient preferences and satisfaction, engagement with technology, usability, competency and fluency with technology, computer literacy, and trust in and acceptance of technology. The review was limited to instruments that reported at least one psychometric property. Excluded were investigator-developed measures, disease-specific assessments delivered via technology or telephone (eg, a cancer-coping measure delivered via computer survey), and measures focused primarily on clinician use (eg, the electronic health record). The search strategy yielded 47,320 articles. Following elimination of duplicates and non-English language publications (n=14,550) and books (n=27), another 31,647 articles were excluded through review of titles. Following a review of the abstracts of the remaining 1096 articles, 68 were retained for full-text review. Of these, 16 described an instrument and six used an instrument; one instrument was drawn from the GEM database, resulting in 23 articles for inclusion. None included a complete psychometric evaluation. The most frequently assessed property was internal consistency (21/23, 91%). Testing for aspects of validity ranged from 48% (11/23) to 78% (18/23). Approximately half (13/23, 57%) reported how to score the instrument. Only six (26%) assessed the readability of the instrument for end users, although all the measures rely on self-report. Although most measures identified in this review were published after the year 2000, rapidly changing technology makes instrument development challenging. Platform-agnostic measures need to be developed that focus on concepts important for use of any type of eHealth innovation. At present, there are important gaps in the availability of psychometrically sound measures to evaluate eHealth technologies. ©Bonnie J Wakefield, Carolyn L Turvey, Kim M Nazi, John E Holman, Timothy P Hogan, Stephanie L Shimada, Diana R Kennedy. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 11.10.2017.

Identification of a practical and reliable method for the evaluation of litter moisture in turkey production.

PubMed

Vinco, L J; Giacomelli, S; Campana, L; Chiari, M; Vitale, N; Lombardi, G; Veldkamp, T; Hocking, P M

2018-02-01

1. An experiment was conducted to compare 5 different methods for the evaluation of litter moisture. 2. For litter collection and assessment, 55 farms were selected, one shed from each farm was inspected and 9 points were identified within each shed. 3. For each device, used for the evaluation of litter moisture, mean and standard deviation of wetness measures per collection point were assessed. 4. The reliability and overall consistency between the 5 instruments used to measure wetness were high (α = 0.72). 5. Measurement of three out of the 9 collection points were sufficient to provide a reliable assessment of litter moisture throughout the shed. 6. Based on the direct correlation between litter moisture and footpad lesions, litter moisture measurement can be used as a resource based on-farm animal welfare indicator. 7. Among the 5 methods analysed, visual scoring is the most simple and practical, and therefore the best candidate to be used on-farm for animal welfare assessment.

Navigation of guidewires and catheters in the body during intervention procedures: a review of computer-based models.

PubMed

Sharei, Hoda; Alderliesten, Tanja; van den Dobbelsteen, John J; Dankelman, Jenny

2018-01-01

Guidewires and catheters are used during minimally invasive interventional procedures to traverse in vascular system and access the desired position. Computer models are increasingly being used to predict the behavior of these instruments. This information can be used to choose the right instrument for each case and increase the success rate of the procedure. Moreover, a designer can test the performance of instruments before the manufacturing phase. A precise model of the instrument is also useful for a training simulator. Therefore, to identify the strengths and weaknesses of different approaches used to model guidewires and catheters, a literature review of the existing techniques has been performed. The literature search was carried out in Google Scholar and Web of Science and limited to English for the period 1960 to 2017. For a computer model to be used in practice, it should be sufficiently realistic and, for some applications, real time. Therefore, we compared different modeling techniques with regard to these requirements, and the purposes of these models are reviewed. Important factors that influence the interaction between the instruments and the vascular wall are discussed. Finally, different ways used to evaluate and validate the models are described. We classified the developed models based on their formulation into finite-element method (FEM), mass-spring model (MSM), and rigid multibody links. Despite its numerical stability, FEM requires a very high computational effort. On the other hand, MSM is faster but there is a risk of numerical instability. The rigid multibody links method has a simple structure and is easy to implement. However, as the length of the instrument is increased, the model becomes slower. For the level of realism of the simulation, friction and collision were incorporated as the most influential forces applied to the instrument during the propagation within a vascular system. To evaluate the accuracy, most of the studies compared the simulation results with the outcome of physical experiments on a variety of phantom models, and only a limited number of studies have done face validity. Although a subset of the validated models is considered to be sufficiently accurate for the specific task for which they were developed and, therefore, are already being used in practice, these models are still under an ongoing development for improvement. Realism and computation time are two important requirements in catheter and guidewire modeling; however, the reviewed studies made a trade-off depending on the purpose of their model. Moreover, due to the complexity of the interaction with the vascular system, some assumptions have been made regarding the properties of both instruments and vascular system. Some validation studies have been reported but without a consistent experimental methodology.

Content Analysis of Evaluation Instruments Used for Student Evaluation of Classroom Teaching Performance in Higher Education.

ERIC Educational Resources Information Center

Tagomori, Harry T.; Bishop, Laurence A.

A major argument against evaluation of teacher performance by students pertains to the instruments being used. Colleges conduct instructional evaluation using instruments they devise, borrow, adopt, or adapt from other institutions. Whether these instruments are tested for content validity is unknown. This study determined how evaluation questions…

The physical therapy profile questionnaire (PTPQ): development, validation and pilot testing.

PubMed

Dizon, Janine Margarita R; Grimmer-Somers, Karen; Kumar, Saravana

2011-09-19

Country by country similarities and differences in physical therapy practice exists. Therefore, before updates in practice can be provided, such as trainings in evidence-based practice, it is necessary to identify the profile and nature of practice in a given country or setting. Following a search of the international literature, no appropriate tool was identified to collect and establish data to create the profile of physical therapy practice in the Philippines. We therefore developed, validated and pilot tested a survey instrument which would comprehensively describe the practice of physical therapy in the Philippines We used a mixed methods design to answer our study aims. A focus group interview was conducted among a group of physical therapists to establish the content and contexts of items to be included in the survey instrument. Findings were amalgamated with the information from the literature on developing survey instruments/questionnaires. A survey instrument was drafted and named as the Physical Therapy Profile Questionnaire (PTPQ). The PTPQ was then validated and pilot tested to a different group of physical therapists.The final version consisted of five separate parts namely (A) General information and demographics, (B) Practice Profile, (C) Treatment Preferences, (D) Bases for clinical work and (E) Bases for educational/research work. At present the PTPQ is relevant to the Philippines and could be used by any country which has a similar nature of practice with the Philippines. The Physical Therapy Practice Questionnaire (PTPQ) was shown to have good face and content validity among the Filipino physical therapists and their context of practice. It has also been found to be useful, easy to administer tool and in a format appealing to respondents. The PTPQ is expected to assist comprehensive data collection to create a profile of physical therapy practice in the Philippines.

The Validation of a Software Evaluation Instrument.

ERIC Educational Resources Information Center

Schmitt, Dorren Rafael

This study, conducted at six southern universities, analyzed the validity and reliability of a researcher developed instrument designed to evaluate educational software in secondary mathematics. The instrument called the Instrument for Software Evaluation for Educators uses measurement scales, presents a summary section of the evaluation, and…

49 CFR 572.130 - Incorporation by reference.

Code of Federal Regulations, 2012 CFR

2012-10-01

... in § 572.132. (3) SAE Recommended Practice J211/1, Rev. Mar 95 “Instrumentation for Impact Tests—Part 1—Electronic Instrumentation”, incorporated by reference in § 572.137; (4) SAE Recommended Practice J211/2, Rev. Mar 95 “Instrumentation for Impact Tests—Part 2—Photographic Instrumentation” incorporated...

49 CFR 572.130 - Incorporation by reference.

Code of Federal Regulations, 2013 CFR

2013-10-01

... in § 572.132. (3) SAE Recommended Practice J211/1, Rev. Mar 95 “Instrumentation for Impact Tests—Part 1—Electronic Instrumentation”, incorporated by reference in § 572.137; (4) SAE Recommended Practice J211/2, Rev. Mar 95 “Instrumentation for Impact Tests—Part 2—Photographic Instrumentation” incorporated...

49 CFR 572.130 - Incorporation by reference.

Code of Federal Regulations, 2014 CFR

2014-10-01

... in § 572.132. (3) SAE Recommended Practice J211/1, Rev. Mar 95 “Instrumentation for Impact Tests—Part 1—Electronic Instrumentation”, incorporated by reference in § 572.137; (4) SAE Recommended Practice J211/2, Rev. Mar 95 “Instrumentation for Impact Tests—Part 2—Photographic Instrumentation” incorporated...

Choosing Assessment Instruments for Anxiety Practice and Outcome Research with School-Aged Youth

ERIC Educational Resources Information Center

Erford, Bradley T.; Lutz, Julie A.

2015-01-01

Using effect size results from our meta-analysis for the treatment of anxiety in school-aged youth, the practical and technical aspects of five commonly used anxiety instruments were analyzed, and effect size estimates compared to indicate the best choices for use in anxiety outcome research.

A systematic review of health economic evaluation in adjuvant breast radiotherapy: Quality counted by numbers.

PubMed

Monten, Chris; Veldeman, Liv; Verhaeghe, Nick; Lievens, Yolande

2017-11-01

Evolving practice in adjuvant breast radiotherapy inevitably impacts healthcare budgets. This is reflected in a rise of health economic evaluations (HEE) in this domain. The available HEE literature was analysed qualitatively and quantitatively, using available instruments. HEEs published between 1/1/2000 and 31/10/2016 were retrieved through a systematic search in Medline, Cochrane and Embase. A quality-assessment using CHEERS (Consolidated Health Economic Evaluation Reporting Standards) was translated into a quantitative score and compared with Tufts Medical Centre CEA registry and Quality of Health Economic Studies (QHES) results. Twenty cost-effectiveness analyses (CEA) and thirteen cost comparisons (CC) were analysed. In qualitative evaluation, valuation or justification of data sources, population heterogeneity and discussion on generalizability, in addition to declaration on funding, were often absent or incomplete. After quantification, the average CHEERS-scores were 74% (CI 66.9-81.1%) and 75.6% (CI 70.7-80.5%) for CEAs and CCs respectively. CEA-scores did not differ significantly from Tufts and QHES-scores. Quantitative CHEERS evaluation is feasible and yields comparable results to validated instruments. HEE in adjuvant breast radiotherapy is of acceptable quality, however, further efforts are needed to improve comprehensive reporting of all data, indispensable for assessing relevance, reliability and generalizability of results. Copyright © 2017 Elsevier B.V. All rights reserved.

Advances in the in Vivo Raman Spectroscopy of Malignant Skin Tumors Using Portable Instrumentation

PubMed Central

Kourkoumelis, Nikolaos; Balatsoukas, Ioannis; Moulia, Violetta; Elka, Aspasia; Gaitanis, Georgios; Bassukas, Ioannis D.

2015-01-01

Raman spectroscopy has emerged as a promising tool for real-time clinical diagnosis of malignant skin tumors offering a number of potential advantages: it is non-intrusive, it requires no sample preparation, and it features high chemical specificity with minimal water interference. However, in vivo tissue evaluation and accurate histopathological classification remain a challenging task for the successful transition from laboratory prototypes to clinical devices. In the literature, there are numerous reports on the applications of Raman spectroscopy to biomedical research and cancer diagnostics. Nevertheless, cases where real-time, portable instrumentations have been employed for the in vivo evaluation of skin lesions are scarce, despite their advantages in use as medical devices in the clinical setting. This paper reviews the advances in real-time Raman spectroscopy for the in vivo characterization of common skin lesions. The translational momentum of Raman spectroscopy towards the clinical practice is revealed by (i) assembling the technical specifications of portable systems and (ii) analyzing the spectral characteristics of in vivo measurements. PMID:26132563

Manifesto: towards a clinically-oriented psychometrics.

PubMed

Vickers, Andrew J; Chen, Ling Y

2017-04-26

New technologies to collect patient - reported outcomes have substantially solved the challenge of integrating a questionnaire in a busy clinical practice. At Memorial Sloan Kettering, we have been collecting patient reported outcomes electronically for many years. Our experience confirms the predicted benefits of obtaining patient reported outcomes but has also raised serious concerns about whether instruments developed for the research setting are appropriate for routine clinical use. We summarize four principles for a clinically - relevant psychometrics. First, minimize patient burden: the use of a large number of items for a single domain may be of interest for research but additional items have little clinical utility. Secondly, use simplified language: patients who do not have good language skills are typically excluded from research studies but will nonetheless present in clinical practice. Third, avoid dumb questions: many questionnaire items are inappropriate when applied to a more general population. Fourth, what works for the group may not work for the individual: group level statistics used to validate survey instruments can obscure problems when applied to a subgroup of patients. There is a need for a clinically-oriented psychometrics to help design, test, and evaluate questionnaires that would be used in routine practice. Developing statistical methods to optimize questionnaires will be highly challenging but needed to bring the potential of patient reported outcomes into widespread clinical use.

The psychometric properties of three self-report screening instruments for identifying frail older people in the community

PubMed Central

2010-01-01

Background Frailty is highly prevalent in older people. Its serious adverse consequences, such as disability, are considered to be a public health problem. Therefore, disability prevention in community-dwelling frail older people is considered to be a priority for research and clinical practice in geriatric care. With regard to disability prevention, valid screening instruments are needed to identify frail older people in time. The aim of this study was to evaluate and compare the psychometric properties of three screening instruments: the Groningen Frailty Indicator (GFI), the Tilburg Frailty Indicator (TFI) and the Sherbrooke Postal Questionnaire (SPQ). For validation purposes the Groningen Activity Restriction Scale (GARS) was added. Methods A questionnaire was sent to 687 community-dwelling older people (≥ 70 years). Agreement between instruments, internal consistency, and construct validity of instruments were evaluated and compared. Results The response rate was 77%. Prevalence estimates of frailty ranged from 40% to 59%. The highest agreement was found between the GFI and the TFI (Cohen's kappa = 0.74). Cronbach's alpha for the GFI, the TFI and the SPQ was 0.73, 0.79 and 0.26, respectively. Scores on the three instruments correlated significantly with each other (GFI - TFI, r = 0.87; GFI - SPQ, r = 0.47; TFI - SPQ, r = 0.42) and with the GARS (GFI - GARS, r = 0.57; TFI - GARS, r = 0.61; SPQ - GARS, r = 0.46). The GFI and the TFI scores were, as expected, significantly related to age, sex, education and income. Conclusions The GFI and the TFI showed high internal consistency and construct validity in contrast to the SPQ. Based on these findings it is not yet possible to conclude whether the GFI or the TFI should be preferred; data on the predictive values of both instruments are needed. The SPQ seems less appropriate for postal screening of frailty among community-dwelling older people. PMID:20353611

[Methods for the costing process in the field of economic evaluation of a rehabilitation program for patients with chronic obstructive lung diseases].

PubMed

Hessel, F P; Wittmann, M; Petro, W; Wasem, J

2000-07-01

Studies in health economics especially economic evaluations of health care technologies and programmes are getting more and more important. However, in Germany there are no established, validated and commonly used instruments for the costing process. For the economic evaluation of a rehabilitation programme for patients with chronic lung diseases such as asthma and chronic bronchitis we developed methods for identification, measurement and validation of resource use during the inpatient rehabilitation programme and during the outpatient follow-up period. These methods are based on methodological considerations as well as on practical experience from conducting a pilot study. With regard to the inpatient setting all relevant diagnostic and therapeutic resource uses could be measured basing on routine clinical documentation and validated by using the cost accounting of the clinic. For measuring the use of resources during the follow-up period in an outpatient setting no reliable administrative data are accessible. Hence, we compared a standardised retrospective patient questionnaire used in a 20-minute interview (n = 50) and a cost diary for the continuing documentation by the patient over a period of 4 weeks (n = 50). Both tools were useful for measuring all relevant resource uses in sufficient detail, but because of higher participation rates and lower dropouts the structured interview appears to be more suitable. Average total costs per month were 1591 DM (interview), respectively 1867 DM (cost diary). Besides productivity loss, costs for medication and GP visits caused the relatively highest resource uses. Practicable instruments were developed for the costing process as part of an economic evaluation in a German rehabilitation setting for pulmonary diseases. After individual modification, these could also be used for different indications and in other institutional settings.

Psychometric testing of inventory of beliefs and attitudes on domestic violence.

PubMed

Hutchinson, Marie; Doran, Frances

2017-06-22

Background Domestic violence (DV) is an international public health issue associated with adverse health outcomes for adults and children. There have been widespread calls to increase nurses' capacity to respond to DV and improve undergraduate nursing education in this area. However, there are few valid, reliable and contemporary measures of nursing attitudes towards and beliefs concerning DV that are suited for use in evaluating education programmes. Aim To establish the psychometric properties of a newly developed inventory designed to measure nursing students' beliefs about and attitudes towards DV. Discussion Exploratory factor analysis identified five factors, with a Cronbach's alpha of 0.646. The few factors loading>.80 suggest that the instrument has good discriminate validity. The absence of cross-loadings indicate good convergent validity. Conclusion The inventory provides one of the first validated and reliable measures for examining undergraduate nursing students' attitudes towards and beliefs about DV. Implications for practice The instrument is suited for use by nurse educators in assessing the influence of curriculum design and teaching strategies on student beliefs and attitudes. It would also be useful in studies investigating nurses' clinical practice on domestic violence.

A Measure of Team Resilience: Developing the Resilience at Work Team Scale.

PubMed

McEwen, Kathryn; Boyd, Carolyn M

2018-03-01

This study develops, and initial evaluates, a new measure of team-based resilience for use in research and practice. We conducted preliminary analyses, based on a cross-sectional sample of 344 employees nested within 31 teams. Seven dimensions were identified through exploratory and confirmatory factor analyses. The measure had high reliability and significant discrimination to indicate the presence of a unique team-based aspect of resilience that contributed to higher work engagement and higher self-rated team performance, over and above the effects of individual resilience. Multilevel analyses showed that team, but not individual, resilience predicted self-rated team performance. Practice implications include a need to focus on collective as well as individual behaviors in resilience-building. The measure provides a diagnostic instrument for teams and a scale to evaluate organizational interventions and research the relationship of resilience to other constructs.

Impact of hybrid delivery of education on student academic performance and the student experience.

PubMed

Congdon, Heather Brennan; Nutter, Douglas A; Charneski, Lisa; Butko, Peter

2009-11-12

To compare student academic performance and the student experience in the first-year doctor of pharmacy (PharmD) program between the main and newly opened satellite campuses of the University of Maryland. Student performance indicators including graded assessments, course averages, cumulative first-year grade point average (GPA), and introductory pharmacy practice experience (IPPE) evaluations were analyzed retrospectively. Student experience indicators were obtained via an online survey instrument and included involvement in student organizations; time-budgeting practices; and stress levels and their perceived effect on performance. Graded assessments, course averages, GPA, and IPPE evaluations were indistinguishable between campuses. Students' time allocation was not different between campuses, except for time spent attending class and watching lecture videos. There was no difference between students' stress levels at each campus. The implementation of a satellite campus to expand pharmacy education yielded academic performance and student engagement comparable to those from traditional delivery methods.

[Benchmarking in ambulatory care practices--The European Practice Assessment (EPA)].

PubMed

Szecsenyi, Joachim; Broge, Björn; Willms, Sara; Brodowski, Marc; Götz, Katja

2011-01-01

The European Practice Assessment (EPA) is a comprehensive quality management which consists of 220 indicators covering 5 domains (infrastructure, people, information, finance, and quality and safety). The aim of the project presented was to evaluate EPA as an instrument for benchmarking in ambulatory care practices. A before-and-after design with a comparison group was chosen. One hundred and two practices conducted EPA at baseline (t1) and at the 3-year follow-up (t2). A further 209 practices began EPA at t2 (comparison group). Since both practice groups differed in several variables (age of GP, location and size of practice), a matched-pair design based on propensity scores was applied leading to a subgroup of 102 comparable practices (out of the 209 practices). Data analysis was carried out using Z scores of the EPA domains. The results showed significant improvements in all domains between t1 and t2 as well as between the comparison group and t2. Furthermore, the results demonstrate that the implementation of total quality management and the re-assessment of the EPA procedure can lead to significant improvements in almost all domains. Copyright © 2011. Published by Elsevier GmbH.

Study protocol. IDUS - Instrumental delivery & ultrasound: a multi-centre randomised controlled trial of ultrasound assessment of the fetal head position versus standard care as an approach to prevent morbidity at instrumental delivery.

PubMed

Murphy, Deirdre J; Burke, Gerard; Montgomery, Alan A; Ramphul, Meenakshi

2012-09-13

Instrumental deliveries are commonly performed in the United Kingdom and Ireland, with rates of 12 - 17% in most centres. Knowing the exact position of the fetal head is a pre-requisite for safe instrumental delivery. Traditionally, diagnosis of the fetal head position is made on transvaginal digital examination by delineating the suture lines of the fetal skull and the fontanelles. However, the accuracy of transvaginal digital examination can be unreliable and varies between 20% and 75%. Failure to identify the correct fetal head position increases the likelihood of failed instrumental delivery with the additional morbidity of sequential use of instruments or second stage caesarean section. The use of ultrasound in determining the position of the fetal head has been explored but is not part of routine clinical practice. A multi-centre randomised controlled trial is proposed. The study will take place in two large maternity units in Ireland with a combined annual birth rate of 13,500 deliveries. It will involve 450 nulliparous women undergoing instrumental delivery after 37 weeks gestation. The main outcome measure will be incorrect diagnosis of the fetal head position. A study involving 450 women will have 80% power to detect a 10% difference in the incidence of inaccurate diagnosis of the fetal head position with two-sided 5% alpha. It is both important and timely to evaluate the use of ultrasound to diagnose the fetal head position prior to instrumental delivery before routine use can be advocated. The overall aim is to reduce the incidence of incorrect diagnosis of the fetal head position prior to instrumental delivery and improve the safety of instrumental deliveries. Current Controlled Trials ISRCTN72230496.

How to improve a critical performance for an ExoMars 2020 Scientific Instrument (RLS). Raman Laser Spectrometer Signal to Noise Ratio (SNR) Optimization

NASA Astrophysics Data System (ADS)

Canora, C. P.; Moral, A. G.; Rull, F.; Maurice, S.; Hutchinson, I.; Ramos, G.; López-Reyes, G.; Belenguer, T.; Canchal, R.; Prieto, J. A. R.; Rodriguez, P.; Santamaria, P.; Berrocal, A.; Colombo, M.; Gallago, P.; Seoane, L.; Quintana, C.; Ibarmia, S.; Zafra, J.; Saiz, J.; Santiago, A.; Marin, A.; Gordillo, C.; Escribano, D.; Sanz-Palominoa, M.

2017-09-01

The Raman Laser Spectrometer (RLS) is one of the Pasteur Payload instruments, within the ESA's Aurora Exploration Programme, ExoMars mission. Raman spectroscopy is based on the analysis of spectral fingerprints due to the inelastic scattering of light when interacting with matter. RLS is composed by Units: SPU (Spectrometer Unit), iOH (Internal Optical Head), and ICEU (Instrument Control and Excitation Unit) and the harnesses (EH and OH). The iOH focuses the excitation laser on the samples and collects the Raman emission from the sample via SPU (CCD) and the video data (analog) is received, digitalizing it and transmiting it to the processor module (ICEU). The main sources of noise arise from the sample, the background, and the instrument (Laser, CCD, focuss, acquisition parameters, operation control). In this last case the sources are mainly perturbations from the optics, dark signal and readout noise. Also flicker noise arising from laser emission fluctuations can be considered as instrument noise. In order to evaluate the SNR of a Raman instrument in a practical manner it is useful to perform end-to-end measurements on given standards samples. These measurements have to be compared with radiometric simulations using Raman efficiency values from literature and taking into account the different instrumental contributions to the SNR. The RLS EQM instrument performances results and its functionalities have been demonstrated in accordance with the science expectations. The Instrument obtained SNR performances in the RLS EQM will be compared experimentally and via analysis, with the Instrument Radiometric Model tool. The characterization process for SNR optimization is still on going. The operational parameters and RLS algorithms (fluorescence removal and acquisition parameters estimation) will be improved in future models (EQM-2) until FM Model delivery.

Cosmet'eau-Changes in the personal care product consumption practices: from whistle-blowers to impacts on aquatic environments.

PubMed

Bressy, Adèle; Carré, Catherine; Caupos, Émilie; de Gouvello, Bernard; Deroubaix, José-Frédéric; Deutsch, Jean-Claude; Mailler, Romain; Marconi, Anthony; Neveu, Pascale; Paulic, Laurent; Pichon, Sébastien; Rocher, Vincent; Severin, Irina; Soyer, Mathilde; Moilleron, Régis

2016-07-01

The Cosmet'eau project (2015-2018) investigates the "changes in the personal care product (PCP) consumption practices: from whistle-blowers to impacts on aquatic environments." In this project, the example of PCPs will be used to understand how public health concerns related to micropollutants can be addressed by public authorities-including local authorities, industries, and consumers. The project aims to characterize the possible changes in PCP consumption practices and to evaluate the impact of their implementation on aquatic contamination. Our goals are to study the whistle-blowers, the risk perception of consumers linked with their practices, and the contamination in parabens and their substitutes, triclosan, and triclocarban from wastewater to surface water. The project investigates the following potential solutions: modifications of industrial formulation or changes in consumption practices. The final purpose is to provide policy instruments for local authorities aiming at building effective strategies to fight against micropollutants in receiving waters.

Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

PubMed

Hardré, Patricia L; Slater, Janis; Nanny, Mark

2010-11-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

Automatic measurement; Mesures automatiques (in French)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ringeard, C.

1974-11-28

By its ability to link-up operations sequentially and memorize the data collected, the computer can introduce a statistical approach in the evaluation of a result. To benefit fully from the advantages of automation, a special effort was made to reduce the programming time to a minimum and to simplify link-ups between the existing system and instruments from different sources. The practical solution of the test laboratory of the C.E.A. Centralized Administration Groupe (GEC) is given.

The Practice Environment Scale of the Nursing Work Index: An updated review and recommendations for use.

PubMed

Swiger, Pauline A; Patrician, Patricia A; Miltner, Rebecca S Susie; Raju, Dheeraj; Breckenridge-Sproat, Sara; Loan, Lori A

2017-09-01

The Practice Environment Scale of the Nursing Work Index (PES-NWI) is an instrument, which measures the nursing practice environment - defined as factors that enhance or attenuate a nurse's ability to practice nursing skillfully and deliver high quality care. The purpose of this paper is to provide an updated review of the Practice Environment Scale of the Nursing Work Index's use to date and provide recommendations that may be helpful to nursing leaders and researchers who plan to use this instrument. A narrative review of quantitative studies. PubMed, EMBASE, and the Cumulative Index to Nursing & Allied Health Literature were searched to identify relevant literature using the search terms, Practice Environment Scale of the Nursing Work Index and PES-NWI. Studies were included if they were published in English between 2010 and 2016 and focused on the relationship between the Practice Environment Scale of the Nursing Work Index and patient, nurse, or organizational outcomes. Data extraction focused on the reported survey scores and the significance and strength of the reported associations. Forty-six articles, from 28 countries, were included in this review. The majority reported significant findings between the nursing practice environment and outcomes. Although some modifications have been made, the instrument has remained primarily unchanged since its development. Most often, the scores regarding staffing and resource adequacy remained the lowest. The frequency of use of this instrument has remained high. Many researchers advocate for a move beyond the study of the connection between the Practice Environment Scale and nurse, patient, and organizational outcomes. Research should shift toward identifying interventions that improve the environment in which nurses practice and determining if changing the environment results in improved care quality. Published by Elsevier Ltd.

A review of the literature pertaining to the efficacy, safety, educational requirements, uses and usage of mechanical adjusting devices

PubMed Central

Taylor, Shane H; Arnold, Nicole D; Biggs, Lesley; Colloca, Christopher J; Mierau, Dale R; Symons, Bruce P; Triano, John J

2004-01-01

Over the past decade, mechanical adjusting devices (MADs) were a major source of debate within the Chiropractors’ Association of Saskatchewan (CAS). Since Saskatchewan was the only jurisdiction in North America to prohibit the use of MADs, the CAS established a committee in 2001 to review the literature on MADs. The committee evaluated the literature on the efficacy, safety, and uses of moving stylus instruments within chiropractic practice, and the educational requirements for chiropractic practice. Following the rating criteria for the evaluation of evidence, as outlined in the Clinical Guidelines for Chiropractic Practice in Canada (1994), the committee reviewed 55 articles – all of which pertained to the Activator. Of the 55 articles, 13 were eliminated from the final study. Of the 42 remaining articles, 6 were rated as class 1 evidence; 11 were rated as class 2 evidence and 25 were rated as class 3 evidence. In this article – the second in a series of two – we review the results of uses and usage, safety and educational requirements. Of the 30 articles designated under the category of usage, 3 were rated as Class 1 evidence; 9 studies were classified as Class 2 evidence and 18 were rated as Class 3 evidence. Overall the committee reached consensus that in clinical practice, there is broad application of these procedures. A minority report was written arguing that the reviewer was unable to reach a conclusion about the use of the Activator Instrument other than it is used as a clinical and research tool. Of the 16 studies that dealt either explicitly or implicitly with safety, 4 were Class 1 evidence; 3 were Class 2 evidence and 9 were Class 3 evidence. Overall the committee reached consensus that the evidence supports that the Activator instrument is safe and has no more relative risk than do manual HVLA procedures. A minority report was written arguing that there is no evidence either to support or refute the view that MAD is safe. Of the 5 studies that dealt with educational requirements, all were Class 3 evidence. Overall the committee reached consensus that there was no evidence in the literature with respect to educational requirements to form any conclusions. A minority report was written offering opinion that there is evidence with respect to educational requirements. PMID:17549227

Review of the integrity of a Self Administered Motivational Instrument.

PubMed

Duffy, Tim; McCaig, Marie; McGrandles, Amanda; Rimmer, Russell; Martin, Colin R

2014-04-01

Motivational interviewing (MI) was developed by Miller and Rollnick as an evidence-based counselling approach for use in supporting people with alcohol problems. Over the years the principles and spirit of MI have been reviewed and fine-tuned and the approach has been embraced by practitioners worldwide and across fields. Since 2001 a number of instruments have been designed to evaluate the fidelity of MI practice. For the purposes of this study, one such instrument is used to assess a self-administered motivational instrument, known as the SAMI, which takes the interviewer role. The SAMI is evaluated against the MITI 3.1.1, which is designed to assess the extent to which MI interventions perform on five global dimensions. These are evocation, collaboration, autonomy/support, direction and empathy. The SAMI was assembled based on the principles and spirit of MI, problem solving and goal-setting. The targeted behaviour changes were student learning styles and approaches to study. The SAMI was distributed, completed and submitted electronically via the university virtual learning environment. Thirty three mature students of a university which delivered online nursing programme were invited to complete the SAMI. Of these, 25 submitted completed transcripts. Transcripts of a sample of six completed SAMIs were assessed by a group of teachers and researchers with experience in the use and evaluation of MI, using five-point Likert scales to assess the SAMI on the five dimensions. Overall, an average score exceeding 4.5 was attained across the five dimensions. Conventionally, such a score is recognised as competency in MI. However, on one dimension (empathy), the rating was three. This current research confirms that global principles have been observed in the online delivery of MI using the SAMI to probe approaches to study. Copyright © 2013 Elsevier Ltd. All rights reserved.

Health-Related Quality of Life in Persons With Ostomies Managed in an Outpatient Care Setting.

PubMed

Santos, Vera Lucia Conceição de Gouveia; Augusto, Fabiana da Silva; Gomboski, Gustavo

2016-01-01

We examined health-related quality of life (HRQOL) in persons with ostomies receiving outpatient care. We also analyzed relationships among HRQOL, demographic, and pertinent clinical factors. We used a descriptive, exploratory, cross-sectional study design to collect and analyze data. Data in this article are a secondary analysis of data collected from a primary study, developed by Santos and Gomboski, on the adaptation and validation of the City of Hope-Quality of Life-Ostomy Questionnaire (COH-QOL-OQ) to the Portuguese language in Brazil. A convenience sample of 215 adults living with an ostomy was evaluated. Slightly more than half (51.6%) were men, 67.5% underwent colostomy surgery, and 59.1% underwent cancer-related ostomy surgery. Subjects received care in specialized health care units in 3 cities in the Brazilian state of Rio Grande do Sul. After approval by the Research Ethics Committee and permission from health care units, data were collected using 2 instruments: the World Health Organization Quality of Life-Short Version (WHOQOL-Bref) (generic HRQOL instrument) and the COH-QOL-OQ (disease specific HRQOL instrument). Data were analyzed using χ test and logistic regression (via a stepwise forward method). Patients were classified into 3 groups according to the means and standard deviations of the scores: low, moderate, and high quality of life (QOL). Ostomy patients had total scores of 69.6 ± 20.2 and 6.1 ± 1.4 for the WHOQOL-Bref and COH-QOL-OQ instruments, respectively. Patients with shorter times since their ostomy creation had worse scores on both the specific QOL (P = .006) and generic QOL (P = .019) instruments. Patients who did not practice religion (P = .027; odds ratio [OR] = 3.39) and those without a partner/spouse (P = .007; OR = 4.90) had increased probability of having worse scores on the WHOQOL-Bref (generic instrument). Persons living with ostomies were found to have scores indicating moderate HRQOL on a disease-specific and generic instrument. Shorter time since ostomy creation, lack of religious practice, and lack of a partner negatively influenced the HRQOL of these patients.

Sonochemical cleaning efficiencies in dental instruments

NASA Astrophysics Data System (ADS)

Tiong, T. Joyce; Walmsley, A. Damien; Price, Gareth J.

2012-05-01

Ultrasound has been widely used for cleaning purposes in a variety of situations, including in dental practice. Cleaning is achieved through a combination of acoustically driven streaming effects and sonochemical effects arising from the production of inertial cavitation in a liquid. In our work, various dental instruments used for endodontic (root canal) treatment have been evaluated for their efficiency in producing sonochemical effects in an in-vitro cleaning environment. The areas where cavitation was produced were mapped by monitoring chemiluminescence from luminol solutions and this was correlated with their cleaning efficiencies - assessed by the ability to bleach a dye, to form an emulsion by mixing immiscible components and also to remove ink from a glass surface. The results showed good correlation (Pearson's coefficient > 0.9) between the cavitation and cleaning efficiencies, suggesting that the former plays an important role in cleaning. The methods developed and the results will be beneficial in endodontics research in order to optimise future root canal instruments and treatments.

The knowledge, efficacy, and practices instrument for oral health providers: a validity study with dental students.

PubMed

Behar-Horenstein, Linda S; Garvan, Cyndi W; Moore, Thomas E; Catalanotto, Frank A

2013-08-01

Valid and reliable instruments to measure and assess cultural competence for oral health care providers are scarce in the literature, and most published scales have been contested due to a lack of item analysis and internal estimates of reliability. The purposes of this study were, first, to develop a standardized instrument to measure dental students' knowledge of diversity, skills in culturally competent patient-centered communication, and use of culture-centered practices in patient care and, second, to provide preliminary validity support for this instrument. The initial instrument used in this study was a thirty-six-item Likert-scale survey entitled the Knowledge, Efficacy, and Practices Instrument for Oral Health Providers (KEPI-OHP). This instrument is an adaption of an initially thirty-three-item version of the Multicultural Awareness, Knowledge, and Skills Scale-Counselor Edition (MAKSS-CE), a scale that assesses factors related to social justice, cultural differences among clients, and cross-cultural client management. After the authors conducted cognitive and expert interviews, focus groups, pilot testing, and item analysis, their initial instrument was reduced to twenty-eight items. The KEPI-OHP was then distributed to 916 dental students (response rate=48.6 percent) across the United States to measure its reliability and assess its validity. Both exploratory and confirmatory factor analyses were conducted to test the scale's validity. The modification of the survey into a sensible instrument with a relatively clear factor structure using factor analysis resulted in twenty items. A scree test suggested three expressive factors, which were retained for rotation. Bentler's comparative fit and Bentler and Bonnett's non-normed indices were 0.95 and 0.92, respectively. A three-factor solution, including efficacy of assessment, knowledge of diversity, and culture-centered practice subscales, comprised of twenty-items was identified. The KEPI-OHP was found to have reasonable internal consistency reliability to warrant its use for baseline and repeated measures in assessing changes in dental students' growth in cultural competence across four-year dental curricula.

Beyond Academic and Social Integration: Understanding the Impact of a STEM Enrichment Program on the Retention and Degree Attainment of Underrepresented Students

PubMed Central

Lane, Tonisha B.

2016-01-01

The current study used a case study methodological approach, including document analysis, semistructured interviews, and participant observations, to investigate how a science, technology, engineering, and mathematics (STEM) enrichment program supported retention and degree attainment of underrepresented students at a large, public, predominantly white institution. From this study, a model emerged that encompassed four components: proactive care, holistic support, community building, and catalysts for STEM identity development. These components encompassed a number of strategies and practices that were instrumental in the outcomes of program participants. This paper concludes with implications for practice, such as using models to inform program planning, assessment, and evaluation. PMID:27543638

[HERA-QUEST: HTA evaluation of generic pharmaceutical products to improve quality, economic efficiency, patient safety and transparency in drug product changes in hospitals].

PubMed

Gyalrong-Steur, Miriam; Kellermann, Anita; Bernard, Rudolf; Berndt, Georg; Bindemann, Meike; Nusser-Rothermundt, Elfriede; Amann, Steffen; Brakebusch, Myga; Brüggmann, Jörg; Tydecks, Eva; Müller, Markus; Dörje, Frank; Kochs, Eberhard; Riedel, Rainer

2017-04-01

In view of the rising cost pressure and an increasing number of drug shortages, switches between generic drug preparations have become a daily routine in hospitals. To ensure consistently high treatment quality and best possible patient safety, the equivalence of the new and the previous drug preparation must be ensured before any change in the purchase of pharmaceutical products takes place. So far, no easily usable, transparent and standardized instrument for this kind of comparison between generic drug products has been available. A group of pharmaceutical experts has developed the drug HTA (health technology assessment) model "HERA" (HTA Evaluation of geneRic phArmaceutical products) through a multi-step process. The instrument is designed to perform both a qualitative and economic comparison of equivalent drug preparations ("aut idem" substitution) before switching products. The economic evaluation does not only consider unit prices and consumption quantity, but also the processing costs associated with a product change process. The qualitative comparison is based on the evaluation of 34 quality criteria belonging to six evaluation fields (e.g., approval status, practical handling, packaging design). The objective evaluation of the quality criteria is complemented by an assessment of special features of the individual hospital for complex drug switches, including the feedback of the physicians utilizing the drug preparation. Thus potentially problematic switches of pharmaceutical products can be avoided at the best possible rate, contributing to the improvement of patient safety. The novel drug HTA model HERA is a tool used in clinical practice that can add to an increase in quality, therapeutic safety and transparency of drug use while simultaneously contributing to the economic optimization of drug procurement in hospitals. Combining these two is essential for hospitals facing the tension between rising cost pressure and at the same time increasing demands on quality and transparency, triggered by, amongst others, current legislation (Hospital Structures Act, anti-corruption legislation). Copyright © 2017. Published by Elsevier GmbH.

Use of Standardized Assessment Instruments by Marital and Family Therapists: A Survey.

ERIC Educational Resources Information Center

Boughner, Shelly R.; And Others

1994-01-01

Surveyed 598 marriage/family practitioners to examine use of standardized assessment instruments in practice. Responses from 188 clinicians who reported use of tests revealed that 147 different standardized tests were used in marriage and family therapy practice. Test use was most frequent for treatment planning purposes, except in premarital area…

The Salient Beliefs Review: A New Instrument for Connecting Spirit and Work.

ERIC Educational Resources Information Center

Bloch, Deborah

2000-01-01

The Salient Beliefs Review is an instrument that examines seven dimensions (change, balance, energy, community, calling, harmony, and unity) in relation to behavior and workplace policies and practices. It can be used to measure the degree of congruence between individual beliefs and the perception of company policy and practices. (SK)

Designing and Using Research Instruments to Describe the Beliefs and Practices of Mathematics Teachers

ERIC Educational Resources Information Center

Swan, Malcolm

2006-01-01

This article describes research instruments that facilitate the description of teachers' beliefs and practices and their use with further education (FE) mathematics teachers. They consist of linked questionnaires aimed at both teachers and students, validated by cross-referencing with more open questionnaires and with classroom observation. They…

Practices for Identifying and Rejecting Hemolyzed Specimens Are Highly Variable in Clinical Laboratories.

PubMed

Howanitz, Peter J; Lehman, Christopher M; Jones, Bruce A; Meier, Frederick A; Horowitz, Gary L

2015-08-01

Hemolysis is an important clinical laboratory quality attribute that influences result reliability. To determine hemolysis identification and rejection practices occurring in clinical laboratories. We used the College of American Pathologists Survey program to distribute a Q-Probes-type questionnaire about hemolysis practices to Chemistry Survey participants. Of 3495 participants sent the questionnaire, 846 (24%) responded. In 71% of 772 laboratories, the hemolysis rate was less than 3.0%, whereas in 5%, it was 6.0% or greater. A visual scale, an instrument scale, and combination of visual and instrument scales were used to identify hemolysis in 48%, 11%, and 41% of laboratories, respectively. A picture of the hemolysis level was used as an aid to technologists' visual interpretation of hemolysis levels in 40% of laboratories. In 7.0% of laboratories, all hemolyzed specimens were rejected; in 4% of laboratories, no hemolyzed specimens were rejected; and in 88% of laboratories, some specimens were rejected depending on hemolysis levels. Participants used 69 different terms to describe hemolysis scales, with 21 terms used in more than 10 laboratories. Slight and moderate were the terms used most commonly. Of 16 different cutoffs used to reject hemolyzed specimens, moderate was the most common, occurring in 30% of laboratories. For whole blood electrolyte measurements performed in 86 laboratories, 57% did not evaluate the presence of hemolysis, but for those that did, the most common practice in 21 laboratories (24%) was centrifuging and visually determining the presence of hemolysis in all specimens. Hemolysis practices vary widely. Standard assessment and consistent reporting are the first steps in reducing interlaboratory variability among results.

Risk factors for cesarean section and instrumental vaginal delivery after successful external cephalic version.

PubMed

de Hundt, Marcella; Vlemmix, Floortje; Bais, Joke M J; de Groot, Christianne J; Mol, Ben Willem; Kok, Marjolein

2016-01-01

Aim of this article is to examine if we could identify factors that predict cesarean section and instrumental vaginal delivery in women who had a successful external cephalic version. We used data from a previous randomized trial among 25 hospitals and their referring midwife practices in the Netherlands. With the data of this trial, we performed a cohort study among women attempting vaginal delivery after successful ECV. We evaluated whether maternal age, gestational age, parity, time interval between ECV and delivery, birth weight, neonatal gender, and induction of labor were predictive for a vaginal delivery on one hand or a CS or instrumental vaginal delivery on the other hand. Unadjusted and adjusted odds ratios were calculated with univariate and multivariate logistic regression analysis. Among 301 women who attempted vaginal delivery after a successful external cephalic version attempt, the cesarean section rate was 13% and the instrumental vaginal delivery rate 6%, resulting in a combined instrumental delivery rate of 19%. Nulliparity increased the risk of cesarean section (OR 2.7 (95% CI 1.2-6.1)) and instrumental delivery (OR 4.2 (95% CI 2.1-8.6)). Maternal age, gestational age at delivery, time interval between external cephalic version and delivery, birth weight and neonatal gender did not contribute to the prediction of failed spontaneous vaginal delivery. In our cohort of 301 women with a successful external cephalic version, nulliparity was the only one of seven factors that predicted the risk for cesarean section and instrumental vaginal delivery.

[The Spanish version of the Short Form 36 Health Survey: a decade of experience and new developments].

PubMed

Vilagut, Gemma; Ferrer, Montse; Rajmil, Luis; Rebollo, Pablo; Permanyer-Miralda, Gaietà; Quintana, José M; Santed, Rosalía; Valderas, José M; Ribera, Aida; Domingo-Salvany, Antonia; Alonso, Jordi

2005-01-01

The Short Form-36 Health Survey (SF-36) is one of the most widely used and evaluated generic health-related quality of life (HRQL) questionnaires. After almost a decade of use in Spain, the present article critically reviews the content and metric properties of the Spanish version, as well as its new developments. A review of indexed articles that used the Spanish version of the SF-36 was performed in Medline (PubMed), the Spanish bibliographic databases IBECS and IME. Articles that provided information on the measurement model, reliability, validity, and responsiveness to change of the instrument were selected. Seventy-nine articles were found, of which 17 evaluated the metric characteristics of the questionnaire. The reliability of the SF-36 scales was higher than the suggested standard (Cronbach's alpha) of 0.7 in 96% of the evaluations. Grouped evaluations obtained by meta-analysis were higher than 0.7 in all cases. The SF-36 showed good discrimination among severity groups, moderate correlations with clinical indicators, and high correlations with other HRQL instruments. Moreover, questionnaire scores predicted mortality and were able to detect improvement due to therapeutic interventions such as coronary angioplasty, benign prostatic hyperplasia surgery, and non-invasive positive pressure home ventilation. The new developments (norm-based scoring, version 2, the SF-12 and SF-8) improved both the metric properties and interpretation of the questionnaire. The Spanish version of the SF-36 and its recently developed versions is a suitable instrument for use in medical research, as well as in clinical practice.

[The development of an instrument for the "evaluation of hospices from the bereaved family members perspective"].

PubMed

Lohe, Mandy; Zimmermann, Manja; Luderer, Christiane; Sadowski, Katharina

2011-06-01

Inpatient hospice settings as facilities of health services are obliged to the quality assurance and internal quality development in Germany. The meaning of the patient's satisfaction as one of the indirect indicators for the judgement of nursing and care quality is indisputable by now. However, a subjective evaluation of the hospices by guests is practically and ethically problematic. An alternative approach is to investigate the views of bereaved relatives and close friends after the guest's death. The present article describes the development of an inventory for the evaluation of inpatient hospice settings from the bereaved relatives' point of view in order to examine the satisfaction of family members with the end-of-life care their loved ones received. With help of the inventory the question should be answered how family members judge the end-of-life care which was given to them and their late family members by the hospice. The construction of the questions results from the basis of existing concepts to the assessment of the end-of-life care and an analysis of all identified instruments to the evaluation of inpatient hospice settings from the perspective of bereaved relatives. The development of the questionnaire enclosed the formation of an item pool, the item choice, the critical discussion of the questions in the body of experts as well as a standardised and cognitive pretest beside a comprehensive literature research. A five-dimension questionnaire was developed that integrates physical, psychological, social, spiritual, and organisational aspects of the care at the end of life. The instrument encompasses 53 items, predominantly closed questions.

Regularization Methods for High-Dimensional Instrumental Variables Regression With an Application to Genetical Genomics

PubMed Central

Lin, Wei; Feng, Rui; Li, Hongzhe

2014-01-01

In genetical genomics studies, it is important to jointly analyze gene expression data and genetic variants in exploring their associations with complex traits, where the dimensionality of gene expressions and genetic variants can both be much larger than the sample size. Motivated by such modern applications, we consider the problem of variable selection and estimation in high-dimensional sparse instrumental variables models. To overcome the difficulty of high dimensionality and unknown optimal instruments, we propose a two-stage regularization framework for identifying and estimating important covariate effects while selecting and estimating optimal instruments. The methodology extends the classical two-stage least squares estimator to high dimensions by exploiting sparsity using sparsity-inducing penalty functions in both stages. The resulting procedure is efficiently implemented by coordinate descent optimization. For the representative L1 regularization and a class of concave regularization methods, we establish estimation, prediction, and model selection properties of the two-stage regularized estimators in the high-dimensional setting where the dimensionality of co-variates and instruments are both allowed to grow exponentially with the sample size. The practical performance of the proposed method is evaluated by simulation studies and its usefulness is illustrated by an analysis of mouse obesity data. Supplementary materials for this article are available online. PMID:26392642

Job demands and job strain as risk factors for employee wellbeing in elderly care: an instrumental-variables analysis.

PubMed

Elovainio, Marko; Heponiemi, Tarja; Kuusio, Hannamaria; Jokela, Markus; Aalto, Anna-Mari; Pekkarinen, Laura; Noro, Anja; Finne-Soveri, Harriet; Kivimäki, Mika; Sinervo, Timo

2015-02-01

The association between psychosocial work environment and employee wellbeing has repeatedly been shown. However, as environmental evaluations have typically been self-reported, the observed associations may be attributable to reporting bias. Applying instrumental-variable regression, we used staffing level (the ratio of staff to residents) as an unconfounded instrument for self-reported job demands and job strain to predict various indicators of wellbeing (perceived stress, psychological distress and sleeping problems) among 1525 registered nurses, practical nurses and nursing assistants working in elderly care wards. In ordinary regression, higher self-reported job demands and job strain were associated with increased risk of perceived stress, psychological distress and sleeping problems. The effect estimates for the associations of these psychosocial factors with perceived stress and psychological distress were greater, but less precisely estimated, in an instrumental-variables analysis which took into account only the variation in self-reported job demands and job strain that was explained by staffing level. No association between psychosocial factors and sleeping problems was observed with the instrumental-variable analysis. These results support a causal interpretation of high self-reported job demands and job strain being risk factors for employee wellbeing. © The Author 2014. Published by Oxford University Press on behalf of the European Public Health Association. All rights reserved.

Design, construction, and technical implementation of a web-based interdisciplinary symptom evaluation (WISE) - a heuristic proposal for orofacial pain and temporomandibular disorders.

PubMed

Ettlin, Dominik A; Sommer, Isabelle; Brönnimann, Ben; Maffioletti, Sergio; Scheidt, Jörg; Hou, Mei-Yin; Lukic, Nenad; Steiger, Beat

2016-12-01

Medical symptoms independent of body location burden individuals to varying degrees and may require care by more than one expert. Various paper and computer-based tools exist that aim to comprehensively capture data for optimal clinical management and research. A web-based interdisciplinary symptom evaluation (WISE) was newly designed, constructed, and technically implemented. For worldwide applicability and to avoid copyright infringements, open source software tools and free validated questionnaires available in multiple languages were used. Highly secure data storage limits access strictly to those who use the tool for collecting, storing, and evaluating their data. Concept and implementation is illustrated by a WISE sample tailored for the requirements of a single center in Switzerland providing interdisciplinary care to orofacial pain and temporomandibular disorder patients. By combining a symptom- burden checklist with in-depth questionnaires serving as case-finding instruments, an algorithm was developed that assists in clarifying case complexity and need for targeted expert evaluation. This novel modular approach provides a personalized, response-tailored instrument for the time- and cost-effective collection of symptom-burden focused quantitative data. The tool includes body drawing options and instructional videos. It is applicable for biopsychosocial evaluation in a variety of clinical settings and offers direct feedback by a case report summary. In clinical practice, the new instrument assists in clarifying case complexity and referral need, based on symptom burden and response -tailored case finding. It provides single-case summary reports from a biopsychosocial perspective and includes graphical symptom maps. Secure, centrally stored data collection of anonymous data is possible. The tool enables personalized medicine, facilitates interprofessional education and collaboration, and allows for multicenter patient-reported outcomes research.

Study protocol of psychometric properties of the Spanish translation of a competence test in evidence based practice: the Fresno test.

PubMed

Argimon-Pallàs, Josep M; Flores-Mateo, Gemma; Jiménez-Villa, Josep; Pujol-Ribera, Enriqueta; Foz, Gonçal; Bundó-Vidiella, Magda; Juncosa, Sebastià; Fuentes-Bellido, Cruz M; Pérez-Rodríguez, Belén; Margalef-Pallarès, Francesc; Villafafila-Ferrero, Rosa; Forès-Garcia, Dolors; Roman-Martínez, Josep; Vilert-Garroga, Esther

2009-02-24

There are few high-quality instruments for evaluating the effectiveness of Evidence-Based Practice (EBP) curricula with objective outcomes measures. The Fresno test is an instrument that evaluates most of EBP steps with a high reliability and validity in the English original version. The present study has the aims to translate the Fresno questionnaire into Spanish and its subsequent validation to ensure the equivalence of the Spanish version against the English original. The questionnaire will be translated with the back translation technique and tested in Primary Care Teaching Units in Catalonia (PCTU). Participants will be: (a) tutors of Family Medicine residents (expert group); (b) Family Medicine residents in their second year of the Family Medicine training program (novice group), and (c) Family Medicine physicians (intermediate group). The questionnaire will be administered before and after an educational intervention. The educational intervention will be an interactive four half-day sessions designed to develop the knowledge and skills required to EBP. Responsiveness statistics used in the analysis will be the effect size, the standardised response mean and Guyatt's method. For internal consistency reliability, two measures will be used: corrected item-total correlations and Cronbach's alpha. Inter-rater reliability will be tested using Kappa coefficient for qualitative items and intra-class correlation coefficient for quantitative items and the overall score. Construct validity, item difficulty, item discrimination and feasibility will be determined. The validation of the Fresno questionnaire into different languages will enable the expansion of the questionnaire, as well as allowing comparison between countries and the evaluation of different teaching models.

Description and evaluation of a hearing conservation program in use in a professional symphony orchestra.

PubMed

O'Brien, Ian; Driscoll, Tim; Ackermann, Bronwen

2015-04-01

Professional orchestral musicians risk permanent hearing loss while playing their instruments. Protecting the hearing of these musicians in the workplace is critical to their ongoing ability to play their instruments, but typical workplace hearing conservation measures can have very damaging effects on the product (music) and the musicians' abilities to hear one another sufficiently. To enable effective intervention, orchestras as employers must encourage engagement with hearing protection programs and implement controls while preserving the integrity of the music. To achieve this, typical approaches used in other industries must be redesigned to suit this unique workplace. In response to these challenges, the Queensland Symphony Orchestra (Brisbane, Australia) introduced a comprehensive hearing conservation strategy in 2005 based upon best practice at the time. This strategy-which has been regularly refined-continues to be implemented on a daily basis. This investigation aimed to assess the successes, difficulties, and practical viability of the program. To achieve this a process evaluation was carried out, incorporating archival analyses, player and management focus groups, and an interview with the program's administrator. Results show the program has successfully become integrated into the orchestra's and the musicians' daily operations and significantly contributes to managing the risk of hearing loss in this population. While there is room for improvement in the orchestra's approach-particularly regarding usable personal protective devices and improved education and training, results are encouraging. This study provides a basis for those wishing to implement or evaluate similar paradigms. © The Author 2014. Published by Oxford University Press on behalf of the British Occupational Hygiene Society.

Cognitive assessment: A challenge for occupational therapists in Brazil

PubMed Central

Conti, Juliana

2017-01-01

Cognitive impairment is a common dysfunction after neurological injury. Cognitive assessment tools can help the therapist understand how impairments are affecting functional status and quality of life. Objective The aim of the study was to identify instruments for cognitive assessment that Occupational Therapists (OT) can use in clinical practice. Methods The instruments published in English and Portuguese between 1999 and 2016 were systematically reviewed. Results The search identified 17 specific instruments for OT not validated in Brazilian Portuguese, 10 non-specific instruments for OT not validated in Brazilian Portuguese, and 25 instruments validated for Portuguese, only one of which was specific for OT (Lowenstein Occupational Therapy Cognitive Assessment). Conclusion There are few assessment cognitive tools validated for use in the Brazilian culture and language. The majority of the instruments appear not to be validated for use by OT in clinical practice. PMID:29213503

Factor analysis methods and validity evidence: A systematic review of instrument development across the continuum of medical education

NASA Astrophysics Data System (ADS)

Wetzel, Angela Payne

Previous systematic reviews indicate a lack of reporting of reliability and validity evidence in subsets of the medical education literature. Psychology and general education reviews of factor analysis also indicate gaps between current and best practices; yet, a comprehensive review of exploratory factor analysis in instrument development across the continuum of medical education had not been previously identified. Therefore, the purpose for this study was critical review of instrument development articles employing exploratory factor or principal component analysis published in medical education (2006--2010) to describe and assess the reporting of methods and validity evidence based on the Standards for Educational and Psychological Testing and factor analysis best practices. Data extraction of 64 articles measuring a variety of constructs that have been published throughout the peer-reviewed medical education literature indicate significant errors in the translation of exploratory factor analysis best practices to current practice. Further, techniques for establishing validity evidence tend to derive from a limited scope of methods including reliability statistics to support internal structure and support for test content. Instruments reviewed for this study lacked supporting evidence based on relationships with other variables and response process, and evidence based on consequences of testing was not evident. Findings suggest a need for further professional development within the medical education researcher community related to (1) appropriate factor analysis methodology and reporting and (2) the importance of pursuing multiple sources of reliability and validity evidence to construct a well-supported argument for the inferences made from the instrument. Medical education researchers and educators should be cautious in adopting instruments from the literature and carefully review available evidence. Finally, editors and reviewers are encouraged to recognize this gap in best practices and subsequently to promote instrument development research that is more consistent through the peer-review process.

Nurses' Attitudes Regarding the Safe Handling of Patients Who Are Morbidly Obese: Instrument Development and Psychometric Analysis.

PubMed

Bejciy-Spring, Susan; Vermillion, Brenda; Morgan, Sally; Newton, Cheryl; Chucta, Sheila; Gatens, Cindy; Zadvinskis, Inga; Holloman, Christopher; Chipps, Esther

2016-12-01

Nurses' attitudes play an important role in the consistent practice of safe patient handling behaviors. The purposes of this study were to develop and assess the psychometric properties of a newly developed instrument measuring attitudes of nurses related to the care and safe handling of patients who are obese. Phases of instrument development included (a) item generation, (b) content validity assessment, (c) reliability assessment, (d) cognitive interviewing, and (e) construct validity assessment through factor analysis. The final data from the exploratory factor analysis produced a 26-item multidimensional instrument that contains 9 subscales. Based on the factor analysis, a 26-item instrument can be used to examine nurses' attitudes regarding patients who are morbidly obese and related safe handling practices.

Psychometric Evaluation of the Summary of Diabetes Self-Care Activities-Arabic (SDSCA-Arabic): Translation and Analysis Process.

PubMed

AlJohani, Khalid A; Kendall, Garth E; Snider, Paul D

2016-01-01

To translate and examine the psychometric properties of the Arabic version of the Summary of Diabetes Self-Care Activities. An instrument translation and validation study. A total of 243 participants (33 first sample and 210 second sample) diagnosed with type 2 diabetes mellitus were recruited from four primary health care centers in Saudi Arabia. The study was guided by the World Health Organization guidelines for translation and validation of instrument. Translation indicators showed satisfactory outcomes for each included process in the forward-translation, an expert panel, and back-translation stages. Reliability and validity outcomes were as follows: test-retest, r = .912 and p < .001; split-half = .9; and Cronbach's alpha (α) = .76. The alpha scores for the subscales were as follows: diet, .89; exercise, .83; blood glucose testing, .92; and foot care, .77. Principal component analysis revealed the presence of four components with eigenvalues greater than 1.0, explaining 34.4, 16.4, 15.4, and 11.2% of the variance in everyday practices for these items, respectively (accumulated = 77.1%). The translation and validation processes revealed acceptable psychometric properties. The instrument could evaluate diabetes self-care in Saudi Arabia and has the potential to be used in other Arabic-speaking populations. © The Author(s) 2014.

Evaluating outcomes of palliative photodynamic therapy: instrument development and preliminary results

NASA Astrophysics Data System (ADS)

Goodell, Teresa T.; Bargo, Paulo R.; Jacques, Steven L.

2002-06-01

Background: Subjective measures are considered the gold standard in palliative care evaluation, but no studies have evaluated palliative photodynamic therapy (PDT) subjectively. If PDT is to be accepted as a palliative therapy for later-stage obstructing esophageal and lung cancer, evidence of its effectiveness and acceptability to patients must be made known. Study Design/Materials and Methods: This ongoing study's major aim is to evaluate subjective outcomes of PDT in patients with obstructing esophageal and lung cancer. Existing measures of health status, dysphagia and performance status were supplemented with an instrument developed to evaluate PDT symptom relief and side effect burden, the PDT Side Effects Survey (PSES). Results: PDT patients treated with porfimer sodium (Photofrin) and 630-nm light experienced reduced dysphagia grade and stable performance status for at least one month after PDT (N= 10-17), but these effects did not necessarily persist at three months. Fatigue, appetite and quality of life may be the most burdensome issues for these patients. Conclusions: Preliminary data suggest that the PSES is an acceptable and valid tool for measuring subjective outcomes of palliative PDT. This study is the first attempt to systematically evaluate subjective outcomes of palliative PDT. Multi-center outcomes research is needed to draw generalizable conclusions that will establish PDT's effectiveness in actual clinical practice and enhance the wider adoption of PDT as a cancer symptom relief modality.

Estimating costs of quality improvement for outpatient healthcare organisations: a practical methodology.

PubMed

Brown, Sydney E S; Chin, Marshall H; Huang, Elbert S

2007-08-01

Outpatient healthcare organisations worldwide participate in quality improvement (QI) programmes. Despite the importance of understanding the financial impact of such programmes, there are no established standard methods for empirically assessing QI programme costs and their consequences for small outpatient healthcare organisations. The costs and cost consequences were evaluated for a diabetes QI programme implemented throughout the USA in federally qualified community health centres. For five case study centres, survey instruments and methods for data analysis were developed. Two types of cost/revenue were evaluated. Direct costs/revenues, such as personnel time, items purchased and grants received, were evaluated using self-administered surveys. Cost/revenue consequences, which were cost/revenue changes that may have occurred due to changes in patient utilisation or physician behaviour, were evaluated using electronic billing data. Other methods for evaluating cost/revenue consequences if electronic billing data are not available are also discussed. This paper describes a practical taxonomy and method for assessing the costs and revenues of QI programmes for outpatient organisations. Results of such analyses will be useful for healthcare organisations implementing QI programmes and also for policy makers designing incentives for QI participation.

An evaluation of the infection control potential of a UV clinical podiatry unit.

PubMed

Humphreys, Paul N; Davies, Chris S; Rout, Simon

2014-02-28

Infection control is a key issue in podiatry as it is in all forms of clinical practice. Airborne contamination may be particularly important in podiatry due to the generation of particulates during treatment. Consequently, technologies that prevent contamination in podiatry settings may have a useful role. The aims of this investigation were twofold, firstly to determine the ability of a UV cabinet to protect instruments from airborne contamination and secondly to determine its ability to remove microbes from contaminated surfaces and instruments. A UV instrument cabinet was installed in a University podiatry suite. Impact samplers and standard microbiological techniques were used to determine the nature and extent of microbial airborne contamination. Sterile filters were used to determine the ability of the UV cabinet to protect exposed surfaces. Artificially contaminated instruments were used to determine the ability of the cabinet to remove microbial contamination. Airborne bacterial contamination was dominated by Gram positive cocci including Staphylococcus aureus. Airborne fungal levels were much lower than those observed for bacteria. The UV cabinet significantly reduced (p < 0.05) the observed levels of airborne contamination. When challenged with contaminated instruments the cabinet was able to reduce microbial levels by between 60% to 100% with more complex instruments e.g. clippers, remaining contaminated. Bacterial airborne contamination is a potential infection risk in podiatry settings due to the presence of S. aureus. The use of a UV instrument cabinet can reduce the risk of contamination by airborne microbes. The UV cabinet tested was unable to decontaminate instruments and as such could pose an infection risk if misused.

An evaluation of the infection control potential of a UV clinical podiatry unit

PubMed Central

2014-01-01

Background Infection control is a key issue in podiatry as it is in all forms of clinical practice. Airborne contamination may be particularly important in podiatry due to the generation of particulates during treatment. Consequently, technologies that prevent contamination in podiatry settings may have a useful role. The aims of this investigation were twofold, firstly to determine the ability of a UV cabinet to protect instruments from airborne contamination and secondly to determine its ability to remove microbes from contaminated surfaces and instruments. Method A UV instrument cabinet was installed in a University podiatry suite. Impact samplers and standard microbiological techniques were used to determine the nature and extent of microbial airborne contamination. Sterile filters were used to determine the ability of the UV cabinet to protect exposed surfaces. Artificially contaminated instruments were used to determine the ability of the cabinet to remove microbial contamination. Results Airborne bacterial contamination was dominated by Gram positive cocci including Staphylococcus aureus. Airborne fungal levels were much lower than those observed for bacteria. The UV cabinet significantly reduced (p < 0.05) the observed levels of airborne contamination. When challenged with contaminated instruments the cabinet was able to reduce microbial levels by between 60% to 100% with more complex instruments e.g. clippers, remaining contaminated. Conclusions Bacterial airborne contamination is a potential infection risk in podiatry settings due to the presence of S. aureus. The use of a UV instrument cabinet can reduce the risk of contamination by airborne microbes. The UV cabinet tested was unable to decontaminate instruments and as such could pose an infection risk if misused. PMID:24576315

The psychometric properties and practicability of self-report instruments to identify medication nonadherence in adult transplant patients: a systematic review.

PubMed

Dobbels, Fabienne; Berben, Lut; De Geest, Sabina; Drent, Gerda; Lennerling, Annette; Whittaker, Clare; Kugler, Christiane

2010-07-27

Nonadherence to immunosuppressive therapy is recognized as a key prognostic indicator for poor posttransplantation long-term outcomes. Several methods aiming to measure medication nonadherence have been suggested in the literature. Although combining measurement methods is regarded as the gold standard for measuring nonadherence, self-report is generally considered a central component of adherence assessment. However, no systematic review currently exists to determine which instrument(s) are most appropriate for use in transplant populations. The transplant360 Task Force first performed a survey of the self-report adherence instruments currently used in European centers. Next, a systematic literature review of self-report instruments assessing medication adherence in chronically ill patients was conducted. Self-report instruments were evaluated to assess those which were: (a) short and easy to score; (b) assessed both the taking and timing of medication intake; and (c) had established reliability and validity. Fourteen instruments were identified from our survey of European centers, of which the Basel Assessment of Adherence Scale for Immunosuppressives met the aforementioned criteria. The systematic review found 20 self-report instruments, of which only two qualified for use in transplantation, that is, the Brief Antiretroviral Adherence Index and the Medication Adherence Self-Report Inventory. The three selected self-report scales may assist transplant professionals in detecting nonadherence. However, these scales were only validated in patients with HIV. Although HIV shares similar characteristics with transplantation, including the importance of taking and timing of medication, further validation in transplant populations is required.

Factor structure and validity of the Depression, Anxiety and Stress Scale-21 in Swedish translation.

PubMed

Alfonsson, S; Wallin, E; Maathz, P

2017-03-01

WHAT IS KNOWN ON THE SUBJECT?: The Depression, Anxiety and Stress Scale-21 (DASS-21) is a widely used measurement for psychological symptoms and distress. Some previous studies have shown that the DASS-21 can accurately measure symptoms of anxiety, depression and stress, while other studies have indicated that the DASS-21 mainly measures overall distress. The factor structure of the DASS-21 is important and debated since if affects interpretations of findings. WHAT DOES THIS PAPER ADD TO EXISTING KNOWLEDGE?: In this study, the DASS-21 was translated into Swedish and evaluated in three diverse samples. The DASS-21 subscales of Depression and Anxiety correlated significantly with corresponding criteria instruments. The DASS-21 Stress subscale showed more diverse associations with psychological distress. The analyses supported a bifactor model of the DASS-21 with three specific factors of depression, anxiety and stress as well as a general distress factor. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: The results show that the DASS-21 may be used to measure unique symptoms of depression, anxiety and, with some caveat, stress as well as overall psychological distress. This study confirms that the DASS-21 is theoretically sound instrument that is feasible for both research and clinical practice. The DASS-21 can be an accessible tool for screening and evaluation in first-line mental health services. Introduction There is a constant need for theoretically sound and valid self-report instruments for measuring psychological distress. Previous studies have shown that the Depression, Anxiety and Stress Scale-21 (DASS-21) is theoretically sound, but there have been some inconsistent results regarding its factor structure. Aims The aim of the present study was to investigate and elucidate the factor structure and convergent validity of the DASS-21. Methods A total of 624 participants recruited from student, primary care and psychotherapy populations. The factor structure of the DASS-21 was assessed by confirmatory factor analyses and the convergent validity by investigating its unique correlations with other psychiatric instruments. Results A bifactor structure with depression, anxiety, stress and a general factor provided the best fit indices for the DASS-21. The convergent validity was adequate for the Depression and Anxiety subscales but more ambiguous for the Stress subscale. Discussion The present study overall supports the validity and factor structure of the DASS-21. Implications for practice The DASS-21 can be used to measure symptoms of depression and anxiety as well as overall distress. It can be useful for mental health nurses, and other first-line psychiatric professionals, in need of a short, feasible and valid instrument in everyday care. © 2017 John Wiley & Sons Ltd.

Measuring changes in perception using the Student Perceptions of Physician-Pharmacist Interprofessional Clinical Education (SPICE) instrument.

PubMed

Zorek, Joseph A; MacLaughlin, Eric J; Fike, David S; MacLaughlin, Anitra A; Samiuddin, Mohammed; Young, Rodney B

2014-05-20

The Student Perceptions of Physician-Pharmacist Interprofessional Clinical Education (SPICE) instrument contains 10 items, 3 factors (interprofessional teamwork and team-based practice, roles/responsibilities for collaborative practice, and patient outcomes from collaborative practice), and utilizes a five-point response scale (1 = strongly disagree, 5 = strongly agree). Given the SPICE instrument's demonstrated validity and reliability, the objective of this study was to evaluate whether it was capable of measuring changes in medical (MS) and pharmacy students' (PS) perceptions following an interprofessional education (IPE) experience. In this prospective cohort study, MS and PS completed the SPICE instrument before and after participation in a predefined IPE experience. Descriptive statistics were used to characterize students and pre-post responses. Independent samples t tests and Fisher's Exact tests were used to assess group difference in demographic variables. Mann Whitney U tests were used to assess between-group differences in item scores. Wilcoxon Signed-Rank tests were used to evaluate post-participation changes in item scores. Spearman correlations were calculated to assess associations between ordinal demographic variables and item scores, and whether the number of clinic visits completed was associated with post-test responses. Paired samples t tests were used to calculate mean score changes for each of the factors. Thirty-four MS and 15 PS were enroled. Baseline differences included age (25.3. ± 1.3 MS vs. 28.7 ± 4.4 PS; p = 0.013), years full-time employment (0.71 ± 0.97 MS vs. 4.60 ± 4.55 PS; p < 0.001), and number of prior IPE rotations (1.41 ± 1.74 MS vs. 3.13 ± 2.1 PS; p < 0.001). Two items generated baseline differences; 1 persisted post-participation: whether MS/PS should be involved in teamwork (3.91 MS vs. 4.60 PS; p < 0.001). For all students, significant mean score increases were observed for role clarity ("my role" [3.72 vs. 4.11; p = 0.001] and "others' roles" [3.87 vs. 4.17; p = 0.001]), impact of teamwork on patient satisfaction (3.72 vs. 4.34; p < 0.001), and ideal curricular location for IPE (4.06 vs. 4.34; p = 0.002). Significant increases were observed for all three factors (teamwork, p = 0.003; roles/responsibilities and patient outcomes, p < 0.001). This study demonstrated the SPICE instrument's ability to measure changes in perception for medical and pharmacy students exposed to an IPE experience, both at the individual item level and at the factor level.

A masterclass to teach public health professionals to conduct practice-based research to promote evidence-based practice: a case study from The Netherlands.

PubMed

Jansen, Maria W J; Hoeijmakers, Marjan

2013-01-01

Public health professionals have a pivotal position in efforts to obtain more practice-based evidence about what people need and what works in real circumstances. Close collaboration with researchers should enable public health professionals to design and conduct research in practical settings to address today's complex public health problems and increase the external validity of results. This requires expanding the research competencies of public health professionals. We developed and implemented a masterclass for public health professionals, modeled on an existing scientific training course for general practitioners and rehabilitation physicians. The masterclass was evaluated using a multiple method design, involving quantitative and qualitative methods. Evaluation took place during, at the end of, and 9 months after the masterclass. Twenty-one candidates (mean age, 41 y) started the program, 66% of whom completed it. Teaching materials, lectures, organization, and facilities were favorably evaluated. At the end of the masterclass, participants were able to design and implement a research proposal in their daily work setting, write a draft article, and critically appraise scientific research for practice and policy purposes. Participants had become more confident about their research competence. Management support from their employer proved crucial. Results obtained with the different methods were consistent. The masterclass appeared to be an effective instrument to increase the practice-based research skills of public health professionals, provided the research is implemented in a supportive organization with management backing and supervision by senior university researchers. We recommend using masterclasses to contribute to the improvement of practice-based evidence for projects addressing current and future public health problems.

Quality appraisal of clinical practice guidelines on the use of physiotherapy in rheumatoid arthritis: a systematic review.

PubMed

Hurkmans, Emalie J; Jones, Anamaria; Li, Linda C; Vliet Vlieland, Theodora P M

2011-10-01

To assess the quality of guidelines published in peer-reviewed literature concerning the role of physiotherapy in the management of patients with RA. A systematic literature search for clinical practice guidelines that included physiotherapy interventions was performed in four electronic databases. We assessed the quality of the selected guidelines using the appraisal of guidelines for research and evaluation (AGREE) instrument. In addition, the recommendations of guidelines with the highest quality scores were summarized. Eight clinical practice guidelines fulfilled the inclusion criteria. Scope/purpose was the most often adequately addressed AGREE domain (in seven of the eight guidelines) and applicability the least (in two of the eight guidelines). Based on the AGREE domain scores, six guidelines could be recommended or strongly recommended for clinical use. Five out of these six (strongly) recommended guidelines included a recommendation on exercise therapy and/or patient education, with these interventions being recommended in every case. Transcutaneous electrical nerve stimulation and thermotherapy were recommended in four of these six guidelines. US, thermotherapy, low-level laser therapy, massage, passive mobilization and balneotherapy were addressed in one or two of these six guidelines. Six of eight clinical practice guidelines addressing physiotherapy interventions were recommended or strongly recommended according to the AGREE instrument. In general, guideline recommendations on physiotherapy intervention, from both the recommended guidelines as well as from the not recommended guidelines, lacked detail concerning mode of delivery, intensity, frequency and duration.

Development of an Educational Game to Set Up Surgical Instruments on the Mayo Stand or Back Table: Applied Research in Production Technology.

PubMed

Paim, Crislaine Pires Padilha; Goldmeier, Silvia

2017-01-10

Existing research suggests that digital games can be used effectively for educational purposes at any level of training. Perioperative nursing educators can use games to complement curricula, in guidance and staff development programs, to foster team collaboration, and to give support to critical thinking in nursing practice because it is a complex environment. To describe the process of developing an educational game to set up surgical instruments on the Mayo stand or back table as a resource to assist the instructor in surgical instrumentation training for students and nursing health professionals in continued education. The study was characterized by applied research in production technology. It included the phases of analysis and design, development, and evaluation. The objectives of the educational game were developed through Bloom's taxonomy. Parallel to the physical development of the educational game, a proposed model for the use of digital elements in educational game activities was applied to develop the game content. The development of the game called "Playing with Tweezers" was carried out in 3 phases and was evaluated by 15 participants, comprising students and professional experts in various areas of knowledge such as nursing, information technology, and education. An environment was created with an initial screen, menu buttons containing the rules of the game, and virtual tour modes for learning and assessment. The "digital" nursing student needs engagement, stimulation, reality, and entertainment, not just readings. "Playing with Tweezers" is an example of educational gaming as an innovative teaching strategy in nursing that encourages the strategy of involving the use of educational games to support theoretical or practical classroom teaching. Thus, the teacher does not work with only 1 type of teaching methodology, but with a combination of different methodologies. In addition, we cannot forget that skill training in an educational game does not replace curricular practice, but helps. ©Crislaine Pires Padilha Paim, Silvia Goldmeier. Originally published in JMIR Serious Games (http://games.jmir.org), 10.01.2017.

The relationship between characteristics of context and research utilization in a pediatric setting.

PubMed

Cummings, Greta G; Hutchinson, Alison M; Scott, Shannon D; Norton, Peter G; Estabrooks, Carole A

2010-06-16

Research utilization investigators have called for more focused examination of the influence of context on research utilization behaviors. Yet, up until recently, lack of instrumentation to identify and quantify aspects of organizational context that are integral to research use has significantly hampered these efforts. The Alberta Context Tool (ACT) was developed to assess the relationships between organizational factors and research utilization by a variety of healthcare professional groups. The purpose of this paper is to present findings from a pilot study using the ACT to elicit pediatric and neonatal healthcare professionals' perceptions of the organizational context in which they work and their use of research to inform practice. Specifically, we report on the relationship between dimensions of context, founded on the Promoting Action on Research Implementation in Health Services (PARIHS) framework, and self-reported research use behavior. A cross-sectional survey approach was employed using a version of the ACT, modified specifically for pediatric settings. The survey was administered to nurses working in three pediatric units in Alberta, Canada. Scores for three dimensions of context (culture, leadership and evaluation) were used to categorize respondent data into one of four context groups (high, moderately high, moderately low and low). We then examined the relationships between nurses' self-reported research use and their perceived context. A 69% response rate was achieved. Statistically significant differences in nurses' perceptions of culture, leadership and evaluation, and self-reported conceptual research use were found across the three units. Differences in instrumental research use across the three groups of nurses by unit were not significant. Higher self-reported instrumental and conceptual research use by all nurses in the sample was associated with more positive perceptions of their context. Overall, the results of this study lend support to the view that more positive contexts are associated with higher reports of research use in practice. These findings have implications for organizational endeavors to promote evidence-informed practice and maximize the quality of care. Importantly, these findings can be used to guide the development of interventions to target modifiable characteristics of organizational context that are influential in shaping research use behavior.

The relationship between characteristics of context and research utilization in a pediatric setting

PubMed Central

2010-01-01

Background Research utilization investigators have called for more focused examination of the influence of context on research utilization behaviors. Yet, up until recently, lack of instrumentation to identify and quantify aspects of organizational context that are integral to research use has significantly hampered these efforts. The Alberta Context Tool (ACT) was developed to assess the relationships between organizational factors and research utilization by a variety of healthcare professional groups. The purpose of this paper is to present findings from a pilot study using the ACT to elicit pediatric and neonatal healthcare professionals' perceptions of the organizational context in which they work and their use of research to inform practice. Specifically, we report on the relationship between dimensions of context, founded on the Promoting Action on Research Implementation in Health Services (PARIHS) framework, and self-reported research use behavior. Methods A cross-sectional survey approach was employed using a version of the ACT, modified specifically for pediatric settings. The survey was administered to nurses working in three pediatric units in Alberta, Canada. Scores for three dimensions of context (culture, leadership and evaluation) were used to categorize respondent data into one of four context groups (high, moderately high, moderately low and low). We then examined the relationships between nurses' self-reported research use and their perceived context. Results A 69% response rate was achieved. Statistically significant differences in nurses' perceptions of culture, leadership and evaluation, and self-reported conceptual research use were found across the three units. Differences in instrumental research use across the three groups of nurses by unit were not significant. Higher self-reported instrumental and conceptual research use by all nurses in the sample was associated with more positive perceptions of their context. Conclusions Overall, the results of this study lend support to the view that more positive contexts are associated with higher reports of research use in practice. These findings have implications for organizational endeavors to promote evidence-informed practice and maximize the quality of care. Importantly, these findings can be used to guide the development of interventions to target modifiable characteristics of organizational context that are influential in shaping research use behavior. PMID:20565714

Assessing health literacy practices in a community pharmacy environment: experiences using the AHRQ Pharmacy Health Literacy Assessment Tool.

PubMed

O'Neal, Katherine S; Crosby, Kimberly M; Miller, Michael J; Murray, Kelly A; Condren, Michelle E

2013-01-01

The Agency for Healthcare Research and Quality (AHRQ) developed the tool, "Is Our Pharmacy Meeting Patients' Needs? Pharmacy Health Literacy Assessment Tool" to evaluate health literacy preparedness of pharmacy environments from patient, staff, and environmental perspectives. The tool was designed at a clinic-based, outpatient pharmacy of a large, urban, public hospital. Despite the ready availability of this tool and the encouragement of AHRQ to adapt it to other environments, there is no published literature on the dissemination and translation of this tool in the community pharmacy environment. The five objectives of this study were to: (1) pilot the AHRQ tool "Is Our Pharmacy Meeting Patients' Needs? Pharmacy Health Literacy Assessment Tool" in a community pharmacy environment; (2) evaluate and adapt the tool; (3) describe the use of health literacy practices from patient, staff, and independent auditor perspectives using the revised tool; (4) evaluate the effect of a low-intensity educational health literacy awareness program; and (5) identify opportunities to improve health literacy-sensitive practices in the community pharmacy environment. The study employed a mixed method, posttest-only control group design using community pharmacies in the Tulsa, OK area. Participants included community pharmacists, staff, patients, and independent auditors. Select pharmacy staff members were invited to receive a health literacy training program delivered by a nationally-recognized health literacy expert to raise awareness of health literacy issues. Approximately eight months after the program, pharmacy staffs were surveyed using a written instrument, patients were interviewed by telephone, and the study investigators performed independent environmental audits in each of the selected pharmacies. Results from auditor evaluations, staff survey responses, and patient interviews were compared for similarities and differences to provide a multidimensional perspective about the use of health literacy-sensitive practices. After piloting and adapting the AHRQ tool for the community pharmacy environment, 60 patients completed telephone interviews, 31 staff members completed surveys, and four independent auditors completed environmental audits in six study pharmacies using the revised data collection instruments. The majority of patients and staff were in agreement that written materials were easy to read. However, the auditors did not report equally high agreement regarding the readability qualities of the written materials. While the majority of staff reported use of literacy-sensitive communication techniques with patients, only a minority of patients reported actual communication with the pharmacist and use of literacy-sensitive communication techniques. At trained pharmacies, a significantly larger proportion of patients reported that the pharmacist spent enough time answering their questions (100% vs. 87%, P = 0.038), but a smaller proportion reported the pharmacists reviewed important information from the written information provided (30% vs. 57%, P = 0.035). A significantly smaller proportion of pharmacy staff also reported using the repeat-back technique at the trained pharmacies (40% vs. 79%, P = 0.035). This project is the first to report piloting, revision, and implementation of the AHRQ Health Literacy Assessment Tool in a community pharmacy practice setting. In addition to adapting data collection instruments and implementation strategies, opportunities that target training to facilitate use of literacy-sensitive practices and active patient engagement with literacy-sensitive communication techniques were identified. Copyright © 2013 Elsevier Inc. All rights reserved.

The concept of research utilization as understood by Swedish nurses: demarcations of instrumental, conceptual, and persuasive research utilization.

PubMed

Strandberg, Elisabeth; Catrine Eldh, Ann; Forsman, Henrietta; Rudman, Ann; Gustavsson, Petter; Wallin, Lars

2014-02-01

The literature implies research utilization (RU) to be a multifaceted and complex phenomenon, difficult to trace in clinical practice. A deeper understanding of the concept of RU in a nursing context is needed, in particular, for the development of instruments for measuring nurses' RU, which could facilitate the evaluation of interventions to support the implementation of evidence-based practice. In this paper, we explored nurses' demarcation of instrumental RU (IRU), conceptual RU (CRU), and persuasive RU (PRU) using an item pool proposed to measure IRU, CRU, and PRU. The item pool (12 items) was presented to two samples: one of practicing registered nurses (n = 890) in Sweden 4 years after graduating and one of recognized content experts (n = 7). Correlation analyses and content validity index (CVI) calculations were used together with qualitative content analysis, in a mixed methods design. According to the item and factor analyses, CRU and PRU could not be distinguished, whereas IRU could. Analyses also revealed problems in linking the CRU items to the external criteria. The CVIs, however, showed excellent or good results for the IRU, CRU, and PRU items as well as at the scale level. The qualitative data indicated that IRU was the least problematic for the experts to categorize, whereas CRU and PRU were harder to demarcate. Our findings illustrate a difficulty in explicitly demarcating between CRU and PRU in clinical nursing. We suggest this overlap is related to conceptual incoherence, indicating a need for further studies. The findings constitute new knowledge about the RU concepts in a clinical nursing context, and highlight differences in how the concepts can be understood by RNs in clinical practice and experts within the field. We suggest that the findings are useful for defining RU in nursing and further development of measures of RU. © 2013 Sigma Theta Tau International.

Factors affecting knowledge transfer from continuing professional education to clinical practice: Development and psychometric properties of a new instrument.

PubMed

Vasli, Parvaneh; Dehghan-Nayeri, Nahid; Khosravi, Laleh

2018-01-01

Despite the emphasis placed on the implementation of continuing professional education programs in Iran, researchers or practitioners have not developed an instrument for assessing the factors that affect the knowledge transfer from such programs to clinical practice. The aim of this study was to design and validate such instrument for the Iranian context. The research used a three-stage mix method. In the first stage, in-depth interviews with nurses and content analysis were conducted, after which themes were extracted from the data. In the second stage, the findings of the content analysis and literature review were examined, and preliminary instrument options were developed. In the third stage, qualitative content validity, face validity, content validity ratio, content validity index, and construct validity using exploratory factor analysis was conducted. The reliability of the instrument was measured before and after the determination of construct validity. Primary tool instrument initially comprised 53 items, and its content validity index was 0.86. In the multi-stage factor analysis, eight questions were excluded, thereby reducing 11 factors to five and finally, to four. The final instrument with 43 items consists of the following dimensions: structure and organizational climate, personal characteristics, nature and status of professionals, and nature of educational programs. Managers can use the Iranian instrument to identify factors affecting knowledge transfer of continuing professional education to clinical practice. Copyright © 2017. Published by Elsevier Ltd.

The 4-Item Negative Symptom Assessment (NSA-4) Instrument: A Simple Tool for Evaluating Negative Symptoms in Schizophrenia Following Brief Training.

PubMed

Alphs, Larry; Morlock, Robert; Coon, Cheryl; van Willigenburg, Arjen; Panagides, John

2010-07-01

Objective. To assess the ability of mental health professionals to use the 4-item Negative Symptom Assessment instrument, derived from the Negative Symptom Assessment-16, to rapidly determine the severity of negative symptoms of schizophrenia.Design. Open participation.Setting. Medical education conferences.Participants. Attendees at two international psychiatry conferences.Measurements. Participants read a brief set of the 4-item Negative Symptom Assessment instructions and viewed a videotape of a patient with schizophrenia. Using the 1 to 6 4-item Negative Symptom Assessment severity rating scale, they rated four negative symptom items and the overall global negative symptoms. These ratings were compared with a consensus rating determination using frequency distributions and Chi-square tests for the proportion of participant ratings that were within one point of the expert rating.Results. More than 400 medical professionals (293 physicians, 50% with a European practice, and 55% who reported past utilization of schizophrenia ratings scales) participated. Between 82.1 and 91.1 percent of the 4-items and the global rating determinations by the participants were within one rating point of the consensus expert ratings. The differences between the percentage of participant rating scores that were within one point versus the percentage that were greater than one point different from those by the consensus experts was significant (p<0.0001). Participants rating of negative symptoms using the 4-item Negative Symptom Assessment did not generally differ among the geographic regions of practice, the professional credentialing, or their familiarity with the use of schizophrenia symptom rating instruments.Conclusion. These findings suggest that clinicians from a variety of geographic practices can, after brief training, use the 4-item Negative Symptom Assessment effectively to rapidly assess negative symptoms in patients with schizophrenia.

Development of a database of instruments for resource-use measurement: purpose, feasibility, and design.

PubMed

Ridyard, Colin H; Hughes, Dyfrig A

2012-01-01

Health economists frequently rely on methods based on patient recall to estimate resource utilization. Access to questionnaires and diaries, however, is often limited. This study examined the feasibility of establishing an open-access Database of Instruments for Resource-Use Measurement, identified relevant fields for data extraction, and outlined its design. An electronic survey was sent to authors of full UK economic evaluations listed in the National Health Service Economic Evaluation Database (2008-2010), authors of monographs of Health Technology Assessments (1998-2010), and subscribers to the JISCMail health economics e-mailing list. The survey included questions on piloting, validation, recall period, and data capture method. Responses were analyzed and data extracted to generate relevant fields for the database. A total of 143 responses to the survey provided data on 54 resource-use instruments for inclusion in the database. All were reliant on patient or carer recall, and a majority (47) were questionnaires. Thirty-seven were designed for self-completion by the patient, carer, or guardian, and the remainder were designed for completion by researchers or health care professionals while interviewing patients. Methods of development were diverse, particularly in areas such as the planning of resource itemization (evident in 25 instruments), piloting (25), and validation (29). On the basis of the present analysis, we developed a Web-enabled Database of Instruments for Resource-Use Measurement, accessible via www.DIRUM.org. This database may serve as a practical resource for health economists, as well as a means to facilitate further research in the area of resource-use data collection. Copyright © 2012 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Evaluation of the psychometric properties of the Nighttime Symptoms of COPD Instrument.

PubMed

Mocarski, Michelle; Zaiser, Erica; Trundell, Dylan; Make, Barry J; Hareendran, Asha

2015-01-01

Nighttime symptoms can negatively impact the quality of life of patients with chronic obstructive pulmonary disease (COPD). The Nighttime Symptoms of COPD Instrument (NiSCI) was designed to measure the occurrence and severity of nighttime symptoms in patients with COPD, the impact of symptoms on nighttime awakenings, and rescue medication use. The objective of this study was to explore item reduction, inform scoring recommendations, and evaluate the psychometric properties of the NiSCI. COPD patients participating in a Phase III clinical trial completed the NiSCI daily. Item analyses were conducted using weekly mean and single day scores. Descriptive statistics (including percentage of respondents at floor/ceiling and inter-item correlations), factor analyses, and Rasch model analyses were conducted to examine item performance and scoring. Test-retest reliability was assessed for the final instrument using the intraclass correlation coefficient (ICC). Correlations with assessments conducted during study visits were used to evaluate convergent and known-groups validity. Data from 1,663 COPD patients aged 40-93 years were analyzed. Item analyses supported the generation of four scores. A one-factor structure was confirmed with factor analysis and Rasch analysis for the symptom severity score. Test-retest reliability was confirmed for the six-item symptom severity (ICC, 0.85), number of nighttime awakenings (ICC, 0.82), and rescue medication (ICC, 0.68) scores. Convergent validity was supported by significant correlations between the NiSCI, St George's Respiratory Questionnaire, and Exacerbations of Chronic Obstructive Pulmonary Disease Tool-Respiratory Symptoms scores. The results suggest that the NiSCI can be used to determine the severity of nighttime COPD symptoms, the number of nighttime awakenings due to COPD symptoms, and the nighttime use of rescue medication. The NiSCI is a reliable and valid instrument to evaluate these concepts in COPD patients in clinical trials and clinical practice. Scoring recommendations and steps for further research are discussed.

Psychometric properties of the Spanish Burnout Inventory among staff nurses.

PubMed

Gil-Monte, P R; Manzano-García, G

2015-12-01

The burnout syndrome contributes to the deterioration in the quality of personal life as well as lower quality practice in healthcare personnel. Researchers have been concerned about the psychometric limitations of some previous questionnaires designed to evaluate burnout. The Spanish Burnout Inventory was developed to address the problems associated with other instruments, but it has not yet been validated in staff nurses. This study provides evidence that the Spanish Burnout Inventory has adequate psychometric properties to estimate burnout in staff nurses. The Spanish Burnout Inventory offers a theoretical proposal to explain the different components of burnout. The Spanish Burnout Inventory provides researchers and practitioners with an expanded conceptualization of the burnout syndrome, which can facilitate the diagnosis and treatment of nursing professionals. Researchers have been concerned about the psychometric limitations of the some previous questionnaires designed to evaluate burnout. To address these problems associated with previous instruments, the Spanish Burnout Inventory (SBI) was developed. The instrument has not yet been validated in staff nurses. The purpose of this paper was to evaluate the psychometric properties of the SBI. The sample consisted of 720 staff nurses from two Spanish general hospitals. The instrument is composed of 20 items distributed in four dimensions: Enthusiasm towards the job (five items), Psychological exhaustion (four items), Indolence (six items) and Guilt (five items). Data were subjected to confirmatory factor analysis. To assess the factorial validity of the SBI, four alternative models were tested. Results show that the four-factor model of the SBI has adequate psychometric properties for the study of burnout in staff nurses. This model fitted the data better than the alternative models. The study provides evidence of the adequate psychometric properties of a measure to evaluate burnout in nursing professionals. The SBI proposes a theoretical explanation for the different types of burnout, facilitating the diagnosis and treatment of staff nurses. © 2015 John Wiley & Sons Ltd.

An Observational Study of Score Study Practices among Undergraduate Instrumental Music Education Majors

ERIC Educational Resources Information Center

Silvey, Brian A.; Montemayor, Mark; Baumgartner, Christopher M.

2017-01-01

The purpose of this study was to investigate undergraduate instrumental music education majors' score study practices as they related to the effectiveness of their simulated conducting. Participants (N = 30) were video recorded in two sessions in which they completed a 20-min score study session and a simulated conducting performance. In the first…

Examining the Teaching of Science, and Technology and Engineering Content and Practices: An Instrument Modification Study

ERIC Educational Resources Information Center

Love, Tyler S.; Wells, John G.; Parkes, Kelly A.

2017-01-01

A modified Reformed Teaching Observation Protocol (RTOP) (Piburn & Sawada, 2000) instrument was used to separately examine eight technology and engineering (T&E) educators' teaching of science, and T&E content and practices, as called for by the "Standards for Technological Literacy: Content for the Study of Technology"…

Implementation of Pedagogical Content Knowledge (PCK) of Mathematics Teachers in Teaching Practice: A Case Study

ERIC Educational Resources Information Center

Maryono; Sutawidjaja, Akbar; Subanji; Irawati, Santi

2017-01-01

This study aims to describe the implementation of pedagogical content knowledge (PCK) of mathematics teachers in the teaching practice of the material system of linear equations of two variables (SLETV). The approach used is a qualitative case study. The main instrument is the researchers themselves and the supporting instruments is a vignette…

The Statistics Teaching Inventory: A Survey on Statistics Teachers' Classroom Practices and Beliefs

ERIC Educational Resources Information Center

Zieffler, Andrew; Park, Jiyoon; Garfield, Joan; delMas, Robert; Bjornsdottir, Audbjorg

2012-01-01

This paper reports on an instrument designed to assess the practices and beliefs of instructors of introductory statistics courses across the disciplines. Funded by a grant from the National Science Foundation, this project developed, piloted, and gathered validity evidence for the Statistics Teaching Inventory (STI). The instrument consists of 50…

Development of an item bank for food parenting practices based on published instruments and reports from Canadian and U.S. parents

USDA-ARS?s Scientific Manuscript database

Research to understand how parents influence their children's dietary intake and eating behaviors has expanded in the past decades and a growing number of instruments are available to assess food parenting practices. Unfortunately, there is no consensus on how constructs should be defined or operati...

On Practice, Skill and Competition: A Pragmatist Theory of Action for Instrumental Music Education

ERIC Educational Resources Information Center

Tan, Leonard

2017-01-01

Practice, skill and competition are important aspects of participating in school bands and orchestras. However, writers have questioned their value. In this philosophical paper, I mine the writings of the American pragmatists--in particular, their theories of habit and experience--to construct a theory of action for instrumental music education,…

Conducting Reflective, Hands-On Research with Advanced Characterization Instruments: A High-Level Undergraduate Practical Exploring Solid-State Polymorphism

ERIC Educational Resources Information Center

Coles, S. J.; Mapp, L. K.

2016-01-01

An undergraduate practical exercise has been designed to provide hands-on, instrument-based experience of advanced characterization techniques. A research experience approach is taken, centered around the concept of solid-state polymorphism, which requires a detailed knowledge of molecular and crystal structure to be gained by advanced analytical…

4D Model on Assessing Psychomotor Aspect in Continental Food Processing Practice

NASA Astrophysics Data System (ADS)

Nurafiati, P.; Ana, A.; Ratnasusanti, H.; Maulana, I.

2018-02-01

This research aims to develop and find out the response of observers for the assessment instrument of student’s psychomotor aspect on continental food processing practice. This research belongs to development research with 4P model that confined till the definition, design, and development stages. The data that gained during the research is analyzed descriptively. Research’s product is assessment instrument rubric form that consists of performance’s aspect which should be assessed and performance’s quality which stated in gradation score with 0-4 level and performance description that completed with picture illustration in every single score. Product was validate and responded based on material, construction, language, objectively, systematic, and practicability aspects. The result show that assessment instrument of student’s psychomotor aspect on continental food processing practice which developed gain very good response with percentage of 84,47%.

SEQUenCE: a service user-centred quality of care instrument for mental health services.

PubMed

Hester, Lorraine; O'Doherty, Lorna Jane; Schnittger, Rebecca; Skelly, Niamh; O'Donnell, Muireann; Butterly, Lisa; Browne, Robert; Frorath, Charlotte; Morgan, Craig; McLoughlin, Declan M; Fearon, Paul

2015-08-01

To develop a quality of care instrument that is grounded in the service user perspective and validate it in a mental health service. The instrument (SEQUenCE (SErvice user QUality of CarE)) was developed through analysis of focus group data and clinical practice guidelines, and refined through field-testing and psychometric analyses. All participants were attending an independent mental health service in Ireland. Participants had a diagnosis of bipolar affective disorder (BPAD) or a psychotic disorder. Twenty-nine service users participated in six focus group interviews. Seventy-one service users participated in field-testing: 10 judged the face validity of an initial 61-item instrument; 28 completed a revised 52-item instrument from which 12 items were removed following test-retest and convergent validity analyses; 33 completed the resulting 40-item instrument. Test-retest reliability, internal consistency and convergent validity of the instrument. The final instrument showed acceptable test-retest reliability at 5-7 days (r = 0.65; P < 0.001), good convergent validity with the Verona Service Satisfaction Scale (r = 0.84, P < 0.001) and good internal consistency (Cronbach's alpha = 0.87). SEQUenCE is a valid, reliable scale that is grounded in the service user perspective and suitable for routine use. It may serve as a useful tool in individual care planning, service evaluation and research. The instrument was developed and validated with service users with a diagnosis of either BPAD or a psychotic disorder; it does not yet have established external validity for other diagnostic groups. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

New resilience instrument for patients with cancer.

PubMed

Ye, Zeng Jie; Liang, Mu Zi; Li, Peng Fei; Sun, Zhe; Chen, Peng; Hu, Guang Yun; Yu, Yuan Liang; Wang, Shu Ni; Qiu, Hong Zhong

2018-02-01

Resilience is an important concept in the cancer literature and is a salient indicator of cancer survivorship. The aim of this study is to develop and validate a new resilience instrument that is specific to patients with cancer diagnosis (RS-SC) in Mainland China. First, a resilience framework was constructed for patients with cancer diagnosis. Second, items were formulated based on the framework to reflect different aspects of resilience. Third, two rounds of expert panel discussion were performed to select important and relevant items. Finally, two cross-sectional studies were conducted to evaluate the psychometric properties of this instrument. Fifty-one items were generated based on the resilience framework and the final 25-item RS-SC resulted in a five-factor solution including Generic Elements, Benefit Finding, Support and Coping, Hope for the Future and Meaning for Existence, accounting for 64.72% of the variance. The Cronbach's α of the RS-SC was 0.825 and the test-retest reliability was 0.874. The RS-SC is a brief and specific self-report resilience instrument for Chinese patients with cancer and shows sound psychometric properties in this study. The RS-SC has potential applications in both clinical practice and research with strength-based resiliency interventions.

Feasibility of patient and peer surveys for Maintenance of Certification among diplomates of the American Board of Anesthesiology.

PubMed

Warner, David O; Sun, Huaping; Harman, Ann E; Culley, Deborah J

2015-06-01

The initial developmental standards for Maintenance of Certification programs proposed by the American Board of Medical Specialties included the administration of patient and peer surveys by the diplomate every 5 years. The aim of this pilot study was to determine the feasibility of Maintenance of Certification in Anesthesiology Program (MOCA) patient and peer surveys in a selected group of American Board of Anesthesiology (ABA) diplomates. The design was a pilot test of survey instruments-MOCA Patient Care Survey and MOCA Peer Survey. The setting was the ABA, Raleigh, NC. The subjects were ABA-certified anesthesiologists who were active examiners for the primary certification oral examination as of January 2013. Fifty-one participating physicians in the patient survey group distributed brochures, which included a link to the MOCA Patient Care Survey, to up to 100 consecutive patients at the point of care. Fifty-one participating physicians in the peer survey group distributed invitations to MOCA Peer Survey via e-mail to 20 peers in a variety of roles. Participants developed and evaluated a practice improvement plan based on survey results. Participants were also surveyed on their opinions on the feasibility of implementing the piloted survey instrument in their practices. Response rates for the patient care and the peer surveys were 15% and 75%, respectively. Both surveys indicated a high level of satisfaction with the diplomates; approximately two-thirds of physicians could not identify practice areas in need of improvement. These results suggest that threats to the validity of these surveys include distribution bias for peer surveys and response bias for patient surveys and that surveys often do not provide actionable information useful for practice improvement. Alternative approaches, such as including anesthesiologists within an integrated institutional evaluation system, could be explored to maximize the benefits of physician assessments provided by peers and patients. Copyright © 2015 Elsevier Inc. All rights reserved.

Practice Patterns of Speech-Language Pathologists in Pediatric Vocal Health.

PubMed

Hartley, Naomi A; Braden, Maia; Thibeault, Susan L

2017-05-17

The purpose of this study was to investigate current practices of speech-language pathologists (SLPs) in the management of pediatric vocal health, with specific analysis of the influence of clinical specialty and workplace setting on management approaches. American Speech-Language-Hearing Association-certified clinicians providing services within the United States (1%-100% voice caseload) completed an anonymous online survey detailing clinician demographics; employment location and service delivery models; approaches to continuing professional development; and specifics of case management, including assessment, treatment, and discharge procedures. Current practice patterns were analyzed for 100 SLPs (0-42 years of experience; 77 self-identifying as voice specialists) providing services in 34 U.S. states across a range of metropolitan and nonmetropolitan workplace settings. In general, SLPs favored a multidisciplinary approach to management; included perceptual, instrumental, and quality of life measures during evaluation; and tailored intervention to the individual using a combination of therapy approaches. In contrast with current practice guidelines, only half reported requiring an otolaryngology evaluation prior to initiating treatment. Both clinical specialty and workplace setting were found to affect practice patterns. SLPs in school settings were significantly less likely to consider themselves voice specialists compared with all other work environments. Those SLPs who considered themselves voice specialists were significantly more likely to utilize voice-specific assessment and treatment approaches. SLP practice largely mirrors current professional practice guidelines; however, potential exists to further enhance client care. To ensure that SLPs are best able to support children in successful communication, further research, education, and advocacy are required.

[From persistence to symbiosis of microorganisms].

PubMed

Bukharin, O V

2012-01-01

Primary results of study of problem of microorganism persistence over the last 2 decades on 7 all-Russian conferences in Orenburg are examined in the article. Milestones of both fundamental research and practically significant studies are designated, the role of persistent potential of microorganisms in infectious pathology is evaluated. The emerging turn of studies from persistence to symbiosis is consonant with the idea of international project "Human microbiom" and allows to use the persistent potential of microorganisms as one of the instruments of resolving issues of infectology.

Device for data-acquisition from transient signals: kinetic considerations

PubMed Central

Sampedro, A. Sanchez; Vives, S. Sagrado

1990-01-01

This paper reports on the evaluation and testing of a home-made device. Data-acquisition, treatment of transient signals and the hardware and software involved are discussed. Some practical aspects are developed in order to power the autonomy of procedures using the device. Kinetic and multi-signal calculations are considered in order to cover the actual tendencies in continuous-flow analysis. Somepractical advantages versus the use of classical chart recorders or commercial computerized-instrument devices are pointed out. PMID:18925275

PET/SPECT: Instrumentation, radiopharmaceuticals, neurology and physiological measurement. Proceedings

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1988-12-31

The following collection of papers was presented at the Department of Energy sponsored symposium ``Frontiers in Nuclear Medicine - PET/SPECT 1987`` held in Washington, D.C. September 27-- 28, 1987. The meeting and these manuscripts concentrate on the techniques of tomography, useful radiopharmaceuticals, and clinical neurologic and cardiac evaluation. The authors of these papers are for the most part those who either developed the techniques or who have extensively applied them to clinical practice. Individual reports are processed separately for the databases.