Evaluation of the FOCUS (Feedback on Counseling Using Simulation) Instrument for Assessment of Client-Centered Nutrition Counseling Behaviors

ERIC Educational Resources Information Center

Henry, Beverly W.; Smith, Thomas J.

2010-01-01

Objective: To develop an instrument to assess client-centered counseling behaviors (skills) of student-counselors in a standardized patient (SP) exercise. Methods: Descriptive study of the accuracy and utility of a newly developed counseling evaluation instrument. Study participants included 11 female student-counselors at a Midwestern…

The Adult Asperger Assessment (AAA): A Diagnostic Method

ERIC Educational Resources Information Center

Baron-Cohen, Simon; Wheelwright, Sally; Robinson, Janine; Woodbury-Smith, Marc

2005-01-01

At the present time there are a large number of adults who have "suspected" Asperger syndrome (AS). In this paper we describe a new instrument, the Adult Asperger Assessment (AAA), developed in our clinic for adults with AS. The need for a new instrument relevant to the diagnosis of AS in adulthood arises because existing instruments are designed…

An Assessment Instrument to Measure Geospatial Thinking Expertise

ERIC Educational Resources Information Center

Huynh, Niem Tu; Sharpe, Bob

2013-01-01

Spatial thinking is fundamental to the practice and theory of geography, however there are few valid and reliable assessment methods in geography to measure student performance in spatial thinking. This article presents the development and evaluation of a geospatial thinking assessment instrument to measure participant understanding of spatial…

Using Longitudinal Scales Assessment for Instrumental Music Students

ERIC Educational Resources Information Center

Simon, Samuel H.

2014-01-01

In music education, current assessment trends emphasize student reflection, tracking progress over time, and formative as well as summative measures. This view of assessment requires instrumental music educators to modernize their approaches without interfering with methods that have proven to be successful. To this end, the Longitudinal Scales…

Cognitive assessment: A challenge for occupational therapists in Brazil

PubMed Central

Conti, Juliana

2017-01-01

Cognitive impairment is a common dysfunction after neurological injury. Cognitive assessment tools can help the therapist understand how impairments are affecting functional status and quality of life. Objective The aim of the study was to identify instruments for cognitive assessment that Occupational Therapists (OT) can use in clinical practice. Methods The instruments published in English and Portuguese between 1999 and 2016 were systematically reviewed. Results The search identified 17 specific instruments for OT not validated in Brazilian Portuguese, 10 non-specific instruments for OT not validated in Brazilian Portuguese, and 25 instruments validated for Portuguese, only one of which was specific for OT (Lowenstein Occupational Therapy Cognitive Assessment). Conclusion There are few assessment cognitive tools validated for use in the Brazilian culture and language. The majority of the instruments appear not to be validated for use by OT in clinical practice. PMID:29213503

Adolescent Populations Research Needs - NCS Dietary Assessment Literature Review

Cancer.gov

As with school age children, it is difficult to make conclusions about the validity of available dietary assessment instruments for adolescents because of the differences in instruments, research designs, reference methods, and populations in the validation literature.

[Legal capacity and instruments assessing cognitive functions in patients with dementia].

PubMed

Voskou, P; Papageorgiou, S; Economou, A; Douzenis, A

2017-01-01

The term "legal capacity" refers to the ability of a person to make a valid declaration of his will or to accept such a declaration. This ability constitutes the main condition for the validity of the legal transaction. The legal transaction includes issues that are adjusted by the Civil Code with which the relations of the citizens in a society are regulated. General practitioners and legal advisors, in any case of a person with cognitive impairment of various severity, should take into account that the assessment tests of the cognitive functions are not by themselves diagnostic of the dementia and they cannot be used as the only way of evaluation of the capacity of patients with cognitive impairment or possible dementia to respond to the needs of everyday life and in more complex decisions, such as the legal capacity. The existing methods for the assessment of the cognitive functions are valuable, mainly, for the detection of any cognitive impairment which may not be perceptible during the clinical evaluation of the patient and secondly for the detection of any changes in the cognitive status of the patient during its following up. The description and study of the instruments which are frequently used in the international scientific society for the assessment of the cognitive functions of the patients with mild cognitive impairment or dementia, during the evaluation of the legal capacity of these patients. The literature relevant to the existing methods assessing the cognitive functions during the evaluation of the legal capacity of patients with dementia was reviewed. The scientific database searched was Pubmed, Medline and Scopus. The key-words used were cognitive functions, dementia, instruments, legal capacity. Various instruments which assess the cognitive functions have been developed and can be grouped in 4 categories. The first one includes instruments used for the general assessment of the cognitive status. These instruments can be extensive or short and consist of subtests for the evaluation of several cognitive functions (memory, attention, perception, speech). The second category includes instruments for the specific assessment of the cognitive status, namely specific tests for one cognitive domain (for example, memory, speech flow, naming). The third category consists of methods which are based on the clinical evaluation during the interview with the patient and his familiars, giving emphasis on the frontal functions of the patient. Finally, the fourth group includes instruments which assess the executive functions of the patients. There is a great need for the development of more studies for the methods/instruments with which the cognitive functions of patients with probable dementia can be assessed during the evaluation of the legal capacity of these patients. The challenge for the scientists is to develop a clinically applicable instrument for the quick and reliable assessment of the legal capacity of people with dementia. The assessment of this ability should be done in relation with the needs, the feelings and the values of the patient.

Hopes and Cautions for Instrument-Based Evaluation of Consent Capacity: Results of a Construct Validity Study of Three Instruments

PubMed Central

Moye, Jennifer; Azar, Annin R.; Karel, Michele J.; Gurrera, Ronald J.

2016-01-01

Does instrument based evaluation of consent capacity increase the precision and validity of competency assessment or does ostensible precision provide a false sense of confidence without in fact improving validity? In this paper we critically examine the evidence for construct validity of three instruments for measuring four functional abilities important in consent capacity: understanding, appreciation, reasoning, and expressing a choice. Instrument based assessment of these abilities is compared through investigation of a multi-trait multi-method matrix in 88 older adults with mild to moderate dementia. Results find variable support for validity. There appears to be strong evidence for good hetero-method validity for the measurement of understanding, mixed evidence for validity in the measurement of reasoning, and strong evidence for poor hetero-method validity for the concepts of appreciation and expressing a choice, although the latter is likely due to extreme range restrictions. The development of empirically based tools for use in capacity evaluation should ultimately enhance the reliability and validity of assessment, yet clearly more research is needed to define and measure the constructs of decisional capacity. We would also emphasize that instrument based assessment of capacity is only one part of a comprehensive evaluation of competency which includes consideration of diagnosis, psychiatric and/or cognitive symptomatology, risk involved in the situation, and individual and cultural differences. PMID:27330455

The implementation of skill assessment by the educators on the mathematics learning process in senior high school

NASA Astrophysics Data System (ADS)

Lestariani, I.; Sujadi, I.; Pramudya, I.

2018-03-01

The purpose of research to describe and know the implementation of skill assessment on the mathematics learning process with the high school mathematics teacher as the subject because it is less fully implemented. This research is the type of the descriptive qualitative method. The data was collecting observation method, interview and documentation. The result showed that on the planning stage of the implementation of skill assessment, there were many teachers who had not prepared all the completeness with various assessment techniques through performance, project and portfolio. The teacher was prepared the list of questions. On the implementation stage, there were many teachers who had not understand the stage of completing the assessment with the appropriate instrument method and development. On the reporting stage, discovered that teachers faced the difficulty on preparing scoring report with the range value. Aside from that, the teachers had not prepared the assessment instrument very well on the planning stage. It can be concluded that the implementation of skill assessment has been implemented but not maximally because educators don’t understand about the skill assessment and the number of instrument that must be prepared before the assessment.

The psychometric properties and practicability of self-report instruments to identify medication nonadherence in adult transplant patients: a systematic review.

PubMed

Dobbels, Fabienne; Berben, Lut; De Geest, Sabina; Drent, Gerda; Lennerling, Annette; Whittaker, Clare; Kugler, Christiane

2010-07-27

Nonadherence to immunosuppressive therapy is recognized as a key prognostic indicator for poor posttransplantation long-term outcomes. Several methods aiming to measure medication nonadherence have been suggested in the literature. Although combining measurement methods is regarded as the gold standard for measuring nonadherence, self-report is generally considered a central component of adherence assessment. However, no systematic review currently exists to determine which instrument(s) are most appropriate for use in transplant populations. The transplant360 Task Force first performed a survey of the self-report adherence instruments currently used in European centers. Next, a systematic literature review of self-report instruments assessing medication adherence in chronically ill patients was conducted. Self-report instruments were evaluated to assess those which were: (a) short and easy to score; (b) assessed both the taking and timing of medication intake; and (c) had established reliability and validity. Fourteen instruments were identified from our survey of European centers, of which the Basel Assessment of Adherence Scale for Immunosuppressives met the aforementioned criteria. The systematic review found 20 self-report instruments, of which only two qualified for use in transplantation, that is, the Brief Antiretroviral Adherence Index and the Medication Adherence Self-Report Inventory. The three selected self-report scales may assist transplant professionals in detecting nonadherence. However, these scales were only validated in patients with HIV. Although HIV shares similar characteristics with transplantation, including the importance of taking and timing of medication, further validation in transplant populations is required.

Development of Assessment Instrument of Critical Thinking in Physics at Senior High School

NASA Astrophysics Data System (ADS)

Sugiarti, T.; Kaniawati, I.; Aviyanti, L.

2017-02-01

The result of preliminary study shows that the assessment of physics in school did not train students’ critical thinking skill. The assessment instrument just measured low cognitive aspects. Supposedly, critical thinking skill is trained in the assessment activity. The study aims to determine the characteristics and the quality of critical thinking skill instrument. It employs descriptive-qualitative method with research and development as the research design. The research participants are 35 students involved in the limited trial and 188 students in the wider trial from three public senior high school in Ciamis which in high level school. The data was collected through expert validation, tests and interviews. The results indicate that the characteristics of the assessment instrument of critical thinking skill is open-ended. The instrument fulfills some indicators namely analyzing argument, deduction, induction, and display information in the form of scenario, text, graphic and table. In addition, the data processing through V4 Anates program shows that the instrument reliability achieves 0.67 with high interpretation of 0.67 and the validity is 0.47 with enough interpretation. Thus, the assessment instrument of critical thinking skill in the form of open-ended essay meets the criteria of quality test, so it can use as instrument of assessment critical thinking skill.

Determining cutting efficiency of nickel-titanium coronal flaring instruments used in lateral action.

PubMed

Peters, O A; Morgental, R D; Schulze, K A; Paqué, F; Kopper, P M P; Vier-Pelisser, F V

2014-06-01

To develop a method to evaluate the cutting behaviour of nickel-titanium (NiTi) coronal flaring instruments. BioRaCe BR0 (BR), HyFlex CM 1 (HY), ProFile OS No. 2 (PF) and ProTaper Sx (PT) instruments were used in simulated coronal flaring using a lateral action against bovine dentine blocks, at 250 and 500 rpm. Cutting efficiency was assessed by three methods: first, areas of notches produced by instruments were directly measured under a stereomicroscope. Second, dentine specimens were then analysed by surface profilometry to determine the maximum cutting depth and finally by microcomputed tomography to assess the volume of removed dentine. Data were compared using parametric tests with the significance level set at 0.05. For all three methods, HY and PF were the most and the least cutting-efficient instruments, respectively (P < 0.05). Significant differences were detected between 250 and 500 rpm for HY and PT (area); for BR, HY and PT (depth); and for BR and HY (volume). There were strong positive correlations between the results obtained with those three different methods with r-values ranging from 0.81 to 0.92. Measuring the amount of material removed in a specific time under stereomicroscopy is a simple and rational way to assess the cutting behaviour of NiTi rotary instruments in lateral action. HyFlex, manufactured with thermomechanically treated NiTi wire, was the most efficient instrument, and increased rotational speed was associated with increased cutting efficiency. © 2013 International Endodontic Journal. Published by John Wiley & Sons Ltd.

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments

PubMed Central

2012-01-01

Background Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. Methods To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. Results The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. Conclusions The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware of methodological deficiencies inherent in existing HEE quality appraisal instruments. These shortcomings of existing HEE quality appraisal instruments are illustrated by the pilot test. PMID:22894708

Validation of a Spectral Method for Quantitative Measurement of Color in Protein Drug Solutions.

PubMed

Yin, Jian; Swartz, Trevor E; Zhang, Jian; Patapoff, Thomas W; Chen, Bartolo; Marhoul, Joseph; Shih, Norman; Kabakoff, Bruce; Rahimi, Kimia

2016-01-01

A quantitative spectral method has been developed to precisely measure the color of protein solutions. In this method, a spectrophotometer is utilized for capturing the visible absorption spectrum of a protein solution, which can then be converted to color values (L*a*b*) that represent human perception of color in a quantitative three-dimensional space. These quantitative values (L*a*b*) allow for calculating the best match of a sample's color to a European Pharmacopoeia reference color solution. In order to qualify this instrument and assay for use in clinical quality control, a technical assessment was conducted to evaluate the assay suitability and precision. Setting acceptance criteria for this study required development and implementation of a unique statistical method for assessing precision in 3-dimensional space. Different instruments, cuvettes, protein solutions, and analysts were compared in this study. The instrument accuracy, repeatability, and assay precision were determined. The instrument and assay are found suitable for use in assessing color of drug substances and drug products and is comparable to the current European Pharmacopoeia visual assessment method. In the biotechnology industry, a visual assessment is the most commonly used method for color characterization, batch release, and stability testing of liquid protein drug solutions. Using this method, an analyst visually determines the color of the sample by choosing the closest match to a standard color series. This visual method can be subjective because it requires an analyst to make a judgment of the best match of color of the sample to the standard color series, and it does not capture data on hue and chroma that would allow for improved product characterization and the ability to detect subtle differences between samples. To overcome these challenges, we developed a quantitative spectral method for color determination that greatly reduces the variability in measuring color and allows for a more precise understanding of color differences. In this study, we established a statistical method for assessing precision in 3-dimensional space and demonstrated that the quantitative spectral method is comparable with respect to precision and accuracy to the current European Pharmacopoeia visual assessment method. © PDA, Inc. 2016.

Earth observing system instrument pointing control modeling for polar orbiting platforms

NASA Technical Reports Server (NTRS)

Briggs, H. C.; Kia, T.; Mccabe, S. A.; Bell, C. E.

1987-01-01

An approach to instrument pointing control performance assessment for large multi-instrument platforms is described. First, instrument pointing requirements and reference platform control systems for the Eos Polar Platforms are reviewed. Performance modeling tools including NASTRAN models of two large platforms, a modal selection procedure utilizing a balanced realization method, and reduced order platform models with core and instrument pointing control loops added are then described. Time history simulations of instrument pointing and stability performance in response to commanded slewing of adjacent instruments demonstrates the limits of tolerable slew activity. Simplified models of rigid body responses are also developed for comparison. Instrument pointing control methods required in addition to the core platform control system to meet instrument pointing requirements are considered.

[Identification of care needs of patients with and without the use of a classification instrument].

PubMed

Perroca, Marcia Galan; Jericó, Marli de Carvalho; Paschoal, Josi Vaz de Lima

2014-08-01

To analyze the agreement and disagreement between the assessments by applying or not a patient classification instrument, and to investigate the association between the agreement and personal and professional characteristics of the evaluators. This is a descriptive exploratory study. 105 patients were hospitalized in a teaching hospital in the state of Sao Paulo, using the kappa statistic (weighted) and the Bootstrap method. The agreement between the assessments were​​: k(w) 0.87 (instrument x internal evaluator), k(w) 0.78 (instrument x external evaluator) and k(w) 0.76 (between evaluators) and the influence of some personal and professional characteristics. The assessments conducted through the use of an instrument contemplated a greater number of areas of care in relation to when the instrument was not applied. The use of this instrument is recommended in order to more effectively identify care needs of patients.

The Clinimetric Properties of Instruments Measuring Home Hazards for Older People at Risk of Falling: A Systematic Review.

PubMed

Romli, Muhammad Hibatullah; Mackenzie, Lynette; Lovarini, Meryl; Tan, Maw Pin; Clemson, Lindy

2018-03-01

Home hazards are associated with falls among older people living in the community. However, evaluating home hazards is a complex process as environmental factors vary according to geography, culture, and architectural design. As a result, many health practitioners commonly use nonstandardized assessment methods that may lead to inaccurate findings. Thus, the aim of this systematic review was to identify standardized instruments for evaluating home hazards related to falls and evaluate the clinimetric properties of these instruments for use by health practitioners. A systematic search was conducted in the Medline, CINAHL, AgeLine, Web of Science databases, and the University of Sydney Library CrossSearch Engine. Study screening, assessment, and quality ratings were conducted independently. Thirty-six studies were identified describing 19 instruments and three assessment techniques. The clinimetric properties varied between instruments. The Home Falls and Accidents Screening Tool, Home Safety Self-Assessment Tool, In-Home Occupational Performance Evaluation, and Westmead Home Safety Assessment were the instruments with high potential for evaluating home hazards associated with falls. Health practitioners can choose the most appropriate instruments for their practice, as a range of standardized instruments with established clinimetric properties are available.

Assessing instrument handling and operative consequences simultaneously: a simple method for creating synced multicamera videos for endosurgical or microsurgical skills assessments.

PubMed

Jabbour, Noel; Sidman, James

2011-10-01

There has been an increasing interest in assessment of technical skills in most medical and surgical disciplines. Many of these assessments involve microscopy or endoscopy and are thus amenable to video recording for post hoc review. An ideal skills assessment video would provide the reviewer with a simultaneous view of the examinee's instrument handling and the operative field. Ideally, a reviewer should be blinded to the identity of the examinee and whether the assessment was performed as a pretest or posttest examination, when given in conjunction with an educational intervention. We describe a simple method for reliably creating deidentified, multicamera, time-synced videos, which may be used in technical skills assessments. We pilot tested this method in a pediatric airway endoscopy Objective Assessment of Technical Skills (OSATS). Total video length was compared with the OSATS administration time. Thirty-nine OSATS were administered. There were no errors encountered in time-syncing the videos using this method. Mean duration of OSATS videos was 11 minutes and 20 seconds, which was significantly less than the time needed for an expert to be present at the administration of each 30-minute OSATS (P < 0.001). The described method for creating time-synced, multicamera skills assessment videos is reliable and may be used in endosurgical or microsurgical skills assessments. Compared with live review, post hoc video review using this method can save valuable expert reviewer time. Most importantly, this method allows a reviewer to simultaneously evaluate an examinee's instrument handling and the operative field while being blinded to the examinee's identity and timing of examination administration.

A qualitative approach to assessing work ability.

PubMed

Tengland, Per-Anders

2013-01-01

We often need to be able to assess the extent to which individuals have or lack work ability. For this we need instruments. Most of the instruments available have flaws. They either lack validity or they use roundabout methods when collecting information about the individual's work ability. The aim of this paper is to present a conceptual model for constructing a questionnaire that can be used for assessing work ability. The methods used are philosophical, i.e. analytical and deductive. A conceptual theory is provided, and based on the resulting definition of the concept of "work ability" conclusions are drawn regarding how to assess work ability. When constructing quantitative instruments, we can increase validity through using a more strict definition of work ability. However, such an approach will only solve some of the problems noted above. The proposal is, instead, to create a qualitative questionnaire, founded on a definition of "work ability", which focuses on the concrete problems concerning the work ability of the individual. Finally, a sketch of such an instrument is provided, with questions covering all the relevant aspects of work ability. The qualitative questionnaire proposed is believed to be superior to more traditional (quantitative) instruments for assessing a person's work ability, as well as for finding solutions to her problems concerning work ability.

Developing an ICT-Literacy Task-Based Assessment Instrument: The Findings on the Final Testing Phase

ERIC Educational Resources Information Center

Mat-jizat, Jessnor Elmy

2013-01-01

This paper reports the findings of a study which seeks to identify the information and communications technology (ICT) literacy levels of trainee teachers, by investigating their ICT proficiency using a task-bask assessment instrument. The Delphi technique was used as a primary validation method for the new assessment tool and the ICT literacy…

Using Delphi Methodology to Design Assessments of Teachers' Pedagogical Content Knowledge

ERIC Educational Resources Information Center

Manizade, Agida Gabil; Mason, Marguerite M.

2011-01-01

Descriptions of methodologies that can be used to create items for assessing teachers' "professionally situated" knowledge are lacking in mathematics education research literature. In this study, researchers described and used the Delphi method to design an instrument to measure teachers' pedagogical content knowledge. The instrument focused on a…

Development and Validation of an Instrument for Assessing Mathematics Classroom Environment in Tertiary Institutions

ERIC Educational Resources Information Center

Yin, Hongbiao; Lu, Genshu

2014-01-01

This report describes the development and validation of an instrument, the University Mathematics Classroom Environment Questionnaire (UMCEQ), for assessing the mathematics classroom environment in tertiary institutions in China. Through the use of multiple methods, including exploratory and confirmatory factor analyses, on two independent samples…

An instrument to assess the statistical intensity of medical research papers.

PubMed

Nieminen, Pentti; Virtanen, Jorma I; Vähänikkilä, Hannu

2017-01-01

There is widespread evidence that statistical methods play an important role in original research articles, especially in medical research. The evaluation of statistical methods and reporting in journals suffers from a lack of standardized methods for assessing the use of statistics. The objective of this study was to develop and evaluate an instrument to assess the statistical intensity in research articles in a standardized way. A checklist-type measure scale was developed by selecting and refining items from previous reports about the statistical contents of medical journal articles and from published guidelines for statistical reporting. A total of 840 original medical research articles that were published between 2007-2015 in 16 journals were evaluated to test the scoring instrument. The total sum of all items was used to assess the intensity between sub-fields and journals. Inter-rater agreement was examined using a random sample of 40 articles. Four raters read and evaluated the selected articles using the developed instrument. The scale consisted of 66 items. The total summary score adequately discriminated between research articles according to their study design characteristics. The new instrument could also discriminate between journals according to their statistical intensity. The inter-observer agreement measured by the ICC was 0.88 between all four raters. Individual item analysis showed very high agreement between the rater pairs, the percentage agreement ranged from 91.7% to 95.2%. A reliable and applicable instrument for evaluating the statistical intensity in research papers was developed. It is a helpful tool for comparing the statistical intensity between sub-fields and journals. The novel instrument may be applied in manuscript peer review to identify papers in need of additional statistical review.

Using 2 Assessment Methods May Better Describe Dietary Supplement Intakes in the United States123

PubMed Central

Nicastro, Holly L; Bailey, Regan L; Dodd, Kevin W

2015-01-01

Background: One-half of US adults report using a dietary supplement. NHANES has traditionally assessed dietary supplement use via a 30-d questionnaire but in 2007 added a supplement module to the 24-h dietary recall (24HR). Objective: We compared these 2 dietary assessment methods, examined potential biases in the methods, and determined the effect that instrument choice had on estimates of prevalence of multivitamin/multimineral dietary supplement (MVMM) use. Methods: We described prevalence of dietary supplement use by age, sex, and assessment instrument in 12,285 adults in the United States (>19 y of age) from NHANES 2007–2010. Results: When using data from the questionnaire alone, 29.3% ± 1.0% of men and 35.5% ± 1.0% of women were users of MVMMs, whereas data from the 24HR only produced prevalence estimates of 26.3% ± 1.1% for men and 33.2% ± 1.0% for women. When using data from both instruments combined, 32.3% ± 1.2% of men and 39.5% ± 1.1% of women were classified as MVMM users. Prevalence estimates were significantly higher by 2–9% in all age–sex groups when using information from both instruments combined than when using data from either instrument individually. A digit preference bias and flattened slope phenomenon were observed in responses to the dietary supplement questionnaire. A majority (67%) of MVMMs were captured on both instruments, whereas 19% additional MVMMs were captured on the questionnaire and 14% additional on the 24HR. Of those captured only on the 24HR, 26% had missing label information, whereas only 12% and 9% of those captured on the questionnaire or both, respectively, had missing information. Conclusions: Use of both the dietary supplement questionnaire and the 24HR can provide advantages to researchers over the use of a single instrument and potentially capture a larger fraction of dietary supplement users. PMID:26019244

Assessing Affective Constructs in Reading: A Mixed Methods Study

ERIC Educational Resources Information Center

Conradi, Kristin

2011-01-01

Research investigating affective dimensions in reading has long been plagued by vaguely defined constructs and, consequently, by an array of potentially problematic instruments designed to measure them. This mixed-methods study investigated the relationship among three popular group-administered instruments intended to tap affective constructs in…

Measurement properties of instruments that assess participation in young people with autism spectrum disorder: a systematic review.

PubMed

Lami, Francesca; Egberts, Kristine; Ure, Alexandra; Conroy, Rowena; Williams, Katrina

2018-03-01

To systematically review the measurement properties of instruments assessing participation in young people with autism spectrum disorder (ASD). A search was performed in MEDLINE, PsycINFO, and PubMed combining three constructs ('ASD', 'test of participation', 'measurement properties'). Results were restricted to articles including people aged 6 to 29 years. The 2539 identified articles were independently screened by two reviewers. For the included articles, data were extracted using standard forms and their risk of bias was assessed. Nine studies (8 cross-sectional) met the inclusion criteria, providing information on seven different instruments. The total sample included 634 participants, with sex available for 600 (males=494; females=106) and age available for 570, with mean age for these participants 140.58 months (SD=9.11; range=36-624). Included instruments were the school function assessment, vocational index, children's assessment of participation and enjoyment/preferences for activities of children, experience sampling method, Pediatric Evaluation of Disability Inventory, Computer Adaptive Test, adolescent and young adult activity card sort, and Patient-Reported Outcomes Measurement Information System parent-proxy peer relationships. Seven studies assessed reliability and validity; good properties were reported for half of the instruments considered. Most studies (n=6) had high risk of bias. Overall the quality of the evidence for each tool was limited. Validation of these instruments, or others that comprehensively assess participation, is needed. Future studies should follow recommended methodological standards. Seven instruments have been used to assess participation in young people with autism. One instrument, with excellent measurement properties in one study, does not comprehensively assess participation. Studies of three instruments that incorporate a more comprehensive assessment of participation have methodological limitations. Overall, limited evidence exists regarding measurement properties of participation assessments for young people with autism. © 2017 Mac Keith Press.

Validity of Guatemalan Mother's Self-Reported Breast-Feeding Practices of 3-Month-Old Infants.

PubMed

Mazariegos, Monica; Slater, Christine; Ramirez-Zea, Manuel

2016-12-01

Breast-feeding practices (BFPs) can be assessed by interviewing the mother about current feeding practices and with a 24-hour recall. It is crucial to establish the accuracy of these methods, which are commonly used by public health decision makers to design health policies aimed at increasing exclusive breast-feeding rates. We aimed to validate 2 self-report BFP instruments using the dose-to-mother deuterium oxide turnover technique (DMDOT) as the reference method. Breast-feeding practices were assessed by interviewing the mother about current feeding practices and with a 24-hour recall in 36 Guatemalan mother-infant pairs. The validity of these instruments was assessed using DMDOT as the reference method. Both self-report instruments overestimated exclusively breast-fed (EBF) infants. Infants classified as EBF were 50% by the reported current feeding practice, 61% by the 24-hour recall, and only 36% using DMDOT. Sensitivity to detect EBF infants from the mother's self-report was 92% (95% CI: 62%-99%) while from the 24-hour recall was 100% (95% CI: 72%-100%, P < .01). However, specificity for both instruments was low, at 74% (95% CI: 51%-89%) for reported current feeding practice and at 61% (95% CI: 39%-79%) for the 24-hour recall (P < .01). Both reported current feeding practice and the 24-hour recall instruments overestimated exclusive breast-feeding. Nevertheless, the use of reported current feeding practice provided more accurate data to assess BFPs in a public health setting. Furthermore, population-based surveys should consider the overestimation of exclusive breast-feeding caused when using these BFP instruments. © The Author(s) 2016.

Application of nondestructive testing in cyclic fatigue evaluation of endodontic Ni-Ti rotary instruments.

PubMed

Li, Uei-Ming; Shin, Chow-Shing; Lan, Wan-Hong; Lin, Chun-Pin

2006-06-01

The purpose of this study was to investigate the application of nondestructive testing in cyclic fatigue evaluation of endodontic ProFile nickel-titanium (NiTi) rotary instruments. As-received ProFile instruments were made to rotate freely in sloped metal blocks by a contra-angle handpiece mounted on a testing machine. Rotation was interrupted periodically, and the instrument removed and engaged onto a device to monitor its stiffness by using two strain gauges in four different directions. This monitoring method has the potential to be developed into a convenient, nondestructive turnkey system that allows in situ assessment of the integrity of NiTi instruments in the clinic. Upon fracture, which was indicated by a change in instrument stiffness, the fractured surface would be examined under a scanning electron microscope. Microscopic evaluation indicated a small area of fatigue fracture with a large area of final ductile fracture, whereby the latter was the major cyclic failure mode. Based on the results of this study, we concluded that a potential nondestructive integrity assessment method for NiTi rotary instruments was developed.

Development and Initial Testing of a Structured Clinical Observation Tool to Assess Pharmacotherapy Competence

ERIC Educational Resources Information Center

Young, John Q.; Lieu, Sandra; O'Sullivan, Patricia; Tong, Lowell

2011-01-01

Objective: The authors developed and tested the feasibility and utility of a new direct-observation instrument to assess trainee performance of a medication management session. Methods: The Psychopharmacotherapy-Structured Clinical Observation (P-SCO) instrument was developed based on multiple sources of expertise and then implemented in 4…

Assessing Situated Reading Motivations across Content Areas: A Dynamic Literacy Motivation Instrument

ERIC Educational Resources Information Center

Neugebauer, Sabina Rak

2017-01-01

While educators and researchers agree on the crucial role of literacy motivation for performance, research on methods for accurately assessing adolescent reading motivation is still uncommon. The most used reading motivation instruments do not attend to the multiple content areas in which adolescents read. The present study examines a new…

New instrument expanding individual tree stem analysis

Treesearch

Neil A. Clark

2001-01-01

Forest health, vitality, and productivity are interrelated and are maintained by using sound forest management. There are some standard indicators that are measured to assess the extent and severity of damage inflicted by biotic and abiotic agents. Assessment of these indicators using affordable methods is a subjective process. A video rangefinder instrument is...

Validation of a method for assessing resident physicians' quality improvement proposals.

PubMed

Leenstra, James L; Beckman, Thomas J; Reed, Darcy A; Mundell, William C; Thomas, Kris G; Krajicek, Bryan J; Cha, Stephen S; Kolars, Joseph C; McDonald, Furman S

2007-09-01

Residency programs involve trainees in quality improvement (QI) projects to evaluate competency in systems-based practice and practice-based learning and improvement. Valid approaches to assess QI proposals are lacking. We developed an instrument for assessing resident QI proposals--the Quality Improvement Proposal Assessment Tool (QIPAT-7)-and determined its validity and reliability. QIPAT-7 content was initially obtained from a national panel of QI experts. Through an iterative process, the instrument was refined, pilot-tested, and revised. Seven raters used the instrument to assess 45 resident QI proposals. Principal factor analysis was used to explore the dimensionality of instrument scores. Cronbach's alpha and intraclass correlations were calculated to determine internal consistency and interrater reliability, respectively. QIPAT-7 items comprised a single factor (eigenvalue = 3.4) suggesting a single assessment dimension. Interrater reliability for each item (range 0.79 to 0.93) and internal consistency reliability among the items (Cronbach's alpha = 0.87) were high. This method for assessing resident physician QI proposals is supported by content and internal structure validity evidence. QIPAT-7 is a useful tool for assessing resident QI proposals. Future research should determine the reliability of QIPAT-7 scores in other residency and fellowship training programs. Correlations should also be made between assessment scores and criteria for QI proposal success such as implementation of QI proposals, resident scholarly productivity, and improved patient outcomes.

How can teachers assess reading skills of generation z learners in German language class?

NASA Astrophysics Data System (ADS)

Dirga, R. N.; Wijayati, P. H.

2018-01-01

Generation Z is a digital native generation who has unique characteristics on the daily basis includes reading. In order to assess their reading skills correctly, teachers need to take these characteristics into consideration. This paper aims to describe the process in developing an instrument to assess reading skills of Generation Z learners in German language class. This study used developmental method. The developed instrument has not only good quality but also consists of texts that are suitable for German learners of Generation Z. This instrument can be used as an example in assessing German learners’ reading skills in the 21st century.

Marketing Education Assessment Guide. Performance-Based Activities with Authentic Assessments Instruments.

ERIC Educational Resources Information Center

Everett, Donna R.

This guide presents performance-based authentic assessment ideas, samples, and suggestions to help marketing teachers and students respond to changes and pressures from outside the classroom. It contains 21 activities, each accompanied by a method of authentic assessment. In most cases, the authentic assessment method is a scoring device. The…

Assessment methods for rehabilitation.

PubMed

Biefang, S; Potthoff, P

1995-09-01

Diagnostics and evaluation in medical rehabilitation should be based on methods that are as objective as possible. In this context quantitative methods are an important precondition. We conducted for the German Pensions Insurance Institutions (which are in charge of the medical and vocational rehabilitation of workers and employees) a survey on assessment methods for rehabilitation which included an evaluation of American literature, with the aim to indicate procedures that can be considered for adaptation in Germany and to define further research requirements. The survey identified: (1) standardized procedures and instrumented tests for the assessment of musculoskeletal, cardiopulmonary and neurophysiological function; (2) personality, intelligence, achievement, neuropsychological and alcoholism screening tests for the assessment of mental or cognitive function; (3) rating scales and self-administered questionnaires for the assessment of Activities of Daily Living and Instrumental Activities of Daily Living (ADL/IADL Scales); (4) generic profiles and indexes as well as disease-specific measures for the assessment of health-related quality of life and health status; and (5) rating scales for vocational assessment. German equivalents or German versions exist only for a part of the procedures identified. Translation and testing of Anglo-Saxon procedures should have priority over the development of new German methods. The following procedures will be taken into account: (a) instrumented tests for physical function, (b) IADL Scales, (c) generic indexes of health-related quality of life, (d) specific quality of life and health status measures for disorders of the circulatory system, metabolic system, digestive organs, respiratory tract and for cancer, and (e) vocational rating scales.

Instruments Assessing Anxiety in Adults with Intellectual Disabilities: A Systematic Review

ERIC Educational Resources Information Center

Hermans, Heidi; van der Pas, Femke H.; Evenhuis, Heleen M.

2011-01-01

Background: In the last decades several instruments measuring anxiety in adults with intellectual disabilities have been developed. Aim: To give an overview of the characteristics and psychometric properties of self-report and informant-report instruments measuring anxiety in this group. Method: Systematic review of the literature. Results:…

Interest and limitations of projective techniques in the assessment of personality disorders.

PubMed

Petot, J M

2000-06-01

Assessing personality disorders (PD) remains a difficult task because of persistent problems linked to concurrent validity of existing instruments, which are all structured interviews or self-report inventories. It has been advocated that indirect methods, projective techniques in particular, can strengthen PD assessment methods. The thematic apperception test (TAT) may be a significant adjuvant method of PD assessment.

The quality of instruments to assess the process of shared decision making: A systematic review

PubMed Central

Bomhof-Roordink, Hanna; Smith, Ian P.; Scholl, Isabelle; Stiggelbout, Anne M.; Pieterse, Arwen H.

2018-01-01

Objective To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. Methods In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. Results We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Conclusions Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument’s content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations. PMID:29447193

Developing evaluation instrument based on CIPP models on the implementation of portfolio assessment

NASA Astrophysics Data System (ADS)

Kurnia, Feni; Rosana, Dadan; Supahar

2017-08-01

This study aimed to develop an evaluation instrument constructed by CIPP model on the implementation of portfolio assessment in science learning. This study used research and development (R & D) method; adapting 4-D by the development of non-test instrument, and the evaluation instrument constructed by CIPP model. CIPP is the abbreviation of Context, Input, Process, and Product. The techniques of data collection were interviews, questionnaires, and observations. Data collection instruments were: 1) the interview guidelines for the analysis of the problems and the needs, 2) questionnaire to see level of accomplishment of portfolio assessment instrument, and 3) observation sheets for teacher and student to dig up responses to the portfolio assessment instrument. The data obtained was quantitative data obtained from several validators. The validators consist of two lecturers as the evaluation experts, two practitioners (science teachers), and three colleagues. This paper shows the results of content validity obtained from the validators and the analysis result of the data obtained by using Aikens' V formula. The results of this study shows that the evaluation instrument based on CIPP models is proper to evaluate the implementation of portfolio assessment instruments. Based on the experts' judgments, practitioners, and colleagues, the Aikens' V coefficient was between 0.86-1,00 which means that it is valid and can be used in the limited trial and operational field trial.

Compact dry chemistry instruments.

PubMed

Terashima, K; Tatsumi, N

1999-01-01

Compact dry chemistry instruments are designed for use in point-of-care-testing (POCT). These instruments have a number of advantages, including light weight, compactness, ease of operation, and the ability to provide accurate results in a short time with a very small sample volume. On the other hand, reagent costs are high compared to liquid method. Moreover, differences in accuracy have been found between dry chemistry and the liquid method in external quality assessment scheme. This report examines reagent costs and shows how the total running costs associated with dry chemistry are actually lower than those associated with the liquid method. This report also describes methods for minimizing differences in accuracy between dry chemistry and the liquid method. Use of these measures is expected to increase the effectiveness of compact dry chemistry instruments in POCT applications.

Beyond Instrumentation: Redesigning Measures and Methods for Evaluating the Graduate College Experience

ERIC Educational Resources Information Center

Hardré, Patricia L.; Hackett, Shannon

2015-01-01

This manuscript chronicles the process and products of a redesign for evaluation of the graduate college experience (GCE) which was initiated by a university graduate college, based on its observed need to reconsider and update its measures and methods for assessing graduate students' experiences. We examined the existing instrumentation and…

Becoming a Reflective Mathematics Teacher: A Guide for Observations and Self-Assessment. Studies in Mathematical Thinking and Learning Series.

ERIC Educational Resources Information Center

Artzt, Alice F.; Armour-Thomas, Eleanor

This activity-oriented book for preservice mathematics teachers who are taking methods courses or who have been student teaching offers a framework for teacher reflection and self- assessment. It supplies detailed observation instruments for observing other teachers, reflective activities, and guidelines and instruments for supervisors. There are…

The Chinese Family Assessment Instrument (C-FAI): Hierarchical Confirmatory Factor Analyses and Factorial Invariance

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Ma, Cecilia M. S.

2010-01-01

Objective: This paper examines the dimensionality and factorial invariance of the Chinese Family Assessment Instrument (C-FAI) using multigroup confirmatory factor analyses (MCFAs). Method: A total of 3,649 students responded to the C-FAI in a community survey. Results: Results showed that there are five dimensions of the C-FAI (communication,…

Quality of life in end stage renal disease patients

PubMed Central

Joshi, Veena D

2014-01-01

AIM: To understand factors associated with quality of life (QOL), examine types of QOL instruments, and determine need for further improvements in QOL assessment. METHODS: The method used databases (Pubmed, Google scholar) and a bibliographic search using key words QOL, end stage renal disease, Hemodialysis, Peritoneal dialysis, instruments to measure QOL, patients and qualitative/quantitative analysis published during 1990 to June 2014. Each article was assessed for sample size, demographics of participants, study design and type of QOL instruments used. We used WHO definition of QOL. RESULTS: For this review, 109 articles were screened, out of which 65 articles were selected. Out of 65 articles, there were 19 reports/reviews and 12 questionnaire manuals. Of the 34 studies, 82% were quantitative while only 18% were qualitative. QOL instruments measured several phenomenon such as physical/psychological health, effects and burdens of kidney disease, social support etc. those are associated with QOL. Few studies looked at spiritual beliefs, cultural beliefs, personal concerns, as per the WHO definition. Telemedicine and Palliative care have now been successfully used however QOL instruments seldom addressed those in the articles reviewed. Also noticed was that longitudinal studies were rarely conducted. Existing QOL instruments only partially measure QOL. This may limit validity of predictive power of QOL. CONCLUSION: Culture and disease specific QOL instruments that assess patients’ objective and subjective experiences covering most aspects of QOL are urgently needed. PMID:25374827

Cost Analysis at the Local Level: Applications and Attitudes. Paper and Report Series No. 103.

ERIC Educational Resources Information Center

Smith, Jana Kay

This study reports the results of a survey sent to 67 metropolitan school district evaluators. The survey assessed past and anticipated conduct of cost analysis methods, as well as attitudes toward the use of these methods. The instrument used contained many items taken from a survey instrument used in a previous study of cost analysis methods at…

A Method for Evaluating Competency in Assessment and Management of Suicide Risk

ERIC Educational Resources Information Center

Hung, Erick K.; Binder, Renee L.; Fordwood, Samantha R.; Hall, Stephen E.; Cramer, Robert J.; McNiel, Dale E.

2012-01-01

Objective: Although health professionals increasingly are expected to be able to assess and manage patients' risk for suicide, few methods are available to evaluate this competency. This report describes development of a competency-assessment instrument for suicide risk-assessment (CAI-S), and evaluates its use in an objective structured clinical…

Development and Validation of an Instrument to Assess the Implementation of Family-Centred Care in Traditional Open Bay Neonatal Intensive Care Units

ERIC Educational Resources Information Center

Al-Motlaq, Mohammad A.; Abuidhail, Jamila; Salameh, Taghreed; Awwad, Wesam

2017-01-01

Objective: To develop an instrument to study family-centred care (FCC) in traditional open bay Neonatal Intensive Care Units (NICUs). Methods: The development process involved constructing instrument's items, establishing content validity by an expert panel and testing the instrument for validity and reliability with a convenience sample of 25…

A fast RCS accuracy assessment method for passive radar calibrators

NASA Astrophysics Data System (ADS)

Zhou, Yongsheng; Li, Chuanrong; Tang, Lingli; Ma, Lingling; Liu, QI

2016-10-01

In microwave radar radiometric calibration, the corner reflector acts as the standard reference target but its structure is usually deformed during the transportation and installation, or deformed by wind and gravity while permanently installed outdoor, which will decrease the RCS accuracy and therefore the radiometric calibration accuracy. A fast RCS accuracy measurement method based on 3-D measuring instrument and RCS simulation was proposed in this paper for tracking the characteristic variation of the corner reflector. In the first step, RCS simulation algorithm was selected and its simulation accuracy was assessed. In the second step, the 3-D measuring instrument was selected and its measuring accuracy was evaluated. Once the accuracy of the selected RCS simulation algorithm and 3-D measuring instrument was satisfied for the RCS accuracy assessment, the 3-D structure of the corner reflector would be obtained by the 3-D measuring instrument, and then the RCSs of the obtained 3-D structure and corresponding ideal structure would be calculated respectively based on the selected RCS simulation algorithm. The final RCS accuracy was the absolute difference of the two RCS calculation results. The advantage of the proposed method was that it could be applied outdoor easily, avoiding the correlation among the plate edge length error, plate orthogonality error, plate curvature error. The accuracy of this method is higher than the method using distortion equation. In the end of the paper, a measurement example was presented in order to show the performance of the proposed method.

Construction of a survey to assess workload and fatigue among AMT operators in Mexico.

PubMed

Hernández Arellano, Juan Luis; Ibarra Mejía, Gabriel; Serratos Pérez, J Nieves; García Alcaraz, Jorge Luis; Brunette, María Julia

2012-01-01

Operators of machinery classified as Advanced Manufacturing Technology (AMT) are exposed to high levels of workload and fatigue. However, only few studies have been conducted on this topic in Hispanic-American countries workers. Several instruments be used to assess workload and fatigue; however, only few of them have been adapted to Spanish language. This paper reports on the development and validity testing of a survey instrument in Spanish, aiming to subjectively assess workload and fatigue among AMT operators in Mexico. After an exhaustive literature review in search of already available measurement instruments, they were adapted for content and later translated into Spanish; a pilot test was conducted to evaluate validity and reliability; afterwards appropriate modifications were made to the testing instruments. Final version of the instrument was applied to a group of 121 operators of CNC lathes. Reliability was analyzed using KMO and Cronbach alpha indices. For the assessment of workload, both NASA-TLX and ISTAS 21 methods were incorporated to the survey instrument. As for fatigue assessment tools, these were SOFI-S, FAS and OFER questionnaires. RESULTS show KMO value and Cronbach alpha above 0.6.Conclusions. The survey instrument as designed, allows the collection of reliable and valid data regarding workload and fatigue among AMT operators in Mexico.

Assessing Social Networks in Patients with Psychotic Disorders: A Systematic Review of Instruments

PubMed Central

Priebe, Stefan

2015-01-01

Background Evidence suggests that social networks of patients with psychotic disorders influence symptoms, quality of life and treatment outcomes. It is therefore important to assess social networks for which appropriate and preferably established instruments should be used. Aims To identify instruments assessing social networks in studies of patients with psychotic disorders and explore their properties. Method A systematic search of electronic databases was conducted to identify studies that used a measure of social networks in patients with psychotic disorders. Results Eight instruments were identified, all of which had been developed before 1991. They have been used in 65 studies (total N of patients = 8,522). They assess one or more aspects of social networks such as their size, structure, dimensionality and quality. Most instruments have various shortcomings, including questionable inter-rater and test-retest reliability. Conclusions The assessment of social networks in patients with psychotic disorders is characterized by a variety of approaches which may reflect the complexity of the construct. Further research on social networks in patients with psychotic disorders would benefit from advanced and more precise instruments using comparable definitions of and timescales for social networks across studies. PMID:26709513

Using 2 Assessment Methods May Better Describe Dietary Supplement Intakes in the United States.

PubMed

Nicastro, Holly L; Bailey, Regan L; Dodd, Kevin W

2015-07-01

One-half of US adults report using a dietary supplement. NHANES has traditionally assessed dietary supplement use via a 30-d questionnaire but in 2007 added a supplement module to the 24-h dietary recall (24HR). We compared these 2 dietary assessment methods, examined potential biases in the methods, and determined the effect that instrument choice had on estimates of prevalence of multivitamin/multimineral dietary supplement (MVMM) use. We described prevalence of dietary supplement use by age, sex, and assessment instrument in 12,285 adults in the United States (>19 y of age) from NHANES 2007-2010. When using data from the questionnaire alone, 29.3% ± 1.0% of men and 35.5% ± 1.0% of women were users of MVMMs, whereas data from the 24HR only produced prevalence estimates of 26.3% ± 1.1% for men and 33.2% ± 1.0% for women. When using data from both instruments combined, 32.3% ± 1.2% of men and 39.5% ± 1.1% of women were classified as MVMM users. Prevalence estimates were significantly higher by 2-9% in all age-sex groups when using information from both instruments combined than when using data from either instrument individually. A digit preference bias and flattened slope phenomenon were observed in responses to the dietary supplement questionnaire. A majority (67%) of MVMMs were captured on both instruments, whereas 19% additional MVMMs were captured on the questionnaire and 14% additional on the 24HR. Of those captured only on the 24HR, 26% had missing label information, whereas only 12% and 9% of those captured on the questionnaire or both, respectively, had missing information. Use of both the dietary supplement questionnaire and the 24HR can provide advantages to researchers over the use of a single instrument and potentially capture a larger fraction of dietary supplement users. © 2015 American Society for Nutrition.

Defect propagation in NiTi rotary instruments: a noncontact optical profilometry analysis.

PubMed

Barbosa, I; Ferreira, F; Scelza, P; Neff, J; Russano, D; Montagnana, M; Zaccaro Scelza, M

2018-04-10

To evaluate the presence and propagation of defects and their effects on surfaces of nickel-titanium (NiTi) instruments using noncontact, three-dimensional optical profilometry, and to assess the accuracy of this method of investigation. The flute surface areas of instruments from two commercial instrumentation systems, namely Reciproc R25 (n = 5) and WaveOne Primary (n = 5), were assessed and compared before and after performing two instrumentation cycles in simulated root canals in clear resin blocks. All the analyses were conducted on areas measuring 211 × 211 μm, located 3 mm from the tips of the instruments. A quantitative analysis was conducted before and after the first and second instrumentation cycles, using the Sa (average roughness over the measurement field), Sq (root mean square roughness) and Sz (average height over the measurement field) amplitude parameters. All the data were submitted to statistical analysis at a 5% level of significance. There was a significant increase (P = 0.007) in wear in both groups, especially between baseline and the second instrumentation cycle, with significantly higher wear values being observed on WaveOne instruments (Sz median values = 33.68 and 2.89 μm, respectively, for WO and RP groups). A significant increase in surface roughness (P = 0.016 and P = 0.008, respectively, for Sa and Sq) was observed in both groups from the first to the second instrumentation cycle, mostly in WaveOne specimens. Qualitative analysis revealed a greater number of defects on the flute topography of all the instruments after use. More defects were identified in WaveOne Primary instruments compared to Reciproc R25, irrespective of the evaluation stage. The investigation method provided an accurate, repeatable and reproducible assessment of NiTi instruments at different time-points. © 2018 International Endodontic Journal. Published by John Wiley & Sons Ltd.

Systematic review and meta-analysis of the performance of clinical risk assessment instruments for screening for osteoporosis or low bone density

PubMed Central

Edwards, D. L.; Saleh, A. A.; Greenspan, S. L.

2015-01-01

Summary We performed a systematic review and meta-analysis of the performance of clinical risk assessment instruments for screening for DXA-determined osteoporosis or low bone density. Commonly evaluated risk instruments showed high sensitivity approaching or exceeding 90 % at particular thresholds within various populations but low specificity at thresholds required for high sensitivity. Simpler instruments, such as OST, generally performed as well as or better than more complex instruments. Introduction The purpose of the study is to systematically review the performance of clinical risk assessment instruments for screening for dual-energy X-ray absorptiometry (DXA)-determined osteoporosis or low bone density. Methods Systematic review and meta-analysis were performed. Multiple literature sources were searched, and data extracted and analyzed from included references. Results One hundred eight references met inclusion criteria. Studies assessed many instruments in 34 countries, most commonly the Osteoporosis Self-Assessment Tool (OST), the Simple Calculated Osteoporosis Risk Estimation (SCORE) instrument, the Osteoporosis Self-Assessment Tool for Asians (OSTA), the Osteoporosis Risk Assessment Instrument (ORAI), and body weight criteria. Meta-analyses of studies evaluating OST using a cutoff threshold of <1 to identify US postmenopausal women with osteoporosis at the femoral neck provided summary sensitivity and specificity estimates of 89 % (95%CI 82–96 %) and 41 % (95%CI 23–59 %), respectively. Meta-analyses of studies evaluating OST using a cutoff threshold of 3 to identify US men with osteoporosis at the femoral neck, total hip, or lumbar spine provided summary sensitivity and specificity estimates of 88 % (95%CI 79–97 %) and 55 % (95%CI 42–68 %), respectively. Frequently evaluated instruments each had thresholds and populations for which sensitivity for osteoporosis or low bone mass detection approached or exceeded 90 % but always with a trade-off of relatively low specificity. Conclusions Commonly evaluated clinical risk assessment instruments each showed high sensitivity approaching or exceeding 90 % for identifying individuals with DXA-determined osteoporosis or low BMD at certain thresholds in different populations but low specificity at thresholds required for high sensitivity. Simpler instruments, such as OST, generally performed as well as or better than more complex instruments. PMID:25644147

A Case for the Standardized Assessment of Testamentary Capacity

PubMed Central

Brenkel, Megan; Whaley, Kimberley; Herrmann, Nathan; Crawford, Kerri; Hazan, Elias; Cardiff, Laura; Owen, Adrian M.

2018-01-01

Background With an increasingly aged, frail population that holds a disproportionate amount of wealth, clinicians (especially those with expertise in older adults) may be asked with more frequency to offer a clinical opinion on testamentary capacity (TC), the mental capacity to make a will. Method This paper reviews the legal criteria as well as the empirical research on assessment tools for determining testamentary capacity (TC). We also review the relevance of instruments used for the assessment of other decisional capacities in order to evince the potential value of developing a standardized assessment of TC for clinician experts. Results The legal criteria, often referred to as a “test”, for determining requisite TC (Banks v. Goodfellow) have remained much the same since 1870 with minimal clinical input and, as such, there has been little development in TC assessment instruments. Decisional instruments designed to assess Consent to Treatment may have relevance for TC. Conclusion We make the case for a semi-structured interview that includes standardized criteria for the legal test for TC, supplemented by a validated brief neuropsychological assessment, which together comprise a Contemporaneous Assessment Instrument (CAI) for TC. PMID:29581818

Development of Mobile Tracer Correlation Method for Assessment of Air Emissions from Landfills and Other Area Sources

EPA Science Inventory

Abstract - A standardized version of a mobile tracer correlation measurement method was developed and used for assessment of methane emissions from 15 landfills in 56 field deployments from 2009 to 2013. This general area source measurement method uses advances in instrumentation...

Assessment on the methods of measuring the tyre-road contact patch stresses

NASA Astrophysics Data System (ADS)

Anghelache, G.; Moisescu, A.-R.; Buretea, D.

2017-08-01

The paper reviews established and modern methods for investigating tri-axial stress distributions in the tyre-road contact patch. The authors used three methods of measuring stress distributions: strain gauge method; force sensing technique; acceleration measurements. Four prototypes of instrumented pins transducers involving mentioned measuring methods were developed. Data acquisitions of the contact patch stresses distributions were performed using each transducer with instrumented pin. The results are analysed and compared, underlining the advantages and drawbacks of each method. The experimental results indicate that the three methods are valuable.

Evaluation Methods and Procedures In a Therapeutic Nursery Program.

ERIC Educational Resources Information Center

Barker, William F.

Four areas of evaluation will be briefly discussed: 1) those areas of functioning which should be assessed, 2) instruments which were used in each area, 3) knowledge of instruments, 4) preliminary results for each instrument. The areas related to the preschool child which should be evaluated consist of: 1) the child's cognitive functioning, 2) the…

Quantitative Analysis of Transnasal Anterior Skull Base Approach: Report of Technology for Intraoperative Assessment of Instrument Motion.

PubMed

Berens, Angelique M; Harbison, Richard Alex; Li, Yangming; Bly, Randall A; Aghdasi, Nava; Ferreira, Manuel; Hannaford, Blake; Moe, Kris S

2017-08-01

To develop a method to measure intraoperative surgical instrument motion. This model will be applicable to the study of surgical instrument kinematics including surgical training, skill verification, and the development of surgical warning systems that detect aberrant instrument motion that may result in patient injury. We developed an algorithm to automate derivation of surgical instrument kinematics in an endoscopic endonasal skull base surgery model. Surgical instrument motion was recorded during a cadaveric endoscopic transnasal approach to the pituitary using a navigation system modified to record intraoperative time-stamped Euclidian coordinates and Euler angles. Microdebrider tip coordinates and angles were referenced to the cadaver's preoperative computed tomography scan allowing us to assess surgical instrument kinematics over time. A representative cadaveric endoscopic endonasal approach to the pituitary was performed to demonstrate feasibility of our algorithm for deriving surgical instrument kinematics. Technical feasibility of automatically measuring intraoperative surgical instrument motion and deriving kinematics measurements was demonstrated using standard navigation equipment.

Divergences between clinical and research methods for assessing personality disorders: implications for research and the evolution of axis II.

PubMed

Westen, D

1997-07-01

The purpose of this study was to examine the extent to which instruments for assessing axis II diverge from clinical diagnostic processes. Subjects in the first study were 52 clinicians with experience in assessment and treatment of patients with personality disorders, who were surveyed about the methods they use in clinical practice to make diagnoses and other aspects of the diagnostic process. A second study replicated the major findings with a random national sample of 1,901 experienced psychiatrists and psychologists. Whereas current instruments rely primarily on direct questions derived from DSM-IV, clinicians of every theoretical persuasion found direct questions useful for assessing axis I disorders but only marginally so for axis II. They made axis II diagnoses, instead, by listening to patients describe interpersonal interactions and observing their behavior with the interviewer. In contrast to findings with current research instruments, most patients with personality disorders in clinical practice receive only one axis II diagnosis, and if they receive more than one, one is considered primary. Clinicians reported treating a substantial number of patients for enduring personality patterns that current axis II instruments do not assess, many of which meet neither axis I nor axis II criteria, notably problems with relatedness, work, self-esteem, and chronic subclinical depressive traits. Measurements of axis II were constructed by using a model derived from axis I instruments that diverges from clinical diagnostic procedures in a way that may be problematic for the assessment of personality disorders and the development of a more clinically and empirically sound taxonomy.

Development of performance test instrument in the experiment of law of conservation mass using self and peer assessment’s technique

NASA Astrophysics Data System (ADS)

Siswaningsih, W.; Nahadi; Firmansyah, D. R.

2018-05-01

The purpose of this research is to develop the instrument of performance assessment of law of mass conservation using self and peer assessment technique that meet valid and reliable criteria. The instrument components consist of task and rubric. The method used is development and validation.Value of the instrument reliability obtained from twice observations that are at four and six students every group with three same observers. Cronbach alpha value for four and six students every group consecutively are 0.94 and 0.76, indicating that value shows that the instrument is reliable. Optimum amount of the students that can be observed are four students. The implementation of the instrument to limited group of students showed that All of the students give positive responses to the instrument used with the interpretation of questionnaire scores >90% that categorized as good.

High-Level Disinfection of Otorhinolaryngology Clinical Instruments: An Evaluation of the Efficacy and Cost-effectiveness of Instrument Storage.

PubMed

Yalamanchi, Pratyusha; Yu, Jason; Chandler, Laura; Mirza, Natasha

2018-01-01

Objectives Despite increasing interest in individual instrument storage, risk of bacterial cross-contamination of otorhinolaryngology clinic instruments has not been assessed. This study is the first to determine the clinical efficacy and cost-effectiveness of standard high-level disinfection and clinic instrument storage. Methods To assess for cross-contamination, surveillance cultures of otorhinolaryngology clinic instruments subject to standard high-level disinfection and storage were obtained at the start and end of the outpatient clinical workday. Rate of microorganism recovery was compared with cultures of instruments stored in individual peel packs and control cultures of contaminated instruments. Based on historical clinic data, the direct allocation method of cost accounting was used to determine aggregate raw material cost and additional labor hours required to process and restock peel-packed instruments. Results Among 150 cultures of standard high-level disinfected and co-located clinic instruments, 3 positive bacterial cultures occurred; 100% of control cultures were positive for bacterial species ( P < .001). There was no statistical difference between surveillance cultures obtained before and after the clinic day. While there was also no significant difference in rate of contamination between peel-packed and co-located instruments, peel packing all instruments requires 6250 additional labor hours, and conservative analyses place the cost of individual semicritical instrument storage at $97,852.50 per year. Discussion With in vitro inoculation of >200 otorhinolaryngology clinic instruments, this study demonstrates that standard high-level disinfection and storage are equally efficacious to more time-consuming and expensive individual instrument storage protocols, such as peel packing, with regard to bacterial contamination. Implications for Practice Standard high-level disinfection and storage are equally effective to labor-intensive and costly individual instrument storage protocols.

Evaluation of the Clinical LOINC (Logical Observation Identifiers, Names, and Codes) Semantic Structure as a Terminology Model for Standardized Assessment Measures

PubMed Central

Bakken, Suzanne; Cimino, James J.; Haskell, Robert; Kukafka, Rita; Matsumoto, Cindi; Chan, Garrett K.; Huff, Stanley M.

2000-01-01

Objective: The purpose of this study was to test the adequacy of the Clinical LOINC (Logical Observation Identifiers, Names, and Codes) semantic structure as a terminology model for standardized assessment measures. Methods: After extension of the definitions, 1,096 items from 35 standardized assessment instruments were dissected into the elements of the Clinical LOINC semantic structure. An additional coder dissected at least one randomly selected item from each instrument. When multiple scale types occurred in a single instrument, a second coder dissected one randomly selected item representative of each scale type. Results: The results support the adequacy of the Clinical LOINC semantic structure as a terminology model for standardized assessments. Using the revised definitions, the coders were able to dissect into the elements of Clinical LOINC all the standardized assessment items in the sample instruments. Percentage agreement for each element was as follows: component, 100 percent; property, 87.8 percent; timing, 82.9 percent; system/sample, 100 percent; scale, 92.6 percent; and method, 97.6 percent. Discussion: This evaluation was an initial step toward the representation of standardized assessment items in a manner that facilitates data sharing and re-use. Further clarification of the definitions, especially those related to time and property, is required to improve inter-rater reliability and to harmonize the representations with similar items already in LOINC. PMID:11062226

Validation of the Portuguese self-administered computerised 24-hour dietary recall among second-, third- and fourth-grade children

USDA-ARS?s Scientific Manuscript database

Current methods for assessing children's dietary intake, such as interviewer-administered 24-h dietary recall (24-h DR), are time consuming and resource intensive. Self-administered instruments offer a low-cost diet assessment method for use with children. The present study assessed the validity of ...

Development of a Self-Rated Mixed Methods Skills Assessment: The National Institutes of Health Mixed Methods Research Training Program for the Health Sciences.

PubMed

Guetterman, Timothy C; Creswell, John W; Wittink, Marsha; Barg, Fran K; Castro, Felipe G; Dahlberg, Britt; Watkins, Daphne C; Deutsch, Charles; Gallo, Joseph J

2017-01-01

Demand for training in mixed methods is high, with little research on faculty development or assessment in mixed methods. We describe the development of a self-rated mixed methods skills assessment and provide validity evidence. The instrument taps six research domains: "Research question," "Design/approach," "Sampling," "Data collection," "Analysis," and "Dissemination." Respondents are asked to rate their ability to define or explain concepts of mixed methods under each domain, their ability to apply the concepts to problems, and the extent to which they need to improve. We administered the questionnaire to 145 faculty and students using an internet survey. We analyzed descriptive statistics and performance characteristics of the questionnaire using the Cronbach alpha to assess reliability and an analysis of variance that compared a mixed methods experience index with assessment scores to assess criterion relatedness. Internal consistency reliability was high for the total set of items (0.95) and adequate (≥0.71) for all but one subscale. Consistent with establishing criterion validity, respondents who had more professional experiences with mixed methods (eg, published a mixed methods article) rated themselves as more skilled, which was statistically significant across the research domains. This self-rated mixed methods assessment instrument may be a useful tool to assess skills in mixed methods for training programs. It can be applied widely at the graduate and faculty level. For the learner, assessment may lead to enhanced motivation to learn and training focused on self-identified needs. For faculty, the assessment may improve curriculum and course content planning.

Adapting the helpful responses questionnaire to assess communication skills involved in delivering contingency management: preliminary psychometrics.

PubMed

Hartzler, Bryan

2015-08-01

A paper/pencil instrument, adapted from Miller and colleagues' (1991) Helpful Responses Questionnaire (HRQ), was developed to assess clinician skill with core communicative aspects involved in delivering contingency management (CM). The instrument presents a single vignette consisting of six points of client dialogue to which respondents write 'what they would say next.' In the context of an implementation/effectiveness hybrid trial, 19 staff clinicians at an opiate treatment program completed serial training outcome assessments before, following, and three months after CM training. Assessments included this adaptation of the HRQ, a multiple-choice CM knowledge test, and a recorded standardized patient encounter scored for CM skillfulness. Study results reveal promising psychometric properties for the instrument, including strong scoring reliability, internal consistency, concurrent and predictive validity, test-retest reliability and sensitivity to training effects. These preliminary findings suggest the instrument is a viable, practical method to assess clinician skill in communicative aspects of CM delivery. Copyright © 2015 Elsevier Inc. All rights reserved.

Using cognitive pre-testing methods in the development of a new evidenced-based pressure ulcer risk assessment instrument.

PubMed

Coleman, S; Nixon, J; Keen, J; Muir, D; Wilson, L; McGinnis, E; Stubbs, N; Dealey, C; Nelson, E A

2016-11-16

Variation in development methods of Pressure Ulcer Risk Assessment Instruments has led to inconsistent inclusion of risk factors and concerns about content validity. A new evidenced-based Risk Assessment Instrument, the Pressure Ulcer Risk Primary Or Secondary Evaluation Tool - PURPOSE-T was developed as part of a National Institute for Health Research (NIHR) funded Pressure Ulcer Research Programme (PURPOSE: RP-PG-0407-10056). This paper reports the pre-test phase to assess and improve PURPOSE-T acceptability, usability and confirm content validity. A descriptive study incorporating cognitive pre-testing methods and integration of service user views was undertaken over 3 cycles comprising PURPOSE-T training, a focus group and one-to-one think-aloud interviews. Clinical nurses from 2 acute and 2 community NHS Trusts, were grouped according to job role. Focus group participants used 3 vignettes to complete PURPOSE-T assessments and then participated in the focus group. Think-aloud participants were interviewed during their completion of PURPOSE-T. After each pre-test cycle analysis was undertaken and adjustment/improvements made to PURPOSE-T in an iterative process. This incorporated the use of descriptive statistics for data completeness and decision rule compliance and directed content analysis for interview and focus group data. Data were collected April 2012-June 2012. Thirty-four nurses participated in 3 pre-test cycles. Data from 3 focus groups, 12 think-aloud interviews incorporating 101 PURPOSE-T assessments led to changes to improve instrument content and design, flow and format, decision support and item-specific wording. Acceptability and usability were demonstrated by improved data completion and appropriate risk pathway allocation. The pre-test also confirmed content validity with clinical nurses. The pre-test was an important step in the development of the preliminary PURPOSE-T and the methods used may have wider instrument development application. PURPOSE-T proposes a new approach to pressure ulcer risk assessment, incorporating a screening stage, the inclusion of skin status to distinguish between those who require primary prevention and those who require secondary prevention/treatment and the use of colour to support pathway allocation and decision making. Further clinical evaluation is planned to assess the reliability and validity of PURPOSE-T and it's impact on care processes and patient outcomes.

A new method for the assessment of the surface topography of NiTi rotary instruments.

PubMed

Ferreira, F; Barbosa, I; Scelza, P; Russano, D; Neff, J; Montagnana, M; Zaccaro Scelza, M

2017-09-01

To describe a new method for the assessment of nanoscale alterations in the surface topography of nickel-titanium endodontic instruments using a high-resolution optical method and to verify the accuracy of the technique. Noncontact three-dimensional optical profilometry was used to evaluate defects on a size 25, .08 taper reciprocating instrument (WaveOne ® ), which was subjected to a cyclic fatigue test in a simulated root canal in a clear resin block. For the investigation, an original procedure was established for the analysis of similar areas located 3 mm from the tip of the instrument before and after canal preparation to enable the repeatability and reproducibility of the measurements with precision. All observations and analysis were taken in areas measuring 210 × 210 μm provided by the software of the equipment. The three-dimensional high-resolution image analysis showed clear alterations in the surface topography of the examined cutting blade and flute of the instrument, before and after use, with the presence of surface irregularities such as deformations, debris, grooves, cracks, steps and microcavities. Optical profilometry provided accurate qualitative nanoscale evaluation of similar surfaces before and after the fatigue test. The stability and repeatability of the technique enables a more comprehensive understanding of the effects of wear on the surface of endodontic instruments. © 2016 International Endodontic Journal. Published by John Wiley & Sons Ltd.

Measuring the youth bullying experience: a systematic review of the psychometric properties of available instruments.

PubMed

Vessey, Judith; Strout, Tania D; DiFazio, Rachel L; Walker, Allison

2014-12-01

Bullying is a significant problem in schools and measuring this concept remains problematic. The purposes of this study were to (1) identify the published self-report measures developed to assess youth bullying; (2) evaluate their psychometric properties and instrument characteristics; and (3) evaluate the quality of identified psychometric papers evaluating youth bullying measures. A systematic review of the literature was conducted using 4 electronic databases. Data extraction and appraisal of identified instruments were completed using a standardized method and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Thirty-one articles describing 27 self-report instruments were evaluated in our analysis. Quality assessments ranged from 18% to 91%, with 6 papers reaching or exceeding a quality score of 75%. Limited evidence supporting the reliability, validity, and responsiveness of existing youth bullying measures was identified. Evidence supporting the psychometric soundness of the instruments identified was limited. Many measures were in early development and additional evaluation is necessary to validate their psychometric properties. A pool of instruments possesses acceptable initial psychometric dependability for selected assessment purposes. These findings have significant implications for assessing youth bullying and designing and evaluating school-based interventions. © 2014, American School Health Association.

Cultural adaptation and translation of measures: an integrated method.

PubMed

Sidani, Souraya; Guruge, Sepali; Miranda, Joyal; Ford-Gilboe, Marilyn; Varcoe, Colleen

2010-04-01

Differences in the conceptualization and operationalization of health-related concepts may exist across cultures. Such differences underscore the importance of examining conceptual equivalence when adapting and translating instruments. In this article, we describe an integrated method for exploring conceptual equivalence within the process of adapting and translating measures. The integrated method involves five phases including selection of instruments for cultural adaptation and translation; assessment of conceptual equivalence, leading to the generation of a set of items deemed to be culturally and linguistically appropriate to assess the concept of interest in the target community; forward translation; back translation (optional); and pre-testing of the set of items. Strengths and limitations of the proposed integrated method are discussed. (c) 2010 Wiley Periodicals, Inc.

Assessing personal talent determinants in young racquet sport players: a systematic review.

PubMed

Faber, Irene R; Bustin, Paul M J; Oosterveld, Frits G J; Elferink-Gemser, Marije T; Nijhuis-Van der Sanden, Maria W G

2016-01-01

Since junior performances have little predictive value for future success, other solutions are sought to assess a young player's potential. The objectives of this systematic review are (1) to provide an overview of instruments measuring personal talent determinants of young players in racquet sports, and (2) to evaluate these instruments regarding their validity for talent development. Electronic searches were conducted in PubMed, PsychINFO, Web of Knowledge, ScienceDirect and SPORTDiscus (1990 to 31 March 2014). Search terms represented tennis, table tennis, badminton and squash, the concept of talent, methods of testing and children. Thirty articles with information regarding over 100 instruments were included. Validity evaluation showed that instruments focusing on intellectual and perceptual abilities, and coordinative skills discriminate elite from non-elite players and/or are related to current performance, but their predictive validity is not confirmed. There is moderate evidence that the assessments of mental and goal management skills predict future performance. Data on instruments measuring physical characteristics prohibit a conclusion due to conflicting findings. This systematic review yielded an ambiguous end point. The lack of longitudinal studies precludes verification of the instrument's capacity to forecast future performance. Future research should focus on instruments assessing multidimensional talent determinants and their predictive value in longitudinal designs.

Automation is an Effective Way to Improve Quality of Verification (Calibration) of Measuring Instruments

NASA Astrophysics Data System (ADS)

Golobokov, M.; Danilevich, S.

2018-04-01

In order to assess calibration reliability and automate such assessment, procedures for data collection and simulation study of thermal imager calibration procedure have been elaborated. The existing calibration techniques do not always provide high reliability. A new method for analyzing the existing calibration techniques and developing new efficient ones has been suggested and tested. A type of software has been studied that allows generating instrument calibration reports automatically, monitoring their proper configuration, processing measurement results and assessing instrument validity. The use of such software allows reducing man-hours spent on finalization of calibration data 2 to 5 times and eliminating a whole set of typical operator errors.

Adaptation and validation of the Inventory of Family Protective Factors for the Portuguese culture

PubMed Central

Augusto, Cláudia Cristina Vieira Carvalho de Oliveira Ferreira; Araújo, Beatriz Rodrigues; Rodrigues, Vítor Manuel Costa Pereira; de Figueiredo, Maria do Céu Aguiar Barbieri

2014-01-01

OBJECTIVES: to adapt and validate the Inventory of Family Protective Factors (IFPF) for the Portuguese culture. This instrument assesses protective factors that contribute to family resilience. Studies addressing resilience are embedded within the salutogenic paradigm, i.e. it addresses protective factors of individuals or groups without underestimating risk factors or vulnerability. METHOD: in order to assess the IFPF's linguistic and conceptual equivalence, the instrument was translated, retro-translated and the think-aloud protocol was used. We then verified the instrument's sensitiveness, reliability and validity of results to assess its psychometric characteristics. A factor analysis was performed of the principal components with varimax rotation of the scale's items and Cronbach's alpha coefficient was calculated for each dimension. A total of 85 families with disabled children, selected through simple random sampling, self-administered the instrument. RESULTS: the IFPF presents psychometric characteristics that are appropriate for the Portuguese population (Cronbach's alpha = .90). CONCLUSION: the IFPF was adapted and validated for the Portuguese culture and is an instrument to be used in studies intended to assess protective factors of family resilience. PMID:25591096

A Systematic Review of Instruments to Assess Organizational Readiness for Knowledge Translation in Health Care

PubMed Central

Gagnon, Marie-Pierre; Attieh, Randa; Ghandour, El Kebir; Légaré, France; Ouimet, Mathieu; Estabrooks, Carole A.; Grimshaw, Jeremy

2014-01-01

Background The translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments. Methods We searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments. Findings We found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69%) of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University –ORC (TCU-ORC) scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University – Director version (TCU-ORC-D), reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19%) instruments. Conclusion Our findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could provide more knowledge on its relevance to diverse clinical contexts. PMID:25474622

Subjective evaluation of treatment outcomes of instrumentation with pedicle screws or hybrid constructs in Lenke Type 1 and 2 adolescent idiopathic scoliosis: what happens when judges are blinded to the instrumentation?

PubMed Central

Ouellet, Jean Albert; Shilt, Jeffrey; Shen, Francis H.; Wood, Kirkham; Chan, Donald; Hicks, John; Bersusky, Ernesto; Reddi, Vasantha

2009-01-01

Superiority of pedicle screws over hybrid/hook instrumentation or vice versa in the treatment of Lenke Type 1 and 2 adolescent idiopathic scoliosis (AIS) remains unresolved for moderate curves. Our objective was therefore to compare the assessment of pedicle screw and hybrid/hooks instrumentation with special attention to cosmesis and uninstrumented spine using novel assessment methods. We carried out a retrospective study of radiographs and clinical photos of 40 cases of thoracic AIS between 40° and 70° of Cobb angle Lenke Type 1 and 2, treated with either pedicle screws or hybrid/hooks. The cases were subjectively assessed by four spine surgeons (SRS Travelling Fellows) for radiographic and operative cosmetic result, shoulder balance, trunk shift, rib hump, and waist asymmetry. Instrumentation in the radiographs was obscured with only the non-instrumented part visible, and the surgeons were asked to guess the instrumentation being used. Eighty photographs of patients before and after surgery were assessed for cosmesis by ten non-medical judges for overall cosmetic score, shoulder balance, waist asymmetry, and shoulder blade prominence. Objective assessment of radiographs and clinical photos was performed for Cobb angle of instrumented and non-instrumented spine, global coronal and sagittal balance, number of unfused vertebrae, disc angulation, tilt of last instrumented vertebra, shoulder balance, waist asymmetry, rib prominence, and percent correction. SRS-24 questionnaire was used to measure health-related quality of life in patients. Subjective assessments by surgeons and non-medical judges showed no significant difference by instrumentation (P ≥ 0.05) for all variables. Out of the 160 guesses by surgeons of the cases with instrumentation blocked in the radiographs, they were unable to guess the instrumentation in 92% of the cases. Objective assessment of all variables and SRS-24 scores of all five domains showed no significant difference by instrumentation (P ≥ 0.05). In this first-ever conducted study in a blinded-fashion, we conclude that there is no significant difference between the pedicle screw and hybrid/hooks instrumentations used to treat AIS for Lenke Type 1 and 2 curves for moderate curves between 40° and 70°. PMID:19672635

Student Attrition in Higher Education: Development of an Instrument to Assess Attrition Factors in Distance Learning Only Educational Environments

ERIC Educational Resources Information Center

York, Jessica Ann

2014-01-01

The purpose of this mixed methods study was to discover the factors and experiences that impact attrition in DLOEEs and to develop an instrument to assess them. Student attrition, those who do not persist voluntarily or involuntarily, occurs in all facets of higher education. In the last five years, the most growth in enrollments has occurred in…

Assessment of Web-Based Authentication Methods in the U.S.: Comparing E-Learning Systems to Internet Healthcare Information Systems

ERIC Educational Resources Information Center

Mattord, Herbert J.

2012-01-01

Organizations continue to rely on password-based authentication methods to control access to many Web-based systems. This research study developed a benchmarking instrument intended to assess authentication methods used in Web-based information systems (IS). It developed an Authentication Method System Index (AMSI) to analyze collected data from…

Translation Quality Assessment in Health Research: A Functionalist Alternative to Back-Translation.

PubMed

Colina, Sonia; Marrone, Nicole; Ingram, Maia; Sánchez, Daisey

2017-09-01

As international research studies become more commonplace, the importance of developing multilingual research instruments continues to increase and with it that of translated materials. It is therefore not unexpected that assessing the quality of translated materials (e.g., research instruments, questionnaires, etc.) has become essential to cross-cultural research, given that the reliability and validity of the research findings crucially depend on the translated instruments. In some fields (e.g., public health and medicine), the quality of translated instruments can also impact the effectiveness and success of interventions and public campaigns. Back-translation (BT) is a commonly used quality assessment tool in cross-cultural research. This quality assurance technique consists of (a) translation (target text [TT 1 ]) of the source text (ST), (b) translation (TT 2 ) of TT 1 back into the source language, and (c) comparison of TT 2 with ST to make sure there are no discrepancies. The accuracy of the BT with respect to the source is supposed to reflect equivalence/accuracy of the TT. This article shows how the use of BT as a translation quality assessment method can have a detrimental effect on a research study and proposes alternatives to BT. One alternative is illustrated on the basis of the translation and quality assessment methods used in a research study on hearing loss carried out in a border community in the southwest of the United States.

Group power through the lens of the 21st century and beyond: further validation of the Sieloff-King Assessment of Group Power within Organizations.

PubMed

Sieloff, Christina L; Bularzik, Anne M

2011-11-01

The purpose was to determine the content validity of a semantic revision of items on a reliable and valid instrument, the Sieloff-King Assessment of Group Power within Organizations (SKAGPO). Research participants expressed negative perceptions regarding the use of the concept of 'power' in SKAGPO items. The SKAGPO is the only instrument measuring a nursing group's power or outcome attainment. Using a survey method, the instrument and grading scale were sent to 12 expert judges. Six participants completed the grading scale. The Content Validity Index (CVI) for seven questions was at or above 83% agreement. Overall, the CVI for the eight revised questions was 93.75%. Subsequently, the instrument was renamed the Sieloff-King Assessment of Group Outcome Attainment within Organizations (SKAGOAO). The semantic revision demonstrated content validity for the revised SKAGOAO. When used by nursing groups to assess their level of outcome attainment, the instrument should continue to be psychometrically evaluated. A nursing group of any size can use the SKAGOAO to both assess the group's level of outcome attainment or empowerment and direct plans to further improve that level. © 2011 Blackwell Publishing Ltd.

Development of a Self-Rated Mixed Methods Skills Assessment: The NIH Mixed Methods Research Training Program for the Health Sciences

PubMed Central

Guetterman, Timothy C.; Creswell, John W.; Wittink, Marsha; Barg, Fran K.; Castro, Felipe G.; Dahlberg, Britt; Watkins, Daphne C.; Deutsch, Charles; Gallo, Joseph J.

2017-01-01

Introduction Demand for training in mixed methods is high, with little research on faculty development or assessment in mixed methods. We describe the development of a Self-Rated Mixed Methods Skills Assessment and provide validity evidence. The instrument taps six research domains: “Research question,” “Design/approach,” “Sampling,” “Data collection,” “Analysis,” and “Dissemination.” Respondents are asked to rate their ability to define or explain concepts of mixed methods under each domain, their ability to apply the concepts to problems, and the extent to which they need to improve. Methods We administered the questionnaire to 145 faculty and students using an internet survey. We analyzed descriptive statistics and performance characteristics of the questionnaire using Cronbach’s alpha to assess reliability and an ANOVA that compared a mixed methods experience index with assessment scores to assess criterion-relatedness. Results Internal consistency reliability was high for the total set of items (.95) and adequate (>=.71) for all but one subscale. Consistent with establishing criterion validity, respondents who had more professional experiences with mixed methods (e.g., published a mixed methods paper) rated themselves as more skilled, which was statistically significant across the research domains. Discussion This Self-Rated Mixed Methods Assessment instrument may be a useful tool to assess skills in mixed methods for training programs. It can be applied widely at the graduate and faculty level. For the learner, assessment may lead to enhanced motivation to learn and training focused on self-identified needs. For faculty, the assessment may improve curriculum and course content planning. PMID:28562495

Efficient clinical evaluation of guideline quality: development and testing of a new tool

PubMed Central

2014-01-01

Background Evaluating the methodological quality of clinical practice guidelines is essential before deciding which ones which could best inform policy or practice. One current method of evaluating clinical guideline quality is the research-focused AGREE II instrument. This uses 23 questions scored 1–7, arranged in six domains, which requires at least two independent testers, and uses a formulaic weighted domain scoring system. Following feedback from time-poor clinicians, policy-makers and managers that this instrument did not suit clinical need, we developed and tested a simpler, shorter, binary scored instrument (the iCAHE Guideline Quality Checklist) designed for single users. Methods Content and construct validity, inter-tester reliability and clinical utility were tested by comparing the new iCAHE Guideline Quality Checklist with the AGREE II instrument. Firstly the questions and domains in both instruments were compared. Six randomly-selected guidelines on a similar theme were then assessed by three independent testers with different experience in guideline quality assessment, using both instruments. Per guideline, weighted domain and total AGREE II scores were calculated, using the scoring rubric for three testers. Total iCAHE scores were calculated per guideline, per tester. The linear relationship between iCAHE and AGREE II scores was assessed using Pearson r correlation coefficients. Score differences between testers were assessed for the iCAHE Guideline Quality Checklist. Results There were congruent questions in each instrument in four domains (Scope & Purpose, Stakeholder involvement, Underlying evidence/Rigour, Clarity). The iCAHE and AGREE II scores were moderate to strongly correlated for the six guidelines. There was generally good agreement between testers for iCAHE scores, irrespective of their experience. The iCAHE instrument was preferred by all testers, and took significantly less time to administer than the AGREE II instrument. However, the use of only three testers and six guidelines compromised study power, rendering this research as pilot investigations of the psychometric properties of the iCAHE instrument. Conclusion The iCAHE Guideline Quality Checklist has promising psychometric properties and clinical utility. PMID:24885893

The quality of instruments to assess the process of shared decision making: A systematic review.

PubMed

Gärtner, Fania R; Bomhof-Roordink, Hanna; Smith, Ian P; Scholl, Isabelle; Stiggelbout, Anne M; Pieterse, Arwen H

2018-01-01

To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument's content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations.

Initial Validation of a Comprehensive Assessment Instrument for Bereavement-Related Grief Symptoms and Risk of Complications: The Indicator of Bereavement Adaptation—Cruse Scotland (IBACS)

PubMed Central

Schut, Henk; Stroebe, Margaret S.; Wilson, Stewart; Birrell, John

2016-01-01

Objective This study assessed the validity of the Indicator of Bereavement Adaptation Cruse Scotland (IBACS). Designed for use in clinical and non-clinical settings, the IBACS measures severity of grief symptoms and risk of developing complications. Method N = 196 (44 male, 152 female) help-seeking, bereaved Scottish adults participated at two timepoints: T1 (baseline) and T2 (after 18 months). Four validated assessment instruments were administered: CORE-R, ICG-R, IES-R, SCL-90-R. Discriminative ability was assessed using ROC curve analysis. Concurrent validity was tested through correlation analysis at T1. Predictive validity was assessed using correlation analyses and ROC curve analysis. Optimal IBACS cutoff values were obtained by calculating a maximal Youden index J in ROC curve analysis. Clinical implications were compared across instruments. Results ROC curve analysis results (AUC = .84, p < .01, 95% CI between .77 and .90) indicated the IBACS is a good diagnostic instrument for assessing complicated grief. Positive correlations (p < .01, 2-tailed) with all four instruments at T1 demonstrated the IBACS' concurrent validity, strongest with complicated grief measures (r = .82). Predictive validity was shown to be fair in T2 ROC curve analysis results (n = 67, AUC = .78, 95% CI between .65 and .92; p < .01). Predictive validity was also supported by stable positive correlations between IBACS and other instruments at T2. Clinical indications were found not to differ across instruments. Conclusions The IBACS offers effective grief symptom and risk assessment for use by non-clinicians. Indications are sufficient to support intake assessment for a stepped model of bereavement intervention. PMID:27741246

Implementation outcome assessment instruments used in physical healthcare settings and their measurement properties: a systematic review protocol

PubMed Central

Vitoratou, Silia; Sevdalis, Nick; Hull, Louise

2017-01-01

Introduction Over the past 10 years, research into methods that promote the uptake, implementation and sustainability of evidence-based interventions has gathered pace. However, implementation outcomes are defined in different ways and assessed by different measures; the extent to which these measures are valid and reliable is unknown. The aim of this systematic review is to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings, to advance the use of precise and accurate measures. Methods and analysis The following databases will be searched from inception to March 2017: MEDLINE, EMBASE, PsycINFO, CINAHL and the Cochrane Library. Grey literature will be sought via HMIC, OpenGrey, ProQuest for theses and Web of Science Conference Proceedings Citation Index-Science. Reference lists of included studies and relevant reviews will be hand searched. Three search strings will be combined to identify eligible studies: (1) implementation literature, (2) implementation outcomes and (3) measurement properties. Screening of titles, abstracts and full papers will be assessed for eligibility by two reviewers independently and any discrepancies resolved via consensus with the wider team. The methodological quality of the studies will be assessed using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. A set of bespoke criteria to determine the quality of the instruments will be used, and the relationship between instrument usability and quality will be explored. Ethics and dissemination Ethical approval is not necessary for systematic review protocols. Researchers and healthcare professionals can use the findings of this systematic review to guide the selection of implementation outcomes instruments, based on their psychometric quality, to assess the impact of their implementation efforts. The findings will also provide a useful guide for reviewers of papers and grants to determine the psychometric quality of the measures used in implementation research. Trial registration number International Prospective Register of Systematic Reviews (PROSPERO): CRD42017065348. PMID:28993392

Problems in developing an instrument for the rapid assessment of personality status.

PubMed

Van Horn, E; Manley, C; Leddy, D; Cicchetti, D; Tyrer, P

2000-06-01

To assess the validity of a quick assessment instrument (10 minutes) for assessing personality status, the Rapid Personality Assessment Schedule (PAS-R). The PAS-R was evaluated in psychotic patients recruited in one of the centres involved in a multicentre randomised controlled trial of intensive vs standard case management (the UK700 case management trial). Patients were assessed using both a full version of the PAS (PAS-I - ICD version) and the PAS-R. The weighted kappa statistic was used to gauge the (criterion-related) validity of the PAS-R using the PAS-I as the gold standard. Both measure code personality status using a four-point rating of severity in addition to recording individual categories of personality disorder. One hundred fifty-five (77%) of 201 patients recruited were assessed with both instruments. The weighted kappa statistic was 0.31, suggesting only moderate agreement between the PAS-I and PAS-R instruments under the four-point rating format, and 0.39 for the dichotomous personality disorder/no disorder separation. The sensitivity (64%) and specificity (82%) of the PAS-R in predicting PAS-I personality disorder were as satisfactory as for other screening instruments but still somewhat disappointing, and the PAS-R had an overall diagnostic accuracy of 78%. The PAS-R is a quick and rough method of detecting personality abnormality but is not a substitute for a fuller assessment.

Development and psychometric evaluation of the Premarital Sexual Behavior Assessment Scale for Young Women (PSAS-YW): an exploratory mixed method study

PubMed Central

2014-01-01

Background Premarital sexual behaviors are important issue for women’s health. The present study was designed to develop and examine the psychometric properties of a scale in order to identify young women who are at greater risk of premarital sexual behavior. Method This was an exploratory mixed method investigation. Indeed, the study was conducted in two phases. In the first phase, qualitative methods (focus group discussion and individual interview) were applied to generate items and develop the questionnaire. In the second phase, psychometric properties (validity and reliability) of the questionnaire were assessed. Results In the first phase an item pool containing 53 statements related to premarital sexual behavior was generated. In the second phase item reduction was applied and the final version of the questionnaire containing 26 items was developed. The psychometric properties of this final version were assessed and the results showed that the instrument has a good structure, and reliability. The results from exploratory factory analysis indicated a 5-factor solution for the instrument that jointly accounted for the 57.4% of variance observed. The Cronbach’s alpha coefficient for the instrument was found to be 0.87. Conclusion This study provided a valid and reliable scale to identify premarital sexual behavior in young women. Assessment of premarital sexual behavior might help to improve women’s sexual abstinence. PMID:24924696

Intercomparison of two comparative reactivity method instruments inf the Mediterranean basin during summer 2013

NASA Astrophysics Data System (ADS)

Zannoni, N.; Dusanter, S.; Gros, V.; Sarda Esteve, R.; Michoud, V.; Sinha, V.; Locoge, N.; Bonsang, B.

2015-09-01

The hydroxyl radical (OH) plays a key role in the atmosphere, as it initiates most of the oxidation processes of volatile organic compounds (VOCs), and can ultimately lead to the formation of ozone and secondary organic aerosols (SOAs). There are still uncertainties associated with the OH budget assessed using current models of atmospheric chemistry and direct measurements of OH sources and sinks have proved to be valuable tools to improve our understanding of the OH chemistry. The total first order loss rate of OH, or total OH reactivity, can be directly measured using three different methods, such as the following: total OH loss rate measurement, laser-induced pump and probe technique and comparative reactivity method. Observations of total OH reactivity are usually coupled to individual measurements of reactive compounds in the gas phase, which are used to calculate the OH reactivity. Studies using the three methods have highlighted that a significant fraction of OH reactivity is often not explained by individually measured reactive compounds and could be associated to unmeasured or unknown chemical species. Therefore accurate and reproducible measurements of OH reactivity are required. The comparative reactivity method (CRM) has demonstrated to be an advantageous technique with an extensive range of applications, and for this reason it has been adopted by several research groups since its development. However, this method also requires careful corrections to derive ambient OH reactivity. Herein we present an intercomparison exercise of two CRM instruments, CRM-LSCE (Laboratoire des Sciences du Climat et de l'Environnement) and CRM-MD (Mines Douai), conducted during July 2013 at the Mediterranean site of Ersa, Cape Corsica, France. The intercomparison exercise included tests to assess the corrections needed by the two instruments to process the raw data sets as well as OH reactivity observations. The observation was divided in three parts: 2 days of plant emissions (8-9 July), 2 days of ambient measurements (10-11 July) and 2 days (12-13 July) of plant emissions. We discuss in detail the experimental approach adopted and how the data sets were processed for both instruments. Corrections required for the two instruments lead to higher values of reactivity in ambient air; overall 20 % increase for CRM-MD and 49 % for CRM-LSCE compared to the raw data. We show that ambient OH reactivity measured by the two instruments agrees very well (correlation described by a linear least squares fit with a slope of 1 and R2 of 0.75). This study highlights that ambient measurements of OH reactivity with differently configured CRM instruments yield consistent results in a low NOx (NO + NO2), terpene rich environment, despite differential corrections relevant to each instrument. Conducting more intercomparison exercises, involving more CRM instruments operated under different ambient and instrumental settings will help in assessing the variability induced due to instrument-specific corrections further.

Recent Developments in the Assessment and Treatment of Pediatric Obsessive-Compulsive Disorder

ERIC Educational Resources Information Center

Berman, Noah C.; Abramowitz, Jonathan S.

2010-01-01

Although tremendous strides have recently been made in the development of assessment and treatment methods for pediatric obsessive-compulsive disorder (OCD), more accurate methods for diagnosis, more effective treatments, and more refined instruments for monitoring progress during therapy are still needed. The present commentary highlights the…

GPs’ opinions of health assessment instruments for people with intellectual disabilities: a qualitative study

PubMed Central

Bakker-van Gijssel, Esther J; Hartman, Tim C olde; Lucassen, Peter LBJ; van den Driessen Mareeuw, Francine; Dees, Marianne K; Assendelft, Willem JJ; van Schrojenstein Lantman-de Valk, Henny MJ

2017-01-01

Background GPs provide health care to people with intellectual disabilities (ID). People with ID find it difficult to express themselves concerning health-related matters. Applying health assessments is an effective method to reveal health needs, and can play a role in prevention and health promotion. Aim The aim of this qualitative study was to explore GPs’ considerations about applying a health assessment for people with ID. Design and setting This focus group study was conducted among a selection of Dutch GPs. Method An interview guide was developed. All discussions were audiorecorded and transcribed. Analysis was performed using the framework analysis approach. Two researchers independently applied open coding and identified a thematic framework. This framework and the summaries of views per theme were discussed in the research team. Results After four focus groups, with 23 GPs, saturation was reached. Three main themes evolved: health assessments in relation to GPs’ responsibility; the usefulness and necessity of health assessments; and barriers to using health assessments on people with ID. A health assessment instrument for people with ID can help GPs to focus on certain issues that are not so common in the general population. GPs are motivated to use such a tool if it is scientifically tested, and results in significant health gains. However, GPs identify barriers at the level of GP, patient, and organisation. Conclusion Most GPs in the focus groups consider providing medical care to people with ID their responsibility and indicate that a health assessment instrument could be a valuable tool. In order to deliver good care, they need education and support. Many barriers need to be overcome before a health assessment instrument can be implemented. PMID:27993898

Comparison of a multispectral vision system and a colorimeter for the assessment of meat color.

PubMed

Trinderup, Camilla H; Dahl, Anders; Jensen, Kirsten; Carstensen, Jens Michael; Conradsen, Knut

2015-04-01

The color assessment ability of a multispectral vision system is investigated by a comparison study with color measurements from a traditional colorimeter. The experiment involves fresh and processed meat samples. Meat is a complex material; heterogeneous with varying scattering and reflectance properties, so several factors can influence the instrumental assessment of meat color. In order to assess whether two methods are equivalent, the variation due to these factors must be taken into account. A statistical analysis was conducted and showed that on a calibration sheet the two instruments are equally capable of measuring color. Moreover the vision system provides a more color rich assessment of fresh meat samples with a glossier surface, than the colorimeter. Careful studies of the different sources of variation enable an assessment of the order of magnitude of the variability between methods accounting for other sources of variation leading to the conclusion that color assessment using a multispectral vision system is superior to traditional colorimeter assessments. Copyright © 2014 Elsevier Ltd. All rights reserved.

Artifact correction and absolute radiometric calibration techniques employed in the Landsat 7 image assessment system

USGS Publications Warehouse

Boncyk, Wayne C.; Markham, Brian L.; Barker, John L.; Helder, Dennis

1996-01-01

The Landsat-7 Image Assessment System (IAS), part of the Landsat-7 Ground System, will calibrate and evaluate the radiometric and geometric performance of the Enhanced Thematic Mapper Plus (ETM +) instrument. The IAS incorporates new instrument radiometric artifact correction and absolute radiometric calibration techniques which overcome some limitations to calibration accuracy inherent in historical calibration methods. Knowledge of ETM + instrument characteristics gleaned from analysis of archival Thematic Mapper in-flight data and from ETM + prelaunch tests allow the determination and quantification of the sources of instrument artifacts. This a priori knowledge will be utilized in IAS algorithms designed to minimize the effects of the noise sources before calibration, in both ETM + image and calibration data.

Assessing medical professionalism: A systematic review of instruments and their measurement properties

PubMed Central

Li, Honghe; Liu, Yang; Wen, Deliang

2017-01-01

Background Over the last three decades, various instruments were developed and employed to assess medical professionalism, but their measurement properties have yet to be fully evaluated. This study aimed to systematically evaluate these instruments’ measurement properties and the methodological quality of their related studies within a universally acceptable standardized framework and then provide corresponding recommendations. Methods A systematic search of the electronic databases PubMed, Web of Science, and PsycINFO was conducted to collect studies published from 1990–2015. After screening titles, abstracts, and full texts for eligibility, the articles included in this study were classified according to their respective instrument’s usage. A two-phase assessment was conducted: 1) methodological quality was assessed by following the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist; and 2) the quality of measurement properties was assessed according to Terwee’s criteria. Results were integrated using best-evidence synthesis to look for recommendable instruments. Results After screening 2,959 records, 74 instruments from 80 existing studies were included. The overall methodological quality of these studies was unsatisfactory, with reasons including but not limited to unknown missing data, inadequate sample sizes, and vague hypotheses. Content validity, cross-cultural validity, and criterion validity were either unreported or negative ratings in most studies. Based on best-evidence synthesis, three instruments were recommended: Hisar’s instrument for nursing students, Nurse Practitioners’ Roles and Competencies Scale, and Perceived Faculty Competency Inventory. Conclusion Although instruments measuring medical professionalism are diverse, only a limited number of studies were methodologically sound. Future studies should give priority to systematically improving the performance of existing instruments and to longitudinal studies. PMID:28498838

Evaluation of 3 cotton trash measurement methods by visible/near-infrared reflectance spectroscopy

USDA-ARS?s Scientific Manuscript database

Currently, three types of instrumentals have been developed to assess the trash content in lint cotton fibers, namely, Shirley analyzer (SA), advanced fiber information system (AFIS), and high volume instrumentation (HVI). Each of these devices has its unique advantages, and comprehensive comparison...

Neurologic examination and instrument-based measurements in the evaluation of ulnar neuropathy at the elbow.

PubMed

Omejec, Gregor; Podnar, Simon

2018-06-01

The aim of the study was to compare the utility of instrument-based assessment of peripheral nerve function with the neurologic examination in ulnar neuropathy at the elbow (UNE). We prospectively recruited consecutive patients with suspected UNE, performed a neurologic examination, and performed instrument-based measurements (muscle cross-sectional area by ultrasonography, muscle strength by dynamometry, and sensation using monofilaments). We found good correlations between clinical estimates and corresponding instrument-based measurements, with similar ability to diagnose UNE and predict UNE pathophysiology. Although instrument-based methods provide quantitative evaluation of peripheral nerve function, we did not find them to be more sensitive or specific in the diagnosis of UNE than the standard neurologic examination. Likewise, instrument-based methods were not better able to differentiate between groups of UNE patients with different pathophysiologies. Muscle Nerve 57: 951-957, 2018. © 2017 Wiley Periodicals, Inc.

Q-SEA – a tool for quality assessment of ethics analyses conducted as part of health technology assessments

PubMed Central

Scott, Anna Mae; Hofmann, Björn; Gutiérrez-Ibarluzea, Iñaki; Bakke Lysdahl, Kristin; Sandman, Lars; Bombard, Yvonne

2017-01-01

Introduction: Assessment of ethics issues is an important part of health technology assessments (HTA). However, in terms of existence of quality assessment tools, ethics for HTA is methodologically underdeveloped in comparison to other areas of HTA, such as clinical or cost effectiveness. Objective: To methodologically advance ethics for HTA by: (1) proposing and elaborating Q-SEA, the first instrument for quality assessment of ethics analyses, and (2) applying Q-SEA to a sample systematic review of ethics for HTA, in order to illustrate and facilitate its use. Methods: To develop a list of items for the Q-SEA instrument, we systematically reviewed the literature on methodology in ethics for HTA, reviewed HTA organizations’ websites, and solicited views from 32 experts in the field of ethics for HTA at two 2-day workshops. We subsequently refined Q-SEA through its application to an ethics analysis conducted for HTA. Results: Q-SEA instrument consists of two domains – the process domain and the output domain. The process domain consists of 5 elements: research question, literature search, inclusion/exclusion criteria, perspective, and ethics framework. The output domain consists of 5 elements: completeness, bias, implications, conceptual clarification, and conflicting values. Conclusion: Q-SEA is the first instrument for quality assessment of ethics analyses in HTA. Further refinements to the instrument to enhance its usability continue. PMID:28326147

Development of a Standardized Kalamazoo Communication Skills Assessment Tool for Radiologists: Validation, Multisource Reliability, and Lessons Learned.

PubMed

Brown, Stephen D; Rider, Elizabeth A; Jamieson, Katherine; Meyer, Elaine C; Callahan, Michael J; DeBenedectis, Carolynn M; Bixby, Sarah D; Walters, Michele; Forman, Sara F; Varrin, Pamela H; Forbes, Peter; Roussin, Christopher J

2017-08-01

The purpose of this study was to develop and test a standardized communication skills assessment instrument for radiology. The Delphi method was used to validate the Kalamazoo Communication Skills Assessment instrument for radiology by revising and achieving consensus on the 43 items of the preexisting instrument among an interdisciplinary team of experts consisting of five radiologists and four nonradiologists (two men, seven women). Reviewers assessed the applicability of the instrument to evaluation of conversations between radiology trainees and trained actors portraying concerned parents in enactments about bad news, radiation risks, and diagnostic errors that were video recorded during a communication workshop. Interrater reliability was assessed by use of the revised instrument to rate a series of enactments between trainees and actors video recorded in a hospital-based simulator center. Eight raters evaluated each of seven different video-recorded interactions between physicians and parent-actors. The final instrument contained 43 items. After three review rounds, 42 of 43 (98%) items had an average rating of relevant or very relevant for bad news conversations. All items were rated as relevant or very relevant for conversations about error disclosure and radiation risk. Reliability and rater agreement measures were moderate. The intraclass correlation coefficient range was 0.07-0.58; mean, 0.30; SD, 0.13; and median, 0.30. The range of weighted kappa values was 0.03-0.47; mean, 0.23; SD, 0.12; and median, 0.22. Ratings varied significantly among conversations (χ 2 6 = 1186; p < 0.0001) and varied significantly by viewing order, rater type, and rater sex. The adapted communication skills assessment instrument is highly relevant for radiology, having moderate interrater reliability. These findings have important implications for assessing the relational competencies of radiology trainees.

Characteristic and Competency Measurement Instrument Development for Maintenance Staff of Mechanical Expertise with SECI Method: A Case of Manufacturing Company

NASA Astrophysics Data System (ADS)

Mahatmavidya, P. A.; Soesanto, R. P.; Kurniawati, A.; Andrawina, L.

2018-03-01

Human resource is an important factor for a company to gain competitiveness, therefore competencies of each individual in a company is a basic characteristic that is taken into account. The increasing employee’s competency will affect directly to the company's performance. The purpose of this research is to improve the quality of human resources of maintenance staff in manufacturing company by designing competency measurement instrument that aims to assess the competency of employees. The focus of this research is the mechanical expertise of maintenance staff. SECI method is used in this research for managing knowledge that is held by senior employees regarding employee competence of mechanical expertise. The SECI method converts the knowledge of a person's tacit knowledge into an explicit knowledge so that the knowledge can be used by others. The knowledge that is gathered from SECI method is converted into a list of competence and break down into the detailed competency. Based on the results of this research, it is known that 11 general competencies, 17 distinctive competencies, 20 indicators, and 20 item list for assessing the competencies are developed. From the result of competency breakdown, the five-level instrument of measurement is designed which can assist in assessing employee’s competency for mechanical expertise.

Optical aberrations measurement with a low cost optometric instrument

NASA Astrophysics Data System (ADS)

Furlan, Walter D.; Muñoz-Escrivá, L.; Pons, A.; Martínez-Corral, M.

2002-08-01

A simple experimental method for measuring optical aberrations of a single lens is proposed. The technique is based on the use of an optometric instrument employed for the assessment of the refractive state of the eye: the retinoscope. Experimental results for spherical aberration and astigmatism are obtained.

[Measurement of shoulder disability in the athlete: a systematic review].

PubMed

Fayad, F; Mace, Y; Lefevre-Colau, M M; Poiraudeau, S; Rannou, F; Revel, M

2004-08-01

To identify all available shoulder disability questionnaires and to examine those that could be used for athlete. We systematically reviewed the literature in Medline using the keywords shoulder, function, scale, index, score, questionnaire, disability, quality of life, assessment, and evaluation. We searched for scales used for athletes with the keywords scale name AND (sport OR athlete). Data were completed by using the "Guide des Outils de Mesure et d'Evaluation en Médecine Physique et de Réadaptation" textbook. Analysis took into account the clinimetric quality of the instruments and the number of items specifically related to sports. A total of 37 instruments have been developed to measure disease-, shoulder-specific or upper extremity specific outcome. Older instruments were developed before the advent of modern measurement methods. They usually combined objective and subjective measures. Recent instruments were designed with use of more advanced methods. Most are self-administered questionnaires. Fourteen scales included items assessing sport activity. Four of these scales have been used to assess shoulder disability in athlete. Six scales have been used to assess such disability but do not have specific items related to sports. There is no gold standard for assessing shoulder outcome in the general population and no validated outcome instruments specifically for athletes. We suggest the use of ASES, WOSI and WORC scales for evaluating shoulder function in the recreational athletes. The DASH scale should be evaluated in this population. The principal criterion in evaluating shoulder function in the high level athlete is a return to the same level of sport performance. Further studies are required to identify measurement tools for shoulder disability that have a high predictive value for return to sport.

[Development of methods and instruments for external quality assurance in inpatient parent-child rehabilitation and prevention].

PubMed

Neuderth, S; Lukasczik, M; Musekamp, G; Gerlich, C; Saupe-Heide, M; Löbmann, R; Vogel, H

2013-02-01

There so far is no standardized program for external quality assurance in inpatient parent-child prevention and rehabilitation in Germany. Therefore, instruments and methods of external quality assurance were developed and evaluated on behalf of the federal-level health insurance institutions. On the level of structure quality, a modular questionnaire for assessing structural features of rehabilitation/prevention centers, basic and allocation criteria as well as a checklist for visitations were developed. Structural data were collected in a nationwide survey of parent-child prevention and rehabilitation centers. Process and outcome quality data were collected in n=38 centers. Process quality was assessed using multiple methods (process-related structural features, case-related routine documentation, and incident-related patient questionnaires). Outcome quality was measured via patient questionnaires (n=1 799 patients). We used a multi-level modelling approach by adjusting relevant confounders on institutional and patient levels. The methods, instruments and analyzing procedures developed for measuring quality on the level of structure, processes and outcomes were adjusted in cooperation with all relevant stakeholders. Results are exemplarily presented for all quality assurance tools. For most of the risk-adjusted outcome parameters, we found no significant differences between institutions. For the first time, a comprehensive, standardized and generally applicable set of methods and instruments for routine use in comparative quality measurement of inpatient parent-child prevention and rehabilitation is available. However, it should be considered that the very heterogeneous field of family-oriented measures can not be covered entirely by an external quality assurance program. Therefore, methods and instruments have to be adapted continuously to the specifics of this area of health care and to new developments. © Georg Thieme Verlag KG Stuttgart · New York.

Application of the Langley plot method to the calibration of the solar backscattered ultraviolet instrument on the Nimbus 7 satellite

NASA Technical Reports Server (NTRS)

Bhartia, P. K.; Taylor, S.; Mcpeters, R. D.; Wellemeyer, C.

1995-01-01

The concept of the well-known Langley plot technique, used for the calibration of ground-based instruments, has been generalized for application to satellite instruments. In polar regions, near summer solstice, the solar backscattered ultraviolet (SBUV) instrument on the Nimbus 7 satellite samples the same ozone field at widely different solar zenith angles. These measurements are compared to assess the long-term drift in the instrument calibration. Although the technique provides only a relative wavelength-to-wavelength calibration, it can be combined with existing techniques to determine the drift of the instrument at any wavelength. Using this technique, we have generated a 12-year data set of ozone vertical profiles from SBUV with an estimated accuracy of +/- 5% at 1 mbar and +/- 2% at 10 mbar (95% confidence) over 12 years. Since the method is insensitive to true changes in the atmospheric ozone profile, it can also be used to compare the calibrations of similar SBUV instruments launched without temporal overlap.

What do Demand-Control and Effort-Reward work stress questionnaires really measure? A discriminant content validity study of relevance and representativeness of measures.

PubMed

Bell, Cheryl; Johnston, Derek; Allan, Julia; Pollard, Beth; Johnston, Marie

2017-05-01

The Demand-Control (DC) and Effort-Reward Imbalance (ERI) models predict health in a work context. Self-report measures of the four key constructs (demand, control, effort, and reward) have been developed and it is important that these measures have good content validity uncontaminated by content from other constructs. We assessed relevance (whether items reflect the constructs) and representativeness (whether all aspects of the construct are assessed, and all items contribute to that assessment) across the instruments and items. Two studies examined fourteen demand/control items from the Job Content Questionnaire and seventeen effort/reward items from the Effort-Reward Imbalance measure using discriminant content validation and a third study developed new methods to assess instrument representativeness. Both methods use judges' ratings and construct definitions to get transparent quantitative estimates of construct validity. Study 1 used dictionary definitions while studies 2 and 3 used published phrases to define constructs. Overall, 3/5 demand items, 4/9 control items, 1/6 effort items, and 7/11 reward items were uniquely classified to the appropriate theoretical construct and were therefore 'pure' items with discriminant content validity (DCV). All pure items measured a defining phrase. However, both the DC and ERI assessment instruments failed to assess all defining aspects. Finding good discriminant content validity for demand and reward measures means these measures are usable and our quantitative results can guide item selection. By contrast, effort and control measures had limitations (in relevance and representativeness) presenting a challenge to the implementation of the theories. Statement of contribution What is already known on this subject? While the reliability and construct validity of Demand-Control and Effort-Reward-Imbalance (DC and ERI) work stress measures are routinely reported, there has not been adequate investigation of their content validity. This paper investigates their content validity in terms of both relevance and representativeness and provides a model for the investigation of content validity of measures in health psychology more generally. What does this study add? A new application of an existing method, discriminant content validity, and a new method of assessing instrument representativeness. 'Pure' DC and ERI items are identified, as are constructs that are not fully represented by their assessment instruments. The findings are important for studies attempting to distinguish between the main DC and ERI work stress constructs. The quantitative results can be used to guide item selection for future studies. © 2017 The British Psychological Society.

Usefulness of Self-Report Instruments in Assessing Men Accused of Domestic Violence

ERIC Educational Resources Information Center

Helfritz, Laura E.; Stanford, Matthew S.; Conklin, Sarah M.; Greve, Kevin W.; Villemarette-Pittman, Nicole R.; Houston, Rebecca J.

2006-01-01

Clinical assessment of domestic violence has traditionally relied on self-report methods of data collection, using structured interviews and lengthy questionnaires such as the MMPI-2. However, in certain situations such as court-ordered domestic violence evaluations, information obtained through self-report methods may be tainted because of…

Development and Psychometric Evaluation of an Instrument to Assess Cross-Cultural Competence of Healthcare Professionals (CCCHP)

PubMed Central

Bernhard, Gerda; Knibbe, Ronald A.; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike

2015-01-01

Background Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs’ cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. Methods The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Results Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs’ cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension’s Cronbach’s α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. Conclusions The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs’ cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs’ cultural competence, and has the ability to distinguish between groups that are expected to differ in cultural competence. This instrument can foster professional development through systematic self-assessment and thus contributes to improve the quality of patient care. PMID:26641876

The SAVRY Improves Prediction of Reoffending: A Naturalistic Longitudinal Comparative Study

ERIC Educational Resources Information Center

Åström, Therese; Gumpert, Clara Hellner; Andershed, Anna-Karin; Forster, Martin

2017-01-01

Purpose: This study investigated the utility of the risk assessment "Structured Assessment of Violence Risk in Youth" (SAVRY) within the social services in Stockholm County, Sweden. Method: SAVRY assessments of 56 adolescents were compared to assessments guided by another instrument (Adolescent Drug Abuse Diagnosis [ADAD]; n = 38) and…

Evaluation of Current Assessment Methods in Engineering Entrepreneurship Education

ERIC Educational Resources Information Center

Purzer, Senay; Fila, Nicholas; Nataraja, Kavin

2016-01-01

Quality assessment is an essential component of education that allows educators to support student learning and improve educational programs. The purpose of this study is to evaluate the current state of assessment in engineering entrepreneurship education. We identified 52 assessment instruments covered in 29 journal articles and conference…

Characterization and measurement of natural gas trace constituents. Volume 1. Arsenic. Final report, June 1989-October 1993

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chao, S.S.; Attari, A.

1995-01-01

The discovery of arsenic compounds, as alkylarsines, in natural gas prompted this research program to develop reliable measurement techniques needed to assess the efficiency of removal processes for these environmentally sensitive substances. These techniques include sampling, speciation, quantitation and on-line instrumental methods for monitoring the total arsenic concentration. The current program has yielded many products, including calibration standards, arsenic-specific sorbents, sensitive analytical methods and instrumentation. Four laboratory analytical methods have been developed and successfully employed for arsenic determination in natural gas. These methods use GC-AED and GC-MS instruments to speciate alkylarsines, and peroxydisulfate extraction with FIAS, special carbon sorbent withmore » XRF and an IGT developed sorbent with GFAA for total arsenic measurement.« less

Assessment of the elderly's functional ability to manage their medication: a systematic literature review.

PubMed

Advinha, Ana Margarida; Lopes, Manuel José; de Oliveira-Martins, Sofia

2017-02-01

Background The evaluation of the elderly's ability to manage medication through the use of a validated tool can be a significant step in identifying inabilities and needs, with the objective of increasing their self-care skills, and promoting successful aging. Aim of the review To identify studies assessing the elderly's functional ability to manage their own medication. Method For the search strategy, the PICO method was used: P-Population (elderly), I-Instruments (tools for assessing medication management ability), C-Context (community) and O-Outcomes (functional ability to manage medication). The final search query was run in MEDLINE/PubMed, CINAHL Plus, ISI Web of Science and Scopus. The whole process was developed according to the PRISMA statement. Results The search retrieved 8051 records. In each screening stage, the selection criteria were applied to eliminate records where at least one of the exclusion criteria was verified. At the end of this selection, we obtained a total of 18 papers (17 studies). The results allow the conclusion to be drawn that studies use several different instruments, most of them not validated. The authors agree that medication management abilities decrease as cognitive impairment increases, even if a lot of studies assess only the physical dimension. DRUGS was the instrument most often used. Conclusion Older adults' ability to manage their medication should be assessed using tools specifically built and validate for the purpose. DRUGS (which uses the real regimen taken by the elderly) was the most widely used assessment instrument in the screened studies.

A Methodological Review of the Assessment of Humanism in Medical Students.

PubMed

Buck, Era; Holden, Mark; Szauter, Karen

2015-11-01

Humanism is a complex construct that defies simplistic measurement. How educators measure humanism shapes understanding and implications for learners. This systematic review sought to address the following questions: How do medical educators assess humanism in medical students, and how does the measurement impact the understanding of humanism in undergraduate medical education (UME)? Using the IECARES (integrity, excellence, compassion, altruism, respect, empathy, and service) Gold Foundation framework, a search of English literature databases from 2000 to 2013 on assessment of humanism in medical students revealed more than 900 articles, of which 155 met criteria for analysis. Using descriptive statistics, articles and assessments were analyzed for construct measured, study design, assessment method, instrument type, perspective/source of assessment, student level, validity evidence, and national context. Of 202 assessments reported in 155 articles, 162 (80%) used surveys; 164 (81%) used student self-reports. One hundred nine articles (70%) included only one humanism construct. Empathy was the most prevalent construct present in 96 (62%); 49 (51%) of those used a single instrument. One hundred fifteen (74%) used exclusively quantitative data; only 48 (31%) used a longitudinal design. Construct underrepresentation was identified as a threat to validity in half of the assessments. Articles included 34 countries; 87 (56%) were from North America. Assessment of humanism in UME incorporates a limited scope of a complex construct, often relying on single quantitative measures from self-reported survey instruments. This highlights the need for multiple methods, perspectives, and longitudinal designs to strengthen the validity of humanism assessments.

Instruments for Assessing Risk of Bias and Other Methodological Criteria of Published Animal Studies: A Systematic Review

PubMed Central

Krauth, David; Woodruff, Tracey J.

2013-01-01

Background: Results from animal toxicology studies are critical to evaluating the potential harm from exposure to environmental chemicals or the safety of drugs prior to human testing. However, there is significant debate about how to evaluate the methodology and potential biases of the animal studies. There is no agreed-upon approach, and a systematic evaluation of current best practices is lacking. Objective: We performed a systematic review to identify and evaluate instruments for assessing the risk of bias and/or other methodological criteria of animal studies. Method: We searched Medline (January 1966–November 2011) to identify all relevant articles. We extracted data on risk of bias criteria (e.g., randomization, blinding, allocation concealment) and other study design features included in each assessment instrument. Discussion: Thirty distinct instruments were identified, with the total number of assessed risk of bias, methodological, and/or reporting criteria ranging from 2 to 25. The most common criteria assessed were randomization (25/30, 83%), investigator blinding (23/30, 77%), and sample size calculation (18/30, 60%). In general, authors failed to empirically justify why these or other criteria were included. Nearly all (28/30, 93%) of the instruments have not been rigorously tested for validity or reliability. Conclusion: Our review highlights a number of risk of bias assessment criteria that have been empirically tested for animal research, including randomization, concealment of allocation, blinding, and accounting for all animals. In addition, there is a need for empirically testing additional methodological criteria and assessing the validity and reliability of a standard risk of bias assessment instrument. Citation: Krauth D, Woodruff TJ, Bero L. 2013. Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review. Environ Health Perspect 121:985–992 (2013); http://dx.doi.org/10.1289/ehp.1206389 PMID:23771496

[Instruments for quantitative methods of nursing research].

PubMed

Vellone, E

2000-01-01

Instruments for quantitative nursing research are a mean to objectify and measure a variable or a phenomenon in the scientific research. There are direct instruments to measure concrete variables and indirect instruments to measure abstract concepts (Burns, Grove, 1997). Indirect instruments measure the attributes by which a concept is made of. Furthermore, there are instruments for physiologic variables (e.g. for the weight), observational instruments (Check-lists e Rating Scales), interviews, questionnaires, diaries and the scales (Check-lists, Rating Scales, Likert Scales, Semantic Differential Scales e Visual Anologue Scales). The choice to select an instrument or another one depends on the research question and design. Instruments research are very useful in research both to describe the variables and to see statistical significant relationships. Very carefully should be their use in the clinical practice for diagnostic assessment.

Fitness to plead: Development and validation of a standardised assessment instrument

PubMed Central

Stahl, Daniel; Appiah-Kusi, Elizabeth; Brewer, Rebecca; Watts, Michael; Peay, Jill; Blackwood, Nigel

2018-01-01

The ability of an individual to participate in courtroom proceedings is assessed by clinicians using legal ‘fitness to plead’ criteria. Findings of ‘unfitness’ are so rare that there is considerable professional unease concerning the utility of the current subjective assessment process. As a result, mentally disordered defendants may be subjected unfairly to criminal trials. The Law Commission in England and Wales has proposed legal reform, as well as the utilisation of a defined psychiatric instrument to assist in fitness to plead assessments. Similar legal reforms are occurring in other jurisdictions. Our objective was to produce and validate a standardised assessment instrument of fitness to plead employing a filmed vignette of criminal proceedings. The instrument was developed in consultation with legal and clinical professionals, and was refined using standard item reduction methods in two initial rounds of testing (n = 212). The factorial structure, test-retest reliability and convergent validity of the resultant instrument were assessed in a further round (n = 160). As a result of this iterative process a 25-item scale was produced, with an underlying two-factor structure representing the foundational and decision-making abilities underpinning fitness to plead. The sub-scales demonstrate good internal consistency (factor 1: 0·76; factor 2: 0·65) and test-retest stability (0·7) as well as excellent convergent validity with scores of intelligence, executive function and mentalising abilities (p≤0·01 in all domains). Overall the standardised Fitness to Plead Assessment instrument has good psychometric properties. It has the potential to ensure that the significant numbers of mentally ill and cognitively impaired individuals who face trial are objectively assessed, and the courtroom process critically informed. PMID:29698396

Method of assessing a lipid-related health risk based on ion mobility analysis of lipoproteins

DOEpatents

Benner, W. Henry; Krauss, Ronald M.; Blanche, Patricia J.

2010-12-14

A medical diagnostic method and instrumentation system for analyzing noncovalently bonded agglomerated biological particles is described. The method and system comprises: a method of preparation for the biological particles; an electrospray generator; an alpha particle radiation source; a differential mobility analyzer; a particle counter; and data acquisition and analysis means. The medical device is useful for the assessment of human diseases, such as cardiac disease risk and hyperlipidemia, by rapid quantitative analysis of lipoprotein fraction densities. Initially, purification procedures are described to reduce an initial blood sample to an analytical input to the instrument. The measured sizes from the analytical sample are correlated with densities, resulting in a spectrum of lipoprotein densities. The lipoprotein density distribution can then be used to characterize cardiac and other lipid-related health risks.

Development of instrument for assessing students’ critical and creative thinking ability

NASA Astrophysics Data System (ADS)

Herpiana, R.; Rosidin, U.

2018-01-01

The purpose of this study was to develop instruments to measure critical thinking ability and creative students in the topics of physics simple harmonic motion. The research method used was research development with application of procedures including research and data collection, planning, and initial product development. The participants of the study were thirty-four tenth grade students and five physics teachers of physics who were selected randomly from schools in the province of Lampung. The data collected by using test and analyzed in quantitative descriptive. Initial data showed that students’ critical and creative thinking ability were still low and instruments to assess students’ critical thinking skills and creative students was not yet available. Most of assessment conducted focused on memorization. Thus, the researchers developed a draft of instrument in the form of the test description based on criteria that encouraged students’ activity in understanding the concepts, strategies and decision/solution in dealing with problems. The development of the instrument was conducted considering real-world phenomena in the form of pictures and stories, description of the situation, and verbal presentation.

The Place of Nailfold Capillaroscopy Among Instrumental Methods for Assessment of Some Peripheral Ischaemic Syndromes in Rheumatology.

PubMed

Lambova, Sevdalina N

2016-01-01

Micro- and macrovascular pathology is a frequent finding in a number of common rheumatic diseases. Secondary Raynaud's phenomenon (RP) is among the most common symptoms in systemic sclerosis and several other systemic autoimmune diseases including a broad differential diagnosis. It should be also differential from other peripheral vascular syndromes such as embolism, thrombosis, etc., some of which lead to clinical manifestation of the blue toe syndrome. The current review discusses the instrumental methods for vascular assessments. Nailfold capillaroscopy is the only method among the imaging techniques that can be used for morphological assessment of the nutritive capillaries in the nailfold area. Laser-Doppler flowmetry and laser-Doppler imaging are methods for functional assessment of microcirculation, while thermography and plethysmography reflect both blood flow in peripheral arteries and microcirculation. Doppler ultrasound and angiography visualize peripheral arteries. The choice of the appropriate instrumental method is guided by the clinical presentation. The main role of capillaroscopy is to provide differential diagnosis between primary and secondary RP. In rheumatology, capillaroscopic changes in systemic sclerosis have been recently defined as diagnostic. The appearance of abnormal capillaroscopic pattern inherits high positive predictive value for the development of a connective tissue disease that is higher than the predictive value of antinuclear antibodies. In cases of abrupt onset of peripheral ischaemia, clinical signs of critical ischaemia, unilateral or lower limb involvement, Doppler ultrasound and angiography are indicated. The most common causes for such clinical picture that may be referred to rheumatologic consultation are the antiphospholipid syndrome, mimickers of vasculitides such as atherosclerosis with cholesterol emboli, and neoplasms.

Measuring organizational and individual factors thought to influence the success of quality improvement in primary care: a systematic review of instruments

PubMed Central

2012-01-01

Background Continuous quality improvement (CQI) methods are widely used in healthcare; however, the effectiveness of the methods is variable, and evidence about the extent to which contextual and other factors modify effects is limited. Investigating the relationship between these factors and CQI outcomes poses challenges for those evaluating CQI, among the most complex of which relate to the measurement of modifying factors. We aimed to provide guidance to support the selection of measurement instruments by systematically collating, categorising, and reviewing quantitative self-report instruments. Methods Data sources: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments, reference lists of systematic reviews, and citations and references of the main report of instruments. Study selection: The scope of the review was determined by a conceptual framework developed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). Papers reporting development or use of an instrument measuring a construct encompassed by the framework were included. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarising and comparing instruments. Instrument content was categorised using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care. Results We identified 186 potentially relevant instruments, 152 of which were analysed to develop the taxonomy. Eighty-four instruments measured constructs relevant to primary care, with content measuring CQI implementation and use (19 instruments), organizational context (51 instruments), and individual factors (21 instruments). Forty-one instruments were included for full review. Development methods were often pragmatic, rather than systematic and theory-based, and evidence supporting measurement properties was limited. Conclusions Many instruments are available for evaluating CQI, but most require further use and testing to establish their measurement properties. Further development and use of these measures in evaluations should increase the contribution made by individual studies to our understanding of CQI and enhance our ability to synthesise evidence for informing policy and practice. PMID:23241168

Analysis of small-angle X-ray scattering data in the presence of significant instrumental smearing

PubMed Central

Bergenholtz, Johan; Ulama, Jeanette; Zackrisson Oskolkova, Malin

2016-01-01

A laboratory-scale small-angle X-ray scattering instrument with pinhole collimation has been used to assess smearing effects due to instrumental resolution. A new, numerically efficient method to smear ideal model intensities is developed and presented. It allows for directly using measured profiles of isotropic but otherwise arbitrary beams in smearing calculations. Samples of low-polydispersity polymer spheres have been used to show that scattering data can in this way be quantitatively modeled even when there is substantial distortion due to instrumental resolution. PMID:26937235

Analysis of cigarette purchase task instrument data with a left-censored mixed effects model.

PubMed

Liao, Wenjie; Luo, Xianghua; Le, Chap T; Chu, Haitao; Epstein, Leonard H; Yu, Jihnhee; Ahluwalia, Jasjit S; Thomas, Janet L

2013-04-01

The drug purchase task is a frequently used instrument for measuring the relative reinforcing efficacy (RRE) of a substance, a central concept in psychopharmacological research. Although a purchase task instrument, such as the cigarette purchase task (CPT), provides a comprehensive and inexpensive way to assess various aspects of a drug's RRE, the application of conventional statistical methods to data generated from such an instrument may not be adequate by simply ignoring or replacing the extra zeros or missing values in the data with arbitrary small consumption values, for example, 0.001. We applied the left-censored mixed effects model to CPT data from a smoking cessation study of college students and demonstrated its superiority over the existing methods with simulation studies. Theoretical implications of the findings, limitations of the proposed method, and future directions of research are also discussed.

Analysis of Cigarette Purchase Task Instrument Data with a Left-Censored Mixed Effects Model

PubMed Central

Liao, Wenjie; Luo, Xianghua; Le, Chap; Chu, Haitao; Epstein, Leonard H.; Yu, Jihnhee; Ahluwalia, Jasjit S.; Thomas, Janet L.

2015-01-01

The drug purchase task is a frequently used instrument for measuring the relative reinforcing efficacy (RRE) of a substance, a central concept in psychopharmacological research. While a purchase task instrument, such as the cigarette purchase task (CPT), provides a comprehensive and inexpensive way to assess various aspects of a drug’s RRE, the application of conventional statistical methods to data generated from such an instrument may not be adequate by simply ignoring or replacing the extra zeros or missing values in the data with arbitrary small consumption values, e.g. 0.001. We applied the left-censored mixed effects model to CPT data from a smoking cessation study of college students and demonstrated its superiority over the existing methods with simulation studies. Theoretical implications of the findings, limitations of the proposed method and future directions of research are also discussed. PMID:23356731

Doctor performance assessment in daily practise: does it help doctors or not? A systematic review.

PubMed

Overeem, Karlijn; Faber, Marjan J; Arah, Onyebuchi A; Elwyn, Glyn; Lombarts, Kiki M J M H; Wollersheim, Hub C; Grol, Richard P T M

2007-11-01

Continuous assessment of individual performance of doctors is crucial for life-long learning and quality of care. Policy-makers and health educators should have good insights into the strengths and weaknesses of the methods available. The aim of this study was to systematically evaluate the feasibility of methods, the psychometric properties of instruments that are especially important for summative assessments, and the effectiveness of methods serving formative assessments used in routine practise to assess the performance of individual doctors. We searched the MEDLINE (1966-January 2006), PsychINFO (1972-January 2006), CINAHL (1982-January 2006), EMBASE (1980-January 2006) and Cochrane (1966-2006) databases for English language articles, and supplemented this with a hand-search of reference lists of relevant studies and bibliographies of review articles. Studies that aimed to assess the performance of individual doctors in routine practise were included. Two reviewers independently abstracted data regarding study design, setting and findings related to reliability, validity, feasibility and effectiveness using a standard data abstraction form. A total of 64 articles met our inclusion criteria. We observed 6 different methods of evaluating performance: simulated patients; video observation; direct observation; peer assessment; audit of medical records, and portfolio or appraisal. Peer assessment is the most feasible method in terms of costs and time. Little psychometric assessment of the instruments has been undertaken so far. Effectiveness of formative assessments is poorly studied. All systems but 2 rely on a single method to assess performance. There is substantial potential to assess performance of doctors in routine practise. The longterm impact and effectiveness of formative performance assessments on education and quality of care remains hardly known. Future research designs need to pay special attention to unmasking effectiveness in terms of performance improvement.

Assessment of Customer Service in Academic Health Care Libraries (ACSAHL): an instrument for measuring customer service*†

PubMed Central

Crossno, Jon E.; Berkins, Brenda; Gotcher, Nancy; Hill, Judith L.; McConoughey, Michelle; Walters, Mitchel

2001-01-01

Objectives: In a pilot study, the library had good results using SERVQUAL, a respected and often-used instrument for measuring customer satisfaction. The SERVQUAL instrument itself, however, received some serious and well-founded criticism from the respondents to our survey. The purpose of this study was to test the comparability of the results of SERVQUAL with a revised and shortened instrument modeled on SERVQUAL. The revised instrument, the Assessment of Customer Service in Academic Health Care Libraries (ACSAHL), was designed to better assess customer service in academic health care libraries. Methods: Surveys were sent to clients who had used the document delivery services at three academic medical libraries in Texas over the previous twelve to eighteen months. ACSAHL surveys were sent exclusively to clients at University of Texas (UT) Southwestern, while the client pools at the two other institutions were randomly divided and provided either SERVQUAL or ACSAHL surveys. Results: Results indicated that more respondents preferred the shorter ACSAHL instrument to the longer and more complex SERVQUAL instrument. Also, comparing the scores from both surveys indicated that ACSAHL elicited comparable results. Conclusions: ACSAHL appears to measure the same type of data in similar settings, but additional testing is recommended both to confirm the survey's results through data replication and to investigate whether the instrument applies to different service areas. PMID:11337948

Construction of the descriptive system for the assessment of quality of life AQoL-6D utility instrument

PubMed Central

2012-01-01

Background Multi attribute utility (MAU) instruments are used to include the health related quality of life (HRQoL) in economic evaluations of health programs. Comparative studies suggest different MAU instruments measure related but different constructs. The objective of this paper is to describe the methods employed to achieve content validity in the descriptive system of the Assessment of Quality of Life (AQoL)-6D, MAU instrument. Methods The AQoL program introduced the use of psychometric methods in the construction of health related MAU instruments. To develop the AQoL-6D we selected 112 items from previous research, focus groups and expert judgment and administered them to 316 members of the public and 302 hospital patients. The search for content validity across a broad spectrum of health states required both formative and reflective modelling. We employed Exploratory Factor Analysis and Structural Equation Modelling (SEM) to meet these dual requirements. Results and Discussion The resulting instrument employs 20 items in a multi-tier descriptive system. Latent dimension variables achieve sensitive descriptions of 6 dimensions which, in turn, combine to form a single latent QoL variable. Diagnostic statistics from the SEM analysis are exceptionally good and confirm the hypothesised structure of the model. Conclusions The AQoL-6D descriptive system has good psychometric properties. They imply that the instrument has achieved construct validity and provides a sensitive description of HRQoL. This means that it may be used with confidence for measuring health related quality of life and that it is a suitable basis for modelling utilities for inclusion in the economic evaluation of health programs. PMID:22507254

[Disabled person's satisfaction with health and social care--an internationally developed instrument].

PubMed

Kullmann, Lajos; Paulik, Edit

2011-02-01

Quality of health and social care is being assessed by largely different methods. Obtaining comparable and valuable data is difficult. Thus, internationally developed instruments have special value. A set of instruments has been developed simultaneously using World Health Organization's instrument development method. One of these is the instrument "Quality of Care and Support for People with Disabilities". Response scales contain five options for physically and three for intellectually disabled persons. Psychometric analysis of the Hungarian instrument version was based on interviews with 151 physically and 166 intellectually disabled persons. Answering rate was high, above 95% with the exception of one item. Internal consistency of the two instrument versions by Cronbach's alpha is 0.845 and 0.745 respectively. Lowest satisfaction was found in the domain "information" in both groups that correlates significantly with health conditions at p < 0.01 and p < 0.05 level respectively. The field trial confirms validity and reliability of the instrument. Its wider use may help the evaluation of satisfaction concerning different components of quality of care, consequently better tailoring of services to needs.

75 FR 30077 - Advisory Committee On Reactor Safeguards (ACRS); Meeting of the ACRS Subcommittee On Digital I&C...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-28

... Subcommittee On Digital I&C Systems The ACRS Subcommittee on Digital Instrumentation and Control (DI&C) Systems... the area of Digital Instrumentation and Control (DI&C) Probabilistic Risk Assessment (PRA). Topics... software reliability methods (QSRMs), NUREG/CR--6997, ``Modeling a Digital Feedwater Control System Using...

An Instrument to Assess the Obesogenic Environment of Child Care Centers

ERIC Educational Resources Information Center

Ward, Dianne; Hales, Derek; Haverly, Katie; Marks, Julie; Benjamin, Sara; Ball, Sarah; Trost, Stewart

2008-01-01

Objectives: To describe protocol and interobserver agreements of an instrument to evaluate nutrition and physical activity environments at child care. Methods: Interobserver data were collected from 9 child care centers, through direct observation and document review (17 observer pairs). Results: Mean agreement between observer pairs was 87.26%…

Sociodemographic Characteristics of Turkish Parents in Relation to Their Recognition of Emotional Maltreatment

ERIC Educational Resources Information Center

Uslu, Runa Idil; Kapci, Emine Gul; Yildirim, Revan; Oney, Esra

2010-01-01

Objectives: To develop an instrument which could assess the extent to which emotionally maltreating parental behavior was recognized by Turkish parents (Study 1) and to evaluate a group of parental and family characteristics that were related with their recognition of emotional maltreatment (Study 2). Methods: Self-administered instruments were…

Convergent and Divergent Validity of the Grammaticality and Utterance Length Instrument

ERIC Educational Resources Information Center

Castilla-Earls, Anny; Fulcher-Rood, Katrina

2018-01-01

Purpose: This feasibility study examines the convergent and divergent validity of the Grammaticality and Utterance Length Instrument (GLi), a tool designed to assess the grammaticality and average utterance length of a child's prerecorded story retell. Method: Three raters used the GLi to rate audio-recorded story retells from 100 English-speaking…

Use of a formal assessment instrument for evaluation of veterinary student surgical skills.

PubMed

Schnabel, Lauren V; Maza, Paul S; Williams, Kimberly M; Irby, Nita L; McDaniel, Carolyn M; Collins, Brian G

2013-05-01

To (1) evaluate the design and use of a global rating scale assessment instrument in veterinary medical education and; (2) examine the effectiveness of 2 surgical techniques courses for improving the surgical skills of veterinary students. Instrument development; observational; survey-based. Students (n = 16) registered for 2 elective surgical techniques courses were enrolled on a volunteer basis. A 5-point global rating scale instrument was designed for the evaluation of 12 basic surgical skills by faculty evaluators and used to obtain student start and end scores during the courses. Upon conclusion of the courses, students completed a survey from which their opinions on their improvement as well as their desire for feedback were obtained. All authors agreed the instrument was easy to use. As groups, 3rd year students, 4th year students, and all students combined had significantly higher total skill scores at the end of the courses compared to the start of the courses. Individually, 10 students (63%) had significant improvement in surgical skills as a result of their participation in the courses: 4 (100%) 3rd year and 6 (50%) 4th year students. Student survey responses revealed a strong desire for feedback as well as support of formal assessment methods. Only weak agreement was found between student opinions on their improvement and the authors' assessment scores. Assessment instruments are useful for (1) student evaluation and (2) for providing students with feedback on their surgical skills. © Copyright 2013 by The American College of Veterinary Surgeons.

Health literacy screening instruments for eHealth applications: a systematic review.

PubMed

Collins, Sarah A; Currie, Leanne M; Bakken, Suzanne; Vawdrey, David K; Stone, Patricia W

2012-06-01

To systematically review current health literacy (HL) instruments for use in consumer-facing and mobile health information technology screening and evaluation tools. The databases, PubMed, OVID, Google Scholar, Cochrane Library and Science Citation Index, were searched for health literacy assessment instruments using the terms "health", "literacy", "computer-based," and "psychometrics". All instruments identified by this method were critically appraised according to their reported psychometric properties and clinical feasibility. Eleven different health literacy instruments were found. Screening questions, such as asking a patient about his/her need for assistance in navigating health information, were evaluated in seven different studies and are promising for use as a valid, reliable, and feasible computer-based approach to identify patients that struggle with low health literacy. However, there was a lack of consistency in the types of screening questions proposed. There is also a lack of information regarding the psychometric properties of computer-based health literacy instruments. Only English language health literacy assessment instruments were reviewed and analyzed. Current health literacy screening tools demonstrate varying benefits depending on the context of their use. In many cases, it seems that a single screening question may be a reliable, valid, and feasible means for establishing health literacy. A combination of screening questions that assess health literacy and technological literacy may enable tailoring eHealth applications to user needs. Further research should determine the best screening question(s) and the best synthesis of various instruments' content and methodologies for computer-based health literacy screening and assessment. Copyright © 2012 Elsevier Inc. All rights reserved.

A Multirater Instrument for the Assessment of Simulated Pediatric Crises

PubMed Central

Calhoun, Aaron W; Boone, Megan; Miller, Karen H; Taulbee, Rebecca L; Montgomery, Vicki L; Boland, Kimberly

2011-01-01

Background Few validated instruments exist to measure pediatric code team skills. The goal of this study was to develop an instrument for the assessment of resuscitation competency and self-appraisal using multirater and gap analysis methodologies. Methods Multirater assessment with gap analysis is a robust methodology that enables the measurement of self-appraisal as well as competency, offering faculty the ability to provide enhanced feedback. The Team Performance during Simulated Crises Instrument (TPDSCI) was grounded in the Accreditation Council for Graduate Medical Education competencies. The instrument contains 5 competencies, each assessed by a series of descriptive rubrics. It was piloted during a series of simulation-based interdisciplinary pediatric crisis resource management education sessions. Course faculty assessed participants, who also did self-assessments. Internal consistency and interrater reliability were analyzed using Cronbach α and intraclass correlation (ICC) statistics. Gap analysis results were examined descriptively. Results Cronbach α for the instrument was between 0.72 and 0.69. The overall ICC was 0.82. ICC values for the medical knowledge, clinical skills, communication skills, and systems-based practice were between 0.87 and 0.72. The ICC for the professionalism domain was 0.22. Further examination of the professionalism competency revealed a positive skew, 43 simulated sessions (98%) had significant gaps for at least one of the competencies, 38 sessions (86%) had gaps indicating self-overappraisal, and 15 sessions (34%) had gaps indicating self-underappraisal. Conclusions The TPDSCI possesses good measures of internal consistency and interrater reliability with respect to medical knowledge, clinical skills, communication skills, systems-based practice, and overall competence in the context of simulated interdisciplinary pediatric medical crises. Professionalism remains difficult to assess. These results provide an encouraging first step toward instrument validation. Gap analysis reveals disparities between faculty and self-assessments that indicate inadequate participant self-reflection. Identifying self-overappraisal can facilitate focused interventions. PMID:22379528

Objective assessment based on motion-related metrics and technical performance in laparoscopic suturing.

PubMed

Sánchez-Margallo, Juan A; Sánchez-Margallo, Francisco M; Oropesa, Ignacio; Enciso, Silvia; Gómez, Enrique J

2017-02-01

The aim of this study is to present the construct and concurrent validity of a motion-tracking method of laparoscopic instruments based on an optical pose tracker and determine its feasibility as an objective assessment tool of psychomotor skills during laparoscopic suturing. A group of novice ([Formula: see text] laparoscopic procedures), intermediate (11-100 laparoscopic procedures) and experienced ([Formula: see text] laparoscopic procedures) surgeons performed three intracorporeal sutures on an ex vivo porcine stomach. Motion analysis metrics were recorded using the proposed tracking method, which employs an optical pose tracker to determine the laparoscopic instruments' position. Construct validation was measured for all 10 metrics across the three groups and between pairs of groups. Concurrent validation was measured against a previously validated suturing checklist. Checklists were completed by two independent surgeons over blinded video recordings of the task. Eighteen novices, 15 intermediates and 11 experienced surgeons took part in this study. Execution time and path length travelled by the laparoscopic dissector presented construct validity. Experienced surgeons required significantly less time ([Formula: see text]), travelled less distance using both laparoscopic instruments ([Formula: see text]) and made more efficient use of the work space ([Formula: see text]) compared with novice and intermediate surgeons. Concurrent validation showed strong correlation between both the execution time and path length and the checklist score ([Formula: see text] and [Formula: see text], [Formula: see text]). The suturing performance was successfully assessed by the motion analysis method. Construct and concurrent validity of the motion-based assessment method has been demonstrated for the execution time and path length metrics. This study demonstrates the efficacy of the presented method for objective evaluation of psychomotor skills in laparoscopic suturing. However, this method does not take into account the quality of the suture. Thus, future works will focus on developing new methods combining motion analysis and qualitative outcome evaluation to provide a complete performance assessment to trainees.

Trainees' Perceptions of Feedback: Validity Evidence for Two FEEDME (Feedback in Medical Education) Instruments.

PubMed

Bing-You, Robert; Ramesh, Saradha; Hayes, Victoria; Varaklis, Kalli; Ward, Denham; Blanco, Maria

2018-01-01

Construct: Medical educators consider feedback a core component of the educational process. Effective feedback allows learners to acquire new skills, knowledge, and attitudes. Learners' perceptions of feedback are an important aspect to assess with valid methods in order to improve the feedback skills of educators and the feedback culture. Although guidelines for delivering effective feedback have existed for several decades, medical students and residents often indicate that they receive little feedback. A recent scoping review on feedback in medical education did not reveal any validity evidence on instruments to assess learner's perceptions of feedback. The purpose of our study was to gather validity evidence on two novel FEEDME (Feedback in Medical Education) instruments to assess medical students' and residents' perceptions of the feedback that they receive. After the authors developed an initial instrument with 54 items, cognitive interviews with medical students and residents suggested that 2 separate instruments were needed, one focused on the feedback culture (FEEDME-Culture) and the other on the provider of feedback (FEEDME-Provider). A Delphi study with 17 medical education experts and faculty members assessed content validity. The response process was explored involving 31 medical students and residents at 2 academic institutions. Exploratory factor analysis and reliability analyses were performed on completed instruments. Two Delphi consultation rounds refined the wording of items and eliminated several items. Learners found both instruments easy and quick to answer; it took them less than 5 minutes to complete. Learners preferred an electronic format of the instruments over paper. Factor analysis revealed a two- and three-factor solution for the FEEDME-Culture and FEEDME-Provider instruments, respectively. Cronbach's alpha was greater than 0.80 for all factors. Items on both instruments were moderately to highly correlated (range, r = .3-.7). Our results provide preliminary validity evidence of 2 novel feedback instruments. After further validation of both FEEDME instruments, sharing the results of the FEEDME-Culture instrument with educational leaders and faculty may improve the culture of feedback on specific educational rotations and at the institutional level. The FEEDME-Provider instrument could be useful for faculty development targeting feedback skills. Additional research studies could assess whether both instruments may be used to help learners receive feedback and prompt reflective learning.

Development and psychometric evaluation of the Premarital Sexual Behavior Assessment Scale for Young Women (PSAS-YW): an exploratory mixed method study.

PubMed

Rahmani, Azam; Merghati-Khoei, Effat; Moghadam-Banaem, Lida; Hajizadeh, Ebrahim; Hamdieh, Mostafa; Montazeri, Ali

2014-06-13

Premarital sexual behaviors are important issue for women's health. The present study was designed to develop and examine the psychometric properties of a scale in order to identify young women who are at greater risk of premarital sexual behavior. This was an exploratory mixed method investigation. Indeed, the study was conducted in two phases. In the first phase, qualitative methods (focus group discussion and individual interview) were applied to generate items and develop the questionnaire. In the second phase, psychometric properties (validity and reliability) of the questionnaire were assessed. In the first phase an item pool containing 53 statements related to premarital sexual behavior was generated. In the second phase item reduction was applied and the final version of the questionnaire containing 26 items was developed. The psychometric properties of this final version were assessed and the results showed that the instrument has a good structure, and reliability. The results from exploratory factory analysis indicated a 5-factor solution for the instrument that jointly accounted for the 57.4% of variance observed. The Cronbach's alpha coefficient for the instrument was found to be 0.87. This study provided a valid and reliable scale to identify premarital sexual behavior in young women. Assessment of premarital sexual behavior might help to improve women's sexual abstinence.

Health Literacy Demands of Patient-Reported Evaluation Tools in Orthopedics: A Mixed-Methods Case Study.

PubMed

Hadden, Kristie; Prince, Latrina Y; Barnes, C Lowry

In response to an assessment of organizational health literacy practices at a major academic health center, this case study evaluated the health literacy demands of patient-reported outcome measures commonly used in orthopedic surgery practices to identify areas for improvement. A mixed-methods approach was used to analyze the readability and patient feedback of orthopedic patient-reported outcome materials. Qualitative results were derived from focus group notes, observations, recordings, and consensus documents. Results were combined to formulate recommendations for quality improvement. Readability results indicated that narrative portions of sample patient outcome tools were written within or below the recommended eighth-grade reading level (= 5.9). However, document literacy results were higher than the recommended reading level (= 9.8). Focus group results revealed that participants had consensus on 8 of 12 plain language best practices, including use of bullet lists and jargon or technical words in both instruments. Although the typical readability of both instruments was not exceedingly high, appropriate readability formula and assessment methods gave a more comprehensive assessment of true readability. In addition, participant feedback revealed the need to reduce jargon and improve formatting to lessen the health literacy demands on patients. As clinicians turn more toward patient-reported measures to assess health care quality, it is important to consider the health literacy demands that are inherent in the instruments they are given in our health systems.

Assessing hospitals' clinical risk management: Development of a monitoring instrument

PubMed Central

2010-01-01

Background Clinical risk management (CRM) plays a crucial role in enabling hospitals to identify, contain, and manage risks related to patient safety. So far, no instruments are available to measure and monitor the level of implementation of CRM. Therefore, our objective was to develop an instrument for assessing CRM in hospitals. Methods The instrument was developed based on a literature review, which identified key elements of CRM. These elements were then discussed with a panel of patient safety experts. A theoretical model was used to describe the level to which CRM elements have been implemented within the organization. Interviews with CRM practitioners and a pilot evaluation were conducted to revise the instrument. The first nationwide application of the instrument (138 participating Swiss hospitals) was complemented by in-depth interviews with 25 CRM practitioners in selected hospitals, for validation purposes. Results The monitoring instrument consists of 28 main questions organized in three sections: 1) Implementation and organizational integration of CRM, 2) Strategic objectives and operational implementation of CRM at hospital level, and 3) Overview of CRM in different services. The instrument is available in four languages (English, German, French, and Italian). It allows hospitals to gather comprehensive and systematic data on their CRM practice and to identify areas for further improvement. Conclusions We have developed an instrument for assessing development stages of CRM in hospitals that should be feasible for a continuous monitoring of developments in this important area of patient safety. PMID:21144039

Individualized Educational Assessment: Twelfth-Grade Science.

ERIC Educational Resources Information Center

Bock, R. Darrell; Zimowski, Michele

The goals, principles, and methods of an individualized educational assessment are described as implemented in a 12th-grade science assessment instrument undergoing field trials in Ohio. Pilot tests were planned for December 1990 and March and April 1991. The assessment design incorporates the duplex design of R. D. Bock and R. J. Mislevy (1988)…

Pediatric Sleep Questionnaires as Diagnostic or Epidemiological Tools: A Review of Currently Available Instruments

PubMed Central

Spruyt, Karen; Gozal, David

2010-01-01

An extensive list of published and unpublished instruments used to investigate or evaluate sleep issues in children was collected and assessed based on the fundamental operational principles of instrument development (11 steps). Of all the available tools identified, only a few were validated and standardized using appropriate psychometric criteria. In fact, only 2 fulfill all desirable criteria and approximately 11 instruments seem to adhere to most of the psychometric tool development requirements, and were therefore assessed in greater detail. Notwithstanding, in the rapidly developing scientific world of pediatric sleep, there are too many tools being used that have not undergone careful and methodical psychometric evaluation, and as such may be fraught with biased or invalid findings. It is hoped that this initial effort in categorizing and assessing available tools for pediatric sleep will serve as recognition of the relatively early developmental stage of our field, and provide the necessary impetus for future tool development using multicentered approaches and adequate methodologies. PMID:20934896

Low-Income, African American and American Indian Children's Viewpoints on Body Image Assessment Tools and Body Satisfaction: A Mixed Methods Study.

PubMed

Heidelberger, Lindsay; Smith, Chery

2018-03-03

Objectives Pediatric obesity is complicated by many factors including psychological issues, such as body dissatisfaction. Body image assessment tools are used with children to measure their acceptance of their body shape or image. Limited research has been conducted with African American and American Indian children to understand their opinions on assessment tools created. This study investigated: (a) children's perception about body image and (b) differences between two body image instruments among low-income, multi-ethnic children. Methods This study uses mixed methodology including focus groups (qualitative) and body image assessment instruments (quantitative). Fifty-one children participated (25 girls, 26 boys); 53% of children identified as African American and 47% as American Indian. The average age was 10.4 years. Open coding methods were used by identify themes from focus group data. SPSS was used for quantitative analysis. Results Children preferred the Figure Rating Scale (FRS/silhouette) instrument over the Children's Body Image Scale (CBIS/photo) because their body parts and facial features were more detailed. Children formed their body image perception with influence from their parents and the media. Children verbalized that they have experienced negative consequences related to poor body image including disordered eating habits, depression, and bullying. Healthy weight children are also aware of weight-related bullying that obese and overweight children face. Conclusions for Practice Children prefer that the images on a body image assessment tool have detailed facial features and are clothed. Further research into body image assessment tools for use with African American and American Indian children is needed.

The Teamwork Assessment Scale: A Novel Instrument to Assess Quality of Undergraduate Medical Students' Teamwork Using the Example of Simulation-based Ward-Rounds

PubMed Central

Kiesewetter, Jan; Fischer, Martin R.

2015-01-01

Background: Simulation-based teamwork trainings are considered a powerful training method to advance teamwork, which becomes more relevant in medical education. The measurement of teamwork is of high importance and several instruments have been developed for various medical domains to meet this need. To our knowledge, no theoretically-based and easy-to-use measurement instrument has been published nor developed specifically for simulation-based teamwork trainings of medical students. Internist ward-rounds function as an important example of teamwork in medicine. Purposes: The purpose of this study was to provide a validated, theoretically-based instrument that is easy-to-use. Furthermore, this study aimed to identify if and when rater scores relate to performance. Methods: Based on a theoretical framework for teamwork behaviour, items regarding four teamwork components (Team Coordination, Team Cooperation, Information Exchange, Team Adjustment Behaviours) were developed. In study one, three ward-round scenarios, simulated by 69 students, were videotaped and rated independently by four trained raters. The instrument was tested for the embedded psychometric properties and factorial structure. In study two, the instrument was tested for construct validity with an external criterion with a second set of 100 students and four raters. Results: In study one, the factorial structure matched the theoretical components but was unable to separate Information Exchange and Team Cooperation. The preliminary version showed adequate psychometric properties (Cronbach’s α=.75). In study two, the instrument showed physician rater scores were more reliable in measurement than those of student raters. Furthermore, a close correlation between the scale and clinical performance as an external criteria was shown (r=.64) and the sufficient psychometric properties were replicated (Cronbach’s α=.78). Conclusions: The validation allows for use of the simulated teamwork assessment scale in undergraduate medical ward-round trainings to reliably measure teamwork by physicians. Further studies are needed to verify the applicability of the instrument. PMID:26038684

Interpreting findings from Mendelian randomization using the MR-Egger method.

PubMed

Burgess, Stephen; Thompson, Simon G

2017-05-01

Mendelian randomization-Egger (MR-Egger) is an analysis method for Mendelian randomization using summarized genetic data. MR-Egger consists of three parts: (1) a test for directional pleiotropy, (2) a test for a causal effect, and (3) an estimate of the causal effect. While conventional analysis methods for Mendelian randomization assume that all genetic variants satisfy the instrumental variable assumptions, the MR-Egger method is able to assess whether genetic variants have pleiotropic effects on the outcome that differ on average from zero (directional pleiotropy), as well as to provide a consistent estimate of the causal effect, under a weaker assumption-the InSIDE (INstrument Strength Independent of Direct Effect) assumption. In this paper, we provide a critical assessment of the MR-Egger method with regard to its implementation and interpretation. While the MR-Egger method is a worthwhile sensitivity analysis for detecting violations of the instrumental variable assumptions, there are several reasons why causal estimates from the MR-Egger method may be biased and have inflated Type 1 error rates in practice, including violations of the InSIDE assumption and the influence of outlying variants. The issues raised in this paper have potentially serious consequences for causal inferences from the MR-Egger approach. We give examples of scenarios in which the estimates from conventional Mendelian randomization methods and MR-Egger differ, and discuss how to interpret findings in such cases.

The development and validation of The Inquiry Science Observation Coding Sheet.

PubMed

Brandon, P R; Taum, A K H; Young, D B; Pottenger, F M

2008-08-01

Evaluation reports increasingly document the degree of program implementation, particularly the extent to which programs adhere to prescribed steps and procedures. Many reports are cursory, however, and few, if any, fully portray the long and winding path taken when developing evaluation instruments, particularly observation instruments. In this article, we describe the development of an observational method for evaluating the degree to which K-12 inquiry science programs are implemented, including the many steps and decisions that occurred during the development, and present evidence for the reliability and validity of the data that we collected with the instrument. The article introduces a method for measuring the adherence of inquiry science implementation and gives evaluators a full picture of what they might expect when developing observation instruments for assessing the degree of program implementation.

Provider payments and patient charges as policy tools for cost-containment: How successful are they in high-income countries?

PubMed Central

Carrin, Guy; Hanvoravongchai, Piya

2003-01-01

In this paper, we focus on those policy instruments with monetary incentives that are used to contain public health expenditure in high-income countries. First, a schematic view of the main cost-containment methods and the variables in the health system they intend to influence is presented. Two types of instruments to control the level and growth of public health expenditure are considered: (i) provider payment methods that influence the price and quantity of health care, and (ii) cost-containment measures that influence the behaviour of patients. Belonging to the first type of instruments, we have: fee-for-service, per diem payment, case payment, capitation, salaries and budgets. The second type of instruments consists of patient charges and reference price systems for pharmaceuticals. Secondly, we provide an overview of experience in high-income countries that use or have used these particular instruments. Finally, the paper assesses the overall potential of these instruments in cost-containment policies. PMID:12914661

Fundamentals of Embouchure in Brass Players: Towards a Definition and Clinical Assessment.

PubMed

Woldendorp, Kees H; Boschma, Hans; Boonstra, Anne M; Arendzen, Hans J; Reneman, Michiel F

2016-12-01

Brass players may experience problems producing an optimal sound (or range of sounds) in their instrument. Assessing and treating dysfunctional embouchure requires knowledge of functional embouchure, but peer-reviewed literature on dysfunctional and functional embouchure is scarce. This study aimed to provide a narrative overview of embouchure based on information from different scientific and clinical fields. This should be regarded as a first step in constructing a reliable, valid, and practical multi-item method to assess embouchure for brass players. Literature reviews were conducted concerning: 1) the definition of embouchure, 2) physics and acoustics of embouchure, 3) functioning of embouchure-related structures, and 4) instruments to assess embouchure. Also, embouchure experts (clinicians, scientists, and elite wind players) were consulted for information and discussion. A proposal for a new definition of embouchure, an overview of the relevant physics and acoustics, functions of embouchure-related body structures, and the main methods to measure embouchure in brass playing are presented. Peer-reviewed information about the fundamentals of dysfunctional embouchure is scarce and sometimes contradictory. A new definition for embouchure is proposed: embouchure is the process needed to adjust the amount, pressure, and direction of the air flow (generated by the breath support) as it travels through the mouth cavity and between the lips, by the position and/or movements of the tongue, teeth, jaws, cheeks, and lips, to produce a tone in a wind instrument. An integrative overview is presented which can serve as a transparent foundation for the present understanding of functional and dysfunctional embouchure and for developing an evidence-based multi-item assessment instrument.

Pain assessment in children: theoretical and empirical validity.

PubMed

Villarruel, A M; Denyes, M J

1991-12-01

Valid assessment of pain in children is foundational for both the nursing practice and research domains, yet few validated methods of pain measurement are currently available for young children. This article describes an innovative research approach used in the development of photographic instruments to measure pain intensity in young African-American and Hispanic children. The instruments were designed to enable children to participate actively in their own care and to do so in ways that are congruent with their developmental and cultural heritage. Conceptualization of the instruments, methodological development, and validation processes grounded in Orem's Self-Care Deficit Theory of Nursing are described. The authors discuss the ways in which the gaps between nursing theory, research, and practice are narrowed when development of instruments to measure clinical nursing phenomena are grounded in nursing theory, validated through research and utilized in practice settings.

Psychometric Comparison of the Functional Assessment Instruments QABF, FACT and FAST for Self-Injurious, Stereotypic and Aggressive/Destructive Behaviour

ERIC Educational Resources Information Center

Zaja, Rebecca H.; Moore, Linda; van Ingen, Daniel J.; Rojahn, Johannes

2011-01-01

Background: Psychometric properties of three functional assessment rating scales were compared for three types of target behaviours [self-injurious behaviour (SIB), stereotypic behaviour and aggressive/destructive behaviour]. Materials and method: The "Questions about Behavioural Function" (QABF), the "Functional Assessment for…

School Violence Assessment: A Conceptual Framework, Instruments, and Methods

ERIC Educational Resources Information Center

Benbenishty, Rami; Astor, Ron Avi; Estrada, Joey Nunez

2008-01-01

This article outlines a philosophical and theoretical framework for conducting school violence assessments at the local level. The authors advocate that assessments employ a strong conceptual foundation based on social work values. These values include the active measurement of ecological factors inside and outside the school that reflect the…

A Study of the Effect of HyperCard and Pen-Paper Performance Assessment Methods on Expert-Novice Chemistry Problem Solving.

ERIC Educational Resources Information Center

Kumar, David D.; And Others

1994-01-01

Investigates HyperCard as a tool for assessment in science education and determines whether or not a HyperCard assessment instrument could differentiate between expert and novice student performance on balancing stoichiometric equations in science education. (ZWH)

The Society for Implementation Research Collaboration Instrument Review Project: a methodology to promote rigorous evaluation.

PubMed

Lewis, Cara C; Stanick, Cameo F; Martinez, Ruben G; Weiner, Bryan J; Kim, Mimi; Barwick, Melanie; Comtois, Katherine A

2015-01-08

Identification of psychometrically strong instruments for the field of implementation science is a high priority underscored in a recent National Institutes of Health working meeting (October 2013). Existing instrument reviews are limited in scope, methods, and findings. The Society for Implementation Research Collaboration Instrument Review Project's objectives address these limitations by identifying and applying a unique methodology to conduct a systematic and comprehensive review of quantitative instruments assessing constructs delineated in two of the field's most widely used frameworks, adopt a systematic search process (using standard search strings), and engage an international team of experts to assess the full range of psychometric criteria (reliability, construct and criterion validity). Although this work focuses on implementation of psychosocial interventions in mental health and health-care settings, the methodology and results will likely be useful across a broad spectrum of settings. This effort has culminated in a centralized online open-access repository of instruments depicting graphical head-to-head comparisons of their psychometric properties. This article describes the methodology and preliminary outcomes. The seven stages of the review, synthesis, and evaluation methodology include (1) setting the scope for the review, (2) identifying frameworks to organize and complete the review, (3) generating a search protocol for the literature review of constructs, (4) literature review of specific instruments, (5) development of an evidence-based assessment rating criteria, (6) data extraction and rating instrument quality by a task force of implementation experts to inform knowledge synthesis, and (7) the creation of a website repository. To date, this multi-faceted and collaborative search and synthesis methodology has identified over 420 instruments related to 34 constructs (total 48 including subconstructs) that are relevant to implementation science. Despite numerous constructs having greater than 20 available instruments, which implies saturation, preliminary results suggest that few instruments stem from gold standard development procedures. We anticipate identifying few high-quality, psychometrically sound instruments once our evidence-based assessment rating criteria have been applied. The results of this methodology may enhance the rigor of implementation science evaluations by systematically facilitating access to psychometrically validated instruments and identifying where further instrument development is needed.

Capturing the Patient’s Experience: Using Qualitative Methods to Develop a Measure of Patient-Reported Symptom Burden: An Example from Ovarian Cancer

PubMed Central

Williams, Loretta A.; Agarwal, Sonika; Bodurka, Diane C.; Saleeba, Angele K.; Sun, Charlotte C.; Cleeland, Charles S.

2013-01-01

Context Experts in patient-reported outcome (PRO) measurement emphasize the importance of including patient input in the development of PRO measures. Although best methods for acquiring this input are not yet identified, patient input early in instrument development ensures that instrument content captures information most important and relevant to patients in understandable terms. Objectives The M. D. Anderson Symptom Inventory (MDASI) is a reliable, valid PRO instrument for assessing cancer symptom burden. We report a qualitative (open-ended, in-depth) interviewing method that can be used to incorporate patient input into PRO symptom measure development, with our experience in constructing a MDASI module for ovarian cancer (MDASI-OC) as a model. Methods Fourteen patients with ovarian cancer (OC) described symptoms experienced at the time of the study, at diagnosis, and during prior treatments. Researchers and clinicians used content analysis of interview transcripts to identify symptoms in patient language. Symptoms were ranked on the basis of the number of patients mentioning them and by clinician assessment of relevance. Results Forty-two symptoms were mentioned. Eight OC-specific items will be added to the 13 core symptom items and six interference items of the MDASI in a test version of the MDASI-OC based on the number of patients mentioning them and clinician assessment of importance. The test version is undergoing psychometric evaluation. Conclusion The qualitative interviewing process, used to develop the test MDASI-OC, systematically captures common symptoms important to patients with ovarian cancer. This methodology incorporates the patient experience recommended by experts in PRO instrument development. PMID:23615044

Informal caregivers and detection of delirium in postacute care: a correlational study of the confusion assessment method (CAM), confusion assessment method-family assessment method (CAM-FAM) and DSM-IV criteria.

PubMed

Flanagan, Nina M; Spencer, Gale

2016-09-01

Delirium is a common, serious and potentially life-threatening syndrome affecting older adults. This syndrome continues to be under-recognised and under treated by healthcare professionals across all care settings. Older adults who develop delirium have poorer outcomes, higher mortality and higher care costs. The purposes of this study were to correlate the confusion assessment method-family assessment method and confusion assessment method in the detection of delirium in postacute care, to correlate the confusion assessment method-family assessment method and diagnostic and statistical manual of mental disorders text revision criteria in detection of delirium in postacute care, to determine the prevalence of delirium in postacute care elders and to describe the relationship of level of cognitive impairment and delirium in the postacute care setting. Implications for Practice Delirium is disturbing for patients and caregivers. Frequently . family members want to provide information about their loved one. The use of the CAM-FAM and CAM can give a more definitive determination of baseline status. Frequent observations using both instruments may lead to better recognition of delirium and implementation of interventions to prevent lasting sequelae. Descriptive studies determined the strengths of relationship between the confusion assessment method, confusion assessment method-family assessment method, Mini-Cog and diagnostic and statistical manual of mental disorders text revision criteria in detection of delirium in the postacute care setting. Prevalence of delirium in this study was 35%. The confusion assessment method-family assessment method highly correlates with the confusion assessment method and diagnostic and statistical manual of mental disorders text revision criteria for detecting delirium in older adults in the postacute care setting. Persons with cognitive impairment are more likely to develop delirium. Family members recognise symptoms of delirium when asked. The confusion assessment method-family assessment method is a valid tool for detection of delirium. Delirium is disturbing for patients and caregivers. Frequently. family members want to provide information about their loved one. The use of the CAM-FAM and CAM can give a more definitive determination of baseline status. Frequent observations using both instruments may lead to better recognition of delirium and implementation of interventions to prevent lasting sequelae. © 2015 John Wiley & Sons Ltd.

Predicting Institutional Aggression in Offenders with Intellectual Disabilities Using the Violence Risk Appraisal Guide

ERIC Educational Resources Information Center

Pouls, Claudia; Jeandarme, Inge

2018-01-01

Background: One of the most extensively tested risk assessment instruments in offenders with an intellectual disability (OIDs) is the Violence Risk Appraisal Guide (VRAG). The purpose of this prospective study was to test the ability of this instrument to predict institutional aggression in OIDs. Method: VRAG scores were collected for 52 OIDs, and…

The use of a combination of instrumental methods to assess change in sensory crispness during storage of a "Honeycrisp" apple breeding family.

PubMed

Chang, Hsueh-Yuan; Vickers, Zata M; Tong, Cindy B S

2018-04-01

Loss of crispness in apple fruit during storage reduces the fruit's fresh sensation and consumer acceptance. Apple varieties that maintain crispness thus have higher potential for longer-term consumer appeal. To efficiently phenotype crispness, several instrumental methods have been tested, but variable results were obtained when different apple varieties were assayed. To extend these studies, we assessed the extent to which instrumental measurements correlate to and predict sensory crispness, with a focus on crispness maintenance. We used an apple breeding family derived from a cross between "Honeycrisp" and "MN1764," which segregates for crispness maintenance. Three types of instrumental measurements (puncture, snapping, and mechanical-acoustic tests) and sensory evaluation were performed on fruit at harvest and after 8 weeks of cold storage. Overall, 20 genotypes from the family and the 2 parents were characterized by 19 force and acoustic measures. In general, crispness was more related to force than to acoustic measures. Force linear distance and maximum force as measured by the mechanical-acoustic test were best correlated with sensory crispness and change in crispness, respectively. The correlations varied by apple genotype. The best multiple linear regression model to predict change in sensory crispness between harvest and storage of fruit of this breeding family incorporated both force and acoustic measures. This work compared the abilities of instrumental tests to predict sensory crispness maintenance of apple fruit. The use of an instrumental method that is highly correlated to sensory crispness evaluation can enhance the efficiency and reduce the cost of measuring crispness for breeding purposes. This study showed that sensory crispness and change in crispness after storage of an apple breeding family were reliably predicted with a combination of instrumental measurements and multiple variable analyses. The strategy potentially can be applied to other apple varieties for more accurate interpretation of crispness maintenance measured instrumentally. © 2018 Wiley Periodicals, Inc.

[Identification and assessment of suicidality].

PubMed

Prinz, Susanne; Egger, Stephan T

2014-10-29

Suicidality is a frequently observed but unfortunately frequently overlooked phenomenon. Every year over 1000 persons in Switzerland commit suicide; the number of attempted suicides is much higher. If suicidality is recognized promptly, appropriately assessed and adequate therapy initiated, suicides can be prevented. The assessment of suicidality can be facilitated by knowledge of the most important risk groups and factors, but also of protective factors. Various instruments are available which provide an overview of the influential factors, whereby some risk factors, e.g. access to suicidal methods or concrete suicide plans, involve a greater suicide risk than others. Such instruments, however, can never replace the overall assessment of a clinician which ought to arise from a dialogue characterized by empathy and transparency.

The Appetitive Aggression Scale—development of an instrument for the assessment of human's attraction to violence.

PubMed Central

Weierstall, Roland; Elbert, Thomas

2011-01-01

Background Several instruments, notably Buss and Perry's Aggression Questionnaire, have been developed for the assessment of aggressive behavior. However, in these instruments, the focus has been on reactive rather than instrumental forms of aggression, even though men in particular may find aggressive behavior attractive. A questionnaire or structured interview for the systematic assessment of the attraction to violence is not yet available. Objective We, therefore, developed a freely available short form for the assessment of a person's attraction to violent and planned forms of aggression based on reports of former combatants on the attraction to violence and the characteristics of instrumental aggression described in the literature. Method The Appetitive Aggression Scale (AAS) was administered to nine samples drawn from different populations, with a total of 1,632 former combatants and participants from war-affected regions (1,193 male and 439 female respondents). Results From the initial set of 31 items, a selection of 15 items was extracted to improve the scale's psychometric properties and assess the construct of appetitive aggression validly with respect to content. Cronbach's Alpha coefficient of 0.85 was appropriate. All items loaded significantly on a single factor accounting for 32% of the total variance. Further analysis revealed that the scale measures a specific construct that can be distinguished from other concepts of human aggression. Conclusions With the AAS, we present an easily administrable tool for the assessment of the attraction to violence. PMID:22893817

Optimizing the positional relationships between instruments used in laparoscopic simulation using a simple trigonometric method.

PubMed

Lorias Espinoza, Daniel; Ordorica Flores, Ricardo; Minor Martínez, Arturo; Gutiérrez Gnecchi, José Antonio

2014-06-01

Various methods for evaluating laparoscopic skill have been reported, but without detailed information on the configuration used they are difficult to reproduce. Here we present a method based on the trigonometric relationships between the instruments used in a laparoscopic training platform in order to provide a tool to aid in the reproducible assessment of surgical laparoscopic technique. The positions of the instruments were represented using triangles. Basic trigonometry was used to objectively establish the distances among the working ports RL, the placement of the optical port h', and the placement of the surgical target OT. The optimal configuration of a training platform depends on the selected working angles, the intracorporeal/extracorporeal lengths of the instrument, and the depth of the surgical target. We demonstrate that some distances, angles, and positions of the instruments are inappropriate for satisfactory laparoscopy. By applying basic trigonometric principles we can determine the ideal placement of the working ports and the optics in a simple, precise, and objective way. In addition, because the method is based on parameters known to be important in both the performance and quantitative quality of laparoscopy, the results are generalizable to different training platforms and types of laparoscopic surgery.

Treating pre-instrumental data as "missing" data: using a tree-ring-based paleoclimate record and imputations to reconstruct streamflow in the Missouri River Basin

NASA Astrophysics Data System (ADS)

Ho, M. W.; Lall, U.; Cook, E. R.

2015-12-01

Advances in paleoclimatology in the past few decades have provided opportunities to expand the temporal perspective of the hydrological and climatological variability across the world. The North American region is particularly fortunate in this respect where a relatively dense network of high resolution paleoclimate proxy records have been assembled. One such network is the annually-resolved Living Blended Drought Atlas (LBDA): a paleoclimate reconstruction of the Palmer Drought Severity Index (PDSI) that covers North America on a 0.5° × 0.5° grid based on tree-ring chronologies. However, the use of the LBDA to assess North American streamflow variability requires a model by which streamflow may be reconstructed. Paleoclimate reconstructions have typically used models that first seek to quantify the relationship between the paleoclimate variable and the environmental variable of interest before extrapolating the relationship back in time. In contrast, the pre-instrumental streamflow is here considered as "missing" data. A method of imputing the "missing" streamflow data, prior to the instrumental record, is applied through multiple imputation using chained equations for streamflow in the Missouri River Basin. In this method, the distribution of the instrumental streamflow and LBDA is used to estimate sets of plausible values for the "missing" streamflow data resulting in a ~600 year-long streamflow reconstruction. Past research into external climate forcings, oceanic-atmospheric variability and its teleconnections, and assessments of rare multi-centennial instrumental records demonstrate that large temporal oscillations in hydrological conditions are unlikely to be captured in most instrumental records. The reconstruction of multi-centennial records of streamflow will enable comprehensive assessments of current and future water resource infrastructure and operations under the existing scope of natural climate variability.

Clinical assessment of the physical activity pattern of chronic fatigue syndrome patients: a validation of three methods.

PubMed

Scheeres, Korine; Knoop, Hans; Meer, van der Jos; Bleijenberg, Gijs

2009-04-01

Effective treatment of chronic fatigue syndrome (CFS) with cognitive behavioural therapy (CBT) relies on a correct classification of so called 'fluctuating active' versus 'passive' patients. For successful treatment with CBT is it especially important to recognise the passive patients and give them a tailored treatment protocol. In the present study it was evaluated whether CFS patient's physical activity pattern can be assessed most accurately with the 'Activity Pattern Interview' (API), the International Physical Activity Questionnaire (IPAQ) or the CFS-Activity Questionnaire (CFS-AQ). The three instruments were validated compared to actometers. Actometers are until now the best and most objective instrument to measure physical activity, but they are too expensive and time consuming for most clinical practice settings. In total 226 CFS patients enrolled for CBT therapy answered the API at intake and filled in the two questionnaires. Directly after intake they wore the actometer for two weeks. Based on receiver operating characteristic (ROC) curves the validity of the three methods were assessed and compared. Both the API and the two questionnaires had an acceptable validity (0.64 to 0.71). None of the three instruments was significantly better than the others. The proportion of false predictions was rather high for all three instrument. The IPAQ had the highest proportion of correct passive predictions (sensitivity 70.1%). The validity of all three instruments appeared to be fair, and all showed rather high proportions of false classifications. Hence in fact none of the tested instruments could really be called satisfactory. Because the IPAQ showed to be the best in correctly predicting 'passive' CFS patients, which is most essentially related to treatment results, it was concluded that the IPAQ is the preferable alternative for an actometer when treating CFS patients in clinical practice.

The construction and validation of an instrument for the assessment of graduates of undergraduate nursing courses 1

PubMed Central

Vieira, Maria Aparecida; Ohara, Conceição Vieira da Silva; de Domenico, Edvane Birelo Lopes

2016-01-01

Abstract Objective: to construct an instrument for the assessment of graduates of undergraduate nursing courses and to validate this instrument through the consensus of specialists. Method: methodological study. In order to elaborate the instrument, documental analysis and a literature review were undertaken. Validation took place through use of the Delphi Conference, between September 2012 and September 2013, in which 36 specialists from Brazilian Nursing participated. In order to analyze reliability, the Cronbach alpha coefficient, the item/total correlation, and the Pearson correlation coefficient were calculated. Results: the instrument was constructed with the participation of specialist nurses representing all regions of Brazil, with experience in lecturing and research. The first Delphi round led to changes in the first instrument, which was restructured and submitted to another round, with a response rate of 94.44%. In the second round, the instrument was validated with a Cronbach alpha of 0.75. Conclusion: the final instrument possessed three dimensions related to the characterization of the graduate, insertion in the job market, and evaluation of the professional training process. This instrument may be used across the territory of Brazil as it is based on the curricular guidelines and contributes to the process of regulation of the quality of the undergraduate courses in Nursing. PMID:27305184

Assessing the Availability of Fertility Regulation Methods: Report on a Methodological Study. Scientific Reports, No. 1, February 1977.

ERIC Educational Resources Information Center

Rodriguez, German

The report investigates the problems of assessing the availability of fertility regulation methods in the household and the community. The study originated from the need to evaluate a number of proposed additions to the data collection instruments used by the World Fertility Survey (WFS). The core questionnaire was modified to add the following…

Applying the WHO recommendations on health-sector response to violence against women to assess the Spanish health system. A mixed methods approach.

PubMed

Goicolea, Isabel; Vives-Cases, Carmen; Minvielle, Fauhn; Briones-Vozmediano, Erica; Ohman, Ann

2014-01-01

This methodological note describes the development and application of a mixed-methods protocol to assess the responsiveness of Spanish health systems to violence against women in Spain, based on the World Health Organization (WHO) recommendations. Five areas for exploration were identified based on the WHO recommendations: policy environment, protocols, training, accountability/monitoring, and prevention/promotion. Two data collection instruments were developed to assess the situation of 17 Spanish regional health systems (RHS) with respect to these areas: 1) a set of indicators to guide a systematic review of secondary sources, and 2) an interview guide to be used with 26 key informants at the regional and national levels. We found differences between RHSs in the five areas assessed. The progress of RHSs on the WHO recommendations was notable at the level of policies, moderate in terms of health service delivery, and very limited in terms of preventive actions. Using a mixed-methods approach was useful for triangulation and complementarity during instrument design, data collection and interpretation. Copyright © 2013 SESPAS. Published by Elsevier Espana. All rights reserved.

Internal consistency of the self-reporting questionnaire-20 in occupational groups

PubMed Central

Santos, Kionna Oliveira Bernardes; Carvalho, Fernando Martins; de Araújo, Tânia Maria

2016-01-01

ABSTRACT OBJECTIVE To assess the internal consistency of the measurements of the Self-Reporting Questionnaire (SRQ-20) in different occupational groups. METHODS A validation study was conducted with data from four surveys with groups of workers, using similar methods. A total of 9,959 workers were studied. In all surveys, the common mental disorders were assessed via SRQ-20. The internal consistency considered the items belonging to dimensions extracted by tetrachoric factor analysis for each study. Item homogeneity assessment compared estimates of Cronbach’s alpha (KD-20), the alpha applied to a tetrachoric correlation matrix and stratified Cronbach’s alpha. RESULTS The SRQ-20 dimensions showed adequate values, considering the reference parameters. The internal consistency of the instrument items, assessed by stratified Cronbach’s alpha, was high (> 0.80) in the four studies. CONCLUSIONS The SRQ-20 showed good internal consistency in the professional categories evaluated. However, there is still a need for studies using alternative methods and additional information able to refine the accuracy of latent variable measurement instruments, as in the case of common mental disorders. PMID:27007682

Stakeholder Perspectives on Workplace-Based Performance Assessment: Towards a Better Understanding of Assessor Behaviour

ERIC Educational Resources Information Center

de Jonge, Laury P. J. W. M.; Timmerman, Angelique A.; Govaerts, Marjan J. B.; Muris, Jean W. M.; Muijtjens, Arno M. M.; Kramer, Anneke W. M.; van der Vleuten, Cees P. M.

2017-01-01

Workplace-Based Assessment (WBA) plays a pivotal role in present-day competency-based medical curricula. Validity in WBA mainly depends on how stakeholders (e.g. clinical supervisors and learners) use the assessments--rather than on the intrinsic qualities of instruments and methods. Current research on assessment in clinical contexts seems to…

Utilization and Limitations of the American College Health Association's National College Health Assessment Instrument: A Systematic Review

ERIC Educational Resources Information Center

Rahn, Rhonda N.; Pruitt, Buster; Goodson, Patricia

2016-01-01

Objective: To analyze the literature in which researchers have utilized the National College Health Assessment (NCHA) I or the NCHA II. Participants and Methods: The authors selected peer-reviewed articles published between 2004 and July 2013 utilizing a single search term: National College Health Assessment. Articles were assessed for instrument…

A Review of International Large-Scale Assessments in Education: Assessing Component Skills and Collecting Contextual Data. PISA for Development

ERIC Educational Resources Information Center

Cresswell, John; Schwantner, Ursula; Waters, Charlotte

2015-01-01

This report reviews the major international and regional large-scale educational assessments, including international surveys, school-based surveys and household-based surveys. The report compares and contrasts the cognitive and contextual data collection instruments and implementation methods used by the different assessments in order to identify…

Development and Evaluation of a Questionnaire to Assess Physical Educators' Knowledge of Student Assessment

ERIC Educational Resources Information Center

Emmanouilidou, Kyriaki; Derri, Vassiliki; Aggelousis, Nicolaos; Vassiliadou, Olga

2012-01-01

The purpose of this pilot study was to develop and evaluate an instrument for measuring Greek elementary physical educators' knowledge of student assessment. A multiple-choice questionnaire comprised of items about concepts, methods, tools, and types of student assessment in physical education was designed and tested. The initial 35-item…

Issues in the Assessment of Social Phobia: A Review

PubMed Central

Letamendi, Andrea M.; Chavira, Denise A.; Stein, Murray B.

2010-01-01

Since the emergence of social phobia in DSM nomenclature, the mental health community has witnessed an expansion in standardized methods for the screening, diagnosis, and measurement of the disorder. This article reviews formal assessment methods for social phobia, including diagnostic interview, clinician-administered instruments, and self report questionnaires. Frequently used tools for assessing constructs related to social phobia, such as disability and quality of life, are also briefly presented. This review evaluates each method by highlighting the assessment features recommended in social phobia literature, including method of administration, item content, coverage, length of scale, type of scores generated, and time frame. PMID:19728569

Review of Measures of Worksite Environmental and Policy Supports for Physical Activity and Healthy Eating

PubMed Central

Reeds, Dominic N.; van Bakergem, Margaret A.; Marx, Christine M.; Brownson, Ross C.; Pamulapati, Surya C.; Hoehner, Christine M.

2015-01-01

Introduction Obesity prevention strategies are needed that target multiple settings, including the worksite. The objective of this study was to assess the state of science concerning available measures of worksite environmental and policy supports for physical activity (PA) and healthy eating (HE). Methods We searched multiple databases for instruments used to assess worksite environments and policies. Two commonly cited instruments developed by state public health departments were also included. Studies that were published from 1991 through 2013 in peer-reviewed publications and gray literature that discussed the development or use of these instruments were analyzed. Instrument administration mode and measurement properties were documented. Items were classified by general health topic, 5 domains of general worksite strategy, and 19 subdomains of worksite strategy specific to PA or HE. Characteristics of worksite measures were described including measurement properties, length, and administration mode, as well as frequencies of items by domain and subdomain. Results Seventeen instruments met inclusion criteria (9 employee surveys, 5 manager surveys, 1 observational assessment, and 2 studies that used multiple administration modes). Fourteen instruments included reliability testing. More items were related to PA than HE. Most instruments (n = 10) lacked items in the internal social environment domain. The most common PA subdomains were exercise facilities and lockers/showers; the most common HE subdomain was healthy options/vending. Conclusion This review highlights gaps in measurement of the worksite social environment. The findings provide a useful resource for researchers and practitioners and should inform future instrument development. PMID:25950572

Parallel Study of HEND, RAD, and DAN Instrument Response to Martian Radiation and Surface Conditions

NASA Technical Reports Server (NTRS)

Martiniez Sierra, Luz Maria; Jun, Insoo; Litvak, Maxim; Sanin, Anton; Mitrofanov, Igor; Zeitlin, Cary

2015-01-01

Nuclear detection methods are being used to understand the radiation environment at Mars. JPL (Jet Propulsion Laboratory) assets on Mars include: Orbiter -2001 Mars Odyssey [High Energy Neutron Detector (HEND)]; Mars Science Laboratory Rover -Curiosity [(Radiation Assessment Detector (RAD); Dynamic Albedo Neutron (DAN))]. Spacecraft have instruments able to detect ionizing and non-ionizing radiation. Instrument response on orbit and on the surface of Mars to space weather and local conditions [is discussed] - Data available at NASA-PDS (Planetary Data System).

Instruments to assess the perception of physicians in the decision-making process of specific clinical encounters: a systematic review

PubMed Central

Légaré, France; Moher, David; Elwyn, Glyn; LeBlanc, Annie; Gravel, Karine

2007-01-01

Background The measurement of processes and outcomes that reflect the complexity of the decision-making process within specific clinical encounters is an important area of research to pursue. A systematic review was conducted to identify instruments that assess the perception physicians have of the decision-making process within specific clinical encounters. Methods For every year available up until April 2007, PubMed, PsycINFO, Current Contents, Dissertation Abstracts and Sociological Abstracts were searched for original studies in English or French. Reference lists from retrieved studies were also consulted. Studies were included if they reported a self-administered instrument evaluating physicians' perceptions of the decision-making process within specific clinical encounters, contained sufficient description to permit critical appraisal and presented quantitative results based on administering the instrument. Two individuals independently assessed the eligibility of the instruments and abstracted information on their conceptual underpinnings, main evaluation domain, development, format, reliability, validity and responsiveness. They also assessed the quality of the studies that reported on the development of the instruments with a modified version of STARD. Results Out of 3431 records identified and screened for evaluation, 26 potentially relevant instruments were assessed; 11 met the inclusion criteria. Five instruments were published before 1995. Among those published after 1995, five offered a corresponding patient version. Overall, the main evaluation domains were: satisfaction with the clinical encounter (n = 2), mutual understanding between health professional and patient (n = 2), mental workload (n = 1), frustration with the clinical encounter (n = 1), nurse-physician collaboration (n = 1), perceptions of communication competence (n = 2), degree of comfort with a decision (n = 1) and information on medication (n = 1). For most instruments (n = 10), some reliability and validity criteria were reported in French or English. Overall, the mean number of items on the modified version of STARD was 12.4 (range: 2 to 18). Conclusion This systematic review provides a critical appraisal and repository of instruments that assess the perception physicians have of the decision-making process within specific clinical encounters. More research is needed to pursue the validation of the existing instruments and the development of patient versions. This will help researchers capture the complexity of the decision-making process within specific clinical encounters. PMID:17937801

Cultural adaptation: translatability assessment and linguistic validation of the patient-reported outcome instrument for irritable bowel syndrome with diarrhea

PubMed Central

Delgado-Herrera, Leticia; Lasch, Kathryn; Popielnicki, Ana; Nishida, Akito; Arbuckle, Rob; Banderas, Benjamin; Zentner, Susan; Gagainis, Ingrid; Zeiher, Bernhardt

2016-01-01

Background and objective Following a 2009 US Food and Drug Administration guidance, a new patient-reported outcome (PRO) instrument was developed to support end points in multinational clinical trials assessing irritable bowel syndrome with diarrhea (IBS-D) symptom severity. Our objective was to assess the translatability of the IBS-D PRO instrument into ten languages, and subsequently perform a cultural adaptation/linguistic validation of the questionnaire into Japanese and US Spanish. Materials and methods Translatability assessments of the US English version of the IBS-D PRO were performed by experienced PRO translators who were native speakers of each target language and currently residing in target-language countries. Languages were Chinese (People’s Republic of China), Dutch (the Netherlands), French (Belgium), German (Germany), Japanese (Japan), Polish (Poland), Portuguese (Brazil), Russian (Russia), Spanish (Mexico), and Spanish (US). The project team assessed the instrument to identify potential linguistic and/or cultural adaptation issues. After the issues identified were resolved, the instrument was translated into Spanish (US) and Japanese through a process of two forward translations, one reconciled translation, and one backward translation. The project team reviewed the translated versions before the instruments were evaluated by cognitive debriefing interviews with samples of five Spanish (US) and five Japanese IBS-D patients. Results Linguistic and cultural adaptation concerns identified during the translatability assessment required minor revisions, mainly the presentation of dates/times and word structure. During the cognitive debriefing interviews, two of five Spanish respondents misunderstood the term “bowel movement” to mean only diarrhea in the Spanish version. Consequently, the term was changed from “movimiento intestinal” to “evacuaciones”. None of the Japanese respondents identified issues with the Japanese version. Conclusion The translatability of the IBS-D PRO instrument into ten target languages was confirmed, with only minor changes made to the translations of the instrument. The translation and linguistic validation into Spanish (US) and Japanese provide evidence that this instrument can be used in multinational trials and clinical settings. PMID:27382346

Development and Validation of an Instrument to Evaluate Perceived Wellbeing Associated with the Ingestion of Water: The Water Ingestion-Related Wellbeing Instrument (WIRWI)

PubMed Central

Espinosa-Montero, Juan; Monterrubio-Flores, Eric A.; Sanchez-Estrada, Marcela; Buendia-Jimenez, Inmaculada; Lieberman, Harris R.; Allaert, François-Andre; Barquera, Simon

2016-01-01

Background Ingestion of water has been associated with general wellbeing. When water intake is insufficient, symptoms such as thirst, fatigue and impaired memory result. Currently there are no instruments to assess water consumption associated with wellbeing. The objective of our study was to develop and validate such an instrument in urban, low socioeconomic, adult Mexican population. Methods To construct the Water Ingestion-Related Wellbeing Instrument (WIRWI), a qualitative study in which wellbeing related to everyday practices and experiences in water consumption were investigated. To validate the WIRWI a formal, five-process procedure was used. Face and content validation were addressed, consistency was assessed by exploratory and confirmatory psychometric factor analyses, repeatability, reproducibility and concurrent validity were assessed by conducting correlation tests with other measures of wellbeing such as a quality of life instrument, the SF-36, and objective parameters such as urine osmolality, 24-hour urine total volume and others. Results The final WIRWI is composed of 17 items assessing physical and mental dimensions. Items were selected based on their content and face validity. Exploratory and confirmatory factor analyses yielded Cronbach's alpha of 0.87 and 0.86, respectively. The final confirmatory factor analysis demonstrated that the model estimates were satisfactory for the constructs. Statistically significant correlations with the SF-36, total liquid consumption and simple water consumption were observed. Conclusion The resulting WIRWI is a reliable tool for assessing wellbeing associated with consumption of plain water in Mexican adults and could be useful for similar groups. PMID:27388902

A Culture-Specific Nutrient Intake Assessment Instrument in Patients with Pulmonary Tuberculosis

PubMed Central

Frediani, Jennifer K.; Tukvadze, Nestani; Sanikidze, Ekaterina; Kipiani, Maia; Hebbar, Gautam; Easley, Kirk A.; Shenvi, Neeta; Ramakrishnan, Usha; Tangpricha, Vin; Blumberg, Henry M.; Ziegler, Thomas R.

2013-01-01

Background and Aim To develop and evaluate a culture-specific nutrient intake assessment tool for use in adults with pulmonary tuberculosis (TB) in Tbilisi, Georgia. Methods We developed an instrument to measure food intake over 3 consecutive days using a questionnaire format. The tool was then compared to 24 hour food recalls. Food intake data from 31 subjects with TB were analyzed using the Nutrient Database System for Research (NDS-R) dietary analysis program. Paired t-tests, Pearson correlations and intraclass correlation coefficients (ICC) were used to assess the agreement between the two methods of dietary intake for calculated nutrient intakes. Results The Pearson correlation coefficient for mean daily caloric intake between the 2 methods was 0.37 (P = 0.04) with a mean difference of 171 kcals/day (p = 0.34). The ICC was 0.38 (95% CI: 0.03 to 0.64) suggesting the within-patient variability may be larger than between-patient variability. Results for mean daily intake of total fat, total carbohydrate, total protein, retinol, vitamins D and E, thiamine, calcium, sodium, iron, selenium, copper, and zinc between the two assessment methods were also similar. Conclusions This novel nutrient intake assessment tool provided quantitative nutrient intake data from TB patients. These pilot data can inform larger studies in similar populations. PMID:23541173

Assessing the overuse of antibiotics in children in Saudi Arabia: validation of the parental perception on antibiotics scale (PAPA scale)

PubMed Central

2013-01-01

Background Antibiotics overuse is a global public health issue influenced by several factors, of which some are parent-related psychosocial factors that can only be measured using valid and reliable psychosocial measurement instruments. The PAPA scale was developed to measure these factors and the content validity of this instrument was assessed. Aim This study further validated the recently developed instrument in terms of (1) face validity and (2) construct validity including: deciding the number and nature of factors, and item selection. Methods Questionnaires were self-administered to parents of children between the ages of 0 and 12 years old. Parents were conveniently recruited from schools’ parental meetings in the Eastern Province, Saudi Arabia. Face validity was assessed with regards to questionnaire clarity and unambiguity. Construct validity and item selection processes were conducted using Exploratory factor analysis. Results Parallel analysis and Exploratory factor analysis using principal axis factoring produced six factors in the developed instrument: knowledge and beliefs, behaviours, sources of information, adherence, awareness about antibiotics resistance, and parents’ perception regarding doctors’ prescribing behaviours. Reliability was assessed (Cronbach’s alpha = 0.78) which demonstrates the instrument as being reliable. Conclusion The ‘factors’ produced in this study coincide with the constructs contextually identified in the development phase of other instruments used to study antibiotic use. However, no other study considering perceptions of antibiotic use had gone beyond content validation of such instruments. This study is the first to constructively validate the factors underlying perceptions regarding antibiotic use in any population and in parents in particular. PMID:23497151

Health Literacy Screening Instruments for eHealth Applications: A Systematic Review

PubMed Central

Collins, Sarah A.; Currie, Leanne M.; Bakken, Suzanne; Vawdrey, David K.; Stone, Patricia W.

2012-01-01

Objective To systematically review current health literacy (HL) instruments for use in consumer-facing and mobile health information technology screening and evaluation tools. Design The databases, PubMed, OVID, Google Scholar, Cochrane Library and Science Citation Index, were searched for health literacy assessment instruments using the terms “health”, “literacy”, “computer-based,” and “psychometrics”. All instruments identified by this method were critically appraised according to their reported psychometric properties and clinical feasibility. Results Eleven different health literacy instruments were found. Screening questions, such as asking a patient about his/her need for assistance in navigating health information, were evaluated in 7 different studies and are promising for use as a valid, reliable, and feasible computer-based approach to identify patients that struggle with low health literacy. However, there was a lack of consistency in the types of screening questions proposed. There is also a lack of information regarding the psychometric properties of computer-based health literacy instruments. Limitations Only English language health literacy assessment instruments were reviewed and analyzed. Conclusions Current health literacy screening tools demonstrate varying benefits depending on the context of their use. In many cases, it seems that a single screening question may be a reliable, valid, and feasible means for establishing health literacy. A combination of screening questions that assess health literacy and technological literacy may enable tailoring eHealth applications to user needs. Further research should determine the best screening question(s) and the best synthesis of various instruments’ content and methodologies for computer-based health literacy screening and assessment. PMID:22521719

Adaptation and Validation of a Burnout Inventory in a Survey of the Staff of a Correctional Institution in Bulgaria.

PubMed

Harizanova, Stanislava N; Mateva, Nonka G; Tarnovska, Tanya Ch

2016-12-01

Burnout syndrome is a phenomenon that seems to be studied globally in relation to all types of populations. The staff in the system of correctional institutions in Bulgaria, however, is oddly left out of this tendency. There is no standardized model in Bulgaria that can be used to detect possible susceptibility to professional burnout. The methods available at present only register the irreversible changes that have already set in the functioning of the individual. V. Boyko's method for burnout assessment allows clinicians to use individual approach to patients and affords easy comparability of results with data from other psychodiagnostic instruments. Adaptation of the assessment instruments to fit the specificities of a study population (linguistic, ethno-cultural, etc.) is obligatory so that the instrument could be correctly used and yield valid results. Validation is one of the most frequently used technique to achieve this. The aim of the present study was to adapt and validate V. Boyko's burnout inventory for diagnosing burnout and assessment of the severity of the burnout syndrome in correctional officers. We conducted a pilot study with 50 officers working in the Plovdiv Regional Correction Facility by test-retest survey performed at an interval of 2 to 4 months. All participants completed the adapted questionnaire translated into Bulgarian voluntarily and anonymously. Statistical analysis was performed using SPSS v.17. We found a mild-to-strong statistically significant correlation (P<0.01) across all subscales between the most frequently used questionnaire for assessing the burnout syndrome, the Maslach Burnout Inventory, and the tool we propose here. The high Cronbach's α coefficient (α=0.94) and Spearman-Brown coefficient (rsb=0.86), and the low mean between-item correlation (r=0.30) demonstrated the instrument's good reliability and validity. With the validation herein presented we offer a highly reliable Bulgarian variant of Boyko's method for burnout assessment and research.

REFERQUAL: a pilot study of a new service quality assessment instrument in the GP exercise referral scheme setting

PubMed Central

Cock, Don; Adams, Iain C; Ibbetson, Adrian B; Baugh, Phil

2006-01-01

Background The development of an instrument accurately assessing service quality in the GP Exercise Referral Scheme (ERS) industry could potentially inform scheme organisers of the factors that affect adherence rates leading to the implementation of strategic interventions aimed at reducing client drop-out. Methods A modified version of the SERVQUAL instrument was designed for use in the ERS setting and subsequently piloted amongst 27 ERS clients. Results Test re-test correlations were calculated via Pearson's 'r' or Spearman's 'rho', depending on whether the variables were Normally Distributed, to show a significant (mean r = 0.957, SD = 0.02, p < 0.05; mean rho = 0.934, SD = 0.03, p < 0.05) relationship between all items within the questionnaire. In addition, satisfactory internal consistency was demonstrated via Cronbach's 'α'. Furthermore, clients responded favourably towards the usability, wording and applicability of the instrument's items. Conclusion REFERQUAL is considered to represent promise as a suitable tool for future evaluation of service quality within the ERS community. Future research should further assess the validity and reliability of this instrument through the use of a confirmatory factor analysis to scrutinise the proposed dimensional structure. PMID:16725021

The development and testing of a qualitative instrument designed to assess critical thinking

NASA Astrophysics Data System (ADS)

Clauson, Cynthia Louisa

This study examined a qualitative approach to assess critical thinking. An instrument was developed that incorporates an assessment process based on Dewey's (1933) concepts of self-reflection and critical thinking as problem solving. The study was designed to pilot test the critical thinking assessment process with writing samples collected from a heterogeneous group of students. The pilot test included two phases. Phase 1 was designed to determine the validity and inter-rater reliability of the instrument using two experts in critical thinking, problem solving, and literacy development. Validity of the instrument was addressed by requesting both experts to respond to ten questions in an interview. The inter-rater reliability was assessed by analyzing the consistency of the two experts' scorings of the 20 writing samples to each other, as well as to my scoring of the same 20 writing samples. Statistical analyses included the Spearman Rho and the Kuder-Richardson (Formula 20). Phase 2 was designed to determine the validity and reliability of the critical thinking assessment process with seven science teachers. Validity was addressed by requesting the teachers to respond to ten questions in a survey and interview. Inter-rater reliability was addressed by comparing the seven teachers' scoring of five writing samples with my scoring of the same five writing samples. Again, the Spearman Rho and the Kuder-Richardson (Formula 20) were used to determine the inter-rater reliability. The validity results suggest that the instrument is helpful as a guide for instruction and provides a systematic method to teach and assess critical thinking while problem solving with students in the classroom. The reliability results show the critical thinking assessment instrument to possess fairly high reliability when used by the experts, but weak reliability when used by classroom teachers. A major conclusion was drawn that teachers, as well as students, would need to receive instruction in critical thinking and in how to use the assessment process in order to gain more consistent interpretations of the six problem-solving steps. Specific changes needing to be made in the instrument to improve the quality are included.

Measurement Properties of Questionnaires Measuring Continuity of Care: A Systematic Review

PubMed Central

Uijen, Annemarie A.; Heinst, Claire W.; Schellevis, Francois G.; van den Bosch, Wil J.H.M.; van de Laar, Floris A.; Terwee, Caroline B.; Schers, Henk J.

2012-01-01

Background Continuity of care is widely acknowledged as a core value in family medicine. In this systematic review, we aimed to identify the instruments measuring continuity of care and to assess the quality of their measurement properties. Methods We did a systematic review using the PubMed, Embase and PsycINFO databases, with an extensive search strategy including ‘continuity of care’, ‘coordination of care’, ‘integration of care’, ‘patient centered care’, ‘case management’ and its linguistic variations. We searched from 1995 to October 2011 and included articles describing the development and/or evaluation of the measurement properties of instruments measuring one or more dimensions of continuity of care (1) care from the same provider who knows and follows the patient (personal continuity), (2) communication and cooperation between care providers in one care setting (team continuity), and (3) communication and cooperation between care providers in different care settings (cross-boundary continuity). We assessed the methodological quality of the measurement properties of each instrument using the COSMIN checklist. Results We included 24 articles describing the development and/or evaluation of 21 instruments. Ten instruments measured all three dimensions of continuity of care. Instruments were developed for different groups of patients or providers. For most instruments, three or four of the six measurement properties were assessed (mostly internal consistency, content validity, structural validity and construct validity). Six instruments scored positive on the quality of at least three of six measurement properties. Conclusions Most included instruments have problems with either the number or quality of its assessed measurement properties or the ability to measure all three dimensions of continuity of care. Based on the results of this review, we recommend the use of one of the four most promising instruments, depending on the target population Diabetes Continuity of Care Questionnaire, Alberta Continuity of Services Scale-Mental Health, Heart Continuity of Care Questionnaire, and Nijmegen Continuity Questionnaire. PMID:22860100

Evaluating the Use of Criteria for Assessing Profession-Specific Communication Skills in Pharmacy

ERIC Educational Resources Information Center

Hyvarinen, Marja-Leena; Tanskanen, Paavo; Katajavuori, Nina; Isotalus, Pekka

2012-01-01

One central task in higher education is to provide students with interpersonal communication competence in their profession. To achieve this, specialised training, based on an understanding of disciplinary communication practices and appropriate assessment methods, is needed. However, there is a lack of reliable assessment instruments which are…

The DUNDRUM Quartet: validation of structured professional judgement instruments DUNDRUM-3 assessment of programme completion and DUNDRUM-4 assessment of recovery in forensic mental health services

PubMed Central

2011-01-01

Background Moving a forensic mental health patient from one level of therapeutic security to a lower level or to the community is influenced by more than risk assessment and risk management. We set out to construct and validate structured professional judgement instruments for consistency and transparency in decision making Methods Two instruments were developed, the seven-item DUNDRUM-3 programme completion instrument and the six item DUNDRUM-4 recovery instrument. These were assessed for all 95 forensic patients at Ireland's only forensic mental health hospital. Results The two instruments had good internal consistency (Cronbach's alpha 0.911 and 0.887). Scores distinguished those allowed no leave or accompanied leave from those with unaccompanied leave (ANOVA F = 38.1 and 50.3 respectively, p < 0.001). Scores also distinguished those in acute/high security units from those in medium or in low secure/pre-discharge units. Each individual item distinguished these levels of need significantly. The DUNDRUM-3 and DUNDRUM-4 correlated moderately with measures of dynamic risk and with the CANFOR staff rated unmet need (Spearman r = 0.5, p < 0.001). Conclusions The DUNDRUM-3 programme completion items distinguished significantly between levels of therapeutic security while the DUNDRUM-4 recovery items consistently distinguished those given unaccompanied leave outside the hospital and those in the lowest levels of therapeutic security. This data forms the basis for a prospective study of outcomes now underway. PMID:21722396

Cognitive assessment instruments in Parkinson's disease patients undergoing deep brain stimulation

PubMed Central

Romann, Aline Juliane; Dornelles, Silvia; Maineri, Nicole de Liz; Rieder, Carlos Roberto de Mello; Olchik, Maira Rozenfeld

2012-01-01

Deep Brain Stimulation (DBS) is a widely used surgical technique in individuals with Parkinson's disease (PD) that can lead to significant reductions in motor symptoms. Objectives To determine, from publications, the most commonly used instruments for cognitive evaluation of individuals with PD undergoing DBS. Methods A systematic review of the databases: PubMed, Medline, EBECS, Scielo and LILACS was conducted, using the descriptors "Deep Brain Stimulation", "Verbal Fluency", "Parkinson Disease", "Executive Function", "Cognition" and "Cognitive Assessment" in combination. Results The Verbal Fluency test was found to be the most used instrument for this investigation in the studies, followed by the Boston Naming Test. References to the Stroop Test, Trail Making Test, and Rey's Auditory Verbal Learning Test were also found. Conclusions The validation of instruments for this population is needed as is the use of batteries offering greater specificity and sensitivity for the detection of cognitive impairment. PMID:29213766

Assessment of the measurement properties of the post stroke motor function instruments available in Brazil: a systematic review

PubMed Central

Lima, Elaine; Teixeira-Salmela, Luci F.; Simões, Luan; Guerra, Ana C. C.; Lemos, Andrea

2016-01-01

Background While there are several instruments in Brazil that measure motor function in patients after stroke, it is unknown whether the measurement properties of these instruments are appropriate. Objective To identify the motor function instruments available in Brazil for patients after stroke. To assess the methodological quality of the studies and the results related to the measurement properties of these instruments. Method Two independent reviewers conducted searches on PubMed, LILACS, CINAHL, Web of Science, and Scopus. Studies that aimed to cross-culturally adapt an existing instrument or create a Brazilian instrument and test at least one measurement property related to motor function in patients after stroke were included. The methodological quality of these studies was checked by the COSMIN checklist with 4-point rating scale and the results of the measurement properties were analyzed by the criteria developed by Terwee et al. Results A total of 11 instruments were considered eligible, none of which were created in Brazil. The process of cross-cultural adaptation was inadequate in 10 out of 11 instruments due to the lack of back-translation or due to inappropriate target population. All of the instruments presented flaws in the measurement properties, especially reliability, internal consistency, and construct validity. Conclusion The flaws observed in both cross-cultural adaptation process and testing measurement properties make the results inconclusive on the validity of the available instruments. Adequate procedures of cross-cultural adaptation and measurement properties of these instruments are strongly needed. PMID:26982452

Gender Differences of Children's Developmental Trajectory from 6 to 60 Months in the Taiwan Birth Cohort Pilot Study

ERIC Educational Resources Information Center

Lung, For-Wey; Chiang, Tung-Liang; Lin, Shio-Jean; Feng, Jui-Ying; Chen, Po-Fei; Shu, Bih-Ching

2011-01-01

The parental report instrument is the most efficient developmental detection method and has shown high validity with professional assessment instruments. The reliability and validity of the Taiwan Birth Cohort Study (TBCS) 6-, 18- and 36-month scales have already been established. In this study, the reliability and validity of the 60-month scale…

Advising on Preferred Reporting Items for patient-reported outcome instrument development: the PRIPROID.

PubMed

Hou, Zheng-Kun; Liu, Feng-Bin; Fang, Ji-Qian; Li, Xiao-Ying; Li, Li-Juan; Lin, Chu-Hua

2013-03-01

The reporting of patient-reported outcomes (PRO) instrument development is vital for both researchers and clinicians to determine its validity, thus, we propose the Preferred Reporting Items for PRO Instrument Development (PRIPROID) to improve the quality of reports. Abiding by the guidance published by the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) Network, we had performed 6 steps for items development: identified the need for a guideline, performed a literature review, obtained funding for the guideline initiative, identified participants, conducted a Delphi exercise and generated a list of PRIPROID items for consideration at the face-to-face meeting. Twenty three items subheadings under 7 topics were included: title and structured abstract, rationale, objectives, intention, eligibility criteria, conceptual framework, items generation, response options, scoring, times, administrative modes, burden assessment, properties assessment, statistical methods, participants, main results, and additional analysis, summary of evidence, limitations, clinical attentions, and conclusions, item pools or final form, and funding. The PRIPROID contains many elements of the PRO research, and this assists researchers to report their results more accurately and to a certain degree use this instrument to evaluate the quality of the research methods.

Improved retrieval of cloud base heights from ceilometer using a non-standard instrument method

NASA Astrophysics Data System (ADS)

Wang, Yang; Zhao, Chuanfeng; Dong, Zipeng; Li, Zhanqing; Hu, Shuzhen; Chen, Tianmeng; Tao, Fa; Wang, Yuzhao

2018-04-01

Cloud-base height (CBH) is a basic cloud parameter but has not been measured accurately, especially under polluted conditions due to the interference of aerosol. Taking advantage of a comprehensive field experiment in northern China in which a variety of advanced cloud probing instruments were operated, different methods of detecting CBH are assessed. The Micro-Pulse Lidar (MPL) and the Vaisala ceilometer (CL51) provided two types of backscattered profiles. The latter has been employed widely as a standard means of measuring CBH using the manufacturer's operational algorithm to generate standard CBH products (CL51 MAN) whose quality is rigorously assessed here, in comparison with a research algorithm that we developed named value distribution equalization (VDE) algorithm. It was applied to both the profiles of lidar backscattering data from the two instruments. The VDE algorithm is found to produce more accurate estimates of CBH for both instruments and can cope with heavy aerosol loading conditions well. By contrast, CL51 MAN overestimates CBH by 400 m and misses many low level clouds under such conditions. These findings are important given that CL51 has been adopted operationally by many meteorological stations in China.

Intervention mapping for the development of a strategy to implement the insurance medicine guidelines for depression

PubMed Central

2011-01-01

Background This article describes the development of a strategy to implement the insurance medicine guidelines for depression. Use of the guidelines is intended to result in more transparent and uniform assessment of claimants with depressive symptoms. Methods The implementation strategy was developed using the Intervention Mapping (IM) method for alignment with insurance-medical practice. The ASE behavioural explanation model (Attitude, Social Influence and Self-Efficacy) was used as theoretical basis for the development work. A literature study of implementation strategies and interviews with insurance physicians were performed to develop instruments for use with the guideline. These instruments were designed to match the needs and the working circumstances of insurance physicians. Performance indicators to measure the quality of the assessment and the adherence to the guidelines were defined with input from insurance physicians. Results This study resulted in the development of a training course to teach insurance physicians how to apply the guidelines for depression, using the aforementioned instruments. The efficacy of this training course will be evaluated in a Randomized Controlled Trial. Conclusions The use of IM made it possible to develop guideline support instruments tailored to insurance medical practice. PMID:21208413

Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1--eliciting concepts for a new PRO instrument.

PubMed

Patrick, Donald L; Burke, Laurie B; Gwaltney, Chad J; Leidy, Nancy Kline; Martin, Mona L; Molsen, Elizabeth; Ring, Lena

2011-12-01

The importance of content validity in developing patient reported outcomes (PRO) instruments is stressed by both the US Food and Drug Administration and the European Medicines Agency. Content validity is the extent to which an instrument measures the important aspects of concepts that developers or users purport it to assess. A PRO instrument measures the concepts most significant and relevant to a patient's condition and its treatment. For PRO instruments, items and domains as reflected in the scores of an instrument should be important to the target population and comprehensive with respect to patient concerns. Documentation of target population input in item generation, as well as evaluation of patient understanding through cognitive interviewing, can provide the evidence for content validity. Developing content for, and assessing respondent understanding of, newly developed PRO instruments for medical product evaluation will be discussed in this two-part ISPOR PRO Good Research Practices Task Force Report. Topics include the methods for generating items, documenting item development, coding of qualitative data from item generation, cognitive interviewing, and tracking item development through the various stages of research and preparing this tracking for submission to regulatory agencies. Part 1 covers elicitation of key concepts using qualitative focus groups and/or interviews to inform content and structure of a new PRO instrument. Part 2 covers the instrument development process, the assessment of patient understanding of the draft instrument using cognitive interviews and steps for instrument revision. The two parts are meant to be read together. They are intended to offer suggestions for good practices in planning, executing, and documenting qualitative studies that are used to support the content validity of PRO instruments to be used in medical product evaluation. Copyright © 2011 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

The Multidimensional Assessment of Interoceptive Awareness (MAIA)

PubMed Central

Mehling, Wolf E.; Price, Cynthia; Daubenmier, Jennifer J.; Acree, Mike; Bartmess, Elizabeth; Stewart, Anita

2012-01-01

This paper describes the development of a multidimensional self-report measure of interoceptive body awareness. The systematic mixed-methods process involved reviewing the current literature, specifying a multidimensional conceptual framework, evaluating prior instruments, developing items, and analyzing focus group responses to scale items by instructors and patients of body awareness-enhancing therapies. Following refinement by cognitive testing, items were field-tested in students and instructors of mind-body approaches. Final item selection was achieved by submitting the field test data to an iterative process using multiple validation methods, including exploratory cluster and confirmatory factor analyses, comparison between known groups, and correlations with established measures of related constructs. The resulting 32-item multidimensional instrument assesses eight concepts. The psychometric properties of these final scales suggest that the Multidimensional Assessment of Interoceptive Awareness (MAIA) may serve as a starting point for research and further collaborative refinement. PMID:23133619

The Utility of the Montreal Cognitive Assessment as a Mental Capacity Assessment Tool for Patients with a Learning Disability

ERIC Educational Resources Information Center

Edge, Daniel; Oyefeso, Adenekan; Evans, Carys; Evans, Amber

2016-01-01

Objective: To determine the psychometric properties of the Montreal Cognitive Assessment (MoCA) in patients with a learning disability and examine it's utility for conducting mental capacity assessment. Method: This study was a cross-sectional, instrument validation study in an inpatient hospital setting, located in the East of England. The sample…

Assessing the relevance of higher education courses.

PubMed

Gómez, Pedro; González, María Jose; Gil, Francisco; Lupiáñez, José Luis; Moreno, María Francisca; Rico, Luis; Romero, Isabel

2007-05-01

The establishment of the European Higher Education Area has involved specifying lists of professional competencies that programs are expected to develop, and with this the need for procedures to measure how every course within a higher education program is aligned with the program's competencies. We propose an instrument for characterizing this alignment, a process that we call assessing the relevance of a course. Using information from the course syllabus (objectives, contents and assessment scheme), our instrument produces indicators for characterizing the syllabus in terms of a competence list and for assessing its coherence. Because assessment involves quality, the results obtained can also be used to revise and improve the course syllabus. We illustrate this process with an example of a methods course from a mathematics teacher education program at a Spanish university.

Suicidality assessment with PRISM-S - simple, fast, and visual: a brief nonverbal method to assess suicidality in adolescent and adult patients.

PubMed

Harbauer, Gregor; Ring, Mariann; Schuetz, Christopher; Andreae, Andreas; Haas, Sebastian

2013-01-01

The PRISM-S task was developed at the Crisis Intervention Center (KIZ) Winterthur, Switzerland, to enable an assessment of the degree of suicidality in less than 5 minutes with a simple, visual instrument. Comparison of validity and clinical use of the new PRISM-S task with other instruments known as "gold standards". Quantitative pilot study enlisting 100 inpatients admitted to the KIZ, aged 15-42 years. Patients' suicidality was assessed by the PRISM-S task during the first clinical interview and compared to data obtained by standardized suicidality instruments. The patients completed the PRISM-S task in 2 to 5 minutes without difficulty. Data show significant positive correlations between the suicidality as assessed by PRISM-S and the gold standards, i.e., DSI-SS (r = 0.59, N = 65, p < .0001). There is no strong evidence that PRISM-S is useful for outpatients or in other settings. The experiences gained with outpatients/patients with other disorders are promising but have not been systematically evaluated. The results do not rely on a randomized design. The sample consists of persons coming to the crisis intervention center. PRISM-S offers a brief, easy-to-administer, and valid method to assess patients' suicidality. The simple instruction facilitates its use in other languages and other cultures as well. The acceptance by patients and health professionals was good, with no one refusing to complete the task.

Reliability and validity evidence of the Assessment of Language Use in Social Contexts for Adults (ALUSCA).

PubMed

Valente, Ana Rita S; Hall, Andreia; Alvelos, Helena; Leahy, Margaret; Jesus, Luis M T

2018-04-12

The appropriate use of language in context depends on the speaker's pragmatic language competencies. A coding system was used to develop a specific and adult-focused self-administered questionnaire to adults who stutter and adults who do not stutter, The Assessment of Language Use in Social Contexts for Adults, with three categories: precursors, basic exchanges, and extended literal/non-literal discourse. This paper presents the content validity, item analysis, reliability coefficients and evidences of construct validity of the instrument. Content validity analysis was based on a two-stage process: first, 11 pragmatic questionnaires were assessed to identify items that probe each pragmatic competency and to create the first version of the instrument; second, items were assessed qualitatively by an expert panel composed by adults who stutter and controls, and quantitatively and qualitatively by an expert panel composed by clinicians. A pilot study was conducted with five adults who stutter and five controls to analyse items and calculate reliability. Construct validity evidences were obtained using the hypothesized relationships method and factor analysis with 28 adults who stutter and 28 controls. Concerning content validity, the questionnaires assessed up to 13 pragmatic competencies. Qualitative and quantitative analysis revealed ambiguities in items construction. Disagreement between experts was solved through item modification. The pilot study showed that the instrument presented internal consistency and temporal stability. Significant differences between adults who stutter and controls and different response profiles revealed the instrument's underlying construct. The instrument is reliable and presented evidences of construct validity.

A Systematic Review of Primary Care Safety Climate Survey Instruments: Their Origins, Psychometric Properties, Quality, and Usage.

PubMed

Curran, Ciara; Lydon, Sinéad; Kelly, Maureen; Murphy, Andrew; Walsh, Chloe; OʼConnor, Paul

2018-06-01

Safety climate (SC) measurement is a common and feasible method of proactive safety assessment in primary care. However, there is no consensus on which instrument is "best" to use. The aim of the study was to identify the origins, psychometric properties, quality, and SC domains measured by survey instruments used to assess SC in primary care settings. Systematic searches were conducted using Medline, Embase, CINAHL, and PsycInfo in February 2016. English-language, peer-reviewed studies that reported the development and/or use of a SC survey in a primary care setting were included. Two reviewers independently extracted data (survey characteristics, origins, and psychometric properties) from studies and applied the Quality Assessment Tool for Studies with Diverse Designs to assess methodological rigour. Safety climate domains within surveys were deductively analyzed and categorized into common healthcare SC themes. Seventeen SC surveys were identified, of which 16 had been adapted from 2 main U.S. hospital-based surveys. Only 1 survey was developed de novo for a primary care setting. The quantity and quality of psychometric testing varied considerably across the surveys. Management commitment to safety was the most frequently measured SC theme (87.5%). Workload was infrequently measured (25%). Valid and reliable instruments, which are context specific to the healthcare environment for intentional use, are essential to accurately assess SC. Key recommendations include further establishing the construct and criterion-related validity of existing instruments as opposed to developing additional surveys.

Validation of the organizational culture assessment instrument.

PubMed

Heritage, Brody; Pollock, Clare; Roberts, Lynne

2014-01-01

Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI) has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102) Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged.

Content validity of the Geriatric Health Assessment Instrument

PubMed Central

Pedreira, Rhaine Borges Santos; Rocha, Saulo Vasconcelos; dos Santos, Clarice Alves; Vasconcelos, Lélia Renata Carneiro; Reis, Martha Cerqueira

2016-01-01

ABSTRACT Objective Assess the content validity of the Elderly Health Assessment Tool with low education. Methods The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as “not valid”, “somewhat valid” or “valid”, using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. Results The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. Conclusion The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly. PMID:27462889

Validation of the Organizational Culture Assessment Instrument

PubMed Central

Heritage, Brody; Pollock, Clare; Roberts, Lynne

2014-01-01

Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI) has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102) Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged. PMID:24667839

A systematic review of methods to assess intake of sugar-sweetened beverages among healthy European adults and children: a DEDIPAC (DEterminants of DIet and Physical Activity) study.

PubMed

Riordan, Fiona; Ryan, Kathleen; Perry, Ivan J; Schulze, Matthias B; Andersen, Lene Frost; Geelen, Anouk; Van't Veer, Pieter; Eussen, Simone; van Dongen, Martien; Wijckmans-Duysens, Nicole; Harrington, Janas M

2017-03-01

Research indicates that intake of sugar-sweetened beverages (SSB) may be associated with negative health consequences. However, differences between assessment methods can affect the comparability of intake data across studies. The current review aimed to identify methods used to assess SSB intake among children and adults in pan-European studies and to inform the development of the DEDIPAC (DEterminants of DIet and Physical Activity) toolbox of methods suitable for use in future European studies. A literature search was conducted using three electronic databases and by hand-searching reference lists. English-language studies of any design which assessed SSB consumption were included in the review. Studies involving two or more European countries were included in the review. Healthy, free-living children and adults. The review identified twenty-three pan-European studies which assessed intake of SSB. The FFQ was the most commonly used (n 24), followed by the 24 h recall (n 6) and diet records (n 1). There were several differences between the identified FFQ, including the definition of SSB used. In total, seven instruments that were tested for validity were selected as potentially suitable to assess SSB intake among adults (n 1), adolescents (n 3) and children (n 3). The current review highlights the need for instruments to use an agreed definition of SSB. Methods that were tested for validity and used in pan-European populations encompassing a range of countries were identified. These methods should be considered for use by future studies focused on evaluating consumption of SSB.

Development of a clinical feeding assessment scale for very young infants in South Africa

PubMed Central

2016-01-01

Background There is a need for validated neonatal feeding assessment instruments in South Africa. A locally developed instrument may contribute to standardised evaluation procedures of high-risk neonates and address needs in resource constrained developing settings. Objective The aim of the study was to develop and validate the content of a clinical feeding assessment scale to diagnose oropharyngeal dysphagia (OPD) in neonates. Method The Neonatal Feeding Assessment Scale (NFAS) was developed using the Delphi method. Five international and South African speech-language therapists (SLTs) formed the expert panel, participating in two rounds of electronic questionnaires to develop and validate the content of the NFAS. Results All participants agreed on the need for the development of a valid clinical feeding assessment instrument to use with the neonatal population. The initial NFAS consisted of 240 items across 8 sections, and after the Delphi process was implemented, the final format was reduced to 211 items across 6 sections. The final format of the NFAS is scored using a binary scoring system guiding the clinician to diagnose the presence or absence of OPD. All members agreed on the format, the scoring system and the feeding constructs addressed in the revised final format of the NFAS. Conclusion The Delphi method and the diverse clinical and research experience of participants could be integrated to develop the NFAS which may be used in clinical practice in South Africa or similar developing contexts. Because of demographically different work settings marked by developed versus developing contexts, participants did not have the same expectations of a clinical dysphagia assessment. The international participants contributed to evidence-based content development. Local participants considered the contextual challenges of South African SLTs entering the field with basic competencies in neonatal dysphagia management, thereby justifying a comprehensive clinical instrument. The NFAS is aimed at clinicians working in Neonatal Intensive Care Units where they manage large caseloads of high-risk neonates. Further validation of the NFAS is recommended to determine its criterion validity in comparison with a widely accepted standard such as the modified barium swallow study. PMID:27796101

Assessing patient capacity to consent to treatment: an integrative review of instruments and tools.

PubMed

Lamont, Scott; Jeon, Yun-Hee; Chiarella, Mary

2013-09-01

To provide a narrative synthesis of research findings on instruments or tools designed to aid assessment of patient capacity to consent to treatment. Capacity assessment is of significant priority within health care as a finding of incapacity is a vehicle for the removal of many of an individual's fundamental rights. Despite there being many instruments and tools available to aid health professionals in the assessment of patient capacity, there are no standardised guidelines from professional bodies that inform the assessment of mental capacity. Integrative review. Primary studies of instruments or tools concerning assessment of patient capacity to consent to treatment, published in English in peer-reviewed journals between January 2005-December 2010, were included in the review. Review papers of capacity assessment instruments were included for years including and prior to 2006. Nineteen instruments were found which assess patient capacity to consent. Key themes were identified in terms of capacity domains assessed, psychometric properties, instrument implementation, patient populations studied and instrument versus clinician judgement. Despite a plethora of capacity assessment instruments and tools available, only a small number of instruments were found to have demonstrated both reliability and validity. Further research is required to improve the validity of existing capacity assessment instruments. Increased attention to patient rights and autonomy arguably places a considerable burden on healthcare professionals to facilitate capacity assessments across a continuum of health care. Despite a plethora of capacity assessment instruments and tools being available to healthcare professionals, a comprehensive assessment requires time and is often difficult in the acute care setting. A strictly formulaic approach to the assessment of capacity is unlikely to capture specific individual nuances; therefore, capacity assessment instruments should support, but not replace, experienced clinical judgement. © 2013 John Wiley & Sons Ltd.

The Infant Motor Profile: A Standardized and Qualitative Method to Assess Motor Behaviour in Infancy

ERIC Educational Resources Information Center

Heineman, Kirsten R.; Bos, Arend F.; Hadders-Algra, Mijna

2008-01-01

A reliable and valid instrument to assess neuromotor condition in infancy is a prerequisite for early detection of developmental motor disorders. We developed a video-based assessment of motor behaviour, the Infant Motor Profile (IMP), to evaluate motor abilities, movement variability, ability to select motor strategies, movement symmetry, and…

Development of the Human Factors Skills for Healthcare Instrument: a valid and reliable tool for assessing interprofessional learning across healthcare practice settings.

PubMed

Reedy, Gabriel B; Lavelle, Mary; Simpson, Thomas; Anderson, Janet E

2017-10-01

A central feature of clinical simulation training is human factors skills, providing staff with the social and cognitive skills to cope with demanding clinical situations. Although these skills are critical to safe patient care, assessing their learning is challenging. This study aimed to develop, pilot and evaluate a valid and reliable structured instrument to assess human factors skills, which can be used pre- and post-simulation training, and is relevant across a range of healthcare professions. Through consultation with a multi-professional expert group, we developed and piloted a 39-item survey with 272 healthcare professionals attending training courses across two large simulation centres in London, one specialising in acute care and one in mental health, both serving healthcare professionals working across acute and community settings. Following psychometric evaluation, the final 12-item instrument was evaluated with a second sample of 711 trainees. Exploratory factor analysis revealed a 12-item, one-factor solution with good internal consistency (α=0.92). The instrument had discriminant validity, with newly qualified trainees scoring significantly lower than experienced trainees ( t (98)=4.88, p<0.001) and was sensitive to change following training in acute and mental health settings, across professional groups (p<0.001). Confirmatory factor analysis revealed an adequate model fit (RMSEA=0.066). The Human Factors Skills for Healthcare Instrument provides a reliable and valid method of assessing trainees' human factors skills self-efficacy across acute and mental health settings. This instrument has the potential to improve the assessment and evaluation of human factors skills learning in both uniprofessional and interprofessional clinical simulation training.

On the Measurement of Power Law Creep Parameters from Instrumented Indentation

NASA Astrophysics Data System (ADS)

Sudharshan Phani, P.; Oliver, W. C.; Pharr, G. M.

2017-11-01

Recently the measurement of the creep response of materials at small scales has received renewed interest largely because the equipment required to perform high-temperature nanomechanical testing has become available to an increasing number of researchers. Despite that increased access, there remain several significant experimental and modeling challenges in small-scale mechanical testing at elevated temperatures that are as yet unresolved. In this regard, relating the creep response observed with high-temperature instrumented indentation experiments to macroscopic uniaxial creep response is of great practical value. In this review, we present an overview of various methods currently being used to measure creep with instrumented indentation, with a focus on geometrically self-similar indenters, and their relative merits and demerits from an experimental perspective. A comparison of the various methods to use those instrumented indentation results to predict the uniaxial power law creep response of a wide range of materials will be presented to assess their validity.

An examination of the hexokinase method for serum glucose assay using external quality assessment data.

PubMed

Westwood, A; Bullock, D G; Whitehead, T P

1986-01-01

Hexokinase methods for serum glucose assay appeared to give slightly but consistently higher inter-laboratory coefficients of variation than all methods combined in the UK External Quality Assessment Scheme; their performance over a two-year period was therefore compared with that for three groups of glucose oxidase methods. This assessment showed no intrinsic inferiority in the hexokinase method. The greater variation may be due to the more heterogeneous group of instruments, particularly discrete analysers, on which the method is used. The Beckman Glucose Analyzer and Astra group (using a glucose oxidase method) showed the least inter-laboratory variability but also the lowest mean value. No comment is offered on the absolute accuracy of any of the methods.

Translation, cross-cultural adaptation to Brazilian- Portuguese and reliability analysis of the instrument Rapid Entire Body Assessment-REBA

PubMed Central

Lamarão, Andressa M.; Costa, Lucíola C. M.; Comper, Maria L. C.; Padula, Rosimeire S.

2014-01-01

Background: Observational instruments, such as the Rapid Entire Body Assessment, quickly assess biomechanical risks present in the workplace. However, in order to use these instruments, it is necessary to conduct the translational/cross-cultural adaptation of the instrument and test its measurement properties. Objectives: To perform the translation and the cross-cultural adaptation to Brazilian-Portuguese and test the reliability of the REBA instrument. Method: The procedures of translation and cross-cultural adaptation to Brazilian-Portuguese were conducted following proposed guidelines that involved translation, synthesis of translations, back translation, committee review and testing of the pre-final version. In addition, reliability and the intra- and inter-rater percent agreement were obtained with the Linear Weighted Kappa Coefficient that was associated with the 95% Confidence Interval and the cross tabulation 2×2. Results : The procedures for translation and adaptation were adequate and the necessary adjustments were conducted on the instrument. The intra- and inter-rater reliability showed values of 0.104 to 0.504, respectively, ranging from very poor to moderate. The percentage agreement values ranged from 5.66% to 69.81%. The percentage agreement was closer to 100% at the item 'upper arm' (69.81%) for the Intra-rater 1 and at the items 'legs' and 'upper arm' for the Intra-rater 2 (62.26%). Conclusions: The processes of translation and cross-cultural adaptation were conducted on the REBA instrument and the Brazilian version of the instrument was obtained. However, despite the reliability of the tests used to correct the translated and adapted version, the reliability values are unacceptable according to the guidelines standard, indicating that the reliability must be re-evaluated. Therefore, caution in the interpretation of the biomechanical risks measured by this instrument should be taken. PMID:25003273

The Development and Validation of an Instrument to Monitor the Implementation of Social Constructivist Learning Environments in Grade 9 Science Classrooms in South Africa

ERIC Educational Resources Information Center

Luckay, Melanie B.; Laugksch, Rudiger C.

2015-01-01

This article describes the development and validation of an instrument that can be used to assess students' perceptions of their learning environment as a means of monitoring and guiding changes toward social constructivist learning environments. The study used a mixed-method approach with priority given to the quantitative data collection. During…

Measuring organizational readiness for knowledge translation in chronic care

PubMed Central

2011-01-01

Background Knowledge translation (KT) is an imperative in order to implement research-based and contextualized practices that can answer the numerous challenges of complex health problems. The Chronic Care Model (CCM) provides a conceptual framework to guide the implementation process in chronic care. Yet, organizations aiming to improve chronic care require an adequate level of organizational readiness (OR) for KT. Available instruments on organizational readiness for change (ORC) have shown limited validity, and are not tailored or adapted to specific phases of the knowledge-to-action (KTA) process. We aim to develop an evidence-based, comprehensive, and valid instrument to measure OR for KT in healthcare. The OR for KT instrument will be based on core concepts retrieved from existing literature and validated by a Delphi study. We will specifically test the instrument in chronic care that is of an increasing importance for the health system. Methods Phase one: We will conduct a systematic review of the theories and instruments assessing ORC in healthcare. The retained theoretical information will be synthesized in a conceptual map. A bibliography and database of ORC instruments will be prepared after appraisal of their psychometric properties according to the standards for educational and psychological testing. An online Delphi study will be carried out among decision makers and knowledge users across Canada to assess the importance of these concepts and measures at different steps in the KTA process in chronic care. Phase two: A final OR for KT instrument will be developed and validated both in French and in English and tested in chronic disease management to measure OR for KT regarding the adoption of comprehensive, patient-centered, and system-based CCMs. Discussion This study provides a comprehensive synthesis of current knowledge on explanatory models and instruments assessing OR for KT. Moreover, this project aims to create more consensus on the theoretical underpinnings and the instrumentation of OR for KT in chronic care. The final product--a comprehensive and valid OR for KT instrument--will provide the chronic care settings with an instrument to assess their readiness to implement evidence-based chronic care. PMID:21752264

Surveying Consumer Satisfaction to Assess Managed-Care Quality: Current Practices

PubMed Central

Gold, Marsha; Wooldridge, Judith

1995-01-01

Growing interest in using consumer satisfaction information to enhance quality of care and promote informed consumer choice has accompanied recent expansions in managed care. This article synthesizes information about consumer satisfaction surveys conducted by managed-care plans, government and other agencies, community groups, and purchasers of care. We discuss survey content, methods, and use of consumer survey information. Differences in the use of consumer surveys preclude one instrument or methodology from meeting all needs. The effectiveness of plan-based surveys could be enhanced by increased information on alternative survey instruments and methods and new methodological studies, such as ones developing risk-adjustment methods. PMID:10151887

Screenee perception and health-related quality of life in colorectal cancer screening: a review.

PubMed

Pizzo, Elena; Pezzoli, Alessandro; Stockbrugger, Reinhold; Bracci, Enrico; Vagnoni, Emidia; Gullini, Sergio

2011-01-01

Screening for colorectal cancer (CRC) has become established to varying degrees in several Western countries for the past 30 years. Because of its effectiveness, screening has been adopted or is planned in a number of other countries. In most countries, the screening method (e.g., fecal occult blood test [FOBT], sigmoidoscopy) is followed by colonoscopy, for verification. In other countries (e.g., United States, Germany), colonoscopy is the preferred first-line investigation method. However, because colonoscopy is considered to be invasive, might be poorly tolerated, and can be associated with complications, the idea of adopting colonoscopy as the primary screening method suffers. Negative effects of screening methods can reduce participation in programs and thereby negate the desired effect on individual and societal health. At present, there is no generally accepted method either to assess the perception and satisfaction of patients screened or the outcome of the screening procedures in CRC. In this review, we discuss the past development and present availability of instruments to measure health-related quality of life (HRQoL), the scarce studies in which such instruments have been used in screening campaigns, and the findings. We suggest the creation of a specific instrument for the assessment of HRQoL in CRC screening. Copyright © 2011 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Ergonomics research methods

NASA Technical Reports Server (NTRS)

Uspenskiy, S. I.; Yermakova, S. V.; Chaynova, L. D.; Mitkin, A. A.; Gushcheva, T. M.; Strelkov, Y. K.; Tsvetkova, N. F.

1973-01-01

Various factors used in ergonomic research are given. They are: (1) anthrometric measurement, (2) polyeffector method of assessing the functional state of man, (3) galvanic skin reaction, (4) pneumography, (5) electromyography, (6) electrooculography, and (7) tachestoscopy. A brief summary is given of each factor and includes instrumentation and results.

Integrating Sensor Monitoring Technology into the Current Air Pollution Regulatory Support Paradigm: Practical Considerations

EPA Science Inventory

The US Environmental Protection Agency (EPA) along with state, local, and tribal governments operate Federal Reference Method (FRM) and Federal Equivalent Method (FEM) instruments to assess compliance with US air pollution standards designed to protect human and ecosystem health....

Methodical Challenges Concerning the Draw-A-Scientist Test: A Critical View about the Assessment and Evaluation of Learners' Conceptions of Scientists

ERIC Educational Resources Information Center

Reinisch, Bianca; Krell, Moritz; Hergert, Susann; Gogolin, Sarah; Krüger, Dirk

2017-01-01

Students' and pre-service teachers' conceptions of scientists have been assessed in a variety of studies. One of the most commonly used instruments is the Draw-A-Scientist Test (DAST) which offers the advantage that no verbal skills are needed by the participants. In some studies, methodical challenges related to the DAST have been discussed; for…

Readiness to tackle chronicity in Spanish health care organisations: a two-year experience with the Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations instrument

PubMed Central

Mira, José Joaquín; Fernández-Cano, Paloma; Contel, Joan Carlos; Guilabert-Mora, Mercedes; Solas-Gaspar, Olga

2015-01-01

Introduction: The Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations instrument was developed to implement the conceptual framework of the Chronic Care Model in the Spanish national health system. It has been used to assess readiness to tackle chronicity in health care organisations. In this study, we use self-assessments at macro-, meso- and micro-management levels to (a) describe the two-year experience with the Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations tool in Spain and (b) assess the validity and reliability of this instrument. Methods: The results from 55 organisational self-assessments were included and described. In addition to that, the internal consistency, reliability and construct validity of Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations were examined using Cronbach's alpha, the Spearman–Brown coefficient and factorial analysis. Results: The obtained scores reflect opportunities for improvement in all dimensions of the instrument. Cronbach's alpha ranged between 0.90 and 0.95 and the Spearman–Brown coefficient ranged between 0.77 and 0.94. All 27 components converged in a second-order factorial solution that explained 53.8% of the total variance, with factorial saturations for the components of between 0.57 and 0.94. Conclusions: Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations is an instrument that allows health care organisations to perform self-assessments regarding their readiness to tackle chronicity and to identify areas for improvement in chronic care. PMID:27118958

Validity and reliability of the Behavior Problems Inventory, the Aberrant Behavior Checklist, and the Repetitive Behavior Scale-Revised among infants and toddlers at risk for intellectual or developmental disabilities: a multi-method assessment approach.

PubMed

Rojahn, Johannes; Schroeder, Stephen R; Mayo-Ortega, Liliana; Oyama-Ganiko, Rosao; LeBlanc, Judith; Marquis, Janet; Berke, Elizabeth

2013-05-01

Reliable and valid assessment of aberrant behaviors is essential in empirically verifying prevention and intervention for individuals with intellectual or developmental disabilities (IDD). Few instruments exist which assess behavior problems in infants. The current longitudinal study examined the performance of three behavior-rating scales for individuals with IDD that have been proven psychometrically sound in older populations: the Aberrant Behavior Checklist (ABC), the Behavior Problems Inventory (BPI-01), and the Repetitive Behavior Scale - Revised (RBS-R). Data were analyzed for 180 between six and 36 months old children at risk for IDD. Internal consistency (Cronbach's α) across the subscales of the three instruments was variable. Test-retest reliability of the three BPI-01 subscales ranged from .68 to .77 for frequency ratings and from .65 to .80 for severity ratings (intraclass correlation coefficients). Using a multitrait-multimethod matrix approach high levels of convergent and discriminant validity across the three instruments was found. As anticipated, there was considerable overlap in the information produced by the three instruments; however, each behavior-rating instrument also contributed unique information. Our findings support using all three scales in conjunction if possible. Copyright © 2013 Elsevier Ltd. All rights reserved.

The development of a knowledge test of depression and its treatment for patients suffering from non-psychotic depression: a psychometric assessment

PubMed Central

Gabriel, Adel; Violato, Claudio

2009-01-01

Background To develop and psychometrically assess a multiple choice question (MCQ) instrument to test knowledge of depression and its treatments in patients suffering from depression. Methods A total of 63 depressed patients and twelve psychiatric experts participated. Based on empirical evidence from an extensive review, theoretical knowledge and in consultations with experts, 27-item MCQ knowledge of depression and its treatment test was constructed. Data collected from the psychiatry experts were used to assess evidence of content validity for the instrument. Results Cronbach's alpha of the instrument was 0.68, and there was an overall 87.8% agreement (items are highly relevant) between experts about the relevance of the MCQs to test patient knowledge on depression and its treatments. There was an overall satisfactory patients' performance on the MCQs with 78.7% correct answers. Results of an item analysis indicated that most items had adequate difficulties and discriminations. Conclusion There was adequate reliability and evidence for content and convergent validity for the instrument. Future research should employ a lager and more heterogeneous sample from both psychiatrist and community samples, than did the present study. Meanwhile, the present study has resulted in psychometrically tested instruments for measuring knowledge of depression and its treatment of depressed patients. PMID:19754944

DEVELOPMENT AND PSYCHOMETRIC TESTING OF A MULTIDIMENSIONAL INSTRUMENT OF PERCEIVED DISCRIMINATION AMONG AFRICAN AMERICANS IN THE JACKSON HEART STUDY

PubMed Central

Sims, Mario; Wyatt, Sharon B.; Gutierrez, Mary Lou; Taylor, Herman A.; Williams, David R.

2009-01-01

Objective Assessing the discrimination-health disparities hypothesis requires psychometrically sound, multidimensional measures of discrimination. Among the available discrimination measures, few are multidimensional and none have adequate psychometric testing in a large, African American sample. We report the development and psychometric testing of the multidimensional Jackson Heart Study Discrimination (JHSDIS) Instrument. Methods A multidimensional measure assessing the occurrence, frequency, attribution, and coping responses to perceived everyday and lifetime discrimination; lifetime burden of discrimination; and effect of skin color was developed and tested in the 5302-member cohort of the Jackson Heart Study. Internal consistency was calculated by using Cronbach α. coefficient. Confirmatory factor analysis established the dimensions, and intercorrelation coefficients assessed the discriminant validity of the instrument. Setting Tri-county area of the Jackson, MS metropolitan statistical area. Results The JHSDIS was psychometrically sound (overall α=.78, .84 and .77, respectively, for the everyday and lifetime subscales). Confirmatory factor analysis yielded 11 factors, which confirmed the a priori dimensions represented. Conclusions The JHSDIS combined three scales into a single multidimensional instrument with good psychometric properties in a large sample of African Americans. This analysis lays the foundation for using this instrument in research that will examine the association between perceived discrimination and CVD among African Americans. PMID:19341164

Content validity of governing in Building Information Modelling (BIM) implementation assessment instrument

NASA Astrophysics Data System (ADS)

Hadzaman, N. A. H.; Takim, R.; Nawawi, A. H.; Mohamad Yusuwan, N.

2018-04-01

BIM governance assessment instrument is a process of analysing the importance in developing BIM governance solution to tackle the existing problems during team collaboration in BIM-based projects. Despite the deployment of integrative technologies in construction industry particularly BIM, it is still insufficient compare to other sectors. Several studies have been established the requirements of BIM implementation concerning all technical and non-technical BIM adoption issues. However, the data are regarded as inadequate to develop a BIM governance framework. Hence, the objective of the paper is to evaluate the content validity of the BIM governance instrument prior to the main data collection. Two methods were employed in the form of literature review and questionnaire survey. Based on the literature review, 273 items with six main constructs are suggested to be incorporated in the BIM governance instrument. The Content Validity Ratio (CVR) scores revealed that 202 out of 273 items are considered as the utmost critical by the content experts. The findings for Item Level Content Validity Index (I-CVI) and Modified Kappa Coefficient however revealed that 257 items in BIM governance instrument are appropriate and excellent. The instrument is highly reliable for future strategies and the development of BIM projects in Malaysia.

Construction of the descriptive system for the Assessment of Quality of Life AQoL-6D utility instrument.

PubMed

Richardson, Jeffrey R J; Peacock, Stuart J; Hawthorne, Graeme; Iezzi, Angelo; Elsworth, Gerald; Day, Neil A

2012-04-17

Multi attribute utility (MAU) instruments are used to include the health related quality of life (HRQoL) in economic evaluations of health programs. Comparative studies suggest different MAU instruments measure related but different constructs. The objective of this paper is to describe the methods employed to achieve content validity in the descriptive system of the Assessment of Quality of Life (AQoL)-6D, MAU instrument. The AQoL program introduced the use of psychometric methods in the construction of health related MAU instruments. To develop the AQoL-6D we selected 112 items from previous research, focus groups and expert judgment and administered them to 316 members of the public and 302 hospital patients. The search for content validity across a broad spectrum of health states required both formative and reflective modelling. We employed Exploratory Factor Analysis and Structural Equation Modelling (SEM) to meet these dual requirements. The resulting instrument employs 20 items in a multi-tier descriptive system. Latent dimension variables achieve sensitive descriptions of 6 dimensions which, in turn, combine to form a single latent QoL variable. Diagnostic statistics from the SEM analysis are exceptionally good and confirm the hypothesised structure of the model. The AQoL-6D descriptive system has good psychometric properties. They imply that the instrument has achieved construct validity and provides a sensitive description of HRQoL. This means that it may be used with confidence for measuring health related quality of life and that it is a suitable basis for modelling utilities for inclusion in the economic evaluation of health programs.

Washington English Language Proficiency Assessment (WELPA). Form C 2015. Interpretation Guide

ERIC Educational Resources Information Center

Washington Office of Superintendent of Public Instruction, 2015

2015-01-01

The "Washington English Language Proficiency Assessment" (WELPA) is a No Child Left Behind (NCLB)-compliant instrument that is used in Grades K-12 as a formal and standardized method of measuring language proficiency. The test results provide important information for classifying English Language Learners (ELLs) and subsequently for…

Using Qualitative Methods for Revising Items in the Hispanic Stress Inventory

ERIC Educational Resources Information Center

Cervantes, Richard C.; Goldbach, Jeremy T.; Padilla, Amado M.

2012-01-01

Despite progress in the development of measures to assess psychosocial stress experiences in the general population, a lack of culturally informed assessment instruments exist to enable clinicians and researchers to detect and accurately diagnosis mental health concerns among Hispanics. The Hispanic Stress Inventory (HSI) was developed…

The Assessment of School Bullying: Using Theory to Inform Practice

ERIC Educational Resources Information Center

Greif, Jennifer L.; Furlong, Michael J.

2006-01-01

This article examines the conceptual basis for and methods used to assess school bullying, including the core bullying behavior elements of repetition, intentionality, and power differential and instruments needed to foster comparability across studies and to improve the precision of intervention capacity. Common bully self-report procedures…

Assessing Nutrition Knowledge and Dietary Habits of Adolescents Using Personal Data Assistants

ERIC Educational Resources Information Center

Murimi, Mary W.; Guthrie, Joanne; Landry, Danielle; Paun, Mihaela M.

2008-01-01

Objective: To assess nutrition knowledge and dietary behaviors of seventh graders in nine randomly selected middle schools in Louisiana. Methods: This descriptive study used personal data assistants (PDAs) to administer a pre-validated questionnaire developed from national instruments to 127 seventh grade students from nine randomly-selected…

Case Study: Longitudinal Treatment of Adolescents with Depression and Inflammatory Bowel Disease

ERIC Educational Resources Information Center

Szigethy, Eva; Carpenter, Johanna; Baum, Emily; Kenney, Elyse; Baptista-Neto, Lourival; Beardslee, William R.; DeMaso, David Ray

2006-01-01

Objective: To assess longitudinal maintenance of improvements in depression, anxiety, global functioning, and physical health perception in 11 adolescents at 6 and 12 months following completion of manual-based cognitive-behavioral therapy. Method: Standardized instruments assessed follow-up changes in depression, anxiety, physical health, and…

Instruments for Assessing Substance Abuse: A Review.

ERIC Educational Resources Information Center

Lambert, Matthew E.; Plescia, Joanne

A review of the assessment literature on substance abuse has revealed 27 separate instruments for assessing substance abuse. These include 22 alcohol instruments and five instruments for assessing other drug abuse. The instruments are listed in a table that provides the title, source, description, population, and psychometric properties of each…

Validation of the diabetes, hypertension and hyperlipidemia (DHL) knowledge instrument in Malaysia

PubMed Central

2012-01-01

Background Patient's knowledge on diabetes, hypertension and hyperlipidaemia and its medications can be used as one of the outcome measures to assess the effectiveness of educational intervention. To date, no such instrument has been validated in Malaysia. Therefore, the aim of this study was to evaluate the validity and reliability of the Diabetes, Hypertension and Hyperlipidemia (DHL) knowledge instrument for assessing the knowledge of patients with type 2 diabetes in Malaysia. Methods A 28-item instrument which comprised of 5 domains: diabetes, hypertension, hyperlipidemia, medications and general issues was designed and tested. One point was given for every correct answer, whilst zero was given for incorrect answers. Scores ranged from 0 to 28, which were then converted into percentage. This was administered to 77 patients with type 2 diabetes in a tertiary hospital, who were on medication(s) for diabetes and who could understand English (patient group), and to 40 pharmacists (professional group). The DHL knowledge instrument was administered again to the patient group after one month. Excluded were patients less than 18 years old. Results Flesch reading ease was 60, which is satisfactory, while the mean difficulty factor(SD) was 0.74(0.21), indicating that DHL knowledge instrument was moderately easy. Internal consistency of the instrument was good, with Cronbach's α = 0.791. The test-retest scores showed no significant difference for 26 out of the 28 items, indicating that the questionnaire has achieved stable reliability. The overall mean(SD) knowledge scores was significantly different between the patient and professional groups [74.35(14.88) versus 93.84(6.47), p < 0.001]. This means that the DHL knowledge instrument could differentiate the knowledge levels of participants. The DHL knowledge instrument shows similar psychometric properties as other validated questionnaires. Conclusions The DHL knowledge instrument shows good promise to be adopted as an instrument for assessing diabetic patients' knowledge concerning their disease conditions and medications in Malaysia. PMID:22361093

Assessing health status and quality-of-life instruments: attributes and review criteria.

PubMed

Aaronson, Neil; Alonso, Jordi; Burnam, Audrey; Lohr, Kathleen N; Patrick, Donald L; Perrin, Edward; Stein, Ruth E

2002-05-01

The field of health status and quality of life (QoL) measurement - as a formal discipline with a cohesive theoretical framework, accepted methods, and diverse applications--has been evolving for the better part of 30 years. To identify health status and QoL instruments and review them against rigorous criteria as a precursor to creating an instrument library for later dissemination, the Medical Outcomes Trust in 1994 created an independently functioning Scientific Advisory Committee (SAC). In the mid-1990s, the SAC defined a set of attributes and criteria to carry out instrument assessments; 5 years later, it updated and revised these materials to take account of the expanding theories and technologies upon which such instruments were being developed. This paper offers the SAC's current conceptualization of eight key attributes of health status and QoL instruments (i.e., conceptual and measurement model; reliability; validity; responsiveness; interpretability; respondent and administrative burden; alternate forms; and cultural and language adaptations) and the criteria by which instruments would be reviewed on each of those attributes. These are suggested guidelines for the field to consider and debate; as measurement techniques become both more familiar and more sophisticated, we expect that experts will wish to update and refine these criteria accordingly.

Measuring emotion regulation and emotional expression in breast cancer patients: A systematic review.

PubMed

Brandão, Tânia; Tavares, Rita; Schulz, Marc S; Matos, Paula Mena

2016-02-01

The important role of emotion regulation and expression in adaptation to breast cancer is now widely recognized. Studies have shown that optimal emotion regulation strategies, including less constrained emotional expression, are associated with better adaptation. Our objective was to systematically review measures used to assess the way women with breast cancer regulate their emotions. This systematic review was conducted in accordance with PRISMA guidelines. Nine different databases were searched. Data were independently extracted and assessed by two researchers. English-language articles that used at least one instrument to measure strategies to regulate emotions in women with breast cancer were included. Of 679 abstracts identified 59 studies were deemed eligible for inclusion. Studies were coded regarding their objectives, methods, and results. We identified 16 instruments used to measure strategies of emotion regulation and expression. The most frequently employed instrument was the Courtauld Emotional Control Scale. Few psychometric proprieties other than internal consistency were reported for most instruments. Many studies did not include important information regarding descriptive characteristics and psychometric properties of the instruments used. The instruments used tap different aspects of emotion regulation. Specific instruments should be explored further with regard to content, validity, and reliability in the context of breast cancer. Copyright © 2015 Elsevier Ltd. All rights reserved.

Functional assessment of chronic illness therapy—the fatigue scale exhibits stronger associations with clinical parameters in chronic dialysis patients compared to other fatigue-assessing instruments

PubMed Central

Chao, Chia-Ter; Huang, Jenq-Wen

2016-01-01

Background. Patients with end-stage renal disease (ESRD) have a high symptom burden, among which fatigue is highly prevalent. Many fatigue-assessing instruments exist, but comparisons among instruments in this patient population have yet to be investigated. Methods. ESRD patients under chronic hemodialysis were prospectively enrolled and seven types of fatigue instruments were administered: Brief Fatigue Inventory (BFI), Functional Assessment of Chronic Illness Therapy–Fatigue (FACIT-F), Fatigue Severity Scale (FSS), Lee Fatigue Scale (LFS), Fatigue Questionnaire (FQ), Fatigue Symptom Inventory (FSI), and Short-Form 36-Vitality (SF36-V). Using these instruments, we investigated the correlation between fatigue severity and clinical/biochemical parameters, including demographic/comorbidity profile, dialysis-related complications, and frailty severity. We used regression analysis with serum albumin and frailty severity as the dependent variables to investigate the independent correlations. Results. A total of 46 ESRD patients were enrolled (average age of 67 ± 11.6 years), and 50% of them had type 2 diabetes mellitus. Results from the seven tested instruments showed high correlation with each other. We found that the fatigue severity by FACIT-F was significantly associated with age (p = 0.03), serum albumin (p = 0.003) and creatinine (p = 0.02) levels, while SF36-V scores were also significantly associated with age (p = 0.02) and serum creatinine levels (p = 0.04). However, the fatigue severity measured by the FSS, FSI, FQ, BFI, and LFS did not exhibit these associations. Moreover, regression analysis showed that only FACIT-F scores were independently associated with serum albumin levels and frailty severity in ESRD patients. Conclusion. Among the seven fatigue-assessing instruments, only the FACIT-F yielded results that demonstrated significant and independent associations with important outcome-related features in ESRD patients. PMID:26998414

Physiologic measures of sexual function in women: a review.

PubMed

Woodard, Terri L; Diamond, Michael P

2009-07-01

To review and describe physiologic measures of assessing sexual function in women. Literature review. Studies that use instruments designed to measure female sexual function. Women participating in studies of female sexual function. Various instruments that measure physiologic features of female sexual function. Appraisal of the various instruments, including their advantages and disadvantages. Many unique physiologic methods of evaluating female sexual function have been developed during the past four decades. Each method has its benefits and limitations. Many physiologic methods exist, but most are not well-validated. In addition there has been an inability to correlate most physiologic measures with subjective measures of sexual arousal. Furthermore, given the complex nature of the sexual response in women, physiologic measures should be considered in context of other data, including the history, physical examination, and validated questionnaires. Nonetheless, the existence of appropriate physiologic measures is vital to our understanding of female sexual function and dysfunction.

Validation of an instrument to assess evidence-based practice knowledge, attitudes, access, and confidence in the dental environment.

PubMed

Hendricson, William D; Rugh, John D; Hatch, John P; Stark, Debra L; Deahl, Thomas; Wallmann, Elizabeth R

2011-02-01

This article reports the validation of an assessment instrument designed to measure the outcomes of training in evidence-based practice (EBP) in the context of dentistry. Four EBP dimensions are measured by this instrument: 1) understanding of EBP concepts, 2) attitudes about EBP, 3) evidence-accessing methods, and 4) confidence in critical appraisal. The instrument-the Knowledge, Attitudes, Access, and Confidence Evaluation (KACE)-has four scales, with a total of thirty-five items: EBP knowledge (ten items), EBP attitudes (ten), accessing evidence (nine), and confidence (six). Four elements of validity were assessed: consistency of items within the KACE scales (extent to which items within a scale measure the same dimension), discrimination (capacity to detect differences between individuals with different training or experience), responsiveness (capacity to detect the effects of education on trainees), and test-retest reliability. Internal consistency of scales was assessed by analyzing responses of second-year dental students, dental residents, and dental faculty members using Cronbach coefficient alpha, a statistical measure of reliability. Discriminative validity was assessed by comparing KACE scores for the three groups. Responsiveness was assessed by comparing pre- and post-training responses for dental students and residents. To measure test-retest reliability, the full KACE was completed twice by a class of freshman dental students seventeen days apart, and the knowledge scale was completed twice by sixteen faculty members fourteen days apart. Item-to-scale consistency ranged from 0.21 to 0.78 for knowledge, 0.57 to 0.83 for attitude, 0.70 to 0.84 for accessing evidence, and 0.87 to 0.94 for confidence. For discrimination, ANOVA and post hoc testing by the Tukey-Kramer method revealed significant score differences among students, residents, and faculty members consistent with education and experience levels. For responsiveness to training, dental students and residents demonstrated statistically significant changes, in desired directions, from pre- to post-test. For the student test-retest, Pearson correlations for KACE scales were as follows: knowledge 0.66, attitudes 0.66, accessing evidence 0.74, and confidence 0.76. For the knowledge scale test-retest by faculty members, the Pearson correlation was 0.79. The construct validity of the KACE is equivalent to that of instruments that assess similar EBP dimensions in medicine. Item consistency for the knowledge scale was more variable than for other KACE scales, a finding also reported for medically oriented EBP instruments. We conclude that the KACE has good discriminative validity, responsiveness to training effects, and test-retest reliability.

Sharing clinical information across care settings: the birth of an integrated assessment system

PubMed Central

Gray, Leonard C; Berg, Katherine; Fries, Brant E; Henrard, Jean-Claude; Hirdes, John P; Steel, Knight; Morris, John N

2009-01-01

Background Population ageing, the emergence of chronic illness, and the shift away from institutional care challenge conventional approaches to assessment systems which traditionally are problem and setting specific. Methods From 2002, the interRAI research collaborative undertook development of a suite of assessment tools to support assessment and care planning of persons with chronic illness, frailty, disability, or mental health problems across care settings. The suite constitutes an early example of a "third generation" assessment system. Results The rationale and development strategy for the suite is described, together with a description of potential applications. To date, ten instruments comprise the suite, each comprising "core" items shared among the majority of instruments and "optional" items that are specific to particular care settings or situations. Conclusion This comprehensive suite offers the opportunity for integrated multi-domain assessment, enabling electronic clinical records, data transfer, ease of interpretation and streamlined training. PMID:19402891

[The methodological assessment and qualitative evaluation of psychometric performance tests based on the example of modern tests that assess reading and spelling skills].

PubMed

Galuschka, Katharina; Rothe, Josefine; Schulte-Körne, Gerd

2015-09-01

This article looks at a means of objectively evaluating the quality of psychometric tests. This approach enables users to evaluate psychometric tests based on their methodological characteristics, in order to decide which instrument should be used. Reading and spelling assessment tools serve as examples. The paper also provides a review of German psychometric tests for the assessment of reading and spelling skills. This method facilitates the identification of psychometric tests.of high methodological quality which can be used for the assessment of reading and spelling skills. Reading performance should ideally be assessed with the following instruments: ELFE 1-6, LGVT 6-12, LESEN 6-7, LESEN 8-9, or WLLP-R. The tests to be used for the evaluation of spelling skills are DERET 1-2+, DERET 3-4+, WRT 1+, WRT 2+, WRT 3+, WRT 4+ or HSP 1-10.

Providing Evidence in the Moral Domain

ERIC Educational Resources Information Center

Cooper, Diane L.; Liddell, Debora L.; Davis, Tiffany J.; Pasquesi, Kira

2012-01-01

In this era of increased accountability, it is important to consider how student affairs researches and assesses the outcomes of efforts to increase moral competence. This article examines both qualitative and quantitative inquiry methods for measuring moral development. The authors review the instrumentation and methods typically used to measure…

Teaching Analytical Method Development in an Undergraduate Instrumental Analysis Course

ERIC Educational Resources Information Center

Lanigan, Katherine C.

2008-01-01

Method development and assessment, central components of carrying out chemical research, require problem-solving skills. This article describes a pedagogical approach for teaching these skills through the adaptation of published experiments and application of group-meeting style discussions to the curriculum of an undergraduate instrumental…

Development and validation of self-reported line drawings for assessment of knee malalignment and foot rotation: a cross-sectional comparative study

PubMed Central

2010-01-01

Background For large scale epidemiological studies clinical assessments and radiographs can be impractical and expensive to apply to more than just a sample of the population examined. The study objectives were to develop and validate two novel instruments for self-reported knee malalignment and foot rotation suitable for use in questionnaire studies of knee pain and osteoarthritis. Methods Two sets of line drawings were developed using similar methodology. Each instrument consisted of an explanatory question followed by a set of drawings showing straight alignment, then two each at 7.5° angulation and 15° angulation in the varus/valgus (knee) and inward/outward (foot) directions. Forty one participants undertaking a community study completed the instruments on two occasions. Participants were assessed once by a blinded expert clinical observer with demonstrated excellent reproducibility. Validity was assessed by sensitivity, specificity and likelihood ratio (LR) using the observer as the reference standard. Reliability was assessed using weighted kappa (κ). Knee malalignment was measured on 400 knee radiographs. General linear model was used to assess for the presence of a linear increase in knee alignment angle (measured medially) from self-reported severe varus to mild varus, straight, mild valgus and severe valgus deformity. Results Observer reproducibility (κ) was 0.89 and 0.81 for the knee malalignment and foot rotation instruments respectively. Self-reported participant reproducibility was also good for the knee (κ 0.73) and foot (κ 0.87) instruments. Validity was excellent for the knee malalignment instrument, with a sensitivity of 0.74 (95%CI 0.54, 0.93) and specificity of 0.97 (95%CI 0.94, 1.00). Similarly the foot rotation instrument was also found to have high sensitivity (0.92, 95%CI 0.83, 1.01) and specificity (0.96, 95%CI 0.93, 1.00). The knee alignment angle increased progressively from self reported severe varus to mild varus, straight, mild valgus and severe valgus knee malalignment (ptrend <0.001). Conclusions The two novel instruments appear to provide a valid and reliable assessment of self-reported knee malalignment and foot rotation, and may have a practical use in epidemiological studies. PMID:20565825

Validation of a two-dimensional liquid chromatography method for quality control testing of pharmaceutical materials.

PubMed

Yang, Samuel H; Wang, Jenny; Zhang, Kelly

2017-04-07

Despite the advantages of 2D-LC, there is currently little to no work in demonstrating the suitability of these 2D-LC methods for use in a quality control (QC) environment for good manufacturing practice (GMP) tests. This lack of information becomes more critical as the availability of commercial 2D-LC instrumentation has significantly increased, and more testing facilities begin to acquire these 2D-LC capabilities. It is increasingly important that the transferability of developed 2D-LC methods be assessed in terms of reproducibility, robustness and performance across different laboratories worldwide. The work presented here focuses on the evaluation of a heart-cutting 2D-LC method used for the analysis of a pharmaceutical material, where a key, co-eluting impurity in the first dimension ( 1 D) is resolved from the main peak and analyzed in the second dimension ( 2 D). A design-of-experiments (DOE) approach was taken in the collection of the data, and the results were then modeled in order to evaluate method robustness using statistical modeling software. This quality by design (QBD) approach gives a deeper understanding of the impact of these 2D-LC critical method attributes (CMAs) and how they affect overall method performance. Although there are multiple parameters that may be critical from method development point of view, a special focus of this work is devoted towards evaluation of unique 2D-LC critical method attributes from method validation perspective that transcend conventional method development and validation. The 2D-LC method attributes are evaluated for their recovery, peak shape, and resolution of the two co-eluting compounds in question on the 2 D. In the method, linearity, accuracy, precision, repeatability, and sensitivity are assessed along with day-to-day, analyst-to-analyst, and lab-to-lab (instrument-to-instrument) assessments. The results of this validation study demonstrate that the 2D-LC method is accurate, sensitive, and robust and is ultimately suitable for QC testing with good method transferability. Copyright © 2017 Elsevier B.V. All rights reserved.

Validity and reliability assessment of a peer evaluation method in team-based learning classes.

PubMed

Yoon, Hyun Bae; Park, Wan Beom; Myung, Sun-Jung; Moon, Sang Hui; Park, Jun-Bean

2018-03-01

Team-based learning (TBL) is increasingly employed in medical education because of its potential to promote active group learning. In TBL, learners are usually asked to assess the contributions of peers within their group to ensure accountability. The purpose of this study is to assess the validity and reliability of a peer evaluation instrument that was used in TBL classes in a single medical school. A total of 141 students were divided into 18 groups in 11 TBL classes. The students were asked to evaluate their peers in the group based on evaluation criteria that were provided to them. We analyzed the comments that were written for the highest and lowest achievers to assess the validity of the peer evaluation instrument. The reliability of the instrument was assessed by examining the agreement among peer ratings within each group of students via intraclass correlation coefficient (ICC) analysis. Most of the students provided reasonable and understandable comments for the high and low achievers within their group, and most of those comments were compatible with the evaluation criteria. The average ICC of each group ranged from 0.390 to 0.863, and the overall average was 0.659. There was no significant difference in inter-rater reliability according to the number of members in the group or the timing of the evaluation within the course. The peer evaluation instrument that was used in the TBL classes was valid and reliable. Providing evaluation criteria and rules seemed to improve the validity and reliability of the instrument.

Review of the tactical evaluation tools for youth players, assessing the tactics in team sports: football.

PubMed

González-Víllora, Sixto; Serra-Olivares, Jaime; Pastor-Vicedo, Juan Carlos; da Costa, Israel Teoldo

2015-01-01

For sports assessment to be comprehensive, it must address all variables of sports development, such as psychological, social-emotional, physical and physiological, technical and tactical. Tactical assessment has been a neglected variable until the 1980s or 1990s. In the last two decades (1995-2015), the evolution of tactical assessment has grown considerably, given its importance in game performance. The aim of this paper is to compile and analyze different tactical measuring tools in team sports, particularly in soccer, through a bibliographical review. Six tools have been selected on five different criteria: (1) Instruments which assess tactics, (2) The studies have an evolution approach related to the tactical principles, (3) With a valid and reliable method, (4) The existence of publications mentioning the tool in the method, v. Applicable in different sports contexts. All six tools are structured around seven headings: introduction, objective(s), tactical principles, materials, procedures, instructions/rules of the game and published studies. In conclusion, the teaching-learning processes more tactical oriented have useful tactical assessment instrument in the literature. The selection of one or another depends some context information, like age and level of expertise of the players.

Comparison of the effect of three autogenous bone harvesting methods on cell viability in rabbits

PubMed Central

Moradi Haghgoo, Janet; Arabi, Seyed Reza; Hosseinipanah, Seyyed Mohammad; Solgi, Ghasem; Rastegarfard, Neda; Farhadian, Maryam

2017-01-01

Background. This study was designed to compare the viability of autogenous bone grafts, harvested using different methods, in order to determine the best harvesting technique with respect to more viable cells. Methods. In this animal experimental study, three harvesting methods, including manual instrument (chisel), rotary device and piezosurgery, were used for harvesting bone grafts from the lateral body of the mandible on the left and right sides of 10 rabbits. In each group, 20 bone samples were collected and their viability was assessed using MTS kit. Statistical analyses, including ANOVA and post hoc Tukey tests, were used for evaluating significant differences between the groups. Results. One-way ANOVA showed significant differences between all the groups (P=0.000). Data analysis using post hoc Tukey tests indicated that manual instrument and piezosurgery had no significant differences with regard to cell viability (P=0.749) and the cell viability in both groups was higher than that with the use of a rotary instrument (P=0.000). Conclusion. Autogenous bone grafts harvested with a manual instrument and piezosurgery had more viable cells in comparison to the bone chips harvested with a rotary device. PMID:28748046

Development of a Simple 12-Item Theory-Based Instrument to Assess the Impact of Continuing Professional Development on Clinical Behavioral Intentions

PubMed Central

Légaré, France; Borduas, Francine; Freitas, Adriana; Jacques, André; Godin, Gaston; Luconi, Francesca; Grimshaw, Jeremy

2014-01-01

Background Decision-makers in organizations providing continuing professional development (CPD) have identified the need for routine assessment of its impact on practice. We sought to develop a theory-based instrument for evaluating the impact of CPD activities on health professionals' clinical behavioral intentions. Methods and Findings Our multipronged study had four phases. 1) We systematically reviewed the literature for instruments that used socio-cognitive theories to assess healthcare professionals' clinically-oriented behavioral intentions and/or behaviors; we extracted items relating to the theoretical constructs of an integrated model of healthcare professionals' behaviors and removed duplicates. 2) A committee of researchers and CPD decision-makers selected a pool of items relevant to CPD. 3) An international group of experts (n = 70) reached consensus on the most relevant items using electronic Delphi surveys. 4) We created a preliminary instrument with the items found most relevant and assessed its factorial validity, internal consistency and reliability (weighted kappa) over a two-week period among 138 physicians attending a CPD activity. Out of 72 potentially relevant instruments, 47 were analyzed. Of the 1218 items extracted from these, 16% were discarded as improperly phrased and 70% discarded as duplicates. Mapping the remaining items onto the constructs of the integrated model of healthcare professionals' behaviors yielded a minimum of 18 and a maximum of 275 items per construct. The partnership committee retained 61 items covering all seven constructs. Two iterations of the Delphi process produced consensus on a provisional 40-item questionnaire. Exploratory factorial analysis following test-retest resulted in a 12-item questionnaire. Cronbach's coefficients for the constructs varied from 0.77 to 0.85. Conclusion A 12-item theory-based instrument for assessing the impact of CPD activities on health professionals' clinical behavioral intentions showed adequate validity and reliability. Further studies could assess its responsiveness to behavior change following CPD activities and its capacity to predict health professionals' clinical performance. PMID:24643173

An Integrative Review of Self-Efficacy Measurement Instruments in Youth with Type 1 Diabetes (T1DM)

PubMed Central

Rasbach, Lisa; Jenkins, Carolyn; Laffel, Lori

2014-01-01

Purpose The purpose of this study is to assess the extant literature on instruments used to measure self-efficacy in youth with type 1 diabetes (T1DM) and their caregivers and to critically evaluate these measurements. Methods An integrative review (2003–2013) was conducted searching PsycINFO, Cumulative Index to Nursing and Allied Health Literature (CINAHL), and U.S. National Library of Medicine PubMed service (PubMed) databases using key words diabetes, type 1 diabetes, and self-efficacy. The authors reviewed the resulting294 references for inclusion criteria of (a) sample of youth with T1DM or sample of caregivers of youth with T1DM, (b) description of the self-efficacy instrument as primary research, and (c) the instrument measured self-efficacy specifically related to diabetes management. Forty-five articles out of the initial 294 met criteria. Results Of the 45 articles, 10 different self-efficacy instruments were identified. The primary theoretical framework used was Bandura’s social cognitive theory and model of self-efficacy. Most participants were white middle class T1DM youth. Evaluations to assess validity often were not reported; however, a majority of studies reported high internal consistency of the instruments. Conclusions Sample homogeneity could limit the applicability of results to certain patient populations. Further psychometric analysis, including validity assessments, should be conducted in more diverse samples. Development of valid and reliable instruments for measuring self-efficacy that are sensitive to change across a wider caregiver base over time is necessary. While this review examined reliable and valid instruments used in research, future opportunities include evaluation of measuring self-efficacy in T1DM youth exposed to recent advances in diabetes management technologies. PMID:25216655

Validation of the translation of an instrument to measure reliability of written information on treatment choices: a study on attention deficit/hyperactivity disorder (ADHD).

PubMed

Montoya, A; Llopis, N; Gilaberte, I

2011-12-01

DISCERN is an instrument designed to help patients assess the reliability of written information on treatment choices. Originally created in English, there is no validated Spanish version of this instrument. This study seeks to validate the Spanish translation of the DISCERN instrument used as a primary measure on a multicenter study aimed to assess the reliability of web-based information on treatment choices for attention deficit/hyperactivity disorder (ADHD). We used a modified version of a method for validating translated instruments in which the original source-language version is formally compared with the back-translated source-language version. Each item was ranked in terms of comparability of language, similarity of interpretability, and degree of understandability. Responses used Likert scales ranging from 1 to 7, where 1 indicates the best interpretability, language and understandability, and 7 indicates the worst. Assessments were performed by 20 raters fluent in the source language. The Spanish translation of DISCERN, based on ratings of comparability, interpretability and degree of understandability (mean score (SD): 1.8 (1.1), 1.4 (0.9) and 1.6 (1.1), respectively), was considered extremely comparable. All items received a score of less than three, therefore no further revision of the translation was needed. The validation process showed that the quality of DISCERN translation was high, validating the comparable language of the tool translated on assessing written information on treatment choices for ADHD.

Preliminary report of a Web-based instrument to assess and teach knowledge and clinical thinking to medical student

PubMed Central

Tokunaga, Hironobu; Ando, Hirotaka; Obika, Mikako; Miyoshi, Tomoko; Tokuda, Yasuharu; Bautista, Miho; Kataoka, Hitomi; Terasawa, Hidekazu

2014-01-01

Objectives We report the preliminary development of a unique Web-based instrument for assessing and teaching knowledge and developing clinical thinking called the “Sequential Questions and Answers” (SQA) test. Included in this feasibility report are physicians’ answers to the Sequential Questions and Answers pre- and posttests and their brief questionnaire replies. Methods The authors refined the SQA test case scenario for content, ease of modifications of case scenarios, test uploading and answer retrieval. Eleven geographically distant physicians evaluated the SQA test, taking the pretest and posttest within two weeks. These physicians completed a brief questionnaire about the SQA test. Results Eleven physicians completed the SQA pre- and posttest; all answers were downloaded for analysis. They reported the ease of website login and navigating within the test module together with many helpful suggestions. Their average posttest score gain was 53% (p=0.012). Conclusions We report the successful launch of a unique Web-based instrument referred to as the Sequential Questions and Answers test. This distinctive test combines teaching organization of the clinical narrative into an assessment tool that promotes acquiring medical knowledge and clinical thinking. We successfully demonstrated the feasibility of geographically distant physicians to access the SQA instrument. The physicians’ helpful suggestions will be added to future SQA test versions. Medical schools might explore the integration of this multi-language-capable SQA assessment and teaching instrument into their undergraduate medical curriculum. PMID:25341203

Towards a standardized method to assess straylight in earth observing optical instruments

NASA Astrophysics Data System (ADS)

Caron, J.; Taccola, M.; Bézy, J.-L.

2017-09-01

Straylight is a spurious effect that can seriously degrade the radiometric accuracy achieved by Earth observing optical instruments, as a result of the high contrast in the observed Earth radiance scenes and spectra. It is considered critical for several ESA missions such as Sentinel-5, FLEX and potential successors to CarbonSat. Although it is traditionally evaluated by Monte-Carlo simulations performed with commercial softwares (e.g. ASAP, Zemax, LightTools), semi-analytical approximate methods [1,2] have drawn some interest in recent years due to their faster computing time and the greater insight they provide in straylight mechanisms. They cannot replace numerical simulations, but may be more advantageous in contexts where many iterations are needed, for instance during the early phases of an instrument design.

Mechanical behavior of three nickel-titanium rotary files: A comparison of numerical simulation with bending and torsion tests.

PubMed

de Arruda Santos, Leandro; López, Javier Bayod; de Las Casas, Estevam Barbosa; de Azevedo Bahia, Maria Guiomar; Buono, Vicente Tadeu Lopes

2014-04-01

To assess the flexibility and torsional stiffness of three nickel-titanium rotary instruments by finite element analysis and compare the numerical results with the experiment. Mtwo (VDW, Munich, Germany) and RaCe (FKG Dentaire, La-Chaux-de-Fonds, Switzerland) size 25, .06 taper (0.25-mm tip diameter, 0.06% conicity) and PTU F1 (Dentsply Maillefer, Ballaigues, Switzerland) instruments were selected for this study. Experimental tests to assess the flexibility and torsional stiffness of the files were performed according to specification ISO 3630-1. Geometric models for finite element analysis were obtained by micro-CT scanning. Boundary conditions for the numerical analysis were based on the specification ISO 3630-1. A good agreement between the simulation and the experiment moment-displacement curves was found for the three types of instruments studied. RaCe exhibited the highest flexibility and PTU presented the highest torsional stiffness. Maximum values of von Mises stress were found for the PTU F1 file (1185MPa) under bending, whereas the values of von Mises stress for the three instruments were quite similar under torsion. The stress patterns proved to be different in Mtwo under bending, according to the displacement orientation. The favorable agreement found between simulation and experiment for the three types of instruments studied confirmed the potential of the numerical method to assess the mechanical behavior of endodontic instruments. Thus, a methodology is established to predict the failure of the instruments under bending and torsion. Copyright © 2014 Elsevier B.V. All rights reserved.

Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems—I-MeDeSA

PubMed Central

Zachariah, Marianne; Seidling, Hanna M; Neri, Pamela M; Cresswell, Kathrin M; Duke, Jon; Bloomrosen, Meryl; Volk, Lynn A; Bates, David W

2011-01-01

Background Medication-related decision support can reduce the frequency of preventable adverse drug events. However, the design of current medication alerts often results in alert fatigue and high over-ride rates, thus reducing any potential benefits. Methods The authors previously reviewed human-factors principles for relevance to medication-related decision support alerts. In this study, instrument items were developed for assessing the appropriate implementation of these human-factors principles in drug–drug interaction (DDI) alerts. User feedback regarding nine electronic medical records was considered during the development process. Content validity, construct validity through correlation analysis, and inter-rater reliability were assessed. Results The final version of the instrument included 26 items associated with nine human-factors principles. Content validation on three systems resulted in the addition of one principle (Corrective Actions) to the instrument and the elimination of eight items. Additionally, the wording of eight items was altered. Correlation analysis suggests a direct relationship between system age and performance of DDI alerts (p=0.0016). Inter-rater reliability indicated substantial agreement between raters (κ=0.764). Conclusion The authors developed and gathered preliminary evidence for the validity of an instrument that measures the appropriate use of human-factors principles in the design and display of DDI alerts. Designers of DDI alerts may use the instrument to improve usability and increase user acceptance of medication alerts, and organizations selecting an electronic medical record may find the instrument helpful in meeting their clinicians' usability needs. PMID:21946241

Instrumental and Non-Instrumental Evaluation of 4-Meter Walking Speed in Older Individuals

PubMed Central

Maggio, Marcello; Ceda, Gian Paolo; Ticinesi, Andrea; De Vita, Francesca; Gelmini, Giovanni; Costantino, Cosimo; Meschi, Tiziana; Kressig, Reto W.; Cesari, Matteo; Fabi, Massimo; Lauretani, Fulvio

2016-01-01

Background Manual measurement of 4-meter gait speed by a stopwatch is the gold standard test for functional assessment in older adults. However, the accuracy of this technique may be biased by several factors, including intra- and inter-operator variability. Instrumental techniques of measurement using accelerometers may have a higher accuracy. Studies addressing the concordance between these two techniques are missing. The aim of the present community-based observational study was to compare manual and instrumental measurements of 4-meter gait speed in older individuals and to assess their relationship with other indicators of physical performance. Methods One-hundred seventy-two (69 men, 103 women) non-disabled community-dwellers aged ≥65 years were enrolled. They underwent a comprehensive geriatric assessment including physical function by Short Physical Performance Battery (SPPB), hand grip strength, and 6-minute walking test (6MWT). Timed usual walking speed on a 4-meter course was assessed by using both a stopwatch (4-meter manual measurement, 4-MM) and a tri-axial accelerometer (4-meter automatic measurement, 4-MA). Correlations between these performance measures were evaluated separately in men and women by partial correlation coefficients. Results In both genders, 4-MA was associated with 4-MM (men r = 0.62, p<0.001; women r = 0.73, p<0.001), handgrip strength (men r = 0.40, p = 0.005; women r = 0.29, p = 0.001) and 6MWT (men r = 0.50, p = 0.0004; women r = 0.22, p = 0.048). 4-MM was associated with handgrip strength and 6MWT in both men and women. Considering gait speed <0.6 m/s as diagnostic of dismobility syndrome, the two methods of assessment disagreed, with a different categorization of subjects, in 19% of men and 23% of women. The use of accelerometer resulted in 29 (13 M, 16 F) additional diagnoses of dismobility, compared with the 4-MM. Conclusions In an older population, the concordance of gait speeds manually or instrumentally assessed is not optimal. The results suggest that manual measures might lead to misclassification of a substantial number of subjects. However, longitudinal studies using standardized and validated procedures aimed at the comparison of different techniques are needed before recommending the use of accelerometers in comprehensive geriatric assessment. PMID:27077744

Initial evaluation of psychometric properties of a structured work task application for the Assessment of Work Performance in a constructed environment.

PubMed

Karlsson, Elin A; Liedberg, Gunilla M; Sandqvist, Jan L

2017-06-22

The Swedish Social Insurance Administration has developed a new assessment tool for sickness insurance. This study is a part of the initial evaluation of the application, called the Assessment of Work Performance, Structured Activities, and focuses on evaluation of the psychometric properties of social validity, content validity, and utility. This was a qualitative study using semi-structured telephone interviews with occupational therapists. A convenience sample was used and participants who fulfilled inclusion criteria (n = 15) were interviewed. Data were analyzed using content analysis with a directed approach. The results indicate that the application provides valuable information and that it is socially valid. Assessors found work tasks suitable for a diverse group of clients and reported that clients accepted the assessments. Improvements were suggested, for example, expanding the application with more work tasks. The instrument has benefits; however, further development is desired. The use of a constructed environment in assessments may be a necessary option to supplement a real environment. But depending on organizational factors such as time and other resources, the participants had different opportunities to do so. Further evaluations regarding ecological validity are essential to ensure that assessments are fair and realistic when using constructed environments. Implications for rehabilitation This study indicates that assessment in a constructed environment can provide a secure and protected context for clients being assessed. Psychometric evaluations are a never-ending process and this assessment instrument needs further development. However, this initial evaluation provides guidance in development of the instrument but also what studies to give priority to. It is important to evaluate social validity in order to ensure that clients and assessors perceive assessment methods fair and meaningful. In this study, participants found the work tasks appropriate and usable when assessing their clients but client's perspective must also be included in following studies. This assessment instrument is the only activity-based assessment instrument within the Swedish Social Security Insurance. Psychometric evaluations are important since it affects so many individuals in Sweden.

Use of Geriatric Assessment for Older Adults in the Oncology Setting: A Systematic Review

PubMed Central

2012-01-01

Background Geriatric assessment is a multidisciplinary diagnostic process that evaluates the older adult’s medical, psychological, social, and functional capacity. No systematic review of the use of geriatric assessment in oncology has been conducted. The goals of this systematic review were: 1) to provide an overview of all geriatric assessment instruments used in the oncology setting; 2) to examine the feasibility and psychometric properties of those instruments; and 3) to systematically evaluate the effectiveness of geriatric assessment in predicting or modifying outcomes (including the impact on treatment decision making, toxicity of treatment, and mortality). Methods We searched Medline, Embase, Psychinfo, Cinahl, and the Cochrane Library for articles published in English, French, Dutch, or German between January 1, 1996, and November 16, 2010, reporting on cross-sectional, longitudinal, interventional, or observational studies that assessed the feasibility or effectiveness of geriatric assessment instruments. The quality of articles was evaluated using relevant quality assessment frameworks. Results We identified 83 articles that reported on 73 studies. The quality of most studies was poor to moderate. Eleven studies examined psychometric properties or diagnostic accuracy of the geriatric assessment instruments used. The assessment generally took 10–45min. Geriatric assessment was most often completed to describe a patient’s health and functional status. Specific domains of geriatric assessment were associated with treatment toxicity in 6 of 9 studies and with mortality in 8 of 16 studies. Of the four studies that examined the impact of geriatric assessment on the cancer treatment decision, two found that geriatric assessment impacted 40%–50% of treatment decisions. Conclusion Geriatric assessment in the oncology setting is feasible, and some domains are associated with adverse outcomes. However, there is limited evidence that geriatric assessment impacted treatment decision making. Further research examining the effectiveness of geriatric assessment on treatment decisions and outcomes is needed. PMID:22851269

Measuring School Functioning in Students with Chronic Fatigue Syndrome: A Systematic Review

ERIC Educational Resources Information Center

Tollit, Michelle; Politis, Jennifer; Knight, Sarah

2018-01-01

Background: It is often surmised that school functioning is significantly impacted in chronic fatigue syndrome (CFS); however, how this phenomenon manifests itself has rarely been characterized. Methods: This systematic review synthesized and critically appraised methods, constructs, and instruments used to assess school functioning in students…

Measuring team factors thought to influence the success of quality improvement in primary care: a systematic review of instruments

PubMed Central

2013-01-01

Background Measuring team factors in evaluations of Continuous Quality Improvement (CQI) may provide important information for enhancing CQI processes and outcomes; however, the large number of potentially relevant factors and associated measurement instruments makes inclusion of such measures challenging. This review aims to provide guidance on the selection of instruments for measuring team-level factors by systematically collating, categorizing, and reviewing quantitative self-report instruments. Methods Data sources: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments; reference lists of systematic reviews; and citations and references of the main report of instruments. Study selection: To determine the scope of the review, we developed and used a conceptual framework designed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). We included papers reporting development or use of an instrument measuring factors relevant to teamwork. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarizing and comparing instruments. Instrument content was categorized using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care. Results We identified 192 potentially relevant instruments, 170 of which were analyzed to develop the taxonomy. Eighty-one instruments measured constructs relevant to CQI teams in primary care, with content covering teamwork context (45 instruments measured enabling conditions or attitudes to teamwork), team process (57 instruments measured teamwork behaviors), and team outcomes (59 instruments measured perceptions of the team or its effectiveness). Forty instruments were included for full review, many with a strong theoretical basis. Evidence supporting measurement properties was limited. Conclusions Existing instruments cover many of the factors hypothesized to contribute to QI success. With further testing, use of these instruments measuring team factors in evaluations could aid our understanding of the influence of teamwork on CQI outcomes. Greater consistency in the factors measured and choice of measurement instruments is required to enable synthesis of findings for informing policy and practice. PMID:23410500

Development and Psychometric Validation of HIPER-Q to Assess Knowledge of Hypertensive Patients in Cardiac Rehabilitation.

PubMed

Santos, Rafaella Zulianello Dos; Bonin, Christiani Decker Batista; Martins, Eliara Ten Caten; Pereira Junior, Moacir; Ghisi, Gabriela Lima de Melo; Macedo, Kassia Rosangela Paz de; Benetti, Magnus

2018-01-01

The absence of instruments capable of measuring the level of knowledge of hypertensive patients in cardiac rehabilitation programs about their disease reflects the lack of specific recommendations for these patients. To develop and validate a questionnaire to evaluate the knowledge of hypertensive patients in cardiac rehabilitation programs about their disease. A total of 184 hypertensive patients (mean age 60.5 ± 10 years, 66.8% men) were evaluated. Reproducibility was assessed by calculation of the intraclass correlation coefficient using the test-retest method. Internal consistency was assessed by the Cronbach's alpha and the construct validity by the exploratory factorial analysis. The final version of the instrument had 17 questions organized in areas considered important for patient education. The instrument proposed showed a clarity index of 8.7 (0.25). The intraclass correlation coefficient was 0.804 and the Cronbach's correlation coefficient was 0.648. Factor analysis revealed five factors associated with knowledge areas. Regarding the criterion validity, patients with higher education level and higher family income showed greater knowledge about hypertension. The instrument has a satisfactory clarity index and adequate validity, and can be used to evaluate the knowledge of hypertensive participants in cardiac rehabilitation programs.

Analysis of Six Reviews on the Quality of Instruments for the Evaluation of Interprofessional Education in German-Speaking Countries.

PubMed

Ehlers, Jan P; Kaap-Fröhlich, Sylvia; Mahler, Cornelia; Scherer, Theresa; Huber, Marion

2017-01-01

Background: More and more institutions worldwide and in German-speaking countries are developing and establishing interprofessional seminars in undergraduate education of health professions. In order to evaluate the different didactic approaches and different outcomes regarding the anticipated interprofessional competencies, it is necessary to apply appropriate instruments. Cross-cultural instruments are particularly helpful for international comparability. The Interprofessional Education working group of the German Medical Association (GMA) aims at identifying existing instruments for the evaluation of interprofessional education in order to make recommendations for German-speaking countries. Methods: Systematic literature research was performed on the websites of international interprofessional organisations (CAIPE, EIPEN, AIPEN), as well as in the PubMed and Cinahl databases. Reviews focusing on quantitative instruments to evaluate competencies according to the modified Kirkpatrick competency levels were searched for. Psychometrics, language/country and setting, in which the instrument was applied, were recorded. Results: Six reviews out of 73 literature research hits were included. A large number of instruments were identified; however, their psychometrics and the applied setting were very heterogeneous. The instruments can mainly be assigned to Kirkpatrick levels 1, 2a & 2b. Most instruments have been developed in English but their psychometrics were not always reported rigorously. Only very few instruments are available in German. Conclusion: It is difficult to find appropriate instruments in German. Internationally, there are different approaches and objectives in the measurement and evaluation of interprofessional competencies. The question arises whether it makes sense to translate existing instruments or to go through the lengthy process of developing new ones. The evaluation of interprofessional seminars with quantitative instruments remains mainly on Kirkpatrick levels 1 and 2. Levels 3 and 4 can probably only be assessed with qualitative or mixed methods. German language instruments are necessary.

Analysis of Six Reviews on the Quality of Instruments for the Evaluation of Interprofessional Education in German-Speaking Countries

PubMed Central

Ehlers, Jan P.; Kaap-Fröhlich, Sylvia; Mahler, Cornelia; Scherer, Theresa; Huber, Marion

2017-01-01

Background: More and more institutions worldwide and in German-speaking countries are developing and establishing interprofessional seminars in undergraduate education of health professions. In order to evaluate the different didactic approaches and different outcomes regarding the anticipated interprofessional competencies, it is necessary to apply appropriate instruments. Cross-cultural instruments are particularly helpful for international comparability. The Interprofessional Education working group of the German Medical Association (GMA) aims at identifying existing instruments for the evaluation of interprofessional education in order to make recommendations for German-speaking countries. Methods: Systematic literature research was performed on the websites of international interprofessional organisations (CAIPE, EIPEN, AIPEN), as well as in the PubMed and Cinahl databases. Reviews focusing on quantitative instruments to evaluate competencies according to the modified Kirkpatrick competency levels were searched for. Psychometrics, language/country and setting, in which the instrument was applied, were recorded. Results: Six reviews out of 73 literature research hits were included. A large number of instruments were identified; however, their psychometrics and the applied setting were very heterogeneous. The instruments can mainly be assigned to Kirkpatrick levels 1, 2a & 2b. Most instruments have been developed in English but their psychometrics were not always reported rigorously. Only very few instruments are available in German. Conclusion: It is difficult to find appropriate instruments in German. Internationally, there are different approaches and objectives in the measurement and evaluation of interprofessional competencies. The question arises whether it makes sense to translate existing instruments or to go through the lengthy process of developing new ones. The evaluation of interprofessional seminars with quantitative instruments remains mainly on Kirkpatrick levels 1 and 2. Levels 3 and 4 can probably only be assessed with qualitative or mixed methods. German language instruments are necessary. PMID:28890927

Measures of Cultural Competence in Nurses: An Integrative Review

PubMed Central

2013-01-01

Background. There is limited literature available identifying and describing the instruments that measure cultural competence in nursing students and nursing professionals. Design. An integrative review was undertaken to identify the characteristics common to these instruments, examine their psychometric properties, and identify the concepts these instruments are designed to measure. Method. There were eleven instruments identified that measure cultural competence in nursing. Of these eleven instruments, four had been thoroughly tested in either initial development or in subsequent testing, with developers providing extensive details of the testing. Results. The current literature identifies that the instruments to assess cultural competence in nurses and nursing students are self-administered and based on individuals' perceptions. The instruments are commonly utilized to test the effectiveness of educational programs designed to increase cultural competence. Conclusions. The reviewed instruments measure nurses' self-perceptions or self-reported level of cultural competence but offer no objective measure of culturally competent care from a patient's perspective which can be problematic. Comparison of instruments reveals that they are based on a variety of conceptual frameworks and that multiple factors should be considered when deciding which instrument to use. PMID:23818818

Assessing Management Support for Worksite Health Promotion: Psychometric Analysis of the Leading by Example (LBE) Instrument

PubMed Central

Della, Lindsay J.; DeJoy, David M.; Goetzel, Ron Z.; Ozminkowski, Ronald J.; Wilson, Mark G.

2009-01-01

Objective This paper describes the development of the Leading by Example (LBE) instrument. Methods Exploratory factor analysis was used to obtain an initial factor structure. Factor validity was evaluated using confirmatory factor analysis methods. Cronbach’s alpha and item-total correlations provided information on the reliability of the factor subscales. Results Four subscales were identified: business alignment with health promotion objectives; awareness of the health-productivity link; worksite support for health promotion; leadership support for health promotion. Factor by group comparisons revealed that the initial factor structure is effective in detecting differences in organizational support for health promotion across different employee groups Conclusions Management support for health promotion can be assessed using the LBE, a brief, self-report questionnaire. Researchers can use the LBE to diagnose, track, and evaluate worksite health promotion programs. PMID:18517097

An Icelandic Version of McMasters Family Assessment Device (FAD)

ERIC Educational Resources Information Center

Juliusdottir, Gudlaug M.; Olafsdottir, Hrefna

2015-01-01

Purpose: An analysis of the psychometric properties of an Icelandic version of McMasters Family Assessment Device (FAD) was conducted in this study. Method: Two groups, clinical and nonclinical, comprising of 529 parents answered the FAD. The study examined the internal reliability and discriminant validity of the instrument in addition to…

Error Ratio Analysis: Alternate Mathematics Assessment for General and Special Educators.

ERIC Educational Resources Information Center

Miller, James H.; Carr, Sonya C.

1997-01-01

Eighty-seven elementary students in grades four, five, and six, were administered a 30-item multiplication instrument to assess performance in computation across grade levels. An interpretation of student performance using error ratio analysis is provided and the use of this method with groups of students for instructional decision making is…

The Luria-Nebraska Neuropsychological Battery and the WAIS-R in Assessment of Adults with Specific Learning Disabilities.

ERIC Educational Resources Information Center

Katz, Lynda; Goldstein, Gerald

1993-01-01

Compared intellectual (Wechsler Adult Intelligence Scale for Adults-Revised) and neuropsychological (Luria-Nebraska Neuropsychological Battery) assessment as valid methods of identifying learning disabilities in adults. Findings from 155 subjects revealed that both instruments were able to distinguish adults with and without learning disabilities.…

Chemometric aided NIR portable instrument for rapid assessment of medicine quality.

PubMed

Zontov, Y V; Balyklova, K S; Titova, A V; Rodionova, O Ye; Pomerantsev, A L

2016-11-30

The progress in instrumentation technology has led to miniaturization of NIR instruments. Fast systems that contain no moving parts were developed to be used in the field, warehouses, drugstores, etc. At the same time, in general these portable/handheld spectrometers have a lower spectral resolution and a narrower spectral region than stationary ones. Vendors of portable instruments supply their equipment with special software for spectra processing, which aims at simplifying the analyst's work to the highest degree possible. Often such software is not fully capable of solving complex problems. In application to a real-world problem of counterfeit drug detection we demonstrate that even impaired spectral data do carry information sufficient for drug authentication. The chemometrics aided approach helps to extract this information and thus to extend the applicability of miniaturized NIR instruments. MicroPhazir-RX NIR spectrometer is used as an example of a portable instrument. The data driven soft independent modeling of class analogy (DD-SIMCA) method is employed for data processing. A representative set of tablets of a calcium channel blocker from 6 different manufacturers is used to illustrate the proposed approach. It is shown that the DD-SIMCA approach yields a better result than the basic method provided by the instrument vendor. Copyright © 2016 Elsevier B.V. All rights reserved.

Micro-computed Tomography versus the Cross-sectioning Method to Evaluate Dentin Defects Induced by Different Mechanized Instrumentation Techniques.

PubMed

Stringheta, Carolina Pessoa; Pelegrine, Rina Andréa; Kato, Augusto Shoji; Freire, Laila Gonzales; Iglecias, Elaine Faga; Gavini, Giulio; Bueno, Carlos Eduardo da Silveira

2017-12-01

The objective of this study was to compare the methods of micro-computed tomography (micro-CT) and cross-sectioning followed by stereomicroscopy in assessing dentinal defects after instrumentation with different mechanized systems. Forty mesial roots of mandibular molars were scanned and divided into 4 groups (n = 10): Group R, Reciproc; Group PTN, ProTaper Next; Group WOG, WaveOne Gold; Group PDL, ProDesign Logic. After instrumentation, the roots were once again submitted to a micro-CT scan, and then sectioned at 3, 6, and 9 mm from the apex, and assessed for the presence of complete and incomplete dentinal defects under a stereomicroscope. The nonparametric Kruskal-Wallis, Friedman, and Wilcoxon tests were used in the statistical analysis. The study used a significance level of 5%. The total number of defects observed by cross-sectioning followed by stereomicroscopy was significantly higher than that observed by micro-CT, in all of the experimental groups (P ≤ .05). All of the defects identified in the postoperative period were already present in the corresponding preoperative period. There was no significant difference among the instrumentation systems as to the median numbers of defects, for either cross-sectioning followed by stereomicroscopy or micro-CT, at all the root levels (P > .05). In the micro-CT analysis, no significant difference was found between the median numbers of pre- and postinstrumentation defects, regardless of the instrumentation system (P > .05). None of the evaluated instrumentation systems led to the formation of new dentin defects. All of the defects identified in the stereomicroscopic analysis were already present before instrumentation, or were absent at both time points in the micro-CT analysis, indicating that the formation of new defects resulted from the sectioning procedure performed before stereomicroscopy and not from instrumentation. Copyright © 2017 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

Assessing the impact of natural policy experiments on socioeconomic inequalities in health: how to apply commonly used quantitative analytical methods?

PubMed

Hu, Yannan; van Lenthe, Frank J; Hoffmann, Rasmus; van Hedel, Karen; Mackenbach, Johan P

2017-04-20

The scientific evidence-base for policies to tackle health inequalities is limited. Natural policy experiments (NPE) have drawn increasing attention as a means to evaluating the effects of policies on health. Several analytical methods can be used to evaluate the outcomes of NPEs in terms of average population health, but it is unclear whether they can also be used to assess the outcomes of NPEs in terms of health inequalities. The aim of this study therefore was to assess whether, and to demonstrate how, a number of commonly used analytical methods for the evaluation of NPEs can be applied to quantify the effect of policies on health inequalities. We identified seven quantitative analytical methods for the evaluation of NPEs: regression adjustment, propensity score matching, difference-in-differences analysis, fixed effects analysis, instrumental variable analysis, regression discontinuity and interrupted time-series. We assessed whether these methods can be used to quantify the effect of policies on the magnitude of health inequalities either by conducting a stratified analysis or by including an interaction term, and illustrated both approaches in a fictitious numerical example. All seven methods can be used to quantify the equity impact of policies on absolute and relative inequalities in health by conducting an analysis stratified by socioeconomic position, and all but one (propensity score matching) can be used to quantify equity impacts by inclusion of an interaction term between socioeconomic position and policy exposure. Methods commonly used in economics and econometrics for the evaluation of NPEs can also be applied to assess the equity impact of policies, and our illustrations provide guidance on how to do this appropriately. The low external validity of results from instrumental variable analysis and regression discontinuity makes these methods less desirable for assessing policy effects on population-level health inequalities. Increased use of the methods in social epidemiology will help to build an evidence base to support policy making in the area of health inequalities.

Developing a Passive Acoustic Monitoring Network for Harbor Porpoise in California

NASA Astrophysics Data System (ADS)

Jacobson, Eiren Kate

Assessing the abundance of and trends in whale, dolphin, and porpoise (cetacean) populations using traditional visual methods can be challenging due primarily to their limited availability at the surface of the ocean. As a result, researchers are increasingly interested in incorporating non-visual and remote observations to improve cetacean population assessments. Passive acoustic monitoring (PAM) can complement or replace visual surveys for cetaceans that produce echolocation clicks, whistles, and other vocalizations. My doctoral dissertation is focused on developing methods to improve PAM of cetaceans. I used the Monterey Bay population of harbor porpoise (Phocoena phocoena ) as a case study for methods development. In Chapter 2, I used passive acoustic data to document that harbor porpoises avoid bottlenose dolphins (Tursiops truncatus) in nearshore Monterey Bay. In Chapter 3, I investigated whether different passive acoustic instruments could be used to monitor harbor porpoise. I recorded harbor porpoise echolocation clicks simultaneously on two different passive acoustic instruments and compared the number and peak frequency of echolocation signals recorded on the two instruments. I found that the number of echolocation clicks was highly correlated between instruments but that the peak frequency of echolocation clicks was not well-correlated, suggesting that some instruments may not be capable of discriminating harbor porpoise echolocation clicks in regions where multiple species with similar echolocation signals are present. In Chapter 4, I used paired visual and passive acoustic surveys to estimate the effective detection area of the passive acoustic sensors in a Bayesian framework. This approach resulted in a posterior distribution of the effective detection area that was consistent with previously published values. In Chapter 5, I used aerial survey and passive acoustic data in a simulation framework to investigate the statistical power of different passive acoustic network designs and hypothetical changes in harbor porpoise abundance. As a whole, this dissertation used an applied approach to methods development to advance the use of PAM for cetaceans.

The cleaning of instruments and syringes

PubMed Central

Darmady, E. M.; Hughes, K. E. A.; Drewett, S. E.; Prince, D.; Tuke, Winifred; Verdon, Patricia

1965-01-01

The dangers to the handler of syringes used for routine injections were found to be negligible, but known infected syringes and those contaminated with antibiotics should be autoclaved before handling as a high proportion of these carry pathogenic organisms. Mechanical methods of cleaning syringes and instruments are assessed. The use of an artificial soil for testing purposes is described. Using this soil, ultrasonics by themselves are inadequate for cleaning syringes and instruments. Agitation with ultrasonics is essential for syringes, but is insufficient for instruments. Detergents are therefore an essential adjunct to the cleaning process. For syringes Pyroneg proved to be the most satisfactory, particularly if they had been previously siliconized. The best detergent for instruments contaminated with these types of soil was Penesolve 814 at a temperature of 95°C. but the instruments must be adequately rinsed after this treatment. A number of other detergents and cleaning agents are discussed. PMID:14247708

Apically extruded debris with reciprocating single-file and full-sequence rotary instrumentation systems.

PubMed

Bürklein, Sebastian; Schäfer, Edgar

2012-06-01

The purpose of this in vitro study was to assess the amount of apically extruded debris using rotary and reciprocating nickel-titanium instrumentation systems. Eighty human mandibular central incisors were randomly assigned to 4 groups (n = 20 teeth per group). The root canals were instrumented according to the manufacturers' instructions using the 2 reciprocating single-file systems Reciproc (VDW, Munich, Germany) and WaveOne (Dentsply Maillefer, Ballaigues, Switzerland) and the 2 full-sequence rotary Mtwo (VDW, Munich, Germany) and ProTaper (Dentsply Maillefer, Ballaigues, Switzerland) instruments. Bidistilled water was used as irrigant. The apically extruded debris was collected in preweighted glass vials using the Myers and Montgomery method. After drying, the mean weight of debris was assessed with a microbalance and statistically analyzed using analysis of variance and the post hoc Student-Newman-Keuls test. The time required to prepare the canals with the different instruments was also recorded. The reciprocating files produced significantly more debris compared with both rotary systems (P < .05). Although no statistically significant difference was obtained between the 2 rotary instruments (P > .05), the reciprocating single-file system Reciproc produced significantly more debris compared with all other instruments (P < .05). Instrumentation was significantly faster using Reciproc than with all other instrument (P < .05). Under the condition of this study, all systems caused apical debris extrusion. Full-sequence rotary instrumentation was associated with less debris extrusion compared with the use of reciprocating single-file systems. Copyright © 2012 American Association of Endodontists. Published by Elsevier Inc. All rights reserved.

Customisation of an instrument to assess anaesthesiologists' non-technical skills.

PubMed

Jepsen, Rikke M H G; Spanager, Lene; Lyk-Jensen, Helle T; Dieckmann, Peter; Østergaard, Doris

2015-02-22

The objectives of the study were to identify Danish anaesthesiologists' non-technical skills and to customise the Scottish-developed Anaesthetists' Non-Technical Skills instrument for Danish anaesthesiologists. Six semi-structured group interviews were conducted with 31 operating room team members: anaes-thesiologists, nurse anaesthetists, surgeons, and scrub nurses. Interviews were transcribed verbatim and analysed using directed content analysis. Anaesthesiologists' non-technical skills were identified, coded, and sorted using the original instrument as a basis. The resulting prototype instrument was discussed with anaesthesiologists from 17 centres to ensure face validity. Interviews lasted 46-67 minutes. Identified examples of anaesthesiologists' good or poor non-technical skills fit the four categories in the original instrument: situation awareness; decision making; team working; and task management. Anaesthesiologists' leadership role in the operating room was emphasised: the original 'Task Management' category was named 'Leadership'. One new element, 'Demonstrating self-awareness' was added under the category 'Situation Awareness'. Compared with the original instrument, half of the behavioural markers were new, which reflected that being aware of and communicating one's own abilities to the team; working systematically; and speaking up to avoid adverse events were important skills. The Anaesthetists' Non-Technical Skills instrument was customised to a Danish setting using the identified non-technical skills for anaesthesiologists and the original instrument as basis. The customised instrument comprises four categories and 16 underpinning elements supported by multiple behavioural markers. Identifying non-technical skills through semi-structured group interviews and analysing them using direct content analysis proved a useful method for customising an assessment instrument to another setting.

Adapting a rapid assessment protocol to environmentally assess palm swamp (Veredas) springs in the Cerrado biome, Brazil.

PubMed

Guimarães, Ariane; de Lima Rodrigues, Aline Sueli; Malafaia, Guilherme

2017-10-30

The exploitation and degradation of natural environments exert intense pressure on important ecosystems worldwide. Thus, it is necessary developing or adapting assessment methods to monitor environmental changes and to generate results to be applied to environmental management programs. The Brazilian Veredas (phytophysiognomies typical to the Cerrado biome) are threatened by several human activities; thus, the aim of the present study is to adapt a rapid assessment protocol (RAP) to be applied to Veredas springs, by using the upper course of the Vai-e-Vem stream watershed (Ipameri County, Goiás State, Brazil). Therefore, several springs in the study site were visited and 11 of them were considered Veredas springs. After the RAP was adapted, the instrument was validated and used to environmentally assess the springs in order to demonstrate its applicability. The present study has provided an instrument of option to monitor Veredas springs.

Health assessment instruments for people with intellectual disabilities-A systematic review.

PubMed

Bakker-van Gijssel, E J; Lucassen, P L B J; Olde Hartman, T C; van Son, L; Assendelft, W J J; van Schrojenstein Lantman-de Valk, H M J

2017-05-01

People with intellectual disabilities (ID) experience health disparities and are less likely to undergo recommended age- and gender-specific screening and health promotion. New diagnoses are frequently missed. Assessments with the aid of health assessment instruments are a way to address these problems. The aim of this review is to find the available health assessment instruments for people with ID used in primary care and evaluate their quality. We conducted an electronic literature search of papers published between January 2000 and May 2016. After a two-phase selection process (kappa: 0.81 and 0.77) we collected data from the 29 included peer-reviewed articles on the following four domains; development, clinimetric properties (i.e. validity, reliability, feasibility, acceptability), content (i.e. ID-related health problems, prevention and health promotion topics) and effectiveness of the instruments. We distinguished 20 different health assessment instruments. Limited information was found on the development of the instruments as well as on their clinimetric properties. The content of the instruments was rather diverse. The included papers agreed that health assessment instruments are effective. However, only three instruments evaluated effectiveness in a randomised controlled trial. Patients with ID, carers and general practitioners (GPs) generally appreciated the health assessment instruments. Two instruments, "Stay well and healthy -Health risk appraisal (SWH-HRA)"and the "Comprehensive Health Assessment Programme (CHAP)", appeared to have the highest quality. These instruments can be used to construct a health assessment instrument for people with ID that meets scientific standards. Copyright © 2017 Elsevier Ltd. All rights reserved.

Predicting child maltreatment: A meta-analysis of the predictive validity of risk assessment instruments.

PubMed

van der Put, Claudia E; Assink, Mark; Boekhout van Solinge, Noëlle F

2017-11-01

Risk assessment is crucial in preventing child maltreatment since it can identify high-risk cases in need of child protection intervention. Despite widespread use of risk assessment instruments in child welfare, it is unknown how well these instruments predict maltreatment and what instrument characteristics are associated with higher levels of predictive validity. Therefore, a multilevel meta-analysis was conducted to examine the predictive accuracy of (characteristics of) risk assessment instruments. A literature search yielded 30 independent studies (N=87,329) examining the predictive validity of 27 different risk assessment instruments. From these studies, 67 effect sizes could be extracted. Overall, a medium significant effect was found (AUC=0.681), indicating a moderate predictive accuracy. Moderator analyses revealed that onset of maltreatment can be better predicted than recurrence of maltreatment, which is a promising finding for early detection and prevention of child maltreatment. In addition, actuarial instruments were found to outperform clinical instruments. To bring risk and needs assessment in child welfare to a higher level, actuarial instruments should be further developed and strengthened by distinguishing risk assessment from needs assessment and by integrating risk assessment with case management. Copyright © 2017 Elsevier Ltd. All rights reserved.

Coaching leadership: leaders' and followers' perception assessment questionnaires in nursing

PubMed Central

Cardoso, Maria Lúcia Alves Pereira; Ramos, Laís Helena; D'Innocenzo, Maria

2014-01-01

ABSTRACT Objective: To describe the development, content analysis, and reliability of two questionnaires to assess the perception of nurse leaders, nurse technicians, and licensed practical nurses – coached in the practice of leadership and the relation with the dimensions of the coaching process. Methods: This was a methodological study with a quantitative and qualitative approach, which had the goal of instrumentation in reference to the construction and validation of measuring instruments. The instrument proposition design was based on the literature on leadership, coaching, and assessment of psychometric properties, subjected to content validation as to clarity, relevance, and applicability in order to validate the propositions through the consensus of judges, using the Delphi technique, in 2010. The final version of the questionnaires was administered to 279 nurses and 608 nurse technicians and licensed practical nurses, at two university hospitals and two private hospitals. Results: The Cronbach's alpha value with all items of the self-perception instrument was very high (0.911). The team members' instrument of perception showed that for all determinants and for each dimension of the coaching process, Cronbach's overall alpha value (0.952) was considered quite high, pointing to a very strong consistency of the scale. Confirmatory analysis showed that the models were well adjusted. Conclusion: From the statistical validation we compared the possibility of reusing the questionnaires for other study samples, because there was evidence of reliability and applicability. PMID:24728249

Corporate Entrepreneurship Assessment Instrument (CEAI): Systematic Validation of a Measure

DTIC Science & Technology

2006-03-01

CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE THESIS...the United States Government. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION...DISTRIBUTION UNLIMITED. AFIT/GIR/ENV/06M-05 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): SYSTEMATIC VALIDATION OF A MEASURE

The development of an integrated assessment instrument for measuring analytical thinking and science process skills

NASA Astrophysics Data System (ADS)

Irwanto, Rohaeti, Eli; LFX, Endang Widjajanti; Suyanta

2017-05-01

This research aims to develop instrument and determine the characteristics of an integrated assessment instrument. This research uses 4-D model, which includes define, design, develop, and disseminate. The primary product is validated by expert judgment, tested it's readability by students, and assessed it's feasibility by chemistry teachers. This research involved 246 students of grade XI of four senior high schools in Yogyakarta, Indonesia. Data collection techniques include interview, questionnaire, and test. Data collection instruments include interview guideline, item validation sheet, users' response questionnaire, instrument readability questionnaire, and essay test. The results show that the integrated assessment instrument has Aiken validity value of 0.95. Item reliability was 0.99 and person reliability was 0.69. Teachers' response to the integrated assessment instrument is very good. Therefore, the integrated assessment instrument is feasible to be applied to measure the students' analytical thinking and science process skills.

Risk assessment for juvenile justice: a meta-analysis.

PubMed

Schwalbe, Craig S

2007-10-01

Risk assessment instruments are increasingly employed by juvenile justice settings to estimate the likelihood of recidivism among delinquent juveniles. In concert with their increased use, validation studies documenting their predictive validity have increased in number. The purpose of this study was to assess the average predictive validity of juvenile justice risk assessment instruments and to identify risk assessment characteristics that are associated with higher predictive validity. A search of the published and grey literature yielded 28 studies that estimated the predictive validity of 28 risk assessment instruments. Findings of the meta-analysis were consistent with effect sizes obtained in larger meta-analyses of criminal justice risk assessment instruments and showed that brief risk assessment instruments had smaller effect sizes than other types of instruments. However, this finding is tentative owing to limitations of the literature.

Validity and test-retest reliability of an at-work production loss instrument.

PubMed

Aboagye, E; Jensen, I; Bergström, G; Hagberg, J; Axén, I; Lohela-Karlsson, M

2016-07-01

Besides causing ill health, a poor work environment may contribute to production loss. Production loss assessment instruments emphasize health-related consequences but there is no instrument to measure reduced work performance related to the work environment. To examine convergent validity and test-retest reliability of health-related production loss (HRPL) and work environment-related production loss (WRPL) against a valid comparable instrument, the Health and Work Performance Questionnaire (HPQ). Cross-sectional study of employees, not on sick leave, who were asked to self-rate their work performance and production losses. Using the Pearson correlation and Bland and Altman's Test of Agreement, convergent validity was examined. Subgroup analyses were performed for employees recording problem-specific reduced work performance. Consistency of pairs of HRPL and WRPL for samples responding to both assessments was expressed using Intraclass Correlation Coefficient (ICC) and tests of repeatability. A total of 88 employees participated and 44 responded to both assessments. Test of agreement between measurements estimates a mean difference of 0.34 for HRPL and -0.03 for WRPL compared with work performance. This indicates that the production loss questions are valid and moderately associated with work performance for the total sample and subgroups. ICC for paired HRPL assessments was 0.90 and 0.91 for WRPL, i.e. the test-retest reliability was good and suggests stability in the instrument. HRPL and WRPL can be used to measure production loss due to health-related and work environment-related problems. These results may have implications for advancing methods of assessing production loss, which represents an important cost to employers. © The Author 2016. Published by Oxford University Press on behalf of the Society of Occupational Medicine. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Perceptions of Organizational Culture of a Multi-Campus Community College District: Mixed Methods in Concert

ERIC Educational Resources Information Center

Kuster Dale, Kimberly

2012-01-01

This concurrent, mixed-methods case study analyzed perceptions of current and preferred organizational culture within a rural, multi-campus community college district. This phenomenon was examined by analyzing and comparing data collected by surveying all full-time employees utilizing the Organizational Culture Assessment Instrument (OCAI) and…

A Comparative Analysis of the Learning Styles of Accounting Students in the United Kingdom and South Africa

ERIC Educational Resources Information Center

McChlery, Stuart; Visser, Susan

2009-01-01

Learners preferentially take in and process information in diverse ways whilst teaching methods also vary presenting the possibility for mismatching teaching methods with learners' preferences leading to disengagement, ineffective learning and potential underperformance. Different research instruments have been used in the past to assess the…

Preparing Preservice Teachers in a Virtual Space: A Case Study of a Literacy Methods Course

ERIC Educational Resources Information Center

Fayne, Harriet R.

2014-01-01

This article describes a case study of an online literacy methods course offered at a small, midwestern university. Formal and informal instruments were used to assess students' backgrounds, interests, and dispositions. Archival course data were analyzed to examine interactions among content, course design, and student characteristics. Despite…

Motivational Engagement and Video Gaming: A Mixed Methods Study

ERIC Educational Resources Information Center

Hoffman, Bobby; Nadelson, Louis

2010-01-01

A mixed methods design was used to identify factors associated with motivational engagement in video gaming. Self-report instruments were administered to 189 video game players to assess goal orientations, affect, need for cognition, and perceptions of engagement and flow. Simultaneously, a sub-set of 25 participants were interviewed and results…

An evaluation of Brix refractometry instruments for measurement of colostrum quality in dairy cattle.

PubMed

Bielmann, V; Gillan, J; Perkins, N R; Skidmore, A L; Godden, S; Leslie, K E

2010-08-01

Acquisition of high quality colostrum is an important factor influencing neonatal calf health. Many methods have been used to assess the Ig concentration of colostrum; however, improved, validated evaluation tools are needed. The aims of this study were to evaluate both optical and digital Brix refractometer instruments for the measurement of Ig concentration of colostrum as compared with the gold standard radial immunodiffusion assay laboratory assessment and to determine the correlation between Ig measurements taken from fresh and frozen colostrum samples for both Brix refractometer instruments. This research was completed using 288 colostrum samples from 3 different farms. It was concluded that the optical and digital Brix refractometers were highly correlated for both fresh and frozen samples (r=0.98 and r=0.97, respectively). Correlation between both refractometer instruments for fresh and frozen samples and the gold standard radial immunodiffusion assay were determined to be very similar, with a correlation coefficient between 0.71 and 0.74. Both instruments exhibited excellent test characteristics, indicating an appropriate cut-off point of 22% Brix score for the identification of good quality colostrum. Copyright (c) 2010 American Dairy Science Association. Published by Elsevier Inc. All rights reserved.

The development of a patient-reported outcome measure for assessing nighttime symptoms of chronic obstructive pulmonary disease.

PubMed

Hareendran, Asha; Palsgrove, Andrew C; Mocarski, Michelle; Schaefer, Michael L; Setyawan, Juliana; Carson, Robyn; Make, Barry

2013-06-25

The assessment of symptoms of chronic obstructive pulmonary disease (COPD) is important for monitoring and managing the disease and for evaluating outcomes of interventions. COPD patients experience symptoms during the day and night, and symptoms experienced at night often disturb sleep. The aim of this paper is to describe methods used to develop a patient-reported outcome (PRO) instrument for evaluating nighttime symptoms of COPD, and to document evidence for the content validity of the instrument. Literature review and clinician interviews were conducted to inform discussion guides to explore patients' nighttime COPD symptom experience. Data from focus groups with COPD patients was used to develop a conceptual framework and the content of a new PRO instrument. Patient understanding of the new instrument was assessed via cognitive interviews with COPD patients. The literature review confirmed that there is no instrument with evidence of content validity currently available to assess nighttime symptoms of COPD. Additionally, the literature review and clinician interviews suggested the need to understand patients' experience of specific symptoms in order to evaluate nighttime symptoms of COPD. Analyses of patient focus group data (N = 27) supported saturation of concepts and aided in development of a conceptual framework. Items were generated using patients' terminology to collect data on concepts in the framework including the occurrence and severity of COPD symptoms, use of rescue medication at night, and nocturnal awakening. Response options were chosen to reflect concepts that were salient to patients. Subsequent cognitive interviewing with ten COPD patients demonstrated that the items, response options, recall period, and instructions were understandable, relevant, and interpreted as intended. A new PRO instrument, the Nighttime Symptoms of COPD Instrument (NiSCI), was developed with documented evidence of content validity. The NiSCI is ready for empirical testing, including item reduction and evaluation of psychometric properties.

Beyond Reading Level: A Systematic Review of the Suitability of Cancer Education Print and Web-based Materials

PubMed Central

Finnie, Ramona K.C.; Felder, Tisha M.; Linder, Suzanne Kneuper; Mullen, Patricia Dolan

2010-01-01

Background Consideration of categories related to reading comprehension—beyond reading level—is imperative to reach low literacy populations effectively. “Suitability” has been proposed as a term to encompass six categories of such factors: content, literacy demand graphics, layout/typography, learning stimulation, and cultural appropriateness. Our purpose was to describe instruments used to evaluate categories of suitability in cancer education materials in published reports and their findings. Methods We searched databases and reference lists for evaluations of print and Web-based cancer education materials to identify and describe measures of these categories. Studies had to evaluate reading level and at least one category of suitability. Results Eleven studies met our criteria.. Seven studies reported inter-rater reliability. Cultural appropriateness was most often assessed; four instruments assessed only surface aspects of cultural appropriateness. Only two of seven instruments used, the Suitability Assessment of Materials (SAM) and the Comprehensibility Assessment of Materials (SAM + CAM), were described as having any evidence of validity. Studies using SMOG and Fry reported higher average reading level scores than those using FK. Most materials failed criteria for reading level and cultural appropriateness. Conclusions We recommend more emphasis on the categories of suitability for those developing cancer education materials and more study of these categories and reliability and validity testing of instruments. PMID:20237884

OMERACT Endorsement of Patient-reported Outcome Instruments in Antineutrophil Cytoplasmic Antibody–associated Vasculitis

PubMed Central

Robson, Joanna C.; Tomasson, Gunnar; Milman, Nataliya; Ashdown, Sue; Boonen, Annelies; Casey, George C.; Cronholm, Peter F.; Cuthbertson, David; Dawson, Jill; Direskeneli, Haner; Easley, Ebony; Kermani, Tanaz A.; Farrar, John T.; Gebhart, Don; Lanier, Georgia; Luqmani, Raashid A.; Mahr, Alfred; McAlear, Carol A.; Peck, Jacqueline; Shea, Beverley; Shea, Judy A.; Sreih, Antoine G.; Tugwell, Peter S.; Merkel, Peter A.

2018-01-01

Objective The antineutrophil cytoplasmic antibody–associated vasculitides (AAV) are multiorgan diseases. Patients with AAV report impairment in their health-related quality of life (HRQOL) and have different priorities regarding disease assessment compared with physicians. The Outcome Measures in Rheumatology (OMERACT) Vasculitis Working Group previously received endorsement for a core set of domains in AAV. Two approaches to measure patient-reported outcomes (PRO) were presented at OMERACT 2016. Methods A novel 5-step tool was used to facilitate assessment of the instruments by delegates: the OMERACT Filter 2.0 Instrument Selection Algorithm, with a red-amber-green checklist of questions, including (1) good match with domain (face and content validity), (2) feasibility, (3) do numeric scores make sense (construct validity)?, (4) overall ratings of discrimination, and (5) can individual thresholds of meaning be defined? Delegates gave an overall endorsement. Three generic Patient-Reported Outcomes Measurement Information System (PROMIS) instruments (fatigue, physical functioning, and pain interference) and a disease-specific PRO, the AAV-PRO (6 domains related to symptoms and HRQOL), were presented. Results OMERACT delegates endorsed the use of the PROMIS instruments for fatigue, physical functioning, and pain interference (87.6% overall endorsement) and the disease-specific AAV-PRO instrument (89.4% overall endorsement). Conclusion The OMERACT Vasculitis Working Group gained endorsement by OMERACT for use of the PROMIS and the AAV-PRO in clinical trials of vasculitis. These instruments are complementary to each other. The PROMIS and the AAV-PRO need further work to assess their utility in longitudinal settings, including their ability to discriminate between treatments of varying efficacy in the setting of a randomized controlled trial. PMID:28864650

Assessment of economic instruments for countries with low municipal waste management performance: An approach based on the analytic hierarchy process.

PubMed

Kling, Maximilian; Seyring, Nicole; Tzanova, Polia

2016-09-01

Economic instruments provide significant potential for countries with low municipal waste management performance in decreasing landfill rates and increasing recycling rates for municipal waste. In this research, strengths and weaknesses of landfill tax, pay-as-you-throw charging systems, deposit-refund systems and extended producer responsibility schemes are compared, focusing on conditions in countries with low waste management performance. In order to prioritise instruments for implementation in these countries, the analytic hierarchy process is applied using results of a literature review as input for the comparison. The assessment reveals that pay-as-you-throw is the most preferable instrument when utility-related criteria are regarded (wb = 0.35; analytic hierarchy process distributive mode; absolute comparison) mainly owing to its waste prevention effect, closely followed by landfill tax (wb = 0.32). Deposit-refund systems (wb = 0.17) and extended producer responsibility (wb = 0.16) rank third and fourth, with marginal differences owing to their similar nature. When cost-related criteria are additionally included in the comparison, landfill tax seems to provide the highest utility-cost ratio. Data from literature concerning cost (contrary to utility-related criteria) is currently not sufficiently available for a robust ranking according to the utility-cost ratio. In general, the analytic hierarchy process is seen as a suitable method for assessing economic instruments in waste management. Independent from the chosen analytic hierarchy process mode, results provide valuable indications for policy-makers on the application of economic instruments, as well as on their specific strengths and weaknesses. Nevertheless, the instruments need to be put in the country-specific context along with the results of this analytic hierarchy process application before practical decisions are made. © The Author(s) 2016.

The Self-Efficacy Scale for Preschool Teachers Regarding Asthma Care: Instrument Development and Validation

ERIC Educational Resources Information Center

Gau, Bih-Shya; Hung, Chao-Chia

2014-01-01

Background: The purpose of this study was to develop and test the psychometric properties of a questionnaire that assesses preschool teachers' self-efficacy in providing asthma care. Methods: A total of 407 teachers from 54 preschools in Taiwan participated in the study by completing the asthma management self-efficacy scale. We assessed validity…

Assessing the Development of Educational Research Literacy: The Effect of Courses on Research Methods in Studies of Educational Science

ERIC Educational Resources Information Center

Groß Ophoff, Jana; Schladitz, Sandra; Leuders, Juliane; Leuders, Timo; Wirtz, Markus A.

2015-01-01

The ability to purposefully access, reflect, and use evidence from educational research (Educational Research Literacy) is expected of future professionals in educational practice. Based on the presented conceptual framework, a test instrument was developed to assess the different competency aspects: Information Literacy, Statistical Literacy, and…

Does Participation in Citizen Science Improve Scientific Literacy? A Study to Compare Assessment Methods

ERIC Educational Resources Information Center

Cronje, Ruth; Rohlinger, Spencer; Crall, Alycia; Newman, Greg

2011-01-01

This study investigated the use of a contextually sensitive instrument to assess the effect of invasive species monitoring training on the scientific literacy of citizen volunteers. The authors measured scientific literacy scores before and after 57 citizens participated in a 2-day event to learn to monitor invasive species with an instrument…

The Stuttering Treatment Research Evaluation and Assessment Tool (STREAT): Evaluating Treatment Research as Part of Evidence-Based Practice

ERIC Educational Resources Information Center

Davidow, Jason H.; Bothe, Anne K.; Bramlett, Robin E.

2006-01-01

Purpose: This article presents, and explains the issues behind, the Stuttering Treatment Research Evaluation and Assessment Tool (STREAT), an instrument created to assist clinicians, researchers, students, and other readers in the process of critically appraising reports of stuttering treatment research. Method: The STREAT was developed by…

Exploring Teachers' Practices in Teaching Mathematics and Statistics in Kwazulu-Natal Schools

ERIC Educational Resources Information Center

Umugiraneza, Odette; Bansilal, Sarah; North, Delia

2017-01-01

Teaching approaches and assessment practices are key factors that contribute to the improvement of learner outcomes. The study on which this article is based, explored the methods used by KwaZulu-Natal (KZN) teachers in teaching and assessing mathematics and statistics. An instrument containing closed and open-ended questions was distributed to…

To Sum or Not to Sum: Taxometric Analysis with Ordered Categorical Assessment Items

ERIC Educational Resources Information Center

Walters, Glenn D.; Ruscio, John

2009-01-01

Meehl's taxometric method has been shown to differentiate between categorical and dimensional data, but there are many ways to implement taxometric procedures. When analyzing the ordered categorical data typically provided by assessment instruments, summing items to form input indicators has been a popular practice for more than 20 years. A Monte…

Validating Culture and Gender-Specific Constructs: A Mixed-Method Approach to Advance Assessment Procedures in Cross-Cultural Settings

ERIC Educational Resources Information Center

Hitchcock, John H.; Sarkar, Sreeroopa; Nastasi, Bonnie; Burkholder, Gary; Varjas, Kristen; Jayasena, Asoka

2006-01-01

Despite on-going calls for developing cultural competency among mental health practitioners, few assessment instruments consider cultural variation in psychological constructs. To meet the challenge of developing measures for minority and international students, it is necessary to account for the influence culture may have on the latent constructs…

A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments.

PubMed

Langer, Astrid

2012-08-16

Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware of methodological deficiencies inherent in existing HEE quality appraisal instruments. These shortcomings of existing HEE quality appraisal instruments are illustrated by the pilot test.

Development and Evaluation of an Instrument to Measure Reasoning About Managing Asthma in Older School-Age Children and Adolescents

PubMed Central

Kintner, Eileen; Cook, Gwendolyn; Hull, Lakisha; Meeder, Linda

2018-01-01

Background and Purpose This article describes development and evaluation of a 4-scenario instrument designed to measure reasoning abilities for managing asthma symptoms. Methods Existing literature informed creation of a reasoning template and the reasoning scenarios. Think-aloud interviews appraised scenario functionality. Experts assessed content validity. Data from 2 groups of students with asthma aged 9–15 years (N = 132 and 307) were used to evaluate psychometric properties. Results The scenarios were deemed functional, content was relevant, and readability was age/grade appropriate. Cronbach’s alpha was 0.79. Exploratory and confirmatory factor analyses indicated a single component solution and revealed a good fit. Concurrent validity was established using correlations with asthma knowledge. Conclusion The instrument could be used to assess reasoning about symptom management and to evaluate educational interventions. PMID:24620511

An Instrument to Measure Maturity of Integrated Care: A First Validation Study

PubMed Central

2018-01-01

Introduction: Lessons captured from interviews with 12 European regions are represented in a new instrument, the B3-Maturity Model (B3-MM). B3-MM aims to assess maturity along 12 dimensions reflecting the various aspects that need to be managed in order to deliver integrated care. The objective of the study was to test the content validity of B3-MM as part of SCIROCCO (Scaling Integrated Care into Context), a European Union funded project. Methods: A literature review was conducted to compare B3-MM’s 12 dimensions and their measurement scales with existing measures and instruments that focus on assessing the development of integrated care. Subsequently, a three-round survey conducted through a Delphi study with international experts in the field of integrated care was performed to test the relevance of: 1) the dimensions, 2) the maturity indicators and 3) the assessment scale used in B3-MM. Results: The 11 articles included in the literature review confirmed all the dimensions described in the original version of B3-MM. The Delphi study rounds resulted in various phrasing amendments of indicators and assessment scale. Full agreement among the experts on the relevance of the 12 B3-MM dimensions, their indicators, and assessment scale was reached after the third Delphi round. Conclusion and discussion: The B3-MM dimensions, maturity indicators and assessment scale showed satisfactory content validity. While the B3-MM is a unique instrument based on existing knowledge and experiences of regions in integrated care, further testing is needed to explore other measurement properties of B3-MM. PMID:29588644

Validity and Reliability of the "Behavior Problems Inventory," the "Aberrant Behavior Checklist," and the "Repetitive Behavior Scale--Revised" among Infants and Toddlers at Risk for Intellectual or Developmental Disabilities: A Multi-Method Assessment Approach

ERIC Educational Resources Information Center

Rojahn, Johannes; Schroeder, Stephen R.; Mayo-Ortega, Liliana; Oyama-Ganiko, Rosao; LeBlanc, Judith; Marquis, Janet; Berke, Elizabeth

2013-01-01

Reliable and valid assessment of aberrant behaviors is essential in empirically verifying prevention and intervention for individuals with intellectual or developmental disabilities (IDD). Few instruments exist which assess behavior problems in infants. The current longitudinal study examined the performance of three behavior-rating scales for…

Ion mobility analysis of lipoproteins

DOEpatents

Benner, W Henry [Danville, CA; Krauss, Ronald M [Berkeley, CA; Blanche, Patricia J [Berkeley, CA

2007-08-21

A medical diagnostic method and instrumentation system for analyzing noncovalently bonded agglomerated biological particles is described. The method and system comprises: a method of preparation for the biological particles; an electrospray generator; an alpha particle radiation source; a differential mobility analyzer; a particle counter; and data acquisition and analysis means. The medical device is useful for the assessment of human diseases, such as cardiac disease risk and hyperlipidemia, by rapid quantitative analysis of lipoprotein fraction densities. Initially, purification procedures are described to reduce an initial blood sample to an analytical input to the instrument. The measured sizes from the analytical sample are correlated with densities, resulting in a spectrum of lipoprotein densities. The lipoprotein density distribution can then be used to characterize cardiac and other lipid-related health risks.

Aerosol preparation of intact lipoproteins

DOEpatents

Benner, W Henry [Danville, CA; Krauss, Ronald M [Berkeley, CA; Blanche, Patricia J [Berkeley, CA

2012-01-17

A medical diagnostic method and instrumentation system for analyzing noncovalently bonded agglomerated biological particles is described. The method and system comprises: a method of preparation for the biological particles; an electrospray generator; an alpha particle radiation source; a differential mobility analyzer; a particle counter; and data acquisition and analysis means. The medical device is useful for the assessment of human diseases, such as cardiac disease risk and hyperlipidemia, by rapid quantitative analysis of lipoprotein fraction densities. Initially, purification procedures are described to reduce an initial blood sample to an analytical input to the instrument. The measured sizes from the analytical sample are correlated with densities, resulting in a spectrum of lipoprotein densities. The lipoprotein density distribution can then be used to characterize cardiac and other lipid-related health risks.

Assessment of Teaching Methods and Critical Thinking in a Course for Science Majors

NASA Astrophysics Data System (ADS)

Speck, Angela; Ruzhitskaya, L.; Whittington, A. G.

2014-01-01

Ability to think critically is a key ingredient to the scientific mindset. Students who take science courses may or may not be predisposed to critical thinking - the ability to evaluate information analytically. Regardless of their initial stages, students can significantly improve their critical thinking through learning and practicing their reasoning skills, critical assessments, conducting and reflecting on observations and experiments, building their questioning and communication skills, and through the use of other techniques. While, there are several of teaching methods that may help to improve critical thinking, there are only a few assessment instruments that can help in evaluating the efficacy of these methods. Critical thinking skills and improvement in those skills are notoriously difficult to measure. Assessments that are based on multiple-choice questions demonstrate students’ final decisions but not their thinking processes. In addition, during the course of studies students may develop subject-based critical thinking while not being able to extend the skills to the general critical thinking. As such, we wanted to design and conduct a study on efficacy of several teaching methods in which we would learn how students’ improve their thinking processes within a science discipline as well as in everyday life situations. We conducted a study among 20 astronomy, physics and geology majors-- both graduate and undergraduate students-- enrolled in our Solar System Science course (mostly seniors and early graduate students) at the University of Missouri. We used the Ennis-Weir Critical Thinking Essay test to assess students’ general critical thinking and, in addition, we implemented our own subject-based critical thinking assessment. Here, we present the results of this study and share our experience on designing a subject-based critical thinking assessment instrument.

Systematic review of measurement tools to assess surgeons' intraoperative cognitive workload.

PubMed

Dias, R D; Ngo-Howard, M C; Boskovski, M T; Zenati, M A; Yule, S J

2018-04-01

Surgeons in the operating theatre deal constantly with high-demand tasks that require simultaneous processing of a large amount of information. In certain situations, high cognitive load occurs, which may impact negatively on a surgeon's performance. This systematic review aims to provide a comprehensive understanding of the different methods used to assess surgeons' cognitive load, and a critique of the reliability and validity of current assessment metrics. A search strategy encompassing MEDLINE, Embase, Web of Science, PsycINFO, ACM Digital Library, IEEE Xplore, PROSPERO and the Cochrane database was developed to identify peer-reviewed articles published from inception to November 2016. Quality was assessed by using the Medical Education Research Study Quality Instrument (MERSQI). A summary table was created to describe study design, setting, specialty, participants, cognitive load measures and MERSQI score. Of 391 articles retrieved, 84 met the inclusion criteria, totalling 2053 unique participants. Most studies were carried out in a simulated setting (59 studies, 70 per cent). Sixty studies (71 per cent) used self-reporting methods, of which the NASA Task Load Index (NASA-TLX) was the most commonly applied tool (44 studies, 52 per cent). Heart rate variability analysis was the most used real-time method (11 studies, 13 per cent). Self-report instruments are valuable when the aim is to assess the overall cognitive load in different surgical procedures and assess learning curves within competence-based surgical education. When the aim is to assess cognitive load related to specific operative stages, real-time tools should be used, as they allow capture of cognitive load fluctuation. A combination of both subjective and objective methods might provide optimal measurement of surgeons' cognition. © 2018 BJS Society Ltd Published by John Wiley & Sons Ltd.

An Adaptation of the Original Fresno Test to Measure Evidence-Based Practice Competence in Pediatric Bedside Nurses.

PubMed

Laibhen-Parkes, Natasha; Kimble, Laura P; Melnyk, Bernadette Mazurek; Sudia, Tanya; Codone, Susan

2018-06-01

Instruments used to assess evidence-based practice (EBP) competence in nurses have been subjective, unreliable, or invalid. The Fresno test was identified as the only instrument to measure all the steps of EBP with supportive reliability and validity data. However, the items and psychometric properties of the original Fresno test are only relevant to measure EBP with medical residents. Therefore, the purpose of this paper is to describe the development of the adapted Fresno test for pediatric nurses, and provide preliminary validity and reliability data for its use with Bachelor of Science in Nursing-prepared pediatric bedside nurses. General adaptations were made to the original instrument's case studies, item content, wording, and format to meet the needs of a pediatric nursing sample. The scoring rubric was also modified to complement changes made to the instrument. Content and face validity, and intrarater reliability of the adapted Fresno test were assessed during a mixed-methods pilot study conducted from October to December 2013 with 29 Bachelor of Science in Nursing-prepared pediatric nurses. Validity data provided evidence for good content and face validity. Intrarater reliability estimates were high. The adapted Fresno test presented here appears to be a valid and reliable assessment of EBP competence in Bachelor of Science in Nursing-prepared pediatric nurses. However, further testing of this instrument is warranted using a larger sample of pediatric nurses in diverse settings. This instrument can be a starting point for evaluating the impact of EBP competence on patient outcomes. © 2018 Sigma Theta Tau International.

Using Instruments for Tactical Assessment in Physical Education and Extra-Curricular Sports

ERIC Educational Resources Information Center

Arias-Estero, José; Castejón, Francisco

2014-01-01

The aim was to analyse the features concerning the applicational purpose and strategy of the most common instruments used to assess game tactics both in Physical Education (PE) and in extra-curricular sport contexts. The review focused on two instruments: the Game Performance Assessment Instrument (GPAI) and the Team Sport Assessment Procedure…

Corporate Entrepreneurship Assessment Instrument (CEAI): Refinement and Validation of a Survey Measure

DTIC Science & Technology

2007-03-01

CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE...States Government. AFIT/GIR/ENV/07-M7 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE...UNLIMITED AFIT/GIR/ENV/07-M7 CORPORATE ENTREPRENEURSHIP ASSESSMENT INSTRUMENT (CEAI): REFINEMENT AND VALIDATION OF A SURVEY MEASURE Michael

Development and psychometric properties of a theory-guided prescription stimulant misuse questionnaire for college students.

PubMed

Bavarian, Niloofar; Flay, Brian R; Ketcham, Patricia L; Smit, Ellen

2013-04-01

A theory-guided instrument for examining prescription stimulant misuse in the college population was developed and its psychometric properties were evaluated from 2011 to 2012 at one Pacific Northwest (United States) university. Study methods included instrument development, assessment by five health and measurement professionals, group interviews with six college students, a test-retest pilot study, and a paper-based, in-classroom, campus study using one-stage cluster sampling (N = 520 students, 20 classrooms, eligible student response rate = 96.30%). The instrument demonstrated reliability (i.e., internal consistency and stability) and validity (i.e., face, content, and predictive). Limitations and implications are discussed.

Evaluating the Implementation of an Olympic Education Program in Greece

NASA Astrophysics Data System (ADS)

Grammatikopoulos, Vasilios; Tsigilis, Nikolaos; Koustelios, Athanasios; Theodorakis, Yannis

2005-11-01

The aim of this study was to develop an instrument for evaluating how an education program has been implemented. Such evaluation can provide insight into the effectiveness of a program. Examined here was the Olympic Education Program used in Greek schools since 2000. In it, students learn the history of the Olympic games and the importance of exercise for health along with the principles and values of sports and volunteerism. The evaluation instrument underlying this study addressed the following six factors: `facilities', `administration', `educational material', `student-teacher relationships', `educational procedures', and `training'. Results indicate that the instrument, while adequate for assessing effectiveness, should be combined with advanced statistical methods.

‘‘Time after time’’: A Quali-T method for assessing music's impact on well-being

PubMed Central

2013-01-01

This article considers the question of how to produce ecologically valid assessments of music's role as a health technology. To address this question, I consider critically some of the standard quantitative instruments used to assess well-being and quality of life. I suggest that these instruments do not lend themselves well to the production of ecologically valid assessments and understandings for two reasons: (1) the process of data elicitation is removed from everyday meanings and practices and therefore risks producing data that is an artifact of the situation in which it is elicited (2) standard, quantitative instruments are not neutral but are rather discursive texts that are inevitably imbued with a politics of expertise and an image of the health care client. For these reasons, I suggest that we consider the question of how to develop ecologically valid, client-centered assessment measures. To that end, I introduce a third critique of the standard quantitative instruments, namely that they are associated with, and promote, an ontology of wellness/illness that downplays the temporally variable and situationally emergent nature of both wellness/illness and musical interventions themselves. As an alternative mode of assessment, I suggest that we reconsider the value of singular case studies and I describe a set of principles that can assist researchers to produce ecologically valid assessments. To this end I introduce the concept of the musical event as a more ecologically valid means for illuminating the specific mechanisms by which music aids well-being. I suggest that the case study approach is temporally sensitive, that it lends itself to an emergent ontology of wellness/illness, and that it is client-centered (and can also be user-led). PMID:23930990

Deformation of HyFlex CM instruments and their shape recovery following heat sterilization.

PubMed

Alfoqom Alazemi, M; Bryant, S T; Dummer, P M H

2015-06-01

To assess the deformation of HyFlex CM instruments (Coltene Whaledent) when used in two instrumentation sequences and to assess their shape recovery after heat sterilization. Simulated root canals with four different shapes were prepared with HyFlex CM instruments using a single-length technique (n = 40) or a crown down technique (n = 40). Pre-preparation, post-preparation and post-sterilization standardized images of each instrument were recorded. Assessment of instrument deformation and their subsequent shape recovery was carried out visually and by comparing the digitised images. Data analysis was carried out using chi-square tests. None of the 400 instruments fractured. Visual assessment of instruments post-preparation revealed that 30.5% had unwound and 0.5% had reverse winding. Following sterilization 8.5% remained unwound and 0.5% remained with reverse winding. When assessing instrument shape using digital images, 35.25% were unwound post-preparation, which reduced to 11% post-sterilization. Nine size 25, 0.08 instruments deformed, but none fully regained their original shape after sterilization; however, other sizes of deformed instruments did regain their shape (P < 0.001). Approximately one third of instruments became deformed as a result of use. However, two thirds of these fully recovered their shape following sterilization. The number of deformed instruments was underestimated when no magnification was used for assessment. Instrument size was related to incidence of deformation and shape recovery. © 2014 International Endodontic Journal. Published by John Wiley & Sons Ltd.

The Laboratory Course Assessment Survey: A Tool to Measure Three Dimensions of Research-Course Design

PubMed Central

Corwin, Lisa A.; Runyon, Christopher; Robinson, Aspen; Dolan, Erin L.

2015-01-01

Course-based undergraduate research experiences (CUREs) are increasingly being offered as scalable ways to involve undergraduates in research. Yet few if any design features that make CUREs effective have been identified. We developed a 17-item survey instrument, the Laboratory Course Assessment Survey (LCAS), that measures students’ perceptions of three design features of biology lab courses: 1) collaboration, 2) discovery and relevance, and 3) iteration. We assessed the psychometric properties of the LCAS using established methods for instrument design and validation. We also assessed the ability of the LCAS to differentiate between CUREs and traditional laboratory courses, and found that the discovery and relevance and iteration scales differentiated between these groups. Our results indicate that the LCAS is suited for characterizing and comparing undergraduate biology lab courses and should be useful for determining the relative importance of the three design features for achieving student outcomes. PMID:26466990

Preceptors’ Self-Assessment of Their Ability to Perform the Learning Objectives of an Experiential Program

PubMed Central

2012-01-01

Objective. To evaluate preceptors’ perception of their ability to perform the Structured Practical Experiences in Pharmacy (SPEP) learning objectives through a self-assessment activity. Methods. A self-assessment instrument consisting of 28 learning objectives associated with clinic, community, and hospital pharmacy practice experiences were developed. Preceptors rated their performance ability for each of the learning objectives using a 3-point Likert scale. Results. Of the 116 preceptors, 89 (77%) completed the self-assessment survey instrument. The overall preceptor responses to the items on performance of the 28 SPEP learning objectives ranged from good to excellent. Years of experience, practice experience setting, and involvement as a SPEP or SPEP and PharmD preceptor had no influence on their self-reported capabilities. Conclusion. Most preceptors rated their ability to perform the learning objectives for the structured practical experiences in pharmacy as high. Competency areas requiring further preceptor development were identified. PMID:23193333

[Recovery Self Assessment: Translation and cultural adaption of a recovery oriented assessment instrument].

PubMed

Zuaboni, Gianfranco; Degano Kieser, Luciana; Kozel, Bernd; Glavanovits, Katharina; Utschakowski, Jörg; Behrens, Johann

2015-08-01

The recovery approach is becoming increasingly important in mental health services and research. In English-speaking countries, its practical implementation as well as the scientific discussion is far more advanced. To support the approach, assessment instruments are required. A widespread and recognised tool is the Recovery Self Assessment Scale {RSA}. This includes four versions of a questionnaire, which cover the perspectives of users, providers, family members and management. In this article, the development of the instrument and the system atictranslation process are presented. Two independent research groups applied different translation. The Swiss research group {AGS} used the ISOPR principles, the German research group (AGN} the Guidelines of the European Social Survey Programme for survey translations TRAPD. The methods differ in the fact,that TRAPD uses focus groups. The results of both groups were combined by means of a consensus process. Within the translation and cultural adjustment of the RSA-D, the the oretical framework of the RSA as well as the transferability into the German speaking context has been ensured. Before the RSA-D c~n beused in practice and research, further studies towards psychometric testing should be conducted.

Development of a Computer-Based Survey Instrument for Organophosphate and N-Methyl-Carbamate Exposure Assessment among Agricultural Pesticide Handlers

PubMed Central

Hofmann, Jonathan N.; Checkoway, Harvey; Borges, Ofelio; Servin, Flor; Fenske, Richard A.; Keifer, Matthew C.

2010-01-01

Background: Assessment of occupational pesticide exposures based on self-reported information can be challenging, particularly with immigrant farm worker populations for whom specialized methods are needed to address language and cultural barriers and account for limited literacy. An audio computer-assisted self-interview (A-CASI) survey instrument was developed to collect information about organophosphate (OP) and N-methyl-carbamate (CB) exposures and other personal characteristics among male agricultural pesticide handlers for an ongoing cholinesterase biomonitoring study in Washington State. Objectives: To assess the feasibility of collecting data using the A-CASI instrument and evaluate reliability for a subset of survey items. Methods: The survey consisted of 64 items administered in Spanish or English on a touch-screen tablet computer. Participants listened to digitally recorded questions on headphones and selected responses on the screen, most of which were displayed as images or icons to facilitate participation of low literacy respondents. From 2006–2008, a total of 195 participants completed the survey during the OP/CB application seasons on at least one occasion. Percent agreement and kappa coefficients were calculated to evaluate test–retest reliability for selected characteristics among 45 participants who completed the survey on two separate occasions within the same year. Results: Almost all participants self-identified as Hispanic or Latino (98%), and 97% completed the survey in Spanish. Most participants completed the survey in a half-hour or less, with minimal assistance from on-site research staff. Analyses of test–retest reliability showed substantial agreement for most demographic, work history, and health characteristics and at least moderate agreement for most variables related to personal protective equipment use during pesticide applications. Conclusions: This A-CASI survey instrument is a novel method that has been used successfully to collect information about OP/CB exposures and other personal characteristics among Spanish-speaking agricultural pesticide handlers. PMID:20413416

Instrument for assessing mobile technology acceptability in diabetes self-management: a validation and reliability study

PubMed Central

Frandes, Mirela; Deiac, Anca V; Timar, Bogdan; Lungeanu, Diana

2017-01-01

Background Nowadays, mobile technologies are part of everyday life, but the lack of instruments to assess their acceptability for the management of chronic diseases makes their actual adoption for this purpose slow. Objective The objective of this study was to develop a survey instrument for assessing patients’ attitude toward and intention to use mobile technology for diabetes mellitus (DM) self-management, as well as to identify sociodemographic characteristics and quality of life factors that affect them. Methods We first conducted the documentation and instrument design phases, which were subsequently followed by the pilot study and instrument validation. Afterward, the instrument was administered 103 patients (median age: 37 years; range: 18–65 years) diagnosed with type 1 or type 2 DM, who accepted to participate in the study. The reliability and construct validity were assessed by computing Cronbach’s alpha and using factor analysis, respectively. Results The instrument included statements about the actual use of electronic devices for DM management, interaction between patient and physician, attitude toward using mobile technology, and quality of life evaluation. Cronbach’s alpha was 0.9 for attitude toward using mobile technology and 0.97 for attitude toward using mobile device applications for DM self-management. Younger patients (Spearman’s ρ=−0.429; P<0.001) with better glycemic control (Spearman’s ρ=−0.322; P<0.001) and higher education level (Kendall’s τ=0.51; P<0.001) had significantly more favorable attitude toward using mobile assistive applications for DM control. Moreover, patients with a higher quality of life presented a significantly more positive attitude toward using modern technology (Spearman’s ρ=0.466; P<0.001). Conclusion The instrument showed good reliability and internal consistency, making it suitable for measuring the acceptability of mobile technology for DM self-management. Additionally, we found that even if most of the patients showed positive attitude toward mobile applications, only a moderate level of intention to indeed use them was observed. Moreover, the study indicated that barriers were truthfulness and easiness to use. PMID:28243069

Design Considerations for IAP Charts Approach Course Track and Communication Frequencies

DOT National Transportation Integrated Search

1991-08-01

This report describes two experiments evaluating format changes on instrument approach : plates (IAPs). The study used a simple chart reading task to assess information : transfer in IAPs. : The first experiment addressed different methods of display...

Review of Diesel Odor and Toxic Vapor Emissions

DOT National Transportation Integrated Search

1981-05-01

The purpose of the study was to attempt to assess the adequacy of the diesel engine exhaust chemical composition data base and instrumental analysis methods for the measurement of chemicals giving rise to sensory response, especially odor and irritat...

INNOVATIVE METHODS FOR EMISSION INVENTORY DEVELOPMENT AND EVALUATION: WORKSHOP SYNTHESIS

EPA Science Inventory

Emission inventories are key databases for evaluating, managing, and regulating air pollutants. Refinements and innovations in instruments that measure air pollutants, models that calculate emissions, and techniques for data management and uncertainty assessment are critical to ...

TEAM Webinar Series | EGRP/DCCPS/NCI/NIH

Cancer.gov

View archived webinars from the Transforming Epidemiology through Advanced Methods (TEAM) Webinar Series, hosted by NCI's Epidemiology and Genomics Research Program. Topics include participant engagement, data coordination, mHealth tools, sample selection, and instruments for diet & physical activity assessment.

20 CFR 628.515 - Objective assessment.

Code of Federal Regulations, 2010 CFR

2010-04-01

... aptitudes for nontraditional occupations), attitude towards work, motivation, behavior patterns affecting... appropriate means to measure skills, abilities, attitudes, and interests of the participants. The methods used... and/or attitude inventories, career guidance instruments, aptitude tests, and basic skills tests. (2...

The Brazilian Research Consortium on Obsessive-Compulsive Spectrum Disorders: recruitment, assessment instruments, methods for the development of multicenter collaborative studies and preliminary results.

PubMed

Miguel, Euripedes Constantino; Ferrão, Ygor Arzeno; Rosário, Maria Conceição do; Mathis, Maria Alice de; Torres, Albina Rodrigues; Fontenelle, Leonardo Franklin; Hounie, Ana Gabriela; Shavitt, Roseli Gedanke; Cordioli, Aristides Volpato; Gonzalez, Christina Hojaij; Petribú, Kátia; Diniz, Juliana Belo; Malavazzi, Dante Marino; Torresan, Ricardo C; Raffin, Andréa Litvin; Meyer, Elisabeth; Braga, Daniela T; Borcato, Sonia; Valério, Carolina; Gropo, Luciana N; Prado, Helena da Silva; Perin, Eduardo Alliende; Santos, Sandro Iêgo; Copque, Helen; Borges, Manuela Corrêa; Lopes, Angélica Prazeres; Silva, Elenita D da

2008-09-01

To describe the recruitment of patients, assessment instruments, implementation, methods and preliminary results of The Brazilian Research Consortium on Obsessive-Compulsive Spectrum Disorders, which includes seven university sites. This cross-sectional study included a comprehensive clinical assessment including semi-structured interviews (sociodemographic data, medical and psychiatric history, disease course and comorbid psychiatric diagnoses), and instruments to assess obsessive-compulsive (Yale-Brown Obsessive-Compulsive Scale and Dimensional Yale-Brown Obsessive-Compulsive Scale), depressive (Beck Depression Inventory) and anxious (Beck Anxiety Inventory) symptoms, sensory phenomena (Universidade de São Paulo Sensory Phenomena Scale), insight (Brown Assessment Beliefs Scale), tics (Yale Global Tics Severity Scale) and quality of life (Medical Outcome Quality of Life Scale Short-form-36 and Social Assessment Scale). The raters' training consisted of watching at least five videotaped interviews and interviewing five patients with an expert researcher before interviewing patients alone. The reliability between all leaders for the most important instruments (Structured Clinical Interview for DSM-IV, Dimensional Yale-Brown Obsessive-Compulsive Scale, Universidade de São Paulo Sensory Phenomena Scale) was measured after six complete interviews. Inter-rater reliability was 96%. By March 2008, 630 obsessive-compulsive disorder patients had been systematically evaluated. Mean age (+/-SE) was 34.7 (+/-0.51), 56.3% were female, and 84.6% Caucasian. The most prevalent obsessive compulsive symptom dimensions were symmetry and contamination. The most common comorbidities were major depression, generalized anxiety and social anxiety disorder. The most common DSM-IV impulsive control disorder was skin picking. The sample was composed mainly by Caucasian individuals, unmarried, with some kind of occupational activity, mean age of 35 years, onset of obsessive-compulsive symptoms at 13 years of age, mild to moderate severity, mostly of symmetry, contamination/cleaning and comorbidity with depressive disorders. The Brazilian Research Consortium on Obsessive-Compulsive Spectrum Disorders has established an important network for standardized collaborative clinical research in obsessive-compulsive disorder and may pave the way to similar projects aimed at integrating other research groups in Brazil and throughout the world.

Reaching clinically relevant outcome measures for new pharmacotherapy and immunotherapy of atopic eczema.

PubMed

Chalmers, Joanne; Deckert, Stefanie; Schmitt, Jochen

2015-06-01

This article describes the core outcome set (COS) for atopic eczema trials. COS describe a minimum set of outcomes to be assessed in a defined situation. COS are required to overcome the current situation of different trials using different endpoints with unclear/insufficient measurement properties resulting in incomparable trials. The global multi-stakeholder Harmonising Outcomes Measures for Eczema initiative developed the Harmonising Outcomes Measures for Eczema roadmap as a generic framework for COS development. Following the establishment of a panel representing all stakeholders, a core set of outcome domains need to be selected based on systematic reviews and consensus methods. Outcome measurement instruments to assess these core domains need to be valid, reliable, and feasible. There is broad global consensus that clinical signs, quality of life, symptoms, and long-term control of flares form the COS for atopic eczema trials. The Eczema Area and Severity Index is recommended to assess clinical signs in atopic eczema trials. Systematic reviews to identify adequate outcome measurement instruments for the other core outcome domains are underway. Clinical signs should be assessed in all atopic eczema trials by at least the Eczema Area and Severity Index. Quality of life, symptoms, and flares should also be assessed in all atopic eczema trials by a valid, reliable, and feasible instrument.

Classification by causes of dark circles and appropriate evaluation method of dark circles.

PubMed

Park, S R; Kim, H J; Park, H K; Kim, J Y; Kim, N S; Byun, K S; Moon, T K; Byun, J W; Moon, J H; Choi, G S

2016-08-01

Dark circles refer to a symptom that present darkness under the eyes. Because of improvement in the quality of life, the dark circles have been recognized as one of major cosmetic concerns. However, it is not easy to classify the dark circles because they have various causes. To select suitable instruments and detailed evaluation items, the dark circles were classified according to the causes through visual assessment, Wood's lamp test, and medical history survey for 100 subjects with dark circles. After the classification, were newly recruited for instrument conformity assessment. Through this, suitable instruments for dark circle evaluation were selected. We performed a randomized clinical trial for dark circles, a placebo-controlled double-blind study, using effective parameters of the instruments selected from the preliminary test. Dark circles of vascular type (35%) and mixed type (54%), a combination of pigmented and vascular types, were the most common. Twenty four subjects with the mixed type dark circles applied the test product (Vitamin C 3%, Vitamin A 0.1%, Vitamin E 0.5%) and placebo on randomized split-face for 8 weeks. The effective parameters (L*, a, M.I., E.I., quasi L*, quasi a* and dermal thickness) were measured during the study period. Result showed that the L* value of Chromameter(®) , Melanin index (M.I.) of Mexameter(®) and quasi L* value obtained by image analysis improved with statistical significance after applying the test product compared with the placebo product. We classified the dark circles according to the causes of the dark circles and verified the reliability of the parameter obtained by the instrument conformity assessment used in this study through the efficacy evaluation. Also based on this study, we were to suggest newly established methods which can be applied to the evaluation of efficacy of functional cosmetics for dark circles. © 2015 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

42 CFR 483.315 - Specification of resident assessment instrument.

Code of Federal Regulations, 2010 CFR

2010-10-01

... updated periodically, and consists of the following: (1) The minimum data set (MDS) and common definitions... specified by CMS. (4) The requirements for use of the RAI that appear at § 483.20. (e) Minimum data set (MDS...) Specify to a facility the method of transmission of data, and instruct the facility on this method. (3...

42 CFR 483.315 - Specification of resident assessment instrument.

Code of Federal Regulations, 2014 CFR

2014-10-01

... updated periodically, and consists of the following: (1) The minimum data set (MDS) and common definitions... specified by CMS. (4) The requirements for use of the RAI that appear at § 483.20. (e) Minimum data set (MDS...) Specify to a facility the method of transmission of data, and instruct the facility on this method. (3...

42 CFR 483.315 - Specification of resident assessment instrument.

Code of Federal Regulations, 2012 CFR

2012-10-01

... updated periodically, and consists of the following: (1) The minimum data set (MDS) and common definitions... specified by CMS. (4) The requirements for use of the RAI that appear at § 483.20. (e) Minimum data set (MDS...) Specify to a facility the method of transmission of data, and instruct the facility on this method. (3...

42 CFR 483.315 - Specification of resident assessment instrument.

Code of Federal Regulations, 2013 CFR

2013-10-01

... updated periodically, and consists of the following: (1) The minimum data set (MDS) and common definitions... specified by CMS. (4) The requirements for use of the RAI that appear at § 483.20. (e) Minimum data set (MDS...) Specify to a facility the method of transmission of data, and instruct the facility on this method. (3...

42 CFR 483.315 - Specification of resident assessment instrument.

Code of Federal Regulations, 2011 CFR

2011-10-01

... updated periodically, and consists of the following: (1) The minimum data set (MDS) and common definitions... specified by CMS. (4) The requirements for use of the RAI that appear at § 483.20. (e) Minimum data set (MDS...) Specify to a facility the method of transmission of data, and instruct the facility on this method. (3...

Implementation outcome assessment instruments used in physical healthcare settings and their measurement properties: a systematic review protocol.

PubMed

Khadjesari, Zarnie; Vitoratou, Silia; Sevdalis, Nick; Hull, Louise

2017-10-08

Over the past 10 years, research into methods that promote the uptake, implementation and sustainability of evidence-based interventions has gathered pace. However, implementation outcomes are defined in different ways and assessed by different measures; the extent to which these measures are valid and reliable is unknown. The aim of this systematic review is to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings, to advance the use of precise and accurate measures. The following databases will be searched from inception to March 2017: MEDLINE, EMBASE, PsycINFO, CINAHL and the Cochrane Library. Grey literature will be sought via HMIC, OpenGrey, ProQuest for theses and Web of Science Conference Proceedings Citation Index-Science. Reference lists of included studies and relevant reviews will be hand searched. Three search strings will be combined to identify eligible studies: (1) implementation literature, (2) implementation outcomes and (3) measurement properties. Screening of titles, abstracts and full papers will be assessed for eligibility by two reviewers independently and any discrepancies resolved via consensus with the wider team. The methodological quality of the studies will be assessed using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. A set of bespoke criteria to determine the quality of the instruments will be used, and the relationship between instrument usability and quality will be explored. Ethical approval is not necessary for systematic review protocols. Researchers and healthcare professionals can use the findings of this systematic review to guide the selection of implementation outcomes instruments, based on their psychometric quality, to assess the impact of their implementation efforts. The findings will also provide a useful guide for reviewers of papers and grants to determine the psychometric quality of the measures used in implementation research. International Prospective Register of Systematic Reviews (PROSPERO): CRD42017065348. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Quality of Work: Validation of a New Instrument in Three Languages

PubMed Central

Steffgen, Georges; Kohl, Diane; Reese, Gerhard; Happ, Christian; Sischka, Philipp

2015-01-01

Introduction and objective: A new instrument to measure quality of work was developed in three languages (German, French and Luxembourgish) and validated in a study of employees working in Luxembourg. Methods and results: A representative sample (n = 1529) was taken and exploratory factor analysis revealed a six-factor solution for the 21-item instrument (satisfaction and respect, mobbing, mental strain at work, cooperation, communication and feedback, and appraisal). Reliability analysis showed satisfying reliability for all six factors and the total questionnaire. In order to examine the construct validity of the new instrument, regression analyses were conducted to test whether the instrument predicted work characteristics’ influence on three components of well-being—burnout, psychological stress and maladaptive coping behaviors. Conclusion: The present validation offers a trilingual inventory for measuring quality of work that may be used, for example, as an assessment tool or for testing the effectiveness of interventions. PMID:26703634

MSL Chemistry and Mineralogy X-Ray Diffraction X-Ray Fluorescence (CheMin) Instrument

NASA Technical Reports Server (NTRS)

Zimmerman, Wayne; Blake, Dave; Harris, William; Morookian, John Michael; Randall, Dave; Reder, Leonard J.; Sarrazin, Phillipe

2013-01-01

This paper provides an overview of the Mars Science Laboratory (MSL) Chemistry and Mineralogy Xray Diffraction (XRD), X-ray Fluorescence (XRF) (CheMin) Instrument, an element of the landed Curiosity rover payload, which landed on Mars in August of 2012. The scientific goal of the MSL mission is to explore and quantitatively assess regions in Gale Crater as a potential habitat for life - past or present. The CheMin instrument will receive Martian rock and soil samples from the MSL Sample Acquisition/Sample Processing and Handling (SA/SPaH) system, and process it utilizing X-Ray spectroscopy methods to determine mineral composition. The Chemin instrument will analyze Martian soil and rocks to enable scientists to investigate geophysical processes occurring on Mars. The CheMin science objectives and proposed surface operations are described along with the CheMin hardware with an emphasis on the system engineering challenges associated with developing such a complex instrument.

Development of a Chinese medicine assessment measure: an interdisciplinary approach using the delphi method.

PubMed

Schnyer, Rosa N; Conboy, Lisa A; Jacobson, Eric; McKnight, Patrick; Goddard, Thomas; Moscatelli, Francesca; Legedza, Anna T R; Kerr, Catherine; Kaptchuk, Ted J; Wayne, Peter M

2005-12-01

The diagnostic framework and clinical reasoning process in Chinese medicine emphasizes the contextual and qualitative nature of a patient's illness. Chinese medicine assessment data may help interpret clinical outcomes. As part of a study aimed at assessing the validity and improving the inter-rater reliability of the Chinese diagnostic process, a structured assessment instrument was developed for use in clinical trials of acupuncture and other Chinese medical therapies. To foster collaboration and maximize resources and information, an interdisciplinary advisory team was assembled. Under the guidance of two group process facilitators, and in order to establish whether the assessment instrument was consistent with accepted Chinese medicine diagnostic categories (face validity) and included the full range of each concept's meaning (content validity), a panel of Traditional Chinese Medicine (TCM) expert clinicians was convened and their responses were organized using the Delphi process, an iterative, anonymous, idea-generating and consensus-building process. An aggregate rating measure was obtained by taking the mean of mean ratings for each question across all 10 experts. Over three rounds, the overall rating increased from 7.4 (SD = 1.3) in Round 1 to 9.1 (SD = 0.5) in Round 3. The level of agreement among clinicians was measured by a decrease in SD. The final instrument TEAMSI-TCM (Traditional East Asian Medicine Structured Interview, TCM version) uses the pattern differentiation model characteristic of TCM. This modular, dynamic version was specifically designed to assess women, with a focus on gynecologic conditions; with modifications it can be adapted for use with other populations and conditions. TEAMSI-TCM is a prescriptive instrument that guides clinicians to use the proper indicators, combine them in a systematic manner, and generate conclusions. In conjunction with treatment manualization and training it may serve to increase inter-rater reliability and inter-trial reproducibility in Chinese medicine clinical trials. Testing of the validity and reliability of this instrument currently is underway.

Violent Recidivism: A Long-Time Follow-Up Study of Mentally Disordered Offenders

PubMed Central

Nilsson, Thomas; Wallinius, Märta; Gustavson, Christina; Anckarsäter, Henrik; Kerekes, Nóra

2011-01-01

Background In this prospective study, mentally disordered perpetrators of severe violent and/or sexual crimes were followed through official registers for 59 (range 8 to 73) months. The relapse rate in criminality was assessed, compared between offenders sentenced to prison versus forensic psychiatric care, and the predictive ability of various risk factors (criminological, clinical, and of structured assessment instruments) was investigated. Method One hundred perpetrators were consecutively assessed between 1998 and 2001 by a clinical battery of established instruments covering DSM-IV diagnoses, psychosocial background factors, and structured assessment instruments (HCR-20, PCL-R, and life-time aggression (LHA)). Follow-up data was collected from official registers for: (i) recidivistic crimes, (ii) crimes during ongoing sanction. Results Twenty subjects relapsed in violent criminality during ongoing sanctions (n = 6) or after discharge/parole (n = 14). Individuals in forensic psychiatric care spent significantly more time at liberty after discharge compared to those in prison, but showed significantly fewer relapses. Criminological (age at first conviction), and clinical (conduct disorder and substance abuse/dependence) risk factors, as well as scores on structured assessment instruments, were moderately associated with violent recidivism. Logistic regression analyses showed that the predictive ability of criminological risk factors versus clinical risk factors combined with scores from assessment instruments was comparable, with each set of variables managing to correctly classify about 80% of all individuals, but the only predictors that remained significant in multiple models were criminological (age at first conviction, and a history of substance abuse among primary relatives). Conclusions Only one in five relapsed into serious criminality, with significantly more relapses among subjects sentenced to prison as compared to forensic psychiatric care. Criminological risk factors tended to be the best predictors of violent relapses, while few synergies were seen when the risk factors were combined. Overall, the predictive validity of common risk factors for violent criminality was rather weak. PMID:22022445

A biocultural perspective on fictive kinship in the Andes: social support and women's immune function in El Alto, Bolivia.

PubMed

Hicks, Kathryn

2014-09-01

This article examines the influence of emotional and instrumental support on women's immune function, a biomarker of stress, in the city of El Alto, Bolivia. It tests the prediction that instrumental support is protective of immune function for women living in this marginal environment. Qualitative and quantitative ethnographic methods were employed to assess perceived emotional and instrumental support and common sources of support; multiple linear regression analysis was used to model the relationship between social support and antibodies to the Epstein-Barr virus. These analyses provided no evidence that instrumental social support is related to women's health, but there is some evidence that emotional support from compadres helps protect immune function. © 2014 by the American Anthropological Association.

Authentic assessment based showcase portfolio on learning of mathematical problem solving in senior high school

NASA Astrophysics Data System (ADS)

Sukmawati, Zuhairoh, Faihatuz

2017-05-01

The purpose of this research was to develop authentic assessment model based on showcase portfolio on learning of mathematical problem solving. This research used research and development Method (R & D) which consists of four stages of development that: Phase I, conducting a preliminary study. Phase II, determining the purpose of developing and preparing the initial model. Phase III, trial test of instrument for the initial draft model and the initial product. The respondents of this research are the students of SMAN 8 and SMAN 20 Makassar. The collection of data was through observation, interviews, documentation, student questionnaire, and instrument tests mathematical solving abilities. The data were analyzed with descriptive and inferential statistics. The results of this research are authentic assessment model design based on showcase portfolio which involves: 1) Steps in implementing the authentic assessment based Showcase, assessment rubric of cognitive aspects, assessment rubric of affective aspects, and assessment rubric of skill aspect. 2) The average ability of the students' problem solving which is scored by using authentic assessment based on showcase portfolio was in high category and the students' response in good category.

Black carbon emissions in gasoline vehicle exhaust: a measurement and instrument comparison.

PubMed

Kamboures, Michael A; Hu, Shishan; Yu, Yong; Sandoval, Julia; Rieger, Paul; Huang, Shiou-Mei; Zhang, Sherry; Dzhema, Inna; Huo, Darey; Ayala, Alberto; Chang, M C Oliver

2013-08-01

A pilot study was conducted to evaluate the performance and agreement of several commercially available black carbon (BC) measurement instruments, when applied to the quantification of BC in light-duty vehicle (LDV) exhaust. Samples from six vehicles, three fuels, and three driving cycles were used. The pilot study included determinations of the method detection limit (MDL) and repeatability. With respect to the MDL, the real-time instruments outperformed the time-integrated instruments, with MDL = 0.12 mg/mi for the AE51 Aethalometer, and 0.15 mg/mi for the Micro Soot Sensor (MSS), versus 0.38 mg/mi for the IMPROVE_A thermal/ optical method, and 0.35 mg/mi for the OT21_T Optical Transmissometer. The real-time instruments had repeatability values ranging from 30% to 35%, which are somewhat better than those of the time-integrated instruments (40-41%). These results suggest that, despite being less resource intensive, real-time methods can be equivalent or superior to time-integrated methods in terms of sensitivity and repeatability. BC mass data, from the photoacoustic and light attenuation instruments, were compared against same-test EC data, determined using the IMPROVE_A method. The MSS BC data was well correlated with EC, with R2 = 0.85 for the composite results and R2 = 0.86 for the phase-by-phase (PBP) results. The correlation of BC, by the AE51, AE22, and OT21_T with EC was moderate to weak. The weaker correlation was driven by the inclusion of US06 test data in the linear regression analysis. We hypothesize that test-cycle-dependent BC:EC ratios are due to the different physicochemical properties of particulate matter (PM) in US06 and Federal Test Procedure (FTP) tests. Correlation amongst the real-time MSS, PASS-1, AE51, and AE22 instruments was excellent (R2 = 0.83-0.95), below 1 mg/mi levels. In the process of investigating these BC instruments, we learned that BC emissions at sub-1 mg/mi levels can be measured and are achievable by current-generation gasoline engines. Most comparison studies of black carbon (BC) measurement methods were carried out in the ambient air. This study assesses the agreement among various BC measurement instrument in emissions from light-duty gasoline vehicles (LDGVs) on standard test cycles, and evaluates applicability of these methods under various fuel types, driving cycles, and engine combustion technologies. This research helps to fill in the knowledge gap of BC method standardization as stated in the U.S. Environmental Protection Agency (EPA) 2011 Report to Congress on Black Carbon, and these results demonstrate the feasibility of quantification of BC at the 1 mg/mi PM standard in California Low Emission Vehicle III regulations.

Adult Survival Skills Assessment.

ERIC Educational Resources Information Center

Walsko, Gregory M.

The purpose of this instrument is to supplement data from the Adult Basic Learning Examination in assessing the functional level of adults in daily situations. It may also be used as a teaching tool for adults requesting tutoring in specific concepts and skills presented in the instrument. This instrument is an informal assessment instrument and…

Proceedings of a Workshop on the Protection of Personnel against Radiofrequency Electromagnetic Radiation Held at the Royal Air Force Establishment, Farnborough, United Kingdom, 6-8 April 1981

DTIC Science & Technology

1981-09-01

setting and application of RFR safety standards, assessment of RFR levels in the military workplaces, RFR instrumentation and dosimetry , the medical...RADIOFREQUENCY BURN HAZARDS IN THE MF/HF BAND ................ ... 76 S. J. Rogers (U.K.) 3. RADIOFREQUENCY RADIATION INSTRUMENTATION AND DOSIMETRY ...97 B. Audone, L. Bolla, and G. Gerbi (Italy) RADIOFREQUENCY RADIATION DOSIMETRY : A REVIEW OF THEORETICAL METHODS AND EXPERIMENTAL RESULTS

The READI Assessment as a Possible Predictor of Student Success in Online Communication Courses

ERIC Educational Resources Information Center

Fair, Brandy; Wickersham, Leah E.

2012-01-01

The problem under investigation for this study was to identify a method for determining a student's potential for success in an online communication course using the Readiness for Education At a Distance Indicator (READI) assessment instrument as a predictor. The READI tool focuses on six areas that students should score well on in order to be…

A Self Rating Scale as a Pre and Post Assessment Tool for Use with Instructional Modules.

ERIC Educational Resources Information Center

Gotts, Sandra Harris

This article describes a self rating pre- and post-assessment instrument that has been developed at the Central Michigan University (CMU). Nine instructional modules have been developed and are being used in science methods courses at CMU. Each module focuses on an identified area of competency for elementary science teachers and contains a…

A Comparison of Functional Behavior Assessment Methodologies with Young Children: Descriptive Methods and Functional Analysis

ERIC Educational Resources Information Center

Alter, Peter J.; Conroy, Maureen A.; Mancil, G. Rich; Haydon, Todd

2008-01-01

The use of functional behavior assessment (FBA) to guide the development of behavior intervention plans continues to increase since they were first mandated in IDEA (Individuals with Disabilities Education Act Amendments of 1997, 20 U.S.C. Section 1400 et seq, 1997). A variety of indirect and direct instruments have been developed to facilitate…

Empowering people to change occupational behaviours to address critical global issues.

PubMed

Ikiugu, Moses N; Westerfield, Madeline A; Lien, Jamie M; Theisen, Emily R; Cerny, Shana L; Nissen, Ranelle M

2015-06-01

The greatest threat to human well-being in this century is climate change and related global issues. We examined the effectiveness of the Modified Instrumentalism in Occupational Therapy model as a framework for facilitating occupational behaviour change to address climate change and related issues. Eleven individuals participated in this mixed-methods single-subject-design study. Data were gathered using the Modified Assessment and Intervention Instrument for Instrumentalism in Occupational Therapy and Daily Occupational Inventories. Quantitative data were analyzed using two- and three-standard deviation band methods. Qualitative data were analyzed using heuristic phenomenological procedures. Occupational performance changed for five participants. Participants' feelings shifted from frustration and helplessness to empowerment and a desire for action. They felt empowered to find occupation-based solutions to the global issues. Occupation-based interventions that increase personal awareness of the connection between occupational performance and global issues could empower people to be agents for action to ameliorate the issues.

Development and Validation of a Symptom-Based Activity Index for Adults with Eosinophilic Esophagitis

PubMed Central

Schoepfer, Alain M.; Straumann, Alex; Panczak, Radoslaw; Coslovsky, Michael; Kuehni, Claudia E.; Maurer, Elisabeth; Haas, Nadine A.; Romero, Yvonne; Hirano, Ikuo; Alexander, Jeffrey A.; Gonsalves, Nirmala; Furuta, Glenn T.; Dellon, Evan S.; Leung, John; Collins, Margaret H.; Bussmann, Christian; Netzer, Peter; Gupta, Sandeep K.; Aceves, Seema S.; Chehade, Mirna; Moawad, Fouad J.; Enders, Felicity T.; Yost, Kathleen J.; Taft, Tiffany H.; Kern, Emily; Zwahlen, Marcel; Safroneeva, Ekaterina

2015-01-01

BACKGROUND & AIMS Standardized instruments are needed to assess the activity of eosinophilic esophagitis (EoE), to provide endpoints for clinical trials and observational studies. We aimed to develop and validate a patient-reported outcome (PRO) instrument and score, based on items that could account for variations in patients’ assessments of disease severity. We also evaluated relationships between patients’ assessment of disease severity and EoE-associated endoscopic, histologic, and laboratory findings. METHODS We collected information from 186 patients with EoE in Switzerland and the US (69.4% male; median age, 43 years) via surveys (n = 135), focus groups (n = 27), and semi-structured interviews (n = 24). Items were generated for the instruments to assess biologic activity based on physician input. Linear regression was used to quantify the extent to which variations in patient-reported disease characteristics could account for variations in patients’ assessment of EoE severity. The PRO instrument was prospectively used in 153 adult patients with EoE (72.5% male; median age, 38 years), and validated in an independent group of 120 patients with EoE (60.8% male; median age, 40.5 years). RESULTS Seven PRO factors that are used to assess characteristics of dysphagia, behavioral adaptations to living with dysphagia, and pain while swallowing accounted for 67% of the variation in patients’ assessment of disease severity. Based on statistical consideration and patient input, a 7-day recall period was selected. Highly active EoE, based on endoscopic and histologic findings, was associated with an increase in patient-assessed disease severity. In the validation study, the mean difference between patient assessment of EoE severity and PRO score was 0.13 (on a scale from 0 to 10). CONCLUSIONS We developed and validated an EoE scoring system based on 7 PRO items that assesses symptoms over a 7-day recall period. Clinicaltrials.gov number: NCT00939263. PMID:25160980

The Teamwork Assessment Scale: A Novel Instrument to Assess Quality of Undergraduate Medical Students' Teamwork Using the Example of Simulation-based Ward-Rounds.

PubMed

Kiesewetter, Jan; Fischer, Martin R

2015-01-01

Simulation-based teamwork trainings are considered a powerful training method to advance teamwork, which becomes more relevant in medical education. The measurement of teamwork is of high importance and several instruments have been developed for various medical domains to meet this need. To our knowledge, no theoretically-based and easy-to-use measurement instrument has been published nor developed specifically for simulation-based teamwork trainings of medical students. Internist ward-rounds function as an important example of teamwork in medicine. The purpose of this study was to provide a validated, theoretically-based instrument that is easy-to-use. Furthermore, this study aimed to identify if and when rater scores relate to performance. Based on a theoretical framework for teamwork behaviour, items regarding four teamwork components (Team Coordination, Team Cooperation, Information Exchange, Team Adjustment Behaviours) were developed. In study one, three ward-round scenarios, simulated by 69 students, were videotaped and rated independently by four trained raters. The instrument was tested for the embedded psychometric properties and factorial structure. In study two, the instrument was tested for construct validity with an external criterion with a second set of 100 students and four raters. In study one, the factorial structure matched the theoretical components but was unable to separate Information Exchange and Team Cooperation. The preliminary version showed adequate psychometric properties (Cronbach's α=.75). In study two, the instrument showed physician rater scores were more reliable in measurement than those of student raters. Furthermore, a close correlation between the scale and clinical performance as an external criteria was shown (r=.64) and the sufficient psychometric properties were replicated (Cronbach's α=.78). The validation allows for use of the simulated teamwork assessment scale in undergraduate medical ward-round trainings to reliably measure teamwork by physicians. Further studies are needed to verify the applicability of the instrument.

Implementation of a chemical background method (OH-CHEM) for measurements of OH using the Leeds FAGE instrument: Characterisation and observations from a coastal location

NASA Astrophysics Data System (ADS)

Woodward-Massey, R.; Cryer, D. R.; Whalley, L. K.; Ingham, T.; Seakins, P. W.; Heard, D. E.; Stimpson, L. M.

2015-12-01

The removal of pollutants and greenhouse gases in the troposphere is dominated by reactions with the hydroxyl radical (OH), which is closely coupled to the hydroperoxy radical (HO2). Comparisons of the levels of OH and HO2 observed during field campaigns to the results of detailed chemical box models serve as a vital tool to assess our understanding of the underlying chemical mechanisms involved in tropospheric oxidation. Recent measurements of OH and HO2 radicals are significantly higher than those predicted by models for some instruments measuring in certain environments, especially those influenced by high emissions of biogenic compounds such as isoprene, prompting intense laboratory research to account for such discrepancies. While current chemical mechanisms are likely incomplete, it is also possible that, at least in part, these elevated radical observations have been influenced by instrumental biases from interfering species. Recent studies have suggested that fluorescence assay by gas expansion (FAGE) instruments may be susceptible to an unknown interference in the measurement of OH. This hypothesis can be tested through the implementation of an alternative method to determine the OH background signal, whereby OH is removed by the addition of a chemical scavenger prior to sampling by FAGE. The Leeds FAGE instrument was modified to facilitate this method by the construction of an inlet pre-injector (IPI), where OH is removed through reaction with propane. The modified Leeds FAGE instrument was deployed at a coastal location in southeast England during summer 2015 as part of the ICOZA (Integrated Chemistry of OZone in the Atmosphere) project. Measurements of OH made using both background methods will be presented, alongside results from laboratory characterisation experiments and details of the IPI design.

Resident Wellness and Social Support: Development and Cognitive Validation of a Resident Social Capital Assessment Tool.

PubMed

Kaplan, Stephen J; Seabott, Heather M; Cunningham, Erika B; Helman, James D; Calderon, Alvin; Thirlby, Richard C; Schenarts, Kimberly D

The purpose of this study is to develop and generate validity evidence for an instrument to measure social capital in residents. Mixed-methods, phased approach utilizing a modified Delphi technique, focus groups, and cognitive interviews. Four residency training institutions in Washington state between February 2016 and March 2017. General surgery, anesthesia, and internal medicine residents ranging from PGY-1 to PGY-6. The initial resident-focused instrument underwent revision via Delphi process with 6 experts; 100% expert consensus was achieved after 4 cycles. Three focus groups were conducted with 19 total residents. Focus groups identified 6 of 11 instrument items with mean quality ratings ≤4.0 on a 1-5 scale. The composite instrument rating of the draft version was 4.1 ± 0.5. After refining the instrument, cognitive interviews with the final version were completed with 22 residents. All items in the final version had quality ratings >4.0; the composite instrument rating was 4.8 ± 0.1. Social capital may be an important factor in resident wellness as residents rely upon each other and external social support to withstand fatigue, burnout, and other negative sequelae of rigorous training. This instrument for assessment of social capital in residents may provide an avenue for data collection and potentially, identification of residents at-risk for wellness degradation. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables.

PubMed

Zaki, Rafdzah; Bulgiba, Awang; Nordin, Noorhaire; Azina Ismail, Noor

2013-06-01

Reliability measures precision or the extent to which test results can be replicated. This is the first ever systematic review to identify statistical methods used to measure reliability of equipment measuring continuous variables. This studyalso aims to highlight the inappropriate statistical method used in the reliability analysis and its implication in the medical practice. In 2010, five electronic databases were searched between 2007 and 2009 to look for reliability studies. A total of 5,795 titles were initially identified. Only 282 titles were potentially related, and finally 42 fitted the inclusion criteria. The Intra-class Correlation Coefficient (ICC) is the most popular method with 25 (60%) studies having used this method followed by the comparing means (8 or 19%). Out of 25 studies using the ICC, only 7 (28%) reported the confidence intervals and types of ICC used. Most studies (71%) also tested the agreement of instruments. This study finds that the Intra-class Correlation Coefficient is the most popular method used to assess the reliability of medical instruments measuring continuous outcomes. There are also inappropriate applications and interpretations of statistical methods in some studies. It is important for medical researchers to be aware of this issue, and be able to correctly perform analysis in reliability studies.

Dimensions of sensation assessed in urinary urgency: a systematic review.

PubMed

Das, Rebekah; Buckley, Jonathan; Williams, Marie

2013-10-01

Urinary urgency is an adverse sensory experience. Confirmation of the multidimensional nature of other adverse sensory experiences such as pain and dyspnea has improved the understanding of neurophysiological and perceptual mechanisms leading to innovations in assessment and treatment. It has been suggested that the sensation of urgency may include multiple dimensions such as intensity, suddenness and unpleasantness. In this systematic review we determine which dimensions of sensation have been assessed by instruments used to measure urinary urgency. A systematic search was undertaken of MEDLINE, Embase, AMED, CINAHL, Ageline, Web of Science, InformIT Health and Scopus databases to identify studies that included assessments of urinary urge or urgency. Articles were included in the analysis if they were primary studies that described the method used to measure urge/urgency in adults and published in English in peer reviewed publications since January 1, 2000. Articles were excluded from study if urgency was measured only in conjunction with other symptoms (eg frequency or incontinence) or if there was no English version of the instrument. Secondary analyses and systematic reviews were retained to hand search references for additional primary studies. Data were extracted for the instruments used to measure urge/urgency. For each instrument the items specific to urinary urgency were reviewed using a prospectively developed categorization process for the sensory dimension and the measurement metric. Items used to assess urinary urgency were collated in a matrix (sensory dimensions vs assessment metric). The most frequently used dimensions, metrics and combinations were descriptively analyzed. After removal of duplicate articles 1,048 full text articles were screened and 411 were excluded, leaving 637 eligible articles from which data were extracted. A total of 216 instruments were identified which were 1 of 6 types, namely 1) wider symptom questionnaires, 2) urgency specific questionnaires, 3) ordinal scales, 4) visual analog scales, 5) event records or 6) body maps. These 216 instruments contained a total of 309 urgency specific items. Of the instruments 51% did not define a dimension of sensation and 26% did not define the metric used. From the remaining instruments 8 dimensions of sensation and 5 types of metrics were identified. From most common to least common, the sensory dimensions assessed were behavioral response, intensity, suddenness, bother, affective response, unpleasantness, quality (descriptors) and problems associated with sensation. Metrics were magnitude, frequency, presence, time frame or location. The most common sensory dimension/metric combinations were frequency of a behavioral response (14% of items) and magnitude of bother caused by the sensation (8% of items). The hypothesis that urinary urgency is multidimensional is supported by the range of dimensions assessed with available instruments. To clarify the nature of urinary urgency compared with the normal desire to void, prospective studies are required to determine whether sensory dimensions are distinct, and which may delineate between normal and pathological sensation. Copyright © 2013 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

Comparative evaluation of apically extruded debris during root canal preparation using ProTaper™, Hyflex™ and Waveone™ rotary systems

PubMed Central

Surakanti, Jayaprada Reddy; Venkata, Ravi Chandra Polavarapu; Vemisetty, Hari Kumar; Dandolu, Ram Kiran; Jaya, Nagendra Krishna Muppalla; Thota, Shirisha

2014-01-01

Background and Aims: Extrusion of any debris during endodontic treatment may potentially cause post-operative complications such as flare-ups. The purpose of this in vitro study was to assess the amount of apically extruded debris during the root canal preparation using rotary and reciprocating nickel-titanium instrumentation systems. Materials and Methods: In this study, 60 human mandibular first premolars were randomly assigned to 3 groups (n = 20 teeth/group). The root canals were instrumented according to the manufacturers’ instructions using the Reciprocating single-file system WaveOne™ (Dentsply Maillefer, Ballaigues, Switzerland) and full-sequence rotary Hyflex CM™ (Coltene Whaledent, Allstetten, Switzerland) and ProTaper™ (Dentsply Maillefer, Ballaigues, Switzerland) instruments. The canals were then irrigated using bidistilled water. The debris that was extruded apically was collected in preweighed eppendorf tubes and assessed with an electronic balance and compared. Statistical Analysis Used: The debris extrusion was compared and statistically analyzed using analysis of variance and the post hoc Student-Newman-Keuls test. Results: The WaveOne™ and ProTaper™ rotary instruments produced significantly more debris compared with Hyflex CM™ rotary instruments (P < 0.05). Conclusions: Under the conditions of this study, all systems that were used resulted in extrusion of apical debris. Full-sequence rotary instrumentation was associated with less debris extrusion compared with the use of reciprocating single-file systems. PMID:24778507

Performance assessment of diffuse optical spectroscopic imaging instruments in a 2-year multicenter breast cancer trial

NASA Astrophysics Data System (ADS)

Leproux, Anaïs; O'Sullivan, Thomas D.; Cerussi, Albert; Durkin, Amanda; Hill, Brian; Hylton, Nola; Yodh, Arjun G.; Carp, Stefan A.; Boas, David; Jiang, Shudong; Paulsen, Keith D.; Pogue, Brian; Roblyer, Darren; Yang, Wei; Tromberg, Bruce J.

2017-12-01

We present a framework for characterizing the performance of an experimental imaging technology, diffuse optical spectroscopic imaging (DOSI), in a 2-year multicenter American College of Radiology Imaging Network (ACRIN) breast cancer study (ACRIN-6691). DOSI instruments combine broadband frequency-domain photon migration with time-independent near-infrared (650 to 1000 nm) spectroscopy to measure tissue absorption and reduced scattering spectra and tissue hemoglobin, water, and lipid composition. The goal of ACRIN-6691 was to test the effectiveness of optically derived imaging endpoints in predicting the final pathologic response of neoadjuvant chemotherapy (NAC). Sixty patients were enrolled over a 2-year period at participating sites and received multiple DOSI scans prior to and during 3- to 6-month NAC. The impact of three sources of error on accuracy and precision, including different operators, instruments, and calibration standards, was evaluated using a broadband reflectance standard and two different solid tissue-simulating optical phantoms. Instruments showed <0.0010 mm-1 (10.3%) and 0.06 mm-1 (4.7%) deviation in broadband absorption and reduced scattering, respectively, over the 2-year duration of ACRIN-6691. These variations establish a useful performance criterion for assessing instrument stability. The proposed procedures and tests are not limited to DOSI; rather, they are intended to provide methods to characterize performance of any instrument used in translational optical imaging.

Measuring quality of life in opioid-dependent people: a systematic review of assessment instruments.

PubMed

Strada, Lisa; Vanderplasschen, Wouter; Buchholz, Angela; Schulte, Bernd; Muller, Ashley E; Verthein, Uwe; Reimer, Jens

2017-12-01

Opioid dependence is a chronic relapsing disorder. Despite increasing research on quality of life (QOL) in people with opioid dependence, little attention has been paid to the instruments used. This systematic review examines the suitability of QOL instruments for use in opioid-dependent populations and the instruments' quality. A systematic search was performed in the databases Medline, PsycInfo, The Cochrane Library, and CINAHL. Articles were eligible if they assessed QOL of opioid-dependent populations using a validated QOL instrument. Item content relevance to opioid-dependent people was evaluated by means of content analysis, and instrument properties were assessed using minimum standards for patient-reported outcome measures. Eighty-nine articles were retrieved, yielding sixteen QOL instruments, of which ten were assessed in this review. Of the ten instruments, six were disease specific, but none for opioid dependence. Two instruments had good item content relevance. The conceptual and measurement model were described in seven instruments. Four instruments were developed with input from the respective target population. Eight instruments had low respondent and administrator burden. Psychometric properties were either not assessed in opioid-dependent populations or were inconclusive or moderate. No instrument scored perfectly on both the content and properties. The limited suitability of instruments for opioid-dependent people hinders accurate and sensitive measurement of QOL in this population. Future research is in need of an opioid dependence-specific QOL instrument to measure the true impact of the disease on people's lives and to evaluate treatment-related services.

Teaching and assessing procedural skills using simulation: metrics and methodology.

PubMed

Lammers, Richard L; Davenport, Moira; Korley, Frederick; Griswold-Theodorson, Sharon; Fitch, Michael T; Narang, Aneesh T; Evans, Leigh V; Gross, Amy; Rodriguez, Elliot; Dodge, Kelly L; Hamann, Cara J; Robey, Walter C

2008-11-01

Simulation allows educators to develop learner-focused training and outcomes-based assessments. However, the effectiveness and validity of simulation-based training in emergency medicine (EM) requires further investigation. Teaching and testing technical skills require methods and assessment instruments that are somewhat different than those used for cognitive or team skills. Drawing from work published by other medical disciplines as well as educational, behavioral, and human factors research, the authors developed six research themes: measurement of procedural skills; development of performance standards; assessment and validation of training methods, simulator models, and assessment tools; optimization of training methods; transfer of skills learned on simulator models to patients; and prevention of skill decay over time. The article reviews relevant and established educational research methodologies and identifies gaps in our knowledge of how physicians learn procedures. The authors present questions requiring further research that, once answered, will advance understanding of simulation-based procedural training and assessment in EM.

A Novel Method to Evaluate the Community Built Environment Using Photographs – Environmental Profile of a Community Health (EPOCH) Photo Neighbourhood Evaluation Tool

PubMed Central

Chow, Clara K.; Corsi, Daniel J.; Lock, Karen; Madhavan, Manisha; Mackie, Pam; Li, Wei; Yi, Sun; Wang, Yang; Swaminathan, Sumathi; Lopez-Jaramillo, Patricio; Gomez-Arbelaez, Diego; Avezum, Álvaro; Lear, Scott A.; Dagenais, Gilles; Teo, Koon; McKee, Martin; Yusuf, Salim

2014-01-01

Background Previous research has shown that environments with features that encourage walking are associated with increased physical activity. Existing methods to assess the built environment using geographical information systems (GIS) data, direct audit or large surveys of the residents face constraints, such as data availability and comparability, when used to study communities in countries in diverse parts of the world. The aim of this study was to develop a method to evaluate features of the built environment of communities using a standard set of photos. In this report we describe the method of photo collection, photo analysis instrument development and inter-rater reliability of the instrument. Methods/Principal Findings A minimum of 5 photos were taken per community in 86 communities in 5 countries according to a standard set of instructions from a designated central point of each community by researchers at each site. A standard pro forma derived from reviewing existing instruments to assess the built environment was developed and used to score the characteristics of each community. Photo sets from each community were assessed independently by three observers in the central research office according to the pro forma and the inter-rater reliability was compared by intra-class correlation (ICC). Overall 87% (53 of 60) items had an ICC of ≥0.70, 7% (4 of 60) had an ICC between 0.60 and 0.70 and 5% (3 of 60) items had an ICC ≤0.50. Conclusions/Significance Analysis of photos using a standardized protocol as described in this study offers a means to obtain reliable and reproducible information on the built environment in communities in very diverse locations around the world. The collection of the photographic data required minimal training and the analysis demonstrated high reliability for the majority of items of interest. PMID:25369366

Development of assessment instruments to measure critical thinking skills

NASA Astrophysics Data System (ADS)

Sumarni, W.; Supardi, K. I.; Widiarti, N.

2018-04-01

Assessment instruments that is commonly used in the school generally have not been orientated on critical thinking skills. The purpose of this research is to develop assessment instruments to measure critical thinking skills, to test validity, reliability, and practicality. This type of research is Research and Development. There are two stages on the preface step, which are field study and literacy study. On the development steps, there some parts, which are 1) instrument construction, 2) expert validity, 3) limited scale tryout and 4) narrow scale try-out. The developed assessment instrument are analysis essay and problem solving. Instruments were declared valid, reliable and practical.

Investigation of threaded fastener structural integrity

NASA Technical Reports Server (NTRS)

1977-01-01

Technical nondestructive evaluation approaches to the determination of fastener integrity were assessed. Existing instruments and methods used to measure stress or strain were examined, with particular interest in fastener shank stress. Industry procedures being followed were evaluated to establish fastener integrity criteria.

Development of Mobile Measurement Method Series OTM 33

EPA Science Inventory

Starting in 2006, the United States Environmental Protection Agency has explored use of mobile instrumented vehicles for a variety of air quality assessment applications under its Geospatial Measurement of Air Pollution (GMAP) program. GMAP systems utilize next generation, fast-r...

Measurement of Clinical Performance of Nurses: A Literature Review.

ERIC Educational Resources Information Center

Robb, Yvonne; Fleming, Valerie; Dietert, Christine

2002-01-01

A research review (n=12) yielded a number of tools for assessing nurses' clinical competence but none that is universally accepted. The review did identify methods that could be used to develop a useful instrument. (Contains 23 references.) (SK)

76 FR 1138 - Enhanced Assessment Instruments

Federal Register 2010, 2011, 2012, 2013, 2014

2011-01-07

... priorities: (a) Collaborating with institutions of higher education, other research institutions, or other... a member State may hold); (2) The consortium's method and process (e.g., consensus, majority) for... available on an ongoing basis for research, including for prospective linking, validity, and program...

INNOVATIVE METHODS FOR EMISSION-INVENTORY DEVELOPMENT AND EVALUATION: WORKSHOP SUMMARY

EPA Science Inventory

Emission inventories are an essential tool for evaluating, managing, and regulating air pollution. Refinements and innovations in instruments that measure air pollutants, models that calculate emissions as well as techniques for data management and uncertainty assessment are nee...

Attention to gender in communication skills assessment instruments in medical education: a review.

PubMed

Dielissen, Patrick; Bottema, Ben; Verdonk, Petra; Lagro-Janssen, Toine

2011-03-01

Gender is increasingly regarded as an important factor in doctor-patient communication education. This review aims to assess if and how gender is addressed by current assessment instruments for communication skills in medical education. In 2009 at Radboud University Nijmegen Medical Centre, an online search was conducted in the bibliographic databases PubMed, PsycINFO and ERIC for references about communication skills assessment instruments designed to be completed by trained faculty staff and used in medical education. The search strategy used the following search terms: 'consultation skills'; 'doctor-patient communication'; 'physician-patient relations'; 'medical education'; 'instruments'; 'measurement', and 'assessment'. Papers published between January 1999 and June 2009 were included. The assessment instruments identified were analysed for gender-specific content. The search yielded 21 communication skills assessment instruments. Only two of the 17 checklists obtained explicitly considered gender as a communication-related issue. Only six of 21 manuals considered gender in any way and none gave specific details to explain which aspects of communication behaviour should be assessed with regard to gender. Very few communication assessment instruments in medical education focus on gender. Nevertheless, interest exists in using gender in communication skills assessment. The criteria for and purpose of assessing gender in communication skills in medical education are yet to be clarified. © Blackwell Publishing Ltd 2011.

Hypothesis driven assessment of an NMR curriculum

NASA Astrophysics Data System (ADS)

Cossey, Kimberly

The goal of this project was to develop a battery of assessments to evaluate an undergraduate NMR curriculum at Penn State University. As a chemical education project, we sought to approach the problem of curriculum assessment from a scientific perspective, while remaining grounded in the education research literature and practices. We chose the phrase hypothesis driven assessment to convey this process of relating the scientific method to the study of educational methods, modules, and curricula. We began from a hypothesis, that deeper understanding of one particular analytical technique (NMR) will increase undergraduate students' abilities to solve chemical problems. We designed an experiment to investigate this hypothesis, and data collected were analyzed and interpreted in light of the hypothesis and several related research questions. The expansion of the NMR curriculum at Penn State was funded through the NSF's Course, Curriculum, and Laboratory Improvement (CCLI) program, and assessment was required. The goal of this project, as stated in the grant proposal, was to provide NMR content in greater depth by integrating NMR modules throughout the curriculum in physical chemistry, instrumental, and organic chemistry laboratory courses. Hands-on contact with the NMR spectrometer and NMR data and repeated exposure of the analytical technique within different contexts (courses) were unique factors of this curriculum. Therefore, we maintained a focus on these aspects throughout the evaluation process. The most challenging and time-consuming aspect of any assessment is the development of testing instruments and methods to provide useful data. After key variables were defined, testing instruments were designed to measure these variables based on educational literature (Chapter 2). The primary variables measured in this assessment were: depth of understanding of NMR, basic NMR knowledge, problem solving skills (HETCOR problem), confidence for skills used in class (within the hands-on NMR modules), confidence for NMR tasks (not practiced), and confidence for general science tasks. Detailed discussion of the instruments, testing methods and experimental design used in this assessment are provided (Chapter 3). All data were analyzed quantitatively using methods adapted from the educational literature (Chapter 4). Data were analyzed and the descriptive statistics, independent t-tests between the experimental and control groups, and correlation statistics were calculated for each variable. In addition, for those variables included on the pretest, dependent t-tests between pretest and posttest scores were also calculated. The results of study 1 and study 2 were used to draw conclusions based on the hypothesis and research questions proposed in this work (Chapter 4). Data collected in this assessment were used to answer the following research questions: (1) Primary research question: Is depth of understanding of NMR linked to problem solving skills? (2) Are the NMR modules working as intended? Do they promote depth of understanding of NMR? (a) Will students who complete NMR modules have a greater depth of understanding of NMR than students who do not complete the modules? (b) Is depth of understanding increasing over the course of the experiment? (3) Is confidence an intermediary between depth of understanding and problem solving skills? Is it linked to both variables? (4) What levels of confidence are affected by the NMR modules? (a) Will confidence for the NMR class skills used in the modules themselves be greater for those who have completed the modules? (b) Will confidence for NMR tasks not practiced in the course be affected? (c) Will confidence for general science tasks be affected? (d) Are different levels of confidence (class skills, NMR tasks, general science tasks) linked to each other? Results from this NMR curriculum assessment could also have implications outside of the courses studied, and so there is potential to impact the chemical education community (section 5.2.1). In addition to providing reliable testing instruments/measures that could be used outside the university, the results of this research contribute to the study of problem solving in chemistry, learner characteristics within the context of chemical education studies, and NMR specific educational evaluations. Valuable information was gathered through the current method of evaluation for the NMR curriculum. However, improvements could be made to the existing assessment, and an alternate assessment that could supplement the information found in this study has been proposed (Chapter 5).

Reliability and validity of a nutrition and physical activity environmental self-assessment for child care

PubMed Central

Benjamin, Sara E; Neelon, Brian; Ball, Sarah C; Bangdiwala, Shrikant I; Ammerman, Alice S; Ward, Dianne S

2007-01-01

Background Few assessment instruments have examined the nutrition and physical activity environments in child care, and none are self-administered. Given the emerging focus on child care settings as a target for intervention, a valid and reliable measure of the nutrition and physical activity environment is needed. Methods To measure inter-rater reliability, 59 child care center directors and 109 staff completed the self-assessment concurrently, but independently. Three weeks later, a repeat self-assessment was completed by a sub-sample of 38 directors to assess test-retest reliability. To assess criterion validity, a researcher-administered environmental assessment was conducted at 69 centers and was compared to a self-assessment completed by the director. A weighted kappa test statistic and percent agreement were calculated to assess agreement for each question on the self-assessment. Results For inter-rater reliability, kappa statistics ranged from 0.20 to 1.00 across all questions. Test-retest reliability of the self-assessment yielded kappa statistics that ranged from 0.07 to 1.00. The inter-quartile kappa statistic ranges for inter-rater and test-retest reliability were 0.45 to 0.63 and 0.27 to 0.45, respectively. When percent agreement was calculated, questions ranged from 52.6% to 100% for inter-rater reliability and 34.3% to 100% for test-retest reliability. Kappa statistics for validity ranged from -0.01 to 0.79, with an inter-quartile range of 0.08 to 0.34. Percent agreement for validity ranged from 12.9% to 93.7%. Conclusion This study provides estimates of criterion validity, inter-rater reliability and test-retest reliability for an environmental nutrition and physical activity self-assessment instrument for child care. Results indicate that the self-assessment is a stable and reasonably accurate instrument for use with child care interventions. We therefore recommend the Nutrition and Physical Activity Self-Assessment for Child Care (NAP SACC) instrument to researchers and practitioners interested in conducting healthy weight intervention in child care. However, a more robust, less subjective measure would be more appropriate for researchers seeking an outcome measure to assess intervention impact. PMID:17615078

Comparison of physical activity using questionnaires (leisure time physical activity instrument and physical activity at home and work instrument) and accelerometry in fibromyalgia patients: the Al-Ándalus project.

PubMed

Segura-Jiménez, Víctor; Alvarez-Gallardo, Inmaculada C; Romero-Zurita, Alejandro; Camiletti-Moirón, Daniel; Munguía-Izquierdo, Diego; Carbonell-Baeza, Ana; Ruiz, Jonatan R

2014-10-01

To compare the levels of physical activity (PA) assessed with questionnaires (Leisure Time Physical Activity Instrument [LTPAI], Physical Activity at Home and Work Instrument [PAHWI]) and accelerometry in patients with fibromyalgia; and to analyze the test-retest reliability of these questionnaires. Cross-sectional study. Local fibromyalgia association. Participants (N=99; 5 men) with fibromyalgia with a mean age of 50.2±9.5 years. Not applicable. Participants carried an accelerometer for 1 week and completed the LTPAI and PAHWI twice (separated by a 1-wk interval). The LTPAI and PAHWI were summed to obtain overall values of PA. Time spent in total, moderate, and moderate-vigorous PA was higher (P<.01) when assessed by the LTPAI and PAHWI compared with accelerometry. The Bland-Altman method showed an absence of agreement between the LTPAI and PAHWI and the accelerometer for moderate, moderate-vigorous, and total PA. The test-retest reliability for the workplace subscale and total score of the PAHWI showed high and moderate intraclass correlation coefficients (ICCs), respectively, but also manifested high SE of measurements (up to 179min/d). The LTPAI showed low to moderate ICCs and high SE of measurements (up to 79min/d). For the LTPAI and PAHWI, the ICCs for total activity across the population were low to moderate, and the Bland-Altman method confirmed this lack of agreement. The LTPAI and PAHWI and the accelerometer differ greatly when assessing PA. Furthermore, the LTPAI and PAHWI did not show good levels of test-retest reliability. Therefore, the self-administered LTPAI and PAHWI show questionable usefulness to assess PA in populations with fibromyalgia. Copyright © 2014 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Updating the OMERACT Filter: Implications for imaging and soluble biomarkers

PubMed Central

D’Agostino, Maria-Antonietta; Boers, Maarten; Kirwan, John; van der Heijde, Desirée; Østergaard, Mikkel; Schett, Georg; Landewé, Robert B.M.; Maksymowych, Walter P.; Naredo, Esperanza; Dougados, Maxime; Iagnocco, Annamaria; Bingham, Clifton O.; Brooks, Peter; Beaton, Dorcas; Gandjbakhch, Frederique; Gossec, Laure; Guillemin, Francis; Hewlett, Sarah; Kloppenburg, Margreet; March, Lyn; Mease, Philip J; Moller, Ingrid; Simon, Lee S; Singh, Jasvinder A; Strand, Vibeke; Wakefield, Richard J; Wells, George; Tugwell, Peter; Conaghan, Philip G

2014-01-01

Objective The OMERACT Filter provides a framework for the validation of outcome measures for use in rheumatology clinical research. However, imaging and biochemical measures may face additional validation challenges due to their technical nature. The Imaging and Soluble Biomarker Session at OMERACT 11 aimed to provide a guide for the iterative development of an imaging or biochemical measurement instrument so it can be used in therapeutic assessment. Methods A hierarchical structure was proposed, reflecting 3 dimensions needed for validating an imaging or biochemical measurement instrument: outcome domain(s), study setting and performance of the instrument. Movement along the axes in any dimension reflects increasing validation. For a given test instrument, the 3-axis structure assesses the extent to which the instrument is a validated measure for the chosen domain, whether it assesses a patient or disease centred-variable, and whether its technical performance is adequate in the context of its application. Some currently used imaging and soluble biomarkers for rheumatoid arthritis, spondyloarthritis and knee osteoarthritis were then evaluated using the original OMERACT filter and the newly proposed structure. Break-out groups critically reviewed the extent to which the candidate biomarkers complied with the proposed step-wise approach, as a way of examining the utility of the proposed 3 dimensional structure. Results Although there was a broad acceptance of the value of the proposed structure in general, some areas for improvement were suggested including clarification of criteria for achieving a certain level of validation and how to deal with extension of the structure to areas beyond clinical trials. Conclusion General support was obtained for a proposed tri-axis structure to assess validation of imaging and soluble biomarkers; nevertheless, additional work is required to better evaluate its place within the OMERACT Filter 2.0. PMID:24584916

Determining the risk of cardiovascular disease using ion mobility of lipoproteins

DOEpatents

Benner, W. Henry; Krauss, Ronald M.; Blanche, Patricia J.

2010-05-11

A medical diagnostic method and instrumentation system for analyzing noncovalently bonded agglomerated biological particles is described. The method and system comprises: a method of preparation for the biological particles; an electrospray generator; an alpha particle radiation source; a differential mobility analyzer; a particle counter; and data acquisition and analysis means. The medical device is useful for the assessment of human diseases, such as cardiac disease risk and hyperlipidemia, by rapid quantitative analysis of lipoprotein fraction densities. Initially, purification procedures are described to reduce an initial blood sample to an analytical input to the instrument. The measured sizes from the analytical sample are correlated with densities, resulting in a spectrum of lipoprotein densities. The lipoprotein density distribution can then be used to characterize cardiac and other lipid-related health risks.

Health related quality of life in disorders of defecation: the Defecation Disorder List

PubMed Central

Voskuijl, W; van der Zaag-Loon..., H J; Ketel, I; Grootenhuis, M; Derkx, B; Benninga, M

2004-01-01

Background: Constipation and encopresis frequently cause problems with respect to emotional wellbeing, and social and family life. Instruments to measure Health Related Quality of Life (HRQoL) in these disorders are not available. Methods: A disease specific HRQoL instrument, the "Defecation Disorder List" (DDL) for children with constipation or functional non-retentive faecal soiling (FNRFS) was developed using accepted guidelines. For each phase of the process, different samples of patients were used. The final phase of development included 27 children. Reliability was assessed in two ways: internal consistency of domains with Cronbach's alpha, and test-retest reliability with intra-class correlation coefficients (ICC). To assess validity, comparable items and domains were correlated with Tacqol, a generic HRQoL instrument for children (TNO-AZL). Results: In the final phase of the development, 27 children completed the instrument. It consisted of 37 items in four domains. The response rate was 96%. Reliability was good for all domains, with Cronbach's alpha values ranging from 0.61 to 0.76. Measures of test-retest stability were good for all four domains with ICCs ranging from 0.82 to 0.92. Validity based on comparison with the Tacqol instrument was moderate. Conclusion: The DDL is promising as a measure of HRQoL in childhood defecation disorders. PMID:15557046

Assessment Using AutoCAD Software of the Preparation of Dentin Walls in Root Canals Produced by 4 Different Endodontic Instrument Systems

PubMed Central

Cabanillas, Cristina; Monterde, Manuel; Pallarés, Antonio; Aranda, Susana; Montes, Raquel

2015-01-01

Objectives. To compare the effectiveness of four instrument systems for preparing oval root canals: manual instrumentation (Step-Back technique), ProTaper Universal, ProTaper Next, and Wave One. Material and Methods. For the purpose of this assessment, 60 teeth extracted for orthodontic or periodontal reasons, specifically canines and premolars with full coronal and root anatomy, were used and 15 samples were assigned to each group. The section of the canals was compared before and after instrumenting and the section of untouched canal wall was measured using AutoCAD software. The data was analysed by means of Shapiro-Wilk, ANOVA, and Kruskal-Wallis tests. Results. In the apical third, 100% of the canals were prepared with all the systems. In the middle third, a p value of 0.5989 in the Kruskal-Wallis test was obtained, which indicates no significant difference between the groups. At the coronal third level, the results obtained revealed that Wave One had a significantly lower mean average than the rest (p < 0.05). Conclusions. There are no differences between the various root canal instrument systems in the apical and middle thirds. At the coronal third level, Wave One system showed performance significantly worse than the rest, among which there were no differences. PMID:26664361

Assessment Using AutoCAD Software of the Preparation of Dentin Walls in Root Canals Produced by 4 Different Endodontic Instrument Systems.

PubMed

Cabanillas, Cristina; Monterde, Manuel; Pallarés, Antonio; Aranda, Susana; Montes, Raquel

2015-01-01

Objectives. To compare the effectiveness of four instrument systems for preparing oval root canals: manual instrumentation (Step-Back technique), ProTaper Universal, ProTaper Next, and Wave One. Material and Methods. For the purpose of this assessment, 60 teeth extracted for orthodontic or periodontal reasons, specifically canines and premolars with full coronal and root anatomy, were used and 15 samples were assigned to each group. The section of the canals was compared before and after instrumenting and the section of untouched canal wall was measured using AutoCAD software. The data was analysed by means of Shapiro-Wilk, ANOVA, and Kruskal-Wallis tests. Results. In the apical third, 100% of the canals were prepared with all the systems. In the middle third, a p value of 0.5989 in the Kruskal-Wallis test was obtained, which indicates no significant difference between the groups. At the coronal third level, the results obtained revealed that Wave One had a significantly lower mean average than the rest (p < 0.05). Conclusions. There are no differences between the various root canal instrument systems in the apical and middle thirds. At the coronal third level, Wave One system showed performance significantly worse than the rest, among which there were no differences.

The evolution of violence risk assessment.

PubMed

Monahan, John; Skeem, Jennifer L

2014-10-01

Many instruments have been published in recent years to improve the ability of mental health clinicians to estimate the likelihood that an individual will behave violently toward others. Increasingly, these instruments are being applied in response to laws that require specialized risk assessments. In this review, we present a framework that goes beyond the "clinical" and "actuarial" dichotomy to describe a continuum of structured approaches to risk assessment. Despite differences among them, there is little evidence that one instrument predicts violence better than another. We believe that these group-based instruments are useful for assessing an individual's risk, and that the instrument should be chosen based on the purpose of the assessment.

Geometric and dimensional characteristics of simulated curved canals prepared with proTaper instruments

PubMed Central

MARTINS, Renata de Castro; BAHIA, Maria Guiomar de Azevedo; BUONO, Vicente Tadeu Lopes

2010-01-01

Objective This study identified which regions of ProTaper instruments work during curved root canal instrumentation. Material and methods Twelve ProTaper instruments of each type, S1, S2, F1, and F2, were assessed morphometrically by measuring tip angle, tip length, tip diameter, length of each pitch along the cutting blades, and instrument diameter at each millimeter from the tip. Curved canals in resin blocks were explored with manual stainless steel files and prepared with ProTaper instruments until the apical end following four distinct sequences of instrumentation: S1; S1 and S2; S1, S2, and F1; S1, S2, F1, and F2. Image analysis was employed for measuring canal diameters. The diameters of the canals and diameters of the instruments were compared. Data were analyzed by one-way ANOVA and Tukey’s test. Results No statistically significant difference was found between the canals and instrument diameters (p>0.05). The largest diameters in the end-point of the instrumented canals were obtained with F1 and F2 instruments and in the initial and middle thirds with S1 and S2 instruments. Conclusions All instruments worked at the tip and along their cutting blades, being susceptible to fail by torsion, fatigue, or the combination of these two mechanisms. PMID:20379681

Spreadsheet for designing valid least-squares calibrations: A tutorial.

PubMed

Bettencourt da Silva, Ricardo J N

2016-02-01

Instrumental methods of analysis are used to define the price of goods, the compliance of products with a regulation, or the outcome of fundamental or applied research. These methods can only play their role properly if reported information is objective and their quality is fit for the intended use. If measurement results are reported with an adequately small measurement uncertainty both of these goals are achieved. The evaluation of the measurement uncertainty can be performed by the bottom-up approach, that involves a detailed description of the measurement process, or using a pragmatic top-down approach that quantify major uncertainty components from global performance data. The bottom-up approach is not so frequently used due to the need to master the quantification of individual components responsible for random and systematic effects that affect measurement results. This work presents a tutorial that can be easily used by non-experts in the accurate evaluation of the measurement uncertainty of instrumental methods of analysis calibrated using least-squares regressions. The tutorial includes the definition of the calibration interval, the assessments of instrumental response homoscedasticity, the definition of calibrators preparation procedure required for least-squares regression model application, the assessment of instrumental response linearity and the evaluation of measurement uncertainty. The developed measurement model is only applicable in calibration ranges where signal precision is constant. A MS-Excel file is made available to allow the easy application of the tutorial. This tool can be useful for cases where top-down approaches cannot produce results with adequately low measurement uncertainty. An example of the application of this tool to the determination of nitrate in water by ion chromatography is presented. Copyright © 2015 Elsevier B.V. All rights reserved.

Validation of the Dementia Care Assessment Packet-Instrumental Activities of Daily Living

PubMed Central

Lee, Seok Bum; Park, Jeong Ran; Yoo, Jeong-Hwa; Park, Joon Hyuk; Lee, Jung Jae; Yoon, Jong Chul; Jhoo, Jin Hyeong; Lee, Dong Young; Woo, Jong Inn; Han, Ji Won; Huh, Yoonseok; Kim, Tae Hui

2013-01-01

Objective We aimed to evaluate the psychometric properties of the IADL measure included in the Dementia Care Assessment Packet (DCAP-IADL) in dementia patients. Methods The study involved 112 dementia patients and 546 controls. The DCAP-IADL was scored in two ways: observed score (OS) and predicted score (PS). The reliability of the DCAP-IADL was evaluated by testing its internal consistency, inter-rater reliability and test-retest reliability. Discriminant validity was evaluated by comparing the mean OS and PS between dementia patients and controls by ANCOVA. Pearson or Spearman correlation analysis was performed with other instruments to assess concurrent validity. Receiver operating characteristics curve analysis was performed to examine diagnostic accuracy. Results Chronbach's α coefficients of the DCAP-IADL were above 0.7. The values in dementia patients were much higher (OS=0.917, PS=0.927), indicating excellent degrees of internal consistency. Inter-rater reliabilities and test-retest reliabilities were statistically significant (p<0.05). PS exhibited higher reliabilities than OS. The mean OS and PS of dementia patients were significantly higher than those of the non-demented group after controlling for age, sex and education level. The DCAP-IADL was significantly correlated with other IADL instruments and MMSE-KC (p<0.001). Areas under the curves of the DCAP-IADL were above 0.9. Conclusion The DCAP-IADL is a reliable and valid instrument for evaluating instrumental ability of daily living for the elderly, and may also be useful for screening dementia. Moreover, administering PS may enable the DCAP-IADL to overcome the differences in gender, culture and life style that hinders accurate evaluation of the elderly in previous IADL instruments. PMID:24302946

Prioritisation of patients on waiting lists for hip and knee arthroplasties and cataract surgery: Instruments validation

PubMed Central

Allepuz, Alejandro; Espallargues, Mireia; Moharra, Montse; Comas, Mercè; Pons, Joan MV

2008-01-01

Background Prioritisation instruments were developed for patients on waiting list for hip and knee arthroplasties (AI) and cataract surgery (CI). The aim of the study was to assess their convergent and discriminant validity and inter-observer reliability. Methods Multicentre validation study which included orthopaedic surgeons and ophthalmologists from 10 hospitals. Participating doctors were asked to include all eligible patients placed in the waiting list for the procedures under study during the medical visit. Doctors assessed patients' priority through a visual analogue scale (VAS) and administered the prioritisation instrument. Information on socio-demographic data and health-related quality of life (HRQOL) (HUI3, EQ-5D, WOMAC and VF-14) was obtained through a telephone interview with patients. The correlation coefficients between the prioritisation instrument score and VAS and HRQOL were calculated. For the reliability study a self-administered questionnaire, which included hypothetic patients' scenarios, was sent via postal mail to the doctors. The priority of these scenarios was assessed through the prioritisation instrument. The intraclass correlation coefficient (ICC) between doctors was calculated. Results Correlations with VAS were strong for the AI (0.64, CI95%: 0.59–0.68) and for the CI (0.65, CI95%: 0.62–0.69), and moderate between the WOMAC and the AI (0.39, CI95%: 0.33–0.45) and the VF-14 and the CI (0.38, IC95%: 0.33–0.43). The results of the discriminant analysis were in general as expected. Inter-observer reliability was 0.79 (CI95%: 0.64–0.94) for the AI, and 0.79 (CI95%: 0.63–0.95) for the CI. Conclusion The results show acceptable validity and reliability of the prioritisation instruments in establishing priority for surgery. PMID:18397519

Standardized assessment of psychosocial factors and their influence on medically confirmed health outcomes in workers: a systematic review.

PubMed

Rosário, Susel; Fonseca, João A; Nienhaus, Albert; da Costa, José Torres

2016-01-01

Previous studies of psychosocial work factors have indicated their importance for workers' health. However, to what extent health problems can be attributed to the nature of the work environment or other psychosocial factors is not clear. No previous systematic review has used inclusion criteria based on specific medical evaluation of work-related health outcomes and the use of validated instruments for the assessment of the psychosocial (work) environment. The aim of this systematic review is to summarize the evidence assessing the relationship between the psychosocial work environment and workers' health based on studies that used standardized and validated instruments to assess the psychosocial work environment and that focused on medically confirmed health outcomes. A systematic review of the literature was carried out by searching the databases PubMed, B-ON, Science Direct, Psycarticles, Psychology and Behavioral Sciences Collection and the search engine (Google Scholar) using appropriate words for studies published from 2004 to 2014. This review follows the recommendations of the Statement for Reporting Systematic Reviews (PRISMA). Studies were included in the review if data on psychosocial validated assessment method(s) for the study population and specific medical evaluation of health-related work outcome(s) were presented. In total, the search strategy yielded 10,623 references, of which 10 studies (seven prospective cohort and three cross-sectional) met the inclusion criteria. Most studies (7/10) observed an adverse effect of poor psychosocial work factors on workers' health: 3 on sickness absence, 4 on cardiovascular diseases. The other 3 studies reported detrimental effects on sleep and on disease-associated biomarkers. A more consistent effect was observed in studies of higher methodological quality that used a prospective design jointly with the use of validated instruments for the assessment of the psychosocial (work) environment and clinical evaluation. More prospective studies are needed to assess the evidence of work-related psychosocial factors on workers´ health.

Assessing Chronic Illness Care Education (ACIC-E): a tool for tracking educational re-design for improving chronic care education.

PubMed

Bowen, Judith L; Provost, Lloyd; Stevens, David P; Johnson, Julie K; Woods, Donna M; Sixta, Connie S; Wagner, Edward H

2010-09-01

Recent Breakthrough Series Collaboratives have focused on improving chronic illness care, but few have included academic practices, and none have specifically targeted residency education in parallel with improving clinical care. Tools are available for assessing progress with clinical improvements, but no similar instruments have been developed for monitoring educational improvements for chronic care education. To design a survey to assist teaching practices with identifying curricular gaps in chronic care education and monitor efforts to address those gaps. During a national academic chronic care collaborative, we used an iterative method to develop and pilot test a survey instrument modeled after the Assessing Chronic Illness Care (ACIC). We implemented this instrument, the ACIC-Education, in a second collaborative and assessed the relationship of survey results with reported educational measures. A combined 57 self-selected teams from 37 teaching hospitals enrolled in one of two collaboratives. We used descriptive statistics to report mean ACIC-E scores and educational measurement results, and Pearson's test for correlation between the final ACIC-E score and reported educational measures. A total of 29 teams from the national collaborative and 15 teams from the second collaborative in California completed the final ACIC-E. The instrument measured progress on all sub-scales of the Chronic Care Model. Fourteen California teams (70%) reported using two to six education measures (mean 4.3). The relationship between the final survey results and the number of educational measures reported was weak (R(2) = 0.06, p = 0.376), but improved when a single outlier was removed (R(2) = 0.37, p = 0.022). The ACIC-E instrument proved feasible to complete. Participating teams, on average, recorded modest improvement in all areas measured by the instrument over the duration of the collaboratives. The relationship between the final ACIC-E score and the number of educational measures was weak. Further research on its utility and validity is required.

The LEAP™ Gesture Interface Device and Take-Home Laparoscopic Simulators: A Study of Construct and Concurrent Validity.

PubMed

Partridge, Roland W; Brown, Fraser S; Brennan, Paul M; Hennessey, Iain A M; Hughes, Mark A

2016-02-01

To assess the potential of the LEAP™ infrared motion tracking device to map laparoscopic instrument movement in a simulated environment. Simulator training is optimized when augmented by objective performance feedback. We explore the potential LEAP has to provide this in a way compatible with affordable take-home simulators. LEAP and the previously validated InsTrac visual tracking tool mapped expert and novice performances of a standardized simulated laparoscopic task. Ability to distinguish between the 2 groups (construct validity) and correlation between techniques (concurrent validity) were the primary outcome measures. Forty-three expert and 38 novice performances demonstrated significant differences in LEAP-derived metrics for instrument path distance (P < .001), speed (P = .002), acceleration (P < .001), motion smoothness (P < .001), and distance between the instruments (P = .019). Only instrument path distance demonstrated a correlation between LEAP and InsTrac tracking methods (novices: r = .663, P < .001; experts: r = .536, P < .001). Consistency of LEAP tracking was poor (average % time hands not tracked: 31.9%). The LEAP motion device is able to track the movement of hands using instruments in a laparoscopic box simulator. Construct validity is demonstrated by its ability to distinguish novice from expert performances. Only time and instrument path distance demonstrated concurrent validity with an existing tracking method however. A number of limitations to the tracking method used by LEAP have been identified. These need to be addressed before it can be considered an alternative to visual tracking for the delivery of objective performance metrics in take-home laparoscopic simulators. © The Author(s) 2015.

Review of the Instruments Most Frequently Employed to Assess Tactics in Physical Education and Youth Sports

ERIC Educational Resources Information Center

Arias, Jose L.; Castejon, Francisco Javier

2012-01-01

Investigators' increased interest in teaching game tactics requires generalizable assessment instruments that are appropriate to whatever is needed by the tactic. This literature review aims to provide information about the instruments most frequently used to assess tactics in youth sports. We found that very few studies used instruments that…

Applying the APA/AERA/NCME "Standards": Evidence for the Validity and Reliability of Three Statewide Teaching Assessment Instruments.

ERIC Educational Resources Information Center

Rothenberg, Lori; Hessling, Peter A.

The statewide teaching performance assessment instruments being used in Georgia, North Carolina, and Florida were examined. Forty-one reliability and validity studies regarding the instruments in use in each state were collected from state departments and universities. Georgia uses the Georgia Teacher Performance Assessment Instrument. North…

Suomi Npp and Jpss Pre-Launch Test Data Collection and Archive

NASA Astrophysics Data System (ADS)

Denning, M.; Ullman, R.; Guenther, B.; Kilcoyne, H.; Chandler, C.; Adameck, J.

2012-12-01

During the development of each Suomi National Polar-orbiting Partnership (Suomi NPP) instrument, significant testing was performed, both in ambient and simulated orbital (thermal-vacuum) conditions, at the instrument factory, and again after integration with the spacecraft. The NPOESS Integrated Program Office (IPO), and later the NASA Joint Polar Satellite System (JPSS) Program Office, defined two primary objectives with respect to capturing instrument and spacecraft test data during these test events. The first objective was to disseminate test data and auxiliary documentation to an often distributed network of scientists to permit timely production of independent assessments of instrument performance, calibration, data quality, and test progress. The second goal was to preserve the data and documentation in a catalogued government archive for the life of the mission, to aid in the resolution of anomalies and to facilitate the comparison of on-orbit instrument operating characteristics to those observed prior to launch. In order to meet these objectives, Suomi NPP pre-launch test data collection, distribution, processing, and archive methods included adaptable support infrastructures to quickly and completely transfer test data and documentation from the instrument and spacecraft factories to sensor scientist teams on-site at the factory and around the country. These methods were unique, effective, and low in cost. These efforts supporting pre-launch instrument calibration permitted timely data quality assessments and technical feedback from contributing organizations within the government, academia, and industry, and were critical in supporting timely sensor development. Second, in parallel to data distribution to the sensor science teams, pre-launch test data were transferred and ingested into the central Suomi NPP calibration and validation (cal/val) system, known as the Government Resource for Algorithm Verification, Independent Testing, and Evaluation (GRAVITE), where they will reside for the life of the mission. As a result, data and documentation are available for query, analysis, and download by the cal/val community via the command-line GRAVITE Transfer Protocol (GTP) tool or via the NOAA-collaborative website "CasaNOSA". Instrument and spacecraft test data, telemetry, and ground support equipment information were collected and organized with detailed test procedures, logs, analyses, characterizations, and reports. This 45 Terabyte archive facilitates the comparison of on-orbit Suomi NPP operating characteristics with that observed prior to launch, and will serve as a resource to aid in the assessment of pre-launch JPSS-1 sensor performance. In summary, this paper will present the innovative pre-launch test data campaign infrastructures employed for Suomi NPP and planned for JPSS-1.

Measuring Resource Utilization: A Systematic Review of Validated Self-Reported Questionnaires.

PubMed

Leggett, Laura E; Khadaroo, Rachel G; Holroyd-Leduc, Jayna; Lorenzetti, Diane L; Hanson, Heather; Wagg, Adrian; Padwal, Raj; Clement, Fiona

2016-03-01

A variety of methods may be used to obtain costing data. Although administrative data are most commonly used, the data available in these datasets are often limited. An alternative method of obtaining costing is through self-reported questionnaires. Currently, there are no systematic reviews that summarize self-reported resource utilization instruments from the published literature.The aim of the study was to identify validated self-report healthcare resource use instruments and to map their attributes.A systematic review was conducted. The search identified articles using terms like "healthcare utilization" and "questionnaire." All abstracts and full texts were considered in duplicate. For inclusion, studies had to assess the validity of a self-reported resource use questionnaire, to report original data, include adult populations, and the questionnaire had to be publically available. Data such as type of resource utilization assessed by each questionnaire, and validation findings were extracted from each study.In all, 2343 unique citations were retrieved; 2297 were excluded during abstract review. Forty-six studies were reviewed in full text, and 15 studies were included in this systematic review. Six assessed resource utilization of patients with chronic conditions; 5 assessed mental health service utilization; 3 assessed resource utilization by a general population; and 1 assessed utilization in older populations. The most frequently measured resources included visits to general practitioners and inpatient stays; nonmedical resources were least frequently measured. Self-reported questionnaires on resource utilization had good agreement with administrative data, although, visits to general practitioners, outpatient days, and nurse visits had poorer agreement.Self-reported questionnaires are a valid method of collecting data on healthcare resource utilization.

Network Mendelian randomization: using genetic variants as instrumental variables to investigate mediation in causal pathways

PubMed Central

Burgess, Stephen; Daniel, Rhian M; Butterworth, Adam S; Thompson, Simon G

2015-01-01

Background: Mendelian randomization uses genetic variants, assumed to be instrumental variables for a particular exposure, to estimate the causal effect of that exposure on an outcome. If the instrumental variable criteria are satisfied, the resulting estimator is consistent even in the presence of unmeasured confounding and reverse causation. Methods: We extend the Mendelian randomization paradigm to investigate more complex networks of relationships between variables, in particular where some of the effect of an exposure on the outcome may operate through an intermediate variable (a mediator). If instrumental variables for the exposure and mediator are available, direct and indirect effects of the exposure on the outcome can be estimated, for example using either a regression-based method or structural equation models. The direction of effect between the exposure and a possible mediator can also be assessed. Methods are illustrated in an applied example considering causal relationships between body mass index, C-reactive protein and uric acid. Results: These estimators are consistent in the presence of unmeasured confounding if, in addition to the instrumental variable assumptions, the effects of both the exposure on the mediator and the mediator on the outcome are homogeneous across individuals and linear without interactions. Nevertheless, a simulation study demonstrates that even considerable heterogeneity in these effects does not lead to bias in the estimates. Conclusions: These methods can be used to estimate direct and indirect causal effects in a mediation setting, and have potential for the investigation of more complex networks between multiple interrelated exposures and disease outcomes. PMID:25150977

34 CFR 668.149 - Special provisions for the approval of assessment procedures for special populations for whom no...

Code of Federal Regulations, 2010 CFR

2010-07-01

... procedure or instrument measures both basic verbal and quantitative skills at the secondary school level. (2... verbal and quantitative skills at the secondary school level; and (4) The passing scores and the methods...

Moving virtuality into reality: A comparison study of the effectiveness of traditional and alternative assessments of learning in a multisensory, fully immersive physics program

NASA Astrophysics Data System (ADS)

Gamor, Keysha Ingram

This paper contains a research study that investigated the relative efficacy of using both a traditional paper-and-pencil assessment instrument and an alternative, virtual reality (VR) assessment instrument to assist educators and/or instructional designers in measuring learning in a virtual reality learning environment. To this end, this research study investigated assessment in VR, with the goal of analyzing aspects of student learning in VR that are feasible to access or capture by traditional assessments and alternative assessments. The researcher also examined what additional types of learning alternative assessments may offer. More specifically, this study compared the effectiveness of a traditional method with an alternative (performance-based) method of assessment that was used to examine the ability of the tools to accurately evidence the levels of students' understanding and learning. The domain area was electrostatics, a complex, abstract multidimensional concept, with which students often experience difficulty. Outcomes of the study suggest that, in the evaluation of learning in an immersive VR learning environment, assessments would most accurately manifest student learning if the assessment measure matched the learning environment itself. In this study, learning and assessing in the VR environment yielded higher final test scores than learning in VR and testing with traditional paper-and-pencil. Being able to transfer knowledge from a VR environment to other situations is critical in demonstrating the overall level of understanding of a concept. For this reason, the researcher recommends a combination of testing measures to enhance understanding of complex, abstract concepts.

In vitro cleaning potential of three different implant debridement methods.

PubMed

Sahrmann, Philipp; Ronay, Valerie; Hofer, Deborah; Attin, Thomas; Jung, Ronald E; Schmidlin, Patrick R

2015-03-01

To assess the cleaning potential of three different instrumentation methods commonly used for implant surface decontamination in vitro, using a bone defect-simulating model. Dental implants were stained with indelible ink and mounted in resin models, which represented standardized peri-implantitis defects with different bone defect angulations (30, 60 and 90°). Cleaning procedures were performed by either an experienced dental hygienist or a 2nd-year postgraduate student. The treatment was repeated 20 times for each instrumentation, that is, with a Gracey curette, an ultrasonic device and an air powder abrasive device (PAD) with glycine powder. After each run, implants were removed and images were taken to detect color remnants in order to measure planimetrically the cumulative uncleaned surface area. SEM images were taken to assess micromorphologic surface changes (magnification 10,000 ×). Results were tested for statistical differences using two-way ANOVA and Bonferroni correction. The areas of uncleaned surfaces (%, mean ± standard deviations) for curettes, ultrasonic tips, and airflow accounted for 24.1 ± 4.8%, 18.5 ± 3.8%, and 11.3 ± 5.4%, respectively. These results were statistically significantly different (P < 0.0001). The cleaning potential of the airflow device increased with wider defects. SEM evaluation displayed distinct surface alterations after instrumentation with steel tips, whereas glycine powder instrumentation had only a minute effect on the surface topography. Within the limitations of the present in vitro model, airflow devices using glycine powders seem to constitute an efficient therapeutic option for the debridement of implants in peri-implantitis defects. Still, some uncleaned areas remained. In wide defects, differences between instruments are more accentuated. © 2013 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Assessing Reliability and Validity of the "GroPromo" Audit Tool for Evaluation of Grocery Store Marketing and Promotional Environments

ERIC Educational Resources Information Center

Kerr, Jacqueline; Sallis, James F.; Bromby, Erica; Glanz, Karen

2012-01-01

Objective: To evaluate reliability and validity of a new tool for assessing the placement and promotional environment in grocery stores. Methods: Trained observers used the "GroPromo" instrument in 40 stores to code the placement of 7 products in 9 locations within a store, along with other promotional characteristics. To test construct validity,…

Assessing the Treatment Effects in Apraxia of Speech: Introduction and Evaluation of the Modified Diadochokinesis Test

ERIC Educational Resources Information Center

Hurkmans, Joost; Jonkers, Roel; Boonstra, Anne M.; Stewart, Roy E.; Reinders-Messelink, Heleen A.

2012-01-01

Background: The number of reliable and valid instruments to measure the effects of therapy in apraxia of speech (AoS) is limited. Aims: To evaluate the newly developed Modified Diadochokinesis Test (MDT), which is a task to assess the effects of rate and rhythm therapies for AoS in a multiple baseline across behaviours design. Methods: The…

Review of near-infrared methods for wound assessment

NASA Astrophysics Data System (ADS)

Sowa, Michael G.; Kuo, Wen-Chuan; Ko, Alex C.-T.; Armstrong, David G.

2016-09-01

Wound management is a challenging and costly problem that is growing in importance as people are living longer. Instrumental methods are increasingly being relied upon to provide objective measures of wound assessment to help guide management. Technologies that employ near-infrared (NIR) light form a prominent contingent among the existing and emerging technologies. We review some of these technologies. Some are already established, such as indocyanine green fluorescence angiography, while we also speculate on others that have the potential to be clinically relevant to wound monitoring and assessment. These various NIR-based technologies address clinical wound management needs along the entire healing trajectory of a wound.

Assessing Emotionally Intelligent Leadership in Pharmacy Students

PubMed Central

Kolar, Claire; Nelson, Michael H.; Fierke, Kerry K.; Sucher, Brandon J.; Janke, Kristin K.

2017-01-01

Objective. To determine the frequency distribution of pharmacy students across Emotionally Intelligent Leadership Inventory (EILI) measures. Methods. The EILI was administered to 235 pharmacy students at two schools. The instrument was systematically compared to the 2013 CAPE Outcomes and analyzed by confirmatory factor analysis. Results. The EILI has primary connections with pharmacy competencies related to interprofessional communication and leadership. The three facets of the EILI were verified for internal consistency (Context, α=.78; Self, α=.74; Others, α=.79). Student scores were the highest for the consciousness of self facet, with a mean score of 31.4 out of 40. Conclusion. The EILI shows promise as an instrument for use in assessing pharmacy students’ emotional intelligence and leadership skills. PMID:28381889

The development of a survey instrument for community health improvement.

PubMed Central

Bazos, D A; Weeks, W B; Fisher, E S; DeBlois, H A; Hamilton, E; Young, M J

2001-01-01

OBJECTIVE: To develop a survey instrument that could be used both to guide and evaluate community health improvement efforts. DATA SOURCES/STUDY SETTING: A randomized telephone survey was administered to a sample of about 250 residents in two communities in Lehigh Valley, Pennsylvania in the fall of 1997. METHODS: The survey instrument was developed by health professionals representing diverse health care organizations. This group worked collaboratively over a period of two years to (1) select a conceptual model of health as a foundation for the survey; (2) review relevant literature to identify indicators that adequately measured the health constructs within the chosen model; (3) develop new indicators where important constructs lacked specific measures; and (4) pilot test the final survey to assess the reliability and validity of the instrument. PRINCIPAL FINDINGS: The Evans and Stoddart Field Model of the Determinants of Health and Well-Being was chosen as the conceptual model within which to develop the survey. The Field Model depicts nine domains important to the origins and production of health and provides a comprehensive framework from which to launch community health improvement efforts. From more than 500 potential indicators we identified 118 survey questions that reflected the multiple determinants of health as conceptualized by this model. Sources from which indicators were selected include the Behavior Risk Factor Surveillance Survey, the National Health Interview Survey, the Consumer Assessment of Health Plans Survey, and the SF-12 Summary Scales. The work group developed 27 new survey questions for constructs for which we could not locate adequate indicators. Twenty-five questions in the final instrument can be compared to nationally published norms or benchmarks. The final instrument was pilot tested in 1997 in two communities. Administration time averaged 22 minutes with a response rate of 66 percent. Reliability of new survey questions was adequate. Face validity was supported by previous findings from qualitative and quantitative studies. CONCLUSIONS: We developed, pilot tested, and validated a survey instrument designed to provide more comprehensive and timely data to communities for community health assessments. This instrument allows communities to identify and measure critical domains of health that have previously not been captured in a single instrument. PMID:11508639

Laboratory and field based evaluation of chromatography ...

EPA Pesticide Factsheets

The Monitor for AeRosols and GAses in ambient air (MARGA) is an on-line ion-chromatography-based instrument designed for speciation of the inorganic gas and aerosol ammonium-nitrate-sulfate system. Previous work to characterize the performance of the MARGA has been primarily based on field comparison to other measurement methods to evaluate accuracy. While such studies are useful, the underlying reasons for disagreement among methods are not always clear. This study examines aspects of MARGA accuracy and precision specifically related to automated chromatography analysis. Using laboratory standards, analytical accuracy, precision, and method detection limits derived from the MARGA chromatography software are compared to an alternative software package (Chromeleon, Thermo Scientific Dionex). Field measurements are used to further evaluate instrument performance, including the MARGA’s use of an internal LiBr standard to control accuracy. Using gas/aerosol ratios and aerosol neutralization state as a case study, the impact of chromatography on measurement error is assessed. The new generation of on-line chromatography-based gas and particle measurement systems have many advantages, including simultaneous analysis of multiple pollutants. The Monitor for Aerosols and Gases in Ambient Air (MARGA) is such an instrument that is used in North America, Europe, and Asia for atmospheric process studies as well as routine monitoring. While the instrument has been evaluat

Creating a Computer Adaptive Test Version of the Late-Life Function & Disability Instrument

PubMed Central

Jette, Alan M.; Haley, Stephen M.; Ni, Pengsheng; Olarsch, Sippy; Moed, Richard

2009-01-01

Background This study applied Item Response Theory (IRT) and Computer Adaptive Test (CAT) methodologies to develop a prototype function and disability assessment instrument for use in aging research. Herein, we report on the development of the CAT version of the Late-Life Function & Disability instrument (Late-Life FDI) and evaluate its psychometric properties. Methods We employed confirmatory factor analysis, IRT methods, validation, and computer simulation analyses of data collected from 671 older adults residing in residential care facilities. We compared accuracy, precision, and sensitivity to change of scores from CAT versions of two Late-Life FDI scales with scores from the fixed-form instrument. Score estimates from the prototype CAT versus the original instrument were compared in a sample of 40 older adults. Results Distinct function and disability domains were identified within the Late-Life FDI item bank and used to construct two prototype CAT scales. Using retrospective data, scores from computer simulations of the prototype CAT scales were highly correlated with scores from the original instrument. The results of computer simulation, accuracy, precision, and sensitivity to change of the CATs closely approximated those of the fixed-form scales, especially for the 10- or 15-item CAT versions. In the prospective study each CAT was administered in less than 3 minutes and CAT scores were highly correlated with scores generated from the original instrument. Conclusions CAT scores of the Late-Life FDI were highly comparable to those obtained from the full-length instrument with a small loss in accuracy, precision, and sensitivity to change. PMID:19038841

Monitoring the ability to deliver care in low- and middle-income countries: a systematic review of health facility assessment tools

PubMed Central

Nickerson, Jason W; Adams, Orvill; Attaran, Amir; Hatcher-Roberts, Janet; Tugwell, Peter

2015-01-01

Introduction Health facilities assessments are an essential instrument for health system strengthening in low- and middle-income countries. These assessments are used to conduct health facility censuses to assess the capacity of the health system to deliver health care and to identify gaps in the coverage of health services. Despite the valuable role of these assessments, there are currently no minimum standards or frameworks for these tools. Methods We used a structured keyword search of the MEDLINE, EMBASE and HealthStar databases and searched the websites of the World Health Organization, the World Bank and the International Health Facilities Assessment Network to locate all available health facilities assessment tools intended for use in low- and middle-income countries. We parsed the various assessment tools to identify similarities between them, which we catalogued into a framework comprising 41 assessment domains. Results We identified 10 health facility assessment tools meeting our inclusion criteria, all of which were included in our analysis. We found substantial variation in the comprehensiveness of the included tools, with the assessments containing indicators in 13 to 33 (median: 25.5) of the 41 assessment domains included in our framework. None of the tools collected data on all 41 of the assessment domains we identified. Conclusions Not only do a large number of health facility assessment tools exist, but the data they collect and methods they employ are very different. This certainly limits the comparability of the data between different countries’ health systems and probably creates blind spots that impede efforts to strengthen those systems. Agreement is needed on the essential elements of health facility assessments to guide the development of specific indicators and for refining existing instruments. PMID:24895350

[Assessment of Functioning when Conducting Occupational Capacity Evaluations--What is "Evidence-Based"?].

PubMed

Canela, Carlos; Schleifer, Roman; Dube, Anish; Hengartner, Michael P; Ebner, Gerhard; Seifritz, Erich; Liebrenz, Michael

2016-03-01

Occupational capacity evaluations have previously been subject to criticism for lacking in quality and consistency. To the authors' knowledge, there is no clear consensus on the best way to formally assess functioning within capacity evaluations. In this review we investigated different instruments that are used to assess functioning in occupational capacity evaluations. Systematic review of the literature. Though several instruments that assess functional capacity were found in our search, a specific validated instrument assessing occupational capacity as part of a larger psychiatric evaluation was not found. The limitations of the existing instruments on assessing functional capacity are discussed. Medical experts relying on instruments to conduct functional capacity evaluations should be cognizant of their limitations. The findings call for the development and use of an instrument specifically designed to assess the functional and occupational capacity of psychiatric patients, which is also likely to improve the quality of these reports. © Georg Thieme Verlag KG Stuttgart · New York.

Comparison of Single Visit Post Endodontic Pain Using Mtwo Rotary and Hand K-File Instruments: A Randomized Clinical Trial

PubMed Central

Kashefinejad, Mohamad; Harandi, Azade; Bijani, Ali

2016-01-01

Objectives: Pain is an unpleasant outcome of endodontic treatment that can be unbearable to patients. Instrumentation techniques may affect the frequency and intensity of post-endodontic pain. This study aimed to compare single visit post endodontic pain using Mtwo (NiTi) rotary and hand K-file instruments. Materials and Methods: In this randomized controlled trial, 60 teeth with symptomatic irreversible pulpitis in 53 patients were selected and randomly assigned into two groups of 30 teeth. In group A, the root canals were prepared with Mtwo (NiTi) rotary instruments. In group B, the root canals were prepared with hand K-file instruments. Pain assessment was implemented using visual analog scale (VAS) at four, eight, 12 and 24 hours after treatment. The acquired data were analyzed using chi-square, Mann-Whitney U and Student’s t-test (P<0.05). Results: Patients treated with rotary instruments experienced significantly less post-endodontic pain than those treated with hand instruments (P<0.001). Conclusions: The use of Mtwo (NiTi) rotary instruments in root canal preparation contributed to lower incidence of postoperative pain than hand K-files. PMID:27536323

Instruments for assessing the risk of falls in acute hospitalized patients: a systematic review and meta-analysis

PubMed Central

2013-01-01

Background Falls are a serious problem for hospitalized patients, reducing the duration and quality of life. It is estimated that over 84% of all adverse events in hospitalized patients are related to falls. Some fall risk assessment tools have been developed and tested in environments other than those for which they were developed with serious validity discrepancies. The aim of this review is to determine the accuracy of instruments for detecting fall risk and predicting falls in acute hospitalized patients. Methods Systematic review and meta-analysis. Main databases, related websites and grey literature were searched. Two blinded reviewers evaluated title and abstracts of the selected articles and, if they met inclusion criteria, methodological quality was assessed in a new blinded process. Meta-analyses of diagnostic ORs (DOR) and likelihood (LH) coefficients were performed with the random effects method. Forest plots were calculated for sensitivity and specificity, DOR and LH. Additionally, summary ROC (SROC) curves were calculated for every analysis. Results Fourteen studies were selected for the review. The meta-analysis was performed with the Morse (MFS), STRATIFY and Hendrich II Fall Risk Model scales. The STRATIFY tool provided greater diagnostic validity, with a DOR value of 7.64 (4.86 - 12.00). A meta-regression was performed to assess the effect of average patient age over 65 years and the performance or otherwise of risk reassessments during the patient’s stay. The reassessment showed a significant reduction in the DOR on the MFS (rDOR 0.75, 95% CI: 0.64 - 0.89, p = 0.017). Conclusions The STRATIFY scale was found to be the best tool for assessing the risk of falls by hospitalized acutely-ill adults. However, the behaviour of these instruments varies considerably depending on the population and the environment, and so their operation should be tested prior to implementation. Further studies are needed to investigate the effect of the reassessment of these instruments with respect to hospitalized adult patients, and to consider the real compliance by healthcare personnel with procedures related to patient safety, and in particular concerning the prevention of falls. PMID:23547708

Development of a structured observational method for the systematic assessment of school food-choice architecture.

PubMed

Ozturk, Orgul D; McInnes, Melayne M; Blake, Christine E; Frongillo, Edward A; Jones, Sonya J

2016-01-01

The objective of this study is to develop a structured observational method for the systematic assessment of the food-choice architecture that can be used to identify key points for behavioral economic intervention intended to improve the health quality of children's diets. We use an ethnographic approach with observations at twelve elementary schools to construct our survey instrument. Elements of the structured observational method include decision environment, salience, accessibility/convenience, defaults/verbal prompts, number of choices, serving ware/method/packaging, and social/physical eating environment. Our survey reveals important "nudgeable" components of the elementary school food-choice architecture, including precommitment and default options on the lunch line.

Acceptability and psychometric properties of Brøset Violence Checklist in psychiatric care settings in China.

PubMed

Yao, X; Li, Z; Arthur, D; Hu, L; An, F-R; Cheng, G

2014-01-01

Short-term risk assessment instrument owns great importance for psychiatric nurses in China; however, the lack of a standardized violence risk assessment instrument has disadvantaged them in clinical practice. The Brøset Violence Checklist (BVC), a behavioural observation tool, is the most frequently cited instrument available for evaluating violence risk in psychiatric inpatients, then worth to be tested in Chinese culture. This study, conducted in two closed wards in a psychiatric hospital in Beijing, revealed that the instrument has favourable reliability, validity and predictive accuracy in Chinese population. BVC provides nurses with a quick and easily administered method to screening out patients with violence potential, thus allowing for early intervention. Feedback from the nurses was quite encouraging and the further use of BVC seems promising. The lack of standardized violence risk assessment instrument has disadvantaged nurses in clinical practice in China, where violent behaviour is an increasing problem. This study conducted a validation of the Brøset Violence Checklist that has proven effective in violence risk prediction in other countries. A sample of 296 patients consecutively admitted to two wards of a psychiatric hospital in Beijing was recruited. These patients were assessed on day shift and evening shift for the first seven days of hospitalization. Violence data and preventive measures were concurrently collected from nursing records and case reports. A total of 3707 assessments for 281 patients were collected revealing 93 episodes of violence among 55 patients. Receiver operating characteristics yielded an area under the curve of 0.85. At the cut-off point of one, its sensitivity/specificity was 78.5%/88.2% and the corresponding positive/negative predictive value was 14.6%/99.4%. In some false positive cases, intense preventive measures had been implemented. Positive feedback from the nurses was gained. The Brøset Violence Checklist was proved as an easy-to-use and time-saving instrument, therefore, regarded as a promising tool to determine if the psychiatric users are potentially violent in the short term. © 2014 John Wiley & Sons Ltd.

An Interactive Internet-Based Plate for Assessing Lunchtime Food Intake: A Validation Study on Male Employees

PubMed Central

Bellocco, Rino; Bakkman, Linda; Trolle Lagerros, Ylva

2013-01-01

Background Misreporting food intake is common because most health screenings rely on self-reports. The more accurate methods (eg, weighing food) are costly, time consuming, and impractical. Objectives We developed a new instrument for reporting food intake—an Internet-based interactive virtual food plate. The objective of this study was to validate this instrument’s ability to assess lunch intake. Methods Participants were asked to compose an ordinary lunch meal using both a virtual and a real lunch plate (with real food on a real plate). The participants ate their real lunch meals on-site. Before and after pictures of the composed lunch meals were taken. Both meals included identical food items. Participants were randomized to start with either instrument. The 2 instruments were compared using correlation and concordance measures (total energy intake, nutritional components, quantity of food, and participant characteristics). Results A total of 55 men (median age: 45 years, median body mass index [BMI]: 25.8 kg/m2) participated. We found an overall overestimation of reported median energy intake using the computer plate (3044 kJ, interquartile range [IQR] 1202 kJ) compared with the real lunch plate (2734 kJ, IQR 1051 kJ, P<.001). Spearman rank correlations and concordance correlations for energy intake and nutritional components ranged between 0.58 to 0.79 and 0.65 to 0.81, respectively. Conclusion Although it slightly overestimated, our computer plate provides promising results in assessing lunch intake. PMID:23335728

A comparative review of measurement instruments to inform and evaluate effectiveness of disability inclusive development.

PubMed

Goujon, Nicolas; Devine, Alexandra; Baker, Sally M; Sprunt, Beth; Edmonds, Tanya J; Booth, Jennifer K; Keeffe, Jill E

2014-01-01

A review of existing measurement instruments was conducted to examine their suitability to measure disability prevalence and assess quality of life, protection of disability rights and community participation by people with disabilities, specifically within the context of development programs in low and middle-income countries. From a search of PubMed and the grey literature, potentially relevant measurement instruments were identified and examined for their content and psychometric properties, where possible. Criteria for inclusion were: based on the WHO's International Classification of Functioning Disability and Health (ICF), used quantitative methods, suitable for population-based studies of disability inclusive development in English and published after 1990. Characteristics of existing instruments were analysed according to components of the ICF and quality of life domains. Ten instruments were identified and reviewed according to the criteria listed above. Each version of instruments was analysed separately. Only three instruments included a component on quality of life. Domains from the ICF that were addressed by some but not all instruments included the environment, technology and communication. The measurement instruments reviewed covered the range of elements required to measure disability-inclusion within development contexts. However no single measurement instrument has the capacity to measure both disability prevalence and changes in quality of life according to contemporary disability paradigms. The review of measurement instruments supports the need for developing an instrument specifically intended to measure disability inclusive practice within development programs. Implications for Rehabilitation Surveys and tools are needed to plan disability inclusive development. Existing measurement tools to determine prevalence of disability, wellbeing, rights and access to the community were reviewed. No single validated tool exists for population-based studies, uses quantitative methods and the components of the ICF to measure prevalence of disability, well-being of people with disability and their access to their communities. A measurement tool that reflects the UNCRPD and addresses all components of the ICF is needed to assist in disability inclusive development, especially in low and mid resource countries.

Risk factors and screening instruments to predict adverse outcomes for undifferentiated older emergency department patients: a systematic review and meta-analysis.

PubMed

Carpenter, Christopher R; Shelton, Erica; Fowler, Susan; Suffoletto, Brian; Platts-Mills, Timothy F; Rothman, Richard E; Hogan, Teresita M

2015-01-01

A significant proportion of geriatric patients experience suboptimal outcomes following episodes of emergency department (ED) care. Risk stratification screening instruments exist to distinguish vulnerable subsets, but their prognostic accuracy varies. This systematic review quantifies the prognostic accuracy of individual risk factors and ED-validated screening instruments to distinguish patients more or less likely to experience short-term adverse outcomes like unanticipated ED returns, hospital readmissions, functional decline, or death. A medical librarian and two emergency physicians conducted a medical literature search of PubMed, EMBASE, SCOPUS, CENTRAL, and ClinicalTrials.gov using numerous combinations of search terms, including emergency medical services, risk stratification, geriatric, and multiple related MeSH terms in hundreds of combinations. Two authors hand-searched relevant specialty society research abstracts. Two physicians independently reviewed all abstracts and used the revised Quality Assessment of Diagnostic Accuracy Studies instrument to assess individual study quality. When two or more qualitatively similar studies were identified, meta-analysis was conducted using Meta-DiSc software. Primary outcomes were sensitivity, specificity, positive likelihood ratio (LR+), and negative likelihood ratio (LR-) for predictors of adverse outcomes at 1 to 12 months after the ED encounters. A hypothetical test-treatment threshold analysis was constructed based on the meta-analytic summary estimate of prognostic accuracy for one outcome. A total of 7,940 unique citations were identified yielding 34 studies for inclusion in this systematic review. Studies were significantly heterogeneous in terms of country, outcomes assessed, and the timing of post-ED outcome assessments. All studies occurred in ED settings and none used published clinical decision rule derivation methodology. Individual risk factors assessed included dementia, delirium, age, dependency, malnutrition, pressure sore risk, and self-rated health. None of these risk factors significantly increased the risk of adverse outcome (LR+ range = 0.78 to 2.84). The absence of dependency reduces the risk of 1-year mortality (LR- = 0.27) and nursing home placement (LR- = 0.27). Five constructs of frailty were evaluated, but none increased or decreased the risk of adverse outcome. Three instruments were evaluated in the meta-analysis: Identification of Seniors at Risk, Triage Risk Screening Tool, and Variables Indicative of Placement Risk. None of these instruments significantly increased (LR+ range for various outcomes = 0.98 to 1.40) or decreased (LR- range = 0.53 to 1.11) the risk of adverse outcomes. The test threshold for 3-month functional decline based on the most accurate instrument was 42%, and the treatment threshold was 61%. Risk stratification of geriatric adults following ED care is limited by the lack of pragmatic, accurate, and reliable instruments. Although absence of dependency reduces the risk of 1-year mortality, no individual risk factor, frailty construct, or risk assessment instrument accurately predicts risk of adverse outcomes in older ED patients. Existing instruments designed to risk stratify older ED patients do not accurately distinguish high- or low-risk subsets. Clinicians, educators, and policy-makers should not use these instruments as valid predictors of post-ED adverse outcomes. Future research to derive and validate feasible ED instruments to distinguish vulnerable elders should employ published decision instrument methods and examine the contributions of alternative variables, such as health literacy and dementia, which often remain clinically occult. © 2014 by the Society for Academic Emergency Medicine.

[Evaluation of an educational website on First Aid].

PubMed

Mori, Satomi; Whitaker, Iveth Yamaguchi; Marin, Heimar de Fátima

2013-08-01

The aim of this study was to evaluate the structure, quality of information and usability of a website on First Aid. The evaluation was performed by information technology (IT) and health care professionals and by students, using specific and validated instruments. The kappa method was used to evaluate the agreement of the answers, and Cronbach's α coefficient was used to assess the reliability of the instrument. There was no agreement (0.047) among the answers obtained from the IT professionals, indicating that the structure of the website must be reviewed. There was also no agreement in the evaluation by the health care professionals (-0.062); however, the overall positive scores suggest that the quality of the information of the website is adequate. The assessment of reliability of the instrument to evaluate the navigability rendered a value of α=0.974. Although improvement of the website structure is recommended, the quality of the information is good, and its use has contributed to the apprenticeship of students.

Assessment of the Local Residual Stresses of 7050-T7452 Aluminum Alloy in Microzones by the Instrumented Indentation with the Berkovich Indenter

NASA Astrophysics Data System (ADS)

He, M.; Huang, C. H.; Wang, X. X.; Yang, F.; Zhang, N.; Li, F. G.

2017-10-01

The local residual stresses in microzones are investigated by the instrumented indentation method with the Berkovich indenter. The parameters required for determination of residual stresses are obtained from indentation load-penetration depth curves constructed during instrumented indentation tests on flat square 7050-T7452 aluminum alloy specimens with a central hole containing the compressive residual stresses generated by the cold extrusion process. The force balance system with account of the tensile and compressive residual stresses is used to explain the phenomenon of different contact areas produced by the same indentation load. The effect of strain-hardening exponent on the residual stress is tuned-off by application of the representative stress σ_{0.033} in the average contact pressure assessment using the Π theorem, while the yield stress value is obtained from the constitutive function. Finally, the residual stresses are calculated according to the proposed equations of the force balance system, and their feasibility is corroborated by the XRD measurements.

[Development and validation of an instrument for initial nursing assessment].

PubMed

Fernández-Sola, Cayetano; Granero-Molina, José; Mollinedo-Mallea, Judith; de Gonzales, María Hilda Peredo; Aguilera-Manrique, Gabriel; Ponce, Mara Luna

2012-12-01

The objective of this study, conducted in Bolivia from April to July of 2008, is the design and validation of an initial nursing assessment instrument to be used in clinical and educational environments in Santa Cruz (Bolivia). Twelve Bolivian nurses participated; both document analysis as well as consensus techniques were used to determine the categories and criteria to be assessed. Categories included in the nursing assessment instrument are a physical assessment and the eleven Gordon's Functional Health Patterns. The nursing assessment instrument stands out as being concise, easy to complete and utilizing a nursing approach. It does not include items for advanced nursing assessment. However, it incorporates items regarding lifestyle and the patient's autonomy. The nursing assessment instrument contributes to improving the quality of clinical records, supports the nursing diagnosis and implementation of the nursing process, promotes the nurse's role and helps to standardize practice.

Ecological Validity and Clinical Utility of Patient-Reported Outcomes Measurement Information System (PROMIS®) instruments for detecting premenstrual symptoms of depression, anger, and fatigue

PubMed Central

Junghaenel, Doerte U.; Schneider, Stefan; Stone, Arthur A.; Christodoulou, Christopher; Broderick, Joan E.

2014-01-01

Objective This study examined the ecological validity and clinical utility of NIH Patient Reported-Outcomes Measurement Information System (PROMIS®) instruments for anger, depression, and fatigue in women with premenstrual symptoms. Methods One-hundred women completed daily diaries and weekly PROMIS assessments over 4 weeks. Weekly assessments were administered through Computerized Adaptive Testing (CAT). Weekly CATs and corresponding daily scores were compared to evaluate ecological validity. To test clinical utility, we examined if CATs could detect changes in symptom levels, if these changes mirrored those obtained from daily scores, and if CATs could identify clinically meaningful premenstrual symptom change. Results PROMIS CAT scores were higher in the pre-menstrual than the baseline (ps < .0001) and post-menstrual (ps < .0001) weeks. The correlations between CATs and aggregated daily scores ranged from .73 to .88 supporting ecological validity. Mean CAT scores showed systematic changes in accordance with the menstrual cycle and the magnitudes of the changes were similar to those obtained from the daily scores. Finally, Receiver Operating Characteristic (ROC) analyses demonstrated the ability of the CATs to discriminate between women with and without clinically meaningful premenstrual symptom change. Conclusions PROMIS CAT instruments for anger, depression, and fatigue demonstrated validity and utility in premenstrual symptom assessment. The results provide encouraging initial evidence of the utility of PROMIS instruments for the measurement of affective premenstrual symptoms. PMID:24630180

Developing a reliable and valid instrument to assess health-affecting aspects of neighborhoods in Tehran

PubMed Central

Ghalichi, Leila; Mohammad, Kazem; Majdzadeh, Reza; Hoseini, Mostafa; Pournik, Omid; Nedjat, Saharnaz

2012-01-01

Background: Residence characteristics can affect health of residents. This paper reports the development of an instrument assessing these aspects of neighborhoods. Materials and Methods: Literature search and focus group discussions with residents were carried out and relevant items were extracted. Five experts reviewed and commented on the items. An observation instrument with 54 items was composed and completed by two independent observers in 20 randomly selected locations. Due to lack of acceptable reliability in some items, the checklist was revised. The new 22-items checklist in four categories (general characteristics, public green area characteristics, access to services and undesirable features) was completed by two independent trained observers in 28 randomly selected locations. Results: The items in the final checklist had kappa statistics ranging from 0.63 to 1, with an exception of the item assessing “presence of beggars, homeless or working/street children”, with kappa as low as 0.27 due to variability of their presence in different times. Average Kappa statistics was 0.78 for general characteristics, 0.79 for public green area characteristics, 0.84 for access to services, and 0.54 for undesirable features. Conclusion: Neighborhood and health observation instrument seems to have good reliability in city of Tehran. It can probably be used in other large cities of Iran and similar cities elsewhere. PMID:23626633

Central fatigue in multiple sclerosis: a review of the literature

PubMed Central

Newland, Pamela; Starkweather, Angela; Sorenson, Matthew

2016-01-01

Concept Fatigue is a major concern for patients with multiple sclerosis (MS). A clear definition of MS-related fatigue is a prerequisite for appropriate instruments for fatigue assessment. In turn, accurate assessment of fatigue in MS will enhance exploration of plausible mechanisms underlying this common and distressing symptom. Content/Objectives To provide an integrative review of the current literature on theoretical models used to study fatigue in MS, instruments used to assess fatigue and other factors that impact fatigue during the various phases of MS. Methods Data sources: PUBMED, OVID, Ovid Health Star, Ovid MEDINE, CINAHL, Health and Psychosocial Instruments (HaPI), and PsycINFO. Seventeen articles fit the inclusion criteria and were included in the review. Results Definitions of MS-related fatigue are reviewed. Several studies found a link with neurotransmitter dysfunction, circadian rhythm, and the timing of fatigue. Central fatigue in MS is associated with neurotransmitters disruptions as well as circadian rhythm disorders, but the evidence is not strong. Perceptions of fatigue or fatigability may arise as either a primary or secondary manifestation of disease. Based on findings from the literature review, a theoretical model of fatigue in MS is proposed. Conclusion Future research on MS-related fatigue may consider a longitudinal design with a carefully selected self-report instrument to advance understanding of the underlying pathological mechanisms. PMID:27146427

The development of a clinical outcomes survey research application: Assessment CenterSM

PubMed Central

Rothrock, Nan E.; Hanrahan, Rachel T.; Jansky, Liz J.; Harniss, Mark; Riley, William

2013-01-01

Introduction The National Institutes of Health sponsored Patient-Reported Outcome Measurement Information System (PROMIS) aimed to create item banks and computerized adaptive tests (CATs) across multiple domains for individuals with a range of chronic diseases. Purpose Web-based software was created to enable a researcher to create study-specific Websites that could administer PROMIS CATs and other instruments to research participants or clinical samples. This paper outlines the process used to develop a user-friendly, free, Web-based resource (Assessment CenterSM) for storage, retrieval, organization, sharing, and administration of patient-reported outcomes (PRO) instruments. Methods Joint Application Design (JAD) sessions were conducted with representatives from numerous institutions in order to supply a general wish list of features. Use Cases were then written to ensure that end user expectations matched programmer specifications. Program development included daily programmer “scrum” sessions, weekly Usability Acceptability Testing (UAT) and continuous Quality Assurance (QA) activities pre- and post-release. Results Assessment Center includes features that promote instrument development including item histories, data management, and storage of statistical analysis results. Conclusions This case study of software development highlights the collection and incorporation of user input throughout the development process. Potential future applications of Assessment Center in clinical research are discussed. PMID:20306332

STEM-based science learning implementation to identify student’s personal intelligences profiles

NASA Astrophysics Data System (ADS)

Wiguna, B. J. P. K.; Suwarma, I. R.; Liliawati, W.

2018-05-01

Science and technology are rapidly developing needs to be balanced with the human resources that have the qualified ability. Not only cognitive ability, but also have the soft skills that support 21st century skills. Science, Technology, Engineering, and Mathematics (STEM) Education is a solution to improve the quality of learning and prepare students may be able to trained 21st century skills. This study aims to analyse the implementation of STEM-based science learning on Newton’s law of motion by identifying the personal intelligences profile junior high school students. The method used in this research is pre experiment with the design of the study one group pre-test post-test. Samples in this study were 26 junior high school students taken using Convenience Sampling. Students personal intelligences profile after learning STEM-based science uses two instruments, self-assessment and peer assessment. Intrapersonal intelligence profile based self-assessment and peer assessment are respectively 69.38; and 64.08. As for interpersonal intelligence for self-assessment instrument is 73 and the peer assessment is 60.23.

How to Assess Creative Thinking Skill in Making Products of Liquid Pressure?

NASA Astrophysics Data System (ADS)

Chasanah, L.; Kaniawati, I.; Hernani, H.

2017-09-01

The primary skills that must be possessed in the 21st century curriculum are learning and innovation skills. One of the learning strategies that can train students to innovate and improve creative thinking skills is by applying Science, Technology, Engineering and Mathematics (STEM) in learning. Based on an interview to one of the science teachers that learning that aims to train learning and innovation skills has not been applied to learning in the classroom because there is not enough time, learning materials and assessment instruments used. This study aims to determine the results of the implementation of performance assessment of creative thinking skills on STEM-based learning in junior high school for the material of liquid pressure. This research uses descriptive method. Participants in this study were junior high school students 8th in Kudus area. The research instrument consists of observation sheet, performance assessment and documentation. The result showed that creative thinking skills performance assessment can assess student’s creativity in making products of STEM-based learning for junior high school.

Fluorescence fingerprint as an instrumental assessment of the sensory quality of tomato juices.

PubMed

Trivittayasil, Vipavee; Tsuta, Mizuki; Imamura, Yoshinori; Sato, Tsuneo; Otagiri, Yuji; Obata, Akio; Otomo, Hiroe; Kokawa, Mito; Sugiyama, Junichi; Fujita, Kaori; Yoshimura, Masatoshi

2016-03-15

Sensory analysis is an important standard for evaluating food products. However, as trained panelists and time are required for the process, the potential of using fluorescence fingerprint as a rapid instrumental method to approximate sensory characteristics was explored in this study. Thirty-five out of 44 descriptive sensory attributes were found to show a significant difference between samples (analysis of variance test). Principal component analysis revealed that principal component 1 could capture 73.84 and 75.28% variance for aroma category and combined flavor and taste category respectively. Fluorescence fingerprints of tomato juices consisted of two visible peaks at excitation/emission wavelengths of 290/350 and 315/425 nm and a long narrow emission peak at 680 nm. The 680 nm peak was only clearly observed in juices obtained from tomatoes cultivated to be eaten raw. The ability to predict overall sensory profiles was investigated by using principal component 1 as a regression target. Fluorescence fingerprint could predict principal component 1 of both aroma and combined flavor and taste with a coefficient of determination above 0.8. The results obtained in this study indicate the potential of using fluorescence fingerprint as an instrumental method for assessing sensory characteristics of tomato juices. © 2015 Society of Chemical Industry.

Provisional Teachers Failing the Mississippi Teacher Assessment Instruments for Certification: An Evaluation for 1991-92.

ERIC Educational Resources Information Center

Amos, Neil; Cheeseman, Robert H.

The Mississippi Teacher Assessment Instruments (MTAIs) contain 16 teaching competencies (14 competencies measured by 3 separate instruments of the MTAI, and 2 performance standards assessed by the local district). The Teaching Plans and Materials MTAI guides assessment of beginning teachers' competence in planning instruction, selecting…

A systematic review on assessment instruments for dementia in persons with intellectual disabilities.

PubMed

Zeilinger, Elisabeth L; Stiehl, Katharina A M; Weber, Germain

2013-11-01

This work describes an extensive systematic literature review on assessment instruments for dementia in persons with intellectual disability (ID). Existing instruments for the detection of dementia in persons with ID were collected and described systematically. This allows a direct and quick overview of available tools. Additionally, it contributes to the availability and usability of information about these instruments, thus enhancing further developments in this field. A systematic literature search in five databases (CINAHL, PsycInfo, PubMed, Scopus, and Web of Science) was conducted. In order to include gray literature an invisible college approach was used. Relevant studies were identified and selected using defined inclusion and exclusion criteria. After the selection process all instruments were coded and classified. It was determined which concepts they assess, whether they were especially developed or adapted for persons with ID, and whether they were designed to assess dementia. The selection of relevant papers, as well as the coding of instruments was done independently by two researchers. In total, 97 records met the search criteria. Out of these, 114 different instruments were extracted. There were 79 instruments to be completed by the person with ID, and 35 informant-based instruments. Additionally, four test batteries were found. Some of these instruments were neither designed for the assessment of dementia, nor for persons with ID. There are a variety of different tools used for the assessment of dementia in ID. Nevertheless, an agreed-upon approach or instrument is missing. Establishing this would improve the quality of assessment in clinical practice, and benefit research. Data collected would become comparable and combinable, and allow research to have more informative value. Copyright © 2013 Elsevier Ltd. All rights reserved.

Developing an Acceptability Assessment of Preventive Dental Treatments

PubMed Central

Hyde, Susan; Gansky, Stuart A.; Gonzalez-Vargas, Maria J.; Husting, Sheila R.; Cheng, Nancy F.; Millstein, Susan G.; Adams, Sally H.

2012-01-01

Objectives Early childhood caries (ECC) is very prevalent among young Hispanic children. ECC is amenable to a variety of preventive procedures, yet many Hispanic families underutilize dental services. Acceptability research may assist in health care planning and resource allocation by identifying patient preferences among efficacious treatments with the goal of improving their utilization. The purposes of this study were (a) to develop a culturally competent acceptability assessment instrument, directed toward the caregivers of young Hispanic children, for five preventive dental treatments for ECC and (b) to test the instrument's reliability and validity. Methods An instrument of five standard treatments known to prevent ECC was developed, translated, reviewed by focus groups, and pilot tested, then tested for reliability. The instrument included illustrated cards, brief video clips, and samples of the treatments and was culturally appropriate for low-income Hispanic caregivers. In addition to determining the acceptability of the five treatments individually, the treatments were also presented as paired comparisons. Results Focus groups and debriefing interviews following the pilot tests established that the instrument has good face validity. The illustrated cards, product samples, and video demonstrations of the five treatments resulted in an instrument possessing good content validity. The instrument has good to excellent test–retest reliability, with identical time 1–time 2 responses for each of the five treatments 92 percent of the time (range 87 to 97 percent), and the same treatment of the paired comparisons preferred 75 percent of the time (range 61 to 90 percent). Conclusions The acceptability instrument described is reliable and valid and may be useful in program planning efforts to identify and increase the utilization of preferred ECC preventive treatments for target populations. PMID:18662256

Teaching Critical Appraisal of Articles on Psychopharmacology

ERIC Educational Resources Information Center

Mohr, Pavel; Hoschl, Cyril; Volavka, Jan

2012-01-01

Objective: Psychiatrists and other physicians sometimes read publications superficially, relying excessively on abstracts. The authors addressed this problem by teaching critical appraisal of individual articles. Method: The authors developed a 23-item appraisal instrument to assess articles in the area of psychopharmacology. The results were…

Beyond Instrumental Literacy: Discourse Ethics and Literacy Education.

ERIC Educational Resources Information Center

Endres, Benjamin J.

Literacy education concerns itself with assessing student needs and determining the appropriate methods for meeting them, without considering the ethical framework in which those "needs" find meaning. This paper argues that a notion of reflective communication, based on Jurgen Habermas's theory of "Discourse," provides an…

Factors Associated with Physical Activity Literacy among Foster Parents

ERIC Educational Resources Information Center

Dominick, Gregory M.; Friedman, Daniela B.; Saunders, Ruth P.; Hussey, Jim R.; Watkins, Ken W.; W.

2012-01-01

Objectives: To explore associations between physical activity (PA) literacy and psychosocial constructs for providing instrumental social support for youth PA. Methods: Ninety-one foster parents completed surveys assessing PA literacy (overall and specific), perceptions of child PA, coordination, PA enjoyment, psychosocial variables:…

Reliability of Speech Diadochokinetic Test Measurement

ERIC Educational Resources Information Center

Gadesmann, Miriam; Miller, Nick

2008-01-01

Background: Measures of articulatory diadochokinesis (DDK) are widely used in the assessment of motor speech disorders and they play a role in detecting abnormality, monitoring speech performance changes and classifying syndromes. Although in clinical practice DDK is generally measured perceptually, without support from instrumental methods that…

Focusing on Student Academic Outcomes. A Working Paper.

ERIC Educational Resources Information Center

Alexander, Joanne M.; Stark, Joan S.

Current methods and instruments for assessing college student academic outcomes are identified and described, and possible outcome measures of NCRIPTAL's (National Center for Research to Improve Postsecondary Teaching and Learning) are suggested. Section I defines college outcomes from several perspectives, including pressures for outcome…

Forty-two systematic reviews generated 23 items for assessing the risk of bias in values and preferences' studies.

PubMed

Yepes-Nuñez, Juan Jose; Zhang, Yuan; Xie, Feng; Alonso-Coello, Pablo; Selva, Anna; Schünemann, Holger; Guyatt, Gordon

2017-05-01

In systematic reviews of studies of patients' values and preferences, the objective of the study was to summarize items and domains authors have identified when considering the risk of bias (RoB) associated with primary studies. We conducted a systematic survey of systematic reviews of patients' values and preference studies. Our search included three databases (MEDLINE, EMBASE, and PsycINFO) from their inception to August 2015. We conducted duplicate data extraction, focusing on items that authors used to address RoB in the primary studies included in their reviews and the associated underlying domains, and summarized criteria in descriptive tables. We identified 42 eligible systematic reviews that addressed 23 items relevant to RoB and grouped the items into 7 domains: appropriate administration of instrument; instrument choice; instrument-described health state presentation; choice of participants group; description, analysis, and presentation of methods and results; patient understanding; and subgroup analysis. The items and domains identified provide insight into issues of RoB in patients' values and preference studies and establish the basis for an instrument to assess RoB in such studies. Copyright © 2017 Elsevier Inc. All rights reserved.

Students’ Impression towards Science Virtual Test (SVT) on Digestive System Topic

NASA Astrophysics Data System (ADS)

Mahfira, C.; Sanjaya, Y.; Rusyati, L.

2018-05-01

During the past few years, technology has significantly support the improvements in assessment.Computer-based test (CBT) comes up as a new type of assessment which offers many benefits. The implementation of computer-based test in term of students’ perspective gives rise to numbers of mixed reactions. Students’ impression is one of the essential things for the implementation of SVT. The purpose of this study was to investigate the impression of students toward SVT. The method used in this research was descriptive method. The participant was 98 students from Junior High School “X” in East Bandung. Students’ impression questionnaire was used as the instrument. There are four aspects tested in this instrument which are students’ experience, technical activity, preference and media of SVT. The result shows that SVT generally gives positive impression to students. Students have a positive experience and did not encounter significant problem when implementing SVT. Students prefer to use SVT and students think the media of SVT is already good.

Evidence-based Assessment of Coping and Stress in Pediatric Psychology

PubMed Central

Simons, Laura E.; Devine, Katie A.; Jaaniste, Tiina; Cohen, Lindsey L.; Chambers, Christine T.; Hayutin, Lisa G.

2008-01-01

Objective To review selected measures of stress and coping in pediatric populations. Stress and coping are presented within a risk and resiliency framework. Methods The Society of Pediatric Psychology (SPP) surveyed the membership to identify the most frequently used assessment instruments. Twelve measures of coping and three measures of stress were reviewed. These instruments were evaluated using the Stress and Coping workgroup's modification of the criteria developed by the SPP Assessment Task Force (SPP-ATF). Results One of the three measures of stress and five of the 12 measures of coping were Well-established measures that broaden understanding. Additionally, one of the coping measures was categorized as a Well-established measure that guides treatment. Merits of the individual measures are discussed. Conclusions Recommendations for future research are provided, including suggestions for the construction and use of measures to inform treatment research. PMID:17938147

Comparison of measuring instruments for radiofrequency radiation from mobile telephones in epidemiological studies: implications for exposure assessment.

PubMed

Inyang, Imo; Benke, Geza; McKenzie, Ray; Abramson, Michael

2008-03-01

The debate on mobile telephone safety continues. Most epidemiological studies investigating health effects of radiofrequency (RF) radiation emitted by mobile phone handsets have been criticised for poor exposure assessment. Most of these studies relied on the historical reconstruction of participants' phone use by questionnaires. Such exposure assessment methods are prone to recall bias resulting in misclassification that may lead to conflicting conclusions. Although there have been some studies using software-modified phones (SMP) for exposure assessment in the literature, until now there is no published work on the use of hardware modified phones (HMPs) or RF dosimeters for studies of mobile phones and health outcomes. We reviewed existing literature on mobile phone epidemiology with particular attention to exposure assessment methods used. Owing to the inherent limitations of these assessment methods, we suggest that the use of HMPs may show promise for more accurate exposure assessment of RF radiation from mobile phones.

A Reliability and Validity of an Instrument to Evaluate the School-Based Assessment System: A Pilot Study

ERIC Educational Resources Information Center

Ghazali, Nor Hasnida Md

2016-01-01

A valid, reliable and practical instrument is needed to evaluate the implementation of the school-based assessment (SBA) system. The aim of this study is to develop and assess the validity and reliability of an instrument to measure the perception of teachers towards the SBA implementation in schools. The instrument is developed based on a…

Bicultural identity among economical migrants from three south European countries living in Switzerland. Adaptation and validation of a new psychometric instrument

PubMed Central

Eytan, Ariel; Jene-Petschen, Nuria; Gex-Fabry, Marianne

2007-01-01

Background Acculturation is one of the determinants of mental health among immigrants. Evaluating adaptation to the host culture is insufficient, since immigrants will develop various degrees of bi- or multicultural identity. However, mental health professionals lack simple and easy to use instruments to guide them with bicultural identity evaluation in their practice. Our aim was to develop such an instrument to be used for clinical purposes among economical migrants from three South European countries living in Geneva, Switzerland. Methods We adapted from existing instruments a 24 item bi-dimensional scale to assess involvement in both culture of origin and host culture. The study included 93 immigrant adults from three south European countries (Italy, Portugal and Spain). Thirty-eight patients were recruited in an outpatient treatment program for alcohol-related problems and 55 participants were hospital employees. Results The questionnaire was rated as easy or rather easy by 97.8% of participants. Median time to complete it was 5 minutes. The instrument allowed discriminating between patients and healthy subjects, with scores for Swiss culture significantly higher among hospital workers. The subscales related to culture of origin and host culture displayed adequate internal consistency (Cronbach's alpha 0.77 and 0.73 respectively). Conclusion It is possible to assist clinicians' assessment of cultural identity of Italian, Portuguese and Spanish economical immigrants in Switzerland with a single and easy to use instrument. PMID:17490478

Instruments used to assess functional limitations in workers applying for disability benefit: a systematic review.

PubMed

Spanjer, Jerry; Groothoff, Johan W; Brouwer, Sandra

2011-01-01

To systematically review the quality of the psychometric properties of instruments for assessing functional limitations in workers applying for disability benefit. Electronic searches of Medline, Embase, CINAHL and PsycINFO were performed to identify studies focusing on the psychometric properties of instruments used to assess functional limitations in workers' compensation claimants. Two independent reviewers applied the inclusion criteria to select relevant articles and then evaluated the psychometric qualities of the instruments found. Of the 712 articles that were identified, 10 studies met the inclusion criteria, reporting on four instruments: the Roland-Morris Disability Questionnaire (RMDQ), the Patient-Specific Functional Scale (PSFS), the Isernhagen Work System (IWS) and the Multiperspective Multidimensional Pain Assessment Protocol (MMPAP). The questionnaires (RMDQ and PSFS) did not focus specifically on the work situation and measured three to eight functional limitations. The psychometric qualities of the IWS were poor to moderate. For the MMPAP, only predictive validity was measured. The instruments assessed a range varying between 3 and 34 physical functional limitations. No instruments were found for assessing mental limitations in workers' compensation claimants. Studies on four instruments specifically focusing on assessing physical functional limitations in workers applying for disability benefit were found. All four instruments have limitations regarding their psychometric qualities or contents. Since the RMDQ has the best demonstrated psychometric qualities and takes little time to complete it, we recommend the RMDQ for clinicians in rehabilitation. For the assessment of functional limitations in workers applying for disability benefit a combination of questionnaires, performance tests or interviews together with the judgment by physicians looks the most promising.

Therapeutic risk management of the suicidal patient: augmenting clinical suicide risk assessment with structured instruments.

PubMed

Homaifar, Beeta; Matarazzo, Bridget; Wortzel, Hal S

2013-09-01

This column is the second in a series presenting a model for therapeutic risk management of the suicidal patient. As discussed in the first part of the series, the model involves several elements including augmenting clinical risk assessment with structured instruments, stratifying risk in terms of both severity and temporality, and developing and documenting a safety plan. This column explores in more detail how to augment clinical risk assessment with structured instruments. Unstructured clinical interviews have the potential to miss important aspects of suicide risk assessment. By augmenting the free-form clinical interview with structured instruments that demonstrate reliability and validity, a more nuanced and multifaceted approach to suicide risk assessment is achieved. Incorporating structured instruments into practice also serves a medicolegal function, since these instruments may become a living part of the medical record, establishing baseline levels of suicidal thoughts and behaviors and facilitating future clinical determinations regarding safety needs. We describe several instruments used in a multidisciplinary suicide consultation service, each of which has demonstrated relevance to suicide risk assessment and screening, ease of administration, and strong psychometric properties. In addition, we emphasize the importance of viewing suicide risk assessment as an ongoing process rather than as a singular event. Finally, we discuss special considerations in the evolving practice of risk assessment.

Improving Measurement Efficiency of the Inner EAR Scale with Item Response Theory.

PubMed

Jessen, Annika; Ho, Andrew D; Corrales, C Eduardo; Yueh, Bevan; Shin, Jennifer J

2018-02-01

Objectives (1) To assess the 11-item Inner Effectiveness of Auditory Rehabilitation (Inner EAR) instrument with item response theory (IRT). (2) To determine whether the underlying latent ability could also be accurately represented by a subset of the items for use in high-volume clinical scenarios. (3) To determine whether the Inner EAR instrument correlates with pure tone thresholds and word recognition scores. Design IRT evaluation of prospective cohort data. Setting Tertiary care academic ambulatory otolaryngology clinic. Subjects and Methods Modern psychometric methods, including factor analysis and IRT, were used to assess unidimensionality and item properties. Regression methods were used to assess prediction of word recognition and pure tone audiometry scores. Results The Inner EAR scale is unidimensional, and items varied in their location and information. Information parameter estimates ranged from 1.63 to 4.52, with higher values indicating more useful items. The IRT model provided a basis for identifying 2 sets of items with relatively lower information parameters. Item information functions demonstrated which items added insubstantial value over and above other items and were removed in stages, creating a 8- and 3-item Inner EAR scale for more efficient assessment. The 8-item version accurately reflected the underlying construct. All versions correlated moderately with word recognition scores and pure tone averages. Conclusion The 11-, 8-, and 3-item versions of the Inner EAR scale have strong psychometric properties, and there is correlational validity evidence for the observed scores. Modern psychometric methods can help streamline care delivery by maximizing relevant information per item administered.

Development and Psychometric Properties of a Tuberculosis-Specific Multidimensional Health-Related Quality-of-Life Measure for Patients with Pulmonary Tuberculosis.

PubMed

Abdulelah, Juman; Sulaiman, Syed Azhar Syed; Hassali, Mohamed A; Blebil, Ali Q; Awaisu, Ahmed; Bredle, Jason M

2015-05-01

Various generic instruments exist to assess health-related quality of life (HRQOL) in patients with tuberculosis (TB), but a psychometrically sound disease-specific instrument is lacking. The present study aimed to develop and psychometrically validate a multidimensional TB-specific HRQOL instrument relevant to the value of patients with pulmonary TB in Iraq with an eye toward cross-cultural application. The core general HRQOL questionnaire is composed of the Functional Assessment of Cancer Therapy-General items. A modular approach was followed for the development of the Functional Assessment of Chronic Illness Therapy-Tuberculosis (FACIT-TB) questionnaire in which a set of items assessing quality-of-life (QOL) issues not sufficiently covered by the core Functional Assessment of Cancer Therapy-General items, but considered to be relevant to the target population, was added. Moreover, principal-component analysis was used to determine the new subscale structure of the questionnaire. In addition to the 27 items of the core questionnaire, a set of 20 items referring to disease symptoms related to the site of infection, adverse effects, and additional QOL dimensions such as fatigue, social stigma, and economic burden of the illness was included. Factor analysis demonstrated that the FACIT-TB construct comprised five domains. A rigorous method was applied in the development of the FACIT-TB measure to fully understand the impact of TB on patients' QOL. The instrument is psychometrically sound and portrays multiple important dimensions of HRQOL. FACIT-TB is relatively brief, is easy to administer and score, and is appropriate for use in clinical trials and practice. Copyright © 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Identification of an Adaptable Computer Program Design for Analyzing a Modular Organizational Assessment Instrument.

DTIC Science & Technology

1981-09-01

ber) Survey-guided development Organizational effectiveness Computer program Organizational diagnosis Management 20. ABSTRACT (Continue an reverse...Army. Doctoral dissertation, Purdue University, December 1977. (DTIC AD-A059-542) Bowers, D. G. Organizational diagnosis : A review and a proposed method...G. E. Compara- tive issues and methods in organizational diagnosis . Ann Arbor MI: Institute for Social Research, University of Michigan, November 1977

Ergonomics diagnosis components in rehabilitation: statistical evaluation of an assessment instrument.

PubMed

Landau, K; Meschke, H; Brauchler, R; Kiesel, J; Knoerzer, J

2007-11-01

The current paper examines an assessment instrument used for combined medical and occupational rehabilitation (MOR) in a group of German hospitals. Patients with a history of musculo-skeletal disease make up a significant proportion of those undergoing rehabilitation. Scale and factor structures, discriminant factors and clustering procedures used in the Bavaria rehabilitation patient assessment method (BRPAM) are investigated in a cross-sectional study involving a sample of 800 patients. Although the results reveal good correlation between differences in the job demand/patient capability profiles and the typical stresses to which the relevant occupation is exposed, analyses also indicate that several factors and items are unstable. According to subjective assessment by the patients, the therapeutic objectives are fully attained in some 80% of cases. Discrepancies between job demands and patient capability revealed by the BRPAM yield pointers to choice of therapy and its chances of success, but these need to be examined in greater detail in long-term studies.

Validity and reliability of wii fit balance board for the assessment of balance of healthy young adults and the elderly.

PubMed

Chang, Wen-Dien; Chang, Wan-Yi; Lee, Chia-Lun; Feng, Chi-Yen

2013-10-01

[Purpose] Balance is an integral part of human ability. The smart balance master system (SBM) is a balance test instrument with good reliability and validity, but it is expensive. Therefore, we modified a Wii Fit balance board, which is a convenient balance assessment tool, and analyzed its reliability and validity. [Subjects and Methods] We recruited 20 healthy young adults and 20 elderly people, and administered 3 balance tests. The correlation coefficient and intraclass correlation of both instruments were analyzed. [Results] There were no statistically significant differences in the 3 tests between the Wii Fit balance board and the SBM. The Wii Fit balance board had a good intraclass correlation (0.86-0.99) for the elderly people and positive correlations (r = 0.58-0.86) with the SBM. [Conclusions] The Wii Fit balance board is a balance assessment tool with good reliability and high validity for elderly people, and we recommend it as an alternative tool for assessing balance ability.

The European Society of Human Reproduction and Embryology guideline for the diagnosis and treatment of endometriosis: an electronic guideline implementability appraisal

PubMed Central

2011-01-01

Background Clinical guidelines are intended to improve healthcare. However, even if guidelines are excellent, their implementation is not assured. In subfertility care, the European Society of Human Reproduction and Embryology (ESHRE) guidelines have been inventoried, and their methodological quality has been assessed. To improve the impact of the ESHRE guidelines and to improve European subfertility care, it is important to optimise the implementability of guidelines. We therefore investigated the implementation barriers of the ESHRE guideline with the best methodological quality and evaluated the used instrument for usability and feasibility. Methods We reviewed the ESHRE guideline for the diagnosis and treatment of endometriosis to assess its implementability. We used an electronic version of the guideline implementability appraisal (eGLIA) instrument. This eGLIA tool consists of 31 questions grouped into 10 dimensions. Seven items address the guideline as a whole, and 24 items assess the individual recommendations in the guideline. The eGLIA instrument identifies factors that influence the implementability of the guideline recommendations. These factors can be divided into facilitators that promote implementation and barriers that oppose implementation. A panel of 10 experts from three European countries appraised all 36 recommendations of the guideline. They discussed discrepancies in a teleconference and completed a questionnaire to evaluate the ease of use and overall utility of the eGLIA instrument. Results Two of the 36 guideline recommendations were straightforward to implement. Five recommendations were considered simply statements because they contained no actions. The remaining 29 recommendations were implementable with some adjustments. We found facilitators of the guideline implementability in the quality of decidability, presentation and formatting, apparent validity, and novelty or innovation of the recommendations. Vaguely defined actions, lack of facilities, immeasurable outcomes, and inflexibility within the recommendations formed barriers to implementation. The eGLIA instrument was generally useful and easy to use. However, assessment with the eGLIA instrument is very time-consuming. Conclusions The ESHRE guideline for the diagnosis and treatment of endometriosis could be improved to facilitate its implementation in daily practice. The eGLIA instrument is a helpful tool for identifying obstacles to implementation of a guideline. However, we recommend a concise version of this instrument. PMID:21247418

Psychomotor skills assessment by motion analysis in minimally invasive surgery on an animal organ.

PubMed

Hofstad, Erlend Fagertun; Våpenstad, Cecilie; Bø, Lars Eirik; Langø, Thomas; Kuhry, Esther; Mårvik, Ronald

2017-08-01

A high level of psychomotor skills is required to perform minimally invasive surgery (MIS) safely. To be able to measure these skills is important in the assessment of surgeons, as it enables constructive feedback during training. The aim of this study was to test the validity of an objective and automatic assessment method using motion analysis during a laparoscopic procedure on an animal organ. Experienced surgeons in laparoscopy (experts) and medical students (novices) performed a cholecystectomy on a porcine liver box model. The motions of the surgical tools were acquired and analyzed by 11 different motion-related metrics, i.e., a total of 19 metrics as eight of them were measured separately for each hand. We identified for which of the metrics the experts outperformed the novices. In total, two experts and 28 novices were included. The experts achieved significantly better results for 13 of the 19 instrument motion metrics. Expert performance is characterized by a low time to complete the cholecystectomy, high bimanual dexterity (instrument coordination), a limited amount of movement and low measurement of motion smoothness of the dissection instrument, and relatively high usage of the grasper to optimize tissue positioning for dissection.

Inter-laboratory verification of European pharmacopoeia monograph on derivative spectrophotometry method and its application for chitosan hydrochloride.

PubMed

Marković, Bojan; Ignjatović, Janko; Vujadinović, Mirjana; Savić, Vedrana; Vladimirov, Sote; Karljiković-Rajić, Katarina

2015-01-01

Inter-laboratory verification of European pharmacopoeia (EP) monograph on derivative spectrophotometry (DS) method and its application for chitosan hydrochloride was carried out on two generation of instruments (earlier GBC Cintra 20 and current technology TS Evolution 300). Instruments operate with different versions of Savitzky-Golay algorithm and modes of generating digital derivative spectra. For resolution power parameter, defined as the amplitude ratio A/B in DS method EP monograph, comparable results were obtained only with algorithm's parameters smoothing points (SP) 7 and the 2nd degree polynomial and those provided corresponding data with other two modes on TS Evolution 300 Medium digital indirect and Medium digital direct. Using quoted algorithm's parameters, the differences in percentages between the amplitude ratio A/B averages, were within accepted criteria (±3%) for assay of drug product for method transfer. The deviation of 1.76% for the degree of deacetylation assessment of chitosan hydrochloride, determined on two instruments, (amplitude (1)D202; the 2nd degree polynomial and SP 9 in Savitzky-Golay algorithm), was acceptable, since it was within allowed criteria (±2%) for assay deviation of drug substance, for method transfer in pharmaceutical analyses. Copyright © 2015 Elsevier B.V. All rights reserved.

Assessment of Work Performance (AWP)--development of an instrument.

PubMed

Sandqvist, Jan L; Törnquist, Kristina B; Henriksson, Chris M

2006-01-01

Adequate work assessments are a matter of importance both for individuals and society [5,29,31,38,40,46,52]. However, there is a lack of adequate and reliable instruments for use in work rehabilitation [14,15,20,21,31,44]. The purpose of this study was to develop and evaluate an observation instrument for assessing work performance, the AWP (Assessment of Work Performance). The purpose of the 14-item instrument is to assess the individual's observable working skills in three different areas: motor skills, process skills, and communication and interaction skills. This article describes the development and results of preliminary testing of the AWP. The testing indicates a satisfactory face validity and utility for the AWP and supports further research and testing of the instrument.

An assessment of the Standardized Assessment of Personality as a screening instrument for the International Personality Disorder Examination: a comparison of informant and patient assessment for personality disorder.

PubMed

Mann, A H; Raven, P; Pilgrim, J; Khanna, S; Velayudham, A; Suresh, K P; Channabasavanna, S M; Janca, A; Sartorius, N

1999-07-01

The International Personality Disorder Examination (IPDE) has been developed as a standardized interview for personality disorders. While it has good psychometric properties, its length makes it difficult to use in the community in population research, particularly outside psychiatric settings. The informant-based Standard Assessment of Personality (SAP), which has been in use since 1981, could serve as a valid screen to detect likely personality disordered individuals who would then receive a definitive diagnosis by IPDE. This study aimed to compare the two instruments in their capacity to detect personality disorder according to ICD-10 taxonomy and to estimate the efficiency of the use of the two together in a case-finding exercise. Ninety psychiatric out-patients in Bangalore, India, were assessed for personality disorder using the two methods. Assessment was conducted by a pair of trained interviewers in random order and by random allocation to interviewer. Overall agreement between the two instruments in the detection of ICD-10 personality disorder was modest (kappa = 0.4). The level of agreement varied according to personality category, ranging from kappa 0.66 (dependent) to kappa 0.09 (dyssocial). The SAP proved to have a high negative predictive value (97%) for IPDE as the gold standard, suggesting its potential as a screen in samples where the expected prevalence of personality disorder is low. A two-stage approach to epidemiological studies of personality disorder may be practicable.

Validity and reliability of the multidimensional assessment of fatigue scale in Iranian patients with relapsing-remitting subtype of multiple sclerosis.

PubMed

Behrangrad, Shabnam; Kordi Yoosefinejad, Amin

2018-03-01

The purpose of this study is to investigate the validity and reliability of the Persian version of the Multidimensional Assessment of Fatigue Scale (MAFS) in an Iranian population with multiple sclerosis. A self-reported survey on fatigue including the MAFS, Fatigue Impact Scale and demographic measures was completed by 130 patients with multiple sclerosis and 60 healthy persons sampled with a convenience method. Test-retest reliability and validity were evaluated 3 days apart. Construct validity of the MAFS was assessed with the Fatigue Impact Scale. The MAFS had high internal consistency (Cronbach's alpha >0.9) and 3-d test-retest reliability (intraclass correlation coefficient = 0.99). Correlation between the Fatigue Impact Scale and MAFS was high (r = 0.99). Correlation between MAFS scores and the Expanded Disability Status Scale was also strong (r = 0.85). Questionnaire items showed acceptable item-scale correlation (0.968-0.993). The Persian version of the MAFS appears to be a valid and reliable questionnaire. It is an appropriate short multidimensional instrument to assess fatigue in patients with multiple sclerosis in clinical practice and research. Implications for Rehabilitation The Persian version of Multidimensional Assessment of Fatigue is a valid and reliable instrument for the assessment and monitoring the fatigue in Persian-language patients with multiple sclerosis. It is very easy to administer and a time efficient scale in comparison to other instruments evaluating fatigue in patients with multiple sclerosis.

The quality of evidence of psychometric properties of three-dimensional spinal posture-measuring instruments

PubMed Central

2011-01-01

Background Psychometric properties include validity, reliability and sensitivity to change. Establishing the psychometric properties of an instrument which measures three-dimensional human posture are essential prior to applying it in clinical practice or research. Methods This paper reports the findings of a systematic literature review which aimed to 1) identify non-invasive three-dimensional (3D) human posture-measuring instruments; and 2) assess the quality of reporting of the methodological procedures undertaken to establish their psychometric properties, using a purpose-build critical appraisal tool. Results Seventeen instruments were identified, of which nine were supported by research into psychometric properties. Eleven and six papers respectively, reported on validity and reliability testing. Rater qualification and reference standards were generally poorly addressed, and there was variable quality reporting of rater blinding and statistical analysis. Conclusions There is a lack of current research to establish the psychometric properties of non-invasive 3D human posture-measuring instruments. PMID:21569486

The application of a handheld personal digital assistant with camera and mobile phone card (Wellnavi) to the general population in a dietary survey.

PubMed

Kikunaga, Shigeshi; Tin, Tomoe; Ishibashi, Genji; Wang, Da-Hong; Kira, Shohei

2007-04-01

This study was carried out to examine first, the validity of a new dietary assessment method, a handheld personal digital assistant with camera and mobile phone card (Wellnavi), in comparison with a weighed diet record as a reference method and second, the relation between obesity and underreporting in the Wellnavi method in 27 men and 48 women volunteers aged 30-67 y from the general population. On the validity, there were significant correlations (0.32-0.75) between the daily nutrient intakes measured by the Wellnavi method and the weighed diet record method in all the subjects except for some nutrients such as iron, magnesium and vitamin E. Results similar to those from the group of all the subjects were obtained in the men's group and the women's group. In all the subjects and the men's group and the women's group, the differences in the daily nutrient intakes between the two dietary assessment methods were statistically significant. However, good agreement of the differences between the two dietary assessment methods for many daily nutrient intakes was obtained in the nonobese men. The nutrient intakes estimated by the Wellnavi method in all the subjects and the men's group and the women's group were significantly lower than those values estimated by the weighed diet record method except for some nutrients such as sodium, iron and fat-soluble vitamins. With respect to the relation between obesity and underreporting, the obesity in women was not a factor of underreporting in the Wellnavi method, but the presence of this relation was undeniable in the obese men. The reason why the values of daily nutrient intakes in the Wellnavi method were lower than those estimated by the weighed diet record method seemed to be the low quality of the digital photo of the Wellnavi instrument. By improving the digital photo quality of this instrument, the Wellnavi method could become a useful new dietary assessment method to get accurate dietary information from people of a wide range of age and occupation, and a wide variety of physical situations of subjects from the general population.

Core data elements tracking elder sexual abuse.

PubMed

Hanrahan, Nancy P; Burgess, Ann W; Gerolamo, Angela M

2005-05-01

Sexual abuse in the older adult population is an understudied vector of violent crimes with significant physical and psychological consequences for victims and families. Research requires a theoretical framework that delineates core elements using a standardized instrument. To develop a conceptual framework and identify core data elements specific to the older adult population, clinical, administrative, and criminal experts were consulted using a nominal group method to revise an existing sexual assault instrument. The revised instrument could be used to establish a national database of elder sexual abuse. The database could become a standard reference to guide the detection, assessment, and prosecution of elder sexual abuse crimes as well as build a base from which policy makers could plan and evaluate interventions that targeted risk factors.

To evaluate the influence of smear layer with different instruments and obturation methods on microleakage of root canal filled teeth: In vitro study.

PubMed

Likhitkar, Manoj S; Kulkarni, Shantaram V; Burande, Aravind; Solanke, Vishal; Kumar, C Sushil; Kamble, Babasaheb

2016-01-01

The success of root canal treatment depends on proper debridement, instrumentation, proper accessibility, and proper restoration. The presence of a smear layer is considered to be a significant factor. This in vitro study was conducted to assess the effect of the presence/absence of a smear layer on the microleakage of root canal filled teeth using different instruments and obturation methods. One hundred extracted mandibular premolars with closed apices and single roots were chosen and then divided into six groups, A to F, consisting of 15 teeth each. The control group included 10 teeth; 5 positive and 5 negative. The teeth were decoronated at the cementoenamel junction. Groups A, B, C, and D were instrumented with engine-driven rotary Protaper NiTi files. Groups E and F were instrumented with conventional stainless steel hand files. Groups A, C, and E were flushed with 3 ml of 17% EDTA to remove the smear layer prior to obturation. All teeth were flushed with 5.25% sodium hypochlorite solution and obturated with AH-Plus sealer with lateral condensation technique for Groups C, D, E, F and with thermoplasticized gutta-percha technique for Groups A and B. Using an electrochemical technique, leakages in the obturated canals were assessed for 45 days. The results were tabulated using Student's t-test (paired and unpaired t-test) with the Statistical Package for the Social Sciences Software Version 21 (IBM Company, New York, USA). Group A showed the lowest mean value at intervals of 10, 20, 30, and 45 days. There was no current flow in the negative controls during the test period. There was leakage in the positive controls within a few minutes of immersion. The results showed that rotary instrumentation contributed toward an exceptional preparation of root canals compared to hand instrumentation. Elimination of the smear layer enhanced the resistance to microleakage; thermoplasticized gutta-percha obturation technique produced a better seal compared to the lateral condensation technique.

Predicting cotton stelometer fiber strength by fourier transform infrared spectroscopy

USDA-ARS?s Scientific Manuscript database

The strength of cotton fibers is one of several important end-use characteristics. In routine programs, it has been mostly assessed by automation-oriented high volume instrument (HVI) system. An alternative method for cotton strength is near infrared (NIR) spectroscopy. Although previous NIR models ...

A Validation Study of the "School Leader Dispositions Inventory"[C

ERIC Educational Resources Information Center

Melton, Teri Denlea; Tysinger, Dawn; Mallory, Barbara; Green, James

2011-01-01

Although university-based school administrator preparation programs are required by accreditation agencies to assess the dispositions of candidates, valid and reliable methods for doing so remain scarce. "The School Leaders Disposition Inventory"[C] (SDLI) is proposed as an instrument that has promise for identifying leadership…

Inclusive Education at Primary Level: Reality or Phantasm

ERIC Educational Resources Information Center

Khan, Itfaq Khaliq; Behlol, Malik Ghulam

2014-01-01

The objectives of this study were to assess the impacts of Inclusive Education (IE) Project implemented in government schools of Islamabad and anticipate its practicability for public schools. Quantitative and qualitative methods were applied for data collection. Study instruments were structured interviews, unstructured focus group discussions,…

Evaluation of the sounding rod method for sampling coarse riverbed sediments in non-wadeable streams and rivers

EPA Science Inventory

The substrate of fluvial systems is regularly characterized as part of a larger physical habitat assessment. Beyond contributing to a basic scientific understanding of fluvial systems, these measures are instrumental in meeting the regulatory responsibilities of bioassessment and...

Use of mass spectrometry coupled with a solids insertion probe to prescreen soil samples for environmental samples

DOE Office of Scientific and Technical Information (OSTI.GOV)

Check, C.E.; Bach, S.B.H.

1995-12-31

The contamination of air, water, and soils by a myriad of sources generates a large sample Currently, sample volume for hazardous constituent analyses is approximately half a million samples per year. The total analytical costs associated with this are astronomical. The analysis of these samples is vital in terms of assessing the types of contamination present and to what degree a site has been contaminated. The results of these analyses are very important for making an informed, knowledgeable decision as to the need for remediation and what type of remediation processes should be initiated based on site suitability vs non-actionmore » for the various sample sites. With an ever growing environmental consciousness in today`s society, the assessment and subsequent remediation of a site needs to be accomplished promptly despite the time constraints traditional methods place on such actions. In order to facilitate a rapid assessment, it is desirable to utilize instrumentation and equipment which afford the most information about a site allowing for optimization in environmental assessment while maintaining a realistic time schedule for the resulting remediation process. Because there are various types of environmental samples that can be taken at a site, different combinations of instrumentation and methods are required for assessing the level and type of contamination present whether it is in air, water, or soils. This study is limited to analyzing soil-like media that would normally fall under EPA Method 8270 which is used to analyze solid waste matrices, soils, and groundwater for semi-volatile organic compounds.« less

Functional leg length discrepancy between theories and reliable instrumental assessment: a study about newly invented NPoS system

PubMed Central

Mahmoud, Asmaa; Abundo, Paolo; Basile, Luisanna; Albensi, Caterina; Marasco, Morena; Bellizzi, Letizia; Galasso, Franco; Foti, Calogero

2017-01-01

Summary Background In spite the instinct social&financial impact of Leg Length Discrepancy (LLD), controversial and conflicting results still exist regarding a reliable assessment/correction method. For proper management it’s essential to discriminate between anatomical&functional Leg Length Discrepancy (FLLD). With the newly invented NPoS (New Postural Solution), under the umbrella of the collaboration of PRM Department, Tor Vergata University with Baro Postural Instruments srl, positive results were observed in both measuring& compensating the hemi-pelvic antero-medial rotation in FLLD through personalized bilateral heel raise using two NPoS components: Foot Image System (FIS) and Postural Optimizer System (POS). This led our research interest to test the validity of NPoS as a preliminary step before evaluating its implementations in postural disorders. Methods After clinical evaluation, 4 subjects with FLLD have been assessed by NPoS. Over a period of 2 months, every subject was evaluated 12 times by two different operators, 48 measurements in total, results have been verified in correlation to BTS GaitLab results. Results Intra-Operator&inter-operator variability analysis showed statistically insignificant differences, while inter-method variability between NPoS and BTS parameters expressed a linear correlation. Conclusion Results suggest a significant validity of NPoS in assessment&correction of FLLD, with high degree of reproducibility with minimal operator dependency. This can be considered a base for promising clinical implications of NPoS as a reliable cost effective postural assessment/corrective tool. Level of evidence V. PMID:29264341

Measuring pediatric hematology-oncology fellows' skills in humanism and professionalism: A novel assessment instrument.

PubMed

Kesselheim, Jennifer C; Agrawal, Anurag K; Bhatia, Nita; Cronin, Angel; Jubran, Rima; Kent, Paul; Kersun, Leslie; Rao, Amulya Nageswara; Rose, Melissa; Savelli, Stephanie; Sharma, Mukta; Shereck, Evan; Twist, Clare J; Wang, Michael

2017-05-01

Educators in pediatric hematology-oncology lack rigorously developed instruments to assess fellows' skills in humanism and professionalism. We developed a novel 15-item self-assessment instrument to address this gap in fellowship training. Fellows (N = 122) were asked to assess their skills in five domains: balancing competing demands of fellowship, caring for the dying patient, confronting depression and burnout, responding to challenging relationships with patients, and practicing humanistic medicine. An expert focus group predefined threshold scores on the instrument that could be used as a cutoff to identify fellows who need support. Reliability and feasibility were assessed and concurrent validity was measured using three established instruments: Maslach Burnout Inventory (MBI), Flourishing Scale (FS), and Jefferson Scale of Physician Empathy (JSPE). For 90 participating fellows (74%), the self-assessment proved feasible to administer and had high internal consistency reliability (Cronbach's α = 0.81). It was moderately correlated with the FS and MBI (Pearson's r = 0.41 and 0.4, respectively) and weakly correlated with the JSPE (Pearson's r = 0.15). Twenty-eight fellows (31%) were identified as needing support. The self-assessment had a sensitivity of 50% (95% confidence interval [CI]: 31-69) and a specificity of 77% (95% CI: 65-87) for identifying fellows who scored poorly on at least one of the three established scales. We developed a novel assessment instrument for use in pediatric fellowship training. The new scale proved feasible and demonstrated internal consistency reliability. Its moderate correlation with other established instruments shows that the novel assessment instrument provides unique, nonredundant information as compared to existing scales. © 2016 Wiley Periodicals, Inc.

The Pediatrics Milestones Assessment Pilot: Development of Workplace-Based Assessment Content, Instruments, and Processes.

PubMed

Hicks, Patricia J; Margolis, Melissa; Poynter, Sue E; Chaffinch, Christa; Tenney-Soeiro, Rebecca; Turner, Teri L; Waggoner-Fountain, Linda; Lockridge, Robin; Clyman, Stephen G; Schwartz, Alan

2016-05-01

To report on the development of content and user feedback regarding the assessment process and utility of the workplace-based assessment instruments of the Pediatrics Milestones Assessment Pilot (PMAP). One multisource feedback instrument and two structured clinical observation instruments were developed and refined by experts in pediatrics and assessment to provide evidence for nine competencies based on the Pediatrics Milestones (PMs) and chosen to inform residency program faculty decisions about learners' readiness to serve as pediatric interns in the inpatient setting. During the 2012-2013 PMAP study, 18 U.S. pediatric residency programs enrolled interns and subinterns. Faculty, residents, nurses, and other observers used the instruments to assess learner performance through direct observation during a one-month rotation. At the end of the rotation, data were aggregated for each learner, milestone levels were assigned using a milestone classification form, and feedback was provided to learners. Learners and site leads were surveyed and/or interviewed about their experience as participants. Across the sites, 2,338 instruments assessing 239 learners were completed by 630 unique observers. Regarding end-of-rotation feedback, 93% of learners (128/137) agreed the assessments and feedback "helped me understand how those with whom I work perceive my performance," and 85% (117/137) agreed they were "useful for constructing future goals or identifying a developmental path." Site leads identified several benefits and challenges to the assessment process. PM-based instruments used in workplace-based assessment provide a meaningful and acceptable approach to collecting evidence of learner competency development. Learners valued feedback provided by PM-based assessment.

Informal Assessment in Reading: Group vs. Individual.

ERIC Educational Resources Information Center

Shipman, Dorothy A.; Warncke, Edna W.

A study was conducted to determine whether informal group assessment instruments could be used effectively to provide the same type of reading achievement information as that secured from informal individual instruments. The researchers developed group instruments comparable to individual instruments, including a group reading inventory for grades…

Counselor Competence, Performance Assessment, and Program Evaluation: Using Psychometric Instruments

ERIC Educational Resources Information Center

Tate, Kevin A.; Bloom, Margaret L.; Tassara, Marcel H.; Caperton, William

2014-01-01

Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

Real-Time Assessment of Mechanical Tissue Trauma in Surgery.

PubMed

Chandler, James H; Mushtaq, Faisal; Moxley-Wyles, Benjamin; West, Nicholas P; Taylor, Gregory W; Culmer, Peter R

2017-10-01

This work presents a method to assess and prevent tissue trauma in real-time during surgery. Tissue trauma occurs routinely during laparoscopic surgery with potentially severe consequences. As such, it is crucial that a surgeon is able to regulate the pressure exerted by surgical instruments. We propose a novel method to assess the onset of tissue trauma by considering the mechanical response of tissue as it is loaded in real-time. We conducted a parametric study using a lab-based grasping model and differing load conditions. Mechanical stress-time data were analyzed to characterize the tissue response to grasps. Qualitative and quantitative histological analyses were performed to inspect damage characteristics of the tissue under different load conditions. These were correlated against the mechanical measures to identify the nature of trauma onset with respect to our predictive metric. Results showed increasing tissue trauma with load and a strong correlation with the mechanical response of the tissue. Load rate and load history also showed a clear effect on tissue response. The proposed method for trauma assessment was effective in identifying damage. The metric can be normalized with respect to loading rate and history, making it feasible in the unconstrained environment of intraoperative surgery. This work demonstrates that tissue trauma can be predicted using mechanical measures in real-time. Applying this technique to laparoscopic tools has the potential to reduce unnecessary tissue trauma and its associated complications by indicating through user feedback or actively regulating the mechanical impact of surgical instruments.

Size response of an SMPS-APS system to commercial multi-walled carbon nanotubes

NASA Astrophysics Data System (ADS)

Lee, Seung-Bok; Lee, Jun-Hyun; Bae, Gwi-Nam

2010-02-01

Carbon nanotubes (CNTs) are representative-engineered nanomaterials with unique properties. The safe production of CNTs urgently requires reliable tools to assess inhalation exposure. In this study, on-line aerosol instruments were employed to detect the release of multi-walled CNTs (MWCNTs) in workplace environments. The size responses of aerosol instruments consisting of both a scanning mobility particle sizer (SMPS) and an aerodynamic particle sizer (APS) were examined using five types of commercial MWCNTs. A MWCNT solution and powder were aerosolized using atomizing and shaking methods, respectively. Regardless of the phase and purity, the aerosolized MWCNTs showed consistent size distributions with both SMPS and APS. The SMPS and APS measurements revealed a dominant broad peak at approximately 200-400 nm and a distinct narrow peak at approximately 2 μm, respectively. Comparing with field application of the two aerosol instruments, the APS response could be a fingerprint of the MWCNTs in a real workplace environment. A modification of the atomizing method is recommended for the long-term inhalation toxicity studies.

Flying Cages in Traveling Wave Ion Mobility: Influence of the Instrumental Parameters on the Topology of the Host-Guest Complexes

NASA Astrophysics Data System (ADS)

Carroy, Glenn; Lemaur, Vincent; Henoumont, Céline; Laurent, Sophie; De Winter, Julien; De Pauw, Edwin; Cornil, Jérôme; Gerbaux, Pascal

2018-01-01

Supramolecular mass spectrometry has emerged in the last decade as an orthogonal method to access, at the molecular level, the structures of noncovalent complexes extracted from the condensed phase to the rarefied gas phase using electrospray ionization. It is often considered that the soft nature of the ESI source confers to the method the capability to generate structural data comparable to those in the condensed phase. In the present paper, using the ammonium ion/cucurbituril combination as a model system, we investigate using ion mobility and computational chemistry the influence of the instrumental parameters on the topology, i.e., internal versus external association, of gaseous host/guest complex ions. MS and theoretical data are confronted to condensed phase data derived from nuclear magnetic resonance spectroscopy to assess whether the instrumental parameters can play an insidious role when trying to derive condensed phase data from mass spectrometry results. [Figure not available: see fulltext.

Sensory and instrumental texture measurements for assessing grape seed parameters during fruit development.

PubMed

Letaief, Hend; Maury, Chantal; Symoneaux, Ronan; Siret, René

2013-08-15

The evolution of the sensory and instrumental properties of grape seeds was investigated during berry development, with a focus on the effects of the harvest season and growing location. The sensory and instrumental texture analyses gave a consistent description of the ripening process. Moreover, the effect of maturation on the seed sensory descriptors was clearly influenced by the harvest season, and astringency was the most appropriate sensory attribute for the assessment of grape seed ripening. Except for seed cracking, which was positively correlated with fracturability (R = 0.69) and toughness (R = 0.68) in 2006, the compression parameters were generally not correlated with the sensory textural attributes but were more likely correlated with other sensory attributes such as astringency and vegetal aroma. The compression indices showed a logarithmic behaviour pattern during grape development, and seed stiffness was shown to be the most valuable textural index for parcel discrimination and identification of the optimal grape harvesting date. This research showed that both seed sensory attributes and instrumental texture properties are indicators of grape ripening. However, these properties could be affected by the harvest season and growing location. As no clear correlation was found between the seed sensory attributes and instrumental texture parameters, a revision of the sensory method available in the literature could be suggested. © 2013 Society of Chemical Industry.

Optimized fractional cloudiness determination from five ground-based remote sensing techniques

DOE Office of Scientific and Technical Information (OSTI.GOV)

Boers, R.; de Haij, M. J.; Wauben, W.M.F.

2010-12-23

A one-year record of fractional cloudiness at 10 minute intervals was generated for the Cabauw Experimental Site for Atmospheric Research [CESAR] (51°58’N, 4° 55’E) using an integrated assessment of five different observational methods. The five methods are based on active as well as passive systems and use either a hemispheric or column remote sensing technique. The one-year instrumental cloudiness data were compared against a 30 year climatology of Observer data in the vicinity of CESAR [1971- 2000]. In the intermediate 2 - 6 octa range, most instruments, but especially the column methods, report lower frequency of occurrence of cloudiness thanmore » the absolute minimum values from the 30 year Observer climatology. At night, the Observer records less clouds in the 1, 2 octa range than during the day, while the instruments registered more clouds. During daytime the Observer also records much more 7 octa cloudiness than the instruments. One column method combining a radar with a lidar outstrips all other techniques in recording cloudiness, even up to height in excess of 9 km. This is mostly due to the high sensitivity of the radar that is used in the technique. A reference algorithm was designed to derive a continuous and optimized record of fractional cloudiness. Output from individual instruments were weighted according to the cloud base height reported at the observation time; the larger the height, the lower the weight. The algorithm was able to provide fractional cloudiness observations every 10 minutes for 98% of the total period of 12 months [15 May 2008 - 14 May 2009].« less

Development of a radiology faculty appraisal instrument by using critical incident interviewing.

PubMed

Collins, J; Albanese, M A; Thakor, S K; Propeck, P A; Scanlan, K A

1997-12-01

To develop a valid and reliable radiology faculty appraisal instrument based on scientific methods. Fifteen radiology residents participated in critical incident interviewing. During a 1-hour interview, a resident was asked to describe five incidents each of effective and ineffective faculty behavior. Two investigators independently listened to the tape-recorded interviews, and two different investigators sorted the incidents into broad categories. A faculty appraisal instrument was developed by listing similar incidents under broad categories. A five-point rating scale was applied to each item. Content validity was assessed by resident and faculty critique of the appraisal instrument. A total of 168 incidents of faculty behavior were generated. The frequency with which similar incidents were reported was recorded. The most common behaviors reported were related to staff expertise and teaching. Interjudge reliability was good, as determined by computing K indices of agreement (overall K = 0.59). There was good agreement regarding instrument content validity among residents but not among faculty. Residents supported the use of the new appraisal instrument, but further tests of validity and reliability and faculty acceptance of the instrument will determine its usefulness as a tool for monitoring faculty teaching performance and making decisions regarding faculty promotion.

[Updating the problems of human ecology and environmental health and the ways of solving them].

PubMed

Rakhmanin, Iu A

2012-01-01

Displaying a variety of scientific areas studying the influence of the environment on human health, the state and modern issues of assessment of environmental quality, hygienic standardization of chemical and biological contamination, methodical support of sanitarian and health monitoring and risk assessment of pollution, environmental health, the need for improvement and harmonization with the international instruments of the legal and methodological framework for the protection of the human environment, of the development of a modern management system of her quality based on epidemiological methods for simulation, risk analysis, assessment of economic damage to the environment and health of the population, forming a new branch of medicine--medicine of environment.

Diagnosing Students' Understanding of the Nature of Models

NASA Astrophysics Data System (ADS)

Gogolin, Sarah; Krüger, Dirk

2017-10-01

Students' understanding of models in science has been subject to a number of investigations. The instruments the researchers used are suitable for educational research but, due to their complexity, cannot be employed directly by teachers. This article presents forced choice (FC) tasks, which, assembled as a diagnostic instrument, are supposed to measure students' understanding of the nature of models efficiently, while being sensitive enough to detect differences between individuals. In order to evaluate if the diagnostic instrument is suitable for its intended use, we propose an approach that complies with the demand to integrate students' responses to the tasks into the validation process. Evidence for validity was gathered based on relations to other variables and on students' response processes. Students' understanding of the nature of models was assessed using three methods: FC tasks, open-ended tasks and interviews ( N = 448). Furthermore, concurrent think-aloud protocols ( N = 30) were performed. The results suggest that the method and the age of the students have an effect on their understanding of the nature of models. A good understanding of the FC tasks as well as a convergence in the findings across the three methods was documented for grades eleven and twelve. This indicates that teachers can use the diagnostic instrument for an efficient and, at the same time, valid diagnosis for this group. Finally, the findings of this article may provide a possible explanation for alternative findings from previous studies as a result of specific methods that were used.

Multi-instrument assessment of physical activity in female office workers.

PubMed

Can, Sema; Gündüz, Nevin; Arslan, Erşan; Biernat, Elżbieta; Ersöz, Gülfem; Kilit, Bülent

2016-11-18

The aim of this study was to examine the multi-instrument assessment of physical activity in female office workers. Fifty healthy women (age (mean ± standard deviation): 34.8±5.9 years, body height: 158±0.4 cm, body weight: 61.8±7.5 kg, body mass index: 24.6±2.7 kg/m²) workers from the same workplace volunteered to participate in the study. Physical activity was measured with the 7-day Physical Activity Assessment Questionnaire (7-d PAAQ), an objective multi-sensor armband tool, and also a waist-mounted pedometer, which were both worn for 7 days. A significant correlation between step numbers measured by armband and pedometer was observed (r = 0.735), but the step numbers measured by these 2 methods were significantly different (10 941±2236 steps/ day and 9170±2377 steps/day, respectively; p < 0.001). There was a weak correlation between the value of 7-d PAAQ total energy expenditure and the value of armband total energy expenditure (r = 0.394, p = 0.005). However, total energy expenditure values measured by armband and 7-d PAAQ were not significantly different (2081±370 kcal/ day and 2084±197 kcal/day, respectively; p = 0.96). In addition, physical activity levels (average daily metabolic equivalents (MET)) measured by armband and 7-d PAAQ were not significantly different (1.45±0.12 MET/day and 1.47±0.24 MET/day, respectively; p = 0.44). The results of this study showed that the correlation between pedometer and armband measurements was higher than that between armband measurements and 7-d PAAQ selfreports. Our results suggest that none of the assessment methods examined here, 7-d PAAQ, pedometer, or armband, is sufficient when used as a single tool for physical activity level determination. Therefore, multi-instrument assessment methods are preferable. Int J Occup Med Environ Health 2016;29(6):937-945. This work is available in Open Access model and licensed under a CC BY-NC 3.0 PL license.

An integrated assessment instrument: Developing and validating instrument for facilitating critical thinking abilities and science process skills on electrolyte and nonelectrolyte solution matter

NASA Astrophysics Data System (ADS)

Astuti, Sri Rejeki Dwi; Suyanta, LFX, Endang Widjajanti; Rohaeti, Eli

2017-05-01

The demanding of assessment in learning process was impact by policy changes. Nowadays, assessment is not only emphasizing knowledge, but also skills and attitudes. However, in reality there are many obstacles in measuring them. This paper aimed to describe how to develop integrated assessment instrument and to verify instruments' validity such as content validity and construct validity. This instrument development used test development model by McIntire. Development process data was acquired based on development test step. Initial product was observed by three peer reviewer and six expert judgments (two subject matter experts, two evaluation experts and two chemistry teachers) to acquire content validity. This research involved 376 first grade students of two Senior High Schools in Bantul Regency to acquire construct validity. Content validity was analyzed used Aiken's formula. The verifying of construct validity was analyzed by exploratory factor analysis using SPSS ver 16.0. The result show that all constructs in integrated assessment instrument are asserted valid according to content validity and construct validity. Therefore, the integrated assessment instrument is suitable for measuring critical thinking abilities and science process skills of senior high school students on electrolyte solution matter.

Informal caregiving in COPD: A systematic review of instruments and their measurement properties.

PubMed

Cruz, Joana; Marques, Alda; Machado, Ana; O'Hoski, Sachi; Goldstein, Roger; Brooks, Dina

2017-07-01

Increasing symptoms and activity restriction associated with COPD progression greatly impact on the lives of their informal caregivers, who play a vital role in maintaining their health. An understanding of this impact is important for clinicians to support caregivers and maintain a viable patient environment at home. This systematic review aimed to identify the instruments commonly used to assess informal caregiving in COPD and describe their measurement properties in this population. Searches were conducted in PubMed, Scopus, Web of Science, CINAHL and PsycINFO and in references of key articles, until November 2016 (PROSPERO: CRD42016041401). Instruments used to assess the impact of COPD on caregivers were identified and their properties described. Quality of studies was rated using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Quality of the measurement properties of instruments was rated as 'positive', 'negative' or 'indeterminate'. Patients cared for, had moderate to very severe COPD and the sample of caregivers ranged from 24 to 406. Thirty-five instruments were used in fifty studies to assess caregivers' psychological status and mood (9 instruments), burden/distress (12 instruments), quality of life (5 instruments) or other (9 instruments). Eighteen studies assessed the measurement properties of 21 instruments, most commonly hypothesis testing (known validity) and internal consistency. Study quality varied from 'poor' to 'fair' and with many properties rated as 'indeterminate'. Although several instruments have been used to assess the impact of COPD on caregivers, an increased understanding of their properties is needed before their widespread implementation. Copyright © 2017 Elsevier Ltd. All rights reserved.

Career Assessment: Recently Developed Instruments Useful for School-to-Work Programs.

ERIC Educational Resources Information Center

Kapes, Jerome T.; Martinez, Linda

This document describes 32 recently developed career assessment instruments that have been deemed useful for school-to-work programs. The following instruments are among those profiled: Ability Explorer; Adult Measure of Essential Skills; Aptitude Interest Inventory; Ashland Interest Assessment; Barriers to Employment Success Inventory; Basic…

A Database Management Assessment Instrument

ERIC Educational Resources Information Center

Landry, Jeffrey P.; Pardue, J. Harold; Daigle, Roy; Longenecker, Herbert E., Jr.

2013-01-01

This paper describes an instrument designed for assessing learning outcomes in data management. In addition to assessment of student learning and ABET outcomes, we have also found the instrument to be effective for determining database placement of incoming information systems (IS) graduate students. Each of these three uses is discussed in this…

Early Childhood Assessment: Recommended Practices and Selected Instruments.

ERIC Educational Resources Information Center

Smith, Steven Lynn, Ed.; Rundall, Dick, Ed.

This manual, developed from an Early Childhood Institute on the Assessment of Young Children conducted in 1981, acquaints education and counseling professionals with a variety of assessment instruments for young handicapped children and assists them in understanding how to adapt instruments to a child's unique disability. Information to facilitate…

Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology.

ERIC Educational Resources Information Center

Cicchetti, Domenic V.

1994-01-01

In the context of developing assessment instruments in psychology, issues of standardization, norming procedures, and test reliability and validity are discussed. Criteria, guidelines, and rules of thumb are provided to help the clinician with instrument selection for a given psychological assessment. (SLD)

Black patients with binge-eating disorder: Comparison of different assessment methods.

PubMed

Lydecker, Janet A; White, Marney A; Grilo, Carlos M

2016-10-01

The Eating Disorder Examination (EDE) is a well-established assessment instrument, but requires substantial training and administration time. The Eating Disorder Examination Questionnaire (EDE-Q) is the corresponding self-report survey, which does not have these demands. Research has shown concordance between these 2 assessment methods, but samples have lacked racial diversity. The current study examined the concordance of the EDE-Q and EDE in a sample of Black patients with binge-eating disorder (BED) and a matched sample of White patients. Participants were 238 (Black n = 119, White n = 119) treatment-seeking adults with DSM-IV-TR-defined BED. Participants completed the EDE-Q, and trained doctoral-level clinicians assessed participants for BED and eating-disorder psychopathology using the Structured Clinical Interview for DSM-IV Disorders and the Eating Disorder Examination (EDE) interview. The EDE-Q and EDE yielded significantly correlated frequencies of binge eating and eating-disorder psychopathology subscales. The EDE-Q yielded significantly lower frequencies of binge eating and higher scores on 3 of 4 subscales (not dietary restraint). Similar patterns of concordance between the EDE-Q and EDE were found for an alternative brief version of the instruments. Patterns of convergence and divergence between the EDE-Q and EDE observed in Black patients with BED are generally consistent with findings derived from the matched White sample: overall, scores are correlated but higher on the self-report compared with interview assessment methods. Clinicians assessing patients with BED should be aware of this overall pattern, and be aware that this pattern is similar in Black patients with BED with the notable exception of dietary restraint. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

The design and analysis of channel transmission communication system of XCTD profiler

NASA Astrophysics Data System (ADS)

Zheng, Yu; Wang, Xiao-Rui; Jin, Xiang-Yu; Song, Guo-Min; Shang, Ying-Sheng; Li, Hong-Zhi

2016-10-01

In this paper, a channel transmission communication system of expendable conductivity-temperature-depth is established in accordance to the operation characteristics of the transmission line to more accurately assess the characteristics of deep-sea abandoned profiler channel. The wrapping inductance is eliminated to maximum extent through the wrapping pattern of the underwater spool and the overwater spool and the calculation of the wrapping diameter. The feasibility of the proposed channel transmission communication system is verified through theoretical analysis and practical measurement of the transmission signal error rate in the amplitude shift keying (ASK) modulation. The proposed design provides a new research method for the channel assessment of complex abandoned measuring instrument and an important experiment evidence for the rapid development of the deep-sea abandoned measuring instrument.

The design and analysis of channel transmission communication system of XCTD profiler.

PubMed

Zheng, Yu; Wang, Xiao-Rui; Jin, Xiang-Yu; Song, Guo-Min; Shang, Ying-Sheng; Li, Hong-Zhi

2016-10-01

In this paper, a channel transmission communication system of expendable conductivity-temperature-depth is established in accordance to the operation characteristics of the transmission line to more accurately assess the characteristics of deep-sea abandoned profiler channel. The wrapping inductance is eliminated to maximum extent through the wrapping pattern of the underwater spool and the overwater spool and the calculation of the wrapping diameter. The feasibility of the proposed channel transmission communication system is verified through theoretical analysis and practical measurement of the transmission signal error rate in the amplitude shift keying (ASK) modulation. The proposed design provides a new research method for the channel assessment of complex abandoned measuring instrument and an important experiment evidence for the rapid development of the deep-sea abandoned measuring instrument.

DSM-5 pathological personality traits and the personality assessment inventory.

PubMed

Hopwood, Christopher J; Wright, Aidan G C; Krueger, Robert F; Schade, Nick; Markon, Kristian E; Morey, Leslie C

2013-06-01

Section 3 of the DSM-5 will include a pathological personality trait system rooted in the quantitative epistemology of personality and clinical psychology. This system has the potential to enhance the clinical utility of the diagnostic nosology by providing a means for the dimensional assessment of individuals with psychopathology. However, there is limited research on the associations of DSM-5 traits with common mental disorders and related clinical phenomena as measured by currently popular assessment instruments. The purpose of this article was to evaluate the convergence of the DSM-5 trait system with a well-validated broadband clinical instrument, the Personality Assessment Inventory (PAI). Bivariate correlations were examined and factor analytic methods were used to examine the degree to which the DSM-5 traits and PAI capture common variance in personality and mental health. In a student sample (N = 1,001), we found broad convergence between the DSM-5 traits and PAI, which could be organized effectively using five factors. The implications of these findings for using traits to address issues related to diagnostic co-occurrence and heterogeneity in routine clinical assessment are discussed.

Development of a monitoring instrument to assess the performance of the Swiss primary care system.

PubMed

Ebert, Sonja T; Pittet, Valérie; Cornuz, Jacques; Senn, Nicolas

2017-11-29

The Swiss health system is customer-driven with fee-for-service paiement scheme and universal coverage. It is highly performing but expensive and health information systems are scarcely implemented. The Swiss Primary Care Active Monitoring (SPAM) program aims to develop an instrument able to describe the performance and effectiveness of the Swiss PC system. Based on a Literature review we developed a conceptual framework and selected indicators according to their ability to reflect the Swiss PC system. A two round modified RAND method with 24 inter-/national experts took place to select primary/secondary indicators (validity, clarity, agreement). A limited set of priority indicators was selected (importance, priority) in a third round. A conceptual framework covering three domains (structure, process, outcome) subdivided into twelve sections (funding, access, organisation/ workflow of resources, (Para-)Medical training, management of knowledge, clinical-/interpersonal care, health status, satisfaction of PC providers/ consumers, equity) was generated. 365 indicators were pre-selected and 335 were finally retained. 56 were kept as priority indicators.- Among the remaining, 199 were identified as primary and 80 as secondary indicators. All domains and sections are represented. The development of the SPAM program allowed the construction of a consensual instrument in a traditionally unregulated health system through a modified RAND method. The selected 56 priority indicators render the SPAM instrument a comprehensive tool supporting a better understanding of the Swiss PC system's performance and effectiveness as well as in identifying potential ways to improve quality of care. Further challenges will be to update indicators regularly and to assess validity and sensitivity-to-change over time.

Pressure ulcer risk assessment and prevention: a systematic comparative effectiveness review.

PubMed

Chou, Roger; Dana, Tracy; Bougatsos, Christina; Blazina, Ian; Starmer, Amy J; Reitel, Katie; Buckley, David I

2013-07-02

Pressure ulcers are associated with substantial health burdens but may be preventable. To review the clinical utility of pressure ulcer risk assessment instruments and the comparative effectiveness of preventive interventions in persons at higher risk. MEDLINE (1946 through November 2012), CINAHL, the Cochrane Library, grant databases, clinical trial registries, and reference lists. Randomized trials and observational studies on effects of using risk assessment on clinical outcomes and randomized trials of preventive interventions on clinical outcomes. Multiple investigators abstracted and checked study details and quality using predefined criteria. One good-quality trial found no evidence that use of a pressure ulcer risk assessment instrument, with or without a protocolized intervention strategy based on assessed risk, reduces risk for incident pressure ulcers compared with less standardized risk assessment based on nurses' clinical judgment. In higher-risk populations, 1 good-quality and 4 fair-quality randomized trials found that more advanced static support surfaces were associated with lower risk for pressure ulcers compared with standard mattresses (relative risk range, 0.20 to 0.60). Evidence on the effectiveness of low-air-loss and alternating-air mattresses was limited, with some trials showing no clear differences from advanced static support surfaces. Evidence on the effectiveness of nutritional supplementation, repositioning, and skin care interventions versus usual care was limited and had methodological shortcomings, precluding strong conclusions. Only English-language articles were included, publication bias could not be formally assessed, and most studies had methodological shortcomings. More advanced static support surfaces are more effective than standard mattresses for preventing ulcers in higher-risk populations. The effectiveness of formal risk assessment instruments and associated intervention protocols compared with less standardized assessment methods and the effectiveness of other preventive interventions compared with usual care have not been clearly established.

In vitro evaluation of efficacy of different rotary instrument systems for gutta percha removal during root canal retreatment

PubMed Central

Joseph, Mercy; Malhotra, Amit; Rao, Murali; Sharma, Abhimanyu; Talwar, Sangeeta

2016-01-01

Background Complete removal of old filling material during root canal retreatment is fundamental for predictable cleaning and shaping of canal anatomy. Most of the retreatment methods tested in earlier studies have shown inability to achieve complete removal of root canal filling. Therefore the aim of this investigation was to assess the efficacy of three different rotary nickel titanium retreatment systems and Hedstrom files in removing filling material from root canals. Material and Methods Sixty extracted mandibular premolars were decoronated to leave 15 mm root. Specimen were hand instrumented and obturated using gutta percha and AH plus root canal sealer. After storage period of two weeks, roots were retreated with three (Protaper retreatment files, Mtwo retreatment files, NRT GPR) rotary retreatment instrument systems and Hedstroem files. Subsequently, samples were sectioned longitudinally and examined under stereomicroscope. Digital images were recorded and evaluated using Digital Image Analysing Software. The retreatment time was recorded for each tooth using a stopwatch. The area of canal and the residual filling material was recorded in mm2 and the percentage of remaining filling material on canal walls was calculated. Data was analysed using ANOVA test. Results Significantly less amount of residual filling material was present in protaper and Mtwo instrumented teeth (p < 0.05) compared to NRT GPR and Hedstrom files group. Protaper instruments also required lesser time during removal of filling material followed by Mtwo instruments, NRT GPR files and Hedstrom files. Conclusions None of the instruments were able to remove the filling material completely from root canal. Protaper universal retreatment system and Mtwo retreatment files were more efficient and faster compared to NRT GPR fles and Hedstrom files. Key words:Gutta-percha removal, nickel titanium, root canal retreatment, rotary instruments. PMID:27703601

Format Effects of Empirically Derived Multiple-Choice versus Free-Response Instruments When Assessing Graphing Abilities

ERIC Educational Resources Information Center

Berg, Craig; Boote, Stacy

2017-01-01

Prior graphing research has demonstrated that clinical interviews and free-response instruments produce very different results than multiple-choice instruments, indicating potential validity problems when using multiple-choice instruments to assess graphing skills (Berg & Smith in "Science Education," 78(6), 527-554, 1994). Extending…

Assessing Mentoring in Organizations: An Evaluation of Commercial Mentoring Instruments

ERIC Educational Resources Information Center

Gilbreath, Brad; Rose, Gail L.; Dietrich, Kim E.

2008-01-01

The purpose of this article is to inform readers about the types of instruments available for assessing and improving mentoring in organizations. Extensive review of the psychological, business and medical literature was conducted to identify commercially published, practitioner-oriented instruments. All of the instruments that were…

Development of student performance assessment based on scientific approach for a basic physics practicum in simple harmonic motion materials

NASA Astrophysics Data System (ADS)

Serevina, V.; Muliyati, D.

2018-05-01

This research aims to develop students’ performance assessment instrument based on scientific approach is valid and reliable in assessing the performance of students on basic physics lab of Simple Harmonic Motion (SHM). This study uses the ADDIE consisting of stages: Analyze, Design, Development, Implementation, and Evaluation. The student performance assessment developed can be used to measure students’ skills in observing, asking, conducting experiments, associating and communicate experimental results that are the ‘5M’ stages in a scientific approach. Each grain of assessment in the instrument is validated by the instrument expert and the evaluation with the result of all points of assessment shall be eligible to be used with a 100% eligibility percentage. The instrument is then tested for the quality of construction, material, and language by panel (lecturer) with the result: 85% or very good instrument construction aspect, material aspect 87.5% or very good, and language aspect 83% or very good. For small group trial obtained instrument reliability level of 0.878 or is in the high category, where r-table is 0.707. For large group trial obtained instrument reliability level of 0.889 or is in the high category, where r-table is 0.320. Instruments declared valid and reliable for 5% significance level. Based on the result of this research, it can be concluded that the student performance appraisal instrument based on the developed scientific approach is declared valid and reliable to be used in assessing student skill in SHM experimental activity.

Oropharyngeal dysphagia: surveying practice patterns of the speech-language pathologist.

PubMed

Martino, Rosemary; Pron, Gaylene; Diamant, Nicholas E

2004-01-01

The present study was designed to obtain a comprehensive view of the dysphagia assessment practice patterns of speech-language pathologists and their opinion on the importance of these practices using survey methods and taking into consideration clinician, patient, and practice-setting variables. A self-administered mail questionnaire was developed following established methodology to maximize response rates. Eight dysphagia experts independently rated the new survey for content validity. Test-retest reliability was assessed with a random sample of 23 participants. The survey was sent to 50 speech-language pathologists randomly selected from the Canadian professional association database of members who practice in dysphagia. Surveys were mailed according to the Dillman Total Design Method and included an incentive offer. High survey (64%) and item response (95%) rates were achieved and clinicians were reliable reporters of their practice behaviors (ICC>0.60). Of all the clinical assessment items, 36% were reported with high (>80%) utilization and 24% with low (<20%) utilization, the former pertaining to tongue motion and vocal quality after food/fluid intake and the latter to testing of oral sensation without food. One-third (33%) of instrumental assessment items were highly utilized and included assessment of bolus movement and laryngeal response to bolus misdirection. Overall, clinician experience and teaching institutions influenced greater utilization. Opinions of importance were similar to utilization behaviors (r = 0.947, p = 0.01). Of all patients referred for dysphagia assessment, full clinical assessments were administered to 71% of patients but instrumental assessments to only 36%. A hierarchical model of practice behavior is proposed to explain this pattern of progressively decreasing item utilization.

Emerging Methods and Systems for Observing Life in the Sea

NASA Astrophysics Data System (ADS)

Chavez, F.; Pearlman, J.; Simmons, S. E.

2016-12-01

There is a growing need for observations of life in the sea at time and space scales consistent with those made for physical and chemical parameters. International programs such as the Global Ocean Observing System (GOOS) and Marine Biodiversity Observation Networks (MBON) are making the case for expanded biological observations and working diligently to prioritize essential variables. Here we review past, present and emerging systems and methods for observing life in the sea from the perspective of maintaining continuous observations over long time periods. Methods that rely on ships with instrumentation and over-the-side sample collections will need to be supplemented and eventually replaced with those based from autonomous platforms. Ship-based optical and acoustic instruments are being reduced in size and power for deployment on moorings and autonomous vehicles. In parallel a new generation of low power, improved resolution sensors are being developed. Animal bio-logging is evolving with new, smaller and more sophisticated tags being developed. New genomic methods, capable of assessing multiple trophic levels from a single water sample, are emerging. Autonomous devices for genomic sample collection are being miniaturized and adapted to autonomous vehicles. The required processing schemes and methods for these emerging data collections are being developed in parallel with the instrumentation. An evolving challenge will be the integration of information from these disparate methods given that each provides their own unique view of life in the sea.

Exploring approaches to dietetic assessment of a common task across different universities through assessment moderation.

PubMed

Palermo, C; Volders, E; Gibson, S; Kennedy, M; Wray, A; Thomas, J; Hannan-Jones, M; Gallegos, D; Beck, E

2018-02-01

Assessment presents one of the greatest challenges to evaluating health professional trainee performance, as a result of the subjectivity of judgements and variability in assessor standards. The present study aimed to test a moderation procedure for assessment across four independent universities and explore approaches to assessment and the factors that influence assessment decisions. Assessment tasks designed independently by each of the four universities to assess student readiness for placement were chosen for the present study. Each university provided four student performance recordings for moderation. Eight different academic assessors viewed the student performances and assessed them using the corresponding university assessment instrument. Assessment results were collated and presented back to the assessors, together with the original university assessment results. Results were discussed with assessors to explore variations. The discussion was recorded, transcribed, thematically analysed and presented back to all assessors to achieve consensus on the emerging major learnings. Although there were differences in absolute scores, there was consistency (12 out of 16 performances) in overall judgement decisions regarding placement readiness. Proficient communication skills were considered a key factor when determining placement readiness. The discussion revealed: (i) assessment instruments; (ii) assessor factors; and (iii) the subjectivity of judgement as the major factors influencing assessment. Assessment moderation is a useful method for improving the quality of assessment decisions by sharing understanding and aligning standards of performance. © 2017 The British Dietetic Association Ltd.

Determination of serum aluminum by electrothermal atomic absorption spectrometry: A comparison between Zeeman and continuum background correction systems

NASA Astrophysics Data System (ADS)

Kruger, Pamela C.; Parsons, Patrick J.

2007-03-01

Excessive exposure to aluminum (Al) can produce serious health consequences in people with impaired renal function, especially those undergoing hemodialysis. Al can accumulate in the brain and in bone, causing dialysis-related encephalopathy and renal osteodystrophy. Thus, dialysis patients are routinely monitored for Al overload, through measurement of their serum Al. Electrothermal atomic absorption spectrometry (ETAAS) is widely used for serum Al determination. Here, we assess the analytical performances of three ETAAS instruments, equipped with different background correction systems and heating arrangements, for the determination of serum Al. Specifically, we compare (1) a Perkin Elmer (PE) Model 3110 AAS, equipped with a longitudinally (end) heated graphite atomizer (HGA) and continuum-source (deuterium) background correction, with (2) a PE Model 4100ZL AAS equipped with a transversely heated graphite atomizer (THGA) and longitudinal Zeeman background correction, and (3) a PE Model Z5100 AAS equipped with a HGA and transverse Zeeman background correction. We were able to transfer the method for serum Al previously established for the Z5100 and 4100ZL instruments to the 3110, with only minor modifications. As with the Zeeman instruments, matrix-matched calibration was not required for the 3110 and, thus, aqueous calibration standards were used. However, the 309.3-nm line was chosen for analysis on the 3110 due to failure of the continuum background correction system at the 396.2-nm line. A small, seemingly insignificant overcorrection error was observed in the background channel on the 3110 instrument at the 309.3-nm line. On the 4100ZL, signal oscillation was observed in the atomization profile. The sensitivity, or characteristic mass ( m0), for Al at the 309.3-nm line on the 3110 AAS was found to be 12.1 ± 0.6 pg, compared to 16.1 ± 0.7 pg for the Z5100, and 23.3 ± 1.3 pg for the 4100ZL at the 396.2-nm line. However, the instrumental detection limits (3 SD) for Al were very similar: 3.0, 3.2, and 4.1 μg L - 1 for the Z5100, 4100ZL, and 3110, respectively. Serum Al method detection limits (3 SD) were 9.8, 6.9, and 7.3 μg L - 1 , respectively. Accuracy was assessed using archived serum (and plasma) reference materials from various external quality assessment schemes (EQAS). Values found with all three instruments were within the acceptable EQAS ranges. The data indicate that relatively modest ETAAS instrumentation equipped with continuum background correction is adequate for routine serum Al monitoring.

Field Assessment of Enclosed Cab Filtration System Performance Using Particle Counting Measurements

PubMed Central

Organiscak, John A.; Cecala, Andrew B.; Noll, James D.

2015-01-01

Enclosed cab filtration systems are typically used on mobile mining equipment to reduce miners’ exposure to airborne dust generated during mining operations. The National Institute for Occupational Safety and Health (NIOSH) Office of Mine Safety and Health Research (OMSHR) has recently worked with a mining equipment manufacturer to examine a new cab filtration system design for underground industrial minerals equipment. This cab filtration system uses a combination of three particulate filters to reduce equipment operators’ exposure to dust and diesel particulates present in underground industrial mineral mines. NIOSH initially examined this cab filtration system using a two-instrument particle counting method at the equipment company’s manufacturing shop facility to assess several alternative filters. This cab filtration system design was further studied on several pieces of equipment during a two- to seven-month period at two underground limestone mines. The two-instrument particle counting method was used outside the underground mine at the end of the production shifts to regularly test the cabs’ long-term protection factor performance with particulates present in the ambient air. This particle counting method showed that three of the four cabs achieved protection factors greater than 1,000 during the field studies. The fourth cab did not perform at this level because it had a damaged filter in the system. The particle counting measurements of submicron particles present in the ambient air were shown to be a timely and useful quantification method in assessing cab performance during these field studies. PMID:23915268

Measurement properties of instruments evaluating self-care and related concepts in people with chronic obstructive pulmonary disease: A systematic review.

PubMed

Clari, Marco; Matarese, Maria; Alvaro, Rosaria; Piredda, Michela; De Marinis, Maria Grazia

2016-01-01

The use of valid and reliable instruments for assessing self-care is crucial for the evaluation of chronic obstructive pulmonary disease (COPD) management programs. The aim of this review is to evaluate the measurement properties and theoretical foundations of instruments for assessing self-care and related concepts in people with COPD. A systematic review was conducted of articles describing the development and validation of self-care instruments. The methodological quality of the measurement properties was assessed using the COSMIN checklist. Ten studies were included evaluating five instruments: three for assessing self-care and self-management and two for assessing self-efficacy. The COPD Self-Efficacy Scale was the most studied instrument, but due to poor study methodological quality, evidence about its measurement properties is inconclusive. Evidence from the COPD Self-Management Scale is more promising, but only one study tested its properties. Due to inconclusive evidence of their measurement properties, no instrument can be recommended for clinical use. Copyright © 2016 Elsevier Inc. All rights reserved.

Outcomes of Posterolateral Fusion with and without Instrumentation and of Interbody Fusion for Isthmic Spondylolisthesis: A Prospective Study.

PubMed

Endler, Peter; Ekman, Per; Möller, Hans; Gerdhem, Paul

2017-05-03

Various methods for the treatment of isthmic spondylolisthesis are available. The aim of this study was to compare outcomes after posterolateral fusion without instrumentation, posterolateral fusion with instrumentation, and interbody fusion. The Swedish Spine Register was used to identify 765 patients who had been operated on for isthmic spondylolisthesis and had at least preoperative and 2-year outcome data; 586 of them had longer follow-up (a mean of 6.9 years). The outcome measures were a global assessment of leg and back pain, the Oswestry Disability Index (ODI), the EuroQol-5 Dimensions (EQ-5D) Questionnaire, the Short Form-36 (SF-36), a visual analog scale (VAS) for back and leg pain, and satisfaction with treatment. Data on additional lumbar spine surgery was searched for in the register, with the mean duration of follow-up for this variable being 10.6 years after the index procedure. Statistical analyses were performed with analysis of covariance or competing-risks proportional hazards regression, adjusted for baseline differences in the studied variables, smoking, employment status, and level of fusion. Posterolateral fusion without instrumentation was performed in 102 patients; posterolateral fusion with instrumentation, in 452; and interbody fusion, in 211. At 1 year, improvement was reported in the global assessment for back pain by 54% of the patients who had posterolateral fusion without instrumentation, 68% of those treated with posterolateral fusion with instrumentation, and 70% of those treated with interbody fusion (p = 0.009). The VAS for back pain and reported satisfaction with treatment showed similar patterns (p = 0.003 and p = 0.017, respectively), whereas other outcomes did not differ among the treatment groups at 1 year. At 2 years, the global assessment for back pain indicated improvement in 57% of the patients who had undergone posterolateral fusion without instrumentation, 70% of those who had posterolateral fusion with instrumentation, and 71% of those treated with interbody fusion (p = 0.022). There were no significant outcome differences at the mean 6.9-year follow-up interval. There was an increased hazard ratio for additional lumbar spine surgery after interbody fusion (4.34; 95% confidence interval [CI] = 1.71 to 11.03) and posterolateral fusion with instrumentation (2.56; 95% CI = 1.02 to 6.42) compared with after posterolateral fusion without instrumentation (1.00; reference). Fusion with instrumentation, with or without interbody fusion, was associated with more improvement in back pain scores and higher satisfaction with treatment compared with fusion without instrumentation at 1 year, but the difference was attenuated with longer follow-up. Fusion with instrumentation was associated with a significantly higher risk of additional spine surgery. Therapeutic Level III. See Instructions for Authors for a complete description of levels of evidence.

Determination of Ammonia in Household Cleaners: An Instrumental Analysis Experiment.

ERIC Educational Resources Information Center

Graham, Richard C.; DePew, Steven

1983-01-01

Briefly discusses three techniques for assessing amount of ammonia present in household cleaners. Because of disadvantages with these methods, the thermometric titration technique is suggested in which students judge the best buy based on relative cost of ammonia present in samples. Laboratory procedures, typical results, and reactions involved…

Comparison of NIR and FT-IR spectral models in the prediction of cotton fiber strength

USDA-ARS?s Scientific Manuscript database

Strength quality in cotton fibers is one of several important end-use characteristics. In routine programs, it has been mostly assessed by automation-oriented high volume instrument (HVI) system. An alternative method for cotton strength is near infrared (NIR) spectroscopy. Although previous NIR mod...

An Informatics Approach to Establishing a Sustainable Public Health Community

ERIC Educational Resources Information Center

Kriseman, Jeffrey Michael

2012-01-01

This work involved the analysis of a public health system, and the design, development and deployment of enterprise informatics architecture, and sustainable community methods to address problems with the current public health system. Specifically, assessment of the Nationally Notifiable Disease Surveillance System (NNDSS) was instrumental in…

Exploring the Need for Web-Based Training among School Nutrition Directors

ERIC Educational Resources Information Center

Zoellner, Jamie; Carr, Deborah

2008-01-01

Objectives: Web-based training (WBT) has the potential to meet the diverse learning needs of school nutrition directors (SNDs). The overall objective of this needs assessment targeting SNDs was to explore their needs and interests in utilizing WBT. Methods: Researchers developed and administered two instruments: 1) a qualitative…